Supported code/design analysis, strategy development and project planning.● Developed multiple MapReduce jobs in Java for data cleaning and preprocessing.● Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.● Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.● Provided design recommendations and thought leadership to sponsors/stakeholders that improved reviewprocesses and resolved technical problems● Doing transformation using spark.● Managed and reviewed Hadoop log files.● Tested raw data and executed performance scripts.