Participated in Business meetings, understood the requirements.•Participate in requirement gathering and documenting the business requirements by conducting grooming sessions/meetings with various business users.•Involved in creating Hive tables and written multiple Hive queries to load the hive tables for analyzing the market data coming from distinct sources. •Created extensive SQL queries for data extraction to test the data against the various databases.•Responsible for importing data to HDFS using Sqoop from different RDBMS servers and exporting data using Sqoop to the RDBMS servers after aggregations for other ETL operations. •Created Partitioning, Bucketing, Map side Join, Parallel execution for optimizing the hive queries. •Developed Simple to complex Map Reduce Jobs using Hive.•Involved in generating analytics data using Map/Reduce programs written in Python.•Extracted and loaded CSV files, Json files data from AWS S3 to Snowflake Cloud Data Warehouse.•Worked on Spark SQL and Data frames for faster execution of Hive queries using Spark SQL Context. •Worked on Cloudera distribution and deployed on AWS EC2 Instances.

•Understanding and analyzing the application related documents and Preparing Mapping for Source and Target accordingly. •Created various Documents such as Proof of concept document for data stage.•Involved in preparing CMC Data Load Build Process based on High level document.•Developed Data stage jobs by using various stages to load data from Flat Files(Source systems) to Target Databases using IBM Datastage.•DataStage Designer was utilized for developing Transformation logics using stages, which includes Transformer, Join, Lookup, Funnel, Filter, Dataset, Copy, and Aggregator Stage.•Used DataStage Director for monitoring and validating its components.•Importing and Exporting DataStage jobs.•Involved in preparing Test Cases and executing them.

Supported BI Application for GERMANY• Monitoring the Data Stage jobs through Control-M.• Verification & Validation of data from source to target.• Captured job Statistics, Record counts in a Spread sheet and shared the results.