Data Engineer
CurrentImplemented solutions for ingesting data from SQL sources and processing/storing the data by utilizing Big Data Technologies such as HDFS, Hive, Sqoop etc. Extensively worked with Partitions, Dynamic Partitioning and Bucketing tables in Hive and designed both Managed and External tables and also worked on optimization of Hive queries. Wrote Hive Queries to have a consolidated view of the provider data and Involved in troubleshooting errors in Hive scripts. Solved performance issues in Hive scripts with understanding of Joins, Group and Aggregation. Used Sqoop to import data from SQL server DB to Hive in HDFS. Exported the analyzed data to the relational databases using Sqoop to generate business reports. Actively participated in Data Migration Projects working closely with business users and stakeholders. Engaged in developing of mapping documents used for the development and designing of reports.