Data Engineer
Current1- ETL design and implementation using Apache Spark,Hadoop based stack.Processing large sets of structured, semi-structured and unstructured data and supporting application architecture with Hadoop.2- Part of a team that designed a Data Migration Utility, an ETL Tool for migrating data from Oracle RDS to HDFS , that gave an end-to-end solution for loading data from RDS into HDFS by extracting data using Sqoop, transforming the data with Apache Spark, and loading it into Hive… Show more 1- ETL design and implementation using Apache Spark,Hadoop based stack.Processing large sets of structured, semi-structured and unstructured data and supporting application architecture with Hadoop.2- Part of a team that designed a Data Migration Utility, an ETL Tool for migrating data from Oracle RDS to HDFS , that gave an end-to-end solution for loading data from RDS into HDFS by extracting data using Sqoop, transforming the data with Apache Spark, and loading it into Hive. Technologies Used: Python, Oracle RDS, HDFS, Sqoop, Spark, Hive, Tableau, Bash/Unix scripts,3- Utilized Tableau to design impactful dashboards and implement data-driven analytic solutions. Show less