Lead Engineer
Current• Perform analysis for converting the Automic workflows executing on On-Premises Hadoop to Airflow DAGs on GCP Hadoop• Analyzing business requirements, source systems, submitting technical solution in tune with business requirements• Writing complex SQL Queries using Joins, Sub-queries & Correlated Sub-Queries to retrieve data from the database as per requirements• Building scalable Big data system using Big data technologies like GCP, ADF, Airflow, Hive, Sqoop and Spark• Imparting on-the-job training to junior team members or new joiners to enhance their skills