Satvik . Email & Phone Number

Noida, Uttar Pradesh, India

• Working on migrating the client's Hadoop big data infrastructure to Cloud.
• Creating 800+ ELT pipelines in Python on Apache Airflow.
• Consuming data from various sources such as FTP/SFTP, SAP, Google BQ, Salesforce, Veeva Vault, etc. and ingesting it in Snowflake tables.
• Performing transformations using SQL and creating DBT models.
• Creating Snowflake UDF/UDTF, DBT macros for minor data manipulations.
• Performing complex transformations and manipulations using Spark on EMR.

Noida, Uttar Pradesh, India

Worked on migrating client's big data infrastructure from on premises to GCP.Building and supporting java, python and scala based big data applications.Worked on batch and streaming jobs using Apache Spark/Pyspark, Kafka, Storm and Flink.Created bash and python scripts.Modified HQLs and pig scripts to run on GCP.Scheduling jobs using Apache Oozie, using.