Satvik . Email & Phone Number

Noida, Uttar Pradesh, India

Working on migrating the client's Hadoop big data infrastructure to Cloud. ● Creating 800+ ELT pipelines in Python on Apache Airflow. ● Consuming data from various sources such as FTP/SFTP, SAP, Google BQ, Salesforce, Veeva Vault, etc. and ingesting it in Snowflake tables. ● Performing transformations using SQL and creating DBT models. ● Creating Snowflake UDF/UDTF, DBT macros for minor data manipulations. ● Performing complex transformations and manipulations using Spark on EMR.

Noida, Uttar Pradesh, India

Worked on migrating client's big data infrastructure from on premises to GCP.Building and supporting java, python and scala based big data applications.Worked on batch and streaming jobs using Apache Spark/Pyspark, Kafka, Storm and Flink.Created bash and python scripts.Modified HQLs and pig scripts to run on GCP.Scheduling jobs using Apache Oozie, using Hive as warehouse and worked on migrating and optimizing legacy Pig jobs. Used GCP services like Dataproc for executing jobs, Google cloud storage, Big Query, Cloud logging.Created log based alerts to notify if data does not reach a particular destination within stipulated time and job failures.