Maintained data pipelines while ingesting data across different data sources using Spark, S3, Airflow, Python and Databricks.Automated ETL process to load data into Auroradb table using Databricks.Improving the already build pipelines as per the client needs.Providing fixes if any production job fails.Develop algorithms to transform data into useful, actionable information.Build, test, and maintain database pipeline architectures.

Analyze production issues to determine root cause andprovides fix recommendations to the team.Create track solutions to application errors reported .Worked with Relational Databases (RDBMS) like MySQL.Worked as a Python developer with Robotics team.