Amit J Email & Phone Number

Dedicated IT professional with 10+ years of consulting experience as a Lead Cloud Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem, Big Data Analytical, Cloud Data engineering, Data Warehouse / Data Mart, Data Visualization, Reporting, and Data Quality solutions with a Master of Science Degree in Software Engineering. Possess extensive experience in data migration, project management, strategic planning and proficiency in leading multiple teams in order to deliver projects on time with accurate results.Here are some noteworthy achievements from my career:• Engineered resilient frameworks for data processing, harnessing the power of Airflow, Snowflake, Python, Jinja2 Templates, Jenkins, and GitHub.• Currently excelling as an AWS Cloud Data Engineer, demonstrating expertise in AWS cloud technologies.• Developed ETL solutions, translating complex business requirements into efficient data pipelines.• Skilled in writing SQL and procedural scripts customized to meet business requirements, with a specific focus on Snowflake environments.• Migrated ~4Billion install base data from Oracle to Elastic search.• Migrated ~1Billion Customer service data from Oracle to Snowflake using Airflow and Python.• Designed and Developed a monitoring solution leveraging AWS Cloud Watch to oversee and track ETL (Extract, Transform, Load) job performance for data freshness, data loss and status.• Designed and implemented distributed systems using Airflow, Kafka, and Snowflake for continuous data ingestion.• Worked with various database systems, including Snowflake, Oracle, Mongo, Cassandra, and Postgres.• Demonstrated extensive expertise in Snowflake, including data warehouse and data lake design and maintenance.• Expertise in designing the inbound and outbound interfaces in Oracle E-Business across the application.• Proficient in Python and Scala programming languages for Apache Spark, adeptly utilizing Data Frame coding in both Python and Scala to construct robust data and ETL pipelines.• Expertise in projects involving Oracle Applications 11i E-Business Suite/R12 Applications, particularly focusing on modules such as MDM (Master Data Management) and TCA (Trading Community Architecture).• Expertise in data modeling, governance, validations, auditing, and data warehouse design.• Worked as a Team Lead managing offshore/onsite teams, working closely with IT Managers and Directors, track the project deliverables and working closely with the IT Mangers/Directors