Dedicated IT professional with 10+ years of consulting experience as a Lead Cloud Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem, Big Data Analytical, Cloud Data engineering, Data Warehouse / Data Mart, Data Visualization, Reporting, and Data Quality solutions with a Master of Science Degree in Software Engineering. Possess extensive experience in data migration, project management, strategic planning and proficiency in leading multiple teams in order to deliver projects on time with accurate results.Here are some noteworthy achievements from my career:• Engineered resilient frameworks for data processing, harnessing the power of Airflow, Snowflake, Python, Jinja2 Templates, Jenkins, and GitHub.• Currently excelling as an AWS Cloud Data Engineer, demonstrating expertise in AWS cloud technologies.• Developed ETL solutions, translating complex business requirements into efficient data pipelines.• Skilled in writing SQL and procedural scripts customized to meet business requirements, with a specific focus on Snowflake environments.• Migrated ~4Billion install base data from Oracle to Elastic search.• Migrated ~1Billion Customer service data from Oracle to Snowflake using Airflow and Python.• Designed and Developed a monitoring solution leveraging AWS Cloud Watch to oversee and track ETL (Extract, Transform, Load) job performance for data freshness, data loss and status.• Designed and implemented distributed systems using Airflow, Kafka, and Snowflake for continuous data ingestion.• Worked with various database systems, including Snowflake, Oracle, Mongo, Cassandra, and Postgres.• Demonstrated extensive expertise in Snowflake, including data warehouse and data lake design and maintenance.• Expertise in designing the inbound and outbound interfaces in Oracle E-Business across the application.• Proficient in Python and Scala programming languages for Apache Spark, adeptly utilizing Data Frame coding in both Python and Scala to construct robust data and ETL pipelines.• Expertise in projects involving Oracle Applications 11i E-Business Suite/R12 Applications, particularly focusing on modules such as MDM (Master Data Management) and TCA (Trading Community Architecture).• Expertise in data modeling, governance, validations, auditing, and data warehouse design.• Worked as a Team Lead managing offshore/onsite teams, working closely with IT Managers and Directors, track the project deliverables and working closely with the IT Mangers/Directors
-
Lead Aws Data EngineerFisJersey City, Nj, Us -
Lead Aws Data EngineerFannie Mae Jul 2021 - PresentPhiladelphia, Pennsylvania, United StatesLed the design and implementation of a migration strategy to move Mainframe data to the AWS cloud platform.Architected and deployed a scalable real-time data platform using AWS Stack (S3, Glue, Lambda, RDS) which enhanced business decision-making capability by 30%. -
Sr Aws Data EngineerCvs Health Jul 2020 - Jun 2021Northbrook, Illinois, United States -
Aws Data EngineerEbay Jul 2018 - Jun 2020San Jose, California, United States -
Data EngineerThe Walt Disney Company Jan 2017 - Jun 2018Burbank, California, United States -
Data EngineerSonata Software Jan 2013 - Jun 2016Bengaluru, Karnataka, India
Frequently Asked Questions about Amit J
What company does Amit J work for?
Amit J works for Fis
What is Amit J's role at the current company?
Amit J's current role is Lead AWS Data engineer.
Who are Amit J's colleagues?
Amit J's colleagues are Rahul Tiwari, Jyotirmayee Shaw, Jorge Gomez, Tainá Carvalho, Azeeza Ibrahim, Mba, Christopher Salazar, Shivani Jadhav.
Not the Amit J you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial