Amandeep Singh Email and Phone Number

• Developed SQL Driven framework to autogenerate multiple orchestration jobs for different objects and code• Improving the Spark jobs performance by tunning configurations and Custom SCD logic, resulting in reduction of Data Load time by 60%• Take a lead role in designing and building data architecture while influencing the strategic direction of the Data Engineering roadmap for business support along with Data governance.• Designed and Developed Delta Sense algorithm in existing… Show more • Developed SQL Driven framework to autogenerate multiple orchestration jobs for different objects and code• Improving the Spark jobs performance by tunning configurations and Custom SCD logic, resulting in reduction of Data Load time by 60%• Take a lead role in designing and building data architecture while influencing the strategic direction of the Data Engineering roadmap for business support along with Data governance.• Designed and Developed Delta Sense algorithm in existing system which results in time saving as well cost saving of infrastructure.• Assess the end-to-end data designs, meticulously examining their strengths and weaknesses, including factors such as data quality, scalability, performance, and data integrity.• Lead and participate in POCs with Client for better futuristic/upgrade solutions or migration in the system.• Establish and clearly communicate organisational vision, goals and success measures to business stakeholders.• Contribute to the growth of the team by nurturing and mentoring new team members and fresh recruits, sharing knowledge and expertise.• Provide regular and transparent reports on the status of development progress, data quality, operational aspects, and system performance to both leadership and business stakeholders. Show less

• Designed and Developed andSQL Framework Driven Solution/Data Pipelines with custom Pyspark/ Spark SQL solution for Data Hub for various data sources into one central repository on S3.• Developing ETL/ELT solutions tailored to client and business needs, leveraging StreamSets ETL/ELT tools with customized features.• Developed Automated solutions in the existing Data Process to reduce the error frequency by 80% including platform integration limitations.• Working directly with… Show more • Designed and Developed andSQL Framework Driven Solution/Data Pipelines with custom Pyspark/ Spark SQL solution for Data Hub for various data sources into one central repository on S3.• Developing ETL/ELT solutions tailored to client and business needs, leveraging StreamSets ETL/ELT tools with customized features.• Developed Automated solutions in the existing Data Process to reduce the error frequency by 80% including platform integration limitations.• Working directly with clients, Global teams and Onshore partners to understand their business needs & requirement, to provide insights & cloud-based solution.• Report on status of development, quality, operations, and system performance to leadership and business stakeholders• Spearheading and overseeing the successful deployment of various releases, ensuring smooth transitions and minimal disruptions.• Taking on a mentorship role by guiding and supporting new team members and fresh talent.• Developing the job scheduling and orchestration solution for the ETL job/pipelines/work-loads created on different tools/platforms using Apache Airflow providing end-to-end control, monitoring and dependencies for the business-critical application jobs.• Designing data models and pipelines that are aligned with the unique demands of the business, ensuring that data is transformed appropriately to support analytics and reporting needs.• Pioneering the adoption of data engineering best practices and standards to uphold data quality, integrity, and security.• Leading and Managing the successful deployment of various releases.• Preparing course-work or learning session of knowledge gained from Project experience Show less

• Extraction of data from various sources such as (Redshift , Symphony and Veeva Vault).• Build Custom MDM solution of ETL jobs and Data Integration using Matillion Tool, Mastering the Data to give a unique golden ID.• Automated the complete Process of MDM from loading the Data to Mastering and maintaining the Delta History with error handling. • Designing and Development of complex Flu Operation solution (with customised features) as per the requirements of the Client/Business, AWS… Show more • Extraction of data from various sources such as (Redshift , Symphony and Veeva Vault).• Build Custom MDM solution of ETL jobs and Data Integration using Matillion Tool, Mastering the Data to give a unique golden ID.• Automated the complete Process of MDM from loading the Data to Mastering and maintaining the Delta History with error handling. • Designing and Development of complex Flu Operation solution (with customised features) as per the requirements of the Client/Business, AWS Redshift as backend Database and Data processing.• Working directly with clients to understand their business needs & requirement.• Designing and Development of Stored Procedures for complex vaccine schedule processing where multiple user can work independently.• Automated the Sensitive/confidential Data flow from SFTP Server to load data in Redshift tables with DQ checks and archival process using Python/S3.• Basic Understanding of Pharma Domain (U.S market). Show less

• Support and development for one of the leading Insurance client's Application.• Maintained the ticket system and developed different set of fixes for business users for the policy claims.• Re-engineer the SQL queries and Stored Procedures• Basic understanding of Insurance Domain

ACS Student Chapter Founder Member