• Championed the transition from outdated legacy data systems to cutting-edge cloud-based solutions, resulting in streamlined data processing and reduced operational expenses. • Architected and oversaw the implementation of expansive data warehousing solutions leveraging platforms like Snowflake.• Established robust data quality assurance protocols encompassing profiling, cleansing, and auditing procedures.• Drove the integration of innovative methodologies and industry best practices, positioning the organization as a leader in data engineering. • Managed coding and unit testing phases, orchestrating thorough code reviews to uphold data integrity. • Guided ETL design, data architecture, and analytical processes, fostering a culture of data-driven decision-making.• Engineered efficient scripts for data loading into Snowflake databases, optimizing data processing efficiency. • Executed data transformation, cleansing, and validation protocols to ensure consistently high data quality. • Collaborated closely with data scientists, analysts, and business stakeholders to grasp data requirements and deliver impactful solutions. • Oversaw system performance, swiftly identifying and resolving bottlenecks and performance challenges. • Conducted bi-weekly training sessions and code review meetings to enhance the technical proficiency and coding standards of junior engineers. • Developed comprehensive onboarding documentation and training initiatives for new team members. • Provided mentorship to a team of 20 junior data engineers, offering technical expertise, conducting code reviews, and facilitating skill development workshops.

• Engineered and orchestrated intricate data pipelines for the efficient processing of massive datasets.• Enhanced data pipeline performance, scalability, and reliability, guaranteeing minimal downtime and rapid data accessibility.• Directed the creation and upkeep of ETL (Extract, Transform, Load) processes, harmonizing data from diverse origins into centralized data repositories such as data warehouses.• Formulated and administered data warehousing architectures leveraging platforms like Snowflake.• Collaborated closely with data scientists, analysts, and key business stakeholders to gather requirements and deliver data-centric solutions.• Transformed business requirements into precise technical specifications, ensuring alignment with overarching data strategies.• Managed concurrent data engineering initiatives, ensuring punctual delivery and adherence to project milestones.

• Orchestrated successful migration of products from Greenplum to Snowflake database.• Developed data loading scripts for Snowflake, optimizing processing efficiency.• Designed and developed ETL jobs, ensuring adherence to code walkthrough protocols.• Promptly resolved production-related issues, ensuring uninterrupted operations.

•Developed design documents and job prototype documents to outline project requirements and specifications.•Created applications to generate reports on mortgage and card details across various geographical locations, enhancing data accessibility.•Designed applications to efficiently load customer-centric data into the database, ensuring accurate data mapping and integration.•Coordinated with Business Analysts and Data Analysts to identify data requirements and ensure seamless data loading processes.•Managed code review processes and optimized code for improved performance, ensuring efficient application operations.•Participated in debugging and fixing issues during system testing phases, ensuring the reliability and functionality of applications.• Created comprehensive test plans and provided support during the testing phase, ensuring thorough testing execution.•Fostered end-to-end support for applications developed, addressing any issues or concerns to ensure smooth operations.

•Led a team of 5 members, overseeing their activities and ensuring efficient workflow management.•Designed, developed, documented, and tested ETL jobs in both Server and Parallel environments using Datastage, facilitating seamless data population into Data Warehouse and Data marts.•Developed batches for existing sessions to streamline scheduling processes using Datastage Manager, enhancing workflow efficiency.• Utilized Datastage Director and runtime engine for scheduling, testing, debugging, and monitoring solutions, ensuring optimal performance.•Devised comprehensive test plans and test data, providing support to the team throughout the testing phase to ensure successful execution.

•Developed job templates, including prototype sequence designs, to streamline ETL processes.•Designed and developed ETL jobs for data extraction, transformation, integration, and loading into data marts using IBM Infosphere DataStage Designer.•Wrote UNIX shell scripts for efficient data manipulation at the file level, ensuring optimal data processing.• Created applications for loading data into various databases, including Teradata, Oracle, and Greenplum, enhancing data accessibility.•Authored SQL scripts to correct data issues in the development environment and developed comprehensive test case documents (UTC and SIT) for rigorous validation.•Collaborated with Business Analysts to gather requirements and analyzed functional documents and specifications to ensure accurate data solutions.