Lead Database Engineer
CurrentLead development of ingesting data from various data sources into data lake, ensure seamless data flow across systems and enable comprehensive data analysis and reporting. Worked closely with other teams and business to understand data needs. Managed multiple tasks and projects simultaneously. Implemented data validation and quality checks to drive accuracy, consistency and reliability. Automated repetitive data processing tasks. Initiated training and mentored team members.• Shifted legacy core business engine to direct selling platform vendor, significantly reducing operational and maintenance costs, mitigating risks and allowing rapid deployment.• Developed and transitioned analytics and reporting data services from traditional SQL batch processing to near real-time streaming data into Google Cloud Platform's BigQuery, empowering consultants and businesses to make timely and informed decisions.• Led migration of global services from AWS to Google Cloud Storage, optimizing data footprint and providing scalability to meet growing business needs.• Effectively migrated ecommerce backend database from on-premises SQL Server to SAP Hybris Commerce MySQL, eliminating cross-platform issues and significantly reducing latency.• Achieved 99.9% data accuracy by validating complex data flows from source to target across multiple projects.• Enhanced testing efficiency by automating test data preparation and integrating QA functional workflows, reducing manual testing time by 30%.• Created and launched test automation framework using Selenium and Java, streamlining testing processes, increasing efficiency and expanding testing coverage across organization.
