Senior Data Engineer
CurrentTransformed financial data into actionable insights by leveraging ETL processes and Python programming within AWS Lambda functions, extracting information from diverse sources stored in AWS S3 Buckets. Collaborated on the design and maintenance of ETL pipelines, ensuring data consistency and compliance with standards, and loading it into S3 and Snowflake data warehouse.Engaged in data integration efforts, liaising with stakeholders to comprehend data sources, structures, and integration needs. Conducted data transformation and cleansing operations, upholding accuracy and compliance before loading into repositories. Optimized ETL workflows, identifying and resolving bottlenecks for enhanced data pipeline efficiency.Demonstrated commitment to data governance, adhering to policies and maintaining data security and privacy standards throughout ETL processes. Implemented error handling mechanisms and monitoring solutions, proactively resolving data pipeline issues.Generated comprehensive technical documentation, including data mappings, ETL process flow diagrams, and system configurations. Collaborated seamlessly with data analysts, business intelligence teams, and stakeholders to meet data needs and deliver solutions aligning with business objectives.Kept abreast of ETL trends, technologies, and best practices, driving continuous improvement in ETL processes and data pipeline reliability. Conducted thorough testing, data validation, and quality assurance checks to ensure and maintain data integrity.Proficient in utilizing SQL, AWS Lambda, AWS S3, AWS Glue, ETL, Python, PowerBI Reports, Github, stored procedures, and SAP BODS.