Data Engineer
Bengaluru, Karnataka, India
Snowflake Warehouse Management, ETL Implementation, and Automated BI Reporting : Implemented an ELT pipeline for a solar company, centralizing data from Oracle, Horizon, Salesforce, Five9, and SharePoint into Snowflake. Created data models, applied SCD 4, and developed over 10 Tableau dashboards. Ensured data quality and optimized ETL processes for better performance through SQL query optimization and materialized views.Single Source of Truth Implementation and Automated Visualization Pipeline: Consolidated data from Google Analytics, HubSpot, Recurly, and AWS S3 into AWS Redshift using Fivetran. Developed SQL queries for Tableau visualizations, automated data processes, and set up Lambda functions and SNS for monitoring and alerts, enhancing data accuracy and Redshift performance.AWS S3 Email Alert System: Developed a Python-based AWS S3 monitoring system for a retail company, using Boto3 to track uploads and AWS SNS and Lambda for email alerts. This system enhanced file management efficiency and team communication by monitoring uploads and sending alerts for missed uploads or anomalies.