Data Engineer - Assistant Manager
Current1. Developed and launched an interactive self-serve data exploration tool for 100+ internal users, incorporating features to process and visualize live data feeds, significantly increasing productivity by 60% and providing actionable insights for adapting marketing strategies.2. Implemented Dagster for orchestration, to automate and manage over 100 ETL jobs, enhancing data ingestion rates by over 2 billion events per day, increasing process efficiency, reducing manual intervention time, and optimizing existing data pipelines, resulting in a 50% improvement in processing speeds and ensuring data integrity for analytics purposes.3. Spearheaded the development and deployment of interactive dashboards using Streamlit with python, enhancing the visualization of performance metrics and strategic opportunities for the sales team.4. Developed a centralized logging solution with Elasticsearch, Logstash and Kibana (ELK stack) leading to a 50% improvement in issue diagnosis times for data pipeline operations.5. Automated manual data collection processes through Python-based script for automated cleansing of incoming IoT data streams, enhancing data quality by 20%, saving the team 15 hours per week that was reallocated to strategic analysis tasks.6. Initiated a company-wide data governance strategy that enforced data standards and streamlined data access for cross-functional teams.7. Designed and developed data models and database schemas that streamlined data flow, accessibility for stakeholders, and enhanced data interpretability, thereby supporting strategic business initiatives and analytics.8. Co-developed two non-provisional patent-pending data-driven models for optimal cell placements in battery packs, enhancing cell uniformity, extending battery life, and significantly reducingpack failure risks by 80%