• Co-creating Databricks-enabled, config-driven and low-code development framework to be utilized by all DoorDash developers to quickly build Spark ETL pipelines with various “plug and play” data sources and sinks including Kafka, CockroachDB, Snowflake, DeltaLake, Parquet, CSV / JSON, etc., enabling data pattern implementation, simplified near real-time data exploration, built-in CI/CD, out-of-the-box DeltaLake Structured Streaming for CDC and optimization• Designing and developing Verint… Show more • Co-creating Databricks-enabled, config-driven and low-code development framework to be utilized by all DoorDash developers to quickly build Spark ETL pipelines with various “plug and play” data sources and sinks including Kafka, CockroachDB, Snowflake, DeltaLake, Parquet, CSV / JSON, etc., enabling data pattern implementation, simplified near real-time data exploration, built-in CI/CD, out-of-the-box DeltaLake Structured Streaming for CDC and optimization• Designing and developing Verint data pipeline to Snowflake for essential workforce management data, reducing 200+ manual work hours required weekly• Integration with Chronosphere to push real-time metrics to visualize critical insights from the current state of pipelines with alerts set up for critical events • DoorDash's ProspectPoint platform integration into Snowflake using Spark for marketing attributions and budget ROI, facilitating the DAC Optimizer machine-learning model in weekly budgeting for submarkets or DMA.• Data migration from Salesforce Figment to Lemonade, involving API 2.0 integration Show less

• Capturing KPI's/use cases from Business Analysts, users.• Extracting data from different systems using SQL for ingesting into AGA.• Developing Python scripts to consume streaming and batch data and stored into S3 bucket.

Hongkong AMI Pilot Project (Jan 2018 - Jan 2020)• Integration between HES and MDMS and different HK Electric systems with MDMS and HES.• Developing Python scripts for daily task automation including CC log collecting, extracts sharing from MDMS to customer-appointed destination directories• Designing and developing billing adapters (flat file service and load profile data from Command Center with data processing up to 90 days backwards) using Digital Signature verification and… Show more Hongkong AMI Pilot Project (Jan 2018 - Jan 2020)• Integration between HES and MDMS and different HK Electric systems with MDMS and HES.• Developing Python scripts for daily task automation including CC log collecting, extracts sharing from MDMS to customer-appointed destination directories• Designing and developing billing adapters (flat file service and load profile data from Command Center with data processing up to 90 days backwards) using Digital Signature verification and Spring batch and Scala technology.MDMS Vietnam Project (May 2016- Jan 2018)• Designing adapters for HES integration, On-Demand Engine Integration with MDMS, and Real-• Time email service using Spring Boot & JMS.• Engineering custom DSE and Historical Data Loading Adapter for MDMS Billing using Unix Shell Scripting and SQL.• Implementing Billing Adapter for seamless Billing System integration with MDMS via Java-based SOAP.• Developing JMS monitoring app with JMX framework for queue status tracking.• Conducting HES and CMIS data analysis to align with MDMS requirements. Show less

Tata Power Project (MDMS & AMI)• Integrating Command Center with MDMS using Flat File adapter via shell scripting and SQL.• Developing backend code for Consumer Portal Android app using Java and MySQL server, with Java-based integration for Command Center and Google services.• Creating Restful Web service for AMI Pulse Android app using Spring framework and MySQL server, including Parser program for Hexa-decimal Meter data.

• Managing tender enquiries on CPP Portal, including Nodal Officer tasks and BoQ creation.• Reporting MIS Reports and managing Digital Signature Certificates (DSCs) mapping.• Conducting IT application training for officers/officials as well as managing technical documentation and project maintenance.