Data Engineer
CurrentPart of WebEx Analytics platform> Built and deployed an Apache Spark Cron Job to join data from MongoDB, Postgres and Apache Iceberg format table. Joined data was stored in Apache Pinot and surfaced to end user using Spring boot APIs> Built and deployed a Flink Job to process and aggregate Calling Metrics data from Apache Kafka and store it in Apache Pinot. Data was surfaced to end user using Spring Boot APIs> Designed and Modelled Postgres DB for storing Contact Center… Show more Part of WebEx Analytics platform> Built and deployed an Apache Spark Cron Job to join data from MongoDB, Postgres and Apache Iceberg format table. Joined data was stored in Apache Pinot and surfaced to end user using Spring boot APIs> Built and deployed a Flink Job to process and aggregate Calling Metrics data from Apache Kafka and store it in Apache Pinot. Data was surfaced to end user using Spring Boot APIs> Designed and Modelled Postgres DB for storing Contact Center IVR/ Digital Data. Built and Deployed a Java Spring Boot Microservice on top of Postgres> Migrated Microservice from MongoDB environment to Postgres and also created a process to migrate data from MongoDB to Postgres. Making a 90% cost reduction> Built an ETL Pipeline to ingest aggregated data for Slido. Data was stored in Apache Iceberg format table and Apache Pinot. SQL queries were written on top of this Data to present insights to end-users Show less