•Led the project customer lifecycle which captures the end-to-end customer journey across multiple products in a single place along with industry- standard SaaS metrics. Mentored multiple junior developers while ensuring best practices in development and testing•Designed, developed and tested a framework that automatically finds and masks PII data for GDPR Super Delete requests•Setup spark structured streaming for real-time data ingestion and fine-tuned to reduce cost by 60% by increasing the EMR cluster utilization to more than 80%•Built a serverless solution on AWS to handle bulk updates in source systems which removed the bottleneck in the existing batch process •Successfully retired Informatica by doing a PoC on AWS AppFlow and migrating all the Salesforce ingestion jobs which saved ~$150k in licensing and compute costs

•Built a file compaction framework for spark streaming jobs which increased the performance of downstream jobs by more than 50%Led a small team of two developers in an effort where we successfully migrated 50+ legacy pig jobs to spark which saved more than $5k per month in compute cost•Ingested and transformed data from various data sources like Kinesis, Kafka, Mixpanel API etc and made it available for the business to derive useful insights

Developed an ETL pipeline to aid the marketing team to plan data-driven marketing strategies for a product •Implemented KPI reporting to measure company performance which included reporting more than 1B$ revenue, ARR and other SaaS metrics sourced from more than five different source systems