I work in Data Engineering Infrastructure group at Slack. I primarily work on building ingestion infra systems at scale. I have built systems to ingest PBs of relational databases into our Data warehouse We keep improving our architecture for efficiency and cost. My focus is to build next gen datawarehouse stack at Slack with incremental processing and event based architectures.

I worked on the back end data team at Onera. I was primarily responsible for the airflow based data pipelines for our retail data processing. I worked on improving the data pipeline runtime by writing better algorithms and moving heavy workloads into GCP Spark on demand datapro clusters.

I work in the backend engineering working on data processing aspects of listings. My job entails making listing feeds process faster, taking care of tonnes of business logics, filtering, deduping etc. I also develop api services and data model to provide these data objects to frontend for consumption and showing up on live site. Currently I am working on a realtime pipeline for our backend listings.

I finished my masters in computer science at the Donald Bren School of Information and Computer Science @ UC Irvine. My specialization includes Distributed Data Systems, Information Retrieval and Data Mining/ML.

I deal in topic modelling, data mining, distributed computing, programming, scripting..

I primarily worked in the hadoop engineering team to build a solr and flume based index for searching logs across a 1000-node hadoop cluster using mapper jobs. I also did a case-study on imdb dataset using hive/pig to identify relationships among among movie attributes like budget, revenues, release times etc.

I worked on a platform service called Content Platforms - its and end to end feed processing system on hadoop that involves numerous downstream components from rest apis to various dashboards.

Worked on network sniffing project under Extreme Blue Worldwide Internship, India Program