Rule based Streaming platform:Worked on building scalable, distributed, high throughput, fault tolerant rule based real time streaming platform to reliably process billions of raw events from web log, mobile log, email log, salesforce events and transactional events. The processed canonical events are published to kafka in Avro format. The platform serves as a “single source of truth” for all analytical data needs at Groupon. Contributed to development of capturing, monitoring and alerting data quality and parsing errors.Rules are created, updated and validated through intuitive UI. Involved in development of Rest API to store and access rules from RDBMS. Designed and developed highly scalable batch engine to persist hourly deduplicated data in HDFS in parquet format for batch and historical analysis.Streaming Analytics Platform:Worked on building real time analytics platform to provide insights to data in real time by taking Spark SQL and executing them incrementally on streaming data. The platform currently supports aggregation, streams join, stream static table join. The result is published to elasticsearch for visualization, debugging, monitoring and alerting. Working on adding features to support real time attribution, real time email cube, streaming lookup and other capabilities to support numerous real time analytics use caseWorked on building elasticsearch infrastructure and tools to do real time data capturing, visualization, monitoring, debugging and alerting.Technologies: Scala, Java, Spark, Storm, Hadoop, Hive, Kafka, MBUS, Redis, HBase and Elastic-Search.

Led the team from requirements gathering to design, development and implementation of small business data mart in Teradata to replace redundant processes and to provide single source of truth for small business customer analytics.Technologies - Teradata, TPT, Unix.

Delivered pre-sale competitive benchmarks and proof of concept to showcase Teradata hardware and software performance and scalability against competition. Worked on Physical implementation, data ingestion, migration of SQL & stored procedures from other databases to Teradata, performance tuning of SQL query, analyzing DBQL & resource usage. Optimized queries using various techniques like Join Indexes, compression, tuning physical implementation, Query rewrite, Stats collection, etc.Technologies - Teradata, Unix, Perl Scripting.

As a Database developer involved in designing physical data models, developing stored procedures in PLSQL, writing optimized SQL, tuning and optimizing SQL and stored procedures to automate healthcare clearing house transactions.Technologies: Oracle 10g, SQL, PL/SQL, Java