Vijay Kumar Email & Phone Number

Bengaluru, Ka, In

Bengaluru, Karnataka, India

# ETL Team• Reduced the number of redundant writes by > 90% (27 million to 1.3 million rows/day) for a class of ETL jobs with a custom change detection algorithm.• Built Cluster lock - a pessimistic lock to provide the (distributed) cluster-level isolated access to a shared resource in exclusive/shared modes. It ensures correctness even in the scenario of n/w splits and/or failures and doesn’t require the DB connection to be kept open for the duration of the lock.• Implemented a miss-tolerant caching layer to reduce (point) DB queries in ETL pipelines. - put numbers cache-hit ratio.# Annotations Team• Increased the processing speed of the annotation-processor by > 8x, from 300 to 2700 objects/min by memoizing heavy point DB queries.• Made the Kafka consumers for ETL annotation horizontally scalable by standardizing the ops cost. It removed the platform-breaking load and frequent rebalancing of consumer groups.• Increased the efficiency of internal mongo query builder by 5x with a non-blocking async worker pool without bloating the memory & bounded retry.• Several other additions - query optimization with index, preventing data corruption with locks, DAG cycle detection module time reduction from 66 sec to 0.4 sec.# Backend Infra Team• Ignite-rb - author of the (only) ruby thin client for apache ignite. Unlike the official py-ignite, it’s concurrent and thread-safe. Received an offer for the client to get included in the ASF as the official ruby client.# Data science• Developed an anomaly detection algorithm based on the standard deviation of the EWA (exponentially weighted average) of the time series correlations. It reduced the false positive rate from ~30% to ~5% wrt. its predecessor.• Scaled the anomaly detection pipeline to run on ~100k time series per day.

Karnataka, India

Built an anomaly detection and alert system. Maintained the complete ownership of the entire engineering process including design, coding, testing and deployment.

Bachelor Of Technology (Btech), Computer Science, 7.84 Cgpa (Till 7Th Sem)

Intermediate, Computer Science, 9.08/10