Senior Software Engineer
CurrentImplemented checksum logic for both the product dimension and all smaller dimensions with around 100million records, resulting in a 50% reduction in redundant record processing and subsequently alleviatingthe infrastructure load.Developed a pipeline to synchronize checksum tables with the most recent table schema and reconcileproduct and dimension tables, proficiently identifying and resolving discrepancies in product records.Designed and implemented an innovative module to retrieve Kafka messages from any topic based onhistorical records within a specified time range.Deployed a pipeline leveraging HVR and Kafka to swiftly detect Insert, Update, and Delete (IUD) eventswithin sub-millisecond intervals, guaranteeing prompt and effective processing for updating the productdimension table