Software Engineer
Current• Integral part of I2R, the primary data source for various applications within FRTB. Managed 600 million daily metrics to uphold internal standards for capital banks and market risk exposures.• Awarded with spot award.• Developed a highly customisable filewatcher that can take multiple input files and join criteria and integrate the output to datalake.• Developed and maintained big data pipeline to ingest PROTO data from different sources using Apache Spark , Kafka, Postgres and ADLS.• Contributed to a springboot backend for React based monitoring services and data flow for various data pipelines. An alerting system was created to notify failures and SLA breach.• Developed extraction pipelines that extracts useful data depending on the downstream consumers.• Actively contributed in migrating the on-premise workflow to azure.• Designed and implemented utility services using common frameworks for cross-functional usage across multiple teams• Ensured code quality, clean code practices with minimum code coverage of 80% on all developments.• Engineered automation shell scripts to optimize routine tasks, delivering substantial time savings and operational efficiency gains.• Reduced spark cluster cost by 70 percent by switching to on demand nodes