Senior Data Engineer
Current• Designed efficient knowledge graph data ingestion using Neptune, resulting in over 50% annual cost savings.• Utilized Terraform for infrastructure provisioning and implemented an LLM for continuous interaction with the Knowledge Graph as a Q&A service.• Leveraged Kubernetes and Docker for infrastructure enhancements, enabling ML model deployment across clouds and on-prem environments.• Revitalized Airflow-based projects, optimized data volume through MySQL and Elasticsearch queries, and streamlined deployments via Gitlab and Jenkins CI.• Collaborated on Python code development, achieving functional modularity and a 32% increase in efficiency.• Enhanced ETL pipelines for business use, achieving a 30% increase in ingestion and transformation capability with a 70% cost reduction.• Led scoping and development for project sprints, creating Functional Specifications.• Conducted code reviews and E2E testing using GitHub version control, resulting in a 26% increase in code efficiency.• Boosted project delivery and code quality through Engineering documentation.• Mentored Senior Engineers for quick adaptation to the firm’s culture and processes.
