Summary:- Seasoned Data Engineering Architect with over 10 years of experience in optimizing projects, data pipelines and data cost. Obsessed with cost optimization, vast experience with project leadership. Skilled in managing and leading large-scale data projects, focusing on cost, quality, timelines, integrity, efficiency. Proficient in a broad spectrum of tools and platforms demonstrating adaptability in various data ecosystems and environments.Key Achievements:• Optimized various data pipelines and processes, achieving performance increases between 2x to 100x.• Spearheaded projects resulting in over ~$20M in AWS cost savings (over a 5-year period) through various optimization techniques.Skills:Scala, Spark, AWS, Akka, Docker, Kubernetes, Python, Kafka, Redshift, Postgres, Snowflake, Dataiku, Thoughtspot, Databricks, DBT, Airflow, Looker, Superset, PowerBI, Tableau, Nifi, PySpark, Spring Boot, Elasticsearch, Whisper models and NVIDIA GPUs.
Listed skills include Scala, Play Framework, Akka, Linux, and 25 others.