Senior Data Engineer
CurrentWith extensive experience in financial data engineering and analytics, I have developed and managed ETL processes using AWS Glue and built scalable data pipelines with AWS Data Pipeline to optimize financial workflows. I have implemented secure data storage solutions using AWS S3, Redshift, and Lake Formation, ensuring data scalability and governance. Leveraging Apache Spark and Hadoop for large-scale data processing and analysis, I’ve optimized real-time data streaming with Apache Kafka and enhanced machine learning applications using TensorFlow for financial forecasting. My expertise includes managing Kubernetes for containerized applications, configuring DBT for data transformation, and improving query performance with SQL. I have led cross-functional teams, employed Agile methodologies, and championed data security and compliance to drive operational excellence. Additionally, I’ve provided actionable insights through detailed data analysis, supporting strategic financial decision-making and fostering a culture of data-driven innovation.