Data Engineer
Current• Built and deployed scalable data processing pipelines on Amazon Web Services (AWS) using AWS Glue and Athena for data transformation and analysis.• Designed S3-based data lakes to handle structured and unstructured data securely.• Created and optimized ETL workflows using AWS Lambda and Step Functions to process high volumes of financial transaction data.• Implemented data security and compliance measures in accordance with PCI DSS standards for banking.• Defined and managed data schemas for Redshift clusters, enabling efficient data warehousing and reporting.• Deployed Redshift Spectrum to query data directly from S3, reducing latency and improving performance.• Developed cost-monitoring dashboards using CloudWatch and integrated alerts for anomaly detection.• Worked with stakeholders to define data schemas and business requirements for reporting on banking KPIs.Led the migration of legacy ETL pipelines to modern, serverless workflows on AWS.• Conducted regular data audits to identify discrepancies and ensure pipeline efficiency and accuracy.• Designed scalable solutions for real-time data ingestion using Kinesis Streams and Firehose.