Senior Aws Data Engineer
CurrentSpecialized in delivering complex systems through end-to-end management, from requirements gathering and system design to development, testing, and deployment. Adeptly employ AGILE/SCRUM methodologies to drive efficient software delivery and collaborate effectively with cross-functional teams.Developing and maintaining data pipelines using Big Data technologies, such as AWS S3, Redshift, Snowflake, and Databricks, and leveraging tools like PySpark and AWS Glue for ETL processes. Exceled in transforming and analyzing large datasets, utilizing technologies like AWS EMR, Kafka, Spark Streaming, and Hadoop.Proficient in creating scalable data solutions with AWS services, Terraform, and CloudFormation, and have a strong background in optimizing data workflows, troubleshooting complex issues, and ensuring robust performance across diverse systems. Designed data ingestion modules, generating BI reports with QuickSight, and integrating data with various platforms through ETL processes and data visualization tools.