Design and development of end-to-end data pipelines on AWS for ingesting, processing, and analysing large volumes of data from multiple sources.Proficient in Amazon Web Services (AWS) with hands-on experience in data engineering tools and services such as S3, Glue, Redshift, Athena, Lambda, DynamoDB, EventBridge.Expertise in designing and implementing data pipelines using Apache Spark and Databricks.Strong programming skills in languages such as Python and PySpark.Experience with distributed computing systems and technologies like Hadoop, and HDFS. Deep understanding of big data storage solutions including AWS S3. Familiarity with data warehousing concepts and technologies using AWS Redshift.Proficient in SQL for data modelling, querying, and optimization.Strong problem-solving skills and ability to troubleshoot and optimize data pipelines for performance and efficiency.Worked closely with stakeholders to gather requirements, define project scope, and deliver data solutions that meet business objectives.Engaged in Agile development practices, adhering to the Jira Scrum board framework.