I'm a passionate Data Engineer and an aspiring Solutions Architect with over 5 years of experience designing, developing, and automating data solutions across the entire data lifecycle. My background combines strong technical skills in:Big Data ETL Development: Experienced in building and optimizing data pipelines for efficient data movement and transformation using tools like Apache Spark, Databricks, Apache Hive, Presto and Apache Airflow for orchestration.Big Data QA and Automation: Adept at designing and implementing automated testing frameworks to ensure data quality and pipeline reliability.AWS Administration, Architecture, and Automation: Skilled in building, managing and automating AWS infrastructure to provide Petabyte scale BigData Platform.Kubernetes Administration and Development: Experienced in management and administration of Kubernetes clusters in AWS. Experienced in deploying and managing containerized distributed Big Data applications like Apache Spark using Kubernetes.