Having Over 9+ years of experience as a Data Engineer, I have substantial experience designing, developing, and deploying data pipelines and ETL processes. I specialize in using AWS Glue, Spark, Python, and PySpark for data analysis and processing. I have experience with Snowflake to create and manage analytical datasets, as well as hands-on knowledge with Hadoop components such as HDFS, MapReduce, and YARN. In addition, I have built RESTful APIs and real-time streaming pipelines for IoT data processing. My expertise also includes dealing with NoSQL databases, developing highly accessible online apps, and improving ETL procedures for performance and efficiency. I am skilled at system analysis, data modeling, and database architecture, and I have expertise migrating SQL databases to cloud platforms such as Azure Data Lake and Azure SQL Data Warehouse.