6+ years of expertise designing, developing, and executing data pipelines and data lake requirements in numerous companies using the Big Data Technology stack, Python, PL/SQL, SQL, REST APIs, and the Azure cloud platform. Implemented Big Data solutions using Hadoop technology stack, including PySpark, Hive, Sqoop, Avro and Thrift. Hands-on experience developing data pipelines using Spark components, Spark SQL, Spark Streaming and MLLib. Designed, build and managed ELT data pipelines leveraging Airflow, python, and GCP solutions. Expertise in Azure infrastructure management (Azure Web Roles, Worker Roles, SQL Azure, Azure Storage, Azure AD Licenses, Of-fice365). Employed the Agile paradigm throughout the entire software development life cycle. Experienced with Dimensional modelling, Data migration, Data cleansing, Data profiling, and ETL Processes features for data warehouses. Proven Problem-solving abilities, including the capacity to identify, Break down, and address complex data challenges.