I am a passionate about Big Data and Cloud technologies my expertise spans Apache Hadoop, Spark, Sqoop, Hive, HBase, and pyspark, with a solid foundation in Azure Cloud Services. I’ve successfully executed data migration, ETL processes, and optimized data pipelines, integrating Azure Databricks Spark with Azure Services to enhanced performance and transform and store Data.Also optimized data analysis pipelines using Apache Spark, employing techniques such as schema creation, bucketing, and partitioning and optimization techniques. Moreover, my expertise extends to integrating Apache Spark with Apache Hive and Azure cloud, enabling fast read operations and facilitating efficient transformations and actions on RDDs in Apache Spark.I am committed to continuous learning and staying at the forefront of industry trends, ready to contribute to innovative projects in Software Development, Big Data, and Cloud Technologies.