• Optimize data performance and scalability.• Scheduling Jobs/Notebooks. / Using Workflows to schedule and deploy the notebooks.• Worked on different different file format like CSV, JSON, PARQUET, XML.• Checking Data Quality, Accuracy, Completeness and Handling Null and Corrupt records.• Developed and optimized ETL pipelines using Azure Databricks for large-scale data processing.• Implemented data transformation and cleansing operations with Pyspark, Spark SQL and Python.• Provided technical support for data-related issues and queries.• Participated in training sessions for new Azure Databricks features and updates.• Optimize data performance and scalability. • Scheduling Jobs/Notebooks. / Using Workflows to schedule and deploy the notebooks. • Worked on different different file format like CSV, JSON, PARQUET, XML. • Checking Data Quality, Accuracy, Completeness and Handling Null and Corrupt records. • Developed and optimized ETL pipelines using Azure Databricks for large-scale data processing. • Implemented data transformation and cleansing operations with Pyspark, Spark SQL and Python. • Provided technical support for data-related issues and queries. • Participated in training sessions for new Azure Databricks features and updates.Skills: Azure Data Factory · Azure Databricks · Azure Data Lake · PySpark · Python (Programming Language) · SQL · ETL Tools · Apache Spark · Hadoop · Microsoft SQL Server · Oracle Database · Extract, Transform, Load (ETL) · Data Modeling · Data Warehousing