Ashok Katari Email & Phone Number

Designed and Developed Azure Data Factory Pipelines to load data from various source systems into Azure data lake storage and to process it into Azure Databricks. Automated the data pipeline with Azure Data Factory (ADF), Increasing operational efficiency by 20%. Used Apache Spark to creating Spark SQL and PySpark scripts to clean and transform data into the cleaning layer. Have strong knowledge of data warehousing concepts such as CDC and SCD types 1 and 2. Worked with Spark SQL queries, data frames, imported data from data sources, performed transformations, executed read/write operations, and saved results to the output directory. Created and maintained documentation on pipeline architecture and processes for easy troubleshooting and future scalability. Collaborated with business analysts and stakeholders to understand and translate requirements into technical solutions.

Spearheaded data pipelines and ETL processes using ADF and Databricks with PySpark and Spark SQL, boosting data competence by 15% and ensuring data integration into diverse sources. Utilized Azure Data Factory and Apache Spark for data ingestion and processing tasks on structured data formats. Wrote complex SQL queries after comprehending business transformation logic. Transformed column and table names according to coding guidelines using regular expressions, streamlining data organization and improving accessibility for users. Migrated Databricks gold layer tables to Snowflake, achieving 25% faster query performance and facilitating seamless data access. Contributed to code reviews and continuous improvement initiatives, fostering a culture of excellence and innovation within the team 20%.

Bachelor Of Technology, Computer Science Engineering

Board Of Intermediate Education