Priyanka S Email & Phone Number

Raleigh-Durham-Chapel Hill Area

Developed and maintained ETL data pipeline for cloud data migration to move data processes from SSIS to azure using Azure Synapse Analytics.Proficiency in building and maintaining data warehouse for reporting layer that supports various data analysis and reporting needs.Created notebooks using PySpark for performing transformations on data.Transitioned the staging layer from warehouse to Azure Data Lake Storage (ADLS) to enhance scalability and performance.Worked on Azure Databricks to create notebooks using Spark-SQL and PySpark to extract and process data from delta tables.Maintained and enhance existing Power BI Datasets and reports as per client requirements.Provided production support for quick debugging and resolution whenever required.Utilized Azure DevOps for version control, CI/CD pipelines and performing release activities.Performed unit and regression testing in lower environments to ensure integrity and consistency of data.

Hyderabad, Telangana, India

Built Azure Data Factory pipelines, enhancing data ingestion efficiency with a 20% increase in volume per unit time.Employed Azure Synapse for data staging, leveraging external tables and Azure Data Lake, optimizing data access.Optimized data processing in Azure Databricks using PySpark, reducing transformation times by 10-20%.Experience with performing various SSIS data transformation tasks like Lookups, Fuzzy Lookups, Conditional Splits, Event Handlers and Error Handlers etc.Automated the incremental data append to HIVE tables and schema evolution using Unix shell scripts. Created Sqoop jobs for incremental imports of data to Hadoop system from multiple sources and storing data in Avro format.Developed Spark streaming jobs for XML data processing from Kafka to ADL, improving data throughput.Deployed Tableau connect with Azure SQL Synapse Analytics and SQL database to set up the data source.Integrated DBT with Spark SQL in Databricks, managed version control via Git, Jenkins & Jira to streamline CI/CD.Generated multiple reports and created process documents. Experience with working in an Agile environment. Performed testing and validation of data to ensure accuracy and consistency.

Master'S Degree, Computer And Information Sciences, General

Bachelor Of Engineering - Be, Computer Science