Devi P Email & Phone Number

• Exploring the load performances between ADLS, ADF Pipelines along with Native SSIS ETL packages and accessing the migration of objects from On-Premises to Azure Data Lake.• Strong development skills with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer.• Created SSIS packages to perform filtering operations and to import the data on daily basis from the legacy data sources to SQL Server 2016. • Created new procedures to handle complex logic for business and modified already existing stored procedures, functions, views, and tables for new enhancements of the project and to resolve the existing defects.• Worked on ingesting the real-time data using Kafka.• Spearheaded the migration of legacy ETL processes to Python-based workflows, reducing system complexity and increasing maintainability.• Integrated Hadoop with Apache Hive for structured data querying and analysis, improving overall data accessibility.• Creating complex SQL scripts to transform legacy data in staging area using SSIS packages.• Used SSIS to create ETL packages to validate, extract, transform and load data into data warehouse.• Designed and implemented data visualization dashboards using tools like Tableau, enhancing business intelligence reporting.• Created, provisioned different Databricks clusters, notebooks, jobs and autoscaling.• Used Azure Maps to Calculate the Distance, Latitude & Longitude.• Utilized cloud platforms (AWS/GCP/Azure) for developing and deploying scalable and cost-effective data architectures• Implemented robust data quality checks and monitoring procedures, ensuring data integrity and reliability.• Implemented Hadoop-based data storage solutions, ensuring scalable and fault-tolerant data storage.

• Created pipelines in ADF using Linked services/Datasets/Pipelines/to Extract, Transform, and Load data from various sources like Azure SQL, Blob Storage, Azure SQL Data Warehouse• Designed SSIS packages to transfer data from flat files to SQL Server using business intelligence development studio.Gathering all the data sources required to build the Business solution • Interaction with BA’s and business users to understand the business rules. Writing the SQL based on requirements.• Involved in SQL tuning. Design and Implemented database application using MS SQL Server 2012 and Business Intelligence (BI) tools to support transaction and business decision making.• Created pipelines in ADF using Linked services/Datasets/Pipelines/to Extract, Transform, and Load data from different sources like Azure SQL, Blob Storage, Azure SQL Data Warehouse.• Evaluated database performance and performed maintenance duties such as tuning, backup and restoration.• Migrated to SQL Server 2008 databases to SQL Server 2014 and upgraded SSIS Packages.• Used Performance Monitor and SQL Profiler for Monitoring memory, processor and SQL Queries.• Working collaboratively with the team members and sharing knowledge regarding project and providing relevant solutions to customers on time. • Implemented Azure Data Factory (ADF) extensively for ingesting data from different source systems like relational and unstructured data to meet business functional requirements.• Design and developed Batch processing and real-time processing solutions using ADF, Databricks clusters and stream Analytics.• Implemented Snowflake's features such as Snowpipe for real-time data loading, enhancing data freshness for analytics.• Written simple DAX calculation as per the requirement to maintain business measures.• Improved performance by optimizing computing time to process the streaming data by optimizing the cluster run time.