Data Engineer
Current1. Created Stored Procedures, Triggers, User defined functions and Views to populate tables and front-end applications using T-SQL for various Database & Application functionalities.2. Extensive experience in Azure Data Lake Analytics, Azure Data Lake Storage, AZURE Data Factory, Azure SQL databases and Azure SQL Data Warehouse for providing analytics and reports for improving marketing strategies.3. Data extraction from various sources, Transformation and Loading into the target SQL Server Database. Implemented Copy activity, Custom Azure Data Factory Pipeline Activities for On-cloud ETL processing.4. Developed and maintained Python scripts for Azure Automation Runbooks, automating routine tasks such as resource provisioning, configuration, and monitoring.5. Created U-SQL script for transform activities and developed complex queries to transform the data from multiple sources and output the data into Azure Data warehouse.6. Designed and implemented a comprehensive data governance framework to ensure data quality, consistency, and security across all data sources and platforms.7. Configured CloudWatch Logs to capture and analyze application logs, system logs, and custom logs.8. Integrated ARM templates with Azure DevOps pipelines for continuous integration and continuous deployment (CI/CD) workflows.9. Managed Azure Storage accounts, including Blob Storage, Azure Files, and Disks, optimizing storage performance and cost.10. Involved in creating the external and internal tables in Azure SQL Datawarehouse and created stored procedures to move the data from external to internal tables and used Poly Base to move data to Azure SQL DW.11. Involved in developing complex Azure Analysis Services tabular databases and deploying the same in Microsoft azure and scheduling the cube through Azure Automation Run book using Python/PowerShell.
