Architect, implement, and manage complex data pipelines in Azure Data Factory utilizing multiple integration runtimes, ensuring efficient data integration, transformation, and orchestration across diverse sources and destinations.Implement data storage solutions including configuring Azure Data Lake Storage Gen2, Azure Blob Storage, Azure SQL Data Warehouse, and Azure Cosmos DB, ensuring optimal data management and accessibility.Develop real-time processing solutions on Azure, leveraging services such as Azure Stream Analytics, Azure Event Hubs, and Azure Databricks, to enable timely data ingestion, processing, and analysis for actionable insights.Orchestrate end-to-end data pipelines with Azure Synapse Analytics, integrating dedicated SQL pools, Power BI, and other Azure services to deliver comprehensive data solutions for advanced analytics and reporting.Implement partitioning strategies in Azure Data Lake Storage and Azure SQL Data Warehouse for optimized data organization and improved query performance.Implement robust secure data solutions on Azure, employing encryption, access controls, and Azure Key Vault, ensuring data confidentiality, integrity, and compliance with regulatory requirements.Designed efficient and scalable tables in Azure, incorporating best practices for data modeling, indexing, and partitioning to optimize performance and facilitate seamless data access and analysis.Create Data Models, translate data models into SQL Objects - schemas, tables, aliases, views, indexes, constraints, triggers, sequences, stored procedures, and user-defined functions as required.Implement Role-Based Access Control (RBAC) and POSIX-compliant security measures in Azure environments, ensuring granular access controls and enhanced security posture for cloud-based data solutions.Implement data governance ensuring data quality, compliance, and effective data management.

Worked with Business Analysts and Data Analysts to gather business requirements, identify necessary data points, and create source-to-target data mapping documents.Responsible for data warehousing, data modeling, and data governance.Designed, implemented, and supported ETL pipelines using SSIS to integrate data from various sources.Architected and implemented BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL Data Warehouse).Designed and implemented migration strategies for traditional systems on Azure (Lift and shift/Azure Migrate, other third-party tools).Collaborated with Data Architects and DBAs to create a best-fit physical data model from the logical data model.Used Erwin for both Forward and Reverse Engineering to create ERD from existing Database Objects and Database Objects from an ERD to migrate Data Model from Oracle to SQL Server.Performed necessary Data Modeling to normalize data collected from various sources to 3NF.Designed and implemented the data lake on the NoSQL database HBase with denormalized tables suited to feed downstream reporting applications.Developed Data Migration and Cleansing rules for the Integration Architecture (OLTP and Data Warehouse).Developed Star and Snowflake schemas based on dimensional models to develop the data warehouse.Applied and monitored Data Governance rules (primary qualifiers, class words, and valid abbreviations in table and column names).Identified Fact and Dimension tables and established the Grain of Fact for Dimensional Models.Scheduled and Monitored SQL Server Agent Jobs to run ETL packages overnight and refresh data in the Data Warehouse.Developed and designed a system to collect data from various sources using Kafka to process it using spark.