Data Engineer
• Worked with all levels of business users and stakeholders to gather the requirements.• Design, develop, and maintain ADF, Synapses data pipelines, dataflows to efficiently extract, transform, and load (ETL) data from various sources into client data lake and data warehouse.• Create and manage data models that facilitate efficient storage and retrieval of data, ensuring data quality and consistency. Implemented data governance on user access to the data models.• Created intuitive ETL/ELT parameterized pipelines, Dataflows using ADF various activities.• Implemented Event and Error Handlings, and monitoring and performance of ADF, Synapse optimization strategies to ensure data pipelines, dataflows run smoothly and efficiently.• Create and maintain detailed documentation of data pipelines, models, and procedures for data engineering best practices including data dictionaries, technical & low-level design documents.• Develop MI and BI Reports predominantly for business functions, stakeholders, and SMEs, based on their requirements and expressed needs using Power BI which provides data insights.• Used various Power BI features to create self-service reports, such as Power Query for Data modeling, and DAX to create columns and derive measure values and variables.• Worked on Azure Key Vault to secure credentials and IAM to restrict user access and manage. • Used Azure Key Vault to store securities, and Azure Active Directory to create user groups, and assign permissions to Power BI users, restrict access using RLS, and automated Power BI reports,• Facilitate and enhancement of data sources that would assist organizational performance and guide in effort to optimize and automate processes to collect and utilize data for reporting.