Arvind Parashar Email & Phone Number

Noida, Uttar Pradesh, India

• Implemented generic pipeline for Incremental & Full-load using ADF.• Good understanding of ADF activities, transformations, Linked Service, Dataset, Integration Runtime, Parameters, variables and Triggers.• Creating Simple and complex pipelines on adhoc basis as requested by client.• Well versed in creating Databricks Notebooks in Pyspark and SQL.• Leveraged databricks to ingest data from various sources like ADLS gen2, on-premise database and API (public and privately hosted).• Having a very good understanding of PySpark DataFrames and Polars DataFrames operations.• Performing e2e data analytics scripts using ADB to obtain crucial insights of the data.• Performing data cleansing and data transformations based on business logics using ADB.• Performing Data Quality Checks, scrutinizing the ingested data, drawing meaningful insights, based on the checks implementing adequate techniques to improve the quality of data from every angle using ADB.• Created YAML pipelines to deploy Azure resources using DevOps CI/CD. • Experienced in performing ETL using Data factory as well as Data bricks.• Implemented a Solution using Azure and Python leveraging Function app and Web app to detect and correct permission assigned on blobs and Containers.• Hands on experience in fetching and querying data/logs from Azure Log Analytics using KQL.• Hands on experience in writing Unit Test cases in Python using Pydantic framework.• Hands on experience of using Azure DevOps CI/D Pipelines, ARM Template, YAML files.• Created Dashboards using Power BI.

Noida

Gurgaon, India

New Delhi Area, India

Database development and maintenance.