Ayush Sengar Email & Phone Number

Gurugram, Hr, In

Gurugram, Haryana, India

Insurance Data Platform Migration from on-prem to Azure• Overview: To create a platform independent data-driven cloud solution and migrate the process from on prem systems related to insurance data into single consistent data warehouse for performing advanced analytics.• Data Modelling: Created mapping documents and followed backward approach to understand table hierarchy and granularity which has been used by new data flow.• Data preparations and ETL: Converted complex Informatica transformations into reusable ADF pipelines to increase performance, modularity and scalability to ingest from various legacy system.• Data Governance: Used Query Surge tool for end-to-end data validation and power automate to notify end users through automatic email notifications. Provided continued support to eliminate data silos and maintain data lineage.• Pipeline deployment: Worked on Azure Devops for deployment of validated code across QA, UAT and production environment via Azure Devops.• Automated API solution: Created a solution to dynamically flatted the JSON files data for more than 70 objects using single ADF pipeline and store the data to Azure SQL DB tables with enabled quality checks and alert email triggering in case of any data discrepancies.

Gurugram, Haryana, India

Gathering & transforming structured/unstructured data from multiple sources for reporting as well as analytic purpose for leading Healthcare client• Data analysis: Analyzed the business requirements and accordingly decided which data flows can be re-used from existing system and which files and inputs are required from clients.• Data gathering: Required files were received on AWS S3 location in parquet format. Files were read using PySpark and loaded into AWS S3 storage location as tables using internal REVO ETL tool.• Data transformations and pipelines: Created the fact, dimension and reporting layers according to business rules. Created the transformation pipelines in REVO tool using PySpark and executed using EMR. Loaded data to Redshift to generate reports and analytic purpose.• Automated Quality checks: Created a python script which was reading SQL scripts and table details from Excel file to perform quality check and notify team via email in case of any QC failures.• Cluster Management: Handled the cluster restoration, backup, scaling up and scaling down of multiple EMR clusters used in project development.

Bangalore Urban, Karnataka, India

Created Azure based cloud Datawarehouse by performing ETL's over different types of data for an education client.• Data Gathering & File list preparation: Provided the solution to read multiple .csv files received at FTP location by creating file list using Python script and to load files using single mapping in Informatica cloud.• Data transformation and loading: Created mapping to load the raw data to Azure DB staging tables and then finally implementing business rules and data transformation logics on Staging tables using IICS transformations and stored procedures.• Dashboard Creation: Provided the frontend team with materialized views and normal views to be used for Dashboard generation.• Object Deployment: Worked on Azure Devops for deployment of code to QA, UAT and Prod environment. Maintaining version control for IICS and DB codes on Azure Devops.• Optimizing Process: Improvements and enhancements in Stored Procedures and replacing logics of stored procedures by ETL logics.• Automated Quality checks: Created a validation table in DB which captures the query and validation status. On top of it, IICS was capturing these details and notifying teams in case of any failures.

Bangalore Urban, Karnataka, India

Bangalore