Anshul Sachdeva Email & Phone Number

Bentonville, Ar, Us

Dublin 2, Ie

Dublin 2, Ie

Dublin 2, Ie

Dublin 2, Ie

- Designed and implemented a configuration driven ETL framework in python-spark to expedite the onboarding of new data assets.- Designed and implemented e2e Allocation engine using python and Bigquery native API’s having all standard ETL tool features.- Lead the data migration project having more than 1000 odd tables from Azure Synapse to GCP Bigquery and setup incremental process with reconciliation.- Strategies and implemented additional grain in whole finance data model for better plan and forecast.IDF (pyspark Framework) - Designed pyspark Configuration based framework to perform ETL and Functional reconciliation.- Implemented Salting techniques to optimize spark reads.- Built a common configuration-based data purging platform for whole finance domain.- This framework has reduced development and unit testing effort estimates of any new data mapping by 50%Allocation Engine (Python Framework)- Generic Framework written in python to orchestrate SQL queries using multi-threading with dependencies check.- It has various features like restart, configured retries, auditing, lineage and reconciliation with source.- This framework makes developers life easy and new mappings can be onboarded by non-technical Associates as well.

Dublin 2, Ie

- Lead the development and implementation of a data lake for the whole emirate covering all major sectors, resulting in a 40% increase in data accessibility.- Collaborated with different teams to setup common data platform.- Designed and implemented generic ETL pipeline using Alteryx and pyspark to curate and aggregate data for performant reporting.- Built data reconciliation framework to reconcile numbers between dashboards and data lake using web scrapping and SQL.

Dublin 2, Ie

- Created java-spark framework to parse policy/Quote (m: n hierarchies’ relationship) XML and ingest into tabular structure in Cassandra NOSQL database for downstream near real time reporting.- Created and enhanced Cassandra data model to improve better performance based on end user query pattern.- Designed multiple report extracts for External applications at near real time.- Performed nonfunctional performance testing in prod like environment to test production volume.

Dublin 2, Ie

- Created oozie workflows to migrate data from relational databases (SQL Server, DB2, Teradata and Flat Files) to Hadoop ecosystem using SQOOP.- Automated integration testing using Junit for flat files parsing.