Pratham Yadav Email & Phone Number

New Delhi, Dl, In

Gurugram, Haryana, India

• Designed and implemented an end-to-end ETL pipeline using Apache NiFi and Python, processing data from S3 bucketsto support the ISDM Ki open-source data platform.• Developed custom Python scripts for advanced data transformation and validation, ensuring high data quality andconsistency across millions of records.• Utilized PySpark for large-scale data processing, implementing complex data checks, currency conversions, and optionmappings.• Managed multi-layer data storage strategy, including raw data layer in Apache Hive and knowledge layer in PostgreSQL,handling schema evolution and data upserts.• Implemented robust error handling and logging mechanisms, enhancing data traceability and facilitating efficientdebugging processes.• Optimized database queries and data processing functions, significantly improving performance for large datasets.• Developed and maintained data quality management systems, including null value treatment, data type conversions, andduplicate record handling.• Worked with multiple database systems (PostgreSQL, Apache Hive) and big data technologies (Apache NiFi, ApacheSpark) to create a scalable and efficient data platform.

Gurugram, Haryana, India

• Led automation initiatives within Atkins Global’s finance department, leveraging Python scripts to streamline daily andweekly tasks, enhancing operational efficiency and accuracy.• Designed and developed comprehensive finance dashboards utilizing HR department data to provide insightful analysisand reporting for informed decision-making within the organization’s finance department.

Delhi, India

• Implemented robust data extraction pipelines using Python to parse information from PDFs, coupled with web scrapingtechniques using BeautifulSoup and Scrapy. Orchestrated seamless database connectivity and storage tailored to clientspecifications, ensuring efficient data management and retrieval.• Provided foundational backend support in MongoDB during the initial phases of development, ensuring seamless datastorage, retrieval, and management for scalable and efficient application architecture.