Punith Krishna Pothula Email & Phone Number

Los Angeles, California, United States

• Managed and contributed to open-source software Web-Karma, a GUI-based data integration tool to combine heterogeneous datasets using ontologies, fixed security vulnerabilities• Refactored code base, enhanced extension support, and integrated text search for 100M+ entities leveraging Wikidata APIs and Elastic Search• Designed and Implemented Transformation API to apply user-defined transformation logic on target columns

Westford, Massachusetts, United States

Bengaluru, Karnataka, India

• Designed and led Apache Spark-based generic data loader framework, helped in reducing overall effort spent on building a batch job by 90%, enabled data loads from multiple sources to targets by applying custom transformation logic to data pipelines• Led a team of 4 in NodeJS-based backend development for an ML-driven application, utilizing the Backend For Frontends microservice design pattern.Directed team in designing and implementing the application's database architecture• Managed a data engineering team of 7 and migrated a sales forecasting project from Azure to GCP, collaborated with the operations team, and scheduled monthly level runs using Apache Airflow• Developed a GitOps pipeline that uses DDL and DML scripts versioned in the GitHub repository to deploy tables in Google BigQuery target environments ( dev, stage, prod ). The pipeline template was leveraged across multiple data engineering teams in Walmart.• Redesigned and enhanced Walmart's patented Travel Bot project by migrating its data sources from Hadoop and Hive to Azure SQL; further innovated by developing a generic parser to extract diverse airline contracts for optimized application functionality.

Bengaluru Area, India

• Spearheaded development of metadata harvesters for RDBMS (SQL DB) and File Storage(ADLS) that scans metadata and posts it to Apache Atlas for tracking data lineage across data pipelines, improving visibility and traceability of data pipelines by 80%• Designed and integrated custom TypeDefs in Apache Atlas to store RDBMS and ADLS metadata in JSON.• Built a Spark-based Data Quality (DQ) Engine, decreasing DQ assessment effort by 70% and enhancing DQ scoring efficiency by 80%. Demonstrated leadership, fostered collaboration, and achieved enhancement in data governance practices• Collaborated with the Microsoft team and designed a DevOps Architecture to isolate the production and development Integration Runtimes for continuous deployment. • Developed an API wrapper for the Data Governance Tool, Collibra, resulting in a reduction of effort and time from a few hours(manual) to 30s, to capture and report data quality scores to business stakeholders• Collaborated with business stakeholders to develop a dashboard to download data quality and comparison reports, resulting in a 70% reduction in manual effort and time taken to generate these reports for day-to-day business operations

Bengaluru Area, India

• Engineered and implemented a robust Python automation suite that streamlined the data migration process, significantly reducing manual effort and leading to an 80% increase in project efficiency.• Developed a command line tool to generate Data Quality reports across different markets, saving 20+ hours of manual effort per week.• Developed a Proof of Concept (POC) using on blockchain using Hyperledger Sawtooth for a supply chain use case

Bengaluru Area, India

Worked in field of Deep Learning and Robotics.

Bengaluru Area, India

Bengaluru Area, India

Master Of Science - Ms, Computer Science

Activities and Societies: Course Producer for CSCI 572

Bachelor Of Engineering - Be, Computer Science, 9.27 / 10

Class 12, 92.8%

Class 10, 9.60 / 10