Jayakrishna Reddy Karri Email & Phone Number

Richardson, Tx, Us

Texas, United States

- Developed an Audit Balance and Control (ABC) framework to configure metadata, ensuring accurate balancing and control of data pipelines and enhancing data integrity.- Spearheaded the development of data pipelines while implementing robust monitoring and performance management strategies to optimize data flow and system efficiency.- Produced comprehensive technical documentation and implementation models for internal applications, facilitating clear communication and knowledge transfer within the team.- Extracted and transformed data from various sources, including text files, CSV, XML, JSON, and databases such as Oracle, MySQL, and Vertica, utilizing best practices in data warehousing and business intelligence.- Set up Apache ActiveMQ for asynchronous processing and developed a data pipeline using AWS Glue (PySpark) and Kafka to ingest and model data into Snowflake, implementing role-based access controls and optimizing cloud data warehouse performance.- Read files from AWS S3, transformed the data, and loaded it into the database. Designed the product with best practices and trends in BI and Data Warehousing.- Developed complex search queries in Splunk to extract actionable insights from large datasets, facilitating troubleshooting and root cause analysis.- Developed a data pipeline using Kafka and Storm to store data in HDFS.- Build A Cloud Data Warehouse was in Snowflake, along with the design of data sharing accounts to securely distribute data to multiple consumers.- Snowflake data shares were created specifically for partner access.

Foster City, California, United States

- Designed an efficient ELT architecture to handle data from multiple sources, including APIs, SFTP, and AWS S3, into Hive and AWS Redshift, ensuring scalability and performance.- Assisted in scripting and web development projects, enhancing team performance with technologies like Flask and JavaScript.- Created a metadata-driven ELT framework using control tables, improving the flexibility and governance of data processing workflows.- Participated in implementing CI/CD pipelines using Azure DevOps and Git, streamlining deployment processes.- Developed an ELT framework for large-scale data migration from AWS Redshift to Snowflake, facilitating seamless data transition and improved query performance.- Configured Kafka for real-time data handling and developed applications utilizing Kafka as both a traditional messaging queue and a streaming platform.- Implemented Splunk for log aggregation, centralizing logs from various sources for streamlined monitoring and analysis, and configured alerts for critical events.- Built custom components within Talend using Python scripts and developed reusable Talend joblets to standardize dimension and fact data load processes, optimizing performance and reducing redundancy.

Richardson, Texas, United States

- Defined and implemented scalable Talend architecture to support current and future data workflows.- Optimized Talend jobs for performance, improving data processing speed while minimizing resource use.- Developed custom Talend components using Java routines to extend functionality for unique business needs.- Created modular Talend jobs and joblets, ensuring reusability and efficient data transformations.Automated and scheduled Talend workflows in TAC, monitoring performance and ensuring pipeline continuity.- Designed and optimized SQL queries and file formats in Snowflake for efficient data loading and processing.- Utilized Snowflake’s COPY command to load data from Azure, ensuring fast and accurate data transfers.- Developed pipelines to transfer data between Azure Data Lake and Blob Storage, ensuring reliable data movement.- Configured Snowpipe for automated data ingestion, enabling near-real-time updates from Azure to Snowflake.

Bengaluru, Karnataka, India

- Led the design and development of ETL architectures and data mappings, ensuring efficient data movement and transformation based on business requirements.- Conducted impact analysis on source data changes, identifying potential risks and ensuring data integrity across systems.- Developed and maintained EME scripts in Ab Initio’s Enterprise Meta>Environment (EME), enhancing version control and team collaboration.- Designed and implemented an automation framework for multi-partner data integration, reducing redundancy and streamlining processes.- Built an automation reconciliation framework using metadata programming for accurate input-output data comparison.- Created reusable components, improving development efficiency and reducing time across projects and releases.- Worked extensively with Ab Initio features like Plans, PDL, and publish components for complex data processing tasks.- Delivered high-quality solutions with strict adherence to testing and validation, ensuring zero defects in production environments.