As a Sr. Data Architect and Systems Architect with over 10 years of experience in the IT industry, I specialize in designing and implementing data architecture solutions that drive business value. My expertise spans systems architecture, big data, data analysis, and the development of high-performance data warehousing and software applications. I possess a strong foundation in business and data analysis, focusing on data profiling, migration, conversion, quality, governance, and metadata management. My proficiency in complex SQL allows me to perform in-depth data analysis across various source systems, facilitating informed decision-making.Throughout my career, I have developed efficient ETL processes, particularly utilizing AWS Glue to migrate data from external sources like Oracle and Parquet files into Snowflake. My experience with PySpark and AWS environments—including Lambda, Athena, and S3—has enabled me to build scalable and flexible data pipelines.I have successfully designed and implemented CI/CD pipelines using Azure DevOps and Git, streamlining deployment workflows and enhancing team productivity. My knowledge extends to big data frameworks such as Hadoop, Spark, and Kafka, and I am well-versed in building Snowflake SQLs, optimizing query performance, and managing cloud environments effectively.At Fannie Mae, I led the development of data pipelines, configured Apache ActiveMQ for asynchronous processing, and utilized Kafka and Storm to manage real-time data processing. I am adept at creating complex search queries in Splunk to derive actionable insights, ensuring robust monitoring and analysis capabilities.I hold certifications in Microsoft Azure, AWS Cloud, and Snowflake, and I am passionate about continuous learning in this rapidly evolving field. With a strong commitment to best practices in data governance and a collaborative approach to problem-solving, I excel in working with cross-functional teams to deliver innovative solutions that meet business objectives.I thrive in dynamic environments where I can leverage my skills in data architecture and analysis to drive efficiencies and enhance data-driven decision-making. Let’s connect to explore how I can contribute to your organization’s data strategy and analytics initiatives!
-
Data ScientistIb Stores LlcRichardson, Tx, Us
-
Sr Data Architect / Systems ArchitectFannie Mae Jul 2021 - PresentTexas, United States- Developed an Audit Balance and Control (ABC) framework to configure metadata, ensuring accurate balancing and control of data pipelines and enhancing data integrity.- Spearheaded the development of data pipelines while implementing robust monitoring and performance management strategies to optimize data flow and system efficiency.- Produced comprehensive technical documentation and implementation models for internal applications, facilitating clear communication and knowledge transfer within the team.- Extracted and transformed data from various sources, including text files, CSV, XML, JSON, and databases such as Oracle, MySQL, and Vertica, utilizing best practices in data warehousing and business intelligence.- Set up Apache ActiveMQ for asynchronous processing and developed a data pipeline using AWS Glue (PySpark) and Kafka to ingest and model data into Snowflake, implementing role-based access controls and optimizing cloud data warehouse performance.- Read files from AWS S3, transformed the data, and loaded it into the database. Designed the product with best practices and trends in BI and Data Warehousing.- Developed complex search queries in Splunk to extract actionable insights from large datasets, facilitating troubleshooting and root cause analysis.- Developed a data pipeline using Kafka and Storm to store data in HDFS.- Build A Cloud Data Warehouse was in Snowflake, along with the design of data sharing accounts to securely distribute data to multiple consumers.- Snowflake data shares were created specifically for partner access. -
Sr Lead Data EngineerGilead Sciences Mar 2018 - Jun 2021Foster City, California, United States- Designed an efficient ELT architecture to handle data from multiple sources, including APIs, SFTP, and AWS S3, into Hive and AWS Redshift, ensuring scalability and performance.- Assisted in scripting and web development projects, enhancing team performance with technologies like Flask and JavaScript.- Created a metadata-driven ELT framework using control tables, improving the flexibility and governance of data processing workflows.- Participated in implementing CI/CD pipelines using Azure DevOps and Git, streamlining deployment processes.- Developed an ELT framework for large-scale data migration from AWS Redshift to Snowflake, facilitating seamless data transition and improved query performance.- Configured Kafka for real-time data handling and developed applications utilizing Kafka as both a traditional messaging queue and a streaming platform.- Implemented Splunk for log aggregation, centralizing logs from various sources for streamlined monitoring and analysis, and configured alerts for critical events.- Built custom components within Talend using Python scripts and developed reusable Talend joblets to standardize dimension and fact data load processes, optimizing performance and reducing redundancy. -
Sr Data EngineerCvs Health Aug 2016 - Feb 2018Richardson, Texas, United States- Defined and implemented scalable Talend architecture to support current and future data workflows.- Optimized Talend jobs for performance, improving data processing speed while minimizing resource use.- Developed custom Talend components using Java routines to extend functionality for unique business needs.- Created modular Talend jobs and joblets, ensuring reusability and efficient data transformations.Automated and scheduled Talend workflows in TAC, monitoring performance and ensuring pipeline continuity.- Designed and optimized SQL queries and file formats in Snowflake for efficient data loading and processing.- Utilized Snowflake’s COPY command to load data from Azure, ensuring fast and accurate data transfers.- Developed pipelines to transfer data between Azure Data Lake and Blob Storage, ensuring reliable data movement.- Configured Snowpipe for automated data ingestion, enabling near-real-time updates from Azure to Snowflake. -
Data EngineerTrigent Software Inc Jul 2011 - Aug 2016Bengaluru, Karnataka, India- Led the design and development of ETL architectures and data mappings, ensuring efficient data movement and transformation based on business requirements.- Conducted impact analysis on source data changes, identifying potential risks and ensuring data integrity across systems.- Developed and maintained EME scripts in Ab Initio’s Enterprise Meta>Environment (EME), enhancing version control and team collaboration.- Designed and implemented an automation framework for multi-partner data integration, reducing redundancy and streamlining processes.- Built an automation reconciliation framework using metadata programming for accurate input-output data comparison.- Created reusable components, improving development efficiency and reducing time across projects and releases.- Worked extensively with Ab Initio features like Plans, PDL, and publish components for complex data processing tasks.- Delivered high-quality solutions with strict adherence to testing and validation, ensuring zero defects in production environments.
Jayakrishna Reddy Karri Skills
Jayakrishna Reddy Karri Education Details
-
Computer Science
Frequently Asked Questions about Jayakrishna Reddy Karri
What company does Jayakrishna Reddy Karri work for?
Jayakrishna Reddy Karri works for Ib Stores Llc
What is Jayakrishna Reddy Karri's role at the current company?
Jayakrishna Reddy Karri's current role is Data Scientist.
What schools did Jayakrishna Reddy Karri attend?
Jayakrishna Reddy Karri attended Amrita Vishwa Vidyapeetham.
What skills is Jayakrishna Reddy Karri known for?
Jayakrishna Reddy Karri has skills like Leadership, Power Generation, Scada, Generators, Object Oriented Programming, Event Planning, R (Programming Language, Pega, Communication, Web Development, Team Management, Survey Research.
Not the Jayakrishna Reddy Karri you were looking for?
-
Jayakrishna Reddy Karri
Richardson, Tx
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial