Sai Teja Reddy Email & Phone Number

Dallas, Texas, United States

• At Capital One, I worked as a GCP Data Engineer on the Integrated Credit Risk Analytics Platform, a key initiative aimed at improving credit assessment processes through the application of advanced analytics and.
• Developed and maintained ETL pipelines to extract, transform, and load (ETL) data from various sources into Snowflake, ensuring high-quality, timely data for credit risk analysis.
• Leveraged GCP services such as Google Cloud Storage for staging data and Cloud Dataflow for batch and stream processing, enabling efficient data ingestion and transformation workflows.
• Built credit risk analytics pipelines using BigQuery, Dataproc, and Cloud Storage to support machine learning workflows.
• Implemented real-time streaming pipelines using Cloud Pub/Sub, reducing data processing time upto 25%.
• Implemented real-time event-driven pipelines using Cloud Pub/Sub, reducing data latency.

Eden Prairie, Minnesota, United States

• Designed and built scalable, distributed data pipelines to ingest and process customer data from multiple sources.
• Developed and managed data solutions within a Hadoop Cluster environment using Hortonworks distribution.
• Created persistent customer keys to unify customer data across various accounts and systems.
• Developed distributed data processing solutions in PySpark to handle large-scale datasets in AWS EMR.

Tampa, Florida, United States

• As a Data Engineer at Verizon, I was responsible for designing and implementing scalable data pipelines using GCP tools to support large-scale data analytics. Leveraging BigQuery for data storage and analysis, I.
• Integrated data from various sources, including HDFS and HBase, into Spark RDDs to enable distributed data processing and analysis.
• Integrated disparate data sources (HDFS, HBase) into a unified platform using GCP services such as Cloud Storage and Data proc.
• Built and optimized data pipelines using PySpark for processing and validating large datasets, ensuring data accuracy and quality.
• Automated workflows using Apache Airflow and implemented Pub/Sub for real-time data synchronization.
• Created data models and Tableau dashboards to visualize operational insights for stakeholders.

Bengaluru, Karnataka, India

• I worked as a Data Engineer on a Customer Data Platform project that centralized customer data from various sources, including CRM systems and web analytics platforms. I developed robust ETL pipelines using Apache.
• Developed various spark applications using Scala to perform various enrichment of these click stream data merged with user profile data.
• Developed Spark code in Python and Spark SQL environment for faster testing and processing of data and loading the data into Spark RDD and doing In-memory computation to generate the output response with less memory.
• Worked on Scala code base related to Apache Spark performing the Actions, Transformations on RDDs, Data Frames and Datasets using Spark SQL and Spark Streaming Contexts.

Chennai, Tamil Nadu, India

• I worked on a project focused on developing a big data processing framework to analyze large volumes of unstructured data. The project involved designing and implementing data ingestion pipelines using Apache Flume and.
• Developed and maintained large-scale data ingestion pipelines using Apache Hadoop components such as HDFS, MapReduce, and Hive to process terabytes of data daily.
• Integrated data from multiple sources like relational databases, flat files, and logs into Hadoop HDFS for efficient storage and processing.
• Implemented MapReduce jobs to transform and aggregate data, performing batch processing on massive datasets.
• Worked with Hive and Pig for querying and analyzing large datasets stored in HDFS, optimizing performance for data analysis.