Divya R Email & Phone Number

United States

Hyderabad, Telangana, India

# Project - HSBC* Designed and architected multiple data pipelines encompassing ETL and ELT processes within Google Cloud Platform (GCP).* Coordinated tasks among team members to ensure seamless data ingestion, transformation, and integration.* Applied various statistical techniques and utilized data mining tools such as Python (Scikit-Learn, Pandas, NumPy, Matplotlib) and SQL to derive actionable insights from raw data.* Utilized GCP services like Cloud Storage, Cloud Pub/Sub… Show more # Project - HSBC* Designed and architected multiple data pipelines encompassing ETL and ELT processes within Google Cloud Platform (GCP).* Coordinated tasks among team members to ensure seamless data ingestion, transformation, and integration.* Applied various statistical techniques and utilized data mining tools such as Python (Scikit-Learn, Pandas, NumPy, Matplotlib) and SQL to derive actionable insights from raw data.* Utilized GCP services like Cloud Storage, Cloud Pub/Sub, and GKE (Google Kubernetes Engine) to build robust data processing pipelines for analytics and reporting.* Automated GKE cluster deployment and management using Terraform and Kubernetes, optimizing development and deployment workflows.* Worked with Apache Spark in Scala for ETL jobs, handling diverse file formats and optimizing data loading into HDFS and ORC Reader for efficient querying.* Explored and compared Hadoop ecosystem components (HDFS, HBase, YARN, MapReduce) with GCP's Data Proc and BigTable for performance enhancements.* Contributed to a platform modernization project by migrating data to GCP, leveraging services like Dataproc, GCS, Cloud Functions, and BigQuery for scalable data management and analytics.* Developed machine learning models in Python and PySpark for predicting attendance in campaigns and events, integrating predictive analytics into data pipelines.* Utilized Matplotlib, Seaborn, and Tableau for data visualization, creating dashboards and generating comprehensive reports to interpret findings for stakeholders. Show less

Hyderabad, Telangana, India

# Project 1: CareFirst* Led successful migrations of data from file systems, SQL Server, and Teradata to Snowflake and Amazon S3.* Enhanced real-time insights by integrating external data sources using APIs and connectors.Designed and implemented data pipelines for processing and analyzing subscriber data, improving operational efficiency.* Implemented techniques that significantly reduced report generation times.* Utilized AWS Glue, EC2, and S3 for data extraction… Show more # Project 1: CareFirst* Led successful migrations of data from file systems, SQL Server, and Teradata to Snowflake and Amazon S3.* Enhanced real-time insights by integrating external data sources using APIs and connectors.Designed and implemented data pipelines for processing and analyzing subscriber data, improving operational efficiency.* Implemented techniques that significantly reduced report generation times.* Utilized AWS Glue, EC2, and S3 for data extraction, transformation, validation, and cleansing.* Developed Python scripts for automating AWS services, ensuring scalable data workflows.* Managed complex SQL and NoSQL databases (e.g., Snowflake) with expertise in SQL, PL/SQL scripts, and Spark SQL.* Developed SQL scripts for handling sensitive data while maintaining security standards.# Project 2: Estée Lauder Companies* Implemented scalable data pipelines using AWS Glue, AWS Lambda, and AWS Step Functions to ingest and transform customer behavioral data into Amazon S3 for analysis.* Leveraged AWS EMR clusters, AWS Athena, Redshift, and QuickSight for analyzing large datasets and deriving actionable insights.* Developed ETL processes using AWS Glue and Amazon RDS to ensure data quality and performance for reporting applications.* Built real-time analytics pipelines with Amazon Kinesis, Lambda, and CloudWatch for continuous monitoring and analysis of streaming data.* Implemented robust security measures using AWS Lambda and DynamoDB to manage access control and ensure data security compliance in Amazon S3.* Conducted comprehensive assessments of AWS services (AWS Glue, Amazon Redshift, S3, Lambda) to optimize architecture and implementation strategies for performance and scalability. Show less

Master Of Science - Ms, Computer Science

Bachelor Of Science - Bs, Computer Science