Sai Surya Email & Phone Number

United States

Dallas, Texas, United States

Led the migration of critical datasets from on-prem SQL servers to Google Cloud which improved data scalability and reduced the cost by almost 40%. Managed the pipelines during the unpredictable workloads avoiding server failure. Implemented a highly available, fault-tolerant Kubernetes infrastructure, automating workflows using Apache Beam, Kubeflow, and Python-based REST APIs. Streamlined project management through Agile methodology, optimizing deployment processes and ensuring timely delivery of financial and regulatory reports.

Plano, Texas, United States

Architected and developed end-to-end ETL/ELT pipelines on Google Cloud, focusing on scalable data lake design and star schema implementation in BigQuery to optimize analytics. Leveraging Cloud Functions, Dataflow, and Apache Beam, I automated data ingestion and transformation for both streaming and batch processing. Additionally, I led a proof of concept for migrating on-prem workloads to GCP, utilizing services like GCS, BigQuery, Cloud SQL, and Cloud Dataproc.

St Louis, Missouri, United States

Led the migration of data from on-premises MS SQL databases to AWS Redshift using AWS Database Migration Service and AWS DataSync. Ensured the implementation of data migration security of rest data and transit data using tools like Amazon CloudFront and SSE. Implemented CloudFormation templates for EC2 instance deployment and used Kubernetes for container orchestration. Integrated AWS Lambda with SQS and DynamoDB using Step Functions and performed data ingestion and transformation via Streamsets and Kinesis, supporting large-scale data processing for over million records daily.

Hyderabad, Telangana, India

Developed and managed a Hadoop-based data lake by extracting and ingesting data from various sources like Teradata, Mainframes and RDBMS into HDFS. Deployed and expanded Hadoop clusters using tools like Pig, Hive, HBase and Sqoop for data processing. Built scalable distributed data solutions using Spark with Scala, Spark SQL and Data Frames. Created and scheduled Oozie workflows to automate the running of Hive and Pig jobs. Also, supported API development and worked with Informatica for monitoring and debugging ETL components in production.

Hyderabad, Telangana, India

Worked with an insurance client to design and implement multiple ETL pipelines using SSIS packages. I managed data extraction from both structured and unstructured in-house systems, transformed the data according to client specifications, and loaded it into data warehouse. Additionally, I automated report generation and supported data migration for analysis across multiple data sources.