Varun Reddy Email & Phone Number

United States

Pittsburgh, Pennsylvania, United States

Designed and implemented scalable data architectures using GCP services like BigQuery, GCS, and Dataproc.Developed ETL/ELT pipelines with Google Cloud Dataflow, Apache Beam, and Hadoop ecosystem tools.Optimized PySpark performance for batch and streaming ETL tasks.Managed real-time data processing with Google Cloud Pub/Sub and Dataflow.Utilized Google BigQuery for data warehousing and analytics.Automated pipelines using Terraform and Google Cloud Deployment Manager.Integrated machine learning models with Vertex AI for predictive analytics.Ensured data governance with Google Data Catalog and tools like Collibra and Alation.Mentored junior engineers and implemented GCP best practices.

New Mexico, United States

Developed complex data engineering solutions using Databricks and Delta Lake on AWS for unified analytics and data lake management.Implemented data encryption with AWS KMS and HSM to secure sensitive healthcare data.Employed AWS Lambda for scalable, cost-effective data processing workflows.Managed data lakes on AWS Lake Formation for efficient storage and retrieval.Used AWS Kinesis and AWS Data Pipeline for real-time data ingestion and processing in healthcare.Integrated data pipelines with EHR systems (Epic, Cerner) for seamless data flow and analytics.Leveraged edge computing with AWS Greengrass to process healthcare data closer to the source.Managed cloud-native data warehousing using Amazon Redshift and Redshift Spectrum for scalable analytics.Automated infrastructure deployment with AWS CloudFormation and Terraform.Designed scalable data pipelines using Apache Spark, Kafka, and Flink on AWS for real-time and batch processing.Architected data solutions with AWS Glue, Data Pipeline, and Dataflow.Managed Hadoop clusters with Cloudera and Hortonworks distributions on AWS for high availability.Developed real-time data processing pipelines with Apache Kafka and Kafka Streams on AWS.Implemented real-time analytics using Apache Flink and Spark Streaming on AWS.Built robust ETL processes with AWS Glue, Talend, and Apache NiFi for large data volumes.Ensured data security and compliance in healthcare using AWS IAM for encryption and access management.Designed fault-tolerant data pipeline architectures on AWS for high availability and reliability.

San Francisco Bay Area

Designed and maintained ETL pipelines using Apache Nifi, Talend, and Informatica.Built scalable data pipelines with Apache Kafka, Apache Flink, and Python for real-time and batch processing.Utilized Apache Spark for large-scale data processing, machine learning, and analytics.Implemented data solutions on AWS, Azure, and Google Cloud using S3, Redshift, BigQuery, Azure Synapse, and Databricks.Managed cloud-based data warehouses including Snowflake, Google BigQuery, and Amazon Redshift.Handled real-time data ingestion and processing with Kafka Streams, AWS Kinesis, and Google Pub/Sub.Employed Google Dataflow and AWS Glue for efficient data processing and transformation.Designed and managed databases such as MySQL, PostgreSQL, SQL Server, MongoDB, and Cassandra.Automated data pipelines and workflows with Apache Airflow and Google Cloud Composer.Ensured data security and compliance with GDPR, CCPA, and HIPAA regulations.Implemented infrastructure as code using Terraform and AWS CloudFormation.Optimized data queries and storage solutions for performance and scalability using Python and Scala.Developed dashboards and reports using Power BI, Tableau, and Looker.Monitored ETL jobs and real-time data streams using Grafana and Prometheus.Collaborated with cross-functional teams to gather requirements and translate them into technical specifications.

California, United States

Designed and managed ETL processes using Apache NiFi and Apache Airflow for seamless data integration.Integrated real-time data from EHR and CRM systems with Apache Kafka for continuous data streaming.Developed scalable data warehouse solutions using Snowflake and Google BigQuery.Optimized data storage and retrieval with Apache Parquet for efficient analytical querying.Ensured data accuracy and quality with Great Expectations and implemented data governance with Collibra.Created and presented insights through data visualizations using Tableau and Power BI.Monitored and improved data pipelines and performance with New Relic for enhanced efficiency.Collaborated with data scientists to integrate machine learning models into pipelines using TensorFlow for advanced analytics.

Pune, Maharashtra, India

Utilized Informatica to build and optimize data integration pipelines.Integrated diverse data sources including relational databases, NoSQL databases, flat files, and APIs.Implemented data cleansing and transformation processes to ensure high data quality and consistency.Developed reports and dashboards using Power BI and Tableau for actionable insights.Deployed and managed ETL pipelines and data solutions on AWS and Google Cloud.Implemented data governance and security protocols to ensure compliance and data protection.Developed automated scripts using Python for ETL process validation, scheduling, and monitoring.

Ahmedabad, Gujarat, India

Experienced SQL Developer skilled in all phases of the Software Development Lifecycle (SDLC), from design to deployment.Proficient in Oracle SQL and PL/SQL, creating complex database objects and managing data operations.Expert in SSIS for data integration and SSRS for developing various types of reports to support business needs.Managed SQL Server environments, ensuring high availability through backup, recovery, and clustering.Optimized database performance with advanced tuning techniques and effective data structuring.