Arun B Email & Phone Number

Nashville, Tennessee, United States

At HCA Healthcare in Nashville, TN, responsible for designing and implementing data pipelines, ETL processes, and data lake architectures using GCP, Snowflake, and BigQuery. Migrated on-premise workloads to Google Cloud and automated the loading of real-time data using Cloud Dataflow and Pub/Sub. Managed cloud infrastructure utilizing AWS and GCP services such as EC2, S3, VPC, and IAM. Developed CI/CD pipelines, optimized data processing using PySpark, and performed statistical analysis and visualization with Python and R. Worked extensively on data migration, real-time data processing, and cloud architecture.

Huntsville, Alabama, United States

As a Data Engineer at Progress Bank Alabama, built and architected multiple scalable data pipelines for large-scale data ingestion, transformation, and analytics using Hadoop, Spark, and Snowflake. Migrated on-premise data to GCP BigQuery and designed near-real-time ETL workflows with Apache Airflow in GCP. Managed Cloudera clusters in Azure, integrated NoSQL databases like Cassandra and HBase, and executed data processing jobs on AWS EMR. Expertise in optimizing data processes with Python, Alteryx, and DevOps tools like Jenkins and Bamboo, while ensuring seamless integration across cloud platforms and on-prem environments.

India

As a Data Engineer at Tech Vulcan Solutions, developed and optimized on-prem Hadoop pipelines for data ingestion, storage, and processing using Flume, HDFS, and Apache Spark. Built ETL pipelines for moving data from Azure Data Lake to Azure SQL DB, leveraging tools like Apache Oozie and QlikView for workflow orchestration and report validation. Managed cloud infrastructure on GCP, implementing IAM policies, Kubernetes configurations, and GKE maintenance. Extensive experience with AWS services including S3, Glue, and EMR for processing large datasets. Automated ETL processes using Python, Spark, and Terraform to enhance data security and operational efficiency.

India

Contributed as a Hadoop Developer at Global Logic Technologies, focusing on designing and implementing an on-premises Hadoop pipeline for data ingestion using Flume. Engaged in storing data in HDFS, processing it through Apache Spark, and serving it in HBase. Developed and optimized data processing workflows to enhance performance and efficiency, while ensuring the reliability and scalability of the HDFS cluster. Collaborated with cross-functional teams to enforce data security measures, adhering to company policies and regulatory standards. Maintained knowledge of Hadoop ecosystem technologies, continually evaluating and integrating new tools to optimize performance.