At BCBS, I work as a Sr. Data Engineer, where I focus on turning complex business challenges into effective Big Data solutions. I’ve built and maintained data pipelines using tools like Spark, Scala, and Hadoop on GCP, and I manage Azure Data Factory pipelines to ensure smooth ETL processes. I also develop RESTful APIs for seamless data transfer and optimize SQL queries to extract valuable insights. My role involves driving data governance initiatives, automating workflows with Oozie, and… Show more At BCBS, I work as a Sr. Data Engineer, where I focus on turning complex business challenges into effective Big Data solutions. I’ve built and maintained data pipelines using tools like Spark, Scala, and Hadoop on GCP, and I manage Azure Data Factory pipelines to ensure smooth ETL processes. I also develop RESTful APIs for seamless data transfer and optimize SQL queries to extract valuable insights. My role involves driving data governance initiatives, automating workflows with Oozie, and working closely with cross-functional teams to create impactful data solutions across AWS, Azure, and GCP. Show less

As a Big Data Engineer at JP Morgan & Chase, I specialized in designing and deploying Hadoop clusters and a variety of Big Data tools, including Spark, Hive, and Kafka. My role involved migrating data from on-premises to cloud platforms, building data pipelines using Azure Data Factory and Databricks, and leveraging Spark and Scala for processing data on GCP. I implemented real-time data streaming with Kafka and Spark Streaming, developed Glue Jobs for data transformation, and optimized ETL… Show more As a Big Data Engineer at JP Morgan & Chase, I specialized in designing and deploying Hadoop clusters and a variety of Big Data tools, including Spark, Hive, and Kafka. My role involved migrating data from on-premises to cloud platforms, building data pipelines using Azure Data Factory and Databricks, and leveraging Spark and Scala for processing data on GCP. I implemented real-time data streaming with Kafka and Spark Streaming, developed Glue Jobs for data transformation, and optimized ETL processes with DBT. Additionally, I worked on migrating Hadoop systems to GCP, creating efficient data engineering solutions, and enhancing data quality through testing and advanced analytics. Show less

At Cisco, I contributed to migrating quality monitoring tools from Amazon EC2 to AWS Lambda, optimizing workflows on Snowflake, and automating cloud infrastructure using Terraform. My responsibilities included managing AWS services and IAM roles, designing dashboards with Tableau and Power BI, and integrating services like EC2, S3, and VPC. I also enhanced dashboard performance with Amazon QuickSight, monitored resources with CloudWatch, and developed Spark and Scala POCs. Additionally, I… Show more At Cisco, I contributed to migrating quality monitoring tools from Amazon EC2 to AWS Lambda, optimizing workflows on Snowflake, and automating cloud infrastructure using Terraform. My responsibilities included managing AWS services and IAM roles, designing dashboards with Tableau and Power BI, and integrating services like EC2, S3, and VPC. I also enhanced dashboard performance with Amazon QuickSight, monitored resources with CloudWatch, and developed Spark and Scala POCs. Additionally, I optimized PL/SQL queries and integrated Apache Airflow with SageMaker for automating machine learning processes. Show less

At Target, I played a key role in data analysis and Python development, focusing on data mapping, modeling, and maintaining data dictionaries. I collaborated with cross-functional teams to develop business solutions, integrated Teradata with R for BI platforms, and designed logical data models using Erwin. My responsibilities included guiding Hadoop solution life cycles, automating data processes with Oozie, and migrating data from RDBMS to NoSQL databases. I also developed PL/SQL triggers… Show more At Target, I played a key role in data analysis and Python development, focusing on data mapping, modeling, and maintaining data dictionaries. I collaborated with cross-functional teams to develop business solutions, integrated Teradata with R for BI platforms, and designed logical data models using Erwin. My responsibilities included guiding Hadoop solution life cycles, automating data processes with Oozie, and migrating data from RDBMS to NoSQL databases. I also developed PL/SQL triggers, stored procedures, and used various R techniques to prepare data for analysis and reporting. Show less

At Compact Systems Pvt Ltd, I worked as an ETL Developer, where I analyzed business requirements, revitalized key metrics, and built technology solutions to identify trends through data analytics and visualization. I translated business needs into effective BI reporting solutions using the Tableau BI suite and developed risk-treatment plans that improved project efficiency. Additionally, I conducted code reviews to ensure high-quality standards and maintained strong post-integration… Show more At Compact Systems Pvt Ltd, I worked as an ETL Developer, where I analyzed business requirements, revitalized key metrics, and built technology solutions to identify trends through data analytics and visualization. I translated business needs into effective BI reporting solutions using the Tableau BI suite and developed risk-treatment plans that improved project efficiency. Additionally, I conducted code reviews to ensure high-quality standards and maintained strong post-integration relationships with customers. My role also involved using shell scripts and PMCMD commands to perform essential ETL functions. Show less