Devika G Email & Phone Number

New York, United States

As a GCP Data Engineer, I have extensive experience in architecting and building robust data pipelines, focusing on end-to-end ETL and ELT processes for data ingestion and transformation within the Google Cloud Platform (GCP). My role involves coordinating tasks across teams to ensure seamless integration and efficient data flow. I have designed and implemented scalable data ingestion pipelines, utilizing GCP tools such as Cloud Dataflow, BigQuery, and Cloud Pub/Sub to streamline data processes. One of my notable projects includes successfully integrating data from Firestore to BigQuery, where I developed a real-time streaming pipeline, ensuring data is available for immediate analysis and reporting. My work also involves optimizing data pipelines for performance and scalability, managing large datasets, and implementing data validation and security measures to maintain data integrity throughout the process.

Chicago, Illinois, United States

I have contributed significantly to the development and maintenance of Spark Applications using Scala and Python, collaborating closely with data development and software engineering teams to optimize performance and ensure seamless integration. My expertise in cloud computing, particularly on the AWS platform, has been instrumental in promoting customer success by designing, building, and migrating applications, software, and services to the AWS Cloud. This includes leveraging key AWS services such as IAM, S3, EMR, Lambda, SNS, Data Lakes, Glue, Athena, and Redshift to create robust, scalable cloud solutions. I played a pivotal role in converting Ab-initio jobs into Spark Applications using Scala, deploying them on AWS EC2 instances to utilize the cloud infrastructure effectively. My responsibilities also included managing performance monitoring and tuning, where I identified and resolved issues to maintain optimal system performance.

Minnesota, United States

Having extensive experience in database management, data engineering, and cloud technologies, enabling me to deliver efficient and scalable solutions for complex business needs. My work involved creating and modifying SQL joins, sub-queries, indexes, stored procedures, triggers, and other T-SQL and PL/SQL code to implement critical business rules and automate various tasks. I also developed scripts to create new tables, views, and queries for enhancing applications, using tools like TOAD, and have been instrumental in improving database performance by 10% to 30% through the implementation of auto-scaling solutions tailored to meet fluctuating load requirements. My experience extends to working with BigQuery, where I downloaded data into pandas or Spark data frames for advanced ETL capabilities. In addition, I have designed and developed Docker container images, integrating them with Spring Boot to manage application life cycles efficiently.

Pune, Maharashtra, India

I have been extensively involved in developing and optimizing data processing applications using Apache Spark and Scala, performing a variety of tasks including data cleansing, validation, transformation, and summarization to meet specific business requirements. I have worked on loading data into Spark RDDs and executing in-memory data computations to generate required outputs efficiently. My expertise includes building robust data pipelines using Spark, Hive, and Sqoop for ingesting, transforming, and analyzing operational data, ensuring that data is processed and ready for further analysis. I have developed Spark jobs and Hive jobs to summarize and transform large datasets, with a strong focus on performance tuning. By adjusting configuration properties and utilizing techniques like broadcast variables, I have successfully optimized Spark applications to improve their performance, making them faster and more efficient. Additionally, I have worked on real-time data streaming using Spark with Kafka, handling streaming data from web server console logs, which is critical for real-time analytics and monitoring.

Delhi, India

I have been deeply involved in the analysis, design, and implementation of business user requirements, translating complex business needs into robust data solutions. My experience includes using Apache Spark for interactive queries, processing streaming data, and integrating with popular NoSQL databases to manage and analyze huge volumes of data. I have developed Spark programs using Python APIs to efficiently import data from Amazon S3, transform it within Spark Dynamic Frames, and convert it into DataFrames for further processing. These transformations and actions are crucial for deriving meaningful insights from large datasets. I have also worked extensively with Spark's core and SparkSQL libraries, developing high-performance Spark jobs for processing and analyzing data. My coding expertise in both Python and Scala has enabled me to create highly complex, maintainable, and efficient scripts that meet application requirements and facilitate data processing and analytics. Additionally, I have developed Pig Scripts for change data capture and delta record processing, ensuring that the data in HDFS is always up-to-date and accurate.

Master'S Degree, Information Science/Studies, 3.8

Bachelor'S Degree, Electrical, Electronics And Communications Engineering, 8.5