Shruthi T Email & Phone Number

United States

United States

As an experienced Data Engineer, I excel in designing and building modern data solutions using Azure PaaS services to support advanced data visualization and analytics. My expertise lies in extracting, transforming, and loading (ETL) data from diverse source systems into Azure data storage solutions, leveraging tools like Azure Data Factory, T-SQL, Spark SQL, and U-SQL.I develop and optimize Spark applications using PySpark and Spark-SQL for data extraction and transformation, helping to uncover valuable insights from complex datasets. I’m proficient in creating pipelines in Azure Data Factory, integrating multiple data sources such as Azure SQL, Blob storage, and Azure Data Warehouse to streamline data flow and processing.Additionally, I’ve implemented OLAP multi-dimensional cube functionality using Azure SQL Data Warehouse, and I’m skilled in performance tuning of Spark applications, ensuring efficient data processing. My experience extends to writing custom UDFs in Scala and PySpark, automating deployment with Azure PowerShell and JSON scripts, and managing builds and releases with Visual Studio Team Services (VSTS).I thrive in Agile environments, using JIRA for project management, and have been actively involved in projects focused on dimensional modeling, data migration, data cleansing, and ETL processes.

India

As a Data Engineer, I specialize in building robust data pipelines and ETL processes using Azure Data Factory (ADF) and Azure services like ADLS, Azure SQL, and Blob Storage. I’ve designed and implemented data ingestion and transformation workflows, ensuring data quality and consistency across various platforms.My expertise includes leveraging Spark SQL/Streaming within Azure Databricks for fast data processing and integrating RDBMS systems for seamless data migration. I’ve also automated workflows using Airflow, developed ETL solutions with PySpark, and optimized deployment through CI/CD processes with Azure Key Vault.Additionally, I utilize tools like Grafana and Prometheus to monitor and optimize application performance, and I create impactful Power BI visualizations, enabling data-driven insights and decision-making for business stakeholders.

India

Experienced Data Engineer with a strong background in designing and implementing streaming ETL pipelines using AWS services, Snowflake, and Airflow. Proficient in building and deploying containerized applications with Docker, Kubernetes, and ECR. Skilled in optimizing SQL queries for Snowflake and fine-tuning Spark jobs on AWS Glue and EMR.I’ve successfully migrated on-premises platforms to AWS Data Lake, ensuring scalability and reliability, and implemented CI/CD processes using GitHub workflows. My expertise extends to data transformations, quality checks, and leveraging Open Telemetry for resource optimization. I’m actively involved in all phases of the Agile development life cycle, consistently driving efficiency and data accuracy.

Master'S Degree, Computer Science

Bachelor Of Technology - Btech, Computer Science