Vasanth Gupta Email & Phone Number

Rhode Island, United States

As a skilled Azure Data Engineer, I led projects leveraging Azure cloud services such as Azure Data Factory (ADF), Azure Databricks, and Azure SQL databases. My expertise in ADF enabled the seamless orchestration and transformation of data, designing end-to-end ETL pipelines integrating data sources as Azure Synapse Analytics and Cosmos DB, SharePoint, flat files, and APIs. Leveraging DBT(Data Build Tool), I have done efficient data transformations and stored in the form of sql models. Created almost 100 sql models in DBT(Data build tool) with the .yml file for each model to better understand the purpose of each column and for documentation purposes. Utilizing Azure Monitoring Services, I monitored pipelines, promptly addressing any issues to maintain uninterrupted data flow. Used Azure Databricks for data processing and validation, utilizing PySpark for manipulation. I ensured data quality and efficient storage using Delta Lake's Unity Catalog, creating structured YAML files for versioned configurations. My contributions extended to comprehensive documentation on Confluence, facilitating team understanding, and managed version control through GitHub, ensuring an organized and collaborative development environment.

New York, United States

As a Senior Data Engineer at DTCC, I designed and implemented both real-time and batch data pipelines. I developed and maintained data integration solutions using Visual Studio and SQL Server Integration Services (SSIS). To automate data workflows and improve data quality, I utilized scripting languages such as Python and UNIX Shell Scripting. I collaborated with cross-functional teams to design effective data solutions, ensuring the implementation of data models using data modeling tools like Erwin Data Modelling Tool.I also implemented data governance policies and ensured compliance with regulatory requirements. To monitor and optimize data processing performance, I used monitoring and diagnostic tools. I provided technical guidance to junior team members and collaborated with other senior engineers to drive innovation and improve data solutions. Finally, I kept up-to-date with emerging data technologies and trends, recommending new tools and technologies to improve data processing and analysis.

St Louis, Missouri, United States

As a data engineer at Centene Corporation, I developed and maintained data pipelines using Python and Flask. I utilized NumPy and Pandas for data manipulation and analysis. In addition, I worked with SQL and MySQL databases for data storage and retrieval. I managed and maintained Cassandra databases for distributed storage of large volumes of data. I built and utilized APIs for data access and integration with other systems.I worked with Spark for distributed processing and analysis of large datasets. I utilized Kinesis for real-time data processing and analysis. I developed and maintained data warehouses. I worked with EC2 instances for hosting applications and managing computing resources. I managed and maintained data storage in S3 buckets.Furthermore, I worked with containerization tools such as Docker for the deployment and management of applications and services. I utilized Shell scripts for the automation and management of various data engineering tasks. Finally, I worked in Agile Methodologies for efficient and iterative development and delivery of data solutions.

Mumbai, Maharashtra, India

As a Hadoop Developer at Ditech, I developed and maintained Hadoop-based data processing applications using Hortonworks and Big Data technologies. For distributed storage of large volumes of data, I utilized HDFS. Additionally, I worked with MapReduce for distributed processing and analysis of large datasets.To import and export data between Hadoop and other data sources, I utilized Sqoop. I also worked with AWS for cloud-based data storage and processing. Furthermore, I utilized Oozie and NiFi for workflow management and data integration.For data manipulation and analysis, I used Python and SQL Server, and for data storage and retrieval, I worked with Oracle. Additionally, I utilized HBase, Hive, Impala, and Pig for data storage, retrieval, and processing. I optimized Hadoop clusters for performance and scalability and utilized Tableau for data visualization and reporting.To work with unstructured data, I worked with NoSQL databases and utilized Unix/Linux for managing and configuring Hadoop environments. Furthermore, I worked with Spark and PySpark for distributed processing and analysis of large datasets. To collaborate on data analysis and sharing, I utilized Notebooks.

Bengaluru, Karnataka, India

As a Data Analyst at Ascena retail group, I conducted data analysis using SQL Server for data storage and retrieval. I developed ETL processes using SSIS for data integration and transformation and utilized SSRS for creating and sharing reports on data analysis results. Additionally, I worked with Tableau for data visualization and reporting, and utilized Excel for data manipulation and analysis.To conduct statistical analysis and modeling, I also worked with R. Furthermore, I utilized AWS for cloud-based data storage and processing, and Python for data manipulation, analysis, and automation. For developing and maintaining web-based data applications, I utilized Django.As part of my role, I conducted data profiling and cleansing to ensure data accuracy and integrity. I conducted ad-hoc data analysis to support business decisions, and worked closely with business stakeholders to understand data needs and requirements. Finally, I conducted data modeling to support data analysis and reporting requirements.