Deepesh S Email & Phone Number

Minnesota, United States

• Developed Hive ETL logic for data cleansing and transformation of data coming through RBMS, files and other batch sources.• Implemented complex data types in Hive also used multiple data formats like ORC, Parquet.• Worked in different parts of data lake implementations and maintenance for ETL processing.• Developed Spark Applications by using Python and implemented Apache Spark data processing project to handle data from various RDBMS, NoSQL and streaming sources.• Experience in deploying and managing PostgreSQL databases on AWS, including performance tuning, security management, and high availability setup.• Skilled in developing custom calculations, measures, and KPIs to meet specific business requirements in Power BI.• Demonstrated ability to design and implement data visualizations in Tableau, leveraging its rich set of features to present data in a clear and compelling manner.• Proficient in developing enterprise-level applications using Java EE (Enterprise Edition) technologies such as Servlets, JSP (JavaServer Pages), JDBC (Java Database Connectivity), and JPA (Java Persistence API).• Hands-on experience with the Spring Framework for building robust and scalable Java applications, including Spring Core, Spring MVC, Spring Boot, and Spring Data.• Hands-on experience with Talend Data Integration for designing and executing data integration workflows, data migration, and real-time data processing tasks.• Experienced in optimizing PySpark jobs for performance and scalability through techniques like partitioning, caching, and parallelism tuning.• Skilled in integrating PySpark with various AWS services such as Amazon S3, Redshift, and EMR for efficient data storage, processing, and analytics.• Competent in managing PySpark clusters on AWS, including provisioning, monitoring, and troubleshooting using Amazon EMR.•Proficient in enabling real-time data integration with IICS on AWS.•Loaded data into S3 buckets using AWS Glue and PySpark.

Austin, Texas, United States

•Implemented Spark applications for bulk data transformations and to optimize query execution.•Proficient in Netezza, an IBM data warehouse appliance, with experience in data modeling, ETL processes, and SQL development.•Experienced in working with large datasets and complex analytics projects using Netezza as the backend infrastructure.•Developed cloud ingestion automation scripts to create bidirectional flow between Azure Blob Storage and HDFS.•Implemented cost-effective strategies in BigQuery, including slot management, reservation utilization, and query optimization, to control query costs•Created scheduled queries and automated jobs in BigQuery using the Cloud Scheduler and Cloud Functions to process and transform data at regular intervals.•Implemented streaming applications ingesting data from Kafka topic into Big Query for ETL operations.•Collaborated with development teams to understand infrastructure requirements and implement Terraform configurations.•Establish and enforce infrastructure as code (IaC) standards and best practices.•Implemented secure transfer routes for external clients using microservices to integrated external storage locations on Azure Gen2 Storage.•Performed data ingestion, data cleansing, data mining, data validation and custom aggregation.•Experience in creating complex stored procedures, functions and views using SQL statements in RDBMS through Snowflake using DBT.•Designed and implemented robust data solutions using SQL within Snowflake, with a keen focus on harnessing the power of DBT for efficient data modeling and transformation.•Experience designing solutions in Azure tools like Azure Data Factory, Azure Data Lake, Azure SQL & Azure SQL Data Warehouse, Azure Functions.• Implemented DataLake migration from on prem clusters to Azure for highly scalable solutions.• Proficient in using Git for version control to manage changes, track code history, and collaborate effectively with team members.

Maharashtra, India

● Experience working on projects with big data, data visualization, R and Python, Unix, and SQL.● Performed exploratory data analysis using NumPy, matplotlib, and pandas.● Experience migrating on-prem data from HDFS to GCS Cloud buckets.● Developed ETL scripts to transform data and store it in BigQuery.● Implemented various ad hoc data proc clusters to scale up application performance.● Developed server groups and static servers for production in Google DataProc.● Migrate RDBMS data into Cloud Sql to implement lambda architecture.● Developed various pyspark applications using to run on top of data proc clusters.● Implemented various DAGs in airflow for automating on-prem and Cloud Operations.● Prepared high-level analysis reports with Excel and Tableau. Provides feedback on the quality of Data including identification of billing patterns and outliers. ● Experience in working with Maps, Density Maps, Tree Maps, Heat Maps Pareto charts, Bubble charts and Bullet Charts, Pie Charts, Barcharts, and Line charts.● Worked on sort & filters of tableau like Basic Sorting, basic filters, quick filters, context filters, condition filters, top filters, and filter operations.● Experience in using Lambda functions like filter (), map (), and reduce () with pandas DataFrame and performing various operations. ● Used Pandas API for analyzing time series. Creating a regression test framework for new code. ● Created templates for page rendering and Django views for the business logic. ● Worked on Django REST framework and integrated new and existing API endpoints. ● Utilized PyUnit for unit testing of the application. ● Performed data analysis using Google APIs and create visualizations such as pie charts, and waterfall charts and displayed them in the web application. ● Using High charts, passed data, and created interactive JavaScript charts for the web application. ● Involved in using Bitbucket for version control and coordinating with the team.

Hyderabad, Telangana, India

● Database design and development including Tables, Primary and Foreign Keys, and Stored Procedures.● Generated SQL and PL/SQL scripts to install create and drop database objects, including tables, views, primary keys, indexes, constraints, packages, sequences, grants, and synonyms.● Maintained a series of UNIX Shell Scripts to manage batch order processing.● Database performance monitoring and identifying bottlenecks hindering the performance of the database.● Tuned SQL statements to improve efficiency and performance, create and maintain/modify PL/SQL Packages, mentor others with the creation of complex SQL statements, perform data modeling, and create/maintain and modify complex database Triggers and Data Migration scripts.● Created changes in the database according to new requirements(new tables in the existing database and fields in the existing tables).● Implemented multiple-table links requiring complex joins, including Outer-joins and Self-joins.● Developed shell scripts for job automation and daily backup● Documentation of the business process through designer● Created, debugged stored procedures, Triggers,Tables, Views and User-Defined Functions● Worked extensively on Exception Handling, to trouble-shoot PL/SQL code● Environment: Oracle 11g, Oracle 9i, SQL Developer, SQL Loader, TOAD,UNIX, Sun Solaris