Shubham G. Email & Phone Number

India

Bengaluru, Karnataka, India

• Implemented a Microsoft Fabric proof of concept for a client, showcasing the ability to handle large-scale data and workloads with scalability, reliability, and system performance in a distributed environment. Provided insights and recommendations based on the proof-of-concept results.• Collaborated with clients, business stakeholders, and offshore teams to understand requirements and build precise analytical solutions.• Worked with Delivery/Development Lead and Data SME on system design and architecture. Identified and recommended appropriate tools/technologies for system development and documentation.• Guided the team in developing automated pipelines for data ingestion and data processing from source systems into analytical platforms leveraging cloud native tools. • Mentored the team and provided technical guidance and direction in application code development for data engineering projects.• Advises on performance optimizations and best practices for scalable data models, pipelines and Databricks configurations.• Oversaw project team and deliverables, tracked progress, handled risks and issues with defined action plans and timelines, and provided support and solutions.• Contributed to Request for Proposal (RFP) to support business objectives and optimize solution costs.• Researched and applied best practices for Azure security, architecture, and infrastructure and revamped data engineering applications.

Hyderabad, Telangana, India

• Coordinated with business stakeholders to gather and understand requirements.• Designed and developed dataflows for seamless data integration.• Constructed ADF pipelines for data orchestration and databricks notebooks for transformation.• Contributed to migrating resources from BA exploration hub to specialized Azure hubs (Exploration, Industrial, Data Lake, and Innovation) to enhance analytical solutions by leveraging the distinct capabilities of these Azure hubs.• Hubs include Exploration, Industrial, Data Lake, and Innovation, each with specific roles in data exploration, processing and analysis, storage, and advanced analytics and innovation. • Translated complex analytical requirements into technical designs, including data pipelines, data models, and reports/dashboards.• Developed Azure Stream Analytics jobs to process streaming data.• Guided and trained team members on best practices, standards, and technology.

Mumbai Area, India

• Collaborated with the onsite coordinator to identify business needs and develop solutions. Advised team on leveraging data/services for consumption.• Held the Cloud Data Platform Engineer role, specializing in Microsoft Azure Cloud services.• Analysed business requirements to create services using Azure cloud platforms like ADF, ADLS, ADLA, AAS, and ADW.• Developed and troubleshot data pipelines using Azure Data Factory (ADF) for data processing & data explorations.• Developed and deployed Azure Logic Apps with dynamic parameters tailored for various environments across different resource groups and subscriptions.• Creating Azure Resource Manager (ARM) templates for Logic Apps and for custom deployment. • Coded views, UDFs, stored procedures, and other database objects for report and interface development.• Assisted in configuring, deploying, and maintaining logic apps and pipelines.• Documented data flow diagrams and technical mapping documents for data processes.• Guided and trained practitioners on best practices, standards, and technology.

Mumbai Area, India

• Coordinated directly with clients for requirement gathering.• Designed and developed Azure Analysis Services (AAS) Tabular Models with DAX measures and automated data refresh using runbooks.• Managed logical partitions in data models for independent processing.• Created interactive Power BI reports for real-time insights and ad-hoc analysis.• Built and published Power BI scorecards, reports, and dashboards, connecting them to AAS tabular models.• Implemented drill-through functionality for detailed, context-specific views. Applied role-based security in Power BI for personalized access across the web and mobile devices.• Developed data mappings and transformation logic for data ingestion based on business rules.• Implemented business logic for data loading into the warehouse per functional specifications and source-to-target mappings.• Created ETL processes using Talend Studio and authored Talend Design Documents.• Conducted unit testing of measures and calculations, wrote SQL queries for data validation, created unit test scripts with various test cases, and resolved bugs.• Completed Talend Data Integration Basics and Advanced (v6.3) Certifications

Pune Area, India

• Managed data extraction, transformation, and loading (ETL) between CRM Cloud systems.• Designed and developed scalable, optimized SSIS packages with control flow and data flow components.• Configured SSIS packages for different environments using variables, parameters, connection details and package configuration files.• Implemented logging, error handling, event handling, transactions in SSIS packages for error data management.• Created and managed database objects, including tables, views, constraints, and indexes based on technical design document and field catalogue.• Developed SQL data warehouse with star schema design. Wrote SQL queries for data validation and verification. • Developed and scheduled reports using SQL Server Reporting Services (SSRS).• Deployment and scheduling of jobs using Autosys. Created deployment sprints and release plans.• Integrated Power BI with other tools and applications.• Ensured quality in all deliverables.

Pune Area, India

• Performed extensive ETL operations using SQL Server Integration Services (SSIS) to extract, transform, and load data from MS SQL Server, flat files, excel, and Teradata.• Designed and developed efficient SSIS packages with various data flow, and control flow components, applied transformations such as conditional split, data conversion, lookup, SQL task, and Script task, etc. to load data from various data sources to MS SQL Server (SQL DW).• Implemented data transformations and error-handling mechanisms in SSIS packages for robust data loading into the Data Warehouse.• Created and modified database objects such as tables, constraints, indexes, views, UDFs, and stored procedures.• Created SQL Agent jobs to automate the execution of SSIS packages.• Maintained error logs in text files and SQL tables for failure tracking.• Designed and developed different types of reports and charts (column, line, bar, pie, etc) using SQL Server Reporting Services (SSRS), including tabular, matrix, drill-down, drill-through reports, etc.

Pune Area, India

• Loaded historical data to address ETL failures.• Provided ad-hoc data extracts to customers to meet their data needs.• Supported daily/weekly/monthly ETL processes to ensure data availability.• Created tables, views, constraints, and stored procedures for report development.• Maintained and created database scripts for application releases.• Involved in development, testing, debugging, and documentation.• Ensured adherence to standards and customized code/modules as needed.• Involved in various phases of the software development life cycle.

Master Of Technology - Mtech, Data Science & Engineering

Masters (M.Tech) in Data Science & Engineering from WILP, BITS Pilani

Bachelor'S Degree, Computer Science & Engineering

Bachelor of Engineering in Computer Science from ITM GOI Gwalior

Higher Secondary, Physics, Chemistry, Mathematics

HSC(XII) from Balak Mandir H.S. School Board of Secondary Education, Madhya Pradesh, Bhopal

High School, Science Stream

SSC(X) from Balak Mandir H.S. School Board of Secondary Education, Madhya Pradesh, Bhopal