Indu. D Email & Phone Number

United States

United States

• Proficient in various Azure cloud components, including Databricks, Data Lake, Blob Storage, Data Factory, Storage Explorer, Synapse, SQL DWH, and CosmosDB.• Experienced in utilizing Databricks to analyze data from Azure data storages, leveraging Spark cluster capabilities to derive insights.• Designed and enforced data governance policies to ensure data quality, consistency, and compliance across organizational data.• Designed and executed cloud-based ETL pipelines in IICS, integrating and transforming data from both cloud and on-premises sources.• Created and maintained complex ETL workflows and mappings in Informatica PowerCenter, facilitating efficient data extraction, transformation, and loading across various systems.• Involved in extracting, transforming, and loading data from source systems to Azure Data Storage services using Azure Data Factory, Databricks, PySpark, Spark SQL, and U-SQL Azure Data Lake Analytics.• Designed and executed data quality assurance procedures, including data profiling, cleansing, and validation, to maintain high levels of data accuracy.• Developed pipelines in Azure Data Factory (ADF) for ETL operations involving Azure SQL, Blob storage, and Azure SQL Data Warehouse, utilizing Linked Services, Datasets, and Pipelines.• Ingested substantial datasets into BigQuery and performed complex SQL queries to derive actionable insights.• Configured and optimized data integration processes to consolidate data from relational databases, flat files, and cloud storage into a unified data warehouse.• Managed and implemented data integration strategies to consolidate data from disparate sources into a unified data repository.• Created and managed data models, including star and snowflake schemas, to support reporting and business intelligence needs.• Worked on Snowflake modeling, including data warehousing techniques, data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment, and change data capture.

Denver, Colorado, United States

• Formulated a resilient data modeling environment using Databricks on Azure, providing consumers with the capability to seamlessly operate highly descriptive notebooks within a fully governed framework.• Migrated extensive datasets to Databricks (Spark), overseeing the creation and administration of clusters, data loading, configuring data pipelines, and transferring data from ADLS Gen2 to Databricks using Azure Data Factory (ADF) pipelines.• Managed data lifecycle processes, including archiving, retention, and purging, to optimize data storage and ensure data relevance.• Exported data from BigQuery to various formats and integrated with visualization tools like Looker or Data Studio to create detailed and interactive reports.• Configured Databricks jobs and refactored ETL Databricks notebooks.• Established multiple pipelines for loading data from Azure Data Lake into Staging SQLDB, followed by transferring it to Azure SQL DB.• Used IICS Monitoring Console to track job performance, manage workflow statuses, and troubleshoot issues proactively.• Created pipelines for loading data from Lake to Databricks and from Databricks to Azure SQL DB.• Used the Spark SQL API in PySpark to extract, load, and execute SQL queries on the data.• Developed a data pipeline using Spark, Hive, and Python for customer data ingestion.• Configured data masking and encryption in IICS to safeguard sensitive information and ensure compliance with security policies.• Utilized IICS’s version control features for collaboration, change management, and maintaining code quality across development teams.• Participated in the migration of MapReduce programs to Spark transformations using Python and created pipelines using Azure Data Factory (ADF) to execute SQL scripts.• Engaged in hands-on experience in architecting ETL transformation layers and crafting Spark jobs for processing.

Fort Mill, South Carolina, United States

• Developed SSIS jobs to automate report generation and cube refresh packages.• Designed SSIS packages for exporting data from flat file sources to SQL Server databases.• Conducted Extract, Transform, Load (ETL) development using SQL Server 2008 Integration Services (SSIS).• Created intricate SSIS packages incorporating appropriate control and data flow elements along with error handling.• Installed and configured SQL Server 2008.• Developed Tablix reports, matrix reports, parameterized reports, and sub-reports using SQL Server Reporting Services 2008.• Improved and deployed SSIS Packages from the development server to the production server.• Created drill-down, drill-through, and sub-reports using RDL.• Deployed RDLs to the Reporting Service Server.• Used Performance Point Services, SSRS, and Excel for reporting purposes.• Designed and implemented parameterized and cascading reports using SSRS 2008.• Developed a data model based on Business Analysts' and reporting team's requirements using SSAS and SSRS.• Generated derived columns on the final fact and dimension tables according to business requirements.• Gained an understanding of OLAP processing for changing and maintaining multi-dimensional data warehousing, optimizing dimensions, hierarchies, and adding aggregations to OLAP Cubes.• Created analytical reports using the PROCLARITY tool.• Played a significant role in the production support of SSAS (cube refresh) and SSIS jobs.

Hyderabad, Telangana, India

• Created, manipulated, and supported SQL Server databases.• Contributed to data modeling, physical and logical design of the database.• Aided in integrating the front end with the SQL Server backend.• Developed Stored Procedures, Triggers, Indexes, User-Defined Functions, Constraints, etc., on various database objects to achieve the desired results.• Imported and exported data from one server to others using tools like Data Transformation Services (DTS).• Wrote T-SQL statements for data retrieval and participated in the performance tuning of T-SQL queries.• Transferred data from various sources/business systems, including MS Excel, MS Access, Flat Files, etc., to SQL Server using SSIS/DTS, utilizing features like data conversion. Also created derived columns based on given requirements.• Provided application support via phone and developed/tested Windows command files and SQL Server queries for Production database monitoring in 24/7 support.• Implemented logging for ETL load at the package level and task level to track the number of records processed by each package and each task within a package using SSIS.• Developed, monitored, and deployed SSIS packages.• Produced multiple Enterprise reports (SSRS/Crystal/Impromptu) from SQL Server Database (OLTP) and SQL Server Analysis Services Database (OLAP), incorporating various reporting features such as group by, drilldowns, drill through, sub-reports, and navigation reports (Hyperlink), etc.• Oversaw the development and deployment of Informatica Intelligent Cloud Services (IICS)-based data integration solutions in Azure settings.

Bachelor'S Degree, Computer Science

Masters, Computer Science