Madhusudhan Katipelli Email & Phone Number

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates

• Designed and implemented efficient Delta Live Tables (DLT) pipelines to streamline data processing and ensure real-time data availability for analytics and reporting.• Utilized DLT features to enforce data quality rules and manage schema changes, reducing data inconsistencies and improving data integrity.• Implemented monitoring and alerting mechanisms for Delta Live Tables pipelines, ensuring timely identification and resolution of issues.• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and ensuring the stability and efficiency of data pipelines.

Malaysia

As a Hadoop, Spark Developer Working at Client UOB:● Developed a metadata management system to improve data governance and tracking● Developed an automated data cleansing process to reduce manual errors and improve data quality● Developed a data catalog to enable users to discover and access data● Created a data governance framework that improved data accuracy and reduced manual errors● Implemented a real-time streaming pipeline that enabled near-instantaneous event processing● Involved in bringing source data from external sources Files CSV to Hive using Pyspark● Developed Notebooks in CDW using Pyspark to ingest the data from SFTP to the Staging after performing data quality checks and transformations● Understanding and implementing the user stories about Data transformation by applying the Models like RSS,DF● Created The Pipeline using Pyspark to automate the reading source Files and Storing in Parquet Files

Hyderabad, Telangana, India

Snowflake Dataware house Developer:● Developed and maintained a technical road map to ensure software requirements were met in a timely manner● Created a dashboard that visually represented key business metrics in real-time, allowing for quick and informed decision-making by management● Developed an automated data warehousing solution that improved data availability by 100%● Developed a cloud-based Snowflake data warehouse that enabled real-time analytics for Business users● Developed Transformation logic by writing Snow-Sql Queries ,Views● Generated Tableau Reports for Users to access the Snow Views Data

Hyderabad, Telangana, India

snowflake developer:● Requirement gathering from Product Owner and design discussion with architect. Providing estimates for the Sprint task.● Updating the Sprint task board on daily basis and providing daily status updates to client which makes it easier to showcase the efforts and predict the Spillover in advance for the Sprint.● Created Linked Services, Datasets, Key Vault Secrets, Schedule based triggers. Developed Pipelines in Data Factory to copy the data from on premise to Data Lake, to enable the archival of processed files, to Process multiple files at the Same Time. Developed Notebooks in Databricks using Pyspark to ingest the data from Data Lake to the Staging table after performing data quality checks and transformations.● Created stored procedures to handle the incremental data in Dimension and Fact tables.● Integrated all the notebook and stored procedure activities in the Pipeline. Created Views with Row level security which helps in restricting the data access to the users across the modules.● Provided Support to Testing team by fixing defects and helping them to achieve test completion on time.● Provided Support to Business team by guiding them in performing the testing and getting it Signed off.

Hyderabad, Telangana

Worked as Hadoop and snowflake developer:● Have been part of Team in Developing python Scripts to ingest the data into Snowflake● Used COPY INTO to bulk load the data from External Stages into Snowflake Tables● Experience in building Snowpipe to continuous load whenever the File Available in Storage like S3 and Azure Storage● In-depth knowledge of Data Sharing and Data Cloning Feature in Snowflake● Having Experience in Ingesting Different File formatted (JSON,CSV) data in to Snowflake Tables ● Experience in working on Azure DataBricks and Orachstrating the Jobs using Airflow● Experience in working on Azure Data factory for creating pipelines ● Build Hive tables using the metadata which is created based on the pre-approved mappings from Source System to Hive.● Developed Spark Jobs for transforming the data from Hive Raw tables and store them into Standard tables.● Having Working Expreince in using the Repositories GIT,BIT BUCKET

Hyderabad, Telangana, India

Worked as Hadoop Developer :● Import data from oracle servers to HDFS and HIVE tables through SQOOP/SPARK import statements ● Creating the tables with new Data model and mapping the columns with existing server/tables ● Transforming /converting Stored procedures into hive queries and transforming the logic applied on Stored procedures in to Hive ● Worked on SPARK Core and Spark-SQL Used Different type of transformations such as an d actions ● Importing Data from RDBMS to HDFS and Exporting data from HDFS to RDBMS using Sqoop.● Transferred all log and text files generated by various products into HDFS location. Collaborate with the vendors and get all the data mappings that is required for analysis and write logic to lookup reference table to populate data in target that helps the business to build reports on top of that data that is provided.● Developed spark RDD’s and applying transformations,Actions on developed RDD’s

Hyderabad, Telangana, India

Worked As Oracle Database Administrator:● Developed automated scripts to maintain database consistency and accuracy● Installed, configured, and maintained database servers, resulting in minimal downtime● Ensured database integrity through the implementation of data validation checks● Tuned database queries to improve performance by 100%● Migrated databases from on-premise to cloud, providing high availability and scalability● Monitored database performance and identified and addressed any performance bottlenecks● Developed a disaster recovery plan that ensured data availability and integrity in the event of an outage

Hyderabad, Telangana, India

Worked As Oracle Database Administrator:Working on Provisioning POD and Supporting Change Management Maintenance Windows● Working in Application Provisioning(POD) apart from DB like Provisioning WEB tier, Analytics, Siebel● Worked On W2K8 Swap Project (Provisioning Siebel, OBI)● Provisioning Database Instance in EXADATA Environment● Adding new node to existing RAC environment.● Worked on DR setup, add db nodes, and install middleware software.● Worked on Applying Upgrades and Application Patch● Hands on experience of Upgrading oracle database from 10g to 11g, and patch set level upgrade oracle 10.2.0.1 to 10.2.0.4

Hyderabad, Telangana, India

Worked As Oracle Database Administrator(client-Oracle India pvt ltd):Working on Provisioning POD and Supporting Change Management Maintenance Windows● Working in Application Provisioning(POD) apart from DB like Provisioning WEB tier, Analytics, Siebel● Worked On W2K8 Swap Project (Provisioning Siebel, OBI)● Provisioning Database Instance in EXADATA Environment● Adding new node to existing RAC environment.● Worked on DR setup, add db nodes, and install middleware software.● Worked on Applying Upgrades and Application Patch● Hands on experience of Upgrading oracle database from 10g to 11g, and patch set level upgrade oracle 10.2.0.1 to 10.2.0.4