Rafi Shaik Email & Phone Number

Hyderabad, Telangana, India

Riyadh, Saudi Arabia

▪ Enhanced data pipelines to efficiently process both structured and semi-structured data, channeling vast volumes of information from diverse sources into a centralized lakehouse.▪ Involved in Data Ingestion, Data Processing, and Data Analysis, adopting the robust Medallion Lakehouse Architecture with distinct (Bronze, Silver & Gold) layers, leveraging the capabilities of Azure Databricks.▪ Developed Spark jobs using DF API and Spark SQL for data cleansing, transformations, and aggregations.▪ Built near real-time dashboards by leveraging Apache Spark streaming, Kafka topics, and NoSQL DB.▪ Design optimization and performance improvement to meet end-to-end throughput requirements.▪ Successful cloud migration initiative, from on-premises to Azure Databricks cloud.

Al-Riyadh Governorate, Saudi Arabia

o Involved in Big Data projects on GCP using GCS, Big Query, data proc, and PySpark.o Involved in Hive and HBase design, partitioning & bucketing, and query Optimizations.o Worked on AWS Bigdata pilot project using S3, EMR, Athena, and Redshift

Bangalore

o Interfacing with the client’s Business Analyst to understand data requirements.o Created Talend DI jobs, Joblets, Master jobs, and execution plans in TAC.o Developing the ETL detail design and unit test cases for each target table (Fact and dimension tables).o Involved in Talend BigData project for Coca-Cola on GCP

Bangalore

Part of the Philips team for the Product Data Hub MDM project responsible for ETL development using Informatica power center and Data Integration Hub (DIH)o Created Informatica PowerCenter mappings and workflows for product data hub solution.o Designed and developed complex mapping for varied transformation logic like Expression, Filter, Aggregator, Router, Joiner Update Strategy, and Unconnected & Connected lookupso Data analysis to ensure accuracy and integrity of data in the context of business functionalityo Involved in solution design for DIH and PowerCenter Components.o Comprehensive code reviews for all deliverable components.o Release documentation – deployment steps, run book creation in coordination with other teams involved in the end-to-end deployment.o Technical documentation which includes a manual for operational support teams.

Bangalore

Enterprise risk management (ERM) is the process of planning, organizing, leading, and controlling the activities of an organization in order to minimize the effects of risk on an organization's capital and earnings. This project has been developed with AbInitio implementation and as we are moving to the Talend tool the same requirement has been redeveloped using Talend data integration, Data quality, and publishing analysis report to the dashboard on UI.o Involved in requirements gathering, analysis, and design of this whole Project.o Reading messages from JMS Queues and passing them to Talend jobs.o Writing shell scripts to read data from JMS Queues and pass them to Talend flow.o Data Cleansing, Aggregating, Scrubbing, and validating source data using various Talend data integration, and quality components as per requirements.o Streamline the Deployment and Scheduling of Data Integration jobs using the TAC.o Handling administrative tasks using Talend Admin Center 5.3.1.o Involved in creating technical specification documents.o Prepared technical documentation to configure the TAC to create projects, Users, Roles, Project Authorizations, Reference and sub-projects, Branch Management, backup of repositories, Project Audit capabilities etc.