Rafi Shaik Email & Phone Number

Hyderabad, Telangana, India

Riyadh, Saudi Arabia

• Enhanced data pipelines to efficiently process both structured and semi-structured data, channeling vast volumes of information from diverse sources into a centralized lakehouse.
• Involved in Data Ingestion, Data Processing, and Data Analysis, adopting the robust Medallion Lakehouse Architecture with distinct (Bronze, Silver & Gold) layers, leveraging the capabilities of Azure Databricks.
• Developed Spark jobs using DF API and Spark SQL for data cleansing, transformations, and aggregations.
• Built near real-time dashboards by leveraging Apache Spark streaming, Kafka topics, and NoSQL DB.
• Design optimization and performance improvement to meet end-to-end throughput requirements.
• Successful cloud migration initiative, from on-premises to Azure Databricks cloud.

Al-Riyadh Governorate, Saudi Arabia

o Involved in Big Data projects on GCP using GCS, Big Query, data proc, and PySpark.o Involved in Hive and HBase design, partitioning & bucketing, and query Optimizations.o Worked on AWS Bigdata pilot project using S3, EMR, Athena, and Redshift

Bangalore

o Interfacing with the client’s Business Analyst to understand data requirements.o Created Talend DI jobs, Joblets, Master jobs, and execution plans in TAC.o Developing the ETL detail design and unit test cases for each target table (Fact and dimension tables).o Involved in Talend BigData project for Coca-Cola on GCP

Bangalore

Part of the Philips team for the Product Data Hub MDM project responsible for ETL development using Informatica power center and Data Integration Hub (DIH)o Created Informatica PowerCenter mappings and workflows for product data hub solution.o Designed and developed complex mapping for varied transformation logic like Expression, Filter, Aggregator.

Bangalore

Enterprise risk management (ERM) is the process of planning, organizing, leading, and controlling the activities of an organization in order to minimize the effects of risk on an organization's capital and earnings. This project has been developed with AbInitio implementation and as we are moving to the Talend tool the same requirement has been redeveloped.