Zain Ul Abidin Email & Phone Number

Islamabad, Pk

United States

- Developed Ingestion Pipelines leveraging Sqoop, streamlining the data import process.- Design Data Warehouse on Apache HIVE, optimizing data storage and accessibility.- Engineered Analytics Data Pipelines utilizing Apache Spark (pyspark), enabling advanced data analysis and transformation.- Established and managed a Data Lake on HDFS, ensuring robust storage and organization of diverse data types.- Orchestrated comprehensive ETL/ELT processes, bridging OTLP to OLAP and Data Lake, employing a suite of technologies including Python, Pyspark, Airflow, HDFS, Sqoop, and Cloudera.

Islamabad, Islāmābād, Pakistan

Course : Operating SystemsStrength : More than 50 StudentsResponsibilities:• Evaluating Codes of the Students • Solving Bugs from Student Codes• Assisting teacher during Lab

Islamabad, Islāmābād, Pakistan

Alteryx : Extracted , Cleaned and transformed data from various resources , ensure data quality for downstream analysis.SQL : Managed and queried databases (PortgreSQL, My-Sql) , optimized schema and crafted complex queries for specific data subsets.Power BI : Created Interactive and visually appealing dashboards , integrating data from multiple sources to provide valuable insights.Python : Used Pandas , Numpy and Matplotlib for data analysis and visualization tasks enhancing programming skills.Collaborative Project : Contributed to building an automated data pipeline using Alteryx , Python and SQL for seamless data flow.

United States

- Utilized Apache Spark-Scala for efficient batch processing and minimizing execution by 20 times. - Employed Hive for Data warehousing for structure level optimization like partitioning and bucketing majorly for highly optimized join queries for 5 normalized queries.- Coordinated ETL workflows for data integrity and quality assurance.- Implemented performance tuning techniques such as broadcast variables , caching , persist and dynamic allocation of resources for spark jobs to enhanced throughput and resource allocation.- Leveraged optimized file formatting like CSV for its simplicity in data exchange and interoperability across systems additionally Avro for flexible schema evolution along with implementing Parquet for optimized columnar storage , enhancing nested query performance and minimizing storage overhead in big data environments.

Islāmābād, Pakistan

• Processed a daily average of 2 million data records for Loan Documentation alignment, ensuring strict compliance with respective agencies policies.• Employed MySQL's robust features, including constraints like NOT NULL, UNIQUE, and CHECK constraints, resulting in a significant reduction in data errors and ensuring data reliability.• Proficiently utilized Microsoft Excel for precise data alignment, maintaining data accuracy and quality.• Designed and optimized SQL queries to handle large datasets, including critical operations such as credit checks, income calculations, and debt-to-income ratios, reducing query execution time by a remarkable 10-times.

Bachelor'S Degree, Computer Science, A

Higher Secondary School Certificate, Pre-Engineering, 87%

Secondary School Certificate, Matriculation, 93%

Primary Education