I'm deeply passionate about exploring cutting-edge technologies and crafting revolutionary Big Data Solutions . My focus lies in developing groundbreaking projects that uses data to undergo decision making. Passionate and dedicated Big Data Engineer with a strong foundation in technologies such as Hadoop, ETL, Spark, Kafka, and Airflow.Currently I am getting my hands dirty on cloud platforms like AZURE , AWS for implementing big data solutions on these platforms.Equipped with a deep understanding of data processing, storage, and analysis, I am committed to architecting robust and scalable solutions that drive actionable insights from large datasets. With hands-on experience in designing and implementing complex data pipelines, I thrive in tackling challenges and optimizing processes to unlock the potential of data-driven decision-making. My journey is fueled by a curiosity to explore emerging trends in the data landscape, ensuring that I stay at the forefront of innovation.
Northbay Solutions
View- Website:
- northbaysolutions.com
- Employees:
- 395
-
Senior Data EngineerNorthbay SolutionsIslamabad, Pk
-
Data EngineerInsure123 Insurance Agency Inc. Jul 2022 - PresentUnited States- Developed Ingestion Pipelines leveraging Sqoop, streamlining the data import process.- Design Data Warehouse on Apache HIVE, optimizing data storage and accessibility.- Engineered Analytics Data Pipelines utilizing Apache Spark (pyspark), enabling advanced data analysis and transformation.- Established and managed a Data Lake on HDFS, ensuring robust storage and organization of diverse data types.- Orchestrated comprehensive ETL/ELT processes, bridging OTLP to OLAP and Data Lake, employing a suite of technologies including Python, Pyspark, Airflow, HDFS, Sqoop, and Cloudera. -
Lab DemonstratorFast-Nuces, Islamabad Campus Aug 2021 - Dec 2021Islamabad, Islāmābād, PakistanCourse : Operating SystemsStrength : More than 50 StudentsResponsibilities:• Evaluating Codes of the Students • Solving Bugs from Student Codes• Assisting teacher during Lab -
Data EngineerImprodata Jun 2021 - Aug 2021Islamabad, Islāmābād, PakistanAlteryx : Extracted , Cleaned and transformed data from various resources , ensure data quality for downstream analysis.SQL : Managed and queried databases (PortgreSQL, My-Sql) , optimized schema and crafted complex queries for specific data subsets.Power BI : Created Interactive and visually appealing dashboards , integrating data from multiple sources to provide valuable insights.Python : Used Pandas , Numpy and Matplotlib for data analysis and visualization tasks enhancing programming skills.Collaborative Project : Contributed to building an automated data pipeline using Alteryx , Python and SQL for seamless data flow. -
Big Data EngineerInsure123 Insurance Agency Inc. Jun 2020 - Aug 2020United States- Utilized Apache Spark-Scala for efficient batch processing and minimizing execution by 20 times. - Employed Hive for Data warehousing for structure level optimization like partitioning and bucketing majorly for highly optimized join queries for 5 normalized queries.- Coordinated ETL workflows for data integrity and quality assurance.- Implemented performance tuning techniques such as broadcast variables , caching , persist and dynamic allocation of resources for spark jobs to enhanced throughput and resource allocation.- Leveraged optimized file formatting like CSV for its simplicity in data exchange and interoperability across systems additionally Avro for flexible schema evolution along with implementing Parquet for optimized columnar storage , enhancing nested query performance and minimizing storage overhead in big data environments.
-
Sql DeveloperBenessere Foundation Jun 2019 - Aug 2019Islāmābād, Pakistan• Processed a daily average of 2 million data records for Loan Documentation alignment, ensuring strict compliance with respective agencies policies.• Employed MySQL's robust features, including constraints like NOT NULL, UNIQUE, and CHECK constraints, resulting in a significant reduction in data errors and ensuring data reliability.• Proficiently utilized Microsoft Excel for precise data alignment, maintaining data accuracy and quality.• Designed and optimized SQL queries to handle large datasets, including critical operations such as credit checks, income calculations, and debt-to-income ratios, reducing query execution time by a remarkable 10-times.
Zain Ul Abidin Education Details
-
Fauji Foundation College For Boys87% -
Fauji Foundation College For Boys93%
-
Sls Montessori And High SchoolPrimary Education
Frequently Asked Questions about Zain Ul Abidin
What company does Zain Ul Abidin work for?
Zain Ul Abidin works for Northbay Solutions
What is Zain Ul Abidin's role at the current company?
Zain Ul Abidin's current role is Senior Data Engineer.
What schools did Zain Ul Abidin attend?
Zain Ul Abidin attended National University Of Computer And Emerging Sciences, Fauji Foundation College For Boys, Fauji Foundation College For Boys, Sls Montessori And High School.
Who are Zain Ul Abidin's colleagues?
Zain Ul Abidin's colleagues are Rohail Malhi, Danish Kamal, Humera Nooreen, Samia Nouman, Muneeb Abdul Shakoor, Farkhanda Sadaf, Saqib Munir.
Not the Zain Ul Abidin you were looking for?
-
2yahoo.com, askaribank.com.pk -
-
-
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial