Imran Yaba Email & Phone Number

Kitchener, ON, CA

Toronto, Ontario, Canada

• Involved in requirements gathering, analysis, design, development, change management, deployment.
• Involved in the development of real time streaming applications using PySpark, Apache Flink, Kafka, Hive on distributed Hadoop Cluster.
• Utilizing Apache Spark with Python to develop and execute Big Data Analytics and Machine learning applications, executed machine learning use cases under Spark ML and Mllib.
• Extracting data from heterogeneous sources and performed complex business logic on network data to normalize raw data which can be utilized by BI teams to detect anomalies.
• Designing and developing Flink pipelines to consume streaming data from Kafka and applied business logic to massage and transform and serialize raw data.
• Developing common Flink module for serializing and deserializing AVRO data by applying schema.

Hyderabad, Telangana, India

• Designed Batch Audit Process in batch\shell script to monitor each ETL job along with reporting status which includes table name, start and finish time, number of rows loaded, status, etc.
• Developed python scripts to automate data ingestion pipeline for multiple data sources and deployed Apache Nifi in AWS.
• Design and develop Tableau visualizations which include preparing Dashboards using calculations, parameters, calculated fields, groups, sets and hierarchies.
• Involved in implementation of new statistical algorithms and operators on Hadoop and SQL platforms and utilized optimizations techniques, linear regressions, K-means clustering, Native Bayes and other approaches.
• Developed Spark batch job to automate creation/metadata update of external Hive table created on top of datasets residing in HDFS.
• Developed Data Serialization spark common module for converting Complex objects into sequence bits by using AVRO, PARQUET, JSON, CSV formats.

Hyderabad, Telangana, India

• 
• Responsible for analysis of requirements and designing generic and standard ETL process to load data from different source systems
• The developed objects are tested for unit/component testing and prepared test cases document for mappings/sessions/workflows.
• Involved in the daily status meeting and interacting with onshore team through mails/calls to follow up the module and to resolve the data/code issues.
• Handled Classification System part of the project which involved loading of the data based on some pre conditions
• Understand the existing business model and customer requirements.

Education record

Education record