Bishoy Makram Email & Phone Number

Cairo, Egypt

Egypt

Egypt

1- Building ETL data pipelines using Apache Spark(Python and Scala) that would store data in Hive or Oracle Databases.2- Provided real-time data feed to our data-science team by configuring and maintaining data-streams between our different sources using Flume and Kafaka.3- Reduced Ad-hoc requests from Data Science team by automating the already built pipeline Using Python, Bash Scripting and Apache Oozie.4- Increased our models performance by optimizing DataScience team implementation into a production grade quality.5- Deployed ML Models using Spark Streaming, Kafka, Django or Flask, each depending on the use case on hand.6- Slashed new ETL building time by 25% for our team members by Writing standard pipeline-apis library for our team to standardize and facilitate pipelines creation across different sources using Python, Scala and Java.7- Helping multiple new agile teams acting as a center of excellence for the BigData team.8- Performing stress testing and Benchmarks for our new Cloudera clusters which resulted in discovering multiple critical issues/misconfigurations saving money for the company by preventing potential data loss and downtime operations.9- Developed an in-house auditing tool for our data lake using Python and bash scripting.

My New Responsibilities now includes 1. Maintaining the platform I already built.2. Implement totally new tools and adding new features to the alreadybuilt platform.3. Introduce new solutions for new challenges we face.4. Coaching new team members to be able to take over pieces of theplatform on their own.5. Extracting Data from clients’ legacy systems.6. Developing new Sentiment Model.

Cairo Governorate, Egypt

My responsibilities covers most of the development process including:1- Designing the app architecture.2- Installing Environment and configuring any tool that I use: Hadoop, Livy, Spark, Kafka, flume, Webservers, etc..., including the network aspect between the mentioned tools.3- Writing the scripts that collects the data from many social media platforms and other data sources.4- Moving the data to internal storage through backend APIs using DJANGO REST/SPRING that pushes to KAFKA, flume, TCP, ...5- Using Apache Livy coupled with Django Rest, I developed backend APIs that uses Apache SPARK as an interactive shell to provide continuously updated analytics to the front end.6- Migrating old data from traditional DBs like postgres using SQOOP to HDFS.My experience extends to DataScience as I developed and integrated Models as APIs doing Sentiment Analysis and NER(Named Entity Recognition ) to Tweetes/Posts/... that comes from social media.

Cairo Governorate, Egypt

Post-Graduate Professional Diploma, Data Processing, A-

Activities and Societies: We studied BigData Development using Hadoop ecosystem and Spark. Also Studied Machine Learning theoretically.

Bachelor'S Degree, Computer Science, Very Good