Daniyal Khalid work email
- Valid
Daniyal Khalid personal email
I'm a Master's graduate of Data Engineering and Analytics. My work experience and interests include data engineering and full stack development.I have experience creating and managing big data ETL pipelines using Python, SQL and Spark, ranging from academia to startups.During my Master's I presented in a research seminar on the current landscape of stream processing for big data graphs. For my practical course, I helped an AI startup develop a Kubernetes based deep learning pipeline for video captioning, significantly reducing their operating costs by implementing auto scaling for GPU workers. I also worked at a legal tech startup for my application project, in which I developed a data pipeline and web application for analyzing the relationships between German court rulings since 2000, which allowed the startup to market themselves and attract funding.For my Master's thesis, I used Apache Hadoop and Giraph to analyze the performance of partitioning algorithms for large scale graphs and trained machine learning models to predict the best partitioner based on the input graph.
-
Software EngineerGoogleGermany
-
Data EngineerDelivery Hero Sep 2023 - PresentBerlin, Germany -
Working Student Data EngineerJoyn Gmbh Aug 2022 - Mar 2023Munich, Bavaria, GermanyAs a working student, I was responsible for various aspects of the backend event collection system and services which ingested, processed and stored events coming from the frontend applications to BigQuery and other storages.I improved the robustness of the system and its releases by adding new unit, integration and performance tests and adding these tests as CI/CD jobs to be executed automatically. Furthermore, I was able to reduce the costs of these services by implementing caching to reduce database calls and migrating functionalities from Cloud Functions to Cloud Run. In addition, I created scheduled queries in IaC to automatically move stale data from BigQuery to Cloud Storage. Finally, I maintained and updated pipelines to move data from the data warehouse to downstream analytics tools such as Mixpanel. -
Working Student Software EngineeringTechnical University Of Munich Jun 2022 - Sep 2022Munich, Bavaria, GermanyThe project consisted of the development of a prototype application that combined parcel delivery with ride hailing in areas of Munich using special electric rickshaws.This involved developing and deploying a full stack web application, which communicated via message passing with a separate application that assigned requests to drivers and computed routes. The major parts included the development of a live map with Open Street Map integration to show live locations of users and drivers to each other, as well as to admins. Live navigation for the drivers was implemented through message passing and REST interfaces. An admin panel to view and manage the users was developed. Finally, the application was deployed on an on premises server using Nginx.The developed application was used to do a real world test run in Munich with real drivers and users. The data from this test run was then analyzed to extract usage statistics and evaluate the feasibility of such an application. -
Student Software EngineerDesign Ai Nov 2021 - Feb 2022Involved in the development, maintenance and deployment of a video captioning AI model. Expanded the functionality of the backend application and database to receive, store and send automatic tags generated from the AI model. Furthermore, added pod and node autoscaling in Kubernetes to dynamically provision GPU workers for the AI model depending on the current load. -
Research InternÉcole Polytechnique Fédérale De Lausanne Aug 2021 - Oct 2021Lausanne, Vaud, SwitzerlandWorked on a research project at the Data Science Lab which involved studying the search topics for which Google tends to send users to Wikipedia, and how this is changing over time.Developed an ETL pipeline to ingest data from Wikipedia's Clickstream dataset, Google Trends and the WikiPDA API. Created transformations for the heterogeneous data to convert it into a homogeneous time series format, suitable for analysisPerformed exploratory analysis on this data, including dimensionality reduction and visualizations, highlighting trends for certain types of topics. -
Software Data EngineerIngenio Ec Apr 2020 - Mar 2021Islāmābād, PakistanWorked on a Twitter analytics platform for providing insights to personalities and brands in Ecuador by generating reports on topics, hashtags and geographic locations.Responsibilities included backend API development (Node.js, Flask), developing data pipelines (Python, Spark, Airflow) and data warehouse management (SQL) - Data ingestion from twitter APIs and third-party libraries- Design and implementation of fact and dimension tables- Batch processing and real time processing scripts to prepare the data for analysis- Development of REST APIs to communicate with frontend client. -
Research InternDeutsches Forschungszentrum Für Künstliche Intelligenz (Dfki) Jun 2019 - Aug 2019GermanyA research project based on developing a machine learning model to extract the structure from tables in documents.Created a pipeline to load, pre-process and save document images for object segmentation.Designed and implemented a neural network in PyTorch to detect table structure and convert tables in documents from images to Excel.
Daniyal Khalid Education Details
-
Data Engineering And Analytics
-
Cgpa: 3.98/4.00
Frequently Asked Questions about Daniyal Khalid
What company does Daniyal Khalid work for?
Daniyal Khalid works for Google
What is Daniyal Khalid's role at the current company?
Daniyal Khalid's current role is Software Engineer.
What is Daniyal Khalid's email address?
Daniyal Khalid's email address is daniyal.khalid@tum.de
What schools did Daniyal Khalid attend?
Daniyal Khalid attended Technical University Of Munich, National University Of Sciences And Technology (Nust).
Not the Daniyal Khalid you were looking for?
-
-
-
-
1khaleef.com
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial