Data Engineer | Data Scientist
Freelance
• Led the creation of a complex data engineering pipeline for collecting and processing real-time cryptocurrency trading information from multiple exchanges.• Developed a reliable system using Python to connect to various cryptocurrency exchange Web Sockets, enabling efficient streaming of live trading data.• Used Google Cloud Platform's Big Query to improve data management, enabling efficient data storage and quick execution of advanced queries.• Integrated Big Query to create a… Show more • Led the creation of a complex data engineering pipeline for collecting and processing real-time cryptocurrency trading information from multiple exchanges.• Developed a reliable system using Python to connect to various cryptocurrency exchange Web Sockets, enabling efficient streaming of live trading data.• Used Google Cloud Platform's Big Query to improve data management, enabling efficient data storage and quick execution of advanced queries.• Integrated Big Query to create a flexible data repository capable of handling complex data analysis and visualization tasks.• Designed the dashboard to provide end-users with a complete, real-time view of market trends, trading activity, and price swings across multiple exchanges.• Implemented advanced data visualization techniques in the dashboard to make it a valuable tool for traders and analysts.• Transformed intricate data into valuable insights, enhancing user decision-making.• Predicted Spots using Machine Learning.• Spearheaded the development of a cutting-edge OCR (Optical Character Recognition) application using Python and the Django framework.• Designed the application to intelligently extract and process financial data from various sources, including slideshows and PDF documents.• Devised algorithms for accurate data extraction and transformed raw data to meet client requirements.• Enhanced user experience and provided actionable insights for clients' decision-making processes.• Employed Python to interface with AWS S3, leveraging its robust libraries for data extraction.• Implemented intricate ETL (Extract, Transform, Load) processes to handle and preprocess Parquet files stored on AWS S3 buckets.• Developed a trained model capable of predicting the optimal timing for sending emails to different customer segments.• Took into account various factors such as past engagement rates, customer demographics, and campaign nature for tailored email dispatch. Show less