Technical Lead - Data Engineering
CurrentLeading a team of 12 members responsible for data scraping, storage management, and daily process oversight.Data Scraping: Overseeing the extraction of data from various websites and updating it to storage accounts, ensuring data accuracy and efficiency.Automation & Pre-Scripts: Developing and maintaining Python-based pre-scripts to filter and refine scraped data, enhancing data quality and processing speed.Process Management: Managing daily operations, ensuring that… Show more Leading a team of 12 members responsible for data scraping, storage management, and daily process oversight.Data Scraping: Overseeing the extraction of data from various websites and updating it to storage accounts, ensuring data accuracy and efficiency.Automation & Pre-Scripts: Developing and maintaining Python-based pre-scripts to filter and refine scraped data, enhancing data quality and processing speed.Process Management: Managing daily operations, ensuring that workflows are optimized for efficiency and alignment with project objectives. Show less