Francisco Jair Oliveira Email and Phone Number

As a Lead Software Engineer in the Data Collection team, I am responsible for:- Team Leadership: Leading and coordinating a team of developers to design, implement, and maintain robust data collection systems.- Scalable Solutions: Developing scalable solutions for capturing, storing, and processing large volumes of data, ensuring high performance and reliability.- Collaboration: Collaborating closely with data scientists, analysts, and other stakeholders to understand needs and translate business requirements into technical specifications.- Quality Assurance: Ensuring the quality and integrity of the collected data through rigorous code reviews, comprehensive testing, and continuous monitoring.- Agile & DevOps Practices: Implementing agile methodologies and DevOps practices to enhance efficiency, streamline workflows, and ensure continuous delivery of high-quality projects.- Technology Innovation: Staying updated with emerging technologies and best practices in data collection and processing to continually improve systems and processes.Key Achievements:- Data Collection: Successfully implemented a system that collects over 57 million product prices daily across Brazil.- Customer Coverage: Achieved coverage of more than 90% of clients' product lists, significantly enhancing data completeness and accuracy.- Performance Optimization: Improved system performance and scalability to handle increasing data volumes without compromising speed or reliability.

As an expert in scraper development, I am responsible for creating new data collection solutions and maintaining and improving existing scrapers. Additionally, I have experience in deploying the developed scrapers, ensuring efficiency and proper functioning of the applications. My goal is to provide effective data collection solutions tailored to the specific needs of each project.

I have extensive experience in implementing scrapers for data collection in various environments, such as mobile, web, and desktop. Additionally, I have strong skills in developing efficient ETLs and I am an expert in deploying applications on AWS using EC2, ECS, Batch, Lambda, and Athena. My focus is on providing scalable solutions for data analysis and visualization.

I maintain and perform ongoing updates on the website of the Center for Open and Distance Education. Additionally, I am responsible for managing the posting of relevant content, ensuring that the site is always up-to-date and provides a positive user experience. With attention to detail and expertise in web development, I ensure the quality and functionality of the website, contributing to the continuous success of the institution.

Desenvolvimento de uma plataforma que emprega algoritmos de aprendizado de máquina para conduzir modelagem in silico de diagnósticos em patologia renal, com o objetivo de oferecer suporte tanto no ensino e aprendizagem quanto no processo de diagnóstico clínico.

Computer and printer network support and systems development for the institution.

Internship in the area of network infrastructure, maintenance of computers and printers and also in the area of development of web systems and mobile applications for the Federal University of Piauí.