Felipe C. Email & Phone Number

São Carlos, Sp, Br

Ballincollig, County Cork, Ireland

✔ Developed and maintained numerous Scrapy spiders across different Python codebases, ensuring efficient delivery of results within demanding schedules. ✔ Tasked with handling various responsibilities, including building projects from scratch and maintenance tasks such as addressing bugs and refactoring older code.✔ Engaged in direct communication with clients to grasp project specifications and offer personalized solutions, adapting to versatile and evolving situations to meet changing project requirements.✔ Actively participated in a fully remote work environment, collaborating with a multicultural team across different time zones.

Palo Alto, California, United States

✔ Tasked with developing, monitoring, and maintaining spiders to crawl and scrape data from hundreds of different sources, including app stores, big e-commerce websites such as Amazon and Walmart, forums, and blogs, across multiple different countries, all using the Scrapy framework and Python daily.✔ Implemented a reliability layer on top of the Scrapy framework, complete with middlewares and extensions, handling headless browsers, rotating proxies, evasion measures, and Redis integration for caching and scheduling, increasing request success rate from 40% to 85%+.✔ Acted on a project to design and implement a distributed crawling architecture, greatly increasingperformance, bringing the volume of scraped data items from the 100k items/week range up to 3mil items/week, and providing real-time monitoring dashboards.✔ Operated in a fast-paced B2B startup environment, often dealing with stakeholders directly, turning their feedback into actionable project requirements, and producing data deliverables on time.

São Carlos, São Paulo, Brazil

✔ Responsible for data extraction projects through different means, querying APIs, diverse databases, or scraping web pages to build datasets needed by both business clients and internal stakeholders for Analytics pipelines.✔ Designed dashboards, automated spreadsheets, and reports using Google Data Studio, transforming and merging data from different sources, such as Google Sheets, and writing complex queries daily using Google Standard SQL on Google BigQuery, providing client companies with real-time marketing insights.✔ Worked closely with non-technical teams from high-profile e-commerce companies in Brazil and their Latin American branches, communicating project needs across different teams and implementing new internal data pipelines to support BI operations, using Python and Google BigQuery.✔ Developed data governance tooling to reduce maintenance efforts by leveraging data lineage and network visualizations for all data pipelines, highlighting bottlenecks, and trimming down storage costs.

Master Of Business Administration - Mba, Artificial Intelligence And Big Data

Bachelor Of Science In Computer Science, Computer Science