Data Engineer
I performed as Data Engineer implementing data pipelines for a client in USA. This data pipeline involves using LLMs via API calls to providers like OpenAI and Anthropic to extract structured data. I also implemented: semantic deduplication algorithms using minhash and a web scrapper using brightdata.