Senior Software Engineer, Python
CurrentIn my current role as Lead Engineer, I'm at the forefront of developing a groundbreaking solution that leverages large language models (LLMs) to automate the extraction and structuring of data from the web, facilitating real-time, intelligent search capabilities for our organization. My contributions and responsibilities in this role include:- Use Case Development: Directed the design and execution of a sophisticated system that integrates LLMs with search engine technologies to identify, crawl, and extract relevant information from online sources, significantly enhancing our data analysis and decision-making capabilities.- Advanced Data Processing: Innovated techniques using LLM embeddings for accurate identification of relevant data within web pages, and implemented JSON/Python dictionary structures for efficient entity extraction and data structuring, ensuring high-quality, actionable insights.- Leadership and Mentorship: Led a remote engineering team, fostering skill development and ensuring high standards of work through comprehensive code reviews and strategic guidance on best practices and project implementation.- Proof of Concept and Innovation: Actively engaged in developing and testing proof of concepts to validate the technology's effectiveness, continuously seeking improvements and advancements in our approach to data extraction and analysis.- Technology Implementation: Employed a robust tech stack, including FastAPI for creating a versatile API, and Mangum for deployment on AWS Lambda, ensuring scalable, reliable, and efficient service delivery within the larger organizational framework.This position requires a deep understanding of LLM capabilities, strong project leadership, and the ability to drive technological innovation, setting a new precedent for leveraging AI in enhancing organizational data intelligence.