Senior Software Engineer
Current•Designed, built, and shipped systems for evaluation of large language models as part of the Amazon Bedrock product, allowing thousands of customers to quickly and easily assess modern LLMs for accuracy, toxicity, and other dimensions.•Drove development of data annotation tools for demonstration data collection, preference ranking data, red teaming, and other generative AI use cases, leading to new multi-million dollar business opportunities.•Deployed and integrated a novel PyTorch model for bounding box annotation, allowing customers to reduce their bounding box annotation time by 39%.•Founding team member of the SageMaker Ground Truth service, where I built distributed systems for running active learning models, allowing customers to save 70% on their data annotation costs.•Tech lead with responsibility for steering weekly engineering operations meetings.•Comfortable working across the software lifecycle, including designing, shipping, and operating internet-scale web services.•Fluent in core AWS technologies, including S3, EC2, AWS Lambda, API Gateway, SNS, SQS, and others, along with Java, Python, and Docker.