Software Engineer
Current• Evaluate AI-generated code responses based on tool, function, and parameter correctness• Assess response fulfillment in addressing user prompts• Perform side-by-side comparisons of responses and provide preference scores• Write detailed justifications for ratings, considering code output and prompt requirements• Handle edge cases like unfeasible requests, blank outputs, and foreign languages• Utilize API documentation to determine the validity of tools, functions, and parameters