Nancy Gates

Nancy Gates Email and Phone Number

AI Trainer/Annotation Team & Project Manager @ Meta
Nancy Gates's Location
United States, United States
Nancy Gates's Contact Details
About Nancy Gates

AI Chat Bot Trainer/ Data Annotator & Annotation Project Manager. Full-Time: October 2024 - Lead AI Quality Analyst @ Centric. Member of LLM team. We train and QA generative AI chatbots to evaluate and refine relevance, factual accuracy, and concision.Contractor @ Cohere: June 2023 - September 2024: Senior Data Quality SpecialistI perform Data Annotation & Evaluation, including:• Training GAI (Generative AI) Chatbots on LLMs• Writing prompts & dialogue• Fact-Checking Chatbot Output• Red Teaming•QA: Quality Assurance/Auditing•Guidelines and project developmentAs a pod lead, I also serve as the POC for a pod of 16 annotators. I help assign them to projects and hold weekly meetings to address questions and issues. I am also a Project Lead for a prompt assessment project, and I run recurring continuing education presentations on our most challenging projects.2017 - 2022: MoveworksAnnotation:•Trained LLM Conversational AI Chatbot for enterprise domains (IT, HR, Legal).•Created semantic search symptom statements and query prompts.•Assisted with recruiting, Interviewing and training new annotators.Project Manager:•Led a large NLU project (30 annotators) with 1K tagging combinations.•Curated data set disagreements for review, discussion, and calibration.•Prepared Monthly Project QC Metrics Reports for ML Engineering.•Worked with taxonomist to create and refine project guidelines.2021: Promoted to Onboarding Manager for Annotation at Moveworks.•Supervised the onboarding and acclimation of nearly 100 annotators. •Co-created detailed onboarding and orientation materials. •Also managed 12 Direct Reports in my role as an Annotation Manager. 2004 - 2017: Online researcher, search relevance quality analyst (Google, Microsoft), and data annotator (temporary job at LinkedIn). Skills:• Researching/Analyzing/Evaluating Search Queries, Web Sites & Ads (text and video).• Digital Literacy: Determining user intent; site relevance; and quality & veracity of information. • Fact-checking; Reference & Research.• Search: Open Web and Proprietary Databases.• Data Annotation; Cataloging/Classifying/Tagging.

Nancy Gates's Current Company Details
Meta

Meta

View
AI Trainer/Annotation Team & Project Manager
Website:
metadownhole.com
Employees:
136862
Nancy Gates Work Experience Details
  • Meta
    Meta
  • Centific
    Ai Quality Analyst
    Centific Oct 2024 - Present
    Redmond, Washington, Us
    Member of the multilingual LLM Team. We train and QA generative AI chatbots, evaluating prompts and output for concision, relevance, safety, and factual accuracy.
  • Cohere
    Senior Data Quality Specialist
    Cohere Jun 2023 - Oct 2024
    Toronto, Ontario, Ca
    •Training GAI (Generative AI) Chatbots on LLMs • Writing prompts & dialogue. • Fact-Checking Chatbot Output.• Red Teaming/Ethical Hacking• Quality Assurance• Creating tutorial videos and FAQsI was also a Pod Lead and served as POC for a pod of 16 annotators. served as the POC for a group of 16 annotators: I helped assign projects and hosted weekly sit-downs to address issues and answer questions.
  • Moveworks
    Annotation Project Manager & Direct Manager
    Moveworks Oct 2017 - Nov 2022
    Mountain View, California, Us
    Annotator and Annotation Manager – Moveworks.ai (2017-2022): Linguistic Annotation for Conversational AI. I also supervised 12 direct hires.-Trained AI Chat Bots across enterprise domains: IT, HR, Legal, Facilities, etc. -Wrote semantic search & query prompts/questions to train the bot to retrieve relevant information while maintaining logical conversational flow. -Managed a large team (30 annotators) on a user intent project with a 1K+ tag taxonomy: we produced 5-7K annotations per week, while maintaining an 85%-90% agreement rate. -Curated large dataset disagreements for recalibration to maintain required agreement rates. -Compiled Monthly QC Reports on Projects and Annotators. -Wrote Project Guidelines according to evolving taxonomy. -Wrote Onboarding and Orientation materials for new hires. -Interviewed and trained new annotators; supervised onboarding
  • Magnit
    Data Annotator
    Magnit Mar 2017 - Jun 2017
    Folsom, California, Us
    Temporary Data Annotation job via Magnit (AKA Worfkforce Logiq/ZeroChaos). I helped refine the LinkedIn search engine using Named Entity Recognition (NER) annotation.
  • Magnit
    Google Ads Evaluator 2004-2006; 2014-2016
    Magnit Aug 2004 - Aug 2016
    Folsom, California, Us
    Search Relevance: I assessed user intent and interests and examined resulting Web search results (including social media) and advertising for relevance and quality. I had to pay close attention to wording and images to determine suitability. Search relevance feedback from human raters helps search engines companies determine results ranking.Note: I worked this project on two two-year contracts. Participation on this project was capped at two stints.
  • Lionbridge Technologies
    Search Relevance & Website Evaluator For Bing
    Lionbridge Technologies Nov 2007 - Jun 2012
    Waltham, Massachusetts, Us
    Evaluated search results yielded by Bing for query relevance and websites for authoritativeness and trustworthiness.
  • Techsoup Global
    Freelance Researcher
    Techsoup Global 2007 - 2009
    Researched and compiled country background reports on technology infrastructure and capabilities, and technology related NGO's.
  • Google
    Google Answers Researcher
    Google 2002 - 2006
    Mountain View, Ca, Us
    I was a Researcher at Google Answers, Google's Online Reference Service, from 2002 until the service closed in 2006. I completed 150 research assignments, from financial to medical queries, and market and historical research.
  • Thomson Reuters
    Writer & Copy Editor Thomson Reuters
    Thomson Reuters 2002 - 2005
    Toronto, On, Ca
    I wrote and edited summaries of corporate quarterly earnings reports for Thomson Reuter's StreetEvents.com, covering a broad range of sectors, from entertainment/media to Homeland Security contractors. Corporations I covered included Raytheon, MGM, Walmart, and News Corp. As an editor, I supervised and edited up to five writers simultaneously under tight deadlines. I also assisted with quarterly quality assurance reviews of StreetEvents reports.

Nancy Gates Skills

Interviewing Data Labeling Writing Orientation Guides Quality Assurance Technical Writing Natural Language Processing Chatbot Development Annotation Writing Instructions Artificial Intelligence Data Annotation Taxonomy Editing Prompt Engineering Onboarding Metadata Conversational Ai Online Research Generative Ai Python Project Management Semantic Search Machine Learning Natural Language Understanding Copy Editing Nlp And Training Data Services Search Relevance Hiring

Nancy Gates Education Details

  • University Of Maine At Augusta
    University Of Maine At Augusta
    Information & Library Science
  • Pennwest Clarion
    Pennwest Clarion
    Library-Information Science
  • Ucla
    Ucla
    Public Relations Courses

Frequently Asked Questions about Nancy Gates

What company does Nancy Gates work for?

Nancy Gates works for Meta

What is Nancy Gates's role at the current company?

Nancy Gates's current role is AI Trainer/Annotation Team & Project Manager.

What is Nancy Gates's email address?

Nancy Gates's email address is na****@****work.fr

What is Nancy Gates's direct phone number?

Nancy Gates's direct phone number is +151331*****

What schools did Nancy Gates attend?

Nancy Gates attended University Of Maine At Augusta, Pennwest Clarion, Ucla.

What skills is Nancy Gates known for?

Nancy Gates has skills like Interviewing, Data Labeling, Writing Orientation Guides, Quality Assurance, Technical Writing, Natural Language Processing, Chatbot Development, Annotation, Writing Instructions, Artificial Intelligence, Data Annotation, Taxonomy.

Who are Nancy Gates's colleagues?

Nancy Gates's colleagues are Debra Teets, Logan Chung, India He Bhai, Leonardo Santamaria, Sameer Mark, Mario Hernández, Ms, Adel Azad.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.