Rob Keller Email & Phone Number

United States

• Served as Senior Measurement Advisor for computerized adaptive testing (CAT)• Conducted simulation studies to optimize CAT configuration and to advise content developers where new development would best serve the testing program• Led teams of research scientists and data analysts to support educational research for local, state, and national educational organizations• Worked as a lead advisor to multiple state and municipal programs in developing and implementing practical and… Show more • Served as Senior Measurement Advisor for computerized adaptive testing (CAT)• Conducted simulation studies to optimize CAT configuration and to advise content developers where new development would best serve the testing program• Led teams of research scientists and data analysts to support educational research for local, state, and national educational organizations• Worked as a lead advisor to multiple state and municipal programs in developing and implementing practical and innovative solutions Show less

Alpharetta, Georgia, United States

• Oversaw the creation of enterprise-level software tools to support operational psychometric work, test development, and adaptive testing• Created tools to support approximately 10 significant operational priorities spanning 4 functional groups, reducing time and effort required for task completion by between 50%-95% and error incidents by over 95%• Conducted dozens of research studies annually in psychometrics, test development, and adaptive testing• Developed data storage and… Show more • Oversaw the creation of enterprise-level software tools to support operational psychometric work, test development, and adaptive testing• Created tools to support approximately 10 significant operational priorities spanning 4 functional groups, reducing time and effort required for task completion by between 50%-95% and error incidents by over 95%• Conducted dozens of research studies annually in psychometrics, test development, and adaptive testing• Developed data storage and integration strategies to support enterprise level psychometric analysis software; developed protocols to allow cross-departmental and cross-organizational communication within software systems; oversaw developers and IT resources to achieve these goals• Conducted operational psychometric procedures, predominantly focused on test equating and standard setting preparation• Performed all equating work for Measured Progress clients for over a decade, equating over 300 tests annually and processing scores for approximately 5 million students each year. • Collaborated with the Psychometric team of 6-8 PhD psychometricians to develop strategies to solve psychometric problems and operationalize solutions• Collaborated with the Content team to develop tools for item writing, test construction and automated test assembly, streamlining development of the production of over 300 tests annually• Worked effectively with leaders across the organization to assist in the development of products and proposals• Served on corporate task forces to improve data quality and integrity, devise technology solutions to support operational work, and build efficiencies and integrations across functional workgroups Show less

• Developed psychometric based software tools to improve workflow as well as data management efficiencies and integrity• Conducted research on best practices and implementation details on operational psychometric topics (e.g., Automated Test Assembly, Computer Adaptive Testing, IRT Based Calibration, Equating techniques)• Worked as part of a development team filling multiple roles, including: Product Owner, Software Engineer, Subject Matter Expert, Business Analyst

• Performed operational psychometric tasks for large-scale high-stakes K-12 testing programs:- Performed IRT based and Classical Test Equating studies for 95% of the company’s contracts- Contributed to bid proposal writing- Worked with clients to ascertain their needs and help them understand their results- Conducted, presented, and published psychometric research that supported operations• Led software development initiatives to develop: - Software tools to support… Show more • Performed operational psychometric tasks for large-scale high-stakes K-12 testing programs:- Performed IRT based and Classical Test Equating studies for 95% of the company’s contracts- Contributed to bid proposal writing- Worked with clients to ascertain their needs and help them understand their results- Conducted, presented, and published psychometric research that supported operations• Led software development initiatives to develop: - Software tools to support psychometric analyses- Automated data driven documentation systems- A computer adaptive testing engine and item bank analysis program• Improved software systems to increase data integrity, quality, and cross functional accessibility Show less

Dover, Nh

• Secured 2 multi-year contracts with the federal government to provide psychometric assistance on English Language and Foreign Language Assessment Programs for the Defense Language National Security Office through an open competitive bid process• Oversaw and participated in simulation work to support small-sample item calibration (IRT) for purposes of constructing parallel forms in foreign language testing programs• Served as member of the Validity Task Force, which guided the Foreign… Show more • Secured 2 multi-year contracts with the federal government to provide psychometric assistance on English Language and Foreign Language Assessment Programs for the Defense Language National Security Office through an open competitive bid process• Oversaw and participated in simulation work to support small-sample item calibration (IRT) for purposes of constructing parallel forms in foreign language testing programs• Served as member of the Validity Task Force, which guided the Foreign Language Center at the Defense Language Institute developing a validity argument and collecting evidence in support of test score interpretations and uses• Provided guidance to the DELTAP (Technical Advisory Panel) on approaches for improving the psychometric rigor of the Foreign Language Assessment Programs Show less