Senior Psychometrician
Current- Leads psychometric support for state department of education on multimillion-dollar contract providing interim assessments in reading and math for grades Pre-K to 2. Regularly monitors student progress, examines measurement quality, and presents updates to technical advisory committee (TAC).- Collaborates closely with engineering, product, content, and research teams on massive project to revamp flagship suite of adaptive assessments for grades Pre-K to 12. Involves changes to test blueprints for better alignment to standards, large-scale calibration of new items and recalibration of existing items, adjustments to score estimation algorithm, revisions to linking with other measures, and extensive CAT simulations to validate updated assessments.- Manages variety of routine operations with cross-functional teams, such as updating national norms and analyzing impact, maintaining item banks, updating performance benchmarks, responding to school district and state-level RFPs, and editing technical manuals for assessment products.- Conducts research to enhance measurement practice, such as constructing unified framework for classification accuracy and consistency, comparing measurement error across disparate score scales, modeling and norming student growth, scoring invariant response patterns in CAT, quantifying adaptiveness of individual items in CAT, evaluating measurement models for curriculum-based measures (CBMs), and detecting low test-taking effort.
