Vice President Of Psychometric Services
CurrentResponsible for directing ABFM psychometric operations. Providing support to the ABFM CEO and Board of Directors as needed, as well as acting as a liaison to other medical specialty boards regarding psychometric issues. Notable achievements:• Transitioned ABFM examinations from Classical Test Theory (CTT) to the dichotomous Rasch model. • Provided psychometric oversight to: the passing standard review process, the Differential Item Functioning (DIF) process, item analysis procedures, and exam scoring.• Conducted and collaborated on research that demonstrates the reliability and validity of ABFM examinations. • Equated the In-Training Exam (ITE) onto the Family Medicine Certification Examination (FMCE) scale which permits the ITE results to be interpreted as how the resident would score on the certification examination at that point in time.• Developed a Bayesian Score Predictor (BSP) that permits residents and residency program directors to use ITE scores or scores from medical licensing examinations to estimate the resident’s probability of passing the FMCE upon graduation from residency. BSP predictions adjust for expected growth attributed to residency training. • Designed the Continuous Knowledge Self-Assessment (CKSA) which permits physicians to test their knowledge and clinical decision-making skills on a quarterly basis. The CKSA also provides physicians with a predicted FMCE scaled score, a predicted probability of passing, and an index of how well placed the physician’s confidence in their answer is (meta-cognitive accuracy). • Conducted outreach efforts to family medicine residency programs that help them to identify struggling residents so that remediation can be done in a timely manner. • Provided oversight for the 2025 rebalanced blueprint. • Conducted studies that demonstrated the comparability of the one-day examination with the 3-4 year longitudinal assessment.•Established a psychometric internship program.
