Responsible for directing ABFM psychometric operations. Providing support to the ABFM CEO and Board of Directors as needed, as well as acting as a liaison to other medical specialty boards regarding psychometric issues. Notable achievements:• Transitioned ABFM examinations from Classical Test Theory (CTT) to the dichotomous Rasch model. • Provided psychometric oversight to: the passing standard review process, the Differential Item Functioning (DIF) process, item analysis procedures, and exam scoring.• Conducted and collaborated on research that demonstrates the reliability and validity of ABFM examinations. • Equated the In-Training Exam (ITE) onto the Family Medicine Certification Examination (FMCE) scale which permits the ITE results to be interpreted as how the resident would score on the certification examination at that point in time.• Developed a Bayesian Score Predictor (BSP) that permits residents and residency program directors to use ITE scores or scores from medical licensing examinations to estimate the resident’s probability of passing the FMCE upon graduation from residency. BSP predictions adjust for expected growth attributed to residency training. • Designed the Continuous Knowledge Self-Assessment (CKSA) which permits physicians to test their knowledge and clinical decision-making skills on a quarterly basis. The CKSA also provides physicians with a predicted FMCE scaled score, a predicted probability of passing, and an index of how well placed the physician’s confidence in their answer is (meta-cognitive accuracy). • Conducted outreach efforts to family medicine residency programs that help them to identify struggling residents so that remediation can be done in a timely manner. • Provided oversight for the 2025 rebalanced blueprint. • Conducted studies that demonstrated the comparability of the one-day examination with the 3-4 year longitudinal assessment.•Established a psychometric internship program.

Supervised professional and clerical staff. Managed the psychometrics, administration, and operations groups within the department. Oversaw the psychometric aspects of the test service transition from Chauncey-Prometric to Pearson VUE. Provided psychometric expertise and analyses for standard setting, test-plan revisions, item equating methodologies, and the selection of item calibration software. Directed the Joint Research Committee’s efforts to solicit, evaluate and fund NCLEX-related research proposals. Directed the efforts to develop uniform policies and procedures to investigate and then address incidents of candidate misconduct.

Supervised clerical staff. Provided psychometric support for the Dental and Optometry Admissions Tests as well as the National Board examinations for dentists and dental hygienists. Provided analyses for survey research projects from the R&D committee that compensate for rater severity. Provided a collection design to facilitate the identification of “drifting” item calibrations.

Supervised professional and clerical staff. Scored 4 different practical exams using a Multi-Faceted Rasch model to control for rater severity, session severity, item difficulty, and task difficulty. Supervised the transmission of results from 20 Computerized Adaptive Tests. Recalibrated the Pathology Residents' In-Service Exam using Rasch equating methods. Calibrated the experimental items onto existing scales. Participated in setting cut scores. Used pooling strategies for low volume exams. Assisted exam committees with item writing. Changed the archiving of Exam Activities records from microfiche to CD-ROM. Initiated and supervised the acquisition/installation of a non-MIS FileServer to support departmental activities. Managed a ten year prospective study of Medical Technologist career patterns. Managed an annual study of medical technology educational programs.

Developed, analyzed, and reported the results of task surveys to assess the current practice of medical sonography. Presented alternative exam development procedures to enhance exam validity and defensibility. Responsible for computer purchase, setup, and maintenance. Acted as staff liaison to Test Development, Certification, and Technology Committee as well as the Review Panel. Wrote SPSS programs to generate statistical reports regarding educational programs, summaries and forecasts of exam applicants, etc. Assisted in the set-up of a computer administered exam and coordinated transfer of enrollments and results. Analyzed certification exam results across time. Conducted surveys to identify common practices of other certification boards, to assess the potential of foreign markets, and to anticipate the reaction of registrants to changes in the continuing competency policy and recertification.

Military Intelligence - Top Secret Clearance