Chapel Hill, North Carolina, United States
I am involved in the planning and oversight of all psychometric activities for the ABP (e.g., practice analysis, standard setting, scoring, score reporting, item analysis, test security analysis, validation research). A few of my primary responsibilities include managing and mentoring psychometric department staff and collaborating with subject matter experts (pediatricians) and other ABP staff (especially test development staff) to develop examination programs that maximize the accuracy and validity of the decisions that are made based on the scores from those exams. In addition to those core responsibilities, I am actively involved in research efforts consistent with the goals of the ABP, focusing largely on issues surrounding equating, standard setting, score reporting, re-certification, and adult learning theory.
I performed psychometric services for licensure and certification programs, including job analysis, item writing training, standard setting, item analysis, equating, IRT analysis, annual reporting, and accreditation consulting. In addition, I supervised our psychometric data analyst and was active in internal research and development efforts that were used to guide Castle's policies and procedures.
I received support from the College Board to lead a research project that investigated the potential for using Advanced Placement (AP) scores in the college admission of transfer students.