Reliability of the Part II Board Certification Examination in Psychiatry: interexaminer consistency
Abstract
OBJECTIVE: The aim of the study was to examine the reliability (interexaminer consistency) of the American Board of Psychiatry and Neurology (ABPN) Part II (oral) examination in psychiatry. METHOD: Grades were assigned independently by two examiners who observed the same examination in a 1-year cycle (1,422 candidates, two examinations each). The consistency between these pairs of grades (pass, condition, fail) was analyzed using a weighted kappa statistic. RESULTS: There was perfect agreement between examiners in 67% of examinations, minor disagreement in 26%, and major disagreement in 7% (weighted kappa = 0.54-0.56). CONCLUSIONS: The Part II ABPN examination demonstrates fair to good reliability as measured by interexaminer consistency. Development of more explicit grading criteria should further improve examiner agreement in future examinations.
Access content
To read the fulltext, please use one of the options below to sign in or purchase access.- Personal login
- Institutional Login
- Sign in via OpenAthens
- Register for access
-
Please login/register if you wish to pair your device and check access availability.
Not a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5 library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).
