American College of Healthcare Executives (ACHE)

American College of Healthcare Executives (ACHE) sponsors a certification program to qualify healthcare executives as Fellows of ACHE (FACHE). Since 1998, HumRRO has provided technical consulting and support for development of the certification examination. HumRRO adheres to professional and legal standards for valid and fair testing in our design and methodology to test development. Every five years, we perform a job analysis study, conducting interviews, focus groups, and an online survey to identify critical tasks and the knowledges necessary to perform those tasks. We use the results of this study to inform and update the test content outline (i.e., test blueprint) appropriately.

Using the empirically derived test blueprint and research-based item development guidelines, we work with subject matter experts to develop the item bank. Development activities include writing and reviewing test items, measuring content validity, and pilot testing. We analyze pilot results to weed out poor items and retain good items. We also facilitate an annual cut-score workshop to identify an appropriate, criterion-related passing standard. We partner with a computer-based testing provider with whom we work closely to ensure the quality and accuracy of the administration and scoring procedures. Throughout the years, ACHE has redesigned aspects of the FACHE program in response to quality improvement initiatives and program evaluations, but HumRRO continues to maintain its approach to the exam, which remains a highly reliable and valid measure of executive competence.