Archives of Rehabilitation Research and Clinical Translation (Jun 2021)

Improving the Delivery of Function-Directed Care During Acute Hospitalizations: Methods to Develop and Validate the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT)

  • Andrea L. Cheville, MD, MSCE,
  • Chun Wang, PhD,
  • Kathleen J. Yost, PhD,
  • Jeanne A. Teresi, EdD, PhD,
  • Mildred Ramirez, PhD,
  • Katja Ocepek-Welikson, M Phil,
  • Pengsheng Ni, MD, MPH,
  • Elizabeth Marfeo, PhD, MPH, OTR/L,
  • Tamra Keeney, DPT, PhD,
  • Jeffrey R. Basford, MD, PhD,
  • David J. Weiss, PhD

Journal volume & issue
Vol. 3, no. 2
p. 100112

Abstract

Read online

Objective:: To (1) develop a patient-reported, multidomain functional assessment tool focused on medically ill patients in acute care settings; (2) characterize the measure's psychometric performance; and (3) establish clinically actionable score strata that link to easily implemented mobility preservation plans. Design:: This article describes the approach that our team pursued to develop and characterize this tool, the Functional Assessment in Acute Care Multidimensional Computer Adaptive Test (FAMCAT). Development involved a multistep process that included (1) expanding and refining existing item banks to optimize their salience for hospitalized patients; (2) administering candidate items to a calibration cohort; (3) estimating multidimensional item response theory models; (4) calibrating the item banks; (5) evaluating potential multidimensional computerized adaptive testing (MCAT) enhancements; (6) parameterizing the MCAT; (7) administering it to patients in a validation cohort; and (8) estimating its predictive and psychometric characteristics. Setting:: A large (2000-bed) Midwestern Medical Center. Participants:: The overall sample included 4495 adults (2341 in a calibration cohort, 2154 in a validation cohort) who were admitted either to medical services with at least 1 chronic condition or to surgical/medical services if they required readmission after a hospitalization for surgery (N=4495). Intervention:: Not applicable. Main Outcome Measures:: Not applicable. Results:: The FAMCAT is an instrument designed to permit the efficient, precise, low-burden, multidomain functional assessment of hospitalized patients. We tried to optimize the FAMCAT's efficiency and precision, as well as its ability to perform multiple assessments during a hospital stay, by applying cutting edge methods such as the adaptive measure of change (AMC), differential item functioning computerized adaptive testing, and integration of collateral test-taking information, particularly item response times. Evaluation of these candidate methods suggested that all may enhance MCAT performance, but none were integrated into initial MCAT parameterization. Conclusions:: The FAMCAT has the potential to address a longstanding need for structured, frequent, and accurate functional assessment among patients hospitalized with medical diagnoses and complications of surgery.

Keywords