The Emergence of Item Response Theory Models and the Patient Reported Outcomes Measurement Information Systems

Authors

  • Steven P. Reise University of California, Los Angeles

DOI:

https://doi.org/10.17713/ajs.v38i4.274

Abstract

Item response theory (IRT) models emerged to solve practical testing problems in large-scale cognitive achievement and aptitude assessment. Within the last decade, an explosion of IRT applications have occurred in the non-cognitive domain. In this report, I highlight the development, implementation, and results of a single project: Patient Reported Outcomes Measurement Information Systems (PROMIS). The PROMIS project
reflects the state-of-the-art application of IRT in the non-cognitive domain, and has produced important advancements in patient reported outcomes measurement.
However, the project also illustrates challenges that confront researchers wishing to apply IRT to non-cognitive constructs. These challenges are: a) selecting a population to set the metric for interpretation of item parameters, b) working with non-normal quasi-continuous latent traits, and c) working with narrow-bandwidth constructs that potentially have a limited
pool of potential indicators. Differences between cognitive and non-cognitive measurement contexts are discussed and directions for future research suggested.

References

Borsboom, D. (2005). Measuring the Mind: Conceptual Issues in Contemporary Psychometrics. Cambridge: Cambridge University Press.

Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., and Yount, S. (2010). Initial item banks and first wave testing of the patient-reported outcomes measurement information system (PROMIS) network: 2005-2008. (under review)

Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., and Reeve, B. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45,

S3-S11.

Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., and Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full length measures of depressive symptoms. (in press)

DeWalt, D. A., Rothrock, N., Yount, S., and Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45, S12-S21.

Embretson, S. E., and Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, NJ: Erlbaum.

Gibbons, R. D., Grochocinski, V. J., Weiss, D. J., Bhaumik, D. K., and Kupfer, D. J. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychological Services, 59, 361-368.

Hambleton, R. K., and Swaminathan, H. (1985). Item response theory: Principles and applications. Norwell, MA: Kluwer Academic Publishers.

Hays, R. D., Morales, L. S., and Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38, 517-527.

Lai, J., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2010). Development of the PROMIS fatigue item bank, computerized adaptive testing, and short-forms. (under review)

Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, T., and Cella, D. (2010). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS): Depression, anxiety, and anger. (under

review)

Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., and Teresi, J. A. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45, S22-S31.

Reise, S. P., Ainsworth, A. T., and Haviland, M. G. (2005). Item response theory: Fundamentals, applications, and promise in psychological research. Current Directions in Psychological Science, 14, 95-101.

Reise, S. P., and Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48.

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 17.

Woods, C. M. (2006). Ramsay-curve item response theory to detect and correct for non-normal latent variables. Psychological Methods, 11, 253-270.

Downloads

Published

2016-04-03

How to Cite

Reise, S. P. (2016). The Emergence of Item Response Theory Models and the Patient Reported Outcomes Measurement Information Systems. Austrian Journal of Statistics, 38(4), 211–220. https://doi.org/10.17713/ajs.v38i4.274

Issue

Section

Articles