The Emergence of Item Response Theory Models and the Patient Reported Outcomes Measurement Information Systems
DOI:
https://doi.org/10.17713/ajs.v38i4.274Abstract
Item response theory (IRT) models emerged to solve practical testing problems in large-scale cognitive achievement and aptitude assessment. Within the last decade, an explosion of IRT applications have occurred in the non-cognitive domain. In this report, I highlight the development, implementation, and results of a single project: Patient Reported Outcomes Measurement Information Systems (PROMIS). The PROMIS projectreflects the state-of-the-art application of IRT in the non-cognitive domain, and has produced important advancements in patient reported outcomes measurement.
However, the project also illustrates challenges that confront researchers wishing to apply IRT to non-cognitive constructs. These challenges are: a) selecting a population to set the metric for interpretation of item parameters, b) working with non-normal quasi-continuous latent traits, and c) working with narrow-bandwidth constructs that potentially have a limited
pool of potential indicators. Differences between cognitive and non-cognitive measurement contexts are discussed and directions for future research suggested.
References
Borsboom, D. (2005). Measuring the Mind: Conceptual Issues in Contemporary Psychometrics. Cambridge: Cambridge University Press.
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., and Yount, S. (2010). Initial item banks and first wave testing of the patient-reported outcomes measurement information system (PROMIS) network: 2005-2008. (under review)
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., and Reeve, B. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45,
S3-S11.
Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., and Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full length measures of depressive symptoms. (in press)
DeWalt, D. A., Rothrock, N., Yount, S., and Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45, S12-S21.
Embretson, S. E., and Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, NJ: Erlbaum.
Gibbons, R. D., Grochocinski, V. J., Weiss, D. J., Bhaumik, D. K., and Kupfer, D. J. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychological Services, 59, 361-368.
Hambleton, R. K., and Swaminathan, H. (1985). Item response theory: Principles and applications. Norwell, MA: Kluwer Academic Publishers.
Hays, R. D., Morales, L. S., and Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38, 517-527.
Lai, J., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2010). Development of the PROMIS fatigue item bank, computerized adaptive testing, and short-forms. (under review)
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, T., and Cella, D. (2010). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS): Depression, anxiety, and anger. (under
review)
Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., and Teresi, J. A. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45, S22-S31.
Reise, S. P., Ainsworth, A. T., and Haviland, M. G. (2005). Item response theory: Fundamentals, applications, and promise in psychological research. Current Directions in Psychological Science, 14, 95-101.
Reise, S. P., and Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 17.
Woods, C. M. (2006). Ramsay-curve item response theory to detect and correct for non-normal latent variables. Psychological Methods, 11, 253-270.
Downloads
Published
How to Cite
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.