0
Get Alert
Please Wait... Processing your request... Please Wait.
You must sign in to sign-up for alerts.

Please confirm that your email address is correct, so you can successfully receive this alert.

Articles   |    
Development of the CAT-ANX: A Computerized Adaptive Test for Anxiety
Robert D. Gibbons, Ph.D.; David J. Weiss, Ph.D.; Paul A. Pilkonis, Ph.D.; Ellen Frank, Ph.D.; Tara Moore, M.A., M.P.H.; Jong Bae Kim, Ph.D.; David J. Kupfer, M.D.
Am J Psychiatry 2014;171:187-194. doi:10.1176/appi.ajp.2013.13020178
View Author and Article Information

Drs. Gibbons, Kupfer, Frank, Weiss, and Pilkonis have financial interests in Adaptive Testing Technologies, through which the CAT-ANX will be made available commercially. Dr. Frank has served as a consultant for Servier International and has received royalties from Guilford Press and American Psychological Association Press. Dr. Kupfer has served as a consultant for the American Psychiatric Association.

Supported by NIMH grant R01-MH66302.

From the Center for Health Statistics, University of Chicago, Chicago; the Department of Psychology, University of Minnesota, Minneapolis; and Western Psychiatric Institute, University of Pittsburgh, Pittsburgh.

Address correspondence to Dr. Gibbons (rdg@uchicago.edu).

Copyright © 2014 by the American Psychiatric Association

Received February 08, 2013; Revised April 03, 2013; Accepted May 06, 2013.

Abstract

Objective  The authors developed a computerized adaptive test for anxiety that decreases patient and clinician burden and increases measurement precision.

Method  A total of 1,614 individuals with and without generalized anxiety disorder from a psychiatric clinic and community mental health center were recruited. The focus of the present study was the development of the Computerized Adaptive Testing–Anxiety Inventory (CAT-ANX). The Structured Clinical Interview for DSM-IV was used to obtain diagnostic classifications of generalized anxiety disorder and major depressive disorder.

Results  An average of 12 items per subject was required to achieve a 0.3 standard error in the anxiety severity estimate and maintain a correlation of 0.94 with the total 431-item test score. CAT-ANX scores were strongly related to the probability of a generalized anxiety disorder diagnosis. Using both the Computerized Adaptive Testing–Depression Inventory and the CAT-ANX, comorbid major depressive disorder and generalized anxiety disorder can be accurately predicted.

Conclusions  Traditional measurement fixes the number of items but allows measurement uncertainty to vary. Computerized adaptive testing fixes measurement uncertainty and allows the number and content of items to vary, leading to a dramatic decrease in the number of items required for a fixed level of measurement uncertainty. Potential applications for inexpensive, efficient, and accurate screening of anxiety in primary care settings, clinical trials, psychiatric epidemiology, molecular genetics, children, and other cultures are discussed.

Abstract Teaser
Figures in this Article

Your Session has timed out. Please sign back in to continue.
Sign In Your Session has timed out. Please sign back in to continue.
Sign In to Access Full Content
 
Username
Password
Sign in via Athens (What is this?)
Athens is a service for single sign-on which enables access to all of an institution's subscriptions on- or off-site.
Not a subscriber?

Subscribe Now/Learn More

PsychiatryOnline subscription options offer access to the DSM-5 library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing PsychiatryOnline@psych.org or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

FIGURE 1. Flowchart of Participant Enrollment, Allocation, and Testing for Development of the Computerized Adaptive Testing–Anxiety Inventory

a Treatment-seeking comparison subjects were patients who came in for treatment but did not meet DSM criteria for depression or anxiety.

FIGURE 2. Observed and Expected Proportions of Generalized Anxiety Disorder as a Function of Score on the Computerized Adaptive Testing–Anxiety Inventory (CAT-ANX)

FIGURE 3. Percentile Rank Among Patients With Generalized Anxiety Disorder and Probability of Generalized Anxiety Disorder Diagnosis for the Range of Scores on the Computerized Adaptive Testing–Anxiety Inventorya

a CAT-ANX=Computerized Adaptive Testing–Anxiety Inventory; GAD=generalized anxiety disorder.

FIGURE 4. Receiver Operating Characteristic Curve for the Computerized Adaptive Testing–Anxiety Inventory Compared With DSM-IV Generalized Anxiety Disorder
Anchor for Jump
TABLE 1.Examples of Items From Each of the Four Domains of the Computerized Adaptive Testing–Anxiety Inventory
Anchor for Jump
TABLE 2.Demographic Characteristics and Diagnostic Prevalence Rates of the Overall Sample (N=1,614)
Table Footer Note

aBased on the Structured Clinical Interview for DSM-IV; percentages based on an N of 387.

Anchor for Jump
TABLE 3.Item-by-Item Results for the Computerized Adaptive Testing–Anxiety Inventory for Two Illustrative Patients
Table Footer Note

aItems apply to the past 2 weeks.

Table Footer Note

bScore=44.0, SE=5.2; probability of generalized anxiety disorder, 0.458; percentile among patients with generalized anxiety disorder, 40.6%.

Table Footer Note

cScore=96.8, SD=5.5, probability of generalized anxiety disorder, 0.997, percentile among patients with generalized anxiety disorder, 99.0%.

+

References

Gibbons  RD;  Weiss  DJ;  Pilkonis  PA;  Frank  E;  Moore  T;  Kim  JB;  Kupfer  DJ:  Development of a computerized adaptive test for depression.  Arch Gen Psychiatry 2012; 69:1104–1112
[CrossRef] | [PubMed]
 
Fliege  H;  Becker  J;  Walter  OB;  Bjorner  JB;  Klapp  BF;  Rose  M:  Development of a computer-adaptive test for depression (D-CAT).  Qual Life Res 2005; 14:2277–2291
[CrossRef] | [PubMed]
 
Gardner  W;  Shear  K;  Kelleher  KJ;  Pajer  KA;  Mammen  O;  Buysse  D;  Frank  E:  Computerized adaptive measurement of depression: a simulation study.  BMC Psychiatry 2004; 4:13–23
[CrossRef] | [PubMed]
 
Gibbons RD, Immekus J, Bock RD: The Added Value of Multidimensional IRT Models. National Cancer Institute Technical Report. June 2007. http://outcomes.cancer.gov/areas/measurement/multidimensional_irt_models.pdf
 
Gibbons  RD;  Weiss  DJ;  Kupfer  DJ;  Frank  E;  Fagiolini  A;  Grochocinski  VJ;  Bhaumik  DK;  Stover  A;  Bock  RD;  Immekus  JC:  Using computerized adaptive testing to reduce the burden of mental health assessment.  Psychiatr Serv 2008; 59:361–368
[CrossRef] | [PubMed]
 
Gibbons  RD;  Hedeker  DR:  Full-information item bifactor analysis.  Psychometrika 1992; 57:423–436
[CrossRef]
 
Gibbons  RD;  Bock  RD;  Hedeker  D;  Weiss  D;  Segawa  E;  Bhaumik  DK;  Kupfer  D;  Frank  E;  Grochocinski  V;  Stover  A:  Full-Information item bifactor analysis of graded response data.  Appl Psychol Meas 2007; 31:4–19
[CrossRef]
 
Bock  RD;  Aitkin  M:  Marginal maximum likelihood estimation of item parameters: application of an EM algorithm.  Psychometrika 1981; 46:443–459
[CrossRef]
 
Quilty  LC;  Zhang  KA;  Bagby  RM:  The latent symptom structure of the Beck Depression Inventory-II in outpatients with major depression.  Psychol Assess 2010; 22:603–608
[CrossRef] | [PubMed]
 
Santor  DA;  Gregus  M;  Welch  A:  Eight decades of measurement in depression.  Measurement 2006; 4:135–155
 
Shafer  AB:  Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung.  J Clin Psychol 2006; 62:123–146
[CrossRef] | [PubMed]
 
Simms  LJ;  Grös  DF;  Watson  D;  O’Hara  MW:  Parsing the general and specific components of depression and anxiety with bifactor modeling.  Depress Anxiety 2008; 25:E34–E46
[CrossRef] | [PubMed]
 
DeWalt  DA;  Rothrock  N;  Yount  S;  Stone  AA; PROMIS Cooperative Group:  Evaluation of item candidates: the PROMIS qualitative item review.  Med Care 2007; 45(suppl 1):S12–S21
[CrossRef] | [PubMed]
 
Cochran  WG;  Cox  GM:  Experimental Designs .  New York,  Wiley, 1957
 
First  MB;  Spitzer  RL;  Gibbon  M;  Williams  JB:  Structured Clinical Interview for DSM-IV Axis I Disorders, Clinician Version (SCID-CV) .  Washington, DC,  American Psychiatric Press, 1996
 
Bock  RD;  Gibbons  RD:  Factor analysis of categorical item responses, in  Handbook of Polytomous Item Response Theory Models: Development and Applications . Edited by Nering  M;  Ostini  R.  Florence, Ky,  Lawrence Erlbaum, 2010
 
References Container
+
+

CME Activity

There is currently no quiz available for this resource. Please click here to go to the CME page to find another.
Submit a Comments
Please read the other comments before you post yours. Contributors must reveal any conflict of interest.
Comments are moderated and will appear on the site at the discertion of APA editorial staff.

* = Required Field
(if multiple authors, separate names by comma)
Example: John Doe



Web of Science® Times Cited: 2

Related Content
See Also...
Articles
Books
DSM-5™ Clinical Cases > Chapter 1.  >
DSM-5™ Clinical Cases > Chapter 5.  >
DSM-5™ Handbook of Differential Diagnosis > Chapter 2.  >
DSM-5™ Clinical Cases > Chapter 12.  >
Manual of Clinical Psychopharmacology, 7th Edition > Chapter 2.  >
Topic Collections
Psychiatric News