Am J Psychiatry 156:5-10, January 1999
©Copyright 1999 American Psychiatric Association
Treatment Research at the Crossroads: The Scientific Interface of Clinical Trials and Effectiveness Research
Kenneth B. Wells, M.D., M.P.H.
OBJECTIVE: Policy and clinical management decisions depend on data on the health and cost impacts of psychiatric treatments under usual care, i.e., effectiveness. Clinical trials, however, provide information on treatment efficacy under best-practice conditions. An understanding of the design, analysis, and conventions of both efficacy and effectiveness studies can lead to research that better informs clinical and societal questions. METHOD: This paper contrasts the strengths and limitations of clinical trials and effectiveness studies for addressing policy and clinical decisions. These research approaches are assessed in terms of outcomes, treatments, service delivery context, implementation conventions, and validity. RESULTS: Clinical trials and effectiveness research share problems of internal and external validity despite more attention to internal validity in clinical trials (e.g., randomization, blinding, standardized protocols) and to external validity in effectiveness studies (e.g., community-based treatments, representative samples). CONCLUSIONS: To develop research at the interface of clinical trials and effectiveness studies, research goals must be redefined, and methods, such as cost-utility and econometric analyses, must be shared and developed. Development of hybrid designs that combine features of efficacy and effectiveness research will require separation of conventions such as frequency of follow-up, intensity of measurement, and sample size from the central scientific issues of aims and validity.
This article has been cited by other articles:
|
|
|
|
 
H. C. Kraemer, I. D. Glick, and D. F. Klein
Clinical Trials Design Lessons From the CATIE Study
Am J Psychiatry,
November 1, 2009;
166(11):
1222 - 1228.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. S. Bauer, K. Biswas, and A. M. Kilbourne
Enhancing Multiyear Guideline Concordance for Bipolar Disorder Through Collaborative Care
Am J Psychiatry,
November 1, 2009;
166(11):
1244 - 1250.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
O. Simonen, E. Vtanen, A. Konu, and M. Blom
Effectiveness in political--administrative decision-making in specialized healthcare
Scand J Public Health,
July 1, 2009;
37(5):
494 - 502.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. A. Southam-Gerow, S. E. Hourigan, and R. B. Allin Jr
Adapting Evidence-Based Mental Health Treatments in Community Settings: Preliminary Results From a Partnership Approach
Behav Modif,
January 1, 2009;
33(1):
82 - 103.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. Namba, T. Morita, C. Imura, E. Kiyohara, S. Ishikawa, and K. Hirai
Terminal delirium: families' experience
Palliative Medicine,
October 1, 2007;
21(7):
587 - 594.
[Abstract]
[PDF]
|
|
|
|
|
|
|
F. Firenzuoli and L. Gori
Herbal Medicine Today: Clinical and Research Issues
Evid. Based Complement. Altern. Med.,
September 1, 2007;
4(suppl_1):
37 - 40.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
L. J. Cabassa and M. C. Hansen
A Systematic Review of Depression Treatments in Primary Care for Latino Adults
Research on Social Work Practice,
July 1, 2007;
17(4):
494 - 503.
[Abstract]
[PDF]
|
|
|
|
|
|
|
B. N. Gaynes, A. J. Rush, M. H. Trivedi, S. R. Wisniewski, G. K. Balasubramani, D. C. Spencer, T. Petersen, M. Klinkman, D. Warden, L. Nicholas, et al.
Major Depression Symptoms in Primary Care and Psychiatric Care Settings: A Cross-Sectional Analysis
Ann. Fam. Med,
March 1, 2007;
5(2):
126 - 134.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
A. P. Weiss
Measuring the Impact of Medical Research: Moving From Outputs to Outcomes
Am J Psychiatry,
February 1, 2007;
164(2):
206 - 214.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. S. Brekke, K. Ell, and L. A. Palinkas
Translational Science at the National Institute of Mental Health: Can Social Work Take Its Rightful Place?
Research on Social Work Practice,
January 1, 2007;
17(1):
123 - 133.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. Polsky, J. A. Doshi, M. S. Bauer, and H. A. Glick
Clinical Trial-Based Cost-Effectiveness Analyses of Antipsychotic Use
Am J Psychiatry,
December 1, 2006;
163(12):
2047 - 2056.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
G. J. McHugo, R. E. Drake, M. F. Brunette, H. Xie, S. M. Essock, and A. I. Green
Enhancing Validity in Co-occurring Disorders Treatment Research
Schizophr Bull,
October 1, 2006;
32(4):
655 - 665.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
V. Roder, D. R. Mueller, K. T. Mueser, and H. D. Brenner
Integrated Psychological Therapy (IPT) for Schizophrenia: Is It Effective?
Schizophr Bull,
October 1, 2006;
32(suppl_1):
S81 - S93.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
P. Roy-Byrne, C. Sherbourne, J. Miranda, M. Stein, M. Craske, D. Golinelli, and G. Sullivan
Poverty and Response to Treatment Among Panic Disorder Patients in Primary Care
Am J Psychiatry,
August 1, 2006;
163(8):
1419 - 1425.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. S. Bauer, L. McBride, W. O. Williford, H. Glick, B. Kinosian, L. Altshuler, T. Beresford, A. M. Kilbourne, M. Sajatovic, and and Coauthors for the Cooperative Studies Program
Collaborative Care for Bipolar Disorder: Part I. Intervention and Implementation in a Randomized Effectiveness Trial
Psychiatr Serv,
July 1, 2006;
57(7):
927 - 936.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. S. Bauer, L. McBride, W. O. Williford, H. Glick, B. Kinosian, L. Altshuler, T. Beresford, A. M. Kilbourne, M. Sajatovic, and and Coauthors for the Cooperative Studies Program
Collaborative Care for Bipolar Disorder: Part II. Impact on Clinical Outcome, Function, and Costs
Psychiatr Serv,
July 1, 2006;
57(7):
937 - 945.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. C. Gotay
Increasing Trial Generalizability
J. Clin. Oncol.,
February 20, 2006;
24(6):
846 - 847.
[Full Text]
[PDF]
|
|
|
|
|
|
|
E. C Paluck, J. P McCormack, M. H. Ensom, M. Levine, J. A Soon, and D. W Fielding
Outcomes of Bupropion Therapy for Smoking Cessation During Routine Clinical Use
Ann. Pharmacother.,
February 1, 2006;
40(2):
185 - 190.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. Addington, E. McKenzie, J. Addington, S. Patten, H. Smith, and C. Adair
Performance Measures for Early Psychosis Treatment Services
Psychiatr Serv,
December 1, 2005;
56(12):
1570 - 1582.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. T. Braslow, N. Duan, S. L. Starks, A. Polo, E. Bromley, and K. B. Wells
Generalizability of Studies on Mental Health Treatment and Outcomes, 1981 to 1996
Psychiatr Serv,
October 1, 2005;
56(10):
1261 - 1268.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. Zimmerman, I. Chelminski, and M. A. Posternak
Generalizability of Antidepressant Efficacy Trials: Differences Between Depressed Psychiatric Outpatients Who Would or Would Not Qualify for an Efficacy Trial
Am J Psychiatry,
July 1, 2005;
162(7):
1370 - 1372.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
I. T. Lagomasino, M. Dwight-Johnson, and G. M. Simpson
Psychopharmacology: The Need for Effectiveness Trials to Inform Evidence-Based Psychiatric Practice
Psychiatr Serv,
June 1, 2005;
56(6):
649 - 651.
[Full Text]
[PDF]
|
|
|
|
|
|
|
R. Murphy
Maximizing current treatment options: exploring psychological barriers to change
Eur. Heart J. Suppl.,
June 1, 2005;
7(suppl_E):
E10 - E14.
[Full Text]
[PDF]
|
|
|
|
|
|
|
G. Sullivan, N. Duan, S. Mukherjee, J. Kirchner, D. Perry, and K. Henderson
The Role of Services Researchers in Facilitating Intervention Research
Psychiatr Serv,
May 1, 2005;
56(5):
537 - 542.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
R. A. Rosenheck
Open Forum: Effectiveness Versus Efficacy of Second-Generation Antipsychotics: Haloperidol Without Anticholinergics as a Comparator
Psychiatr Serv,
January 1, 2005;
56(1):
85 - 92.
[Full Text]
[PDF]
|
|
|
|
|
|
|
P. P. Roy-Byrne, C. D. Sherbourne, M. G. Craske, M. B. Stein, W. Katon, G. Sullivan, A. Means-Christensen, and A. Bystritsky
Moving Treatment Research From Clinical Trials to the Real World
Focus,
July 1, 2004;
2(3):
410 - 415.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. Zatzick, P. Roy-Byrne, J. Russo, F. Rivara, R. Droesch, A. Wagner, C. Dunn, G. Jurkovich, E. Uehara, and W. Katon
A Randomized Effectiveness Trial of Stepped Collaborative Care for Acutely Injured Trauma Survivors
Arch Gen Psychiatry,
May 1, 2004;
61(5):
498 - 506.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. S. Bauer and L. Mitchner
What Is a "Mood Stabilizer"? An Evidence-Based Response
Am J Psychiatry,
January 1, 2004;
161(1):
3 - 18.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. Horvitz-Lennon, S.-L. T. Normand, R. G. Frank, and H. H. Goldman
"Usual Care" for Major Depression in the 1990s: Characteristics and Expert-Estimated Outcomes
Am J Psychiatry,
April 1, 2003;
160(4):
720 - 726.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
B. Dickey, S.-L. T. Normand, R. C. Hermann, S. V. Eisen, D. E. Cortes, P. D. Cleary, and N. Ware
Guideline Recommendations for Treatment of Schizophrenia: The Impact of Managed Care
Arch Gen Psychiatry,
April 1, 2003;
60(4):
340 - 348.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
P. P. Roy-Byrne, C. D. Sherbourne, M. G. Craske, M. B. Stein, W. Katon, G. Sullivan, A. Means-Christensen, and A. Bystritsky
Moving Treatment Research From Clinical Trials to the Real World
Psychiatr Serv,
March 1, 2003;
54(3):
327 - 332.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
K. M. Carroll and B. J. Rounsaville
Bridging the Gap: A Hybrid Model to Link Efficacy and Effectiveness Research in Substance Abuse Treatment
Psychiatr Serv,
March 1, 2003;
54(3):
333 - 339.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
W. Goldman, J. McCulloch, and B. Cuffel
A Four-Year Study of Enhancing Outpatient Psychotherapy in Managed Care
Psychiatr Serv,
January 1, 2003;
54(1):
41 - 49.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
S. M. GILBODY, A. O. HOUSE, and T. A. SHELDON
Outcomes research in mental health: Systematic review
The British Journal of Psychiatry,
July 1, 2002;
181(1):
8 - 16.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. F. Zatzick, S.-M. Kang, H.-G. Muller, J. E. Russo, F. P. Rivara, W. Katon, G. J. Jurkovich, and P. Roy-Byrne
Predicting Posttraumatic Distress in Hospitalized Trauma Survivors With Acute Injuries
Am J Psychiatry,
June 1, 2002;
159(6):
941 - 946.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. A. Posternak, M. Zimmerman, and D. A. Solomon
Integrating Outcomes Research Into Clinical Practice
Psychiatr Serv,
March 1, 2002;
53(3):
335 - 336.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. Chambers, D. M. Dimaculangan, K. Grindrod, J. Hanson, F. Pataky, and T. T. Vu
Clinical effectiveness of trastuzumab: early experience
Journal of Oncology Pharmacy Practice,
March 1, 2002;
8(1):
19 - 25.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. G. Ray
Evidence in Upheaval: Incorporating Observational Data Into Clinical Practice
Arch Intern Med,
February 11, 2002;
162(3):
249 - 254.
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. D. R. WILLIAMS and J. GARNER
The case against the evidence': a different perspective on evidence-based medicine
The British Journal of Psychiatry,
January 1, 2002;
180(1):
8 - 12.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
S. GILBODY and P. WHITTY
Improving the delivery and organisation of mental health services: beyond the conventional randomised controlled trial
The British Journal of Psychiatry,
January 1, 2002;
180(1):
13 - 18.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
S. P. Ringel, J. F. Steiner, B. G. Vickrey, and S. S. Spencer
Training clinical researchers in neurology: We must do better
Neurology,
August 14, 2001;
57(3):
388 - 392.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
F. Creed, J. Ratcliffe, L. Fernandez, B. Tomenson, S. Palmer, C. Rigby, E. Guthrie, N. Read, and D. Thompson
Health-Related Quality of Life and Health Care Costs in Severe, Refractory Irritable Bowel Syndrome
Ann Intern Med,
May 1, 2001;
134(9_Part_2):
860 - 868.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
R. D. Alarc"n
Hispanic Psychiatry: From Margin to Mainstream
Transcultural Psychiatry,
March 1, 2001;
38(1):
5 - 25.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. D. Marshall, R. L. Spitzer, S. C. Vaughan, R. Vaughan, L. A. Mellman, R. A. MacKinnon, and S. P. Roose
Assessing the Subjective Experience of Being a Participant in Psychiatric Research
Am J Psychiatry,
February 1, 2001;
158(2):
319 - 321.
[Abstract]
[Full Text]
|
|
|
|
|
|
|
J. J. Gallo and J. C. Coyne
The Challenge of Depression in Late Life: Bridging Science and Service in Primary Care
JAMA,
September 27, 2000;
284(12):
1570 - 1572.
[Full Text]
[PDF]
|
|
|
|
|
|
|
K. Humphreys and C. Weisner
Use of Exclusion Criteria in Selecting Research Subjects and Its Effect on the Generalizability of Alcohol Treatment Outcome Studies
Am J Psychiatry,
April 1, 2000;
157(4):
588 - 594.
[Abstract]
[Full Text]
|
|
|
|
|
|
|
K. B. Wells, C. Sherbourne, M. Schoenbaum, N. Duan, L. Meredith, J. Unutzer, J. Miranda, M. F. Carney, and L. V. Rubenstein
Impact of Disseminating Quality Improvement Programs for Depression in Managed Primary Care: A Randomized Controlled Trial
JAMA,
January 12, 2000;
283(2):
212 - 220.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
S. W. Woods, D. M. Ziedonis, M. J. Sernyak, E. Diaz, and R. A. Rosenheck
Characteristics of Participants and Nonparticipants in Medication Trials for Treatment of Schizophrenia
Psychiatr Serv,
January 1, 2000;
51(1):
79 - 84.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
H. J. BURSZTAJN
Clinical Trials and Effectiveness Research
Am J Psychiatry,
January 1, 2000;
157(1):
152- - 152.
[Full Text]
|
|
|
|
|
|
|
B. G. Vickrey
Getting oriented to patient-oriented outcomes
Neurology,
September 1, 1999;
53(4):
662 - 662.
[Full Text]
[PDF]
|
|
|
|
|
|
|
G. Andrews
Randomised controlled trials in psychiatry: important but poorly accepted
BMJ,
August 28, 1999;
319(7209):
562 - 564.
[Full Text]
|
|
|
Get information about faster international access.
Privacy Policy
Copyright © 1999
American Psychiatric Association.
All rights reserved.
Home
| Search
| Current Issue
| Past Issues
| Subscribe
| All APPI Journals
| Help
| Contact Us
|
