Please confirm that your email address is correct, so you can successfully receive this alert.
Dr. Fava has received research support or advisory, consulting, speaking, or publishing fees from Abbott Laboratories, Advanced Meeting Partners, Alkermes, Amarin, APA, Aspect Medical Systems, AstraZeneca, Auspex Pharmaceuticals, Bayer AG, Belvoir Publishing, Best Practice Project Management, Inc., BioMarin Pharmaceuticals, Inc., Bio Research, BrainCells, Biovail Pharmaceuticals, Boehringer-Ingelheim, BrainCells, Bristol-Myers Squibb Company, Cephalon, Clinical Trial Solutions, CNS Response, Compellis, Cypress Pharmaceuticals, Dov Pharmaceuticals, Eli Lilly, EPIX Pharmaceuticals, Euthymics Bioscience, Fabre-Kramer Pharmaceuticals, Forest Pharmaceuticals, Ganeden, GlaxoSmithKline, Grunenthal GmbH, Imedex, J&J Pharmaceuticals, Janssen Pharmaceutica, Jazz Pharmaceuticals, Knoll Pharmaceutical Company, Labopharm, Lichtwer Pharma GmbH, Lorex Pharmaceuticals, Lundbeck, MedAvante, Merck, Methylation Sciences, MGH Psychiatry Academy/Primedia, MGH Psychiatry Academy/Reed-Elsevier, NARSAD, National Center for Complementary and Alternative Medicine, National Institute on Drug Abuse, Neuronetics, NIMH, Novartis, Nutrition 21, Organon, PamLab, Pfizer, PharmaStar, Pharmavite, Precision Human Biolaboratory, PsychoGenics, Roche, Sanofi-Aventis, Sepracor, Schering-Plough, Shire, Solvay Pharmaceuticals, Somaxon, Somerset Pharmaceuticals, Synthelabo, Takeda, Tetragenex, TransForm Pharmaceuticals, Transcept Pharmaceuticals, UBC, Vanda Pharmaceuticals, and Wyeth-Ayerst; he has equity holdings in Compellis, has patent applications for "sequential parallel comparison of design" (SPCD) and for a combination of azapirones and bupropion in major depression, and receives royalties for the Massachusetts General Hospital Cognitive and Physical Functioning Questionnaire, the Discontinuation-Emergent Signs and Symptoms scale, and SAFER. Dr. Ostacher has received research support or advisory, consulting, or speaking fees from AstraZeneca, Bristol-Myers Squibb, Concordant Rater Systems, Eli Lilly, Forest Pharmaceuticals, GlaxoSmithKline, Janssen Pharmaceutica, Pfizer, and Massachusetts General Hospital Psychiatry Academy (lectures supported through Independent Medical Education grants from AstraZeneca, Eli Lilly, and Janssen Pharmaceuticals). Dr. Perlis has received research support or advisory, consulting, or speaking fees from AstraZeneca, Bristol-Myers Squibb, Elan/Eisai, Eli Lilly, GlaxoSmithKline, Pfizer, and Proteus Biomedical, and has equity holdings and patents for Concordant Rater Systems, LLC. Dr. Sachs has received research support or advisory, consulting, or speaking fees from Abbott, AstraZeneca, Bristol-Myers Squibb, Cephalon, CNS Response, Elan Pharmaceuticals, Eli Lilly, GlaxoSmithKline, Janssen, Memory Pharmaceuticals, Merck, NIMH, Novartis, Organon, Pfizer, Repligen, Sanofi-Aventis, Shire, Sigma-Tau, Solvay, and Wyeth; his spouse is a shareholder with Concordant Rater Systems. Dr. Nierenberg has received research support or advisory or consulting fees or honoraria from American Drug Utilization Review, American Society for Clinical Psychopharmacology, APA (travel expenses), Appliance Computing Inc. (Mindsite), Baystate Medical Center, Belvoir Publishing, Brain Cells, Inc., Brandeis University, Columbia University, Eli Lilly, Hillside Hospital, IMEDEX, MBL Publishing, MJ Consulting, New York State, NIMH, Novartis, PamLabs, Pfizer Pharmaceuticals, Physicians Postgraduate Press, PGx Health, Schering-Plough, Shire, SUNY Buffalo, Targacept, Takeda Pharmaceuticals, University of Texas Southwestern Dallas, University of Wisconsin, and University of Pisa; he is a presenter for the Massachusetts General Hospital Psychiatry Academy, which has been supported through Independent Medical Education grants from Astra Zeneca, Bristol-Myers Squibb, Eli Lilly, and Janssen Pharmaceuticals; he owns stock options in Appliance Computing, Inc., and Brain Cells, Inc.; through Massachusetts General Hospital (MGH), he is named for copyrights to the Clinical Positive Affect Scale and the MGH Structured Clinical Interview for the Montgomery-Åsberg Depression Rating Scale exclusively licensed to the MGH Clinical Trials Network and Institute; also through MGH, he has a patent extension application for the combination of buspirone, bupropion, and melatonin for the treatment of depression. Dr. Rosenbaum has consulted for or is a member of scientific advisory boards for Auspex, Medavante, NeuroÂnetics, and Supernus, and he holds equity in Compellis and Medavante. Dr. Freedman has reviewed this editorial and found no evidence of influence from these relationships.
Address correspondence and reprint requests to Dr. Perlis, Bipolar Clinic and Research Program, Massachusetts General Hospital, 50 Staniford St., 5th Floor, Boston, MA 02114; firstname.lastname@example.org (e-mail). Editorial accepted for publication November 2009.
Copyright © American Psychiatric Association
The gold standard for evidence in psychiatry, as elsewhere in medicine, is often considered to be the randomized, placebo-controlled, double-blind study. The use of blinding or masking plays a key role in these designs by addressing the problem of expectancy. First, if participants anticipate greater benefit from a particular treatment, they may be more likely to respond to it, which is considered a component of placebo response. Not surprisingly, participants have been found to report greater anticipated benefits when they were randomized to enter an active-comparator, versus a placebo-comparator, study (1). Likewise, raters may anticipate greater benefit from active drug and thus favor it in their ratings, whether consciously or unconsciously. Greater response rates in both active and placebo arms occur when a greater proportion of participants receive active treatment—that is, when patients (1) or raters (2) expect more participants to benefit.
Double-blinding, typically by providing drug and placebo in identical capsules, is intended to minimize the impact of expectancy and the related concept of credibility. The blind may be compromised in a variety of ways, however, beginning with differences in medication taste or smell. Of particular concern may be the emergence of adverse effects, particularly when those adverse effects are known to be associated with a specific medication. The requirement that informed consent forms delineate common adverse effects may increase this risk (3). Indeed, when the degree of unblinding is assessed in antidepressant trials, multiple reports suggest that it is extensive: at least three-quarters of patients are typically able to correctly guess at their treatment assignment (4, 5). Moreover, even the sudden absence of adverse effects may contribute to unblinding, as might occur when a participant stabilized on a sedating medication is abruptly switched to placebo at randomization in a relapse-prevention study.
If such unblinding occurs, does it meaningfully affect trial results? A meta-analysis of antidepressant trials using active placebos, such as those with antihistaminergic or anticholinergic effects, suggested smaller effect sizes than those observed in the presumably less blinded trials with inert placebo (6). Estimating the potential impact in published studies is difficult, but certain findings when results are stratified by potentially unblinding adverse effects raise concern. In a trial of quetiapine in bipolar depression (7), for example, when investigators examined only the groups reporting sedation, mean change in the Montgomery-Åsberg Depression Rating Scale total score at week 8 was —18.8 in the quetiapine groups (N=195) and —18.9 in the placebo group (N=24). Conversely, when the subset of participants without sedation were examined, the mean change in the Montgomery-Åsberg Depression Rating Scale total score was —19.3 and —11.7 in the quetiapine and placebo groups, respectively. While only a small subset of patients were in the placebo/sedation arm, the disparity in placebo response might suggest that clinical raters were attempting to "guess" at treatment assignment.
Unfortunately, for psychotropic drugs, CNS side effects may be inevitable. Therefore, we call for more uniform application of standards in the design, reporting, and review of clinical trials.
1. Consistent with CONSORT (8) and international guidelines (9), participants and raters should be asked to guess treatment assignment, and the degree of true and false unblinding should be reported in the primary publication of results. Statistical techniques to formally test for unblinding have been described and are readily available (10). However, while this approach may help to identify flawed trials, it does nothing to prevent them, and guesses at the end of a trial may be confounded by "true" efficacy.
2. To minimize the impact of adverse effects on efficacy ratings, one rater should evaluate symptoms but not side effects, while another rater scores side effects and not symptoms.
3. Where the risk of unblinding through adverse effects is substantial, the use of an "active" placebo should be considered, with adverse effects mimicking those of the active drug. This design is rarely used in modern psychotropic studies: A MEDLINE search for "active placebo" identified only one randomized controlled antidepressant trial since 2000 with this design. However, the ethical problem of deliberately inducing risk for adverse effects, even if they are benign or even potentially therapeutic, requires further study.
All of these recommendations are reflected in existing guidance documents for clinical trial design and analysis, and some date back more than 25 years. If readers, reviewers, and journal editors ensure that they are applied where appropriate, confidence in the gold standard for determining clinical efficacy could be enhanced.
Download citation file:
Web of Science® Times Cited: 14