The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Communications and UpdatesFull Access

Deficiency of the Odds Ratio for Common Outcomes

To the Editor: The article by Chen et al. (1) in the July issue provides a fascinating account of the interaction by genotype in the context of a smoking cessation trial. Participating smokers were randomly assigned either to placebo (N=132) or to various combinations of active treatments (N=941). The authors then reported the proportion with confirmed 7-day abstinence after 8 weeks, stratified by three common haplotypes (defined by two single-nucleotide polymorphisms on chromosome 15 that have established associations with nicotine and cocaine dependence). Despite clear evidence of statistical interaction between haplotype group and successful smoking cessation, the authors’ stated conclusion that “[s]mokers with the high-risk haplotype were three times as likely to respond to pharmacologic cessation treatments as were smokers with the low-risk haplotype” is not correct. As shown in Figure S4 of the online data supplement that accompanies the Chen et al. article, treatment approximately doubled (not tripled) the 8-week abstinence proportion in the high-risk haplotype group, from about 24% to about 50%. In contrast, there was no treatment effect in the low-risk haplotype group.

The explanation for this large discrepancy is that the authors made the common error of interpreting odds ratios from logistic regression models as relative risks. This interpretation is not valid for outcomes that are not rare. It has been repeatedly noted in the biomedical literature that this is a serious deficiency of the odds ratio (2, 3), and many authors have therefore urged that for cohort analyses such as those used in the Chen et al. study, the odds ratio is not a parameter of interest and should be avoided (4). It is simple in these settings to estimate risk ratios or differences (5), and this also facilitates useful calculations such as the number needed to treat (i.e., the inverse risk difference) (6). For example, manipulation of these absolute risks shows that the number needed to treat in order to prevent one relapse among the high-risk haplotype subpopulation is approximately four. This is an impressive finding that is completely obscured in the published analysis.

Montreal, Quebec

The authors report no financial relationships with commercial interests.

References

1 Chen LS, Baker TB, Piper ME, Breslau N, Cannon DS, Doheny KF, Gogarten SM, Johnson EO, Saccone NL, Wang JC, Weiss RB, Goate AM, Bierut LJ: Interplay of genetic risk factors (CHRNA5-CHRNA3-CHRNB4) and cessation treatments in smoking cessation success. Am J Psychiatry 2012; 169:735–742LinkGoogle Scholar

2 Altman DG, Deeks JJ, Sackett DL: Odds ratios should be avoided when events are common. BMJ 1998; 317:1318Crossref, MedlineGoogle Scholar

3 Schwartz LM, Woloshin S, Welch HG: Misunderstandings about the effects of race and sex on physicians’ referrals for cardiac catheterization. N Engl J Med 1999; 341:279–283; Discussion 286–287Crossref, MedlineGoogle Scholar

4 Knol MJ, Duijnhoven RG, Grobbee DE, Moons KG, Groenwold RH: Potential misinterpretation of treatment effects due to use of odds ratios and logistic regression in randomized controlled trials. PLoS ONE 2011; 6:e21248Crossref, MedlineGoogle Scholar

5 Austin PC: Absolute risk reductions, relative risks, relative risk reductions, and numbers needed to treat can be obtained from a logistic regression model. J Clin Epidemiol 2010; 63:2–6Crossref, MedlineGoogle Scholar

6 Bender R, Kuss O, Hildebrandt M, Gehrmann U: Estimating adjusted NNT measures in logistic regression analysis. Stat Med 2007; 26:5586–5595Crossref, MedlineGoogle Scholar