The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

Few individuals with mood disorders have access to evidence-based collaborative chronic care models (CCMs) because most patients are seen in small-group practices (<20 providers) with limited capacity to deliver CCMs. In this single-blind randomized controlled trial, we determined whether a CCM delivered nationally in a U.S. health plan improved 12-month outcomes among enrollees with mood disorders compared with usual care.

Methods:

Aetna insurance enrollees (N=238), mostly females (66.1%) with a mean age of 41.1 years, who were recently hospitalized for unipolar major depression or bipolar disorder provided informed consent, completed baseline assessments, and were randomly assigned to usual care or CCM. The CCM included 10 sessions of the Life Goals self-management program and brief contacts by phone by a care manager to determine symptom status. Primary outcomes were changes over 12 months in depression symptoms (nine-item Patient Health Questionnaire [PHQ-9]) and mental health–related quality of life (Short Form–12).

Results:

Adjusted mean PHQ-9 scores were lower by 2.34 points (95% confidence level [CL]=−4.18 to –0.50, p=0.01), indicating improved symptoms, and adjusted mean SF-12 mental health scores were higher by 3.21 points (CL=–.97 to 7.38, p=0.10), indicating better quality of life, among participants receiving CCM versus usual care.

Conclusions:

Individuals receiving CCM compared with usual care had improved clinical outcomes, although substantial attrition may limit the impact of health plan–level delivery of CCMs. Further research on the use of health plan–level interventions, such as CCMs, as alternatives to practice-based models is warranted.

HIGHLIGHTS

  • Mood disorders affect one in five individuals yet less than half receive adequate treatment because of the limited capacity of many practices in providing effective collaborative care models (CCMs).

  • This RCT determined whether a health plan–level CCM improved mental health outcomes for individuals with mood disorders.

  • Individuals hospitalized for unipolar major depression or bipolar disorder and enrolled in a large national health plan were randomly assigned to receive either the collaborative care model (self-management sessions and care management) by telephone or usual care.

  • Compared with usual care, those receiving the CCM had lower overall depression symptoms and potentially improved mental health quality of life in 12 months.

One in five individuals in the United States has a mood disorder (unipolar major depression or bipolar disorder) (1, 2), resulting in increased risk of long-term general medical conditions (3) and premature mortality (4), including suicide (5). Up to 70% of treatment costs for mood disorders are incurred outside the mental health sector, notably in primary care (6). In privately insured populations, mood disorders represent the most expensive conditions, with bipolar disorder incurring the most health care costs (7). Effective treatments for mood disorders include psychosocial interventions in addition to medications, yet only 40% of individuals with mood disorders receive adequate treatment (2).

Collaborative chronic care models (CCMs), which provide ongoing psychosocial support in conjunction with treatment coordination, have demonstrated improved outcomes for persons with mood disorders at little or no net health care cost (810). Recent meta-analyses found that implementation of at least three core components of the CCM (e.g., self-management, care management, and clinical information systems or case finding) resulted in improved mental and physical outcomes for persons with mental disorders, with little to no net health care costs (8, 11). Often implemented by care managers, CCMs also support health care delivery systems that are subject to bundled payments under health care reform (1214) and medical home mandates (15, 16). However, CCMs for mood disorders have primarily been implemented in large, integrated health care systems that have the capacity to hire on-site care managers and can scale up the necessary tools, including clinical information systems (1618). In contrast, over 90% of U.S. commercial health plan enrollees receive care from small practices (<20 primary care physicians) (16, 19), which do not have the capacity to hire care managers at each site to provide CCM core components.

Rather than implement CCMs at the individual-practice level, another option is to implement the programs remotely at the health plan level, which may allow for the further implementation and sustainability of CCMs in solo or small group practices. A key advantage of health plan–level implementation is an economy of scale, made possible through the deployment of virtual care managers and use of common information technologies (20). However, prior studies of implementation of CCMs at the population level have been limited to unipolar depression treatment (21, 22) in large practices (23, 24).

This article reports outcomes following intervention from a randomized trial at the health plan level of a CCM delivered across mood disorders (depression and bipolar disorder). Our primary hypothesis was that patients in the United States who had recently been hospitalized for a mood disorder would have reduced 12-month depressive symptoms and improved mental health–related quality of life after receiving plan-level CCM versus usual care.

Methods

This single-blind, randomized controlled effectiveness trial included patients from Aetna health plan who were randomly assigned to receive either the CCM for mood disorders delivered at the health plan level or usual care. Aetna health plan is one of the largest health care insurers in the country, serving approximately 12 million covered lives, with 244,971 providers (19). Over 90% of Aetna health plan enrollees receive care from primary or mental health practices with fewer than 20 physicians (19).

Participants

As described in detail elsewhere, eligible patients included Aetna health plan enrollees (beneficiaries or family members of beneficiaries) who were identified from Aetna claims data from across the lower 48 United States, who were ages 21 or older, and who had been hospitalized in the past 6 months for unipolar major depression or bipolar disorder (bipolar manic or depressed state) (25). We chose recent hospitalization as an inclusion criterion because inpatient care indicates greater clinical severity that could benefit from a CCM (26). The study received institutional review board (IRB) approval from local IRBs, and all patient participants provided verbal informed consent. Prior to randomization, participants were approached, gave consent, and were enrolled by phone by the Aetna care manager, who used claims data from recent inpatient hospitalization history to identify potential participants. Recruitment began in July 2014 and ended in July 2015; follow-up assessments continued through July 2017.

The care manager contacted participants by phone to confirm eligibility and enroll participants. The care manager was trained by study staff in CCM procedures, assessments, and human subjects protection by using established CCM-based protocols (27). Participants were ineligible if they were no longer enrolled in Aetna health plan, were deceased, or were unable to provide informed consent because of an unstable condition, inpatient status, or inability to communicate in English.

Randomization

The study analyst randomly assigned participants to CCM or usual care by using a computer-generated algorithm stratified by diagnosis at hospitalization discharge (unipolar disorder or bipolar disorder). The allocation sequence was concealed from recruiters until interventions were assigned. Those randomized to the usual care arm received standard care from their practice provider and none of the CCM components from the care manager.

Intervention

Patients randomized to the CCM received contacts and psychosocial intervention from the Aetna care manager in addition to usual care from their provider. The care manager, with a master’s degree in clinical social work, delivered the CCM intervention over a 6-month period, including the following core components: clinical information systems (Aetna clinical database to track and initially contact potentially eligible patients), self-management support (10 weekly sessions by phone), and ongoing care management (8, 10, 11). The self-management sessions were adapted from the evidence-based Life Goals program (2731), a psychosocial intervention that focuses on symptom coping strategies to reduce stigma and promote wellness goals and that has been shown to improve outcomes for those with unipolar depression or bipolar disorder (28, 30, 3234). Ongoing care management included up to six monthly brief contacts to determine status and symptoms. Fidelity to the CCM was supported through a 2-day training session for the care manager as well as regular calls with the care manager to review session content and how patient contacts were progressing (27).

Participants from both treatment arms who experienced imminent risk (e.g., suicidal or assaultive ideation) were cared for according to protocols used in prior CCM studies (25, 27). The care manager and research assistant were trained to handle emergencies involving participants with suicidal ideation and were instructed to contact their providers on an as-needed basis.

Data Collection and Outcomes

Thirty-minute assessments of primary outcome measures and covariates were conducted at baseline and 6- and 12-month follow-ups. Baseline assessments were ascertained by the care manager at the time of enrollment and included demographic information, health status, and baseline measures for primary outcomes. Follow-up assessments consisted of follow-up measures of primary outcomes and were conducted by a study research assistant who was not employed by Aetna and who was blinded to the patients’ randomization allocation. Clinical outcomes were measured at 12 months to assess durability of the 6-month CCM program.

Changes in depressive symptoms, the primary outcomes, were measured by the nine-item Patient Health Questionnaire (PHQ-9), a widely used assessment of depressive symptoms (35), and the mental health component score on the 12-item Short-Form (SF-12) Health-Related Quality of Life Survey (36). The PHQ-9 was chosen because depression symptoms are also a significant complaint among individuals with bipolar disorder.

Covariate information ascertained from assessments included demographic characteristics (age, sex, race-ethnicity, education, employment status, and living alone) and health behaviors, including hazardous drinking (having six or more drinks on a single occasion within the past month, as defined by the Alcohol Use Disorders Identification Test) (37), illicit drug use, and smoking. Other covariates ascertained from Aetna claims data included enrollment status (beneficiary versus family member) and primary mental health diagnosis (bipolar disorder or major depression).

Analyses

Primary clinical outcomes (change in PHQ-9 and SF-12 mental component summary [MCS] scores) were modeled by using mixed-effects models with random intercepts and baseline values of the outcome (at randomization), treatment arm indicator, time (6 and 12 months), and the interaction of treatment arm × time as predictors. The interaction term was included to explore whether the outcomes changed between 6 and 12 months.

Missing data were handled by using a standardized process. First, possible missing patterns of the data were identified based on determining whether there was any relationship with missing data and outcomes or treatment arm. Multivariable logistic regression models were then run on dichotomous variables created to represent each missing pattern as a function of baseline patient characteristics, each outcome, and treatment arm. The final models of primary clinical outcomes (PHQ-9 and MCS) used multiple imputation methods to account for missing data. Variables employed in the imputation were empirically driven on the basis of the association between the variables to be imputed and auxiliary variables and included all model covariates, treatment indicators, and missing data pattern indicators. Twenty data sets were imputed, and results were pooled according to Rubin’s (38) rule of combining data sets.

Results

A total of 9,121 potentially eligible patients from the Aetna database were identified by clinical information systems as having a diagnosis of unipolar depression or bipolar disorder from an inpatient discharge in the past six months. Of those, 7,335 were deemed to be ineligible (<21 years old, not living within the 48 contiguous United States, or no longer covered by Aetna), leaving 1,786 potentially eligible patients. Of the 1,786 approached, 403 declined to participate, 999 could not be reached, and 104 were determined to be ineligible. Of the 238 enrolled, 115 were randomly assigned at baseline to receive the CCM and 123 to receive usual care. [A CONSORT diagram of the study is available in an online supplement.] Based on the actual sample size of 73 (165 patients dropped out of the study, a dropout rate of 69%), the resultant power to detect mean differences between treatment arms was 27% for the PHQ-9 (Cohen’s d=.25) and 19% for the SF-12 MCS (Cohen’s d=.20) scores.

At baseline, respondents were a mean±SD age of 41.3±31.1; were mostly female (66%), white (81%), and employed (58%); and had a mean score of 12.7±6.6 on the PHQ-9 and 35.6±15.2 on the SF-12 MCS (Table 1). Among those assigned to the CCM, the mean number of self-management sessions completed was 8.4±2.7, and the mean number of care management contacts was 4.7±2.6.

TABLE 1. Baseline characteristics among enrollees in a collaborative chronic care model (CCM) for mood disorders or in usual carea

Overall (N=238)CCM (N=115)Usual care (N=123)
CharacteristicN%N%N%
Primary enrollee (versus family member)1405972636855
Practice size <20 providers19787978910086
Female1566677677964
White1938199869476
Any college 1687175659376
Employed1395870616956
Lives alone532230261219
Alcohol use (hazardous drinking)b662834303226
Other substance use401717152319
Current smoker692938333125
Primary diagnosis:
 Major depression1566676668065
 Bipolar disorder823539344335
Age (M+SD)41.3+13.142.8±12.939.9±13.2
PHQ-9 score (M+SD)c12.7+6.613.0±7.112.4±6.1
SF-12 score (M+SD)d
 MCS35.6±15.236.9±15.334.4±15.2
 PCS48.6±13.247.2±13.549.8±12.7

aNone of the comparisons between CCM and usual care groups were statistically significant.

bHazardous drinking was based on the self-reported Alcohol Use Disorders Identification Test, which inquires about having six or more drinks on a single occasion within the past month. Responses were dichotomized as 0 (no) or 1 (yes).

cPHQ-9, nine-item Patient Health Questionnaire. Possible scores ranges from 0 to 27, with higher scores indicating worse depressive symptoms.

dSF-12, 12-item Short-Form Health-Related Quality of Life Survey. The mental component summary (MCS) and physical component summary (PCS) each use normed-based scoring derived from the general population, set to a mean±SD of 50±10 (range 0–100). Higher scores indicate greater quality of life.

TABLE 1. Baseline characteristics among enrollees in a collaborative chronic care model (CCM) for mood disorders or in usual carea

Enlarge table

Dropout also difference across treatment arms in the 0- to 6-month follow up period, where dropout more likely for CCM participants (30%) than for usual care participants (19%). Later dropout (6–12 months) was similar among the treatment arms: usual care participants (21%) and CCM participants (22%). Indicators representing time of dropout (6 or 12 months) were included in the imputation process. By 12 months, lost coverage was the reason for dropout among more than 80% of participants who dropped out, which did not differ by study group.

Figure 1 presents the unadjusted mean scores for the PHQ-9 and SF-12 MCS at each assessment, demonstrating that the changes mainly occurred between baseline and 6 months. The final models did not include the interaction term, given that it was neither meaningfully nor statistically significant.

FIGURE 1.

FIGURE 1. Mean unadjusted PHQ-9 (A) and SF-12 MCS (B) scores among 73 participants in a collaborative chronic care model (CCM) for mood disorders or usual care, by time of assessmenta

aPHQ-9, nine-item Patient Health Questionnaire; higher scores reflect worse depression symptoms. SF-12 MCS, mental component summary of the 12-item Short-Form Health-Related Quality of Life Survey; higher scores reflect better quality of life.

Based on the model fit with main effects of 12-month and treatment arm (CCM) indicators, adjusted mean±SE PHQ-9 scores among patients receiving the CCM were lower by –2.34±0.92 points (95% confidence level [CL]=–4.18 to –0.50, p=0.004), compared with those receiving usual care. Although not statistically significant, adjusted mean SF-12 MCS scores for patients who received the CCM were higher (indicating better quality of life) by 3.21±2.09 points (95% CL=–0.97 to 7.38), compared with scores of those receiving usual care.

Similar results were obtained from fitting the model to each outcome with an interaction term of time × treatment (see online supplement).

Discussion

We described 12-month results from the first study, to our knowledge, to implement the CCM within a nationwide commercial health plan for patients hospitalized for unipolar depression or bipolar disorder. We found that after randomization, patients receiving CCM had less reported depression symptoms and a trend toward more improvement in mental health quality of life compared with patients receiving usual care. Despite having private insurance, study participants reported substantial impairment in mental health quality of life (i.e., score on the SF-12 mental health lower by an average of 15 points compared with the general population) (36).

The observed effects of reduced mood disorder symptoms among patients randomly assigned to CCM compared with usual care are reflective of prior studies of CCM that focused on those with major depression or bipolar disorder (8). The study also adds to the growing body of literature on the effectiveness of collaborative care in improving mental health outcomes across age groups (22) and mental health conditions (22, 3942), reflecting the potential for a more cost-efficient approach to providing evidence-based care remotely to patients without access to on-site collaborative care.

CCMs to date have primarily been implemented solely for unipolar depression (21, 26, 4346) or within large integrated health systems, which, unlike solo or small group primary care practices, have sufficient infrastructure to mount such integrated efforts. Implementing CCMs in health plans across mood disorders represents an important effort to overcome such geographic and administrative barriers (31). Most commercially insured individuals receive care from network model health plans and within small practices, which have limited capacity to provide organized CCMs or other disease management interventions (11, 16, 19). CCMs that address the range of mood disorders, including bipolar disorder, might be able to address suicide—notably through the reduction of depressive symptoms (47).

There were several limitations to this study that warrant consideration. Only a fraction of potentially eligible patients was enrolled. Participants may have been less inclined to engage in a program offered by an insurer rather than a care provider. Moreover, those who were recently hospitalized, especially patients from more rural settings, could be an especially difficult population to reach or engage (21). Postrandomization dropout was also substantial; the primary reason for participant dropout was disenrollment from Aetna coverage, given that enrollment in Aetna was a study inclusion criterion. Although we did not have information on reasons for Aetna coverage change, loss of coverage can be triggered by changes in employer/employment status or premium increases (48). Evidence suggests that about half of Americans switch health plans within 3 years (49).

Moreover, the care manager had limited contact with the patients’ providers, limiting their ability to help manage pharmacotherapy for patients; however, in previous trials the Life Goals program was demonstrated to be effective as a stand-alone self-management program (30, 34). Although the research assistant made every effort to follow up with patients by using a brief survey, lack of available contact information once the individual disenrolled from the health plan and lack of subject compensation for survey participation may have contributed to follow-up attrition. We also used multiple imputations to account for the high rate of loss at 12 months; however, the method is limited by the number of available variables to impute and did not address the possibility that the remaining participants may be highly selected. In addition, whereas this study employed the core components of the CCM found to be effective from previous meta-analyses (self-management, care management, and clinical information systems), we were unable to fully implement provider clinical decision support in regard to mood disorders medication management across the multiple practices. Finally, although the study incorporated well-established clinical outcomes measures, clinical outcomes were self-reported (8, 11).

Conclusions

Overall findings from this study indicate that a health plan–level CCM was effective in reducing depressive symptoms and improving health-related quality of life for a cross-diagnosis group of individuals with mood disorders (depression and bipolar disorder). However, protocol dropout rates, primarily due to low initial acceptance of a health plan–level intervention and instability of health plan enrollment, mitigate the certainty of these conclusions as well as the willingness of commercial insurers to invest in such plan-level interventions. Nonetheless, delivery of CCMs at the health plan level may be the sole approach to extend these evidence-based interventions to patients with mood disorders who are managed in venues likely too small to implement CCMs on site.

Additional methods to enhance implementation at the health plan level warrant further investigation. Such methods include the use of virtual tools to allow care managers to engage with the patients’ principal care providers, especially within small practices; additional mobile health or Web-based programs (39, 50) to enable providers and patients to extend care coordination and self-management; and other implementation strategies, such as practice-based facilitation or performance incentives (51). Ultimately, a health plan–based virtual CCM intervention is a potentially cost-efficient approach to delivering this evidence-based practice at the population level.

Center for Clinical Management Research, U.S. Department of Veterans Affairs (VA) Ann Arbor Healthcare System, Ann Arbor, Michigan (Kilbourne, Kim); Department of Psychiatry, University of Michigan Medical School, North Campus, Ann Arbor (Kilbourne, Prenovost, Liebrecht); Department of Health Management and Policy, School of Public Health, University of Michigan, Ann Arbor (Eisenberg); Aetna Healthcare, Blue Bell, Pennsylvania (Un); Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, and Department of Psychiatry, Harvard Medical School, Boston (Bauer).
Send correspondence to Dr. Kilbourne (e-mail: ).

This research was supported by the U.S. Agency for Healthcare Research and Quality (AHRQ) (R18 HS 21425). The trial is registered at clinicaltrials.gov (NCT02041962).

AHRQ had no role in the data acquisition, analysis, or review or writing of the manuscript. The views expressed in this article are those of the authors and do not necessarily represent the views of the VA.

Dr. Kilbourne and Dr. Bauer receive royalties from New Harbinger Publishing for manuals related to the intervention, and Dr. Bauer receives royalties from Springer. The other authors report no financial relationships with commercial interests.

References

1 Judd LL, Akiskal HS: The prevalence and disability of bipolar spectrum disorders in the US population: re-analysis of the ECA database taking into account subthreshold cases. J Affect Disord 2003; 73:123–131Crossref, MedlineGoogle Scholar

2 Kessler RC, Wang PS: The descriptive epidemiology of commonly occurring mental disorders in the United States. Annu Rev Public Health 2008; 29:115–129Crossref, MedlineGoogle Scholar

3 Katon WJ, Lin EH, Von Korff M, et al.: Collaborative care for patients with depression and chronic illnesses. N Engl J Med 2010; 363:2611–2620Crossref, MedlineGoogle Scholar

4 Walker ER, McGee RE, Druss BG: Mortality in mental disorders and global disease burden implications: a systematic review and meta-analysis. JAMA Psychiatry 2015; 72:334–341Crossref, MedlineGoogle Scholar

5 Ilgen MA, Bohnert AS, Ignacio RV, et al.: Psychiatric diagnoses and risk of suicide in veterans. Arch Gen Psychiatry 2010; 67:1152–1158Crossref, MedlineGoogle Scholar

6 Dilsaver SC: An estimate of the minimum economic burden of bipolar I and II disorders in the United States: 2009. J Affect Disord 2011; 129:79–83Crossref, MedlineGoogle Scholar

7 Williams MD, Shah ND, Wagie AE, et al.: Direct costs of bipolar disorder versus other chronic conditions: an employer-based health plan analysis. Psychiatr Serv 2011; 62:1073–1078LinkGoogle Scholar

8 Woltmann E, Grogan-Kaylor A, Perron B, et al.: Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: systematic review and meta-analysis. Am J Psychiatry 2012; 169:790–804LinkGoogle Scholar

9 Gilbody S, Bower P, Fletcher J, et al.: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Intern Med 2006; 166:2314–2321Crossref, MedlineGoogle Scholar

10 Coleman K, Austin BT, Brach C, et al.: Evidence on the chronic care model in the new millennium. Health Aff 2009; 28:75–85CrossrefGoogle Scholar

11 Miller CJ, Grogan-Kaylor A, Perron BE, et al.: Collaborative chronic care models for mental health conditions: cumulative meta-analysis and metaregression to guide future research and implementation. Med Care 2013; 51:922–930Crossref, MedlineGoogle Scholar

12 Fisher ES, McClellan MB, Bertko J, et al.: Fostering accountable health care: moving forward in Medicare. Health Aff (Millwood) 2009; 28:w219–w231Crossref, MedlineGoogle Scholar

13 Barnes AJ, Unruh L, Chukmaitov A, et al.: Accountable care organizations in the USA: types, developments and challenges. Health Policy 2014; 118:1–7Crossref, MedlineGoogle Scholar

14 Shortell SM, Casalino LP: Implementing qualifications criteria and technical assistance for accountable care organizations. JAMA 2010; 303:1747–1748Crossref, MedlineGoogle Scholar

15 Nutting PA, Miller WL, Crabtree BF, et al.: Initial lessons from the first national demonstration project on practice transformation to a patient-centered medical home. Ann Fam Med 2009; 7:254–260Crossref, MedlineGoogle Scholar

16 Rittenhouse DR, Casalino LP, Shortell SM, et al.: Small and medium-size physician practices use few patient-centered medical home processes. Health Aff 2011; 30:1575–1584CrossrefGoogle Scholar

17 Rittenhouse DR, Shortell SM, Gillies RR, et al.: Improving chronic illness care: findings from a national study of care management processes in large physician practices. Med Care Res Rev 2010; 67:301–320Crossref, MedlineGoogle Scholar

18 Unützer J, Katon W, Callahan CM, et al.: Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 2002; 288:2836–2845Crossref, MedlineGoogle Scholar

19 Bauer MS, Leader D, Un H, et al.: Primary care and behavioral health practice size: the challenge for health care reform. Med Care 2012; 50:843–848Crossref, MedlineGoogle Scholar

20 Peterson TA, Bernstein SJ, Spahlinger DA: Population health: a new paradigm for medicine. Am J Med Sci 2016; 351:26–32Crossref, MedlineGoogle Scholar

21 Fortney JC, Enderle MA, Clothier JL, et al.: Population level effectiveness of implementing collaborative care management for depression. Gen Hosp Psychiatry 2013; 35:455–460Crossref, MedlineGoogle Scholar

22 Maust DT, Mavandadi S, Benson A, et al.: Telephone-based care management for older adults initiated on psychotropic medication. Int J Geriatr Psychiatry 2013; 28:410–416Crossref, MedlineGoogle Scholar

23 Simon GE, Ludman EJ, Operskalski BH: Randomized trial of a telephone care management program for outpatients starting antidepressant treatment. Psychiatr Serv 2006; 57:1441–1445LinkGoogle Scholar

24 Simon GE, Ludman EJ, Rutter CM: Incremental benefit and cost of telephone care management and telephone psychotherapy for depression in primary care. Arch Gen Psychiatry 2009; 66:1081–1089Crossref, MedlineGoogle Scholar

25 Kilbourne AM, Nord KM, Kyle J, et al.: Randomized controlled trial of a health plan–level mood disorders psychosocial intervention for solo or small practices. BMC Psychol 2014; 2:48Crossref, MedlineGoogle Scholar

26 Rollman BL, Belnap BH, LeMenager MS, et al.: Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial. JAMA 2009; 302:2095–2103Crossref, MedlineGoogle Scholar

27 Bauer MS, McBride L, Williford WO, et al.: Collaborative care for bipolar disorder: part I. intervention and implementation in a randomized effectiveness trial. Psychiatr Serv 2006; 57:927–936LinkGoogle Scholar

28 Bauer MS, McBride L, Williford WO, et al.: Collaborative care for bipolar disorder: part II. impact on clinical outcome, function, and costs. Psychiatr Serv 2006; 57:937–945LinkGoogle Scholar

29 Simon GE, Ludman EJ, Bauer MS, et al.: Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry 2006; 63:500–508Crossref, MedlineGoogle Scholar

30 Kilbourne AM, Li D, Lai Z, et al.: Pilot randomized trial of a cross-diagnosis collaborative care program for patients with mood disorders. Depress Anxiety 2013; 30:116–122Crossref, MedlineGoogle Scholar

31 Bauer MS, Krawczyk L, Tuozzo K, et al.: Implementing and sustaining team-based telecare for bipolar disorder: lessons learned from a model-guided, mixed methods analysis. Telemed J E Health 2018;24:45–53Crossref, MedlineGoogle Scholar

32 Kilbourne AM, Post EP, Nossek A, et al.: Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. Psychiatr Serv 2008; 59:760–768LinkGoogle Scholar

33 Kilbourne AM, Goodrich DE, Lai Z, et al.: Randomized controlled trial to assess reduction of cardiovascular disease risk in patients with bipolar disorder: the Self-Management Addressing Heart Risk Trial (SMAHRT). J Clin Psychiatry 2013; 74:e655–e662Crossref, MedlineGoogle Scholar

34 Kilbourne AM, Barbaresso MM, Lai Z, et al.: Improving physical health in patients with chronic mental disorders: twelve-month results from a randomized controlled collaborative care trial. J Clin Psychiatry 2017; 78:129–137Crossref, MedlineGoogle Scholar

35 Kroenke K, Spitzer RL, Williams JB: The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001; 16:606–613Crossref, MedlineGoogle Scholar

36 Ware J Jr, Kosinski M, Keller SDA: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996; 34:220–233Crossref, MedlineGoogle Scholar

37 Dawson DA, Grant BF, Stinson FS: The AUDIT-C: screening for alcohol use disorders and risk drinking in the presence of other psychiatric disorders. Compr Psychiatry 2005; 46:405–416Crossref, MedlineGoogle Scholar

38 Rubin DR: Multiple Imputation for Non-Response in Surveys. New York, Wiley, 1987Google Scholar

39 Fortney JC, Pyne JM, Kimbrell TA, et al.: Telemedicine-based collaborative care for posttraumatic stress disorder: a randomized clinical trial. JAMA Psychiatry 2015; 72:58–67Crossref, MedlineGoogle Scholar

40 Meredith LS, Eisenman DP, Han B, et al.: Impact of collaborative care for underserved patients with PTSD in primary care: a randomized controlled trial. J Gen Intern Med 2016; 31:509–517Crossref, MedlineGoogle Scholar

41 Grubbs KM, Fortney JC, Pyne J, et al.: A comparison of collaborative care outcomes in two health care systems: VA clinics and federally qualified health centers. Psychiatr Serv 2018; 69:431–437LinkGoogle Scholar

42 Gerlach LB, Mavandadi S, Maust DT, et al.: Improving access to collaborative behavioral health care for rural-dwelling older adults. Psychiatr Serv 2018; 69:117–120LinkGoogle Scholar

43 Gilbody S, Lewis H, Adamson J, et al.: Effect of collaborative care vs usual care on depressive symptoms in older adults with subthreshold depression: the CASPER randomized clinical trial. JAMA 2017; 317:728–737Crossref, MedlineGoogle Scholar

44 Solberg LI, Crain AL, Maciosek MV, et al.: A stepped-wedge evaluation of an initiative to spread the collaborative care model for depression in primary care. Ann Fam Med 2015; 13:412–420Crossref, MedlineGoogle Scholar

45 Mavandadi S, Benson A, DiFilippo S, et al.: A telephone-based program to provide symptom monitoring alone vs symptom monitoring plus care management for late-life depression and anxiety: a randomized clinical trial. JAMA Psychiatry 2015; 72:1211–1218Crossref, MedlineGoogle Scholar

46 Richardson LP, Ludman E, McCauley E, et al.: Collaborative care for adolescents with depression in primary care: a randomized clinical trial. JAMA 2014; 312:809–816Crossref, MedlineGoogle Scholar

47 Ilgen MA, Czyz EK, Welsh DE, et al.: A collaborative therapeutic relationship and risk of suicidal ideation in patients with bipolar disorder. J Affect Disord 2009; 115:246–251Crossref, MedlineGoogle Scholar

48 Claxton G, Rae M, Panchal N, et al.: Health benefits in 2014: stability in premiums and coverage for employer-sponsored plans. Health Aff (Millwood) 2014; 33:1851–1860Crossref, MedlineGoogle Scholar

49 Finn Partners National Survey Reveals How Fragmented Health System Places Greater Burden on Patients. CISION PR Newswire, Feb 9, 2016. https://www.prnewswire.com/news-releases/finn-partners-national-survey-reveals-how-fragmented-health-system-places-greater-burden-on-patients-300217167.htmlGoogle Scholar

50 Rollman BL, Herbeck Belnap B, Abebe KZ, et al.: Effectiveness of online collaborative care for treating mood and anxiety disorders in primary care: a randomized clinical trial. JAMA Psychiatry 2018; 75:56–64Crossref, MedlineGoogle Scholar

51 Powell BJ, Waltz TJ, Chinman MJ, et al.: A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015; 10:21Crossref, MedlineGoogle Scholar