Randomized Controlled Trial of a Collaborative Care Intervention for Mood Disorders by a National Commercial Health Plan
Abstract
Objective:
Few individuals with mood disorders have access to evidence-based collaborative chronic care models (CCMs) because most patients are seen in small-group practices (<20 providers) with limited capacity to deliver CCMs. In this single-blind randomized controlled trial, we determined whether a CCM delivered nationally in a U.S. health plan improved 12-month outcomes among enrollees with mood disorders compared with usual care.
Methods:
Aetna insurance enrollees (N=238), mostly females (66.1%) with a mean age of 41.1 years, who were recently hospitalized for unipolar major depression or bipolar disorder provided informed consent, completed baseline assessments, and were randomly assigned to usual care or CCM. The CCM included 10 sessions of the Life Goals self-management program and brief contacts by phone by a care manager to determine symptom status. Primary outcomes were changes over 12 months in depression symptoms (nine-item Patient Health Questionnaire [PHQ-9]) and mental health–related quality of life (Short Form–12).
Results:
Adjusted mean PHQ-9 scores were lower by 2.34 points (95% confidence level [CL]=−4.18 to –0.50, p=0.01), indicating improved symptoms, and adjusted mean SF-12 mental health scores were higher by 3.21 points (CL=–.97 to 7.38, p=0.10), indicating better quality of life, among participants receiving CCM versus usual care.
Conclusions:
Individuals receiving CCM compared with usual care had improved clinical outcomes, although substantial attrition may limit the impact of health plan–level delivery of CCMs. Further research on the use of health plan–level interventions, such as CCMs, as alternatives to practice-based models is warranted.
HIGHLIGHTS
Mood disorders affect one in five individuals yet less than half receive adequate treatment because of the limited capacity of many practices in providing effective collaborative care models (CCMs).
This RCT determined whether a health plan–level CCM improved mental health outcomes for individuals with mood disorders.
Individuals hospitalized for unipolar major depression or bipolar disorder and enrolled in a large national health plan were randomly assigned to receive either the collaborative care model (self-management sessions and care management) by telephone or usual care.
Compared with usual care, those receiving the CCM had lower overall depression symptoms and potentially improved mental health quality of life in 12 months.
One in five individuals in the United States has a mood disorder (unipolar major depression or bipolar disorder) (1, 2), resulting in increased risk of long-term general medical conditions (3) and premature mortality (4), including suicide (5). Up to 70% of treatment costs for mood disorders are incurred outside the mental health sector, notably in primary care (6). In privately insured populations, mood disorders represent the most expensive conditions, with bipolar disorder incurring the most health care costs (7). Effective treatments for mood disorders include psychosocial interventions in addition to medications, yet only 40% of individuals with mood disorders receive adequate treatment (2).
Collaborative chronic care models (CCMs), which provide ongoing psychosocial support in conjunction with treatment coordination, have demonstrated improved outcomes for persons with mood disorders at little or no net health care cost (8–10). Recent meta-analyses found that implementation of at least three core components of the CCM (e.g., self-management, care management, and clinical information systems or case finding) resulted in improved mental and physical outcomes for persons with mental disorders, with little to no net health care costs (8, 11). Often implemented by care managers, CCMs also support health care delivery systems that are subject to bundled payments under health care reform (12–14) and medical home mandates (15, 16). However, CCMs for mood disorders have primarily been implemented in large, integrated health care systems that have the capacity to hire on-site care managers and can scale up the necessary tools, including clinical information systems (16–18). In contrast, over 90% of U.S. commercial health plan enrollees receive care from small practices (<20 primary care physicians) (16, 19), which do not have the capacity to hire care managers at each site to provide CCM core components.
Rather than implement CCMs at the individual-practice level, another option is to implement the programs remotely at the health plan level, which may allow for the further implementation and sustainability of CCMs in solo or small group practices. A key advantage of health plan–level implementation is an economy of scale, made possible through the deployment of virtual care managers and use of common information technologies (20). However, prior studies of implementation of CCMs at the population level have been limited to unipolar depression treatment (21, 22) in large practices (23, 24).
This article reports outcomes following intervention from a randomized trial at the health plan level of a CCM delivered across mood disorders (depression and bipolar disorder). Our primary hypothesis was that patients in the United States who had recently been hospitalized for a mood disorder would have reduced 12-month depressive symptoms and improved mental health–related quality of life after receiving plan-level CCM versus usual care.
Methods
This single-blind, randomized controlled effectiveness trial included patients from Aetna health plan who were randomly assigned to receive either the CCM for mood disorders delivered at the health plan level or usual care. Aetna health plan is one of the largest health care insurers in the country, serving approximately 12 million covered lives, with 244,971 providers (19). Over 90% of Aetna health plan enrollees receive care from primary or mental health practices with fewer than 20 physicians (19).
Participants
As described in detail elsewhere, eligible patients included Aetna health plan enrollees (beneficiaries or family members of beneficiaries) who were identified from Aetna claims data from across the lower 48 United States, who were ages 21 or older, and who had been hospitalized in the past 6 months for unipolar major depression or bipolar disorder (bipolar manic or depressed state) (25). We chose recent hospitalization as an inclusion criterion because inpatient care indicates greater clinical severity that could benefit from a CCM (26). The study received institutional review board (IRB) approval from local IRBs, and all patient participants provided verbal informed consent. Prior to randomization, participants were approached, gave consent, and were enrolled by phone by the Aetna care manager, who used claims data from recent inpatient hospitalization history to identify potential participants. Recruitment began in July 2014 and ended in July 2015; follow-up assessments continued through July 2017.
The care manager contacted participants by phone to confirm eligibility and enroll participants. The care manager was trained by study staff in CCM procedures, assessments, and human subjects protection by using established CCM-based protocols (27). Participants were ineligible if they were no longer enrolled in Aetna health plan, were deceased, or were unable to provide informed consent because of an unstable condition, inpatient status, or inability to communicate in English.
Randomization
The study analyst randomly assigned participants to CCM or usual care by using a computer-generated algorithm stratified by diagnosis at hospitalization discharge (unipolar disorder or bipolar disorder). The allocation sequence was concealed from recruiters until interventions were assigned. Those randomized to the usual care arm received standard care from their practice provider and none of the CCM components from the care manager.
Intervention
Patients randomized to the CCM received contacts and psychosocial intervention from the Aetna care manager in addition to usual care from their provider. The care manager, with a master’s degree in clinical social work, delivered the CCM intervention over a 6-month period, including the following core components: clinical information systems (Aetna clinical database to track and initially contact potentially eligible patients), self-management support (10 weekly sessions by phone), and ongoing care management (8, 10, 11). The self-management sessions were adapted from the evidence-based Life Goals program (27–31), a psychosocial intervention that focuses on symptom coping strategies to reduce stigma and promote wellness goals and that has been shown to improve outcomes for those with unipolar depression or bipolar disorder (28, 30, 32–34). Ongoing care management included up to six monthly brief contacts to determine status and symptoms. Fidelity to the CCM was supported through a 2-day training session for the care manager as well as regular calls with the care manager to review session content and how patient contacts were progressing (27).
Participants from both treatment arms who experienced imminent risk (e.g., suicidal or assaultive ideation) were cared for according to protocols used in prior CCM studies (25, 27). The care manager and research assistant were trained to handle emergencies involving participants with suicidal ideation and were instructed to contact their providers on an as-needed basis.
Data Collection and Outcomes
Thirty-minute assessments of primary outcome measures and covariates were conducted at baseline and 6- and 12-month follow-ups. Baseline assessments were ascertained by the care manager at the time of enrollment and included demographic information, health status, and baseline measures for primary outcomes. Follow-up assessments consisted of follow-up measures of primary outcomes and were conducted by a study research assistant who was not employed by Aetna and who was blinded to the patients’ randomization allocation. Clinical outcomes were measured at 12 months to assess durability of the 6-month CCM program.
Changes in depressive symptoms, the primary outcomes, were measured by the nine-item Patient Health Questionnaire (PHQ-9), a widely used assessment of depressive symptoms (35), and the mental health component score on the 12-item Short-Form (SF-12) Health-Related Quality of Life Survey (36). The PHQ-9 was chosen because depression symptoms are also a significant complaint among individuals with bipolar disorder.
Covariate information ascertained from assessments included demographic characteristics (age, sex, race-ethnicity, education, employment status, and living alone) and health behaviors, including hazardous drinking (having six or more drinks on a single occasion within the past month, as defined by the Alcohol Use Disorders Identification Test) (37), illicit drug use, and smoking. Other covariates ascertained from Aetna claims data included enrollment status (beneficiary versus family member) and primary mental health diagnosis (bipolar disorder or major depression).
Analyses
Primary clinical outcomes (change in PHQ-9 and SF-12 mental component summary [MCS] scores) were modeled by using mixed-effects models with random intercepts and baseline values of the outcome (at randomization), treatment arm indicator, time (6 and 12 months), and the interaction of treatment arm × time as predictors. The interaction term was included to explore whether the outcomes changed between 6 and 12 months.
Missing data were handled by using a standardized process. First, possible missing patterns of the data were identified based on determining whether there was any relationship with missing data and outcomes or treatment arm. Multivariable logistic regression models were then run on dichotomous variables created to represent each missing pattern as a function of baseline patient characteristics, each outcome, and treatment arm. The final models of primary clinical outcomes (PHQ-9 and MCS) used multiple imputation methods to account for missing data. Variables employed in the imputation were empirically driven on the basis of the association between the variables to be imputed and auxiliary variables and included all model covariates, treatment indicators, and missing data pattern indicators. Twenty data sets were imputed, and results were pooled according to Rubin’s (38) rule of combining data sets.
Results
A total of 9,121 potentially eligible patients from the Aetna database were identified by clinical information systems as having a diagnosis of unipolar depression or bipolar disorder from an inpatient discharge in the past six months. Of those, 7,335 were deemed to be ineligible (<21 years old, not living within the 48 contiguous United States, or no longer covered by Aetna), leaving 1,786 potentially eligible patients. Of the 1,786 approached, 403 declined to participate, 999 could not be reached, and 104 were determined to be ineligible. Of the 238 enrolled, 115 were randomly assigned at baseline to receive the CCM and 123 to receive usual care. [A CONSORT diagram of the study is available in an online supplement.] Based on the actual sample size of 73 (165 patients dropped out of the study, a dropout rate of 69%), the resultant power to detect mean differences between treatment arms was 27% for the PHQ-9 (Cohen’s d=.25) and 19% for the SF-12 MCS (Cohen’s d=.20) scores.
At baseline, respondents were a mean±SD age of 41.3±31.1; were mostly female (66%), white (81%), and employed (58%); and had a mean score of 12.7±6.6 on the PHQ-9 and 35.6±15.2 on the SF-12 MCS (Table 1). Among those assigned to the CCM, the mean number of self-management sessions completed was 8.4±2.7, and the mean number of care management contacts was 4.7±2.6.
Overall (N=238) | CCM (N=115) | Usual care (N=123) | ||||
---|---|---|---|---|---|---|
Characteristic | N | % | N | % | N | % |
Primary enrollee (versus family member) | 140 | 59 | 72 | 63 | 68 | 55 |
Practice size <20 providers | 197 | 87 | 97 | 89 | 100 | 86 |
Female | 156 | 66 | 77 | 67 | 79 | 64 |
White | 193 | 81 | 99 | 86 | 94 | 76 |
Any college | 168 | 71 | 75 | 65 | 93 | 76 |
Employed | 139 | 58 | 70 | 61 | 69 | 56 |
Lives alone | 53 | 22 | 30 | 26 | 12 | 19 |
Alcohol use (hazardous drinking)b | 66 | 28 | 34 | 30 | 32 | 26 |
Other substance use | 40 | 17 | 17 | 15 | 23 | 19 |
Current smoker | 69 | 29 | 38 | 33 | 31 | 25 |
Primary diagnosis: | ||||||
Major depression | 156 | 66 | 76 | 66 | 80 | 65 |
Bipolar disorder | 82 | 35 | 39 | 34 | 43 | 35 |
Age (M+SD) | 41.3+13.1 | 42.8±12.9 | 39.9±13.2 | |||
PHQ-9 score (M+SD)c | 12.7+6.6 | 13.0±7.1 | 12.4±6.1 | |||
SF-12 score (M+SD)d | ||||||
MCS | 35.6±15.2 | 36.9±15.3 | 34.4±15.2 | |||
PCS | 48.6±13.2 | 47.2±13.5 | 49.8±12.7 |
Dropout also difference across treatment arms in the 0- to 6-month follow up period, where dropout more likely for CCM participants (30%) than for usual care participants (19%). Later dropout (6–12 months) was similar among the treatment arms: usual care participants (21%) and CCM participants (22%). Indicators representing time of dropout (6 or 12 months) were included in the imputation process. By 12 months, lost coverage was the reason for dropout among more than 80% of participants who dropped out, which did not differ by study group.
Figure 1 presents the unadjusted mean scores for the PHQ-9 and SF-12 MCS at each assessment, demonstrating that the changes mainly occurred between baseline and 6 months. The final models did not include the interaction term, given that it was neither meaningfully nor statistically significant.
Based on the model fit with main effects of 12-month and treatment arm (CCM) indicators, adjusted mean±SE PHQ-9 scores among patients receiving the CCM were lower by –2.34±0.92 points (95% confidence level [CL]=–4.18 to –0.50, p=0.004), compared with those receiving usual care. Although not statistically significant, adjusted mean SF-12 MCS scores for patients who received the CCM were higher (indicating better quality of life) by 3.21±2.09 points (95% CL=–0.97 to 7.38), compared with scores of those receiving usual care.
Similar results were obtained from fitting the model to each outcome with an interaction term of time × treatment (see online supplement).
Discussion
We described 12-month results from the first study, to our knowledge, to implement the CCM within a nationwide commercial health plan for patients hospitalized for unipolar depression or bipolar disorder. We found that after randomization, patients receiving CCM had less reported depression symptoms and a trend toward more improvement in mental health quality of life compared with patients receiving usual care. Despite having private insurance, study participants reported substantial impairment in mental health quality of life (i.e., score on the SF-12 mental health lower by an average of 15 points compared with the general population) (36).
The observed effects of reduced mood disorder symptoms among patients randomly assigned to CCM compared with usual care are reflective of prior studies of CCM that focused on those with major depression or bipolar disorder (8). The study also adds to the growing body of literature on the effectiveness of collaborative care in improving mental health outcomes across age groups (22) and mental health conditions (22, 39–42), reflecting the potential for a more cost-efficient approach to providing evidence-based care remotely to patients without access to on-site collaborative care.
CCMs to date have primarily been implemented solely for unipolar depression (21, 26, 43–46) or within large integrated health systems, which, unlike solo or small group primary care practices, have sufficient infrastructure to mount such integrated efforts. Implementing CCMs in health plans across mood disorders represents an important effort to overcome such geographic and administrative barriers (31). Most commercially insured individuals receive care from network model health plans and within small practices, which have limited capacity to provide organized CCMs or other disease management interventions (11, 16, 19). CCMs that address the range of mood disorders, including bipolar disorder, might be able to address suicide—notably through the reduction of depressive symptoms (47).
There were several limitations to this study that warrant consideration. Only a fraction of potentially eligible patients was enrolled. Participants may have been less inclined to engage in a program offered by an insurer rather than a care provider. Moreover, those who were recently hospitalized, especially patients from more rural settings, could be an especially difficult population to reach or engage (21). Postrandomization dropout was also substantial; the primary reason for participant dropout was disenrollment from Aetna coverage, given that enrollment in Aetna was a study inclusion criterion. Although we did not have information on reasons for Aetna coverage change, loss of coverage can be triggered by changes in employer/employment status or premium increases (48). Evidence suggests that about half of Americans switch health plans within 3 years (49).
Moreover, the care manager had limited contact with the patients’ providers, limiting their ability to help manage pharmacotherapy for patients; however, in previous trials the Life Goals program was demonstrated to be effective as a stand-alone self-management program (30, 34). Although the research assistant made every effort to follow up with patients by using a brief survey, lack of available contact information once the individual disenrolled from the health plan and lack of subject compensation for survey participation may have contributed to follow-up attrition. We also used multiple imputations to account for the high rate of loss at 12 months; however, the method is limited by the number of available variables to impute and did not address the possibility that the remaining participants may be highly selected. In addition, whereas this study employed the core components of the CCM found to be effective from previous meta-analyses (self-management, care management, and clinical information systems), we were unable to fully implement provider clinical decision support in regard to mood disorders medication management across the multiple practices. Finally, although the study incorporated well-established clinical outcomes measures, clinical outcomes were self-reported (8, 11).
Conclusions
Overall findings from this study indicate that a health plan–level CCM was effective in reducing depressive symptoms and improving health-related quality of life for a cross-diagnosis group of individuals with mood disorders (depression and bipolar disorder). However, protocol dropout rates, primarily due to low initial acceptance of a health plan–level intervention and instability of health plan enrollment, mitigate the certainty of these conclusions as well as the willingness of commercial insurers to invest in such plan-level interventions. Nonetheless, delivery of CCMs at the health plan level may be the sole approach to extend these evidence-based interventions to patients with mood disorders who are managed in venues likely too small to implement CCMs on site.
Additional methods to enhance implementation at the health plan level warrant further investigation. Such methods include the use of virtual tools to allow care managers to engage with the patients’ principal care providers, especially within small practices; additional mobile health or Web-based programs (39, 50) to enable providers and patients to extend care coordination and self-management; and other implementation strategies, such as practice-based facilitation or performance incentives (51). Ultimately, a health plan–based virtual CCM intervention is a potentially cost-efficient approach to delivering this evidence-based practice at the population level.
1 : The prevalence and disability of bipolar spectrum disorders in the US population: re-analysis of the ECA database taking into account subthreshold cases. J Affect Disord 2003; 73:123–131Crossref, Medline, Google Scholar
2 : The descriptive epidemiology of commonly occurring mental disorders in the United States. Annu Rev Public Health 2008; 29:115–129Crossref, Medline, Google Scholar
3 : Collaborative care for patients with depression and chronic illnesses. N Engl J Med 2010; 363:2611–2620Crossref, Medline, Google Scholar
4 : Mortality in mental disorders and global disease burden implications: a systematic review and meta-analysis. JAMA Psychiatry 2015; 72:334–341Crossref, Medline, Google Scholar
5 : Psychiatric diagnoses and risk of suicide in veterans. Arch Gen Psychiatry 2010; 67:1152–1158Crossref, Medline, Google Scholar
6 : An estimate of the minimum economic burden of bipolar I and II disorders in the United States: 2009. J Affect Disord 2011; 129:79–83Crossref, Medline, Google Scholar
7 : Direct costs of bipolar disorder versus other chronic conditions: an employer-based health plan analysis. Psychiatr Serv 2011; 62:1073–1078Link, Google Scholar
8 : Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: systematic review and meta-analysis. Am J Psychiatry 2012; 169:790–804Link, Google Scholar
9 : Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Intern Med 2006; 166:2314–2321Crossref, Medline, Google Scholar
10 : Evidence on the chronic care model in the new millennium. Health Aff 2009; 28:75–85Crossref, Google Scholar
11 : Collaborative chronic care models for mental health conditions: cumulative meta-analysis and metaregression to guide future research and implementation. Med Care 2013; 51:922–930Crossref, Medline, Google Scholar
12 : Fostering accountable health care: moving forward in Medicare. Health Aff (Millwood) 2009; 28:w219–w231Crossref, Medline, Google Scholar
13 : Accountable care organizations in the USA: types, developments and challenges. Health Policy 2014; 118:1–7Crossref, Medline, Google Scholar
14 : Implementing qualifications criteria and technical assistance for accountable care organizations. JAMA 2010; 303:1747–1748Crossref, Medline, Google Scholar
15 : Initial lessons from the first national demonstration project on practice transformation to a patient-centered medical home. Ann Fam Med 2009; 7:254–260Crossref, Medline, Google Scholar
16 : Small and medium-size physician practices use few patient-centered medical home processes. Health Aff 2011; 30:1575–1584Crossref, Google Scholar
17 : Improving chronic illness care: findings from a national study of care management processes in large physician practices. Med Care Res Rev 2010; 67:301–320Crossref, Medline, Google Scholar
18 : Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 2002; 288:2836–2845Crossref, Medline, Google Scholar
19 : Primary care and behavioral health practice size: the challenge for health care reform. Med Care 2012; 50:843–848Crossref, Medline, Google Scholar
20 : Population health: a new paradigm for medicine. Am J Med Sci 2016; 351:26–32Crossref, Medline, Google Scholar
21 : Population level effectiveness of implementing collaborative care management for depression. Gen Hosp Psychiatry 2013; 35:455–460Crossref, Medline, Google Scholar
22 : Telephone-based care management for older adults initiated on psychotropic medication. Int J Geriatr Psychiatry 2013; 28:410–416Crossref, Medline, Google Scholar
23 : Randomized trial of a telephone care management program for outpatients starting antidepressant treatment. Psychiatr Serv 2006; 57:1441–1445Link, Google Scholar
24 : Incremental benefit and cost of telephone care management and telephone psychotherapy for depression in primary care. Arch Gen Psychiatry 2009; 66:1081–1089Crossref, Medline, Google Scholar
25 : Randomized controlled trial of a health plan–level mood disorders psychosocial intervention for solo or small practices. BMC Psychol 2014; 2:48Crossref, Medline, Google Scholar
26 : Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial. JAMA 2009; 302:2095–2103Crossref, Medline, Google Scholar
27 : Collaborative care for bipolar disorder: part I. intervention and implementation in a randomized effectiveness trial. Psychiatr Serv 2006; 57:927–936Link, Google Scholar
28 : Collaborative care for bipolar disorder: part II. impact on clinical outcome, function, and costs. Psychiatr Serv 2006; 57:937–945Link, Google Scholar
29 : Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry 2006; 63:500–508Crossref, Medline, Google Scholar
30 : Pilot randomized trial of a cross-diagnosis collaborative care program for patients with mood disorders. Depress Anxiety 2013; 30:116–122Crossref, Medline, Google Scholar
31 : Implementing and sustaining team-based telecare for bipolar disorder: lessons learned from a model-guided, mixed methods analysis. Telemed J E Health 2018;24:45–53Crossref, Medline, Google Scholar
32 : Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. Psychiatr Serv 2008; 59:760–768Link, Google Scholar
33 : Randomized controlled trial to assess reduction of cardiovascular disease risk in patients with bipolar disorder: the Self-Management Addressing Heart Risk Trial (SMAHRT). J Clin Psychiatry 2013; 74:e655–e662Crossref, Medline, Google Scholar
34 : Improving physical health in patients with chronic mental disorders: twelve-month results from a randomized controlled collaborative care trial. J Clin Psychiatry 2017; 78:129–137Crossref, Medline, Google Scholar
35 : The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001; 16:606–613Crossref, Medline, Google Scholar
36 : A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996; 34:220–233Crossref, Medline, Google Scholar
37 : The AUDIT-C: screening for alcohol use disorders and risk drinking in the presence of other psychiatric disorders. Compr Psychiatry 2005; 46:405–416Crossref, Medline, Google Scholar
38 Rubin DR: Multiple Imputation for Non-Response in Surveys. New York, Wiley, 1987Google Scholar
39 : Telemedicine-based collaborative care for posttraumatic stress disorder: a randomized clinical trial. JAMA Psychiatry 2015; 72:58–67Crossref, Medline, Google Scholar
40 : Impact of collaborative care for underserved patients with PTSD in primary care: a randomized controlled trial. J Gen Intern Med 2016; 31:509–517Crossref, Medline, Google Scholar
41 : A comparison of collaborative care outcomes in two health care systems: VA clinics and federally qualified health centers. Psychiatr Serv 2018; 69:431–437Link, Google Scholar
42 : Improving access to collaborative behavioral health care for rural-dwelling older adults. Psychiatr Serv 2018; 69:117–120Link, Google Scholar
43 : Effect of collaborative care vs usual care on depressive symptoms in older adults with subthreshold depression: the CASPER randomized clinical trial. JAMA 2017; 317:728–737Crossref, Medline, Google Scholar
44 : A stepped-wedge evaluation of an initiative to spread the collaborative care model for depression in primary care. Ann Fam Med 2015; 13:412–420Crossref, Medline, Google Scholar
45 : A telephone-based program to provide symptom monitoring alone vs symptom monitoring plus care management for late-life depression and anxiety: a randomized clinical trial. JAMA Psychiatry 2015; 72:1211–1218Crossref, Medline, Google Scholar
46 : Collaborative care for adolescents with depression in primary care: a randomized clinical trial. JAMA 2014; 312:809–816Crossref, Medline, Google Scholar
47 : A collaborative therapeutic relationship and risk of suicidal ideation in patients with bipolar disorder. J Affect Disord 2009; 115:246–251Crossref, Medline, Google Scholar
48 : Health benefits in 2014: stability in premiums and coverage for employer-sponsored plans. Health Aff (Millwood) 2014; 33:1851–1860Crossref, Medline, Google Scholar
49 Finn Partners National Survey Reveals How Fragmented Health System Places Greater Burden on Patients. CISION PR Newswire, Feb 9, 2016. https://www.prnewswire.com/news-releases/finn-partners-national-survey-reveals-how-fragmented-health-system-places-greater-burden-on-patients-300217167.htmlGoogle Scholar
50 : Effectiveness of online collaborative care for treating mood and anxiety disorders in primary care: a randomized clinical trial. JAMA Psychiatry 2018; 75:56–64Crossref, Medline, Google Scholar
51 : A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015; 10:21Crossref, Medline, Google Scholar