0
Get Alert
Please Wait... Processing your request... Please Wait.
You must sign in to sign-up for alerts.

Please confirm that your email address is correct, so you can successfully receive this alert.

1
Articles   |    
Practice-Based Versus Telemedicine-Based Collaborative Care for Depression in Rural Federally Qualified Health Centers: A Pragmatic Randomized Comparative Effectiveness Trial
John C. Fortney, Ph.D.; Jeffrey M. Pyne, M.D.; Sip B. Mouden, M.S., C.R.C.; Dinesh Mittal, M.D.; Teresa J. Hudson, Pharm.D.; Gary W. Schroeder, Ph.D.; David K. Williams, Ph.D.; Carol A. Bynum, Ph.D.; Rhonda Mattox, M.D.; Kathryn M. Rost, Ph.D.
Am J Psychiatry 2013;170:414-425. doi:10.1176/appi.ajp.2012.12050696
View Author and Article Information

The authors report no financial relationships with commercial interests.

Supported by NIMH grant R01 MH076908/MH076908-04S1 to Dr. Fortney.

Clinicaltrials.gov identifier: NCT00439452.

From the Division of Health Services Research, Department of Psychiatry, College of Medicine, the Department of Biostatistics, College of Public Health, and the Center for Distance Health, University of Arkansas for Medical Sciences, Little Rock; Health Services Research and Development and the South Central Mental Illness Education and Clinical Center, Central Arkansas Veterans Healthcare System, North Little Rock; Community Health Centers of Arkansas, North Little Rock; United Family Services, Little Rock; and the Department of Mental Health Law and Policy, College of Behavioral and Community Sciences, University of South Florida, Tampa.

Address correspondence to Dr. Fortney (fortneyjohnc@uams.edu).

Copyright © 2013 by the American Psychiatric Association

Received May 28, 2012; Revised September 17, 2012; Accepted October 12, 2012.

Objective  Practice-based collaborative care is a complex evidence-based practice that is difficult to implement in smaller primary care practices that lack on-site mental health staff. Telemedicine-based collaborative care virtually co-locates and integrates mental health providers into primary care settings. The objective of this multisite randomized pragmatic comparative effectiveness trial was to compare the outcomes of patients assigned to practice-based and telemedicine-based collaborative care.

Method  From 2007 to 2009, patients at federally qualified health centers serving medically underserved populations were screened for depression, and 364 patients who screened positive were enrolled and followed for 18 months. Those assigned to practice-based collaborative care received evidence-based care from an on-site primary care provider and a nurse care manager. Those assigned to telemedicine-based collaborative care received evidence-based care from an on-site primary care provider and an off-site team: a nurse care manager and a pharmacist by telephone, and a psychologist and a psychiatrist via videoconferencing. The primary clinical outcome measures were treatment response, remission, and change in depression severity.

Results  Significant group main effects were observed for both response (odds ratio=7.74, 95% CI=3.94–15.20) and remission (odds ratio=12.69, 95% CI=4.81–33.46), and a significant overall group-by-time interaction effect was observed for depression severity on the Hopkins Symptom Checklist, with greater reductions in severity over time for patients in the telemedicine-based group. Improvements in outcomes appeared to be attributable to higher fidelity to the collaborative care evidence base in the telemedicine-based group.

Conclusions  Contracting with an off-site telemedicine-based collaborative care team can yield better outcomes than implementing practice-based collaborative care with locally available staff.

Abstract Teaser
Figures in this Article

Complex evidence-based practices are difficult to implement with fidelity in routine care. One such evidence-based practice, practice-based collaborative care, involves co-located primary care providers, mental health specialists, and care managers working together on-site in a primary care setting. Practice-based collaborative care has been shown to improve depression outcomes in numerous randomized effectiveness trials (17). However, implementation in smaller primary care practices presents challenges where it is typically not feasible to employ on-site mental health specialists or full-time care managers. Only 25% of U.S. primary care practices have on-site mental health specialists (8). Two studies (3, 9) have demonstrated that depression outcomes can be improved in small primary care clinics lacking on-site mental health specialists by training on-site nurses to be depression care managers; however, the effect sizes have been small to medium. Moreover, based on the results of a meta-analysis of randomized trials of practice-based collaborative care, Gilbody et al. (10) concluded that collaborative care interventions with more mental health specialist involvement have larger effect sizes.

Telemedicine technologies now make possible the virtual co-location of mental health specialists and primary care providers. Telemedicine-based collaborative care involves an off-site team of mental health specialists collaborating with on-site primary care providers, from a centralized location, using telephones, videoconferencing, and electronic health records. A multisite randomized trial conducted in the Department of Veterans Affairs (VA) (11, 12) demonstrated that telemedicine-based collaborative care is more effective than usual care in small satellite primary care clinics. Telemedicine-based collaborative care has also been adopted and sustained as part of routine care in small satellite primary care clinics within the VA (13). Compared with practice-based collaborative care, telemedicine-based collaborative care has the potential to be implemented with higher fidelity in smaller primary care clinics because the off-site team can include an array of mental health specialists, and full-time care managers can practice under more intensive clinical supervision and dedicate their time to care coordination activities, resulting in higher fidelity to care manager protocols. However, there are also potential disadvantages to telemedicine-based collaborative care. Off-site care managers cannot build on established relationships with patients and may have difficulty establishing therapeutic alliances from a distance. Likewise, if off-site care managers lack access to on-site medical records, they may have difficulty integrating behavioral and physical aspects of care and face barriers communicating with on-site primary care providers. In addition, the stepped care elements of the collaborative care model (e.g., psychiatric consultation) may be less effective when delivered via telemedicine. However, patients and providers uniformly report high levels of satisfaction with videoconferencing (1417), and there is good evidence for the clinical equivalency of psychiatric (1821) and psychological (2226) treatments delivered via videoconferencing compared with face-to-face.

Given that 1) practice-based collaborative care without the involvement of on-site mental health specialists improves outcomes, 2) practice-based collaborative care with involvement from on-site mental health specialists improves outcomes more, and 3) the potential disadvantages of telemedicine-based collaborative care, an important policy-relevant question is whether it is more effective for small, remote primary care clinics to implement practice-based collaborative care without the involvement of on-site mental health specialists or to implement telemedicine-based collaborative care in partnership with an off-site team of mental health specialists.

Our objective in this pragmatic (27) comparative effectiveness trial (28) was to compare the process outcomes and clinical outcomes of patients randomly assigned to telemedicine-based collaborative care or practice-based collaborative care in small, remote primary care clinics that lacked on-site mental health specialists, thereby comparing two organizational approaches (with clinical equipoise) to delivering collaborative care for depression (29). We chose to conduct a pragmatic trial design in order to compare two viable competing strategies to delivering an evidence-based practice rather than an explanatory trial designed to determine why one approach was superior to the other. We hypothesized that compared with patients assigned to practice-based collaborative care, those assigned to telemedicine-based collaborative care would receive higher-fidelity care management, more specialty mental health services (e.g., telepsychiatry and telepsychology), and higher-quality pharmacotherapy and therefore would experience greater symptom improvement. Secondary outcomes examined included health status, quality of life, and satisfaction with care.

We partnered with five federally qualified health centers serving medically underserved populations in Arkansas’ Mississippi Delta region and the Ozark Highlands. With federal oversight from the Health Resources and Services Administration (HRSA), federally qualified health centers make up the nation’s largest and fastest growing network of primary care providers, with 8,000 clinics providing services to 20 million Americans. Three-quarters of federally qualified health center patients live in poverty, half live in rural areas, one-third are uninsured, and one-third are from minority populations. Mental health problems are the most commonly reported reasons for visits to federally qualified health centers (30), yet only 5.5% of encounters are with on-site mental health specialists (31). Research conducted in partnership with federally qualified health centers has direct applicability to a large segment of the U.S. population at risk for experiencing health disparities.

+

Design Overview

This multisite randomized trial employed a comparative effectiveness research design (28). Patients were randomly assigned to one of two active treatment arms, both of which represent potentially feasible approaches to adapting the evidence-based collaborative care model for routine delivery in medically underserved areas. The study design also contained many elements of pragmatic trials (27), including the use of relatively few exclusion criteria, enrollment of a diverse sample of patients, monitoring of but not controlling intervention fidelity, a primary outcome measure defined in terms of changes in patient-reported symptoms, and use of intent-to-treat analyses to examine group differences.

+

Setting and Participants

We approached six federally qualified health centers, and five agreed to participate. Participating centers employed between 1.3 and 9.7 primary care physician full-time equivalents, served between 5,362 and 13,050 unique primary care patients, and operated one to six clinics across multiple locations. None of the participating clinic locations had an on-site mental health specialist. Between November 2007 and June 2009, 19,285 patients were screened for depression by health center staff using the nine-item Patient Health Questionnaire (see the CONSORT diagram in the data supplement that accompanies the online edition of this article). Fifteen percent of patients (N=2,863) screened positive (a score ≥10 on the Patient Health Questionnaire); health center staff obtained informed consent from 62% of potentially eligible patients (N=829), and 55% (N=364) were found to be eligible and completed the baseline telephone interview. We excluded patients that primary care providers would not be comfortable treating; exclusion criteria included pregnancy, schizophrenia, acute suicidal ideation, substance dependence, bipolar disorder, recent bereavement, and current specialty mental health treatment. We also excluded patients who were unable to participate in research because of cognitive impairment, having a court-appointed guardian, not speaking English, having no telephone, or having a life event preventing participation. Screening and eligibility results were entered into the medical record.

+

Randomization and Interventions

+

Randomization.

Eligible patients were assigned by computer randomization using a 2×2 Latin square design (stratified by clinic) to either telemedicine-based collaborative care or practice-based collaborative care. It was not feasible to blind patients or providers to randomization status.

+

Practice-based collaborative care.

The practice-based collaborative care intervention was designed to be the same as the model of care supported by HRSA, known as the Depression Health Disparities Collaborative (32, 33), which represents more intensive treatment than usual care. Practice-based collaborative care involved two types of providers: on-site primary care providers and on-site nurse depression care managers. Each clinic location employed a half-time depression care manager funded by the study. Depression care managers were nurses (R.N. or L.P.N.) who had no prior mental health experience. They received a care manager training manual, 1 day of training in depression care management, and access to a web-based patient registry and depression care manager decision support system (34). Patients could choose either watchful waiting or antidepressant treatment. Depression care manager encounters were conducted either face-to-face or by telephone, depending on the patient’s preference. The initial depression care manager encounter included 1) symptom monitoring with the Patient Health Questionnaire, 2) education/activation, 3) barrier assessment/resolution, and 4) establishing self-management goals, including planning physical, rewarding, and social activities. Follow-up encounters, scheduled every 2 weeks during acute treatment and every 4 weeks during continuation treatment, included the monitoring of symptoms, medication adherence, side effects, and engagement in planned self-management activities. Depression care managers received no clinical supervision from a mental health specialist. Progress notes were entered into the patients’ paper medical record. A trial was considered to have failed in the acute phase if the patient did not respond to treatment (response was defined as a decrease of ≥50% in Patient Health Questionnaire score) after 8 weeks of treatment. No additional on-site mental health support was available for patients who did not respond to treatment, although patients could be referred to off-site mental health providers (e.g., community mental health centers). Patients received the intervention for up to 12 months.

+

Telemedicine-based collaborative care.

Telemedicine-based collaborative care involved five types of providers: on-site primary care providers and off-site depression care managers (at the R.N. level), pharmacists (at the Pharm.D. level), psychologists (at the Ph.D. level), and psychiatrists. The off-site team, located at the University of Arkansas for Medical Sciences, was funded by the study. The full-time depression care manager was a nurse who had no prior mental health experience and received the same training and tools as the on-site depression care managers. All depression care manager encounters were conducted by telephone and followed the protocol described above. Progress notes were faxed to the clinic. During weekly meetings, the depression care manager received clinical supervision and the off-site team discussed new patients and patients who were not responding to treatment, and they offered treatment recommendations to primary care providers via the depression care manager progress notes. Patients received stepped care, whereby treatment intensity was increased for patients who were not responding to treatment. If the patient did not respond to the initial antidepressant, the pharmacist conducted a medication history and provided medication management by telephone as needed. If the patient did not respond to two antidepressant trials, a psychiatry consultation via videoconferencing was scheduled. At any time, patients had access to cognitive-behavioral therapy (CBT) delivered via videoconferencing. Patients who did not respond to an antidepressant trial were specifically encouraged to initiate and complete CBT.

+

Outcomes and Follow-Up

+

Fidelity assessment.

Fidelity to the depression care manager protocol was measured through chart review. Five of the charts (1.4%) could not be located during the site visits. The following fidelity measures were abstracted: number of depression care manager encounters with documented Patient Health Questionnaire scores; self-management activities; antidepressant adherence assessments and side effect assessments for those treated with antidepressants; and counseling adherence assessments for those referred to psychotherapy. Depression care manager fidelity was also measured from patient self-report during the 6- and 12-month telephone interviews using items that addressed education, self-management, symptom monitoring, adherence monitoring, and collaboration among providers. To measure fidelity to the stepped care protocol, we examined what proportion of patients in the telemedicine group who failed to respond to at least one medication trial had a telephone pharmacist encounter and what proportion of those who failed to respond to two trials had a telepsychiatry consultation. We also examined what proportion of patients in the telemedicine-based group attended at least one telepsychotherapy session and completed at least eight sessions.

+

Baseline interviews.

Data were collected at baseline in a blinded telephone interview. At baseline, sociodemographic and clinical case-mix data were collected using the Depression Outcomes Module (35, 36), the Mini International Neuropsychiatric Interview (37, 38), the Duke Social Support and Stress Scale (39, 40), the Quality Improvement for Depression Treatment Acceptability scale (3, 4), and the Depression Health Beliefs Inventory (41). Zip codes were used to categorize patients’ residence as rural or urban according to Rural Urban Commuting Area classification scheme C.

+

Follow-up interviews.

Blinded follow-up telephone interviews were completed for 87% of participants (N=318) at 6 months, 79% (N=287) at 12 months, and 78% (N=283) at 18 months. In addition to the fidelity measures described above, the other primary process measures included self-reported mental health service utilization, antidepressant prescriptions, antidepressant dosage (categorized as starting, usual, or high [42]), and antidepressant adherence (taking the full prescribed dosage at least 80% of days in the previous month). The primary clinical outcome measures were changes in depression severity and treatment response and remission. Depression severity was measured continuously using the 20-item Hopkins Symptom Checklist (HSCL) (43, 44). Response, measured dichotomously, was defined as a decrease of ≥50% in HSCL score between baseline and follow-up. Remission, measured dichotomously, was defined as an HSCL score <0.5. Secondary outcome measures included health status (based on the physical and mental health composite scale scores from the 12-item Short-Form Health Survey) (45, 46), quality of life (based on the Quality of Well-Being scale) (4750), and satisfaction with care (based on the Consumer Assessment of Healthcare Providers and Systems) (51).

+

Statistical Analysis

Patients were the unit of the intent-to-treat analysis. Clinic-level intraclass correlation coefficients for HSCL change scores were not significant. Provider-level intraclass correlation could not be calculated because patients could have multiple primary care providers. For the hypotheses examining fidelity, separate logistic regressions were specified for the first 6 months and the second 6 months. For the hypotheses examining other outcomes, we used mixed models and included data from all completed research assessments (52). Case-mix variables were selected using the method of purposeful selection (53). Case-mix variables with missing values were imputed using the PROC MI procedure in SAS, version 9.3 (SAS Institute, Cary, N.C.). PROC MIXED and PROC GLIMMIX were used with the PROC MIANALYZE procedure to model outcomes with linear, binomial, negative binomial, or ordinal distributions. All models specified clinic as a random effect to control for intraclass correlation coefficient. Time was included as a fixed effect. The model specifications included main effects for group and time (with practice-based collaborative care assigned as the reference group) and interaction effects for group by time. The main group effect was used to test the hypotheses for dependent variables not measured at baseline (e.g., treatment response). For dependent variables that were measured at baseline (e.g., HSCL score), group-by-time interaction effects were used to test the hypothesis that the rate of improvement differed across the two groups. Because there were multiple group-by-time interaction terms, an omnibus test was used to determine whether these variables collectively explained a significant amount of the variance in the dependent variable (54). If the omnibus test was significant at the conservative alpha level of 0.10, we report group differences and significance tests for each time period. Otherwise, we report group differences averaged across the time periods and one significance test. The analysis had an 85% power to detect a 15% difference (e.g., 30% versus 45%) in response rates.

The study participants’ socioeconomic and clinical characteristics are summarized in Table 1. Two-thirds (64.5%) were unemployed, 69.7% had an annual household income <$20,000, 50.8% were uninsured, and 68.1% lived in a rural area. At baseline, 83.2% met diagnostic criteria for major depressive disorder, and the mean HSCL score was 1.9, indicating moderately severe depression. The mean number of chronic physical health disorders was 4.6 (SD=2.6), and psychiatric comorbidity was common. Mean physical and mental health composite scale scores were nearly two standard deviations below those for the general population. Nearly half (48.4%) were already receiving depression treatment at enrollment, indicating treatment resistance.

 
Anchor for Jump
TABLE 1.Baseline Sociodemographic and Clinical Characteristics of Participants in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Carea
Table Footer Note

a There were no significant differences between groups, except as otherwise noted. Some numbers do not add up to total number of patients because of missing data, and some percentages do not add up to 100 because of rounding.

Table Footer Note

b Numbers in parentheses indicate the possible range.

Table Footer Note

c Percentages do not add up to 100 because some patients had more than one type of insurance.

Table Footer Note

d Significant difference between groups, p=0.01.

Table Footer Note

e Significant difference between groups, p=0.05.

+

Care Manager Fidelity

Table 2 describes care manager fidelity. At the 6- and 12-month follow-ups, significantly more patients in the telemedicine-based group than in the practice-based group reported that a health care professional other than their primary care provider 1) gave them helpful information about depression or depression treatment (odds ratios, 2.77 at 6 months and 2.32 at 12 months); 2) made helpful suggestions about things they could do to help depression, such as exercise or becoming more socially active (odds ratios, 3.47 at 6 months and 2.50 at 12 months); 3) asked them about their depression symptoms (odds ratios, 3.60 at 6 months and 2.63 at 12 months); and 4) asked them if they were taking antidepressant medications as prescribed or attending scheduled counseling sessions (odds ratios, 4.70 at 6 months and 3.96 at 12 months). More patients in the telemedicine-based group also reported that their primary care provider worked collaboratively with a mental health specialist (odds ratios, 4.63 at 6 months and 9.05 at 12 months).

 
Anchor for Jump
TABLE 2.Group Differences in Fidelity to the Care Manager Protocol in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Based on the question “How often did a health care professional other than your primary care physician give you helpful information about depression or depression treatment?”

Table Footer Note

b Based on the question “How often did a health care professional other than your primary care physician make helpful suggestions about things you can do to help depression, such as exercise or becoming more active socially?”

Table Footer Note

c Based on the question “How often did a health care professional other than your primary care physician ask you about your depression symptoms?”

Table Footer Note

d Based on the question “How often did a health care professional other than your primary care physician ask you whether you were taking antidepressant medications as prescribed or attending scheduled counseling sessions?”

Table Footer Note

e Based on the question “How often did your primary care physician work together with a mental health specialist to care for your depression symptoms?”

Table Footer Note

f Model did not include a random effect to control for intraclass correlation coefficient because when included, the variance-covariance matrix was not positive definite, indicating not enough variation in the dependent variable attributable to variation in the random effect.

Table Footer Note

g Antidepressant analysis conducted on subsample of 187 patients. Counseling analysis conducted on subsample of 42 patients.

Compared with patients in the practice-based group, those in the telemedicine-based group had significantly more depression care manager encounters in which Patient Health Questionnaire depression severity scores were documented in the medical record during both the first 6 months and the second 6 months (incidence rate ratios, 4.10 and 4.64, respectively). Patients in the telemedicine-based group also had significantly more depression care manager encounters in which self-management goals were documented during the first 6 months (incidence rate ratio=5.62). Among patients who received a prescription for an antidepressant, those in the telemedicine-based group had significantly more depression care manager encounters in which medication adherence was documented during both the first 6 months and the second 6 months (incidence rate ratios, 2.69 and 2.49, respectively). Likewise, patients in the telemedicine-based group who received a prescription for an antidepressant had significantly more depression care manager encounters in which the presence or absence of side effects was documented during both the first 6 months and the second 6 months (incidence rate ratios, 4.22 and 4.46, respectively). Among patients who were referred to counseling, there were no significant group differences in the number of depression care manager encounters in which session attendance was documented in the medical record.

+

Stepped Care Fidelity

Among patients in the telemedicine-based group who failed to respond to at least one medication trial (N=73), 8.2% (N=6) had a telephone encounter with the pharmacist. Among those who had failed to respond to two trials (N=29), 48.3% (N=14) had a telepsychiatry consultation. Another seven patients had an ad hoc telepsychiatry consultation. Also, 16.6% of patients (N=30) attended at least one telepsychotherapy session, and 7.8% (N=14) completed eight or more sessions.

+

Treatment Process Outcomes

Table 3 summarizes the treatment provided to the two groups. There were no significant group differences at baseline, and no significant group-by-time interactions for number of primary care visits or number of depression-related primary care visits, or mental health visits. With respect to antidepressant treatment, there were no significant group main effects for receiving an antidepressant prescription, number of prescribed antidepressants, dosage level (starting, usual, high), or adherence.

 
Anchor for Jump
TABLE 3.Group Differences in Services Utilization and Antidepressant Treatment in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Number of primary care visits during which depression symptoms were discussed.

Table Footer Note

b Any visit to a mental health specialist, either face-to-face with a provider in the community or via videoconferencing with a study telepsychologist or telepsychiatrist.

Table Footer Note

c Adherence coded as 1 if taking antidepressant ≥80% of days in past month, and 0 otherwise.

Table Footer Note

d Analysis conducted on the subsample of patients with an active antidepressant prescription and not reporting antidepressant discontinuation as a result of primary care physician instruction; at the 6-month follow-up, N=187; at the 12-month follow-up, N=166; and at the 18-month follow-up, N=150.

Table Footer Note

e Analysis conducted on the subsample of patients with an active antidepressant prescription with nonmissing dosages; at 6-month follow-up, N=190; at 12-month follow-up, N=171; and at 18-month follow-up, N=148.

+

Clinical Outcomes

Clinical outcomes are presented in Table 4. A significant group main effect was observed for both response (odds ratio=7.74) and remission (odds ratio=12.69), with patients in the telemedicine-based group having better outcomes. We also observed a significant overall group-by-time interaction effect for HSCL score (χ2=40.51, df=3, p<0.001), with greater reductions in severity for patients in the telemedicine-based group (Figure 1). There was also a significant overall group-by-time interaction effect for mental health composite scale score (χ2=11.46, df=3, p=0.01) and Quality of Well-Being score (χ2=6.55, df=3, p=0.09), with greater improvements among patients in the telemedicine-based group. There were no significant overall group-by-time interaction effects for physical health composite scale score, although this finding is likely an artifact resulting from the orthogonal factor rotation and negative weights used to score the physical and mental health composite scales (55). There were no group differences in satisfaction at baseline, but the omnibus test of the group-by-time interactions was significant at the 0.10 level (χ2=6.69, df=3, p=0.08), with the telemedicine-based group having higher satisfaction.

 
Anchor for Jump
TABLE 4.Group Differences in Clinical Outcomes in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Satisfaction coded 1 if patient reported very satisfied or satisfied and 0 if patient reported very dissatisfied, dissatisfied, or neither satisfied or dissatisfied.

Table Footer Note

b Response coded 1 if patient experienced a reduction of ≥50% in depression severity according to the Hopkins Symptom Checklist, and 0 otherwise.

Table Footer Note

c Remission coded 1 if patient reported a Hopkins Symptom Checklist score <0.5, and 0 otherwise.

 
Anchor for JumpAnchor for Jump
FIGURE 1.Adjusted Depression Severity Scores for Patients Receiving Practice-Based or Telemedicine-Based Collaborative Carea

a The graph shows least square means of scores on the Hopkins Symptom Checklist. Least square means, or marginal means, are the estimated group means controlling for the covariates, which are held constant at their mean values. Error bars indicate 95% confidence intervals.

Study participants were recruited from small, remote primary care clinics associated with the largest publicly funded health care system in the country. The sample was predominantly rural, unemployed, and uninsured. Patients had numerous comorbidities, and their depression was treatment resistant. The high degree of treatment resistance likely contributed to the low response and remission rates among those assigned to the practice-based collaborative care group. Compared with patients assigned to the practice-based collaborative care group, those in the telemedicine-based group had significantly and substantially greater treatment response rates, remission rates, reductions in depression severity, and increases in mental health status and quality of life. Improved outcomes were achieved in the telemedicine-based group without increasing the number of primary care visits. Improved outcomes appear to be due to higher fidelity to the care manager protocol in the telemedicine-based collaborative care model, despite the fact that off-site and on-site depression care managers had similar levels of clinical experience at baseline and underwent identical training. The higher fidelity to the care manager protocol in the telemedicine-based model may have been due to the fact that the off-site depression care manager practiced under more intensive clinical supervision and dedicated 100% of her time to depression care manager activities.

The greater fidelity to the care manager protocol did not translate into improvements in the quality of pharmacotherapy for the telemedicine-based group. The majority of patients in both groups initiated antidepressant treatment at therapeutic dosages, and adherence was high. Likewise, the psychotherapy available to patients in the telemedicine-based group via videoconferencing was not highly utilized and was not likely to have contributed substantially to improved outcomes. Our findings were essentially unchanged when patients who received telepsychotherapy were excluded from the analytical sample. Because group differences in outcomes are not likely to be attributable to either pharmacotherapy or psychotherapy, we hypothesize that patients assigned to telemedicine-based collaborative care were more likely to engage in self-management activities, such as physical, rewarding, and social activities. This hypothesis is based on the finding that patients in the telemedicine-based group received more encouragement from the depression care manager to engage in self-management activities. Previous research has demonstrated that behavioral activation is a clinically effective stand-alone treatment for depression (56, 57). Also, patients in the practice-based collaborative care intervention in Project Impact (58) were found to have significantly better treatment response rates if the depression care manager documented in the medical record that the patient scheduled physical, rewarding, and social activities. This hypothesis needs to be tested using an experimental dismantling study specifically designed to estimate the incremental treatment effect of scheduling self-management activities. Another possibility is that the more frequent depression care manager encounters provided to the telemedicine-based group resulted in greater social support, which in turn reduced depressive symptoms. This was the conclusion of Hunkeler et al. (59), who similarly reported that a depression care manager program at Kaiser Permanente did not improve antidepressant management, but did reduce depression symptoms.

An inherent limitation of this pragmatic trial is that the results are not conclusive with respect to identifying treatment mechanisms. Explanatory trial designs are needed to determine why patients assigned to receive telemedicine-based collaborative care had better outcomes than those assigned to receive practice-based collaborative care. However, for policy makers at HRSA and federally qualified health centers lacking on-site mental health personnel, these results clearly indicate that contracting with an off-site depression care team yields better depression outcomes than implementing collaborative care with staff available on-site. Future research should also examine whether having on-site nurse care managers supported by off-site psychiatrists, psychologists, and pharmacists via telephone and videoconferencing is an effective organizational approach to delivering collaborative care.

The authors gratefully acknowledge the patients and staff at the Boston Mountain Rural Health Center, Community Clinic NWA, Corning Area Healthcare, East Arkansas Family Health Center, and Jefferson Comprehensive Care Systems, as well as staff at the Community Health Centers of Arkansas. They also acknowledge the important contributions of project staff, including Amanda Davis, Loretta Ducker, Debbie Hodges, Choi Lai, Liya Lu, Michael McCarther, Camille Mack, Jennifer Stephens, and Vera Tate, as well as the contributions of the anonymous manuscript reviewers.

Katon  W;  Von Korff  M;  Lin  E;  Simon  G;  Walker  E;  Unützer  J;  Bush  T;  Russo  J;  Ludman  E:  Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial.  Arch Gen Psychiatry 1999; 56:1109–1115
[CrossRef] | [PubMed]
 
Katon  W;  Robinson  P;  Von Korff  M;  Lin  E;  Bush  T;  Ludman  E;  Simon  G;  Walker  E:  A multifaceted intervention to improve treatment of depression in primary care.  Arch Gen Psychiatry 1996; 53:924–932
[CrossRef] | [PubMed]
 
Rost  K;  Nutting  P;  Smith  J;  Werner  J;  Duan  N:  Improving depression outcomes in community primary care practice: a randomized trial of the quEST intervention.  J Gen Intern Med 2001; 16:143–149
[CrossRef] | [PubMed]
 
Wells  KB;  Sherbourne  C;  Schoenbaum  M;  Duan  N;  Meredith  L;  Unützer  J;  Miranda  J;  Carney  MF;  Rubenstein  LV:  Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial.  JAMA 2000; 283:212–220
[CrossRef] | [PubMed]
 
Unützer  J;  Katon  W;  Callahan  CM;  Williams  JW  Jr;  Hunkeler  E;  Harpole  L;  Hoffing  M;  Della Penna  RD;  Noël  PH;  Lin  EH;  Areán  PA;  Hegel  MT;  Tang  L;  Belin  TR;  Oishi  S;  Langston  C;  IMPACT Investigators (Improving Mood-Promoting Access to Collaborative Treatment):  Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial.  JAMA 2002; 288:2836–2845
[CrossRef] | [PubMed]
 
Alexopoulos  GS;  Katz  IR;  Bruce  ML;  Heo  M;  Ten Have  T;  Raue  P;  Bogner  HR;  Schulberg  HC;  Mulsant  BH;  Reynolds  CF  3rd;  PROSPECT Group:  Remission in depressed geriatric primary care patients: a report from the PROSPECT study.  Am J Psychiatry 2005; 162:718–724
[CrossRef] | [PubMed]
 
Bruce  ML;  Ten Have  TR;  Reynolds  CF  3rd;  Katz  II;  Schulberg  HC;  Mulsant  BH;  Brown  GK;  McAvay  GJ;  Pearson  JL;  Alexopoulos  GS:  Reducing suicidal ideation and depressive symptoms in depressed older primary care patients: a randomized controlled trial.  JAMA 2004; 291:1081–1091
[CrossRef] | [PubMed]
 
Williams  JW  Jr;  Rost  K;  Dietrich  AJ;  Ciotti  MC;  Zyzanski  SJ;  Cornell  J:  Primary care physicians’ approach to depressive disorders: effects of physician specialty and practice structure.  Arch Fam Med 1999; 8:58–67
[CrossRef] | [PubMed]
 
Gensichen  J;  von Korff  M;  Peitz  M;  Muth  C;  Beyer  M;  Güthlin  C;  Torge  M;  Petersen  JJ;  Rosemann  T;  König  J;  Gerlach  FM;  PRoMPT (Primary Care Monitoring for Depressive Patients Trial):  Case management for depression by health care assistants in small primary care practices: a cluster randomized trial.  Ann Intern Med 2009; 151:369–378
[PubMed]
 
Gilbody  S;  Whitty  P;  Grimshaw  J;  Thomas  R:  Educational and organizational interventions to improve the management of depression in primary care: a systematic review.  JAMA 2003; 289:3145–3151
[CrossRef] | [PubMed]
 
Fortney  JC;  Pyne  JM;  Edlund  MJ;  Williams  DK;  Robinson  DE;  Mittal  D;  Henderson  KL:  A randomized trial of telemedicine-based collaborative care for depression.  J Gen Intern Med 2007; 22:1086–1093
[CrossRef] | [PubMed]
 
Pyne  JM;  Fortney  JC;  Tripathi  SP;  Maciejewski  ML;  Edlund  MJ;  Williams  DK:  Cost-effectiveness analysis of a rural telemedicine collaborative care intervention for depression.  Arch Gen Psychiatry 2010; 67:812–821
[CrossRef] | [PubMed]
 
Fortney  J;  Enderle  M;  McDougall  S;  Clothier  J;  Otero  J;  Altman  L;  Curran  G:  Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics.  Implement Sci 2012; 7:30
[CrossRef] | [PubMed]
 
Rohland  BM;  Saleh  SS;  Rohrer  JE;  Romitti  PA:  Acceptability of telepsychiatry to a rural population.  Psychiatr Serv 2000; 51:672–674
[CrossRef] | [PubMed]
 
Callahan  EJ;  Hilty  DM;  Nesbitt  TS:  Patient satisfaction with telemedicine consultation in primary care: comparison of ratings of medical and mental health applications.  Telemed J 1998; 4:363–369
[CrossRef] | [PubMed]
 
Germain  V;  Marchand  A;  Bouchard  S;  Guay  S;  Drouin  MS:  Assessment of therapeutic alliance in face-to-face or videoconference treatment for posttraumatic stress disorder.  Cyberpsychol Behav Soc Netw 2010; 13:29–35
[CrossRef] | [PubMed]
 
Simpson  S:  The provision of a telepsychology service to Shetland: client and therapist satisfaction and the ability to develop a therapeutic alliance.  J Telemed Telecare 2001; 7(suppl 1):34–36
[CrossRef] | [PubMed]
 
Ruskin  PE;  Silver-Aylaian  M;  Kling  MA;  Reed  SA;  Bradham  DD;  Hebel  JR;  Barrett  D;  Knowles  F  3rd;  Hauser  P:  Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in-person treatment.  Am J Psychiatry 2004; 161:1471–1476
[CrossRef] | [PubMed]
 
Ruskin  PE;  Reed  S;  Kumar  R;  Kling  MA;  Siegel  E;  Rosen  M;  Hauser  P:  Reliability and acceptability of psychiatric diagnosis via telecommunication and audiovisual technology.  Psychiatr Serv 1998; 49:1086–1088
[PubMed]
 
O’Reilly  R;  Bishop  J;  Maddox  K;  Hutchinson  L;  Fisman  M;  Takhar  J:  Is telepsychiatry equivalent to face-to-face psychiatry? Results from a randomized controlled equivalence trial.  Psychiatr Serv 2007; 58:836–843
[CrossRef] | [PubMed]
 
Hailey  D;  Roine  R;  Ohinmaa  A:  The effectiveness of telemental health applications: a review.  Can J Psychiatry 2008; 53:769–778
[PubMed]
 
Nelson  EL;  Barnard  M;  Cain  S:  Treating childhood depression over videoconferencing.  Telemed J E Health 2003; 9:49–55
[CrossRef] | [PubMed]
 
Bouchard  S;  Paquin  B;  Payeur  R;  Allard  M;  Rivard  V;  Fournier  T;  Renaud  P;  Lapierre  J:  Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference.  Telemed J E Health 2004; 10:13–25
[CrossRef] | [PubMed]
 
Frueh  BC;  Monnier  J;  Yim  E;  Grubaugh  AL;  Hamner  MB;  Knapp  RG:  A randomized trial of telepsychiatry for post-traumatic stress disorder.  J Telemed Telecare 2007; 13:142–147
[CrossRef] | [PubMed]
 
Germain  V;  Marchand  A;  Bouchard  S;  Drouin  MS;  Guay  S:  Effectiveness of cognitive behavioural therapy administered by videoconference for posttraumatic stress disorder.  Cogn Behav Ther 2009; 38:42–53
[CrossRef] | [PubMed]
 
Morland  LA;  Greene  CJ;  Rosen  CS;  Foy  D;  Reilly  P;  Shore  J;  He  Q;  Frueh  BC:  Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial.  J Clin Psychiatry 2010; 71:855–863
[CrossRef] | [PubMed]
 
Thorpe  KE;  Zwarenstein  M;  Oxman  AD;  Treweek  S;  Furberg  CD;  Altman  DG;  Tunis  S;  Bergel  E;  Harvey  I;  Magid  DJ;  Chalkidou  K:  A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers.  J Clin Epidemiol 2009; 62:464–475
[CrossRef] | [PubMed]
 
Institute of Medicine:  Initial National Priorities for Comparative Effectiveness Research .  Washington, DC,  National Academies Press, 2009
 
Tunis  SR;  Stryer  DB;  Clancy  CM:  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy.  JAMA 2003; 290:1624–1632
[CrossRef] | [PubMed]
 
Druss  BG;  Bornemann  T;  Fry-Johnson  YW;  McCombs  HG;  Politzer  RM;  Rust  G:  Trends in mental health and substance abuse services at the nation’s community health centers: 1998–2003.  Am J Public Health 2006; 96:1779–1784
[CrossRef] | [PubMed]
 
National Association of Community Health Centers: US Health Center Fact Sheet: 2006. Bethesda, Md, National Association of Community Health Centers, 2007 (www.nachc.com/client/documents/US_Fact_Sheet_2007.pdf)
 
Landon  BE;  Hicks  LS;  O’Malley  AJ;  Lieu  TA;  Keegan  T;  McNeil  BJ;  Guadagnoli  E:  Improving the management of chronic disease at community health centers.  N Engl J Med 2007; 356:921–934
[CrossRef] | [PubMed]
 
Meredith  LS;  Mendel  P;  Pearson  M;  Wu  SY;  Joyce  G;  Straus  JB;  Ryan  G;  Keeler  E;  Unützer  J:  Implementation and maintenance of quality improvement for treating depression in primary care.  Psychiatr Serv 2006; 57:48–55
[CrossRef] | [PubMed]
 
Fortney  JC;  Pyne  JM;  Steven  CA;  Williams  JS;  Hedrick  RG;  Lunsford  AK;  Raney  WN;  Ackerman  BA;  Ducker  LO;  Bonner  LM;  Smith  JL:  A web-based clinical decision support system for depression care management.  Am J Manag Care 2010; 16:849–854
[PubMed]
 
Smith GR Jr, Burnam A, Burns BJ, Cleary P, Rost KM: Depression Outcomes Module (DOM), in Handbook of Psychiatric Measures. Edited by American Psychiatric Association. Washington, DC, American Psychiatric Association, 2000, pp 213–215
 
Kramer  TL;  Smith  GR;  D’Arezzo  KW;  Card-Higginson  P:  Depression Outcomes Module .  Little Rock, Ark,  The Guide to Behavioral Health Outcomes Management Systems, 2000, pp 71–83
 
Lecrubier  Y;  Sheehan  DV;  Weiller  E;  Amorim  P;  Bonora  I;  Sheehan  KH;  Janavs  J;  Dunbar  GC:  The Mini International Neuropsychiatric Interview (MINI), a short diagnostic structured interview: reliability and validity according to the CIDI.  Eur Psychiatry 1997; 12:224–231
[CrossRef]
 
Sheehan  DV;  Lecrubier  Y;  Sheehan  KH;  Janavs  J;  Weiller  E;  Keskiner  A;  Schinka  J;  Knapp  E;  Sheehan  MF;  Dunbar  GC:  The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability.  Eur Psychiatry 1997; 12:232–241
[CrossRef]
 
Parkerson  GR  Jr;  Michener  JL;  Wu  LR;  Finch  JN;  Muhlbaier  LH;  Magruder-Habib  K;  Kertesz  JW;  Clapp-Channing  N;  Morrow  DS;  Chen  AL;  Jokerst  E:  Associations among family support, family stress, and personal functional health status.  J Clin Epidemiol 1989; 42:217–229
[CrossRef] | [PubMed]
 
Parkerson  GR  Jr;  Broadhead  WE;  Tse  CK:  Quality of life and functional health of primary care patients.  J Clin Epidemiol 1992; 45:1303–1313
[CrossRef] | [PubMed]
 
Edlund  MJ;  Fortney  JC;  Reaves  CM;  Pyne  JM;  Mittal  D:  Beliefs about depression and depression treatment among depressed veterans.  Med Care 2008; 46:581–589
[CrossRef] | [PubMed]
 
Simon  GE;  Lin  EHB;  Katon  W;  Saunders  K;  VonKorff  M;  Walker  E;  Bush  T;  Robinson  P:  Outcomes of “inadequate” antidepressant treatment.  J Gen Intern Med 1995; 10:663–670
[CrossRef] | [PubMed]
 
Derogatis  LR;  Lipman  RS;  Rickels  K;  Uhlenhuth  EH;  Covi  L:  The Hopkins Symptom Checklist (HSCL): a measure of primary symptom dimensions.  Mod Probl Pharmacopsychiatry 1974; 7:79–110
[PubMed]
 
Derogatis  LR;  Lipman  RS;  Rickels  K;  Uhlenhuth  EH;  Covi  L:  The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory.  Behav Sci 1974; 19:1–15
[CrossRef] | [PubMed]
 
Jones  D;  Kazis  L;  Lee  A;  Rogers  W;  Skinner  K;  Cassar  L;  Wilson  N;  Hendricks  A:  Health status assessments using the Veterans SF-12 and SF-36: methods for evaluating otucomes in the Veterans Health Administration.  J Ambul Care Manage 2001; 24:68–86
[PubMed]
 
Kazis  LE;  Miller  DR;  Clark  J;  Skinner  K;  Lee  A;  Rogers  W;  Spiro  A  3rd;  Payne  S;  Fincke  G;  Selim  A;  Linzer  M:  Health-related quality of life in patients served by the Department of Veterans Affairs: results from the Veterans Health Study.  Arch Intern Med 1998; 158:626–632
[CrossRef] | [PubMed]
 
Kaplan  RM;  Anderson  JP:  The general health policy model: an integrated approach, in  Quality of Life and Pharmacoeconomics in Clinical Trials , 2nd ed. Edited by Spiker  B.  Philadelphia,  Lippincott-Raven, 1996, pp 309–321
 
Kaplan  RM;  Bush  JW:  Health-related quality of life measurement for evaluation research and policy analysis.  Health Psychol 1982; 1:61–80
[CrossRef]
 
Pyne  JM;  Patterson  TL;  Kaplan  RM;  Gillin  JC;  Koch  WL;  Grant  I:  Assessment of the quality of life of patients with major depression.  Psychiatr Serv 1997; 48:224–230
[PubMed]
 
Pyne  JM;  Patterson  TL;  Kaplan  RM;  Ho  S;  Gillin  JC;  Golshan  S;  Grant  I:  Preliminary longitudinal assessment of quality of life in patients with major depression.  Psychopharmacol Bull 1997; 33:23–29
[PubMed]
 
Beebe  TJ;  Harrison  PA;  McRae  JA  Jr;  Asche  SE:  Evaluating behavioral health services in Minnesota’s Medicaid population using the Experience of Care and Health Outcomes (ECHO) Survey.  J Health Care Poor Underserved 2003; 14:608–621
[CrossRef] | [PubMed]
 
Little  RC;  Milliken  GA;  Stroup  WW;  Wolfinger  RD:  SAS System for Mixed Models .  Cary, NC,  SAS Institute Inc., 1996
 
Bursac  Z;  Gauss  CH;  Williams  DK;  Hosmer  DW:  Purposeful selection of variables in logistic regression.  Source Code Biol Med 2008; 3:17
[CrossRef] | [PubMed]
 
Hogan  JW;  Laird  NM:  Intention-to-treat analyses for incomplete repeated measures data.  Biometrics 1996; 52:1002–1017
[CrossRef] | [PubMed]
 
Simon  GE;  Revicki  DA;  Grothaus  L;  Vonkorff  M:  SF-36 summary scores: are physical and mental health truly distinct? Med Care 1998; 36:567–572
[CrossRef] | [PubMed]
 
Spates  CR;  Pagoto  S;  Kalata  A:  A qualitative and quantitative review of behavioral activation treatment of major depressive disorder.  Behav Analyst Today 2006; 74:508–518
 
Dimidjian  S;  Hollon  SD;  Dobson  KS;  Schmaling  KB;  Kohlenberg  RJ;  Addis  ME;  Gallop  R;  McGlinchey  JB;  Markley  DK;  Gollan  JK;  Atkins  DC;  Dunner  DL;  Jacobson  NS:  Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression.  J Consult Clin Psychol 2006; 74:658–670
[CrossRef] | [PubMed]
 
Riebe  G;  Fan  MY;  Unützer  J;  Vannoy  S:  Activity scheduling as a core component of effective care management for late-life depression.  Int J Geriatr Psychiatry 2012; 27:1298–1304
[CrossRef] | [PubMed]
 
Hunkeler  EM;  Meresman  JF;  Hargreaves  WA;  Fireman  B;  Berman  WH;  Kirsch  AJ;  Groebe  J;  Hurt  SW;  Braden  P;  Getzell  M;  Feigenbaum  PA;  Peng  T;  Salzer  M:  Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care.  Arch Fam Med 2000; 9:700–708
[CrossRef] | [PubMed]
 
References Container

FIGURE 1. Adjusted Depression Severity Scores for Patients Receiving Practice-Based or Telemedicine-Based Collaborative Carea

a The graph shows least square means of scores on the Hopkins Symptom Checklist. Least square means, or marginal means, are the estimated group means controlling for the covariates, which are held constant at their mean values. Error bars indicate 95% confidence intervals.

Anchor for Jump
TABLE 1.Baseline Sociodemographic and Clinical Characteristics of Participants in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Carea
Table Footer Note

a There were no significant differences between groups, except as otherwise noted. Some numbers do not add up to total number of patients because of missing data, and some percentages do not add up to 100 because of rounding.

Table Footer Note

b Numbers in parentheses indicate the possible range.

Table Footer Note

c Percentages do not add up to 100 because some patients had more than one type of insurance.

Table Footer Note

d Significant difference between groups, p=0.01.

Table Footer Note

e Significant difference between groups, p=0.05.

Anchor for Jump
TABLE 2.Group Differences in Fidelity to the Care Manager Protocol in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Based on the question “How often did a health care professional other than your primary care physician give you helpful information about depression or depression treatment?”

Table Footer Note

b Based on the question “How often did a health care professional other than your primary care physician make helpful suggestions about things you can do to help depression, such as exercise or becoming more active socially?”

Table Footer Note

c Based on the question “How often did a health care professional other than your primary care physician ask you about your depression symptoms?”

Table Footer Note

d Based on the question “How often did a health care professional other than your primary care physician ask you whether you were taking antidepressant medications as prescribed or attending scheduled counseling sessions?”

Table Footer Note

e Based on the question “How often did your primary care physician work together with a mental health specialist to care for your depression symptoms?”

Table Footer Note

f Model did not include a random effect to control for intraclass correlation coefficient because when included, the variance-covariance matrix was not positive definite, indicating not enough variation in the dependent variable attributable to variation in the random effect.

Table Footer Note

g Antidepressant analysis conducted on subsample of 187 patients. Counseling analysis conducted on subsample of 42 patients.

Anchor for Jump
TABLE 3.Group Differences in Services Utilization and Antidepressant Treatment in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Number of primary care visits during which depression symptoms were discussed.

Table Footer Note

b Any visit to a mental health specialist, either face-to-face with a provider in the community or via videoconferencing with a study telepsychologist or telepsychiatrist.

Table Footer Note

c Adherence coded as 1 if taking antidepressant ≥80% of days in past month, and 0 otherwise.

Table Footer Note

d Analysis conducted on the subsample of patients with an active antidepressant prescription and not reporting antidepressant discontinuation as a result of primary care physician instruction; at the 6-month follow-up, N=187; at the 12-month follow-up, N=166; and at the 18-month follow-up, N=150.

Table Footer Note

e Analysis conducted on the subsample of patients with an active antidepressant prescription with nonmissing dosages; at 6-month follow-up, N=190; at 12-month follow-up, N=171; and at 18-month follow-up, N=148.

Anchor for Jump
TABLE 4.Group Differences in Clinical Outcomes in a Randomized Study of Practice-Based or Telemedicine-Based Collaborative Care
Table Footer Note

a Satisfaction coded 1 if patient reported very satisfied or satisfied and 0 if patient reported very dissatisfied, dissatisfied, or neither satisfied or dissatisfied.

Table Footer Note

b Response coded 1 if patient experienced a reduction of ≥50% in depression severity according to the Hopkins Symptom Checklist, and 0 otherwise.

Table Footer Note

c Remission coded 1 if patient reported a Hopkins Symptom Checklist score <0.5, and 0 otherwise.

+

References

Katon  W;  Von Korff  M;  Lin  E;  Simon  G;  Walker  E;  Unützer  J;  Bush  T;  Russo  J;  Ludman  E:  Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial.  Arch Gen Psychiatry 1999; 56:1109–1115
[CrossRef] | [PubMed]
 
Katon  W;  Robinson  P;  Von Korff  M;  Lin  E;  Bush  T;  Ludman  E;  Simon  G;  Walker  E:  A multifaceted intervention to improve treatment of depression in primary care.  Arch Gen Psychiatry 1996; 53:924–932
[CrossRef] | [PubMed]
 
Rost  K;  Nutting  P;  Smith  J;  Werner  J;  Duan  N:  Improving depression outcomes in community primary care practice: a randomized trial of the quEST intervention.  J Gen Intern Med 2001; 16:143–149
[CrossRef] | [PubMed]
 
Wells  KB;  Sherbourne  C;  Schoenbaum  M;  Duan  N;  Meredith  L;  Unützer  J;  Miranda  J;  Carney  MF;  Rubenstein  LV:  Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial.  JAMA 2000; 283:212–220
[CrossRef] | [PubMed]
 
Unützer  J;  Katon  W;  Callahan  CM;  Williams  JW  Jr;  Hunkeler  E;  Harpole  L;  Hoffing  M;  Della Penna  RD;  Noël  PH;  Lin  EH;  Areán  PA;  Hegel  MT;  Tang  L;  Belin  TR;  Oishi  S;  Langston  C;  IMPACT Investigators (Improving Mood-Promoting Access to Collaborative Treatment):  Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial.  JAMA 2002; 288:2836–2845
[CrossRef] | [PubMed]
 
Alexopoulos  GS;  Katz  IR;  Bruce  ML;  Heo  M;  Ten Have  T;  Raue  P;  Bogner  HR;  Schulberg  HC;  Mulsant  BH;  Reynolds  CF  3rd;  PROSPECT Group:  Remission in depressed geriatric primary care patients: a report from the PROSPECT study.  Am J Psychiatry 2005; 162:718–724
[CrossRef] | [PubMed]
 
Bruce  ML;  Ten Have  TR;  Reynolds  CF  3rd;  Katz  II;  Schulberg  HC;  Mulsant  BH;  Brown  GK;  McAvay  GJ;  Pearson  JL;  Alexopoulos  GS:  Reducing suicidal ideation and depressive symptoms in depressed older primary care patients: a randomized controlled trial.  JAMA 2004; 291:1081–1091
[CrossRef] | [PubMed]
 
Williams  JW  Jr;  Rost  K;  Dietrich  AJ;  Ciotti  MC;  Zyzanski  SJ;  Cornell  J:  Primary care physicians’ approach to depressive disorders: effects of physician specialty and practice structure.  Arch Fam Med 1999; 8:58–67
[CrossRef] | [PubMed]
 
Gensichen  J;  von Korff  M;  Peitz  M;  Muth  C;  Beyer  M;  Güthlin  C;  Torge  M;  Petersen  JJ;  Rosemann  T;  König  J;  Gerlach  FM;  PRoMPT (Primary Care Monitoring for Depressive Patients Trial):  Case management for depression by health care assistants in small primary care practices: a cluster randomized trial.  Ann Intern Med 2009; 151:369–378
[PubMed]
 
Gilbody  S;  Whitty  P;  Grimshaw  J;  Thomas  R:  Educational and organizational interventions to improve the management of depression in primary care: a systematic review.  JAMA 2003; 289:3145–3151
[CrossRef] | [PubMed]
 
Fortney  JC;  Pyne  JM;  Edlund  MJ;  Williams  DK;  Robinson  DE;  Mittal  D;  Henderson  KL:  A randomized trial of telemedicine-based collaborative care for depression.  J Gen Intern Med 2007; 22:1086–1093
[CrossRef] | [PubMed]
 
Pyne  JM;  Fortney  JC;  Tripathi  SP;  Maciejewski  ML;  Edlund  MJ;  Williams  DK:  Cost-effectiveness analysis of a rural telemedicine collaborative care intervention for depression.  Arch Gen Psychiatry 2010; 67:812–821
[CrossRef] | [PubMed]
 
Fortney  J;  Enderle  M;  McDougall  S;  Clothier  J;  Otero  J;  Altman  L;  Curran  G:  Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics.  Implement Sci 2012; 7:30
[CrossRef] | [PubMed]
 
Rohland  BM;  Saleh  SS;  Rohrer  JE;  Romitti  PA:  Acceptability of telepsychiatry to a rural population.  Psychiatr Serv 2000; 51:672–674
[CrossRef] | [PubMed]
 
Callahan  EJ;  Hilty  DM;  Nesbitt  TS:  Patient satisfaction with telemedicine consultation in primary care: comparison of ratings of medical and mental health applications.  Telemed J 1998; 4:363–369
[CrossRef] | [PubMed]
 
Germain  V;  Marchand  A;  Bouchard  S;  Guay  S;  Drouin  MS:  Assessment of therapeutic alliance in face-to-face or videoconference treatment for posttraumatic stress disorder.  Cyberpsychol Behav Soc Netw 2010; 13:29–35
[CrossRef] | [PubMed]
 
Simpson  S:  The provision of a telepsychology service to Shetland: client and therapist satisfaction and the ability to develop a therapeutic alliance.  J Telemed Telecare 2001; 7(suppl 1):34–36
[CrossRef] | [PubMed]
 
Ruskin  PE;  Silver-Aylaian  M;  Kling  MA;  Reed  SA;  Bradham  DD;  Hebel  JR;  Barrett  D;  Knowles  F  3rd;  Hauser  P:  Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in-person treatment.  Am J Psychiatry 2004; 161:1471–1476
[CrossRef] | [PubMed]
 
Ruskin  PE;  Reed  S;  Kumar  R;  Kling  MA;  Siegel  E;  Rosen  M;  Hauser  P:  Reliability and acceptability of psychiatric diagnosis via telecommunication and audiovisual technology.  Psychiatr Serv 1998; 49:1086–1088
[PubMed]
 
O’Reilly  R;  Bishop  J;  Maddox  K;  Hutchinson  L;  Fisman  M;  Takhar  J:  Is telepsychiatry equivalent to face-to-face psychiatry? Results from a randomized controlled equivalence trial.  Psychiatr Serv 2007; 58:836–843
[CrossRef] | [PubMed]
 
Hailey  D;  Roine  R;  Ohinmaa  A:  The effectiveness of telemental health applications: a review.  Can J Psychiatry 2008; 53:769–778
[PubMed]
 
Nelson  EL;  Barnard  M;  Cain  S:  Treating childhood depression over videoconferencing.  Telemed J E Health 2003; 9:49–55
[CrossRef] | [PubMed]
 
Bouchard  S;  Paquin  B;  Payeur  R;  Allard  M;  Rivard  V;  Fournier  T;  Renaud  P;  Lapierre  J:  Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference.  Telemed J E Health 2004; 10:13–25
[CrossRef] | [PubMed]
 
Frueh  BC;  Monnier  J;  Yim  E;  Grubaugh  AL;  Hamner  MB;  Knapp  RG:  A randomized trial of telepsychiatry for post-traumatic stress disorder.  J Telemed Telecare 2007; 13:142–147
[CrossRef] | [PubMed]
 
Germain  V;  Marchand  A;  Bouchard  S;  Drouin  MS;  Guay  S:  Effectiveness of cognitive behavioural therapy administered by videoconference for posttraumatic stress disorder.  Cogn Behav Ther 2009; 38:42–53
[CrossRef] | [PubMed]
 
Morland  LA;  Greene  CJ;  Rosen  CS;  Foy  D;  Reilly  P;  Shore  J;  He  Q;  Frueh  BC:  Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial.  J Clin Psychiatry 2010; 71:855–863
[CrossRef] | [PubMed]
 
Thorpe  KE;  Zwarenstein  M;  Oxman  AD;  Treweek  S;  Furberg  CD;  Altman  DG;  Tunis  S;  Bergel  E;  Harvey  I;  Magid  DJ;  Chalkidou  K:  A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers.  J Clin Epidemiol 2009; 62:464–475
[CrossRef] | [PubMed]
 
Institute of Medicine:  Initial National Priorities for Comparative Effectiveness Research .  Washington, DC,  National Academies Press, 2009
 
Tunis  SR;  Stryer  DB;  Clancy  CM:  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy.  JAMA 2003; 290:1624–1632
[CrossRef] | [PubMed]
 
Druss  BG;  Bornemann  T;  Fry-Johnson  YW;  McCombs  HG;  Politzer  RM;  Rust  G:  Trends in mental health and substance abuse services at the nation’s community health centers: 1998–2003.  Am J Public Health 2006; 96:1779–1784
[CrossRef] | [PubMed]
 
National Association of Community Health Centers: US Health Center Fact Sheet: 2006. Bethesda, Md, National Association of Community Health Centers, 2007 (www.nachc.com/client/documents/US_Fact_Sheet_2007.pdf)
 
Landon  BE;  Hicks  LS;  O’Malley  AJ;  Lieu  TA;  Keegan  T;  McNeil  BJ;  Guadagnoli  E:  Improving the management of chronic disease at community health centers.  N Engl J Med 2007; 356:921–934
[CrossRef] | [PubMed]
 
Meredith  LS;  Mendel  P;  Pearson  M;  Wu  SY;  Joyce  G;  Straus  JB;  Ryan  G;  Keeler  E;  Unützer  J:  Implementation and maintenance of quality improvement for treating depression in primary care.  Psychiatr Serv 2006; 57:48–55
[CrossRef] | [PubMed]
 
Fortney  JC;  Pyne  JM;  Steven  CA;  Williams  JS;  Hedrick  RG;  Lunsford  AK;  Raney  WN;  Ackerman  BA;  Ducker  LO;  Bonner  LM;  Smith  JL:  A web-based clinical decision support system for depression care management.  Am J Manag Care 2010; 16:849–854
[PubMed]
 
Smith GR Jr, Burnam A, Burns BJ, Cleary P, Rost KM: Depression Outcomes Module (DOM), in Handbook of Psychiatric Measures. Edited by American Psychiatric Association. Washington, DC, American Psychiatric Association, 2000, pp 213–215
 
Kramer  TL;  Smith  GR;  D’Arezzo  KW;  Card-Higginson  P:  Depression Outcomes Module .  Little Rock, Ark,  The Guide to Behavioral Health Outcomes Management Systems, 2000, pp 71–83
 
Lecrubier  Y;  Sheehan  DV;  Weiller  E;  Amorim  P;  Bonora  I;  Sheehan  KH;  Janavs  J;  Dunbar  GC:  The Mini International Neuropsychiatric Interview (MINI), a short diagnostic structured interview: reliability and validity according to the CIDI.  Eur Psychiatry 1997; 12:224–231
[CrossRef]
 
Sheehan  DV;  Lecrubier  Y;  Sheehan  KH;  Janavs  J;  Weiller  E;  Keskiner  A;  Schinka  J;  Knapp  E;  Sheehan  MF;  Dunbar  GC:  The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability.  Eur Psychiatry 1997; 12:232–241
[CrossRef]
 
Parkerson  GR  Jr;  Michener  JL;  Wu  LR;  Finch  JN;  Muhlbaier  LH;  Magruder-Habib  K;  Kertesz  JW;  Clapp-Channing  N;  Morrow  DS;  Chen  AL;  Jokerst  E:  Associations among family support, family stress, and personal functional health status.  J Clin Epidemiol 1989; 42:217–229
[CrossRef] | [PubMed]
 
Parkerson  GR  Jr;  Broadhead  WE;  Tse  CK:  Quality of life and functional health of primary care patients.  J Clin Epidemiol 1992; 45:1303–1313
[CrossRef] | [PubMed]
 
Edlund  MJ;  Fortney  JC;  Reaves  CM;  Pyne  JM;  Mittal  D:  Beliefs about depression and depression treatment among depressed veterans.  Med Care 2008; 46:581–589
[CrossRef] | [PubMed]
 
Simon  GE;  Lin  EHB;  Katon  W;  Saunders  K;  VonKorff  M;  Walker  E;  Bush  T;  Robinson  P:  Outcomes of “inadequate” antidepressant treatment.  J Gen Intern Med 1995; 10:663–670
[CrossRef] | [PubMed]
 
Derogatis  LR;  Lipman  RS;  Rickels  K;  Uhlenhuth  EH;  Covi  L:  The Hopkins Symptom Checklist (HSCL): a measure of primary symptom dimensions.  Mod Probl Pharmacopsychiatry 1974; 7:79–110
[PubMed]
 
Derogatis  LR;  Lipman  RS;  Rickels  K;  Uhlenhuth  EH;  Covi  L:  The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory.  Behav Sci 1974; 19:1–15
[CrossRef] | [PubMed]
 
Jones  D;  Kazis  L;  Lee  A;  Rogers  W;  Skinner  K;  Cassar  L;  Wilson  N;  Hendricks  A:  Health status assessments using the Veterans SF-12 and SF-36: methods for evaluating otucomes in the Veterans Health Administration.  J Ambul Care Manage 2001; 24:68–86
[PubMed]
 
Kazis  LE;  Miller  DR;  Clark  J;  Skinner  K;  Lee  A;  Rogers  W;  Spiro  A  3rd;  Payne  S;  Fincke  G;  Selim  A;  Linzer  M:  Health-related quality of life in patients served by the Department of Veterans Affairs: results from the Veterans Health Study.  Arch Intern Med 1998; 158:626–632
[CrossRef] | [PubMed]
 
Kaplan  RM;  Anderson  JP:  The general health policy model: an integrated approach, in  Quality of Life and Pharmacoeconomics in Clinical Trials , 2nd ed. Edited by Spiker  B.  Philadelphia,  Lippincott-Raven, 1996, pp 309–321
 
Kaplan  RM;  Bush  JW:  Health-related quality of life measurement for evaluation research and policy analysis.  Health Psychol 1982; 1:61–80
[CrossRef]
 
Pyne  JM;  Patterson  TL;  Kaplan  RM;  Gillin  JC;  Koch  WL;  Grant  I:  Assessment of the quality of life of patients with major depression.  Psychiatr Serv 1997; 48:224–230
[PubMed]
 
Pyne  JM;  Patterson  TL;  Kaplan  RM;  Ho  S;  Gillin  JC;  Golshan  S;  Grant  I:  Preliminary longitudinal assessment of quality of life in patients with major depression.  Psychopharmacol Bull 1997; 33:23–29
[PubMed]
 
Beebe  TJ;  Harrison  PA;  McRae  JA  Jr;  Asche  SE:  Evaluating behavioral health services in Minnesota’s Medicaid population using the Experience of Care and Health Outcomes (ECHO) Survey.  J Health Care Poor Underserved 2003; 14:608–621
[CrossRef] | [PubMed]
 
Little  RC;  Milliken  GA;  Stroup  WW;  Wolfinger  RD:  SAS System for Mixed Models .  Cary, NC,  SAS Institute Inc., 1996
 
Bursac  Z;  Gauss  CH;  Williams  DK;  Hosmer  DW:  Purposeful selection of variables in logistic regression.  Source Code Biol Med 2008; 3:17
[CrossRef] | [PubMed]
 
Hogan  JW;  Laird  NM:  Intention-to-treat analyses for incomplete repeated measures data.  Biometrics 1996; 52:1002–1017
[CrossRef] | [PubMed]
 
Simon  GE;  Revicki  DA;  Grothaus  L;  Vonkorff  M:  SF-36 summary scores: are physical and mental health truly distinct? Med Care 1998; 36:567–572
[CrossRef] | [PubMed]
 
Spates  CR;  Pagoto  S;  Kalata  A:  A qualitative and quantitative review of behavioral activation treatment of major depressive disorder.  Behav Analyst Today 2006; 74:508–518
 
Dimidjian  S;  Hollon  SD;  Dobson  KS;  Schmaling  KB;  Kohlenberg  RJ;  Addis  ME;  Gallop  R;  McGlinchey  JB;  Markley  DK;  Gollan  JK;  Atkins  DC;  Dunner  DL;  Jacobson  NS:  Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression.  J Consult Clin Psychol 2006; 74:658–670
[CrossRef] | [PubMed]
 
Riebe  G;  Fan  MY;  Unützer  J;  Vannoy  S:  Activity scheduling as a core component of effective care management for late-life depression.  Int J Geriatr Psychiatry 2012; 27:1298–1304
[CrossRef] | [PubMed]
 
Hunkeler  EM;  Meresman  JF;  Hargreaves  WA;  Fireman  B;  Berman  WH;  Kirsch  AJ;  Groebe  J;  Hurt  SW;  Braden  P;  Getzell  M;  Feigenbaum  PA;  Peng  T;  Salzer  M:  Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care.  Arch Fam Med 2000; 9:700–708
[CrossRef] | [PubMed]
 
References Container
+
+

Self-Assessment Quiz

Did you know? You can add a subscription now to earn CME Credits!

1.
In the telemedicine-based collaborative care arm of the study, which clinical activity or activities were delivered via videoconferencing?
2.
Which care manager activity or activities were documented in the medical record more frequently for patients randomized to telemedicine-based collaborative care compared with patients randomized to practice-based collaborative care?
3.
Patients randomized to telemedicine-based collaborative care experienced a significant reduction in which of these outcome domains compared with patients randomized to practice-based collaborative care?
Submit a Comments
Please read the other comments before you post yours. Contributors must reveal any conflict of interest.
Comments are moderated and will appear on the site at the discertion of APA editorial staff.

* = Required Field
(if multiple authors, separate names by comma)
Example: John Doe