The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/ajp.156.11.1765

Abstract

OBJECTIVE: The changing effectiveness of a treatment program for dual-diagnosis patients was evaluated over a 2-year period with the use of a sequential study group design. METHOD: The treatment outcome of 179 consecutively enrolled patients with chronic psychotic illness and comorbid substance dependence who entered a specialized day hospital dual-diagnosis treatment program from Sept. 1, 1994, to Aug. 31, 1996, was evaluated. The 24 months were divided into four successive 6-month periods for comparing the evolving effectiveness of the program for groups of patients entering the day hospital during these four periods. Treatment attendance, hospital utilization, and twice weekly urine toxicology analyses were used as outcome measures. RESULTS: The initial treatment engagement rate, defined as at least 2 days of attendance in the first month, increased significantly from group 1 to group 4, more than doubling. Thirty-day and 90-day treatment retention rates also substantially increased from group 1 to group 4. More patients had no hospitalization in the 6 months after entering the day hospital program than in the 6 months before entering the day hospital program. Urine toxicology monitoring indicated that the patients in group 4 were more likely than those in group 1 to remain abstinent at follow-up. CONCLUSIONS: The evolving clinical effectiveness of a developing program can be quantified by using a sequential group comparison design. The sequential outcome improvements may be related to the incremental contributions of assertive case management and skills training for relapse prevention.

Comorbid substance abuse in patients with chronic psychotic illness adds to the challenges facing their ­successful rehabilitation. Increased morbidity from substance-induced psychotic exacerbation, dysphoria, anxiety, insomnia, and agitation has been documented (1). Poor retention in outpatient treatment and recurrent need for hospitalization disrupt rehabilitation efforts. Traditional treatment approaches have been unable to modify the course of illness for the majority of these patients (24). Given these challenges and an estimated lifetime prevalence of substance abuse of 47% among patients with schizophrenia (5), there has been increasing interest in developing effective treatment for these dually diagnosed patients (4, 612).

Although several studies of treatment for substance abuse included patients with chronic psychotic illnesses, only four published reports (68, 13) have described specific treatment outcomes for this population. The results from these studies were constrained by small sample sizes and reliance on self-reported sobriety status. The reported treatment outcomes were notable for the low treatment retention at 3 and 6 months and the low rates of sobriety for the patients who had a comorbid nonalcoholic substance disorder.

Diverse approaches to the treatment of this population have been proposed. Several programs have adopted cognitive behavioral therapy oriented toward relapse prevention (68, 14, 15). The prevailing rationale for deviations from the traditional 12-step approach has been the impression that many patients with chronic psychotic illness were unable to tolerate the confrontational and abstract spiritual approach. In addition, the applicability of the strict self-help requirement for these severely mentally ill patients has been questioned. Some of the treatment programs supplemented self-help by providing integrated case management and psychiatric care (4). These treatment programs varied in intensity from weekly group therapy to intensive inpatient treatment of 6 months’ duration (10). The scope and intensity of case management and degree of integration of psychiatric care and relapse prevention treatment also varied among treatment programs. Despite these differences, initial reports from these innovative programs supported the feasibility of providing these interventions (4, 16).

Variations in the choice of treatment components and intensity of intervention can be attributed to the early developmental phase of the integrated treatment approach. Data supporting the inclusion of specific treatment components and optimal treatment intensity have been lacking (13, 16). Without assessment of the contribution by individual program components, evaluative studies are of limited use in guiding the further refinement and development of integrated treatment programs.

The dual-diagnosis treatment program at the West Los Angeles Veterans Affairs (VA) Medical Center was established in 1990 to develop rehabilitative services for patients with chronic psychotic illnesses and comorbid substance dependence (1719). Although the treatment program began operations in 1990, implementation of many of the desired program components was delayed until 1995 and 1996 as a result of administrative obstacles. We designed the current study to determine the contribution of newly added program components to the effectiveness of the day hospital program. A sequential group design allowed the comparison of program effectiveness over time as we incrementally approximated our originally proposed program. If our conceptualization of an effective program was correct, then patient engagement, treatment attendance, and sobriety maintenance would increase, while psychiatric hospital utilization would decrease, in successive groups entering the day hospital program between 1994 and 1996.

METHOD

Patients with chronic psychotic disorder and comorbid substance dependence were referred for enrollment in the dual-diagnosis treatment program from the emergency department, psychiatric inpatient units, and outpatient psychiatric clinics of the VA Medical Center. A special request for referral of patients with comorbid cocaine dependence was made through recruitment memos and flyers to maximize the inclusion of these patients.

We prospectively examined the 6-month treatment engagement and outcome of four groups successively enrolled over a 2-year period in the day hospital of the dual-diagnosis treatment program. We divided the 2 years from Sept. 1, 1994, to Aug. 31, 1996, into four successive 6-month periods. Patients’ data were entered into an analysis based on intent to treat; that is, data from all patients who had at least one visit to the day hospital were included. The patients were assigned to one of the four groups on the basis of the date of their first visit. Group 1 included all patients entering Sept. 1, 1994, to Feb. 28, 1995; group 2 included all patients entering March 1, 1995, to Aug. 31, 1995; group 3 included all patients entering Sept. 1, 1995, to Feb. 29, 1996; and group 4 included all patients entering March 1, 1996, to Aug. 31, 1996.

We excluded patients who had been previously treated at the day hospital, as indicated by any visit to the day hospital logged between Jan. 1, 1990, and Sept. 1, 1994. This procedure prevented the contamination of current treatment effect by prior day hospital treatment.

All patients (N=179) were veterans eligible for care at the West Los Angeles VA Medical Center. Clinical diagnoses were made by the treating psychiatrists using DSM IV criteria. The clinical and sociodemographic characteristics of the subjects are shown in table 1. There were no statistically significant differences among the four groups in marital status, gender, race, and clinical diagnoses. As would be expected from a population of dually diagnosed U.S. veterans, 98% of the patients were male; most were unmarried, and most of them had an axis I diagnosis in the schizophrenia spectrum. We used psychiatric hospital utilization in the 6 months before entry into the day hospital program as an indirect measure of the patients’ pre-entry severity of illness; there were no statistically significant differences between the groups.

Treatment

We conceptualized integrated psychiatric care as using a single physical location, with primary treatment teams providing both inpatient and outpatient mental health and substance treatment services. All patients were encouraged to attend the day hospital phase of treatment. Relapse prevention training was conducted through a series of skills training groups that emphasized the mastery of specific social skills, which could reduce the frequency and severity of relapse. This 35-session training program, the substance abuse management module, is aimed at overcoming the obstacles posed by cognitive and social skills deficits found in patients with schizophrenia. An additional two sessions of skills practice were provided each week to enhance and maintain these skills. A manual-driven version of this treatment module was implemented starting with group 4.

The major program components that were available during each of the four 6-month periods are summarized in table 2. Starting with group 3, with the addition of two case managers, we were able to increase the intensity of assertive case management functions (e.g., housing and advocacy services) that were localized within each of the three day hospital treatment teams (20). Starting with group 3, we also provided free lunch to patients who attended the day hospital each day. All psychoeducational group sessions lasted 45 minutes, and patients received credit for attending each session and for providing twice weekly urine samples for toxicology testing. Urine toxicology results and program attendance records were discussed with each patient individually and during treatment team meetings. We prescribed psychotropic medications for relief of specific symptoms. In addition, disulfiram was available to patients with comorbid alcohol dependence. None of the patients received clozapine or olanzapine during the study period, and few patients received risperidone. There was no significant difference in the very limited use of risperidone by patients before versus after their entry into the day hospital program. The medication management strategy was not modified over the study period; haloperidol and fluphenazine were the predominant antipsychotic agents prescribed.

Outcome Measures

Treatment attendance records were entered daily into a centralized electronic medical record database by clerical staff for all patients who attended the treatment program each day. We reviewed the medical records database at West Los Angeles VA Medical Center to obtain the number of psychiatric admissions and dates of hospitalization for each patient in the 6 months before and the 6 months after the start of treatment at the day hospital. Inpatient psychiatric bed-days for the period 6 months before and after starting the day hospital program were tabulated for each patient. We included only psychiatric inpatient care at the West Los Angeles VA Medical Center in this analysis.

Urine samples were collected and analyzed twice weekly. An assigned nursing staff member collected urine samples under direct visual supervision. Urine toxicology analyses were performed according to a previously reported method (21). The drugs of abuse screened were marijuana (in the form of Δ-9-tetrahydrocannabinol), barbiturates, cocaine (in the form of the major metabolite, benzoylecgonine), amphetamine, and opioids (in the form of morphine).

Data Analysis

Analyses of the data proceeded in five steps for each of the four groups. The first analysis examined the patients’ initial engagement in treatment. In this analysis, we defined initial treatment engagement as attending the day hospital program at least 2 days in the first 30 days of enrollment. We calculated the initial engagement rate as the number of patients who were engaged in treatment as a percentage of all patients in each group. The second analysis examined the days of day hospital attendance for the patients who were engaged in treatment. We calculated 1-month treatment “dose” as the number of days of attendance in the first 30 days of treatment and 3-month treatment dose as the number of days of program attendance during first 3 months of the follow-up period. These last two variables served as measures of sustained participation in the day hospital program.

Since all patients were treated with antipsychotic medication, and we dispensed no more than a 1-month supply of medication at each visit, patients who did not return at least once every 30 days were very likely to be noncompliant and inadequately treated. In the third analysis, we examined the level of compliance with follow-up treatment after the first month in the program. We defined 30-day treatment retention as returning for treatment at least once in the 30 days after the first 30 days of entering the day hospital program; 90-day treatment retention was similarly defined, except it was calculated using those patients who continued in treatment for at least one day in the 30 days after the first 90 days of entering the day hospital program.

In the fourth analysis, we examined the impact of program enrollment on psychiatric hospitalization by comparing episodes and days of hospitalization in the 6 months before and the 6 months after entry into the day hospital program. We determined the percentage of patients in each group who had any hospitalization during that time interval. For the patients with any hospitalization, we calculated the mean number of episodes and the mean number of days per episode of hospital utilization.

Finally, we compared the sobriety status of each group during each month of the 6-month follow-up period. We defined maintenance of sobriety for any given month as providing two or more drug-free urine samples and no drug-positive urine sample during that month. We calculated the sobriety rate for each group as the number of patients who achieved this sobriety criterion in that month divided by the total number of patients in that group.

We used SPSS 7.0 for Windows (SPSS, Chicago) and SAS version 6.12 (SAS Institute, Cary, N.C.) for statistical calculations. We used the Pearson chi-square test for comparisons of categorical variables between groups and the McNemar chi-square test for comparisons of hospitalization rates before and after treatment within each group. The Cochran-Armitage trend test (SAS Proc Freq) (22, 23) was used for the hypothesized trend of increased treatment retention from group 1 to group 4. We used repeated measures analysis of variance (ANOVA) for binary variables (GLIMMIX SAS Macro) and continuous variables (General Linear Model, SAS Proc MIXED). We used natural log transformation for dose of treatment and episodes and days of hospitalization.

RESULTS

As shown in table 3, the initial treatment engagement rate, the mean number of days of attendance, and the treatment retention rate in the day hospital program all showed sequential improvements from group 1 to group 4. Statistically significant comparisons and interactions are also depicted in table 3. The engagement, attendance, and retention rates were the best in group 4, as we hypothesized, since that group experienced the fullest spectrum of treatment components in comparison with the other three groups. Also, as predicted, we found the greatest pairwise differences in engagement, attendance, and retention between group 4 and group 1.

As shown in table 4, the reduction in psychiatric hospital utilization occurred among patients who did not require rehospitalization after entry into the day hospital program. For the patients with at least one hospitalization after entry into the day hospital program, there was no reduction in the number of episodes or days of hospitalization.

An increasing percentage of patients from group 1 to group 4 maintained sobriety for at least 1, 2, 3, and 4 months in the first 6 months of treatment (Cochran-Armitage trend test statistic: 1 month, 2.16, p=0.03; 2 months, 4.26, p=0.01; 3 months, 6.37, p=0.001; 4 months, 2.02, p=0.04). Sixty percent of the patients in group 4 maintained sobriety for at least 1 month, compared with 30% of the patients in group 1. Thirty-one percent of the patients in group 4 maintained sobriety for at least 3 months, compared with only 5% of the patients in group 1. In the sixth month of treatment, 20% of the patients in group 4 were sober, compared with none in group 1. Groups 2 and 3 were intermediate between groups 1 and 4 in the proportion of patients who maintained sobriety.

DISCUSSION

The improvements noted in engagement, treatment participation, and sobriety supported the hypothesis that the program changes during 1995 and 1996 led to greater program effectiveness. Among the many changes, the increase in intensity of assertive case management and the increasing experience and competence of the staff in the implementation of biobehavioral elements may have been the two most important changes related to the sequential improvements in outcome from group 1 to group 4. In conjunction with integrated psychiatric care, assertive case management enhanced the engagement process by maximizing patients’ access to social and rehabilitative resources. Once engaged in treatment, patients were more likely to receive medication services and training in relapse prevention skills. Although the two additional case managers arrived during the time of group 3, their case management abilities increased during the initial months of their training, with a latency in the full impact of their efforts until group 4.

Program attendance during the first month in the day hospital program was one major determinant of the patients’ opportunity to acquire the skills taught in the program’s psychoeducational groups. Thus, with the enhanced deployment of assertive case management in group 4, patients may have derived increased therapeutic benefits through improved attendance. For example, a subgroup of 16 patients in group 4 who successfully completed the substance abuse management module attained significantly increased knowledge and social skills, while self-reported days of cocaine use significantly decreased in the 30 days after completion in comparison with the 30 days before entry into the day hospital program (17). In addition to the full implementation of the substance abuse management module in group 4, the incremental improvements in content and staff expertise in teaching it from group 1 to group 4 may have contributed to the observed outcome improvements.

While psychiatric hospital utilization decreased for all four groups following enrollment in the day hospital program, we did not find any significant differences among the groups in hospital utilization in the 6 months after day hospital program enrollment. Although this may have been related to a trend toward a higher pre-enrollment rate of hospital utilization in group 4 in comparison with group 1, there were other possible explanations. For example, as the treatment retention rate rose in the later groups, it is possible that some of the patients who would not have been engaged in treatment if they had been in group 1 were successfully engaged in treatment because they were part of group 4. The psychiatric hospital utilization of these more difficult-to-engage patients, once engaged in treatment, might have been higher than that of the more easily engaged patients. In addition, the engagement process may have modified the help-seeking behavior of these patients. The higher hospital utilization by this more severely ill group may have offset the reduction in hospital utilization of the patients who did not require hospitalization.

Since the objective of this project was to assess the changes in program performance over time, we compared patients grouped by date of entry into the day hospital program. This design requires specific cautions in the interpretation of results, because it relies on two assumptions: group uniformity and a causal relationship between programmatic elements and outcome.

The first caution relates to the possibility that patients entering the day hospital program may have differed from group to group. Although the day hospital admission criteria and patient demographic and diagnostic variables were stable over the four groups, we cannot be fully certain that this is a complete set of relevant characteristics. We attempted to maintain diagnostic homogeneity by including only patients with a DSM-IV diagnosis of chronic schizophrenia, schizoaffective disorder, or psychotic disorder not otherwise specified (if schizophrenia or schizoaffective disorder could not be excluded because of an insufficient period of sobriety). In our previous study of patients with chronic psychotic disorders who were admitted for inpatient treatment at this hospital (24), definitive diagnosis was possible for only 25% of the patients despite the use of a structured diagnostic procedure (Structured Clinical Interview for DSM-IV Axis I Disorders, Patient Edition), even when repeated 18 months after the initial assessment. In 78% of the diagnostically uncertain cases, the cause of uncertainty was an insufficient period of sobriety.

The second caution relates to the causal inference that the reported outcome improvements are linked to changes in the day hospital program. Without a concurrent control group, we are unable to exclude the effect of temporally correlated factors not specific to the day hospital program. Some examples of possible confounding factors include changes in the availability of community residential resources and advances in pharmacological treatment. However, it is important to note that it is impractical to construct multiple controlled studies to test the additive benefit of each component in an integrated treatment program. It is also unethical to withhold treatment components that are known to be efficacious from previous controlled studies.

The relatively short 6-month follow-up period is another potential limitation. However, it is likely that this similarly biased the results from all four groups, and thus comparisons among the groups remain valid.

The steep decline in treatment retention and sobriety during the first 6 months of treatment in all groups indicates that further refinements in the treatment of these patients are needed. An important implication of this observation is that our ambition in achieving satisfactory treatment outcome at 1-year follow-up must be preceded by the successful development of a program capable of achieving effective retention and treatment during the first 6 months.

In complex psychosocial treatment programs, the stability of program performance over time can never be fully ensured. Both intended and unintended program modifications will inevitably affect program performance. As program components were modified or added, it was often with the hope that these changes would favorably affect treatment effectiveness. Monitoring of program performance based on a key set of outcome measures is necessary for the cost-effectiveness assessment of these program changes. In this study, we demonstrated the feasibility of conducting a clinical program evaluation over a 2-year period without reliance on research funding. We expect that the method we described can be useful in the evaluation of other complex treatment programs.

This is the largest study, to our knowledge, of treatment outcome in patients suffering from chronic psychotic illnesses and comorbid substance dependence. The results of the study suggest that our integrated approach became increasingly effective in the early stages of treatment. The treatment program we have described is undergoing active development, and we hope that the continued refinement of our methods will achieve increasingly better outcomes for our patients. We also hope that this report will stimulate efforts by others to report their experiences with these challenging patients.

Presented in part at the 150th annual meeting of the American Psychiatric Association, San Diego, May 17–22, 1997. Received May 28, 1998; revision received April 12, 1999; accepted May 11, 1999. From the Department of Psychiatry, Harbor-UCLA Medical Center; the Department of Psychiatry, VA Medical Center, West Los Angeles; and the University of California, Los Angeles. Address reprint requests to Dr. Ho, 1000 West Carson St., Box 498, Torrance, CA 90509; (e-mail). Supported in part by NIMH National Research Service Award MH-14584 to Dr. Ho. This work is an integral project of the UCLA Research Center for Severe Mental Illnesses. The authors thank Jim Mintz, Ph.D., for statistical assistance.

TABLE 1
TABLE 2
TABLE 3
TABLE 4

References

1. Dixon L, Haas G, Weiden P, Sweeney J, Frances A: Acute effects of drug abuse in schizophrenic patients: clinical observations and patients’ self-reports. Schizophr Bull 1990; 16:69–79Crossref, MedlineGoogle Scholar

2. Kivlahan DR, Heiman JR, Wright RC, Mundt JW, Shupe JA: Treatment cost and rehospitalization rate in schizophrenic outpatients with a history of substance abuse. Hosp Community Psychiatry 1991; 42:609–614AbstractGoogle Scholar

3. Bartels SJ, Teague GB, Drake RE, Clark RE, Bush PW, Noordsy DL: Substance abuse in schizophrenia: service utilization and costs. J Nerv Ment Dis 1993; 181:31–37Crossref, MedlineGoogle Scholar

4. Drake RE, Mueser KT, Clark RE, Wallach MA: The course, treatment, and outcome of substance disorder in persons with severe mental illness. Am J Orthopsychiatry 1996; 66:42–51Crossref, MedlineGoogle Scholar

5. Regier DA, Farmer ME, Rae DS, Locke BZ, Keith SJ, Judd LL, Goodwin FK: Comorbidity of mental disorders with alcohol and other drug abuse: results from the Epidemiologic Catchment Area (ECA) study. JAMA 1990; 264:2511–2518Google Scholar

6. Kofoed L, Kania J, Walsh T, Atkinson RM: Outpatient treatment of patients with substance abuse and coexisting psychiatric disorders. Am J Psychiatry 1986; 143:867–872LinkGoogle Scholar

7. Hellerstein DJ, Meehan B: Outpatient group therapy for schizophrenic substance abusers. Am J Psychiatry 1987; 144:1337–1339Google Scholar

8. Drake RE, McHugo GJ, Noordsy DL: Treatment of alcoholism among schizophrenic outpatients:4-year outcomes. Am J Psychiatry 1993; 150:328–329Google Scholar

9. Brady S, Hiam CM, Saemann R, Humbert L, Fleming MZ, Dawkins-Brickhouse K: Dual diagnosis: a treatment model for substance abuse and major mental illness. Community Ment Health J 1996; 32:573–578Crossref, MedlineGoogle Scholar

10. Bachmann KM, Moggi F, Hirsbrunner H, Donati R, Brodbeck J: An integrated treatment program for dually diagnosed patients. Psychiatr Serv 1997; 48:314–316LinkGoogle Scholar

11. Hellerstein DJ, Rosenthal RN, Miner CR: A prospective study of integrated outpatient treatment for substance-abusing schizophrenic patients. Am J Addict 1995; 4:33–42CrossrefGoogle Scholar

12. Meisler N, Blankertz L, Santos AB, McKay C: Impact of assertive community treatment on homeless persons with co-occurring severe psychiatric and substance use disorders. Community Ment Health J 1997; 33:113–122Crossref, MedlineGoogle Scholar

13. Drake RE, Antosca LM, Noordsy DL, Bartels SJ, Osher FC: New Hampshire’s specialized services for the dually diagnosed. New Dir Ment Health Serv 1991; 50:57–67Crossref, MedlineGoogle Scholar

14. Nigam R, Schottenfeld R, Kosten TR: Treatment of dual diagnosis patients: a relapse prevention group approach. J Subst Abuse Treat 1992; 9:305–309Crossref, MedlineGoogle Scholar

15. Franco H, Galanter M, Castaneda R, Patterson J: Combining behavioral and self-help approaches in the inpatient management of dually diagnosed patients. J Subst Abuse Treat 1995; 12:227–232Crossref, MedlineGoogle Scholar

16. Drake RE, Yovetich NA, Bebout RR, Harris M, McHugo GJ: Integrated treatment for dually diagnosed homeless adults. J Nerv Ment Dis 1997; 185:298–305Crossref, MedlineGoogle Scholar

17. Roberts LJ, Shaner A, Eckman TA, Tucker DE, Vaccaro JV: Effectively treating stimulant-abusing schizophrenics: mission impossible. New Dir Ment Health Serv 1992; 53:55–65Crossref, MedlineGoogle Scholar

18. Tsuang JW, Ho AP, Eckman TA, Shaner A: Rehab rounds: dual diagnosis treatment for patients with schizophrenia who are substance dependent. Psychiatr Serv 1997; 48:887–889LinkGoogle Scholar

19. Shaner AL, Roberts LJ, Eckman TA, Wilkins JN: Skills training for substance abusing schizophrenics, in 1997 Annual Meeting New Research Program and Abstracts. Washington, DC, American Psychiatric Association, 1997, p 228Google Scholar

20. Stein LI, Test MA: Alternative to mental hospital treatment, I: conceptual model, treatment program, and clinical evaluation. Arch Gen Psychiatry 1980; 37:392–397Crossref, MedlineGoogle Scholar

21. Shaner A, Khalsa ME, Roberts L, Wilkins J, Anglin D, Hsieh S-C: Unrecognized cocaine use among schizophrenic patients. Am J Psychiatry 1993; 150:758–762LinkGoogle Scholar

22. Armitage P: Tests for linear trends in proportions and frequencies. Biometrics 1955; 11:375–386CrossrefGoogle Scholar

23. Cochran WG: Some methods for strengthening the common chi-square. Biometrics 1954; 10:417–451CrossrefGoogle Scholar

24. Shaner A, Roberts LJ, Eckman TA, Racenstein JM, Tucker DE, Tsuang JW, Mintz J: Sources of diagnostic uncertainty for chronically psychotic cocaine abusers. Psychiatr Serv 1998; 49:684–690LinkGoogle Scholar