The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:

Abstract

Objective: Costs of treating child psychiatric disorders fall on educational, primary care, juvenile justice, and social service agencies as well as on psychiatric services. The authors estimated multiagency mental health costs by integrating service unit costs with utilization rates in an 11-county area. Using psychiatric diagnoses made independently of service use records, the authors calculated costs across agencies as well as the extent of unmet need for psychiatric care. Method: Annual parent and child reports were used to measure mental health care needs and units of service across 21 types of settings for the population-based Great Smoky Mountain Study sample of 1,420 adolescents from ages 13 to 16. Unit costs for services were generated from information from service providers and records. The authors calculated costs overall, costs by type of service, and costs by diagnosis. Results: Average annual costs per adolescent treated were $3,146. Juvenile justice and inpatient/residential facilities accounted for well over half of the total costs. Costs for youths with two or more diagnoses were twice as much as costs of those with a single disorder. Among adolescents with service needs, 66.9% received no services. Public health insurance was associated with higher rates of specialty mental health care than either private insurance or no insurance. Conclusions: Annual costs across all services were three to four times greater than recent health insurance estimates alone. Many costs for adolescents with mental health problems were borne by agencies not designed primarily to provide psychiatric or psychological services. Only one in three adolescents needing psychiatric care received any mental health services.

The annual cost of treating child and adolescent mental illness was estimated at $11.6 billion in 1998 (1) , not including costs incurred outside medical settings. Yet educational, juvenile justice, and child welfare agencies all incur costs related to childhood mental illness (2) , and children often use services from many agencies, to deal with many problems. Studies that examine service use for a limited set of providers (e.g., references 1 , 3 , 4) or focus on a single diagnosis or presenting problem (57) will underestimate the broader community costs of early mental illness.

Four elements are needed to estimate the costs of childhood mental illness across service agencies: a representative population sample; assessment of psychiatric disorder that is independent of treatment records (to measure unmet service needs); information on costs across all relevant service systems; and information on the number of units of each type of service used by each study participant. This study meets these requirements for a population sample of 13- to 16-year-olds in the southeastern United States.

Method

Sampling Frame

The study used data from the Great Smoky Mountain Study sample, drawn from a predominantly rural 11-county area of North Carolina (population 180,000) that had an adequate mental health care system. The sampling frame was the student information management system databases of the 13 school districts in the area. A representative sample of 4,500 children, 1,500 each at ages 9, 11, and 13, was selected using a household equal probability design to select one child from each household.

Two-Stage Sampling

A two-stage sampling process was used to increase the number of mental health service users in the study sample while permitting estimates to be made for the whole population (8) . All children who scored above a predetermined cut point on a behavioral screening questionnaire (9) , plus a 1-in-10 random sample of children who scored below the cut point, were recruited. Ninety-five percent of families contacted completed the screening questionnaire, and 80% of eligible families (1,073 of 1,346) agreed to participate in the interviews. In addition, all age-appropriate American Indian children living in the area were sought for recruitment irrespective of their screening questionnaire scores, and 81% (350/432) agreed to participate. Of the total sample of 1,423, three died early in the study and are omitted from these analyses. Eligible children and one of their parents were interviewed annually until the youths were 16 years of age. Institutional review board approval was obtained, and both children and parents provided informed consent.

The estimates presented in this article are based on data collected between 1993 and 2000 for each cohort at ages 13, 14, 15, and 16. The average response rate for each wave was 81.6%. The data are weighted back to population rates (8) .

Approach to Cost Analysis

The first step in cost analysis is to determine the perspective, that is, to answer the question “costs to whom?” (10) . We estimated the costs to the broad set of health care (primary and specialty), school, juvenile justice, and social service agencies that bear the financial brunt of adolescents’ emotional and behavioral problems. By including a comprehensive set of service agencies, we hoped to approximate a societal perspective (11) . However, this approach omits many costs borne by families, including direct costs (e.g., travel) and indirect costs such as impact on parents’ ability to work and the child’s future earnings.

Key Measures

Three sets of measures were collected: psychiatric disorders, as a marker of need for services; the number and type of units of service utilized per child; and the cost of each unit of service.

Psychiatric diagnoses were made at annual interviews using the Child and Adolescent Psychiatric Assessment (12) . Need for services was defined as the presence of either a diagnosis according to DSM-IV criteria (13) or psychiatric symptoms associated with significant functional impairment at home or in school. Youths with impairing symptoms below the threshold for formal diagnosis were categorized as needing services because earlier work with these data (14) showed that this group frequently has many symptoms across several diagnostic categories without any formal DSM-IV diagnosis and that they often have a poor prognosis without treatment. This group is roughly equivalent to those who would be given a DSM-IV not otherwise specified diagnosis. Children were categorized as needing services the first time they either met diagnostic criteria for a disorder or had impairing symptoms of a disorder. They were then counted as having that disorder at each of the subsequent data waves. Using this “persistent” definition reflects the chronic nature of psychopathology as well as common clinical procedure: mental health services (for example, stimulant medication for attention deficit hyperactivity disorder [ADHD]) are considered to be needed to maintain mental health after symptoms fall below the full diagnostic threshold.

Service use for mental health problems was identified using the Child and Adolescent Services Assessment (15) , an interview for parent and child that provides details on use of 39 types of service during the 3 months preceding the interview. For each type of service used, information is collected about the number of sessions, the length of visits, and the focus of treatment. The instrument also asks about family income and health insurance. For this article, 21 types of service covered in the interview were classified into seven categories: inpatient hospital, residential, outpatient, school, primary care, juvenile justice, and informal services. Services were excluded from these analyses if they involved no formal costs (e.g., talking to a sibling or parent) or if the primary object of the expenditures by the agency was an adult (e.g., social service investigations of abuse). To ensure that services are related to mental health concerns, the Child and Adolescent Services Assessment uses four safeguards: the measure is administered immediately after the Child and Adolescent Psychiatric Assessment to cue recall. The Child and Adolescent Services Assessment begins by reviewing all mental health concerns identified in the diagnostic interview; when querying about the general services settings, the questions are qualified with the phrase “for any of the kinds of problems that you told me about”; and when prompted for detailed service information, the interviewer is asked to identify the focus of treatment. Only service use related to mental health is coded.

Cost estimates for service units were obtained from a diverse range of national, state, and local resources. A full list of data sources and a detailed description of data collection methods are available in an online appendix at http://devepi.mc.duke.edu/mentalhealthcost.pdf.

When available, unit cost estimates were specific to the state, county, and year from which the utilization data were drawn, and cost estimates included direct costs, such as the salaries of health care providers, and indirect costs, such as administrative support. The consumer price index was used to index costs to the year in which the service was provided if historic unit cost data were unavailable. The figures for some service categories incorporate a range of cost estimates for each service in that category, reflecting cost variations across sources of information. All costs are reported in 2000 real dollars. Participants might use several services and might use a service more than once. We use “service events” to present the number of discrete observations in which a service was reported as being accessed.

Analyses

Cost estimates were calculated by multiplying reported service units by unit costs. The Child and Adolescent Services Assessment obtains service units through items inquiring about duration (in minutes) and number of visits. Cost estimates include average annual costs per individual and total annual costs per 100,000 population. If an individual reported service use at more than one time point, separate cost estimates were averaged for the individual to control for correlated data points. Three-month cost estimates, but not service utilization rates, could be weighted to annual estimates by multiplying estimates by four. A total sample cost estimate was generated by summing costs across all participants. The total sample cost was weighted to obtain an estimate for a population of 100,000. Service utilization rates were computed with logistic regression models using general estimation equations to account for both sampling design and within-subject correlation across multiple waves. Sampling weights were applied for estimates.

Results

Table 1 lists the categories, services within each category, and unit cost range for each service. The likelihood of service use did not differ from cohort to cohort, so numbers of units of care and costs were aggregated across cohorts.

Utilization Rates and Costs by Service Category

Table 2 presents mental health service costs and utilization rates by service category. Over 3 months, 17.9% of the sample used mental health services. School was the most common setting, followed by psychiatric outpatient, juvenile justice, and primary care settings. In general, rarely accessed services (e.g., inpatient and residential) were the most costly.

Figure 1 summarizes the relationship between service events and costs. It shows, for example, that only 4% of the sample used nonhospital residential services within a 3-month period but accounted for 43% of total costs, while mental health services were delivered in school settings to 30% of the sample for 13% of the total costs.

Figure 1. Services Used and Costs by Service Category for 1,420 Adolescents Ages 13–16 in a Rural Area of North Carolina a

a Service events refer to the number of discrete observations in which a service was reported as being accessed (i.e., the total number of events possible equals the number of subjects multiplied by the number of interview waves by the number of service categories).

Details of demographic differences in costs can be found in the online appendix at http://devepi.mc.duke.edu/mentalhealthcost.pdf. The sample had almost equal numbers of boys and girls. Boys were nonsignificantly more likely to use services, but the costs of services for boys were 61% greater than those for girls (average annual costs, $3,803 versus $2,363), and boys were responsible for 70% of the total annual costs. Of the two primary racial/ethnic groups (Anglo and American Indian), Anglos were less likely to use services (17% versus 24%) and costs were about $1,500 less per user, but because they were the majority (90.4%) of the population, they were responsible for most (69.7%) of the costs. The proportion of adolescents using services increased with age (controlling for year), rising from 14.1% at age 13 to 17.3% at age 16. Average annual costs also increased, from $2,433–$2,996 at age 13 to $4,152–$4,725 at age 16.

Costs by Diagnosis

Table 3 illustrates how need for services affected costs. About one-third of adolescents (33.1%) with a need for services used services from any agency. Youths with a formal DSM-IV diagnosis incurred modestly greater costs than those with subdiagnostic impairment ($4,456 versus $4,034) and much greater costs than those without a psychiatric diagnosis or impairment ($1,284).

Among youths with mental illness, comorbidity has been shown to be the rule rather than the exception (16) . In Table 3 , costs are presented for both single-disorder and comorbid cases in various diagnostic categories. Disruptive behavior disorders (conduct disorder, oppositional defiant disorder, and ADHD) accounted for the largest proportion of costs for single-disorder groups because of both higher prevalence rates and substantially higher costs in juvenile justice and inpatient services. Adolescents with multiple diagnoses incurred the greatest costs, and those with three or more diagnoses the greatest of all ($6,744). However, only 49.9% of even the latter group received any services. Overall, depression and disruptive behavior disorders accounted for the highest rates of service use and the largest proportion of total mental health costs.

Costs by Insurance Status

Table 4 compares primary and specialty mental health costs by the primary source of insurance funding. Private insurance was the most common source of funding for the sample (74.6%), followed by public funding (Medicaid, Medicare, Indian Health Service; 14.0%) and no insurance (9.6%). Participants with public insurance were more likely than either privately insured or uninsured children to use specialty mental health services. Yearly costs were greater for children with public funding for primary care services and specialty mental health services.

Discussion

This study is one of the first to look at mental health service costs across a full range of service settings and diagnostic groups. The costs of mental health services in this 11-county area extrapolates to national costs of $10.2 billion to $12.3 billion just for 13- to 16-year-olds. This is three to four times more than previous national estimates for the entire child and adolescent population, which were based largely on health insurance data alone.

A number of specific findings of this study are noteworthy. First, costs for outpatient specialty mental health services constituted about 7% of the total of mental health costs for adolescents. Juvenile justice services and inpatient services, such as inpatient hospitals and group homes, accounted for 67% of all costs. Second, schools were the most frequent service providers for adolescents and were responsible for 13% of the costs; thus, the burden of adolescent mental health problems was commonly borne by agencies that were not designed primarily to provide psychiatric or psychological services. Third, although the per-child costs were similar to those of other diagnostic groups, children with disruptive behavior disorders accounted for the greatest expenses of any diagnostic group because of the higher prevalence of these disorders in childhood. Fourth, less than one in three adolescents who had a need for services during the period examined received any services from any agency. Finally, the proportion of adolescents with service needs who received mental health care in the medical sector was similar for those with private health insurance and for those with no insurance. A higher proportion of those with public insurance received services.

This study contributes in several ways to the literature on the costs of treating adolescent mental illness. It uses a representative population sample and an annual detailed psychiatric assessment of each participant for 4 years as well as details of the type and amount of disorder-related services used across multiple agencies, and it generates costs from detailed investigations of the relevant agencies. Other studies have estimated costs for children with various types of health care funding (e.g., those on Medicaid or those with private health insurance [ 1 , 3 , 4 ]) or children with specific disorders (57) , but none permitted estimates of costs of multiple service providers for individual cases across a whole population.

The study also presents average costs at both the individual and population levels. The Fort Bragg Demonstration Project (17) estimated the average costs of services from medical and mental health agencies for children in contact with mental health services, and a Comprehensive Community Mental Health Services for Children and Their Families Program study (18) of costs in Ohio for children at risk of out-of-home placement obtained cost data from most agencies. Annual estimates of the cost per treated child were between $5,000 and $6,000 in the Ohio sample and around $5,000 for the nonexperimental comparison group in the Fort Bragg study. The equivalent group of adolescents in Great Smoky Mountains Study (i.e., those in contact with specialty mental health services) generated much higher annual costs ($10,921), indicating that the failure to include a full range of service providers can lead to substantial underestimation of costs.

The cost estimates in this study are based on “persistent” diagnoses—that is, once a child was diagnosed, that diagnosis was carried to subsequent observations—to reflect the chronic nature of psychopathology and the clinical reality that patients often continue to be treated after symptoms subside and fall below the full diagnostic threshold. Analyses were also completed on two alternative assumptions: 1) subjects were counted in the diagnostic group only when they met full criteria for the diagnosis; and 2) subjects were excluded from further observations after a diagnosis was met and then was not met or resolved on a subsequent observation. In both scenarios, average annual costs were higher for subjects with a diagnosis and those without than costs computed using the “persistent” diagnosis (in scenario 1, costs were $5,664 and $2,942, respectively, and in scenario 2, $1,543 and $6,013, respectively). These assumptions also change the prevalence rates for the diagnostic conditions. As evidenced by these comparisons, service cost estimates generated with the “persistent” diagnosis should be considered conservative.

Limitations

Several limitations to this study need to be considered. The data are from a relatively rural area in the southeastern United States that may not be representative of the rest of the country in rates of mental illness, levels of service use, and costs per unit of service. However, there is evidence that rates of mental illness are very similar in this and other national and international population samples (19 , 20) and that the proportion of children receiving needed mental health care is similar in other areas of the United States (2125) and the United Kingdom (26) . Also, the unit costs used in this study are highly consistent with figures from national and other local estimates (see the online appendix at http://devepi.mc.duke.edu/mentalhealthcost.pdf).

Although the study oversampled American Indians, it included very few African Americans, Latinos, and Asian Americans, because few members of these groups live in the 11-county area studied. Also, in this study, race/ethnicity, family income, and insurance status were confounded: although the prevalence of psychiatric disorders was similar across the sample (27) , Anglos were better off and more likely to have private insurance (and to have lower rates of service use), while African Americans and American Indians were more likely to be poor and to have publicly funded health insurance.

We used information from parents and children as the basis for our estimates of units of service use rather than from administrative sources such as Medicaid claims. The services that carry most of the cost burden, such as schools and the juvenile justice system, do not maintain records that permit extraction of costs of units of service for individual study participants. Medicaid claims data provide estimates of the cost of providing care from the perspective of the payer rather than the patient (e.g., references 3, 4, 28) and are limited to medical service providers. There is a large literature supporting the validity of self- and parent-reported psychiatric symptoms and service use compared with institutional records (2932) .

Three additional limitations have to do with factors that lay beyond the scope of this article. First, these analyses excluded many costs incurred by families with a mentally ill adolescent, such as additional child care, travel, out-of-pocket expenses, and lost work opportunities. Second, these analyses did not consider the appropriateness or adequacy of the services provided or their impact on the course of illness. Third, the age range of the sample was limited to early adolescence.

Conclusions and Implications

Notable efforts are being made in many states to provide an integrated system of care for children and adolescents with mental illness (33 , 34) . The data presented here reinforce the need for such integration. The adolescents who incurred the greatest costs had complex psychiatric profiles and were likely to need services from many sources. Rates of adolescent inpatient hospitalization have fallen since the 1980s (35) , but it is clear that expensive residential facilities were still seen to be necessary for a small proportion of youths with psychiatric disorders. However, much of the cost is being borne by non-mental health agencies.

These analyses identified a high level of unmet need: some 70% of adolescents with service needs received no help from any of the service sectors whose raison d’être is to provide services to children. Yet, even children who have neither a psychiatric diagnosis nor symptomatic impairment may need mental health care. Children with disabilities or recent trauma, for example, could benefit from counseling.

There is considerable evidence that the majority of adult psychiatric disorders are continuations or recurrences of chronic disorders that have their origins in childhood or adolescence (36 , 37) . Treatments that effectively manage many early-onset disorders are now available (38 , 39) . In this context, the level of unmet need, as well as the burden on service systems that were not designed to deliver expert mental health care, is a matter of grave concern.

Received Feb. 16, 2006; revisions received April 17 and May 22, 2006; accepted June 9, 2006. From the Department of Psychiatry, Duke University Medical Center; and the Research Triangle Institute, Durham, N.C. Address correspondence and reprint requests to Dr. Copeland, Department of Psychiatry and Behavioral Sciences, Box 3454, Duke University Medical Center, Durham, NC 27710; [email protected] (e-mail). All authors report no competing interests.Dr. Costello, as principal investigator, had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.Supported in part by NIH grants DA11301 and MH57761 and Independent Scientist Award MH01167 to Dr. Costello and Faculty Scholar Awards from the William T. Grant Foundation to Dr. Costello.

References

1. Ringel JS, Sturm R: National estimates of mental health utilization and expenditures for children in 1998. J Behav Health Serv Res 2001; 28:319–333Google Scholar

2. Burns BJ, Costello EJ, Angold A, Tweed D, Stangl D, Farmer EM, Erkanli A: Children’s mental health service use across service sectors. Health Aff 1995; 14:147–159Google Scholar

3. Mandell DS, Guevara JP, Rostain AL, Hadley T: Medical expenditures among children with psychiatric disorders in a Medicaid population. Psychiatr Serv 2003; 54:465–467Google Scholar

4. Martin A, Leslie D: Psychiatric inpatient, outpatient, and medication utilization and costs among privately insured youths, 1997–2000. Am J Psychiatry 2003; 160:757–764Google Scholar

5. Sheidow AJ, Bradford WD, Henggeler SW, Rowland MD, Halliday-Boykins C, Schoenwald SK, Ward DM: Treatment costs for youths receiving multisystemic therapy or hospitalization after a psychiatric crisis. Psychiatr Serv 2004; 55:548–554Google Scholar

6. Needle R, Brown P, Lavee Y, Su S, Doherty W: Costs and consequences of drug use: a comparison of health care utilization and social-psychological consequences for clinical and non-clinical adolescents and their families. Int J Addict 1988; 23:1125–1143Google Scholar

7. Scott S, Knapp M, Henderson J, Maughan B: Financial cost of social exclusion: follow-up study of antisocial children into adulthood. BMJ 2001; 323:191–194Google Scholar

8. Shrout PE, Newman SC: Design of two-phase prevalence surveys of rare disorders. Biometrics 1989; 45:549–555Google Scholar

9. Achenbach TM, Edelbrock CS: Behavorial problems and competencies reported by parents of normal and disturbed children aged four through sixteen. Monogr Soc Res Child Dev 1981; 46:1–82Google Scholar

10. Gold MR, Siegal JE, Russell LB, Weinstein MC: Cost-Effectiveness in Health and Medicine. New York, Oxford University Press, 1996Google Scholar

11. Knapp M: Economic evaluation and conduct disorders, in Conduct Disorders in Childhood and Adolescence. Edited by Hill J, Maughan B. New York, Cambridge University Press, 2001, pp 478–506Google Scholar

12. Angold A, Prendergast M, Cox A, Harrington R, Simonoff E, Rutter M: The Child and Adolescent Psychiatric Assessment (CAPA). Psychol Med 1995; 25:739–753Google Scholar

13. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, 4th ed. Washington, DC, American Psychiatric Association, 1994Google Scholar

14. Angold A, Costello EJ, Farmer EMZ, Burns BJ, Erkanli A: Impaired but undiagnosed. J Am Acad Child Adolesc Psychiatry 1999; 38:129–137Google Scholar

15. Ascher BH, Farmer EMZ, Burns BJ, Angold A: The Child and Adolescent Services Assessment (CASA): description and psychometrics. J Emot Behav Disord 1996; 4:12–20Google Scholar

16. Angold A, Costello EJ, Erkanli A: Comorbidity. J Child Psychol Psychiatry 1999; 40:57–87Google Scholar

17. Foster EM, Bickman L: Refining the cost analyses of the Fort Bragg Evaluation: the impact of cost offset and cost shifting. Ment Health Serv Res 2000; 2:13–25Google Scholar

18. Foster EM, Connor T: Public costs of better mental health services for children and adolescents. Psychiatr Serv 2005; 56:50–55Google Scholar

19. Roberts RE, Attkisson CC, Rosenblatt A: Prevalence of psychopathology among children and adolescents. Am J Psychiatry 1998; 155:715–725Google Scholar

20. Jaffee S, Harrington H, Cohen P, Moffitt TE: Cumulative prevalence of psychiatric disorder in youth. J Am Acad Child Adolesc Psychiatry 2005; 44:406–407Google Scholar

21. Leaf PJ, Alegria M, Cohen P, Goodman SH, Horwitz SM, Hoven CW, Narrow WE, Vaden-Kiernan M, Regier DA: Mental health service use in the community and schools: results from the four-community MECA Study. J Am Acad Child Adolesc Psychiatry 1996; 35:889–897Google Scholar

22. Leslie DL, Rosenheck RA, Horwitz SM: Patterns of mental health utilization and costs among children in a privately insured population. Health Serv Res 2001; 36(1 pt 1):113–127Google Scholar

23. Horwitz SM, Leaf PJ, Leventhal JM, Forsyth B, Speechley KN: Identification and management of psychosocial and developmental problems in community-based primary care pediatric practices. Pediatrics 1992; 89:480–485Google Scholar

24. Staghezza-Jaramillo B, Bird HR, Gould MS, Canino G: Mental health service utilization among Puerto Rican children ages 4 through 16. J Child Fam Stud 1995; 4:399–418Google Scholar

25. Offord DR, Boyle MH, Szatmari P, Rae-Grant NI, Links PS, Cadman DT, et al: Ontario Child Health Study, II: six-month prevalence of disorder and rates of service utilization. Arch Gen Psychiatry 1987; 44:832–836Google Scholar

26. Vostanis P, Meltzer H, Goodman R, Ford T: Service utilisation by children with conduct disorders. Eur Child Adolesc Psychiatry 2003; 12:231–238Google Scholar

27. Costello EJ, Keeler GP, Angold A: Poverty, race/ethnicity, and psychiatric disorder: a study of rural children. Am J Public Health 2001; 91:1494–1498Google Scholar

28. Zito JM, Safer DJ, DosReis S, Gardner JF, Magder L, Soeken K, Boles M, Lynch F, Riddle MA: Psychotropic practice patterns for youth: a 10-year perspective. Arch Pediatr Adolesc Med 2003; 157:17–25Google Scholar

29. Farrington DP: Predicting adult official and self-reported violence, in Clinical Assessment of Dangerousness: Empirical Contributions. Edited by Pinard GF, Pagani L. New York, Cambridge University Press, 2001, pp 66–88Google Scholar

30. Farmer EMZ, Angold A, Burns BJ, Costello EJ: Reliability of self-reported service use: test-retest consistency of children’s responses to the Child and Adolescent Services Assessment (CASA). J Child Fam Stud 1994; 3:307–325Google Scholar

31. Winters KC, Stinchfield RD, Henly GA, Schwartz RH: Validity of adolescent self-report of alcohol and other drug involvement. Int J Addict 1991; 25:1379–1395Google Scholar

32. Bussing R, Mason DM, Leon CE, Sinha K: Agreement between CASA parent reports and provider records of children’s ADHD services. J Behav Health Serv Res 2003; 30:462–469Google Scholar

33. Stroul BA, Friedman RM: The system of care concept and philosophy, in Children’s Mental Health: Creating Systems of Care in a Changing Society. Edited by Stroul BA. Baltimore, Brookes, 1996, pp 3–21Google Scholar

34. Duchnowski AJ, Kutash K: The mental health perspective: comprehensive and collaborative systems that work for troubled youth, in Developing Comprehensive Systems for Troubled Youth: A National Agenda. Edited by Nelson CM, Wolford B. Richmond, Ky, National Coalition for Juvenile Justice Services, 1996, pp 90-110Google Scholar

35. Kiesler CA, Simpkins C: Changes in psychiatric inpatient treatment of children and youth in general hospitals: 1980–1985. Hosp Community Psychiatry 1991; 42:601–604Google Scholar

36. Insel TR, Fenton WS: Psychiatric epidemiology: it’s not just about counting anymore. Arch Gen Psychiatry 2005; 62:590–592Google Scholar

37. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE: Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey replication. Arch Gen Psychiatry 2005; 62:593–602Google Scholar

38. Farmer EM, Compton SN, Bums BJ, Robertson E: Review of the evidence base for treatment of childhood psychopathology: externalizing disorders. J Consult Clin Psychol 2002; 70:1267–1302Google Scholar

39. Compton SN, Burns BJ, Helen LE, Robertson E: Review of the evidence base for treatment of childhood psychopathology: internalizing disorders. J Consult Clin Psychol 2002; 70:1240–1266Google Scholar