The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

The authors sought to characterize the symptoms of patients later hospitalized for psychotic disorders in primary mental health outpatient settings, and to investigate whether these symptoms can be used to predict later onset of psychotic illness.

Method:

This was a population-based historical prospective cohort study using national registers of clinical psychiatric services. The sample (N=114,983) comprised 18- to 21-year-olds serving in the Israeli military and examined in military mental health outpatient clinics across 72 consecutive months.

Results:

Overall, 1,092 individuals (0.95%) not diagnosed with a psychotic disorder at the time of examination were hospitalized for nonaffective psychotic disorder up to 9 years after the index examination. A principal components analysis of symptoms presented at index examination found that a symptom cluster of thought disorder, perceptual abnormalities, poor orientation, and suicidality was associated with an increased risk for hospitalization for nonaffective psychotic disorder within 14 days after examination (hazard ratio=45.80, 95% CI=22.87–91.73), 15–111 days after examination, (hazard ratio=19.59, 95% CI=13.08–29.33), 112–365 days after examination (hazard ratio=4.94, 95% CI=2.59–9.40), and 1–3.5 years after examination (hazard ratio=3.42, 95% CI=2.21–5.28), but not for hospitalization 3.5 years or more after examination (hazard ratio=1.57, 95% CI=0.91–2.71). Despite the increased risk, the positive predictive values of this symptom cluster were low, ranging from 0.54% to 1.99%.

Conclusions:

In 18- to 21-year-olds, the presence of psychotic symptoms was associated with later hospitalization for a nonaffective psychotic disorder. However, the low positive predictive values of symptoms elicited in primary mental health care settings suggest that symptoms alone are not useful in predicting later hospitalization for nonaffective psychotic disorder.

The prodrome heralding the onset of a psychotic disorder is commonly defined as the period between the beginning of subtle behavioral and emotional deviations from norms and the clinical manifestation of the full psychotic episode. Prospective studies attempting to identify and predict impending psychosis by following “high-risk” or “prodromal” individuals have proliferated in the past two decades (15). (The terms “prodromal” and “ultra high risk” are often used interchangeably; here we use the term “prodromal.”) The overwhelming majority of these studies have been conducted in specialized prodromal clinics, to which adolescents arrive via several sequential referral filters (6).

Studies of such samples provide important information on predictors of psychosis and schizophrenia. Significant predictors of nonaffective psychotic disorder found in those settings include genetic risk with recent deterioration in functioning, unusual thought content, suspicion/paranoia, social impairment, history of substance abuse, disorganized symptoms (1, 7, 8), positive symptoms, bizarre thinking, sleep disturbances, schizotypal disorder, and lower level of education (4). If such findings could be generalized to primary psychiatric care, this would have substantial implications for early detection and early intervention in psychotic disorders.

The aim of this study was to present a population-based context to concepts developed in specialized prodromal clinics. Young men and women examined in military mental health outpatient clinics were followed for psychiatric hospitalizations, and the association between symptoms present at the index examination and risk for later hospitalization for nonaffective psychotic disorders was examined.

This study has two important methodological advantages. First, the 18- to 21-year-olds examined and followed for up to 9 years are representative of the entire population. Second, since mental health care, including hospitalization, is free and easily accessible both in the military and in civilian settings in Israel, biases caused by limited access to mental health care are minimal.

Method

The study was approved by the ethics committees of the Israeli Defense Forces (IDF) Medical Corps and the Chaim Sheba Medical Center.

Service in the IDF is mandatory for all Jewish Israelis between the ages of 18 and 21 for males and 18 and 20 for females. The association between signs and symptoms present in a mental health examination and subsequent psychiatric hospitalization was examined by merging data from the IDF’s Mental Health Examination Archive with data from the national Psychiatric Hospitalization Case Registry. These databases were linked using the Israeli national identification number (analogous to the U.S. Social Security number) assigned to all newborns and legal citizens. For service members 18 to 21 years old examined in military mental health outpatient clinics who later appeared in the hospitalization registry, dates of hospitalizations and discharge diagnoses were added to the file. To preserve confidentiality, the national identification number was removed before the linked file was transferred to the investigators.

Databases

IDF Mental Health Examination Archive.

The IDF mental health examination archive contains information obtained from military mental health outpatient clinics, including examinations of all young adults serving in the IDF from 2000 to 2006 referred by others or self-referred to mental health examination. These examinations are performed by postgraduate-level licensed social workers, clinical psychologists, or psychiatrists in military mental health outpatient clinics. To achieve the greatest standardization possible, all mental health professionals go through special courses and receive ongoing supervision by senior psychiatrists, psychologists, and social workers, focusing on the administration and documentation of the mental health examination. Referrals to military mental health outpatient clinics are made by military general practitioners, mental health professionals, or commanding officers. The mental health examination consists of a semistructured interview and a structured rating scale documenting the presence or absence of psychiatric signs and symptoms.

Psychiatric Hospitalization Case Registry.

The national Psychiatric Hospitalization Case Registry is a complete listing of all psychiatric hospitalizations in Israel, including in psychiatric hospitals, day hospitals, and psychiatric units in general hospitals, using ICD discharge diagnoses assigned by a board-certified psychiatrist. Reporting is regularly monitored to ensure precision.

A study comparing Research Diagnostic Criteria diagnoses with registry diagnoses (9) found that registry diagnoses of nonaffective psychotic disorders (ICD-10 codes F20.0–29.9) had a sensitivity of 0.87, and 93% of patients with schizophrenia in the population are eventually hospitalized and appear in the registry (10).

Study Population

During the years 2000–2006, a total of 114,983 service members 18–21 years old were examined at least once by a mental health professional. Of these, 2,450 (2.1%) were later hospitalized in a psychiatric ward, up to 9 years after the index mental health examination (see Figure S1 in the data supplement that accompanies the online edition of this article). Of those hospitalized, 1,092 received a diagnosis of a nonaffective psychotic disorder (ICD-10 codes F20.0–29.9). These rates of hospitalization for nonaffective psychotic disorder are in agreement with a 2011 report of the Israeli Ministry of Health (25) finding that 58.4% of psychiatric hospitalizations were for the treatment of schizophrenia or other psychotic disorders.

A total of 1,358 service members from the sample were later hospitalized for other psychiatric disorders (2.9% for organic mental disorders [ICD-10 codes F00–F09], 8.1% for substance-related disorders [codes F10–F19], 18.8% for affective disorders [codes F30–F39], 29.7% for anxiety and somatoform disorders [codes F40–F49], 8.0% for eating disorders [code F50], 15.1% for personality disorders [codes F60–F69], 0.2% for intellectual disabilities [codes F70-F79], 0.4% for developmental disorders [codes F80–F89], 4.1% for childhood-onset disorders [codes F90–F98], and 12.7% for unspecified mental disorder [code F99]). The comparison group included 112,533 individuals examined by mental health professionals between 2000 and 2006 who were not later hospitalized in a psychiatric ward.

The nonaffective psychotic disorder group (N=1,092) was classified into five groups according to time from the index mental health examination to hospitalization. The first group comprised those who were hospitalized 0–14 days after the index examination (N=43), an interval suggesting that these individuals may already have been suffering from a psychotic disorder and possibly had been masking their symptoms. Because many prodromal studies have assessed risk for hospitalization within 1 year, we divided those hospitalized between 15 and 365 days according to the median time elapsed between the index examination and later hospitalization, resulting in groups hospitalized between 15 and 111 days (N=143) and between 112 and 365 days (N=138) after the index examination. Individuals who were hospitalized more than 1 year after the examination were also divided according to the median time elapsed between the index examination and later hospitalization, resulting in group hospitalized between 1 and 3.5 years (N=385) and between 3.5 and 9 years after the index examination (N=383).

Statistical Analysis

Cox proportional hazards regression models were used to compare the prevalence of individual symptoms identified in the first mental health examination between individuals who were later hospitalized for a nonaffective psychotic disorder, those later hospitalized for other psychiatric disorders, and those who were not later hospitalized for a psychiatric disorder. Hazard ratios with 95% confidence intervals were computed.

In an attempt to classify clinically recognizable symptom clusters, we clustered the 24 symptoms recorded during the index mental health examination into clusters using categorical principal components analysis with variable principal normalization. These clusters were then dichotomized, such that individuals with at least one of the symptoms in a given cluster were included in that cluster and compared with those not having any of the symptoms in the cluster. The dichotomized cluster scores were then included in a Cox proportional hazards regression analysis to assess which cluster of symptoms best predicted later hospitalization, followed by analyses stratified by time from examination. We then performed a “high-risk group” analysis, examining the potential additive effects of the presence of other symptom clusters in addition to symptoms from the psychotic symptom cluster. Hazard ratios with 95% confidence intervals were computed. The sensitivity, specificity, and positive predictive values were calculated for each category of symptoms.

Analyses were performed using SPSS, version 17.0 (SPSS, Inc., Chicago).

Results

Psychiatric Symptoms in 18- to 21-Year-Olds

Table 1 presents the prevalence of each individual symptom present in the index mental health examination among service members 18–21 years old who were later hospitalized for nonaffective psychotic disorders, those who were later hospitalized for other psychiatric disorders, and those who were not later hospitalized. Service members examined in the military mental health clinics presented with between zero and six symptoms. Those who were later hospitalized for nonaffective psychotic disorders or other psychiatric disorders reported significantly more symptoms than those not later hospitalized (p≤0.001).

TABLE 1. Prevalence of Symptoms Among 18- to 21-Year-Olds and Association With Risk of Later Hospitalization for Nonaffective Psychotic Disorder or for Other Psychiatric Disorders

ABCA vs. B (ref.)A vs. C (ref.)B vs. C (ref.)
SymptomHospitalized for Nonaffective Psychotic Disorder (%) (N=1,092)Hospitalized for Other Psychiatric Disorders (%) (N=1,358)Not Hospitalized for Psychiatric Disorders (%) (N=112,533)Hazard Ratio95% CIHazard Ratio95% CIHazard Ratio95% CI
Negative affect28.231.028.30.890.76–1.050.920.77–1.060.980.82–1.17
Depressed mood19.122.124.60.990.83–1.180.780.65–0.930.890.74–1.08
Disturbance of sleep12.915.616.60.910.73–1.120.780.63–0.960.930.75–1.16
Reduced appetite8.512.911.91.040.82–1.310.840.67–1.071.040.82–1.32
Anxiety17.318.817.50.920.76–1.120.910.75–1.101.020.83–1.26
Disheveled appearance and abnormal behavior9.78.75.21.30*1.02–1.661.941.52–2.481.591.19–2.13
Suicidal ideation7.111.85.80.73*0.55–0.971.170.88–1.551.921.48–2.47
Emotional lability11.48.96.61.240.97–1.591.571.22–2.001.310.97–1.75
Social isolation5.84.73.90.960.72–1.281.741.31–2.331.471.04–2.08
Previous suicide attempt1.93.51.20.53*0.30–0.941.230.70–2.183.001.99–4.51
Impulse control problems2.62.71.30.760.49–1.181.861.19–2.902.481.62–3.80
Aggressive behavior2.71.21.11.250.81–1.902.501.64–3.831.510.83–2.74
Substance abuse1.71.50.51.190.96–2.162.751.52–4.992.791.45–5.39
Thought disorder6.62.70.52.96*2.02–4.357.395.03–10.853.261.74–6.08
Perceptual abnormalities1.60.90.20.510.13–2.051.510.38–6.055.432.43–12.12
Obsessive-compulsive behavior2.32.10.91.180.70–2.002.111.25–3.582.411.39–4.18
Impaired judgment2.51.20.23.00*1.61–5.605.873.14–10.952.811.05–7.52
Poor orientation1.10.3<0.13.22*1.04–10.0213.684.40–42.52
Memory problems0.70.70.22.68*1.00–7.162.691.01–7.181.640.41–6.58
Sexual orientation problems1.10.10.32.03*1.09–3.804.102.20–7.650.500.07–3.53
Sexual dysfunction0.50.50.41.930.62–5.990.940.30–2.921.150.37–3.56
Poor self-esteem2.33.02.10.740.46–1.201.100.68–1.771.761.15–2.69
Somatic problems2.12.22.40.820.49–1.370.790.47–1.311.150.72–1.84
Enuresis0.50.81.20.490.20–1.180.510.21–1.230.990.49–1.99

*p<0.05.

TABLE 1. Prevalence of Symptoms Among 18- to 21-Year-Olds and Association With Risk of Later Hospitalization for Nonaffective Psychotic Disorder or for Other Psychiatric Disorders

Enlarge table

Principal Components Analysis

Nominal categorical principal components analysis to cluster all symptoms identified four clusters (Table 2): 1) depressive symptoms (negative affect, depressed mood, disturbance of sleep, reduced appetite, anxiety, disheveled appearance and abnormal behavior, and suicidal ideation; 2) risk behavior and impulse control problems (impulse control problems, aggressive behavior, and impaired judgment); 3) psychotic symptoms (thought disorder, perceptual abnormalities, poor orientation, and previous suicide attempts); 4) other symptoms (social isolation, emotional lability, poor self-esteem, and substance abuse). Sexual orientation problems, obsessive-compulsive behavior, memory problems, somatic problems, sexual dysfunction, and enuresis did not load on any cluster (loadings <0.3) and therefore were not included in the final principal components analysis. Each cluster had an eigenvalue >1, and the total variance accounted for was 29.95%. Although this value may seem low, a smaller proportion of explained variance is expected when categorical variables are used in principal components analysis (11).

TABLE 2. Categorical Principal Components Analysis of Symptoms in 18- to 21-Year-Oldsa

SymptomDepressive SymptomsRisk Behavior and Impulse Control ProblemsPsychotic SymptomsOther Symptoms
Negative affect0.55–0.30
Depressed mood0.52–0.38
Disturbance of sleep0.58–0.41
Reduced appetite0.48–0.46
Anxiety0.36
Disheveled appearance and abnormal behavior0.470.24
Suicidal ideation0.410.26
Impulse control problems0.540.39
Aggressive behavior0.210.540.200.41
Impaired judgment–0.410.25
Previous suicide attempts0.240.37
Thought disorder0.23–0.24–0.440.31
Perceptual abnormalities–0.460.55
Poor orientation–0.380.54
Social isolation0.330.35
Emotional lability0.380.38
Poor self-esteem–0.250.36
Substance abuse0.39
Sexual orientation problems0.24–0.260.260.25
Obsessive-compulsive behavior–0.29–0.25
Memory problems–0.24
Somatic problems0.23–0.28
Sexual dysfunction
Enuresis
Eigenvalue2.391.531.451.82
% of variance9.946.386.047.60

aOnly loadings ≥0.2 are presented.

TABLE 2. Categorical Principal Components Analysis of Symptoms in 18- to 21-Year-Oldsa

Enlarge table

Risk of Hospitalization for Nonaffective Psychotic Disorder After Index Mental Health Examination

The risk of hospitalization for a nonaffective psychotic disorder was elevated for the entire duration of follow-up among individuals who presented with psychotic symptoms (hazard ratio=5.37, 95% CI=4.36–6.61; follow-up mean=5.3 years, median=5.2 years, range=0–9.3 years) (Table 3). However, the association between psychotic symptoms and hospitalization attenuated over time. In individuals hospitalized within 14 days, the hazard ratio was 45.80 (95% CI=22.87–91.73), and it decreased to 1.57 (95% CI=0.91–2.71) in those who were hospitalized 3.5 years or more after the index examination. Sensitivity similarly decreased from 48.84% for the group hospitalized within 14 days to 3.66% for the group hospitalized 3.5 years or more after the index examination. The specificity was 98.20%. The positive predictive values of this cluster ranged from 0.54% to 1.99%. Among those who presented with thought disorder or perceptual abnormalities, the risk of hospitalization for a nonaffective psychotic disorder for the entire duration of follow-up relative to the nonhospitalized comparison group was sixfold higher (hazard ratio=6.09, 95% CI=4.20–8.83).

TABLE 3. Risk for Hospitalization for a Nonaffective Psychotic Disorder Using Clusters From Principal Components Analysis, Including Positive Predictive Value (PPV), Sensitivity, and Specificity, by Interval From Index Mental Health Examination to Hospitalization

Cluster
Depressive SymptomsRisk Behavior and Impulse Control ProblemsPsychotic SymptomsOther Symptoms
MeasureStatistic95% CIStatistic95% CIStatistic95% CIStatistic95% CI
Hospitalization for nonaffective psychotic disorder during entire duration of follow-up
Hazard ratio0.770.68–0.872.251.76–2.885.374.36–6.611.441.21–1.70
PPV0.930.86–1.022.72.13–3.411.010.83–1.201.471.27–1.70
Sensitivity48.945.90–51.9119.5715.10–24.705.154.27–6.2017.1214.96–19.52
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04
Hospitalization for nonaffective psychotic disorder 1–14 days from index examination
Hazard ratio0.490.25–0.944.482.06–9.7745.822.87–91.732.451.25–4.79
PPV0.040.02–0.060.350.17–0.691.030.65–1.590.130.08–0.22
Sensitivity55.8140.01–70.5920.9310.58–36.4848.8433.56–64.3239.5325.37–55.55
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04
Hospitalization for nonaffective psychotic disorder 15–111 days from index examination
Hazard ratio0.770.54–1.102.841.63–4.9619.5913.08–29.331.641.09–2.46
PPV0.140.11–0.180.580.34–0.981.991.45–2.710.290.20–0.49
Sensitivity56.6448.10–64.8210.496.19–17.0028.6721.58–36.9325.1718.47–33.25
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04
Hospitalization for nonaffective psychotic disorder 112–365 days from index examination
Hazard ratio0.660.46–0.941.60.69–3.694.942.59–9.401.520.95–2.44
PPV0.110.08–0.140.240.01–0.540.540.28–0.990.180.12–0.28
Sensitivity44.235.84–52.894.351.78–9.637.924.24–14.1516.6711.07–24.17
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04
Hospitalization for nonaffective psychotic disorder 1–3.5 years from index examination
Hazard ratio0.770.62–0.952.571.67–3.933.422.21–5.281.220.90–1.64
PPV0.320.27–0.360.930.60–1.041.120.73–1.700.440.34–0.58
Sensitivity46.4941.44–51.626.234.12–9.265.973.91–8.9614.5511.26–18.56
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04
Hospitalization for nonaffective psychotic disorder ≥3.5 years from index examination
Hazard ratio0.690.39–1.181.550.95–2.561.570.91–2.711.471.09–1.99
PPV0.330.29–0.390.660.40–1.080.690.39–1.180.440.33–0.57
Sensitivity49.3544.24–54.474.442.69–7.153.662.09–6.2014.3611.09–18.37
Specificity49.9449.65–50.2497.7397.64–97.8198.298.12–98.2888.8688.67–89.04

TABLE 3. Risk for Hospitalization for a Nonaffective Psychotic Disorder Using Clusters From Principal Components Analysis, Including Positive Predictive Value (PPV), Sensitivity, and Specificity, by Interval From Index Mental Health Examination to Hospitalization

Enlarge table

The risk of later hospitalization for a nonaffective psychotic disorder was also increased for the entire duration of follow-up among individuals who presented with risk behavior and impulse control problems, as it was for those who presented with social isolation, emotional lability, poor self-esteem, and substance abuse (hazard ratio=2.25, 95% CI=1.76–2.88, and hazard ratio=1.44, 95% CI=1.21–1.70, respectively) (Table 3). In contrast, depressive symptoms were associated with a lower risk for hospitalization for a nonaffective psychotic disorder for the entire duration of follow-up (hazard ratio=0.77, 95% CI=0.68–0.87) (Table 3).

In the subanalysis performed on the high-risk group of individuals who presented with psychotic symptoms at the first mental health examination, the presence of symptoms from the impulse control and risk behavior problems cluster (hazard ratio=3.64, 95% CI=2.33–5.68) or other symptoms (hazard ratio=1.70, 95% CI=1.17–2.47) was associated with an elevated risk for hospitalization for a nonaffective psychotic disorder for the entire follow-up period.

Risk of Hospitalization for Other Psychiatric Disorders After Index Mental Health Examination

The risk of hospitalization for other psychiatric disorders during the entire follow-up period was elevated among individuals who presented with psychotic symptoms (hazard ratio=3.14, 95% CI=2.25–4.38), impulse control and risk behavior problems (hazard ratio=2.04, 95% CI=1.42–2.95), or symptoms from the other symptoms cluster (hazard ratio=1.46, 95% CI=1.17–1.183). Analyses stratified by time from index examination were also conducted, utilizing the same groups as for hospitalization for nonaffective psychotic disorders (Table 1; see also the online data supplement). The association between psychotic symptoms or impulse control and risk behavior problems and hospitalization attenuated over time, with a pattern similar to that observed for hospitalization for nonaffective psychotic disorders, although the strength of the associations were slightly lower.

Discussion

In this study of a population-based sample of 18- to 21-year-olds, the strongest predictor of hospitalization for a nonaffective psychotic disorder was the presence of a cluster of symptoms including thought disorder, perceptual abnormalities, poor orientation, and suicidality at the time of the index mental health examination. These results confirm previous findings, from studies conducted both in specialized prodromal clinics (4, 7) and in the general population (12, 13), that subthreshold psychotic symptoms are associated with an elevated risk for later developing a psychotic disorder. The results further support the focus of prodromal clinics on individuals with attenuated psychotic symptoms, as this study shows that even within primary mental health care settings, this group had the greatest risk for later hospitalization for nonaffective psychotic disorders. We also found that risk behavior and impulse control problems were associated with later hospitalization for nonaffective psychotic disorders. This is in agreement with previous reports of behavioral and emotional instability, impulsivity, and problems with aggression control before the clinical onset of psychotic disorders (1416).

Depressive symptoms were associated with lower risk for hospitalization for nonaffective psychotic disorder. Some studies have reported that depression is highly prevalent in the prodromal phase of psychotic illness (2), and it has been found to be predictive of psychotic disorder in prodromal individuals (5) and in individuals in the general population presenting with hallucinations (17), while other studies did not find dysphoric mood to contribute uniquely to psychosis prediction (7) or suggested that depression before the onset of the first psychotic episode was more strongly associated with a later diagnosis of an affective psychosis than with a later diagnosis of schizophrenia (18).

The North American Prodrome Longitudinal Study (7) reported a positive predictive value of 52% for prodromal patients with higher levels of unusual thought content and suspicion/paranoia, and positive predictive values between 68% and 80% for prediction algorithms combining two or three of the following: genetic risk for schizophrenia, deterioration in functioning, unusual thought content, suspicion/paranoia, social impairment, and a history of substance abuse. The prospective European Prediction of Psychosis Study (4) predicted transition to psychosis using positive symptoms, bizarre thinking, sleep disturbances, a schizotypal disorder, past-year level of functioning, and years of education; that model had a positive predictive value of 83.3%. A meta-analysis of the prediction ability of prodromal clinical interview instruments for later active psychosis showed very good predictive power in help-seeking individuals but not in the general population, with a reported positive predictive value of 5.7% (19). Our population-based study yielded positive predictive values that are at the lower range of the latter estimate, in particular within the first 111 days after first examination. Those hospitalized within 2 weeks of the index mental health examination had a hazard ratio of 45 for psychotic symptoms, suggesting that these adolescents were probably already acutely psychotic, hence were hospitalized within days, and probably should have been diagnosed as suffering from a psychotic disorder at their examination. As time to hospitalization increased, the predictive ability of psychotic symptoms decreased gradually, as is expected. In psychotic illness, psychotic symptoms usually appear at low intensity and gradually increase over time until reaching a threshold enabling diagnosis (7).

The lower positive predictive value in population-based settings compared with prodromal clinics is likely due to the fact that patients often arrive at prodromal clinics after consecutive stages of screening, e.g., first being examined by a school psychologist or a family physician, then being referred to a general psychiatrist, and only then being referred to a specialized prodromal clinic. The psychopathology in patients assessed in prodromal clinics is substantial (20), and these patients are very different from 18- to 21-year-olds presenting at a military mental health outpatient clinic. As military service in Israel is mandatory, soldiers represent the general population in Israel in the 18- to 21-year age range and hence are, we believe, comparable to individuals seeking treatment at a college mental health clinic. The nature of our study population, representative of the general population, may be a possible explanation for the clusters including symptoms that do not seem to fit together. For example, “psychotic symptoms” include poor orientation and suicide attempts, and the cluster “other symptoms” includes a mixture of clinical features that appear unrelated to each other (sexual orientation, self-esteem, substance abuse, obsessive-compulsive behavior). These results reflect the empirical clustering of symptoms in this general population cohort, and they probably reflect the heterogeneity of this sample, as opposed to the more homogeneous population of high-risk prodromal patients.

We found a significant association between the presence of psychotic symptoms and hospitalization for other psychiatric disorders, although to a lesser magnitude than for hospitalization for nonaffective psychotic disorders. This is in agreement with previous work reporting that two-thirds of individuals classified as high risk will not convert to full psychotic disorder, with the majority of these individuals experiencing nonpsychotic disorders (21).

To our knowledge, this is the first study on symptoms associated with the psychosis prodrome that is population-based and uses a prospective, albeit historical, design. We know of only one other population-based study on the topic, the seminal ABC Schizophrenia Study (2, 22). That study, however, collected data retrospectively and compared case subjects with healthy comparison subjects. The overwhelming majority of previous prospective studies on the prodrome have focused on highly selected patients with diagnostic uncertainty or persons already manifesting mild psychotic symptoms at the time of referral (23).

This study has several important strengths. First, the military has little tolerance for odd behaviors, which leads to a low threshold for referral to a mental health examination. Our sample therefore may include case subjects who would not necessarily seek medical attention or might not be referred for psychiatric consultation in a community setting. Second, the national Psychiatric Hospitalization Case Registry lists all psychiatric hospitalizations in Israel. Therefore, this study has little loss to follow-up, in contrast to studies from prodromal clinics, which are prone to loss to follow-up. In addition, we were able to follow these individuals for a prolonged period, up to 9 years, to verify hospitalization for psychotic disorder.

Nevertheless, limitations of the study should be acknowledged. Our sample did not include individuals with very poor functioning in adolescence, as they are not drafted into the IDF. Also, the military mental health examination is a standard clinical examination without a formal assessment for prodromal symptoms. Nevertheless, many of the symptoms that appear in prodrome questionnaires, such as the Structured Interview for Prodromal Symptoms and the Scale of Prodromal Symptoms (24), are included in the interviews conducted by military mental health professionals, including unusual thought content, subthreshold perceptual abnormalities, social isolation, and sleep disturbance. It is possible that if an instrument specifically aimed at identifying prodromal symptoms had been administered to all 18- to 21-year-olds, more of the future patients would have been identified. In addition, some individuals might have been treated successfully as outpatients and hence avoided hospitalization.

In summary, among 18- to 21-year-olds in a general population setting, the presence of psychotic symptoms was associated with later hospitalization for a nonaffective psychotic disorder. However, the positive predictive value of these symptoms was very low. The clinical setting of this study, characterized by a low threshold and high sensitivity to odd and unusual behaviors, and use of a population-based sample performing mandatory military service, coupled with free access to health care, point to the challenges of applying prediction algorithms or risk calculators (20) outside the context of the specialized prodromal clinics in which they were developed.

From the Departments of Diagnostic Imaging and Psychiatry, Sheba Medical Center, Ramat Gan, Israel; the Departments of Psychiatry and Preventive Medicine, Friedman Brain Institute and Mindich Institute of Child Health and Development, Icahn School of Medicine at Mount Sinai, New York; the Department of Mental Health, Israeli Defense Forces Medical Corps, Ramat Gan, Israel; the Department of Psychiatry, Rambam Medical Center, Haifa, Israel; Rappaport School of Medicine, Technion-Israel Institute of Technology, Haifa, Israel; the Department of Mental Health, Ministry of Health, Jerusalem, Israel; the Department of Psychology, Hebrew University, Jerusalem, Israel; and the Department of Psychiatry, Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel.
Address correspondence to Prof. Weiser ().

Presented in part at the 55th Annual Meeting of the American College of Neuropsychopharmacology, Hollywood, Florida, Dec. 4–8, 2016.

Dr. Davidson is employed by Minerva Neurosciences and has stock options. The other authors report no financial relationships with commercial interests.

References

1 Addington J, Liu L, Buchy L, et al.: North American Prodrome Longitudinal Study (NAPLS 2): the prodromal symptoms. J Nerv Ment Dis 2015; 203:328–335Crossref, MedlineGoogle Scholar

2 Häfner H, Maurer K, an der Heiden W: ABC Schizophrenia Study: an overview of results since 1996. Soc Psychiatry Psychiatr Epidemiol 2013; 48:1021–1031Crossref, MedlineGoogle Scholar

3 Mason O, Startup M, Halpin S, et al.: Risk factors for transition to first episode psychosis among individuals with “at-risk mental states”. Schizophr Res 2004; 71:227–237Crossref, MedlineGoogle Scholar

4 Ruhrmann S, Schultze-Lutter F, Salokangas RKR, et al.: Prediction of psychosis in adolescents and young adults at high risk: results from the prospective European Prediction of Psychosis Study. Arch Gen Psychiatry 2010; 67:241–251Crossref, MedlineGoogle Scholar

5 Yung AR, Phillips LJ, Yuen HP, et al.: Risk factors for psychosis in an ultra high-risk group: psychopathology and clinical features. Schizophr Res 2004; 67:131–142Crossref, MedlineGoogle Scholar

6 Fusar-Poli P, Schultze-Lutter F, Cappucciati M, et al.: The dark side of the moon: meta-analytical impact of recruitment strategies on risk enrichment in the clinical high risk state for psychosis. Schizophr Bull 2016; 42:732–743Crossref, MedlineGoogle Scholar

7 Cannon TD, Cadenhead K, Cornblatt B, et al.: Prediction of psychosis in youth at high clinical risk: a multisite longitudinal study in North America. Arch Gen Psychiatry 2008; 65:28–37Crossref, MedlineGoogle Scholar

8 Perkins DO, Jeffries CD, Cornblatt BA, et al.: Severity of thought disorder predicts psychosis in persons at clinical high-risk. Schizophr Res 2015; 169:169–177Crossref, MedlineGoogle Scholar

9 Weiser M, Kanyas K, Malaspina D, et al.: Sensitivity of ICD-10 diagnosis of psychotic disorders in the Israeli National Hospitalization Registry compared with RDC diagnoses based on SADS-L. Compr Psychiatry 2005; 46:38–42Crossref, MedlineGoogle Scholar

10 Weiser M, Werbeloff N, Dohrenwend BP, et al.: Do psychiatric registries include all persons with schizophrenia in the general population? A population-based longitudinal study. Schizophr Res 2012; 135:187–191Crossref, MedlineGoogle Scholar

11 Kolenikov S, Gustavo A: The use of discrete data in PCA: theory, simulations, and applications to socioeconomic indices. Chapel Hill, University of North Carolina, Carolina Population Center, Oct 20, 2004. https://www.measureevaluation.org/resources/publications/wp-04-85/at_download/documentGoogle Scholar

12 Kaymaz N, Drukker M, Lieb R, et al.: Do subthreshold psychotic experiences predict clinical outcomes in unselected non-help-seeking population-based samples? A systematic review and meta-analysis, enriched with new results. Psychol Med 2012; 42:2239–2253Crossref, MedlineGoogle Scholar

13 Werbeloff N, Drukker M, Dohrenwend BP, et al.: Self-reported attenuated psychotic symptoms as forerunners of severe mental disorders later in life. Arch Gen Psychiatry 2012; 69:467–475Crossref, MedlineGoogle Scholar

14 Marwaha S, Broome MR, Bebbington PE, et al.: Mood instability and psychosis: analyses of British national survey data. Schizophr Bull 2014; 40:269–277Crossref, MedlineGoogle Scholar

15 Olin SS, John RS, Mednick SA: Assessing the predictive value of teacher reports in a high risk sample for schizophrenia: a ROC analysis. Schizophr Res 1995; 16:53–66Crossref, MedlineGoogle Scholar

16 Lee SJ, Yoo SY, Kang D-H, et al.: Potential vulnerability markers within the affective domain in subjects at genetic and clinical high risk for schizophrenia. Psychopathology 2008; 41:236–244Crossref, MedlineGoogle Scholar

17 Krabbendam L, Myin-Germeys I, Hanssen M, et al.: Development of depressed mood predicts onset of psychotic disorder in individuals who report hallucinatory experiences. Br J Clin Psychol 2005; 44:113–125Crossref, MedlineGoogle Scholar

18 Iyer SN, Boekestyn L, Cassidy CM, et al.: Signs and symptoms in the pre-psychotic phase: description and implications for diagnostic trajectories. Psychol Med 2008; 38:1147–1156Crossref, MedlineGoogle Scholar

19 Fusar-Poli P, Cappucciati M, Rutigliano G, et al.: At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction. World Psychiatry 2015; 14:322–332Crossref, MedlineGoogle Scholar

20 Addington J, Cornblatt BA, Cadenhead KS, et al.: At clinical high risk for psychosis: outcome for nonconverters. Am J Psychiatry 2011; 168:800–805LinkGoogle Scholar

21 Lin A, Wood SJ, Nelson B, et al.: Outcomes of nontransitioned cases in a sample at ultra-high risk for psychosis. Am J Psychiatry 2015; 172:249–258LinkGoogle Scholar

22 Häfner H, an der Heiden W: The course of schizophrenia in the light of modern follow-up studies: the ABC and WHO studies. Eur Arch Psychiatry Clin Neurosci 1999; 249(suppl 4):14–26Crossref, MedlineGoogle Scholar

23 Klosterkötter J, Hellmich M, Steinmeyer EM, et al.: Diagnosing schizophrenia in the initial prodromal phase. Arch Gen Psychiatry 2001; 58:158–164Crossref, MedlineGoogle Scholar

24 Miller T, Mednick SA, McGlashan T, et al.: Early Intervention in Psychotic Disorders. Dordrecht, the Netherlands, Kluwer Academic Publishers, 2001CrossrefGoogle Scholar

25 Israel Ministry of Health: Mental Health in Israel: Statistical Annual 2012. Jerusalem, Ministry of Health, Department of Information and Evaluation, 2013 (Hebrew and English). www.health.gov.il/PublicationsFiles/mtl-Yearbook-2012.pdfGoogle Scholar