Identifying Social Skills That Support Housing Attainment and Retention Among Homeless Persons With Serious Mental Illness
Abstract
Objective:
By combining supportive services with independent housing, permanent supportive housing (PSH) programs effectively address homelessness. Yet, many persons with serious mental illness struggle to attain and retain housing in these programs. Social skills—which facilitate social interactions and instrumental tasks—predict premature exit from PSH. This project aimed to build consensus on a set of social skills that supports independent housing attainment and retention among homeless persons with serious mental illness, with a clinical focus on PSH programs.
Methods:
Guided by the RAND/University of California, Los Angeles, appropriateness method, the set of social skills was developed by using literature review; key informant interviews (N=12), a national consensus panel of experts in psychosocial rehabilitation and homelessness (N=11), and two focus groups with homeless persons with serious mental illness (N=17).
Results:
These methods identified 24 social skills in seven domains: finding and renting an apartment, using one’s time well, getting closer to people, managing finances, avoiding problems with drugs and alcohol, solving interpersonal problems, and managing one’s health. Expert panelists and focus group participants agreed that these social skills were feasible for inclusion in social skills training and could strongly affect housing outcomes in PSH settings.
Conclusions:
Consensus was reached about a set of social skills relevant to housing attainment and retention for persons with serious mental illness engaged in PSH. Next steps include modifying social skills training interventions to this skill set, making contextual modifications relevant to the setting and context of PSH, and studying the effectiveness and implementation of the adapted intervention in PSH.
HIGHLIGHTS
Many homeless persons with serious mental illness struggle to attain and retain housing in permanent supportive housing programs.
Social skills are an important but underappreciated determinant of housing acquisition and retention.
Consensus was reached about a set of social skills relevant to housing attainment and retention for persons with serious mental illness engaged in permanent supportive housing.
Serious mental illness is one of the strongest risk factors for experiencing homelessness (1). Persons with serious mental illness (defined here as a psychotic disorder, bipolar disorder, major depressive disorder, or posttraumatic stress disorder) (2) often have difficulty managing even routine tenant-landlord conflicts (3), increasing their risk of eviction. Serious psychiatric symptoms (e.g., psychosis) can pose barriers to basic household tasks and social relationships. Even when engaged in permanent supportive housing (PSH) programs (4, 5), which provide permanent, community-based housing and field-based supportive services, this population’s social and cognitive impairments can hinder housing acquisition and maintenance (6–8).
Moreover, among persons with serious mental illness who have experienced homelessness (hereafter, “homeless-experienced” persons), social skills—which facilitate social interactions and instrumental tasks, like money management (9)—are an important but underappreciated determinant of housing acquisition and retention (10, 11). Although the literature describes social skills that improve community functioning among persons with serious mental illness (12, 13), it generally reflects persons who do not live independently (e.g., who live with family). There is no consensus regarding a set of social skills that supports independent housing attainment and retention among homeless-experienced persons with serious mental illness.
Social skills are operationalized as an individual’s ability to communicate emotions and other requests in interpersonal situations. For persons with serious mental illness, there are strong relationships between social skills and functional outcomes, like vocational activities. Unfortunately, many persons have deficits in social skills that persist throughout their illness (9). Social skills training strengthens interpersonal skills through behavioral instruction, that is, role modeling, practice, feedback, and guidance to apply learned skills in everyday life (9, 14). For persons with schizophrenia, these interventions have a moderate mean effect size on community functioning, a large weighted mean effect size on social skills, and a small to moderate mean effect size on symptoms (14).
Yet, at present, although serious mental illness conveys significant risk of homelessness (1)—and despite evidence that social skills are associated with housing outcomes in this group (6, 8, 10, 15–17)—few, if any, social skills training interventions are designed to address skills that are relevant in the context of PSH (e.g., interactions with landlords or neighbors). Of note, there are two PSH models. Single-site PSH subsidizes housing in dedicated multiunit facilities for homeless-experienced or low-income persons, often with on-site services. In contrast, scattered-site PSH—the preferred and more common approach to PSH and public housing— subsidizes housing in the general community (at market-defined rental rates) while providing field-based support (18, 19). To develop interventions that are accessible and useful for scattered-site PSH participants with serious mental illness, there is a pressing need to identify a set of social skills that supports this population’s housing attainment and retention. Given that scattered-site PSH employs independent housing in the community, these social skills can also support persons who live independently.
PSH is an evidence-based practice that addresses homelessness among persons with serious mental illness. Prior research substantiates positive health and psychosocial outcomes of this intervention (e.g., decreased substance use, decreased hospitalizations, increased perceived autonomy, and improved housing retention) (4, 20–22). Although PSH boasts high housing retention (85% remain housed 1 year after move-in) (23), characteristics related to psychiatric diagnoses are salient predictors of program “failure” (e.g., problems acquiring or keeping housing) (10, 24–27). Social skills and symptoms contribute to housing attainment and retention in PSH. Given widespread PSH implementation, the loss of housing by 15% of participants in year 1 translates to a significant number of persons (who are disproportionately diagnosed as having serious mental illness) (10). Innovations that address predictors of housing outcomes in this group—including social skills that influence housing acquisition and maintenance—are needed to improve PSH outcomes.
In identifying social skills that support this population’s housing attainment and retention, this study drew upon a classification system developed by Stirman and colleagues (28) that codifies modifications and adaptations to effective interventions. Specifically, developing consensus on a set of social skills is relevant to the content modification of effective social skills interventions. Specific content modifications included in this classification system include adding elements (intervention modules), removing elements (removing or skipping intervention modules), and substituting elements (a module is replaced with something different in substance) (28). Here, modules refer to specific social skills taught by the intervention.
To inform content modifications, this study aimed to identify a set of social skills strongly supported by a group of diverse stakeholders as important for housing attainment and retention among homeless-experienced persons with serious mental illness. The clinical focus was scattered-site PSH programs. Estimates were also obtained regarding stakeholders’ perceptions of the likelihood that a PSH participant with serious mental illness could learn and apply each social skill after completion of typical social skills training protocols.
Methods
The set of social skills was developed by using a literature review, key informant interviews, a national consensus panel of experts in psychosocial rehabilitation and homelessness, and focus groups with homeless-experienced persons with serious mental illness. Data were collected from February 2017 to January 2018. The U.S. Department of Veterans Affairs (VA) Greater Los Angeles’ Institutional Review Board approved all procedures. Because key informants and expert panelists were not considered human subjects, informed consent was not obtained from these groups. Informed consent was obtained from focus group participants.
The literature review included published journal articles, clinical manuals, and unpublished documents on social skills training for persons with serious mental illness. The review began with meta-analyses and systematic reviews published in English from 1990 to 2015, identified using the following keywords in PsycINFO and MEDLINE: social skills training, skills training, serious mental illness, severe mental illness, and schizophrenia. Six articles were identified. Next, one author (S.G.) spoke with authors of these articles and clinical leaders in this area. These individuals were asked for additional salient literature on this subject (regardless of publication status) and for the names of other knowledgeable persons in this area. After several iterations, this process led to the review of articles cited in the introduction of this article and other key references (29–34). Twelve articles, three clinical manuals, and three unpublished documents were included.
To complement this review with the clinical experiences and practice evidence of national leaders in this area, key informant interviews were conducted (in person or by phone) with 12 experts, including clinicians, implementation leaders, researchers, and academicians. Respondents were selected for their national or regional reputation as leaders in this field; most had authored articles from the literature review and others were recommended as content experts by these authors. Efforts were made to ensure that respondents represented a breadth of stakeholders in mental health treatment. Informants were asked to discuss social skills that they believed were most important to improve community functioning among persons with serious mental illness; they were also asked to identify and describe social skills that were most pertinent to homeless-experienced persons with serious mental illness during the transition into independent apartments. Interviews also discussed social skills training content of limited or no relevance to the population of interest.
The interviewer took detailed notes during each interview; two authors (S.G. and E.K.) used these notes to systematically create templated summaries of each interview, matching domains in the interview guide (35). Matrix analysis methods were used to synthesize key themes by domain and develop a detailed list of relevant social skills (36). This list was reviewed to identify categories that were conceptually consistent with the literature review and with established social skills training interventions that are effective for persons with serious mental illness (12, 13). Two authors (S.G. and A.Y.) reviewed these skills, identified redundancies and similar themes, and reworded skills as needed.
A national panel of 11 individuals was subsequently identified, including prominent clinicians, academic experts, and administrators with expertise in homelessness or psychosocial rehabilitation for persons with serious mental illness. Reputation-based snowball sampling—beginning with a list of experts identified by the authors (37)—was used to recruit a panel with demonstrated experience in the rehabilitation of homeless-experienced persons or persons with serious mental illness. Four panelists were clinical and research psychologists focused on psychosocial rehabilitation, five were primary care physician-investigators with expertise in homelessness, and two were licensed clinical social workers with doctoral degrees who were experienced in homelessness and serious mental illness. The approach used was modified from the RAND/University of California, Los Angeles, appropriateness method (38), which has been employed in numerous studies (39–41) to reach consensus on mental health practices.
Each panelist was e-mailed a document presenting an overview of the proposed intervention and its goals, an executive summary of findings from the literature review and key informant interviews, and salient literature on social skills training for persons with serious mental illness. Panelists were also e-mailed a link to a Web-based preconference survey that included a list of 39 social skills and two questions regarding each skills. Skills were identified from core themes in the literature review and key informant interviews; themes were matched with skills from the literature review’s clinical manuals (12, 13, 42). Some skills were adapted to reflect interview narratives. Asking panelists to think of homeless-experienced consumers with serious mental illness engaged in scattered-site PSH, survey questions assessed feasibility and impact, respectively: “How likely is it that a consumer could apply this skill in his/her everyday life?” and “How likely is this skill to substantially improve consumers’ rates of housing attainment or retention?” These domains have precedent in mental health consensus panels (39, 41). Responses to both questions were made on a 9-point Likert scale (1, extremely likely, to 9, extremely unlikely. Panelists were also given the opportunity to add social skills (in free response fields), rating them 1 to 3 in feasibility and impact.
Means, standard deviation, and the number of responses with ratings of >3 (responses of 3 anchored as moderately feasible or impactful) were calculated for each skill (in total and by feasibility and impact separately). These summary statistics were fact-checked and reviewed with several key informants who were not panelists; eight skills with rating dispersion (mean score of <3 but >25% of responses of >3) were identified for further discussion.
The national panel was virtually convened (by telephone or Web-based modality) in August 2017 to reach consensus on the final set of social skills. The goal of the conference was to refine the set of social skills while increasing consensus for the final product. Preconference ratings were summarized, and the research evidence supporting the aforementioned eight skills was reviewed. Panelists could reword, split, combine, or discard skills. They were encouraged to negotiate areas of disagreement to increase consensus on the final skills. After discussion, panelists confidentially rated each skill again using the questions from the preconference survey.
Last, in two focus groups (about 1 hour each) moderated by two authors (E.K. and S.G.), the set of social skills identified by the panel was discussed with persons with serious mental illness receiving PSH at VA Greater Los Angeles (N=17). Maximum variation purposive sampling (43, 44) was used to select heterogeneous participants across age and gender, two variables associated with differential risk for experiencing homelessness (45–47). Five were women and 12 were men; their mean±SD age was 46.4±14.1 years. Most (N=10) were African American; others were white (N=5), Hispanic (N=1), or Asian (N=1).
The focus groups reviewed the entire set of social skills derived from the expert panel. Participants were given an opportunity to reword, add, or remove skills. They brainstormed behavioral instruction (e.g., pertinent role-plays) for each skill. Both moderators took detailed field notes during the groups; these notes were combined. Parallel to analyses of the key informant interviews, two authors (E.K. and S.G.) used the combined notes to create templated summaries of each focus group that aligned with domains discussed in the focus group (35). Matrix analysis methods (36) identified key themes by domain.
Results
The literature review and key informant interviews were used to identify 39 skills within seven skill domains: finding and renting an apartment, using one’s time well, getting closer to people, managing finances, avoiding problems with drugs and alcohol, solving interpersonal problems, and managing one’s health. This list of skills was presented to the national panel for preconference ratings.
Skills (N=19) with a mean preconference rating of >3 in feasibility or impact were reviewed with selected nonpanelist key informants. Noting the preconference ratings, these skills were discussed iteratively and reworded if needed; four were kept, seven were removed, and eight were marked for panel discussion. Other skills (with mean preconference ratings of ≤3 in feasibility and impact) were also reviewed with these nonpanelist key informants; two additional skills were removed per these discussions. The virtual conference increased consensus on the eight discussed skills. Rewording was suggested for several skills. After each skill was discussed, panelists rated the skill’s feasibility and impact again; two were kept (mean feasibility and impact ≤3) and the other six were removed.
The refined set of 24 skills was shared in the focus groups with homeless-experienced persons with serious mental illness (N=17). These groups enhanced the language of several skills to increase their consumer-centeredness. Although participants could add or remove skills, they opted not to do so; rather, the groups focused on techniques to effectively train the population of interest in these skills (e.g., role-play scenarios relevant to their everyday lives).
Table 1 presents the final set of social skills and their rating by the national panel; when applicable, this table reflects the rewording recommended by the focus groups. The skill rated as most feasible was developing strategies for remembering appointments and medications. The skills rated as having the strongest impact were interviewing for an apartment with a landlord or property manager, finding productive things to do, identifying personal financial patterns, and developing a budget. The mean of all skills was 2.6 for feasibility and 2.4 for impact.
Feasibility | Impact | |||
---|---|---|---|---|
Domain and skill | M | SD | M | SD |
Finding and renting an apartment | ||||
Interviewing for an apartment with a landlord or property manager | 2.7 | 1.4 | 1.9 | 1.4 |
Using one’s time well | ||||
Making a morning, afternoon, and evening schedule | 2.9 | 1.5 | 3.3 | 1.5 |
Finding productive things to do (e.g., work, school, spending time with family or friends, hobbies, spiritual activities) | 2.7 | 1.2 | 1.9 | 1.3 |
Asking for feedback about productive things you are involved with (e.g., asking a supervisor at a volunteer activity to tell you how you are doing) | 2.6 | 1.2 | 2.7 | 1.5 |
Starting a conversation with a new or unfamiliar person | 2.1 | 1.1 | 2.3 | 1.5 |
Getting closer to people | ||||
Making new friends | 2.4 | 2.0 | 2.3 | 1.1 |
Establishing and honoring boundaries with family and friends | 2.8 | 2.2 | 2.2 | 1.4 |
Managing finances | ||||
Identifying personal financial patterns | 2.8 | 1.5 | 1.9 | .9 |
Distinguishing between needs and wants | 2.9 | 1.2 | 2.2 | .8 |
Developing a budget | 2.8 | 1.9 | 1.8 | 1.0 |
Avoiding financial exploitation by family and friends | 3.3 | 1.9 | 2.0 | 1.0 |
Avoiding problems with drugs and alcohol | ||||
Responding to family and friends stop asking you to use drugs and alcohol | 2.6 | 1.3 | 2.4 | 1.5 |
Responding to a stranger or drug dealer | 2.7 | 1.3 | 2.6 | 1.6 |
Solving interpersonal problems | ||||
Asking for help from another person | 2.1 | 1.4 | 2.6 | 1.6 |
Identifying events and cues that make you angry | 2.2 | .8 | 2.0 | 1.6 |
Making effective complaints | 2.3 | 1.9 | 2.6 | 1.8 |
Compromising and negotiating | 2.8 | 2.5 | 2.0 | .9 |
Dealing with other people who are angry | 2.8 | 1.9 | 2.4 | 1.4 |
Managing one’s health | ||||
Developing strategies for remembering appointments and medications | 1.6 | .7 | 2.8 | 1.7 |
Reporting pain and other physical symptoms effectively | 3.0 | 1.5 | 2.1 | 1.0 |
Reporting mood and other mental health symptoms effectively | 2.0 | 1.1 | 2.9 | 1.5 |
Coping with stress | 2.3 | 1.9 | 2.0 | 1.0 |
Using relaxation techniques | 2.4 | 1.9 | 2.9 | 1.3 |
Asking questions about your medications | 2.6 | 2.0 | 3.0 | 1.0 |
Discussion
Despite PSH services, homeless-experienced persons with serious mental illness often struggle to acquire and retain housing (6–8). Although improved social skills can help these individuals exit homelessness (10), there is a dearth of knowledge surrounding specific social skills that affect this population’s housing outcomes. Using literature review, key informant interviews, a national consensus panel, and consumer focus groups, this project identified 24 social skills that enable housing attainment and retention among persons with serious mental illness engaged in scattered-site PSH. Feasibility of training and impact on housing outcomes were concurrent foci of this project. A highly feasible skill with low impact is unlikely to bolster housing outcomes in this vulnerable population. Conversely, persons with serious mental illness are unlikely to see improvement in skills with low feasibility of training, regardless of potential impact.
Prior to this project, there was no known research or consensus development that could inform social skills training interventions for homeless-experienced persons with serious mental illness. The diverse stakeholders who informed this work had considerable experience in psychosocial rehabilitation for persons with serious mental illness or a history of homelessness. There was strong consensus that it was feasible to train the population of interest in an identified set of social skills and that these skills can strongly affect housing attainment and retention among homeless-experienced persons with serious mental illness. In addition, consumers showed strong support for this skill set, changing nomenclature as opposed to content and brainstorming ways to effectively train these skills using behavioral instruction that parallels challenges in their daily lives.
Beyond the content modifications undertaken in this project, there are a number of important issues regarding the implementation of social skills training interventions for persons with serious mental illness engaged in scattered-site PSH. Stirman’s (28) classification system refers to these issues as context modifications (relevant to an intervention’s format, setting, personnel, or population). To guide context modifications, qualitative data collection with PSH staff and participants is a critical next step in this research. For example, homeless persons often have fundamental needs—for food, clothing, or shelter—that compete with their adherence to services (48). As such, incentivizing participation in this intervention and offering flexibility (e.g., open groups allowing walk-in participation) in the training’s structure may be important for this population. Moreover, to improve functioning, social skills training interventions are anchored in role-plays and other strategies that facilitate skill practice in real-world settings (9); the context and setting of PSH settings are distinct from those of psychosocial rehabilitation programs (e.g., day treatment) in which social skills training is frequently delivered. Iterative testing and tailoring of a housing-focused social skills training program will be needed to adapt to the needs of homeless-experienced persons with serious mental illness engaged in scattered-site PSH. In addition, populations with significant comorbidities (e.g., recalcitrant substance abuse) may require disparate sets of social skills and/or treatment delivery modalities.
This set of social skills has limitations. First, the derived set of social skills is not completely inclusive; dependent on a consumer’s strengths and deficits, additional skills may be important for housing attainment and retention. Second, the set of social skills reflects the experiences and perspectives of the specific stakeholders engaged in this project; involvement of other experts or consumers might have resulted in a different skill set. Third, the set of skills will need to be revised as gain a better understanding of specific social skills that predict housing outcomes. Overall, this set of social skills should be viewed with caution until future studies determine whether improving these skills enhances housing attainment and retention among homeless-experienced persons with serious mental illness.
Conclusions
This project established consensus on a set of social skills that facilitate housing attainment and retention for homeless-experienced persons with serious mental illness. Though PSH effectively addresses homelessness, many persons with serious mental illness struggle to obtain and sustain housing in these programs. Little is known about social skills that predict these individual’s housing outcomes. To date, although PSH case managers often perform informal social coaching, there is no literature on the systematic development, implementation, or testing of social skills training interventions for persons with serious mental illness in PSH programs. Moreover, although PSH programs often boast multidisciplinary teams with a breadth of expertise, real-world implementation of PSH often suffers from poor fidelity to supportive services, instead prioritizing speed of housing attainment and low barriers to program entry (49). As PSH programs bolster their supportive services to improve care for the most vulnerable, content modification of social skills training is critically needed. This set of social skills is a first step toward content modifications. Future directions include research on the effectiveness and implementation of a social skills training intervention that is modified to this set of skills. Iterative adaptation and context modifications of this intervention are anticipated to establish an effective intervention with strong potential for systematic uptake in the PSH context.
1 : Risk factors for homelessness. Epidemiol Rev 1993; 15:546–556Crossref, Medline, Google Scholar
2 : Re-engaging Veterans With Serious Mental Illness in Treatment. Washington, DC, Department of Veterans Affairs, Veterans Health Administration, 2012. ]http://www.va.gov/vhapublications/ViewPublication.asp?pub_ID=2476Google Scholar
3 : Some perspectives on deinstitutionalization. Psychiatr Serv 2001; 52:1039–1045Link, Google Scholar
4 : Housing First, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. Am J Public Health 2004; 94:651–656Crossref, Medline, Google Scholar
5 : Decreasing psychiatric symptoms by increasing choice in services for adults with histories of homelessness. Am J Community Psychol 2005; 36:223–238Crossref, Medline, Google Scholar
6 : Cognitive impairments and the prevention of homelessness: research and practice review. J Prim Prev 2007; 28:375–388Crossref, Medline, Google Scholar
7 : A quantitative review of cognitive functioning in homeless adults. J Nerv Ment Dis 2015; 203:126–131Crossref, Medline, Google Scholar
8 : Factors affecting exits from homelessness among persons with serious mental illness and substance use disorders. J Clin Psychiatry 2015; 76:e469–e476Crossref, Medline, Google Scholar
9 : Recent advances in social skills training for schizophrenia. Schizophr Bull 2006; 32(suppl 1):S12–S23Crossref, Medline, Google Scholar
10 : “They’re homeless in a home”: retaining homeless-experienced consumers in supported housing. Psychol Serv 2017; 14:154–166Crossref, Medline, Google Scholar
11 : Problem solving skills and deficits among homeless veterans with serious mental illness. Am J Orthopsychiatry (Epub ahead of print, July 16, 2018)Google Scholar
12 : Social Skills Training for Schizophrenia, 2nd ed. New York, Guildford Press, 2004Google Scholar
13 : Innovations in skills training for the seriously mentally ill: the UCLA social and independent living skills modules. Inno Res 1993; 2:43–59Google Scholar
14 : A meta-analysis of controlled research on social skills training for schizophrenia. J Consult Clin Psychol 2008; 76:491–504Crossref, Medline, Google Scholar
15 : Effect of scattered-site housing using rent supplements and intensive case management on housing stability among homeless adults with mental illness: a randomized trial. JAMA 2015; 313:905–915Crossref, Medline, Google Scholar
16 : Some clinical approaches to the homeless mentally ill. Community Ment Health J 1990; 26:463–480Crossref, Medline, Google Scholar
17 : Neurological deficits in the homeless: a downward spiral. Lancet Neurol 2009; 8:228–229Crossref, Medline, Google Scholar
18 : Applying the Housing First approach to single-site permanent supportive housing. J Soc Distress Homeless (Epub ahead of print, Nov 20, 2018)Google Scholar
19 : Health in all policies: the role of the U.S. Department of Housing and Urban Development and present and future challenges. Health Aff 2012; 31:2130–2137Crossref, Google Scholar
20 : Project-based Housing First for chronically homeless individuals with alcohol problems: within-subjects analyses of 2-year alcohol trajectories. Am J Public Health 2012; 102:511–519Crossref, Medline, Google Scholar
21 : Effectiveness of interventions to improve the health and housing status of homeless people: a rapid systematic review. BMC Public Health 2011; 11:638Crossref, Medline, Google Scholar
22 : Housing First for long-term shelter dwellers with psychiatric disabilities in a suburban county: a four-year study of housing access and retention. J Prim Prev 2007; 28:265–279Crossref, Medline, Google Scholar
23 Tsemberis S: Pathways’ Housing First: Ending Homelessness and Supporting Recovery for People With Psychiatric Disabilities and Addiction Disorders, 2008Google Scholar
24 : Factors associated with premature exits from supported housing. Psychiatr Serv 2016; 67:86–93Google Scholar
25 : Factors that influence returns to homelessness following an exit from permanent supportive housing: health and supportive services utilization proximal to program exit. Fam Soc 2016; 97:221–229Google Scholar
26 : Factors associated with veterans' access to permanent supportive housing. Psychiatr Serv 2016; 67:870–877Google Scholar
27 : Residential moves among housing first participants. J Behav Health Serv Res 2018; 45:124–132Crossref, Medline, Google Scholar
28 : Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci 2013; 8:65Crossref, Medline, Google Scholar
29 : Social skills programmes for schizophrenia. Cochrane Database Syst Rev 2015; 6:CD009006Google Scholar
30 : Social skills training with schizophrenics: a meta-analytic evaluation. J Consult Clin Psychol 1990; 58:741–747Crossref, Medline, Google Scholar
31 : Social skills training in adult psychiatric populations: a meta-analysis. J Behav Ther Exp Psychiatry 1991; 22:203–210Crossref, Medline, Google Scholar
32 : Meta-analytic evaluation of skills training research for individuals with severe mental illness. J Consult Clin Psychol 1996; 64:1337–1346Crossref, Medline, Google Scholar
33 : Efficacy of psychological therapy in schizophrenia: conclusions from meta-analyses. Schizophr Bull 2006; 32(suppl 1):S64–S80Crossref, Medline, Google Scholar
34 : Psychological treatments in schizophrenia: I. meta-analysis of family intervention and cognitive behaviour therapy. Psychol Med 2002; 32:763–782Crossref, Medline, Google Scholar
35 : Qualitative Methods in Rapid Turn-Around Health Service Research: VA HSR&D National Cyberseminar Series: Spotlight on Women's Health. Washington, DC, US Department of Veterans Affairs, 2013.Google Scholar
36 : Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res 2002; 12:855–866Crossref, Medline, Google Scholar
37 : Innovative methods for using expert panels in identifying implementation strategies and obtaining recommendations for their use. Implement Sci 2015; 10:A44Crossref, Medline, Google Scholar
38 : The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica, CA, RAND Corp, 2001Google Scholar
39 : Clinical consensus recommendations for urine testing of adherence to antipsychotics among people with serious mental illness. Psychiatr Serv 2018; 69:345–348Link, Google Scholar
40 : Assessment of suicidal ideation and behavior: report of the International Society for CNS Clinical Trials and Methodology Consensus Meeting. J Clin Psychiatry 2017; 78:e638–e647Crossref, Medline, Google Scholar
41 : Identifying clinical competencies that support rehabilitation and empowerment in individuals with severe mental illness. J Behav Health Serv Res 2000; 27:321–333Crossref, Medline, Google Scholar
42 Mueser KT, Gingerich S: Coping Skills Book: A Session-by-Session Guide With CD. 10th ed. Bohemia, NY, Wellness Reproductions and Publishing, Inc, 2005Google Scholar
43 : Sampling for qualitative research. Fam Pract 1996; 13:522–525Crossref, Medline, Google Scholar
44 : Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health 2015; 42:533–544Crossref, Medline, Google Scholar
45 : Homelessness among female veterans: a systematic review of the literature. Women Health 2013; 53:572–596Crossref, Medline, Google Scholar
46 : “Homelessness and trauma go hand-in-hand”: pathways to homelessness among women veterans. Womens Health Issues 2011; 21(suppl):S203–S209Crossref, Medline, Google Scholar
47 : A review of the literature on the effectiveness of housing and support, assertive community treatment, and intensive case management interventions for persons with mental illness who have been homeless. Am J Orthopsychiatry 2007; 77:350–361Crossref, Medline, Google Scholar
48 : Competing priorities as a barrier to medical care among homeless adults in Los Angeles. Am J Public Health 1997; 87:217–220Crossref, Medline, Google Scholar
49 : Housing first on a large scale: fidelity strengths and challenges in the VA’s HUD-VASH program. Psychol Serv 2017; 14:118–128Crossref, Medline, Google Scholar