The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Global Mental Health Implementation Science ProtocolFull Access

Implementation and Scale-Up of Integrated Depression Care in South Africa: An Observational Implementation Research Protocol

Published Online:https://doi.org/10.1176/appi.ps.202000014

Abstract

Background:

People with chronic general medical conditions who have comorbid depression experience poorer health outcomes. This problem has received scant attention in low- and middle-income countries. The aim of the ongoing study reported here is to refine and promote the scale-up of an evidence-based task-sharing collaborative care model, the Mental Health Integration (MhINT) program, to treat patients with comorbid depression and chronic disease in primary health care settings in South Africa.

Methods:

Adopting a learning-health-systems approach, this study uses an onsite, iterative observational implementation science design. Stage 1 comprises assessment of the original MhINT model under real-world conditions in an urban subdistrict in KwaZulu-Natal, South Africa, to inform refinement of the model and its implementation strategies. Stage 2 comprises assessment of the refined model across urban, semiurban, and rural contexts. In both stages, population-level effects are assessed by using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) evaluation framework with various sources of data, including secondary data collection and a patient cohort study (N=550). The Consolidated Framework for Implementation Research is used to understand contextual determinants of implementation success involving quantitative and qualitative interviews (stage 1, N=78; stage 2, N=282).

Results:

The study results will help refine intervention components and implementation strategies to enable scale-up of the MhINT model for depression in South Africa.

Next steps:

Next steps include strengthening ongoing engagements with policy makers and managers, providing technical support for implementation, and building the capacity of policy makers and managers in implementation science to promote wider dissemination and sustainment of the intervention.

Editor's Note: In partnership with Milton L. Wainberg, M.D., Psychiatric Services is publishing protocols to address the gap between global mental health research and treatment. These protocols present large-scale, global mental health implementation studies soon to begin or under way. Taking an implementation science approach, the protocols describe key design and analytic choices for delivery of evidence-based practices to improve global mental health care. This series represents the best of our current science, and we hope these articles inform and inspire.

Highlights

This study protocol uses an onsite, iterative, observational implementation research design and a learning-health-systems approach to assess the implementation of an evidence-based collaborative model for integrated primary care for depression.

Potential refinements to all components of the model at multiple levels (patient, provider, system) are evaluated simultaneously, in contrast to evaluating the contribution of a fixed implementation strategy on the basis of a set of predetermined outcomes.

The learning-health-systems approach promotes the model’s alignment with and response to the priorities and practicalities of implementation across diverse, real-world settings, which should optimize implementation and wider dissemination.

South Africa faces a substantial burden of multimorbid chronic diseases, including HIV, cardiovascular disease, diabetes, common mental disorders (CMDs) (e.g., depression, anxiety), and substance use disorders (14). Depression is of particular concern. Depression is the most prevalent disorder in South Africa (5), and people with chronic general medical diseases are more likely to experience depression than the general population (6, 7). Furthermore, depression comorbid with chronic general medical conditions compromises patient self-care and adherence to treatment regimens for general medical diseases (810), and this patient population experiences poorer health outcomes and increased mortality (11, 12).

In the context of a 75% treatment gap for CMDs in South Africa (13), the country’s national mental health policy emphasizes the integration of mental health care, including depression care, into primary health care (PHC) via task sharing (14). This focus is in line with health systems reforms toward horizontal integrated programming to respond to the burden of multimorbid diseases in South Africa (14).

PHC-based task sharing as part of pharmacological and psychosocial treatment models for CMDs has proven effective in low- and middle-income countries (LMICs) (15, 16). Furthermore, integrated collaborative stepped care that includes task sharing has been found to be efficient and effective for depression care. Most of this evidence comes from controlled trials in high- and middle-income countries (1719). Few evidence-based models of collaborative stepped care pertain to integrated depression care in real-world, lower-resource contexts (2022). Additionally, evidence is lacking on implementation strategies that enable uptake of integrated primary care for depression within routine primary care in LMICs.

A collaborative task-sharing model for integrated primary care for depression was developed through the Program for Improving Mental Health Care (PRIME) in South Africa (PRIME-SA) (23). The model’s efficacy and effectiveness were evaluated through a repeat cross-sectional survey in clinics and a comparison group cohort study, which had good outcomes at the facility and patient level (24), and through a pragmatic cluster randomized controlled trial using study-employed lay counselors (25), which found that the model did not produce inferior outcomes compared with care as usual when psychological treatment was provided by mental health specialists (26). However, uptake of the model—in particular, PHC providers’ identification and referral of chronic care patients with comorbid depression—was poor.

In accordance with the translational research continuum (27), this evidence-based model represents the initial Mental Health Integration (MhINT) model evaluated by this observational implementation science protocol to understand how to promote implementation and broader dissemination of the model. Funding obtained from the Centers for Disease Control and Prevention (U2GGH001197) was used to provide technical support to the KwaZulu-Natal Department of Health (KZN DoH) in the KwaZulu-Natal province of South Africa in order to scale up this model in one district, as a test site. The intervention components of the initial MhINT model involve the provision of psychoeducation, screening, and strengthened clinician assessment and diagnosis of depressive symptoms at the PHC facility level (see Figure A1 in the online supplement). The latter is achieved through the provision of enhanced mental health training in the use of Adult Primary Care (APC), known internationally as the Practical Approach to Care Kit (PACK) (28). APC is a clinical decision-making tool providing integrated evidence-based guidelines for the diagnosis and treatment of chronic conditions. It is intended for use by all health care practitioners working at the primary care level and has been rolled out nationally by the South African National Department of Health.

Referral pathways are also strengthened. Depending on severity of depressive symptoms, patients are referred to either nonspecialist clinic-based staff trained to provide psychosocial counseling using cognitive-behavioral techniques and problem solving, both shown to have an evidence base for delivery within nonspecialized health care settings (15); clinic-based PHC doctors with strengthened training to initiate psychotropic medication; or mental health specialists at the district level. To optimize scale-up of this task-sharing model by the KZN DoH, an initial set of implementation strategies was chosen on the basis of practical experience and process evaluation conducted during the formative and outcome evaluation of the PRIME-SA model (23, 24).

Table 1 describes the roles of various health systems actors in implementing this initial model, including the initial set of implementation strategies employed by MhINT. We have aligned these roles to the implementation strategies specified by the Expert Recommendations for Implementing Change (29). We describe the Southern African Research Consortium for Mental Health Integration (SMhINT) evaluation protocol. Our aim is to observe real-world implementation of the initial MhINT model described above in order to identify opportunities to refine and adapt this initial model and to optimize widespread implementation and dissemination of the model in South Africa.

TABLE 1. Overview of MhINT model provider roles, technical support, and implementation strategiesa

ProviderRoleMhINT technical supportb
Mental health coordinator/district mental health task teamProvides overall coordination, monitoring, and evaluationDistrict mental health task team supported through 2-day workshop and mentoring support to undertake a situational analysis that informs a district mental health care plan, which is incorporated into district plans
PsychologistProvides training and supervisionPsychologists oriented and trained through a 4-day workshop in their roles of providing training, supervision, and emotional support to PHC level within a task-sharing approach
Registered psychological counselors/social workersProvide training and supervision; support lay counselorsOrientation and training of registered counselors or equivalent through a 4-day workshop to train and supervise PHC facility-based nonspecialist counselors
PHC coordinators and operational managersSupport mental health integration using CQI2-day training workshop in CQI tools with MhINT-provided mentorship for PHC coordinators and facility managers in CQI to support PHC facilities in integration of depression care
Facility managersOversee implementation and integrationOrientation to responsibilities of different role players in collaborative care model through a half-day workshop; capacitated in CQI for monitoring implementation and data management
PHC staff nurses/enrolled nursesConduct initial mental health screening of the PHC facility populationPer KZN DoH guidelines, MhINT did not initially provide technical support
PHC clinical nurse practitionersIdentify CMDs; provide brief intervention, referral, and reassessmentExisting facility trainers capacitated through a 3-day workshop to provide onsite sessions orienting clinical nurse practitioners to person-centered care and their role as case managers within the collaborative care model; equipped facility trainers with clinical communication skills for person-centered care, use of APC for treatment and referral of CMDs
PHC doctorsInitiate medication; monitor psychotropic medicationOriented to collaborative care model and APC; capacitated in mhGAP-IG guidelines through a half-day workshop
Lay counselors/enrolled nursesProvide evidence-based counseling (CMDs and adherence)Oriented to collaborative care model; capacitated in manualized depression counseling package with problem-solving and cognitive-behavioral techniques through a 5-day workshop; training is followed by individual in vivo supervision and monthly emotional support by the psychological counselors/social workers
Outreach team leaders (PHC clinical nurse practitioners/enrolled nurses)Supervise community health workers; conduct home visits for patients with difficult casesAs per KZN DoH guidelines, MhINT did not initially provide technical support
Community health workersConduct case identification, psychoeducation, and tracing and linkage to careAs per KZN DoH guidelines, MhINT did not initially provide technical support
MhINT implementation strategyERIC strategyPurpose
Situational analysiscConduct local needs assessmentInform development of district mental health plan
Train-the-trainer model for building capacitydUse train-the-trainer strategiesEfficiently train primary care providers
Supportive supervisioneAudit and feedback; provide clinical supervisionMentor providers, monitor competency, and offer emotional support
APC decision support tooleProvide clinical guidelinesPromote nurse-led identification and management of patients with depression and other CMDs
Continuous quality improvementcDevelop and organize quality monitoring systemsIdentify implementation bottlenecks and propose solutions through learning collective

aAPC, adult primary care; CMD, common mental disorders; CQI, continuous quality improvement; KZN DoH, KwaZulu-Natal Department of Health; ERIC, Expert Recommendations for Implementing Change project; mhGAP-IG, Mental Health Gap Intervention Guide; MhINT, Mental Health Integration program; PHC, primary health care.

bIncludes orientation workshops, training, and mentorship. Details of the MhINT training and orientation workshops can be found in the training and orientation manuals on the Centre for Rural Health website (www.crh.ukzn.ac.za).

cSystem level.

dFacility level.

eProvider level.

TABLE 1. Overview of MhINT model provider roles, technical support, and implementation strategiesa

Enlarge table

Methods

Learning-Health-Systems Approach

We are guided by a learning-health-systems approach, where policy makers, researchers, service providers, and patients work as a collective to iteratively coproduce new knowledge and engage in shared decision making to strengthen the health system and health outcomes (30). Critically, learning health systems strive to identify interventions and implementation strategies that work in routine contexts: generating new evidence through research when required, solving practical problems of service delivery, and engaging in rigorous evaluation of program effectiveness to improve quality across the health system (30). This study builds on a sustained partnership between the investigators and the South African Departments of Health at the national, provincial, and district levels through the PRIME and MhINT programs, collectively amounting to 6 years of collaboration.

Study Design

We will use an onsite, iterative, observational implementation science design (27) structured around the four phases of intervention scale-up established by Barker et al. (31): an initial “setup” phase, during which the initial MhINT model is introduced into the system; an early assessment and refinement of the initial model into a “scalable unit” for inclusion in routine PHC services; an assessment of the scalable unit across a variety of contexts that would be encountered at scale; and a “going-to-full-scale” phase, during which a larger number of sites adopt the refined MhINT model. The initial setup phase, involving the introduction of the MhINT model into the study site district, was completed between 2016 and 2018. This protocol covers the assessment and refinement of the model into a scalable unit and the assessment of the scalable unit across contexts (renamed as stages 1 and 2, respectively). Barker et al.’s fourth phase is beyond the scope of this study.

We combine the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework (32) and the Consolidated Framework for Implementation Research (CFIR) (33) with mixed-methods data collection (34) (see Figure A2 in the online supplement). Within the context of our overall aim, the study objectives are described in Box 1.

BOX 1. Objectives of the Mental Health Integration (MhINT) program assessment study

Stage 1: Assessment of the Initial MhINT Model (Urban Setting)

  • Objective 1.1: Assess the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) evaluation framework outcomes of the initial “setup” MhINT model in one subdistrict.

  • Objective 1.2: Assess Consolidated Framework for Implementation Research (CFIR) determinants of the dissemination, impact, and sustainability of the initial setup MhINT model across multiple domains.

  • Objective 1.3: Engage in a participatory process with key stakeholders to recommend refinements to strengthen the MhINT model and its implementation strategies into a “scalable unit.”

Stage 2: Assessment of the Scalable Unit Across Diverse Contexts (Urban, Semiurban, Rural Settings)

  • Objective 2.1: Assess the RE-AIM outcomes of the strengthened MhINT scalable unit across diverse contexts (urban, semiurban, and rural).

  • Objective 2.2: Assess CFIR determinants of the dissemination, impact, and sustainability of the scalable unit MhINT model across diverse contexts (urban, semiurban, rural) to inform further adaptations for going to “full scale.”

  • Objective 2.3: Engage in a participatory process with key stakeholders to recommend refinements to strengthen the MhINT model and its implementation strategies into a full-scale model for wider scale-up.

RE-AIM outlines the critical elements of the population-level effects of health interventions (32). Definitions of the RE-AIM elements are provided in Table 2. Semistructured interviews targeting CFIR domains will be used to explore the implementation component of RE-AIM. CFIR delineates constructs associated with implementation success across several domains: intervention characteristics, such as goodness of fit; inner setting or health system characteristics that may aid or abet integration, including organizational culture; characteristics of the outer setting or external environment, such as policies and community needs; characteristics of individuals, including patient and provider needs; and implementation processes, such as harnessing of support from key stakeholders to improve uptake (33, 35). This study received ethical approval from the University of KwaZulu-Natal Biomedical Research Ethics Committee (reference: BF190/17).

TABLE 2. Characteristics of Amajuba subdistricts: Newcastle, Dannhauser, and eMadlangenia

NewcastleDannhausereMadlangeni
Characteristic(urban)(semiurban)(rural)
Land area (km2)1,8551,5163,539
Population363,236105,34136,869
Poverty rate (%)56.378.680.7
N of households90,34720,8446,667
Income
 No income (%)288334
Health resources
 Hospitals301
 Community health centers010
 PHC facilities14102
 WBPHCOTs552b
 Mobile points123679
Mental health specialists
 Psychologists200
 Sessional psychiatrists100

aPHC, primary health care; WBPHCOT, ward-based primary health care outreach team.

bOne per PHC.

TABLE 2. Characteristics of Amajuba subdistricts: Newcastle, Dannhauser, and eMadlangenia

Enlarge table

Study Sites

The study site is the Amajuba district in the northwest of KwaZulu-Natal, where the MhINT model was implemented. Amajuba has three diverse subdistricts: Newcastle (urban), Dannhauser (semiurban), and eMadlangeni (rural) (Table 2). Assessment of the initial MhINT setup model (objectives 1.1 and 1.2) will be undertaken in 10 of the 14 PHC facilities in the urban Newcastle subdistrict. Assessment of the refined MhINT scalable unit model (objectives 2.1 and 2.2) is planned to take place across all three subdistricts, providing the opportunity to observe how the refined model and implementation strategies perform in the initial urban site (Newcastle) and whether adaptations are needed for semiurban and rural contexts. All PHC facilities are serviced by full-time PHC nurses, including professional nurses with a 4-year degree or diploma, enrolled nurses who have a 2-year diploma, sessional PHC doctors, and HIV counselors. Limited mental health specialists (N=3) are available at referral facilities.

Study Procedures

Objectives 1.1 and 2.1: RE-AIM assessment.

In order to assess the RE-AIM outcomes, a number of data sources, summarized in Table 3, will be used with accompanying subprotocols for the collection of these data. We provide more details on the subprotocols below.

TABLE 3 Key variables and data sources for objectives 1.1, 1.2., 2.1, and 2.2a

Key variableSourceSubprotocolFrequency
Reachb
% of patients screened for CMDs at community level lost to follow-upcClinic recordsSecondary dataQuarterly
Characteristics of chronic care patients lost to follow-up screened and not screened at community levelClinic recordsSecondary dataQuarterly
% of chronic care patients screened for CMDs at facility levelDHIS dataSecondary dataQuarterly
Characteristics of chronic care patients screened and not screened at facility levelPatient cohortsCohortQuarterly
% of positive chronic care patients screened who screened positive for depressionCohort dataCohortOnce
Characteristics of chronic care patients who screened positive or negative for depressioncCohort dataCohortOnce
% of chronic care patients screening positive who are diagnosed and referredCohort dataCohortOnce
Characteristics of chronic care patients screening positive who are diagnosed and referredCohort dataCohortOnce
% of chronic care patients referred for counseling who receive at least one counseling sessionCohort data, project recordsCohort, secondary dataOnce, quarterly
Characteristics of referred patients receiving one or more counseling sessions/not receiving any sessionsCohort data, CFIR interviews with patients receiving one or more counseling sessions and those receiving no sessionsCohort, qualitative dataOnce
% of clinic population receiving mental health treatment initiationDHIS dataSecondary dataMonthly
Effectivenessd
Depressive symptomsPatient cohorts3-month cohort dataOnce
DisabilityPatient cohorts3-month cohort dataOnce
Adherence to prescribed medicationsPatient cohorts3-month cohort dataOnce
Perceived stressPatient cohorts3-month cohort dataOnce
Adoptione
Facility-level rate of morning talkFacility recordsSecondary dataMonthly
Characteristics of facilities with greater/fewer morning talks on CMDs per monthFacility profiles, ORIC, MICA, CFIR interviews with facility managers and counselors/health promotersSecondary data, quantitative data, qualitative dataAnnually, once
Facility-level rate of screening of chronic care patients for CMDsDHIS dataSecondary dataMonthly
Characteristics of facilities achieving KwaZulu-Natal Department of Health screening targets (35% of head count/less than 35% of head count)Facility profiles, ORIC, MICA, CFIR interviews with facility managers and enrolled nursesSecondary data, quantitative data, qualitative dataAnnually, once
Facility-level rate of diagnosis and referral of chronic care patients screening positive for depressionCohortCohort dataOnce
Characteristics of facilities with higher/lower rate of diagnosis and referral of chronic care patients screening positive for depressionFacility profiles, ORIC, MICA, CFIR interviews with facility managers and PHC nursesSecondary data, quantitative data, qualitative dataAnnually, once
Facility-level rate of referred patients’ uptake of one or more counseling sessionsMhINT project recordsSecondary dataQuarterly
Characteristics of facilities with higher/lower referred patient uptake of one or more counseling sessionsFacility profiles, ORIC, MICA, CFIR interviews with facility managers and counselorsSecondary data, quantitative data, qualitative dataAnnually, once
Facility-level rate of mental health treatment initiation over timeDHIS dataSecondaryMonthly
% of providers who diagnosed one or more patients with CMDMhINT project recordsSecondary dataMonthly
Characteristics of providers who refer/do not referCFIR interviews with nurses who refer/do not referQualitative dataOnce
Implementationf
Consistency of morning talks over time per facilityFacility records, CFIR interviews with facility managers and counselors/health promotersSecondary data, qualitative dataQuarterly, once
Quality and consistency of screening over time per facilityFacility records, CFIR interviews with facility managers and enrolled nursesSecondary data, qualitative dataQuarterly, once
Quality and consistency of diagnosis and referrals per facilityCohort, MhINT project records over time, CFIR interviews with facility managers and PHC nursesCohort, secondary data, qualitative dataQuarterly, once
Fidelity of counseling interventionFidelity checklists, CFIR interviews with clinic counselorsMhINT project data, qualitative dataOnce
Cost of interventioncCosting analysisCostingQuarterly
Adaptations to interventionProject CQI records, CFIR interviews with facility managersSecondary data, qualitative dataQuarterly, once
Maintenanceg
Stability of effects of the intervention on patient-level outcomes of effectiveness over timePatient cohort3- and 9-month cohort dataOnce
Characteristics of patients who had stability of effects over time and those who relapsedPatient cohort, CFIR interviews with patients who maintained stability of effects over time and those who relapsed3- and 9-month cohort data, qualitative dataOnce
Institutionalization of interventionAudit of routine use of MhINT tools, processes, and training materials at district level; CFIR interviews with district managersSecondary data, qualitative dataOnce

aCFIR, Consolidated Framework for Implementation Research; CMD, common mental disorder; CQI, continuous quality improvement; DHIS, District Health Information System; MhINT, Mental Health Integration program; MICA, Mental Illness: Clinicians’ Attitudes Scale; ORIC, Organizational Readiness for Implementing Change; PHC, primary health care.

bIndividual-level analyses of the proportion and characteristics of the target population that received the intervention along the continuum of care.

cData collected only in stage 2, when the revised scalable unit is assessed.

dReal-world effectiveness on patient-level outcomes.

eOrganizational-level outcome referring to the proportion and characteristics of settings/service providers who adopt the intervention.

fExtent to which the intervention was implemented with consistency and fidelity along the continuum of care, adaptations made during the study, and cost.

gOrganizational-level institutionalization of the program over time and individual-level sustainability of health outcomes.

TABLE 3 Key variables and data sources for objectives 1.1, 1.2., 2.1, and 2.2a

Enlarge table

Secondary data on project implementation, including project records and routinely collected data, will be gathered from all participating clinics from the start to the end of the cohort studies in stages 1 and 2. Routine service delivery data on screening and treatment rates will be extracted from the provincial District Health Information System. Data that are collected only by facilities (e.g., tracking delivery of some implementation strategies, including morning talks) will be extracted by field-workers. MhINT project monitoring data will include counseling intervention fidelity, measured by using fidelity checklists and records from supervisory visits; referral rates extracted from referral forms; facility and staff characteristics gleaned from facility profiles; patient counseling uptake assessed from patient tracking forms; and implementation of training packages and use of standardized operating procedures, extracted from training records and continuous quality improvement reports.

The cohort study will estimate how depression diagnoses made by nurses and referral for depression management affected participants’ depression outcomes, treatment adherence, stress, disability, income, and employment.

Enrollment of eligible participants for the cohorts will be done by trained research workers with the nine-item Patient Health Questionnaire (PHQ-9) and will occur before consultation with a nurse. Professional nurses will not know participants’ PHQ-9 scores; any diagnosis of depression by professional nurses will be based on APC guidelines and will be independent of enrollment procedures. Whether each participant has been diagnosed as having depression by a nurse is determined with an exit interview conducted after the participant’s consultation with a nurse. Participants will be divided into three groups: patients diagnosed and referred for care by the nurse, patients diagnosed and not referred, and patients not diagnosed. Data will be collected at baseline at patients’ first point of contact with the program and at 3-month and 9-month follow-ups to ascertain stability of effects.

A target sample of 550 participants is set for the cohort study (not diagnosed, N=200; diagnosed and not referred, N=150; diagnosed and referred, N=200). This sample is estimated to provide 86% power to detect a difference in mean PHQ-9 score of 2.0 points (5.3 versus 7.3) between the diagnosed and referred and undiagnosed groups, with 5% significance, assuming SD=5.1, intraclass correlation=0.1, and a 20% loss to follow-up (mean±SD=7.3±5.1 is from the 6-month follow-up in the PRIME trial). The sample of 200 participants in the diagnosed and referred group and 150 in the diagnosed but not referred group will provide 81% power to detect a difference in mean PHQ-9 score of 2.0 points (5.3 versus 7.3) between the groups, with 5% significance, also assuming SD=5.1, intraclass correlation=0.1, and a 20% loss to follow-up. The number of patients recruited in each clinic may vary, depending on the number consecutively enrolled, in order to meet the total sample sizes required. Inclusion criteria are age ≥18 years, having time and ability to complete the full interview, willingness to provide informed consent, and reporting a PHQ-9 score ≥9. Exclusion criteria are reporting a PHQ-9 score <9 and inability to provide informed consent (e.g., presence of severe intellectual disability, currently experiencing an acute medical issue, or lack of private space for the interview). Field-workers will be trained to make these assessments. Patients with severe depression and who have had thoughts of ending their life for 7 days or more in the past 2 weeks will be accompanied by project staff to a clinic’s professional nurses for care; project staff will be instructed not to leave the patient unattended until the patient has been seen by a professional nurse.

After providing written informed consent, participants will be interviewed in the local language (isiZulu) or English. Data will be collected by using digital handheld devices and uploaded onto a secure server at the University of KwaZulu-Natal. Data quality assurance will be managed through daily quality checks of uploaded data and in vivo observations of interviews to ensure fidelity of questionnaire administration. The research team will contact all participants enrolled at baseline for follow-up (irrespective of whether they refused or discontinued recommended clinical care) via telephone, home visits, etc.

Sociodemographic variables, including sex, age, language, ethnic group, educational and employment status, income, and household composition will be recorded at baseline. Questions about employment and income will be repeated at follow-up interviews after 3 and 9 months to track whether the intervention affects change in economic status. Depression symptoms will be measured with the PHQ-9, which is aligned with DSM-IV-TR diagnostic criteria for major depressive disorder (36). The PHQ-9 has been validated for diagnosis of depression, with a cutoff score of ≥9 in the chronic care population in South Africa (37). The PHQ-9 score will be the primary outcome of the cohort study. General disability will be measured with the 12-item World Health Organization Disability Assessment Scale, version 2.0, which has been used across cultures, including in South Africa (38). Treatment adherence to prescribed medications will be measured with the Visual Analog Scale (39), which has been used in South Africa (40) and other settings with limited resources and is a cost-effective alternative to measuring medication levels from biological samples (41, 42). The Perceived Stress Measure is a 10-item self-report measure that assesses the extent to which an individual experiences stress from situations in his or her life; the measure has been used previously in South Africa (43).

The primary analyses will compare mean PHQ-9 scores measured at 3 months and the proportion of participants whose PHQ-9 scores decreased by at least 50% from baseline to 3 months. Comparisons will be made among the diagnosed but not referred group, the diagnosed and referred group, and the undiagnosed group, adjusting for propensity scores using the t-effects package in Stata, version 16. The propensity scores will be the predicted probabilities of receiving a diagnosis of depression and being referred, respectively, at the baseline visit. These propensity scores will be drawn from logistic regression models, with baseline PHQ-9 scores, age, sex, and socioeconomic indicators as explanatory variables. These propensity scores will also be used to compare PHQ-9 scores and all other outcomes at 3 and 9 months. The comparisons between groups will account for intraclass correlation of outcomes between clinics by using robust adjustment. We will also use multilevel mixed models to analyze pooled panel data from baseline and 3 and 9 months, with group, time, and sociodemographic variables as covariates and with patient and clinic as random effects. Finally, linear and logistic regression analyses will investigate additional predictors, moderators, and mediating factors of the outcomes (44).

A costing analysis will be performed in stage 2 of the study for each subdistrict. We will estimate the incremental cost per outcome (change in PHQ-9 score, adherence, etc.), estimate the cost to scale up, and perform a budget impact analysis from the program/payer perspective (i.e., KZN DoH). We will estimate economic costs, including actual financial outlays and costs of donated time and volunteer time (see Table A1 in the online supplement).

We will estimate the incremental costs of implementing the intervention compared with the current standard for each subdistrict. Intervention costs will include costs associated with start-up, personnel, transport, communication, consumables, and overhead costs. Cost data will be collected from the study budget, clinic expense reports, published information on labor costs, and staff interviews. To assess staff time spent on the intervention, we will conduct time and motion studies in all subdistricts while the intervention is running at full capacity. Together, the microcosting data, time and motion studies, and clinical outcomes will be used to estimate the average cost of providing services.

The costing results will be reported separately for each subdistrict. For all key inputs and outputs, we will follow the standard guidelines of the Second Panel of Cost-Effectiveness in Health and Medicine (45). We will conduct sensitivity analyses around key cost inputs to account for the uncertainty in our results. For budget impact analysis, we will consider direct program costs in the different subdistricts. Direct medical costs will be measured to ensure that KZN DoH costs reflect the opportunity cost of the resources used in delivering services. Furthermore, the top-down approach of expense report collection will be compared with the bottom-up microcosting approach in order to triangulate and refine our cost estimates.

Objectives 1.2 and 2.2: CFIR interviews.

After 12 months of data collection assessing the RE-AIM outcomes, qualitative and quantitative interviews targeting CFIR domains will be performed to understand these RE-AIM outcomes in both stages 1 and 2. Structured quantitative interviews will comprise the Organizational Readiness for Implementing Change, a 12-item measure of change commitment and change efficacy based on Weiner’s theory of organizational readiness for change (46), and the Mental Illness: Clinicians’ Attitudes Scale, a 16-item mental health–related stigma scale (47). Interview guides will be translated into isiZulu and “back-translated” to ensure accuracy.

All facility managers and service providers from the facilities across the subdistricts will be requested to complete the quantitative interviews. Semistructured qualitative interviews will be conducted with facility-level managers, district managers, service providers, and patients (stage 1, N=78; stage 2, N=282) by trained interviewers (for a breakdown of sample sizes, see Table A2 in the online supplement). With the exception of the counselors (all of whom will be interviewed), participants will be sampled purposively according to the following strata: facility-level managers according to high- and low-performing clinics, individual professional nurses according to high and low diagnoses rates, and patients according to high and low uptake rates of counseling sessions. Interviews will be audiotaped and conducted in isiZulu or English, depending on participant preference and following informed consent procedures. When necessary, audiotaped interviews will be translated from isiZulu into English and transcribed, and back-translation checks will be performed by multilingual members of the research team. Any discrepancies will be reconsidered in consultation with a third multilingual researcher (48). Transcripts will be analyzed with the framework analysis typically used in health policy research. A thematic framework will first be developed by using the CFIR domains. Transcript content will then be coded by using the thematic framework while allowing inductive themes to emerge. Cases will be grouped by the aforementioned participant strata to identify multilevel barriers and enabling factors (49).

Objectives 1.3 and 2.3: participatory concept mapping.

Purposively selected key stakeholders will be engaged in a participatory concept mapping exercise to reflect on the results of objectives 1.1, 1.2, 2.1, and 2.2. Collaborative learning sessions—specifically, process mapping and nominal group techniques for developing priorities—will be used to brainstorm potential strategies to overcome identified barriers and optimize facilitating factors. Identified strategies will be sorted and rated according to perceived importance and feasibility for participants. Approximately 22 stakeholders, grouped according to their designation as managers, providers, or patients, will be involved in workshops at each stage (see Table A3 in the online supplement). We will include a national representative responsible for community mental health services, all members of the provincial mental health directorate, key district managers responsible for PHC and mental health, operational managers from all participating facilities, a range of high- and low-referring nurses purposively selected, and outreach team leaders and community health workers purposively selected on the basis of high and low number of referrals from the community level. Patients will also be purposively selected in order to provide a range of individuals with both high and low uptake of the counseling intervention. Informed by this process, the initial MhINT model will be refined in stage 1 to develop a MhINT scalable unit that will then be assessed across the diverse subdistricts in stage 2. Subgroup analysis for each site will use the methods outlined above for the RE-AIM framework and CFIR interviews. The same process will be repeated in stage 2 to further refine the model for broader scale-up.

Results

Given that strengthening health systems requires adaptability, collaborative mechanisms, and routine data gathering (50), the adoption of a learning-health-systems approach reflected in the two-stage design will facilitate the iterative examination of findings of this observational research design, in collaboration with patients, providers, health managers, and researchers. Shared decisions, identified in stage 1, on how to address bottlenecks to uptake of the initial setup MhINT model, will lead to the coproduction of novel and localized interventions and strategies for optimizing implementation and scale-up (i.e., the scalable unit), which will be tested in stage 2 across three diverse contexts (urban, semiurban, and rural). Assessment of the varying strengths and limitations of the refined model in these three contexts will allow us to identify distinct implementation strategies needed to strengthen integration in urban, semiurban, and rural contexts. The findings should help strengthen the MhINT model with interventions and implementation strategies to assist the South African government in scaling up to “full scale.” The findings will also build on previous research from other counties, which suggests a need to integrate mental health care into PHC with an approach that strengthens the whole health system (51). This study will also provide knowledge on strategies to optimize scale-up of collaborative care in integrated care for depression comorbid with chronic general medical conditions in other settings with limited resources.

Discussion and Next Steps

Global mental health stakeholders have increasingly recognized the need for systems change to enable the integration of mental health, inclusive of depression, into PHC (52); the primacy of open and flexible models that allow for cross-context adaptations (53); and the paucity of studies testing optimal implementation strategies to promote scale-up of integrated depression care in routine primary care in LMICs (22). Against this backdrop, and while the results of this study protocol remain to be seen, the design of this study may be helpful for other implementation research collaborations that aim to promote uptake of depression care integrated into routine primary care services. Notably, the iterative learning-health-systems approach is important for ensuring the uptake and sustainability of interventions and implementation strategies (54) (Box 2).

BOX 2. Key challenges, opportunities, and design solutions of the Mental Health Integration (MhINT) program assessment study

Key Challenges

  • Prior research found poor uptake of routine services of the initial MhINT evidence-based collaborative care package for integrated depression care being evaluated by the Southern African Research Consortium for Mental Health Integration (SMhINT) evaluation protocol.

  • In particular, identification and referral of comorbid depression in primary care patients (i.e., the first steps in the treatment cascade) were poor.

  • This deficiency highlighted the need for implementation science to help understand how to improve uptake and embed the package in routine care.

Key Advantages

  • The public health priority of integrated depression treatment for patients with multimorbid chronic diseases in South Africa has heightened, given evidence of poorer health outcomes among chronic patients with comorbid depression.

  • Health systems reforms have created an opportunity to shape policy for integrated horizontal programming in South Africa.

  • Funding for technical support for the scale-up of the initial MhINT package in one district has provided the opportunity to iteratively evaluate how to refine the package and implementation strategies for broader scale-up.

Design Solutions

  • The adoption of a learning-health-systems approach and iterative two-stage research design across varying contexts will enable the research team to be responsive to context and the needs of the KwaZulu-Natal Department of Health (KZN DoH).

  • The strong collaborative relationship with the KZN DoH will enable key lessons to be translated into policy changes necessary for institutionalization and broader scale-up.

  • Locating the SMhINT study within broader efforts to support the KZN DoH in health systems reforms toward horizontal programming will enable earlier embedding of integrated depression care within these reforms.

However, compared with controlled implementation research designs, this approach provides less control over the research process and requires greater investment of researchers’ time and resources in negotiations and capacity building activities (55). Furthermore, in light of a higher probability of sustaining mental health integration in the presence of systems reforms that enable chronic care (51), investment of time and resources into such systems strengthening initiatives may also be necessary to create this enabling environment.

Next steps for the researchers engaged in the SMhINT study include sustaining ongoing engagements with policy makers, planners, and managers; providing technical support for health systems strengthening to facilitate implementation; and building the capacity of policy makers and managers in implementation science to promote wider dissemination and sustainment of the intervention.

Centre for Rural Health, School of Nursing and Public Health, University of KwaZulu-Natal, Durban, South Africa (Petersen, Grant, Gigaba, Van Rensburg, Luvuno, Bhana); Department of Global Health (Kemp, Rao, Wagenaar, Sherr, Barnabas), Department of Psychiatry and Behavioral Sciences (Rao), Department of Epidemiology (Wagenaar), University of Washington, Seattle; Norwich Medical School, University of East Anglia, Norwich, Norfolk, United Kingdom (Bachmann); School of Applied Human Sciences, University of KwaZulu-Natal, Durban, South Africa (Mntambo, Gigaba); Center for Global Mental Health Research, National Institute of Mental Health, Bethesda, Maryland (Amarreh); Knowledge Translation Unit, University of Cape Town, Cape Town, South Africa, and King’s Global Health Institute, King’s College London, London (Fairall); Mental Health and Substance Abuse Directorate, KwaZulu-Natal Department of Health, Natalia, Pietermaritzburg, South Africa (Hongo); Health Systems Research Unit, South African Medical Research Council, Durban, South Africa (Bhana).
Send correspondence to Dr. Petersen ().

Research reported in this article was supported by the National Institute of Mental Health (NIMH) (U19MH113191-01). Dr. Kemp (F31MH112397) and Dr. Wagenaar (K01MH110599) were supported by grants from NIMH. This article is part of a series of NIMH-funded U19 protocols focused on global mental health implementation science.

The authors report no financial relationships with commercial interests.

The authors gratefully acknowledge the ongoing collaboration with the KwaZulu-Natal (KZN) Department of Health, especially the Mental Health Directorate, KZN Directorate for District Services, the district management, and service providers from the Amajuba district. This article is an output of the Southern African Research Consortium for Mental Health Integration. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

References

1. Mayosi BM, Flisher AJ, Lalloo UG, et al.: The burden of noncommunicable diseases in South Africa. Lancet 2009; 374:934–947Crossref, MedlineGoogle Scholar

2. Herman AA, Stein DJ, Seedat S, et al.: The South African Stress and Health (SASH) study: 12-month and lifetime prevalence of common mental disorders. S Afr Med J 2009; 99:339–344MedlineGoogle Scholar

3. Mendenhall E, Richter LM, Stein A, et al.: Psychological and physical comorbidity among urban South African women. PLoS One 2013; 8:e78803Crossref, MedlineGoogle Scholar

4. Folb N, Timmerman V, Levitt NS, et al.: Multimorbidity, control, and treatment of noncommunicable diseases among primary healthcare attenders in the Western Cape, South Africa. S Afr Med J 2015; 105:642–647Crossref, MedlineGoogle Scholar

5. Tomlinson M, Grimsrud AT, Stein DJ, et al.: The epidemiology of major depression in South Africa: results from the South African stress and health study. S Afr Med J 2009; 99:367–373MedlineGoogle Scholar

6. Moussavi S, Chatterji S, Verdes E, et al.: Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet 2007; 370:851–858Crossref, MedlineGoogle Scholar

7. Ciesla JA, Roberts JE: Meta-analysis of the relationship between HIV infection and risk for depressive disorders. Am J Psychiatry 2001; 158:725–730LinkGoogle Scholar

8. Leserman J: Role of depression, stress, and trauma in HIV disease progression. Psychosom Med 2008; 70:539–545Crossref, MedlineGoogle Scholar

9. Gonzalez JS, Batchelder AW, Psaros C, et al.: Depression and HIV/AIDS treatment nonadherence: a review and meta-analysis. J Acquir Immune Defic Syndr 2011; 58:181–187Crossref, MedlineGoogle Scholar

10. Prince M, Patel V, Saxena S, et al.: No health without mental health. Lancet 2007; 370:859–877Crossref, MedlineGoogle Scholar

11. Cruess DG, Douglas SD, Petitto JM, et al.: Association of depression, CD8+ T lymphocytes, and natural killer cell activity: implications for morbidity and mortality in human immunodeficiency virus disease. Curr Psychiatry Rep 2003; 5:445–450Crossref, MedlineGoogle Scholar

12. Park M, Katon WJ, Wolf FM: Depression and risk of mortality in individuals with diabetes: a meta-analysis and systematic review. Gen Hosp Psychiatry 2013; 35:217–225Crossref, MedlineGoogle Scholar

13. Seedat S, Williams DR, Herman AA, et al.: Mental health service use among South Africans for mood, anxiety, and substance use disorders. S Afr Med J 2009; 99:346–352MedlineGoogle Scholar

14. Mahomed OH, Asmall S: Development and implementation of an integrated chronic disease model in South Africa: lessons in the management of change through improving the quality of clinical practice. Int J Integr Care 2015; 15:e038Crossref, MedlineGoogle Scholar

15. Dua T, Barbui C, Clark N, et al.: Evidence-based guidelines for mental, neurological, and substance use disorders in low- and middle-income countries: summary of WHO recommendations. PLoS Med 2011; 8:e1001122Crossref, MedlineGoogle Scholar

16. Patel V, Chisholm D, Parikh R, et al.: Addressing the burden of mental, neurological, and substance use disorders: key messages from Disease Control Priorities, 3rd edition. Lancet 2016; 387:1672–1685Crossref, MedlineGoogle Scholar

17. Katon WJ, Lin EH, Von Korff M, et al.: Collaborative care for patients with depression and chronic illnesses. N Engl J Med 2010; 363:2611–2620Crossref, MedlineGoogle Scholar

18. Araya R, Alvarado R, Minoletti A: Chile: an ongoing mental health revolution. Lancet 2009; 374:597–598Crossref, MedlineGoogle Scholar

19. Araya R, Rojas G, Fritsch R, et al.: Treating depression in primary care in low-income women in Santiago, Chile: a randomised controlled trial. Lancet 2003; 361:995–1000Crossref, MedlineGoogle Scholar

20. van Ginneken N, Tharyan P, Lewin S, et al.: Nonspecialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low- and middle-income countries. Cochrane Database Syst Rev 2013; 11:CD009149MedlineGoogle Scholar

21. Cubillos L, Bartels SM, Torrey WC, et al.: The effectiveness and cost-effectiveness of integrating mental health services in primary care in low- and middle-income countries: systematic review. BJPsych Bull 2021; 45:40–52Crossref, MedlineGoogle Scholar

22. Wagenaar BH, Hammett WH, Jackson C, et al.: Implementation outcomes and strategies for depression interventions in low- and middle-income countries: a systematic review. Glob Ment Health 2020; 7:e7Crossref, MedlineGoogle Scholar

23. Petersen I, Fairall L, Bhana A, et al.: Integrating mental health into chronic care in South Africa: the development of a district mental healthcare plan. Br J Psychiatry 2016; 208(suppl 56):s29–s39Crossref, MedlineGoogle Scholar

24. Petersen I, Bhana A, Fairall LR, et al.: Evaluation of a collaborative care model for integrated primary care of common mental disorders comorbid with chronic conditions in South Africa. BMC Psychiatry 2019; 19:107Crossref, MedlineGoogle Scholar

25. Petersen I, Bhana A, Folb N, et al.: Collaborative care for the detection and management of depression among adults with hypertension in South Africa: study protocol for the PRIME-SA randomised controlled trial. Trials 2018; 19:192Crossref, MedlineGoogle Scholar

26. Petersen, Fairall L, Zani B, et al.: Effectiveness of a task-sharing collaborative care model for identification and management of depressive symptoms in patients with hypertension attending public sector primary care clinics in South Africa: pragmatic parallel cluster randomised controlled trial. J Affect Disord 2021; 282:112–121MedlineGoogle Scholar

27. Brown CH, Curran G, Palinkas LA, et al.: An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health 2017; 38:1–22Crossref, MedlineGoogle Scholar

28. Fairall L, Bateman E, Cornick R, et al.: Innovating to improve primary care in less developed countries: towards a global model. BMJ Innov 2015; 1:196–203Crossref, MedlineGoogle Scholar

29. Powell BJ, Waltz TJ, Chinman MJ, et al.: A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015; 10:21Crossref, MedlineGoogle Scholar

30. English M, Irimu G, Agweyu A, et al.: Building learning health systems to accelerate research and improve outcomes of clinical care in low- and middle-income countries. PLoS Med 2016; 13:e1001991Crossref, MedlineGoogle Scholar

31. Barker PM, Reid A, Schall MW: A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa. Implement Sci 2016; 11:12Crossref, MedlineGoogle Scholar

32. Kessler RS, Purcell EP, Glasgow RE, et al.: What does it mean to “employ” the RE-AIM model? Eval Health Prof 2013; 36:44–66Crossref, MedlineGoogle Scholar

33. Damschroder LJ, Aron DC, Keith RE, et al.: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009; 4:50Crossref, MedlineGoogle Scholar

34. Bledsoe KL, Graham JA: The use of multiple evaluation approaches in program evaluation. Am J Eval 2005; 26:302–319CrossrefGoogle Scholar

35. Nilsen P: Making sense of implementation theories, models, and frameworks. Implement Sci 2015; 10:53Crossref, MedlineGoogle Scholar

36. Kroenke K, Spitzer RL, Williams JB, et al.: The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry 2010; 32:345–359Crossref, MedlineGoogle Scholar

37. Bhana A, Rathod SD, Selohilwe O, et al.: The validity of the Patient Health Questionnaire for screening depression in chronic care patients in primary health care in South Africa. BMC Psychiatry 2015; 15:118Crossref, MedlineGoogle Scholar

38. Garin O, Ayuso-Mateos JL, Almansa J, et al.: Validation of the “World Health Organization Disability Assessment Schedule, WHODAS-2” in patients with chronic diseases. Health Qual Life Outcomes 2010; 8:51Crossref, MedlineGoogle Scholar

39. Kalichman SC, Amaral CM, Swetzes C, et al.: A simple single-item rating scale to measure medication adherence: further evidence for convergent validity. J Int Assoc Physicians AIDS Care 2009; 8:367–374CrossrefGoogle Scholar

40. Peltzer K, Friend-du Preez N, Ramlagan S, et al.: Antiretroviral treatment adherence among HIV patients in KwaZulu-Natal, South Africa. BMC Public Health 2010; 10:111Crossref, MedlineGoogle Scholar

41. Maneesriwongul WL, Tulathong S, Fennie KP, et al.: Adherence to antiretroviral medication among HIV-positive patients in Thailand. J Acquir Immune Defic Syndr 2006; 43(suppl 1):S119–S122Crossref, MedlineGoogle Scholar

42. Sarna A, Luchters S, Geibel, S, et al: Promoting Adherence to Antiretroviral Therapy Through a Directly Administered Antiretroviral Therapy (DAART) Strategy in Mombasa, Kenya. Horizons Research Update., Nairobi, Kenya, Population Council, 2005Google Scholar

43. Vythilingum B, Roos A, Faure SC, et al.: Risk factors for substance use in pregnant women in South Africa. S Afr Med J 2012; 102:851–854Crossref, MedlineGoogle Scholar

44. Folb N, Lund C, Fairall LR, et al.: Socioeconomic predictors and consequences of depression among primary care attenders with noncommunicable diseases in the Western Cape, South Africa: cohort study within a randomised trial. BMC Public Health 2015; 15:1194Crossref, MedlineGoogle Scholar

45. Sanders GD, Neumann PJ, Basu A, et al.: Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA 2016; 316:1093–1103Crossref, MedlineGoogle Scholar

46. Shea CM, Jacobs SR, Esserman DA, et al.: Organizational Readiness for Implementing Change: a psychometric assessment of a new measure. Implement Sci 2014; 9:7Crossref, MedlineGoogle Scholar

47. Gabbidon J, Clement S, van Nieuwenhuizen A, et al.: Mental Illness: Clinicians’ Attitudes (MICA) scale—psychometric properties of a version for healthcare students and professionals. Psychiatry Res 2013; 206:81–87Crossref, MedlineGoogle Scholar

48. Wong JP, Poon MK: Bringing translation out of the shadows: translation as an issue of methodological significance in cross-cultural qualitative research. J Transcult Nurs 2010; 21:151–158Crossref, MedlineGoogle Scholar

49. Damschroder LJ, Lowery JC: Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci 2013; 8:51Crossref, MedlineGoogle Scholar

50. Witter S, Palmer N, Balabanova D, et al.: Health system strengthening—reflections on its meaning, assessment, and our state of knowledge. Int J Health Plann Manage 2019; 34:e1980–e1989Crossref, MedlineGoogle Scholar

51. Thornicroft G, Ahuja S, Barber S, et al.: Integrated care for people with long-term mental and physical health conditions in low-income and middle-income countries. Lancet Psychiatry 2019; 6:174–186Crossref, MedlineGoogle Scholar

52. Petersen I, van Rensburg A, Kigozi F, et al.: Scaling up integrated primary mental health in six low- and middle-income countries: obstacles, synergies, and implications for systems reform. BJPsych Open 2019; 5:e69Crossref, MedlineGoogle Scholar

53. Raviola G, Naslund JA, Smith SL, et al.: Innovative models in mental health delivery systems: task sharing care with non-specialist providers to close the mental health treatment gap. Curr Psychiatry Rep 2019; 21:44Crossref, MedlineGoogle Scholar

54. Estabrooks PA, Brownson RC, Pronk NP: Dissemination and implementation science for public health professionals: an overview and call to action. Prev Chronic Dis 2018; 15:E162Crossref, MedlineGoogle Scholar

55. Bergold J, Thomas S: Participatory research methods: a methodological approach in motion. Historical social research. Hist Soz Forsch 2012; 37:191–222Google Scholar