The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

The COVID-19 pandemic led to a rapid shift toward remote delivery of psychological interventions and transition to voice-only and video communication platforms. However, agreement is lacking on key competencies that are aligned with equitable approaches for standardized training and supervision of remote psychological intervention delivery. A rapid review was conducted to identify and describe competencies that could inform best practices of remote services delivery during and after the COVID-19 pandemic.

Methods:

Scopus, MEDLINE, and PsycINFO were searched for literature published in English (2015–2021) on competencies for synchronous, remote psychological interventions that can be measured through observation.

Results:

Of 135 articles identified, 12 met inclusion criteria. Studies targeted populations in high-income countries (11 in the United States and Canada, one in Saudi Arabia) and focused on specialist practitioners, professionals, or trainees in professional or prelicensure programs working with adult populations. Ten skill categories were identified: emergency and safety protocols for remote services, facilitating communication over remote platforms, remote consent procedures, technological literacy, practitioner-client identification for remote services, confidentiality during remote services, communication skills during remote services, engagement and interpersonal skills for remote services, establishing professional boundaries during remote services, and encouraging continuity of care during remote services.

Conclusions:

These 10 skills domains can offer a foundation for refinement of discrete, individual-level competencies that can be aligned with global initiatives promoting use of observational competency assessment during training and supervision programs for psychological interventions. More research is needed on identification of and agreement on remote competencies and on their evaluation.

HIGHLIGHTS

  • The COVID-19 pandemic has led to heightened attention on synchronous delivery of psychological interventions through remote formats (e.g., telephone and voice-only and video digital platforms).

  • A rapid review identified 12 articles covering 59 categories of competencies for synchronous remote delivery of psychological interventions that were harmonized into 10 core skill domains.

  • Further research is needed to identify, agree upon, and evaluate the use of key competencies for training and delivery of remote psychological support, particularly in task-sharing and low-resource settings, to inform best practices of delivery of remote services during and after COVID-19.

The COVID-19 pandemic inhibited traditional in-person delivery of psychological interventions globally. Because mental health delivery systems are predominantly focused on in-person services, systems were either terminated or interrupted in 93% of countries during the pandemic (1). Concurrently, elevated rates of depression, anxiety, and general psychological distress were reported in both high-income countries (HICs) and low- and middle-income countries (LMICs), causing an escalation in the need for psychological services (26).

In response to the crisis, practitioners and programs in many countries have been trying to overcome disruption to in-person psychological services by swiftly shifting to delivery of remote services (1, 7). This is true in both HICs and LMICs, where a range of innovations for remote delivery has been implemented (8), including the provision of psychological interventions through task-sharing or collaborative care models by nonspecialists (e.g., persons without a mental health professional degree, such as community health workers or members of community-based organizations) (810).

Prior to the COVID-19 pandemic, international application of remote delivery of psychological treatments, and telemedicine in general, was limited and varied considerably (11). Since the COVID-19 pandemic, many countries and regions have expanded their use of telemedicine to include psychological support. In a recent survey, 37% of 112 countries reported using telehealth technologies for mental health consultations (12). Despite the ongoing stark “digital divide” in online access or digital smartphone applications that exists in LMICs compared with HICs (13), training for and delivery of remote psychological support have been occurring globally (1418), including for synchronous delivery, such as through urgent telephone calls via suicide or emergency hotlines and delivery of brief, evidence-based interventions over a video or telephone connection (19). Global initiatives have been launched with aims to support practitioners in adapting typical in-person psychological support and treatments to remote formats, particularly for synchronous practitioner-client care (e.g., direct care to a client via video or telephone connection, not including asynchronous methods such as Short Messaging Service [SMS], e-mail, self-help applications, or digital interventions) (20, 21).

For example, the World Health Organization (WHO) now provides brief e-learning courses on preparing for remote delivery of psychological support, highlighting unique considerations for remote services, such as distinct confidentiality issues, assessment of suicide, variation in verbal and nonverbal communications, and issues around technology and connectivity (www.whoequipremote.org). Similar initiatives include the Inter-Agency Standing Committee’s release of guidance and operational considerations for implementation and delivery of remote mental health and psychosocial support programming across sectors (22) and the rapid distribution by the International Federation of Red Cross and Red Crescent Societies of the manual Remote Psychological First Aid During the COVID-19 Outbreak, which provides brief guidelines on using basic helping skills remotely to help people dealing with distress, primarily through voice-only connections, along with an online training package for teaching the skills (17, 23, 24).

The global adoption of remote psychological support and treatment delivery prompted by this crisis is predicted to continue a strong growth trajectory, and practitioner training in remote technologies has been encouraged (25). This training is particularly important in areas where COVID-19 has exacerbated existing inequities in mental health care. Approaches to training and supervision that support high-quality service provision in addition to availability of services and that are deployable in low-income settings must be prioritized (26, 27). Many global sectors identify the measurement and monitoring of practitioner competency as a key ingredient to ensuring high-quality care. Current examples include the not-for-profit physician-led organization, Accreditation Council for Graduate Medical Education (ACGME), which established core competencies required for “every resident and practicing physician” in the United States (28), and the ongoing consultation work led by the WHO for drafting the Global Competency Framework for UHC to establish required competencies for primary health care workers globally (29). However, conceptualization and application of competency and competency frameworks are mixed within and across sectors and countries, thereby limiting common understanding and implementation into practice on a global level (30).

Given the growing number of resources being developed for remote-specific adaptations for psychological support, it is important to recognize the advantages and disadvantages of adapting in-person care techniques for use with remote modalities and to consider whether there are competencies that support synchronous remote delivery that could be fundamentally different from those used for in-person care. Therefore, we conducted a rapid review to identify the skills currently recognized as foundational to remote delivery of any psychological service, how they are described, and how they can be harmonized.

Methods

In this article, we use the term “remote psychological support”—also referred to as tele–mental health, tele–behavioral health, telepsychology, or teletherapy—to refer to the use of synchronous telecommunications, such as telephone and voice-only or videoconferencing connections, to deliver psychological interventions and associated mental health services by a specialist or nonspecialist practitioner directly to a client or patient. The term psychological support is more frequently used in global settings to capture the increasing use of task-sharing initiatives whereby trained and supervised nonspecialist practitioners deliver care. Task-sharing models are particularly prevalent in LMICs, where the gap between those in need of services and those who have access to such services or available resources is almost 90% (31, 32). Using a simplified systematic methodology, we conducted a rapid review to enable timely identification of competencies and inform ongoing delivery of remote psychological support during the COVID-19 pandemic.

Rapid review methods are similar to those of systematic reviews but are adjusted in a range of ways based on the topic and assessment needs in order to facilitate a streamlined approach to synthesizing evidence within a limited time frame. These reviews are often conducted to support decision making for program implementation or service delivery efforts responding to emerging needs or urgent matters—for example, humanitarian crises such as the COVID-19 pandemic (33, 34). Systematized guidance on conducting a rapid review is mixed (33), and a PRISMA checklist for standardizing rapid review processes is not yet available (35). Therefore, for this rapid review, we chose to adhere as closely as possible to a systematic review process in a limited time frame, including registration of a protocol on February 25, 2021 (PROSPERO, CRD 42021242534; Open Science, https://osf.io/s4b7m/), to clearly report our methods. We referred to previous reviews in similar areas for expansion of search terms related to remote mental health services (36, 37).

Operational Definition of Competency and Competency Measurement Type

We specified the operationalization of competency and competency measurement to promote conceptual clarity and comparability with existing frameworks and methods in this field. Mills and colleagues (30) defined competency as “The observable ability of a person, integrating knowledge, skills, and attitudes in their performance of tasks. Competencies are durable, trainable and, through the expression of behaviors, measurable.” For this review, we focused on literature that highlights competencies that can be measured through observation, such as through standardized role-plays, a method that has been suggested over other competency measurement types (e.g., knowledge tests) (38, 39). This operationalization is consistent with freely available competency-driven training resources (40), and thus we anticipate that the results of this review can align with globally centered initiatives and can support the standardization of more equitable and less bespoke practices (e.g., specific to a certain organization, association, or setting) for measuring and monitoring competency. Moreover, competency evaluation approaches that use observational measurement with role-plays offer an assessment process distinct from quality and fidelity assessments that use live sessions (41) and may increase a practitioner’s confidence and competency achievements prior to real-world delivery when such approaches are included in training and supervision (4245), which aligns well with our overall aims for this study.

Study Identification

On February 26, 2021, we searched Scopus, MEDLINE, and PsycINFO for published literature and guidelines for descriptions of competencies related to delivering remote psychological support during synchronous sessions and that are observable through direct practitioner-client interactions, such as skills unique to remote settings that can improve communication over remote modalities (e.g., technology skills), skills for optimizing interactions during voice-only or video-based interactions (e.g., using telephone or videoconferencing), or other foundational practitioner competencies that may be used for in-person services and have been adapted or modified for remote delivery (e.g., nonverbal communication, practices to ensure safety and privacy). We limited our search to peer-reviewed articles, published in the English language between 2015 and 2021, and we included any relevant articles identified during full-text review. (A sample search strategy is presented in the online supplement.) Database results were initially imported into EndNote X9 (46), a reference management system, and then imported into Covidence (47), a Web-based software platform for streamlining systematic reviews, for removal of duplicates, screening, and data extraction.

Study Eligibility Criteria

Inclusion and exclusion criteria were created and agreed upon by two authors who are experts in systematic reviews and competencies (G.A.P., B.A.K.) (see online supplement for details). We included articles that focused on or included competencies involving practitioners or practitioners-in-training over age 18 who were delivering any mental health–related intervention or care and who included a session or component of synchronous remote connection for direct practitioner-beneficiary interaction over video-conferencing or voice-only platforms. We excluded articles that focused on or had competencies involved with in-person delivery components, non–mental health–related interventions or care, asynchronous treatments or intervention components, or treatment-specific techniques or competencies and components otherwise not observable through practitioner-client sessions or not adaptable or modifiable to remote scenarios. Screening processes were streamlined to one author-reviewer (G.A.P.), who conducted title and abstract screening and full-text screening and who conferred with a second author-reviewer (B.A.K.) regarding any discrepancies. To support rigor, a third author-reviewer (K.A.P.) confirmed exclusion of full-text articles. During full-text screening, if an article included mixed components of remote and in-person delivery or common and treatment-specific techniques, it was included for the extraction stage.

Data Extraction and Analysis

Predetermined extraction criteria for each eligible article included general study information (study design and type, setting, and population type for providers), label and description of guideline or skill, and any behaviors or other attributes included with the description. Iterative creation of extraction criteria was optional if other relevant information presented itself throughout the extraction process. These categories were inserted into Covidence, and one author (G.A.P.) carried out the initial extraction of the included articles. Any data related to the inclusion and extraction criteria were extracted, regardless of whether the article had mixed components—e.g., synchronous and asynchronous or remote and in-person delivery. To ensure accuracy in reporting, any surrounding information that may have supported comprehension of or that gave additional context to the criteria-matched data was also extracted. Another author (K.A.P.) checked the extracted data for accuracy and consistency by using the “check data” form in Covidence, which allows for direct comparisons per category and corrections as needed alongside the article being extracted. Final data were exported from Covidence into a spreadsheet to prepare for analysis, wherein an in-depth mapping and matching exercise was conducted to identify and consolidate core skill domains across articles. The mapping and matching exercise was done in three stages: mapping and matching labels of competency categories extracted from the articles to create overarching domains, mapping the corresponding label descriptions within each domain, and in-depth description matching across domains.

Results

The search identified 135 articles. Twelve articles met inclusion criteria (4859). (A flow diagram of the identification process is available in the online supplement.) Study types included guidance documents (e.g., guidelines, program guidance overview, and in-depth guidance commentary; N=5) (4852), narrative reviews (N=3) (5355), a scoping review (N=1) (56), a task force review of guidelines (N=1) (57), a case series (N=1) (58), and a feasibility study (N=1) (59). All studies took place in HICs. Most were reported from the United States and Canada (N=11), and one study was reported from Saudi Arabia (57). Each article focused its guidance or considerations on practitioner conduct or training principles for specialist practitioners or professionals or on trainees or students in a prelicensure or professional program; all were working with adult populations. Within the scope of their work, the authors of seven articles (58%) referenced the American Psychological Association’s telepsychology guidelines (48, 50, 56, 59), and three articles (25%) referenced the ACGME requirements for training and preparing resident and fellow physicians (48, 53, 54). Four articles mentioned work with youth populations; these articles suggested that the same procedures used with adults be followed with modifications as needed, such as paying attention to youths’ developmental status (48, 49, 51, 52). Summary descriptions of included articles can be found in Table 1.

TABLE 1. Summary descriptions of 12 articles reviewed for identification of observable competencies in remote psychological support

ArticleTarget countryTarget populationDescribes synchronous psychological treatmentDescribes guidelines for remote psychological supportDefines competency for psychological support practitionerDescribes observable behaviors during remote practitioner-client interactionDescribes competencies unique to synchronous remote modalityDescribes in-person competencies adaptable for remote delivery
Alqahtani et al., 2021 (57)Saudi ArabiaPractitioners: clinical psychologists
Barnett and Kolmes, 2016 (58)United StatesPractitioners: mental health clinicians
Danesh et al., 2019 (59)United StatesStudents: prelicensure graduate mental health nurse practitioners, undergraduate nursing and social work students
DeJong, 2018 (48)United StatesPractitioners: psychiatrists
Hames et al., 2020 (49)United StatesStudents: graduate psychology students
Hilty et al., 2015 (53)Canada, United StatesTrainees: advanced medical students, early residents, others in graduate medical training
Hilty et al., 2018 (54)Canada, United StatesPractitioners: psychologists, social workers, marriage and family therapists, psychiatrists
McCord et al., 2015 (50)United StatesStudents: doctoral, counseling psychology students
McCord et al., 2020 (56)United StatesPractitioners: psychologists; students: postgraduate psychology students
Sabin and Skimming, 2015 (55)United StatesPractitioners: psychiatrists
Shore et al., 2018 (51)United StatesPractitioners: psychiatrists; trainees: psychiatry trainees
American Psychiatric Association and American Telemedicine Association, 2018 (52)United StatesPractitioners: psychiatrists; trainees: psychiatry trainees

TABLE 1. Summary descriptions of 12 articles reviewed for identification of observable competencies in remote psychological support

Enlarge table

Identification of Competency Categories Related to Remote Psychological Support

Four articles (33%) provided an operational definition of competency, with definitions differing across the articles (48, 53, 54, 58):

“Professional competence can be viewed as the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and community served. Competence requires that practitioners possess the knowledge and skills needed to ensure meeting minimum expectations for the quality of professional services provided.” (58)

“ACGME defines milestones as competency-based developmental outcomes (e.g., knowledge, skills, attitudes, and performance) that can be demonstrated progressively by residents and fellows from the beginning of their education through graduation to the unsupervised practice of their specialties.” (48)

Only two of the 12 included articles (17%) referenced competency measurement, both of which included observational measurement through simulation methods, but there was not a universally preferred method of measurement across articles (53, 59).

A total of 59 competency categories with descriptions of knowledge, attitudes, or skill sets related to remote psychological interventions were identified across articles, ranging from two to eight categories per article. Terminology and framing varied across articles, such as using direct labeling (“skill,” “competence,” or “competency”) with or without the related stage or topics of remote psychological interventions (e.g., “Competency 1,” “general telemental health competence,” or “telepsychology technical skills”) (42, 50, 58), omitting any reference to “skill” or “competency” and referring only to it as a scenario, domain, or stage in practice (e.g., “client care,” “management and treatment planning,” or “telepsychology practice domain”) (49, 53, 56). Some articles used a category such as “best practices” to describe behaviors or actions (e.g., “Examples of best practices include the use of settings in which the patient’s video screen should not include picture-in-picture because self-reflected image can inhibit the patient’s communication”) (59).

Within and across articles, descriptions of competency categories varied in style (e.g., checklists and paragraphs), detail, and length (e.g., in-depth descriptions with five to seven sentences or four or more bullets or brief descriptions using one or two bullets or a phrase). All articles included either operative descriptions (N=10, 83%) or some reference to a behavior that a practitioner could show an observer. Descriptions utilized present or past tense, or sometimes both, and sometimes included both unobservable (e.g., completed before or between sessions) and observable (e.g., performed during a session with a client or patient) knowledge, attitudes, or skills in a sequence of events involving multiple interactions or timepoints. For example, “Within their knowledge of local resources, providers should have knowledge of or be acquainted with local in-person and emergency resources” (56); or “Technological competence includes possessing adequate knowledge of and familiarity with the various technologies being used in the practice of tele–mental health. . . . Practitioners should possess adequate familiarity with systems used so that they can make needed adjustments to settings used to ensure that auditory and visual quality are sufficient for optimal professional services to be provided as well as to provide instruction to clients on the use of these systems” (58). (A table in the online supplement presents other examples of various description types from four articles.)

Harmonization of Core Skill Domains

The 59 competency categories from each article were inserted into a matrix to guide the mapping and matching exercise for identifying core domains (Figure 1). After label mapping and descriptive mapping, we generated a consolidated list of 10 domains common across articles.

FIGURE 1.

FIGURE 1. Mapping and matching exercise for identifying core domains across the 12 included articles

Table 2 presents the domain name, general description of the domain, and the referenced articles that contributed to the domain creation. The 10 domains included remote-specific skills (e.g., use of technology during remote delivery) and skills that can be used for in-person delivery with varying degrees of adaptation for remote settings (e.g., communication skills). The domains were prioritized by the number of articles mentioning the guidance and are as follows: emergency and safety protocols (N=10 articles), facilitating communication over remote platforms (N=8), remote consent procedures (N=7), technological literacy (N=7), confidentiality and privacy during remote services (N=7), practitioner-client identification for remote services (N=5), verbal and nonverbal communication during remote services (N=4), engagement and interpersonal skills for remote services (N=4), establishing professional boundaries during remote services (N=4), and encouraging continuity of care during remote services (N=1). Although harmonization into domains was possible, descriptions from articles varied within domains. Examples of these description variations are presented below (a table with exact descriptions per article per domain is available in the online supplement.)

TABLE 2. Ten skill domains identified for remote psychological support and the corresponding reviewed articles

DomainDomain descriptionContributing articles
Domain 1: Emergency and safety protocols for remote servicesPractitioner assesses for risk to or from the client, including client harm to self, to others, or from others. Safety protocols should be put into place with the client, including a plan in case of emergency. Plans may need to include local support services near the client’s physical location. Practitioner confirms client understands risk and safety procedures and asks for feedback and clarification as needed.Alqahtani et al., 2021 (57); Barnett and Kolmes, 2016 (58); Danesh et al., 2019 (59); DeJong, 2018 (48); Hilty et al., 2015 (53); Hilty et al., 2018 (54); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55); Shore et al., 2018 (51); American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 2: Facilitating communication over remote platformsPractitioner should create the environment in which to emulate remote psychological support to ensure full engagement and high-quality care delivery. This includes addressing factors of distractibility and confidentiality for both the practitioner and the client(s), such as limiting distractions and assessing the environment for any unexpected disruptions, including understanding the location where the client is receiving the session and any potential interruptions or breaches to privacy.Alqahtani et al., 2021 (57); Danesh et al., 2019 (59); Hilty et al., 2015 (53); McCord et al., 2015 (50); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55); Shore et al., 2018 (51), American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 3: Remote consent proceduresPractitioner should clearly discuss, without jargon and in lay language, any possible risks and benefits, suitability of telecommunication, and possible alternatives with the client before delivering remote psychological support. This includes abiding by local and national ethics and laws, as well as specific policies and protocols related to the practitioner’s organization, program, or credentialing body as applicable. Expectations and guidelines for conduct of sessions and engagement with the client are discussed, and the client must provide consent either verbal or written. Documentation procedures and any other communications or processes should be included during the consent process so that the client(s) or caregiver has full capacity and is knowledgeable for giving or refusing consent.Alqahtani et al., 2021 (57); Hames et al., 2020 (49); McCord et al., 2015 (50); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55); Shore et al., 2018 (51); American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 4: Technological literacyPractitioner is familiar with and has knowledge of various technologies and related requirements for using telecommunications to deliver mental health services. Practitioner is aware of various hardware and software, Internet connection types and variabilities, and security measures and precautions for ensuring privacy and confidentiality and can clearly communicate this to the client, guiding the client through such mediums to ensure comfort and accessibility.Alqahtani et al., 2021 (57); Barnett and Kolmes, 2016 (58); McCord et al., 2015 (50); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55); Shore et al., 2018 (51), American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 5: Confidentiality and privacy during remote servicesPractitioner ensures confidentiality and privacy for any remote psychological support session and should adjust when or if full privacy cannot be reached on either the practitioner’s or the client's side. Discussions are held with the client to maximize confidentiality and private settings, including brainstorming or finding ways for confidential discussions if the client or practitioner has people nearby or similar security breaches (e.g., set up a code word).Danesh et al., 2019 (59); DeJong, 2018 (48); Hames et al., 2020 (49); Hilty et al., 2015 (53); Hilty et al., 2018 (54); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55)
Domain 6: Practitioner-client identification for remote servicesPractitioners identify themselves clearly to the client(s) or caregivers, including offering credentials and location. Practitioner confirms client identification and how the client would like to be called or referred to and confirms location of client.Alqahtani et al., 2021 (57); McCord et al., 2020 (56); Sabin and Skimming, 2015 (55); Shore et al., 2018 (51); American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 7: Verbal and nonverbal communication during remote servicesPractitioner uses clear verbal and nonverbal communication skills during remote interaction and adjusts as needed to promote awareness and engagement with body language.Alqahtani et al., 2021 (57); DeJong, 2018 (48); Hilty et al., 2018 (54); McCord et al., 2015 (50)
Domain 8: Engagement and interpersonal skills for remote servicesPractitioner ensures a therapeutic alliance with the client, building trust and rapport over remote communications during psychological support sessions.Alqahtani et al., 2021 (57); Hilty et al., 2015 (53); Hilty et al., 2018 (54); American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 9: Establishing professional boundaries during remote servicesPractitioner is aware that remote psychological support sessions can create confusing or inconsistent interpretations in professional boundaries and relationship in terms of telecommunication modalities between the practitioner and the client and should discuss with the client specific dates and times the practitioner is available for contact, guidelines on what telecommunications are acceptable during and between sessions (e.g., text messaging), and what should be avoided (e.g., “friending” on social media platforms).DeJong 2018 (48); McCord et al., 2020 (56); Shore et al., 2018 (51); American Psychiatric Association and American Telemedicine Association, 2018 (52)
Domain 10: Encouraging continuity of care during remote servicesPractitioner should encourage continuity of care, particularly if interactions over telecommunications are brief or a single session, by discussing with the client ways to engage therapeutically to promote well-being and other options and referral resources according to the client’s needs.Sabin and Skimming, 2015 (55)

TABLE 2. Ten skill domains identified for remote psychological support and the corresponding reviewed articles

Enlarge table

Domain 1: Emergency and safety protocols during remote services.

All 10 articles (83%) contributing to this domain had some description related to a practitioner’s ability to screen for risk of or handle emergencies (48, 5159). Seven of the 10 articles (70%) included reference to having a protocol or plan in place or included action steps to determine risk, such as, “Check on need for an emergency protocol,” “a plan for addressing acute safety issues,” and “Providers should have protocols in place.” Seven articles (70%) included specifications for practitioners’ knowledge of local resources, “Must be aware of local emergency resources,” or of a service or “back-up” local to the client or patient. Two of these seven articles also included guidance for practitioners to discuss with clients or patients the “importance of having consistency” in location and for practitioners to be aware of their location and any changes to ensure relevant emergency resource knowledge.

Domain 2: Facilitating communication over remote platforms.

The eight articles (67%) included in this domain all had some reference to the practitioner’s creation of an environment that can enhance engagement with the client (5053, 5557, 59). Five of the eight articles (63%) had specific descriptions to address placement and height of the camera at an “ideal position” with “face clearly visible to the other person” and “close to the patient’s eye level.” Two articles (25%) had instructions to turn off the picture-in-picture feature on the client’s side. Three (38%) directed the practitioner to secure an agreeable physical environment on the sides of both the practitioner and the client by using “well-placed lights.” Three (38%) had general guidance for “maximizing comfort” or to “minimize distractions” or “clarify and amplify communication.”

Domain 3: Remote consent procedures.

The seven articles (58%) in this domain included descriptions of addressing and discussing with the client the nuances of consent procedures as consent relates to remote delivery (4952, 5557). This included four articles (57%) with guidance for the practitioner to explain “benefits, risks, and limitations” related to remote psychological support, such as drawbacks to not being able to see full body language, potential Internet security breaches, or, in the case of one article, discussing circumstances for discontinuation of remote services if they can no longer be provided safely. Three of the seven articles (43%) had guidance for discussing possible alternatives to remote support and for establishing expectations for client-practitioner interactions in and outside sessions.

Domain 4: Technological literacy.

The seven articles (58%) in this domain had skill descriptions regarding the practitioner’s level of knowledge and familiarity with technology and the practitioner’s skill set for clearly communicating with and guiding the client through such mediums (5052, 5558). Guidance included making technical modifications with devices or Internet connections, such as adjusting volumes and checking microphones, cameras, video display, and wiring for a strong Internet connection on both receiver ends (N=5 articles, 71%), assessing the client’s comfort and past experiences with technology or videoconferencing (N=2, 29%), maintaining communication about potential issues and disruptions with remote modalities (N=2, 29%), and establishing a back-up plan in case of disruption (N=2, 29%).

Domain 5: Confidentiality and privacy during remote services.

Seven of the 12 articles (58%) included descriptions of ways practitioners may address confidentiality and privacy processes or issues during remote services (48, 49, 5356, 59). These typically involved adjustments to existing in-person confidentiality and privacy procedures, such as “Use telepsychology regulations, and if none, apply judgment to convert in-person ones,” or additions to existing laws, such as a practitioner’s conducting a standard HIPAA privacy and security discussion with the client while also adjusting “behavior context, e.g., institutional, local, regional,” or additionally explaining how “digital health information will be protected and kept from outside interference during the course of telephone, video, email, or text-based therapeutic services.” Some articles had descriptions of specific adjustments the practitioner could make to enhance and ensure privacy, such as “using head-phones” or “adding white noise,” planning sessions when children can be supervised by others, and moving the camera around to show the practitioner’s space to the client.

Domain 6: Practitioner-client identification for remote services.

Five of the 12 articles (42%) included steps or guidance for practitioners to identify themselves and clients before remote services begin or during the first session of remote treatment or services (51, 52, 5557). Among these articles, identification methods included having introductions or verification of the practitioner’s and client’s identity (N=5 articles, 100%), introducing other parties present on both sides (N=1, 20%), providing the practitioner’s certification or credentials (N=4, 80%), confirming the location of the practitioner (N=2, 40%) and of the client (N=3, 60%), and exchanging immediate contact information between the practitioner and the client (telephone, text, or e-mail) and other relevant support people (N=2, 40%).

Domain 7: Verbal and nonverbal communication in remote services.

In four articles (33%), authors gave suggestions and guidance on ways that practitioners could facilitate clear verbal and nonverbal communication during remote services (48, 50, 54, 57). Nonverbal communication recommendations varied across the four articles and included having an “appropriate appearance” or “appropriate posture” or presenting as “well-appearing”; instructing the practitioner to “listen more and speak less”; listing options for how the practitioner can make facial expressions “very clear to the client,” such as zooming the camera in on the practitioner or the client’s face or zooming out for a better view of the client’s body language; and, more generally, instructing the practitioner to “optimize one and other’s telepresence.” Verbal communication recommendations were identified in two of the four articles, either with specific instructions (e.g., “ask open questions” and “summarize outcomes”) or more broad instruction to the practitioner to “amplify communication (i.e., 15%) based on video literature” and to “trouble-shoot communication difficulties.”

Domain 8: Engagement and interpersonal skills for remote services.

We identified four articles (33%) that explicitly referenced behaviors that a practitioner could perform to enhance rapport building and therapeutic alliance, although these behaviors sometimes overlapped with the verbal and nonverbal communication domain (5254, 57). References were made for the practitioner to “establish therapeutic alliance, build trust and rapport” and to “adjust to technology (e.g., replace handshakes with verbal comment)”; guidance was provided for the practitioner to be attentive to technology and how it affects “patient rapport and communication.”

Domain 9: Establishing professional boundaries during remote services.

Four articles (33%) covered guidance on ways that practitioners could mitigate ambiguity in professional boundaries that arises during remote services (48, 51, 52, 56). Suggestions for practitioners varied from general statements, such as for the practitioner to describe the “appropriate interpersonal and online relationship boundaries,” to more specific suggestions. Specific suggestions involved practitioner guidance to discuss and document with the client when and how the practitioner will communicate, including detailing the technology medium (e.g., video, text, or e-mail); business hours and response times; and when, where, or whom to contact in an emergency. Issues involving a practitioner’s personal and professional social media presence and clear boundaries on these platforms were also mentioned in one article.

Domain 10: Encouraging continuity of care during remote services.

One article (8%) covered the topic of the importance of a practitioner’s encouraging continuity of care during remote services, particularly to cover remote-characteristic services, such as a brief call or a single session (55). The authors of this article emphasized that “Even if the telepsychiatric meeting is a single appointment, the psychiatrist is responsible for giving the patient clear guidance about what to do next.” They also offered options to address levels of urgency with “reasonable actions,” such as managing this step with a “relatively healthy and well-functioning patient” by advising the person on how to find a referral and with “a patient with emergent clinical needs and significant risk factors,” which may require the practitioner to schedule a follow-up appointment to check in with the client.

Discussion

We conducted a rapid review to synthesize evidence of observable competencies for remote psychological support services to aid in decision making and program implementation for training and delivery of remote psychological support during the COVID-19 pandemic and thereafter. Observable knowledge, attitudes, or skills unique to remote delivery with adult clients and in-person knowledge, attitudes, or skills modified for remote delivery with adult clients were identified across 12 peer-reviewed articles. Operationalization and framing varied across articles, which supported the need for the harmonization procedure in this rapid review. We did not identify any published literature from LMICs for this review, and thus our results are limited to high-income settings. Consequently, the core skill domains may capture techniques or processes that may need adaptation for the technical, logistical, legal, social, and cultural contexts wherein roughly 85% of the world’s population lives (32). For example, issues related to confidentiality and the practical elements that constitute privacy during remote services are likely to vary dramatically and are not well represented by the seven articles identified in this review. Moreover, although the skill domains described in this review pertain to unique aspects of using remote modalities to deliver psychological support, the standard of clinical care provided should ideally meet the accepted requirements for the given treatment setting.

Many of the guidelines and considerations found in the articles were tailored toward existing organizational structures, practices, ethics, and laws, which may represent a barrier to generalizing these competencies, especially in the case of nonspecialist practitioners who are not typically connected to professional mental health associations. For example, several articles in this review offered guidance on ethical and legal compliance, primarily around health laws based in the United States (e.g., HIPAA), which may not be relevant for training in other settings and may create obstacles for implementation of psychological interventions designed for humanitarian settings that encourage multisectoral coordination for a whole-person and whole-society approach to mental health (60). Other skills identified in articles were specific to a particular setting, such as inpatient units, or for remote care that takes place within a specific organizational infrastructure (e.g., delivered in supervised emergency settings at a hospital or delivered in tandem with trained technical specialists). Moreover, because of their length, some of the guidance and competency frameworks in the included articles may not be feasible to implement in lower-resourced or humanitarian settings or in emergencies, such as the COVID-19 pandemic, given the already extremely short timelines and lack of funding and human resources.

A recent survey found that almost 50% of the countries that promptly adopted remote psychological support to address disruptions to in-person services due to COVID-19 were low-income countries (61). Yet only 35% of those living in low-resource countries have Internet access, compared with 80% in higher-resourced countries (62); telecommunication status ranges widely across global regions in terms of policy, innovation, infrastructure, and technology (e.g., digital apps and video consultation platforms), with advancements predominantly being led in high-income settings (11). Although digital technologies are rapidly progressing in high-income settings and changing the way in which therapy is delivered (e.g., self-help digital applications and virtual reality) (63), a cooperative effort must be made to meet the varying social, environmental, and resource needs and to inform optimal use of remote delivery methods (13, 64).

As such, more evidence on implementation, training, and delivery of remote psychological support and related competency assessments in low-resource countries is needed to fully capture key competencies that support safe and effective remote care and to inform best practices for remote delivery. In terms of competencies for synchronous remote modalities, such as video connections or voice-only with telephones, standardizing the use of common definitions, applications, and measurement strategies could be a start. For example, having clear distinctions of how to measure competency alongside the framework and formatting competency descriptions with concise, simple descriptions of actionable behaviors could enhance adaptability and feasibility of implementing observational competencies into practice across an array of global organizations and programs.

Also, future research on and implementation of competencies and assessments would ideally align with current global initiatives that offer and promote the use of competency assessment tools that can be measured observationally, such as those paired with structured role-plays. An initiative led by the WHO and UNICEF called Ensuring Quality in Psychological Support (EQUIP) (www.equipcompetency.org) aims to improve the competence of practitioners and the consistency and quality of psychological support training, supervision, and service delivery by providing resources, tools, and guidance for assessment and enhancement of essential competencies and use of competency-driven approaches in training and supervision programs (40). EQUIP supports competency tools paired with standardized role-plays for observational assessment, such as the ENhancing Assessment of Common Therapeutic factors (ENACT) tool (65, 66) that covers foundational helping skills (e.g., communication, empathy, rapport building, and confidentiality) in the delivery of psychological support to adults, including among nonspecialists and for manualized interventions (67). ENACT has been widely implemented in a range of countries and humanitarian settings (40, 6872) and has been successfully used in remote training of nonspecialists for delivery of a brief psychological intervention during the COVID-19 pandemic (19). The online supplement contains a draft observational evaluation tool for remotely delivered psychological interventions (ENACT-Remote) that training and implementing organizations can pilot test for remote competency assessment in the context of the COVID-19 pandemic and other expansions of tele–mental health services.

This review had some limitations. Because it focused only on common competencies that are observable during a practitioner-client interaction in a remote session, the goal was to address individual-focused competencies that are not tailored to certain licensures, treatments, programs, or organizational infrastructures. Therefore, we specifically designed our protocol to exclude identification of certain skills and competencies from this review and cannot report on them at this time: “higher-order” or “internal” skills (e.g., conceptual decision making, reflection, and mindfulness), skills that are not directly observable during synchronous care (e.g., competencies demonstrated between sessions or prior to or after a session or certain knowledge or certain attitudes), skills that are related to therapeutic change but likely remain consistent for remote or in-person sessions (e.g., promoting hope and providing psychoeducation), and tailored skills (e.g., treatment, organization, and infrastructure specific). Furthermore, this review did not identify skills specific to practitioners who work with youths, and thus our results are limited to practitioners who work with adults. We recognize the benefit of these areas and encourage our fellow researchers to explore these areas further, such as reviewing existing child-focused competencies and competency frameworks available in both high-income and low-income settings that could be used for remote settings (73, 74).

Because of the rapid nature of this review, we limited our search to three databases and did not include gray literature. In addition, the evidence identified and summarized in this review is limited to high-income settings. Therefore, we cannot say we have comprehensively represented all core skill domains for remote psychological support nor have we refined them as discrete observational competencies useable in observational assessments. We have summarized and distilled results from only the published literature. Future exercises, such as a Delphi process wherein a group of field experts could participate in several rounds of surveying, could be considered to support consensus among these skill domains, along with other research studies and exercises involving implementation across more diverse global settings. Furthermore, the processes of this rapid review did not include an assessment of the quality of each included study, and thus we cannot determine the overall quality of the evidence at this time. Although this review highlighted core skill domains identified for the synchronous delivery of remote psychological support, it cannot be generalized for asynchronous methods.

As the field of remote psychological support develops, identifying competencies used in asynchronous methods and how these pair with the skill domains identified in this review could be beneficial for supporting enhanced and effective remote delivery of care. For example, identifying core skills around the use of digital applications or SMS messaging between sessions that support consistency during delivery of synchronous remote psychological support or that strengthen treatment adherence and relationship building when hybrid techniques are used (in-person and remote sessions) would be an important step in this field.

Conclusions

Standardized and observable, individual-level competencies can form a foundation for training, evaluation, and research to ultimately support safe and effective delivery of remote psychological support. Common definitions, applications, and measurement strategies for remote care competencies could enhance adaptability and support feasible adaptation and implementation across organizations and settings, particularly in contexts where financial and human resources available for mental health and psychosocial support services are already limited. The core skill domains formulated in this review show that harmonizing remote-specific skills and in-person skills modified for remote delivery is possible. Future work is warranted, such as identification of and agreement on a full scope of remote competencies that are representative of low-resource settings. Future research could explore the modification and adaptation of these domains into concrete competencies that align with existing global competency assessment tools and observational measurement strategies.

Division of Global Mental Health, Department of Psychiatry and Behavioral Sciences, George Washington University, Washington, D.C. (Pedersen, Kohrt); Department of Psychology, New School for Social Research, New York City (Pfeffer, Brown); Department of Psychiatry, New York University School of Medicine, New York City (Brown); Department of Mental Health and Substance Use, World Health Organization, Geneva (Carswell, Schafer); Child Protection in Emergencies, Child Protection, Programme Division, UNICEF, New York City (Willhoite).
Send correspondence to Ms. Pedersen ().

This work was funded by the National Institutes of Health (COVID-19 supplement to R01MH120649; Dr. Kohrt, principal investigator).

The authors report no financial relationships with commercial interests.

The authors alone are responsible for the views expressed in this article, which do not necessarily represent the views, decisions, or policies of the institutions with which the authors are affiliated.

References

1. The Impact of COVID-19 on Mental, Neurological and Substance Use Services: Results of a Rapid Assessment. Geneva, World Health Organization, 2020. https://www.who.int/publications/i/item/978924012455Google Scholar

2. Kumar M, Kumar P: Impact of pandemic on mental health in lower- and middle-income countries (LMICs). Glob Ment Health 2020; 7:e35Crossref, MedlineGoogle Scholar

3. Tee M, Wang C, Tee C, et al.: Impact of the COVID-19 pandemic on physical and mental health in lower and upper middle-income Asian Countries: a comparison between the Philippines and China. Front Psychiatry 2021; 11:568929Crossref, MedlineGoogle Scholar

4. Li L, Li F, Fortunati F, et al.: Association of a prior psychiatric diagnosis with mortality among hospitalized patients with coronavirus disease 2019 (COVID-19) infection. JAMA Netw Open 2020; 3:e2023282Crossref, MedlineGoogle Scholar

5. Ettman CK, Abdalla SM, Cohen GH, et al.: Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Netw Open 2020; 3:e2019686Crossref, MedlineGoogle Scholar

6. Panchal N, Kamal R, Cox C, et al.: The Implications of COVID-19 for Mental Health and Substance Use. Oakland, CA, Kaiser Family Foundation, 2021. https://www.kff.org/coronavirus-covid-19/issue-brief/the-implications-of-covid-19-for-mental-health-and-substance-use/Google Scholar

7. Policy Brief: COVID-19 and the Need for Action on Mental Health. New York, United Nations, 2020. https://unsdg.un.org/sites/default/files/2020-05/UN-Policy-Brief-COVID-19-and-mental-health.pdfGoogle Scholar

8. Kola L, Kohrt BA, Hanlon C, et al.: COVID-19 mental health impact and responses in low-income and middle-income countries: reimagining global mental health. Lancet Psychiatry 2021; 8:535–550Crossref, MedlineGoogle Scholar

9. Barbui C, Purgato M, Abdulmalik J, et al.: Efficacy of psychosocial interventions for mental health outcomes in low-income and middle-income countries: an umbrella review. Lancet Psychiatry 2020; 7:162–172Crossref, MedlineGoogle Scholar

10. Singla DR, Kohrt BA, Murray LK, et al.: Psychological treatments for the world: lessons from low- and middle-income countries. Annu Rev Clin Psychol 2017; 13:149–181Crossref, MedlineGoogle Scholar

11. Bhaskar S, Bradley S, Chattu VK, et al.: Telemedicine across the globe—position paper from the COVID-19 Pandemic Health System Resilience PROGRAM (REPROGRAM) International Consortium (part 1). Front Public Health 2020; 8:556720Crossref, MedlineGoogle Scholar

12. Second Round of the National Pulse Survey on Continuity of Essential Health Services During the COVID-19 Pandemic: January–March 2021: Interim Report. Geneva, World Health Organization, 2021. https://www.who.int/publications/i/item/WHO-2019-nCoV-EHS-continuity-survey-2021.1Google Scholar

13. Makri A: Bridging the digital divide in health care. Lancet Digital Health 2019; 1:e204–e205 CrossrefGoogle Scholar

14. Joshi U, Naslund JA, Anand A, et al.: Assessing costs of developing a digital program for training community health workers to deliver treatment for depression: a case study in rural India. Psychiatry Res 2022; 307:114299Crossref, MedlineGoogle Scholar

15. Wainberg ML, Gouveia ML, Stockton MA, et al.: Technology and implementation science to forge the future of evidence-based psychotherapies: the PRIDE scale-up study. Evid Based Ment Health 2021; 24:19–24Crossref, MedlineGoogle Scholar

16. Wainberg ML, Lovero KL, Duarte CS, et al.: Partnerships in research to implement and disseminate sustainable and scalable evidence-based practices (PRIDE) in Mozambique. Psychiatr Serv 2020; 72:802–811LinkGoogle Scholar

17. Francis B, Juares Rizal A, Ahmad Sabki Z, et al.: Remote Psychological First Aid (rPFA) in the time of Covid-19: a preliminary report of the Malaysian experience. Asian J Psychiatr 2020; 54:102240Crossref, MedlineGoogle Scholar

18. Rahman A, Naslund JA, Betancourt TS, et al.: The NIMH global mental health research community and COVID-19. Lancet Psychiatry 2020; 7:834–836Crossref, MedlineGoogle Scholar

19. McBride K, Harrison S, Mahata S, et al.: Building mental health and psychosocial support capacity during a pandemic: the process of adapting problem management plus for remote training and implementation during COVID-19 in New York City, Europe and East Africa. Intervention 2021; 19:37–47 Google Scholar

20. Liberal SP, Bordiano G, Lovisi GM, et al.: Implementation of a telemental health service for medical students during the COVID-19 pandemic [in Portuguese]. Rev Bras Educ Méd 2021; 45:e202 Google Scholar

21. Diwan MN, Ali Awan H, Aamir A, et al.: Telepsychiatry in low- and middle-income countries during COVID-19: pandemic, barriers, and road model. J Nervous Ment Dis 2021; 209:144–146Crossref, MedlineGoogle Scholar

22. Operational Considerations for Multisectoral Mental Health and Psychosocial Support Programmes During the COVID-19 Pandemic. Geneva, Inter-Agency Standing Committee Reference Group MHPSS, 2020. https://interagencystandingcommittee.org/system/files/2020-06/IASC%20Guidance%20on%20Operational%20considerations%20for%20Multisectoral%20MHPSS%20Programmes%20during%20the%20COVID-19%20Pandemic.pdfGoogle Scholar

23. Remote Psychological First Aid During the COVID-19 Outbreak: Interim Guidance–March 2020. Copenhagen, International Federation of Red Cross and Red Crescent Societies, 2020. https://reliefweb.int/sites/reliefweb.int/files/resources/IFRC-PS-Centre-Remote-Psychological-First-Aid-during-a-COVID-19-outbreak-Interim-guidance.pdf Google Scholar

24. Online Psychological First Aid Training for COVID-19. Copenhagen, International Federation of Red Cross and Red Crescent Societies, Psychosocial Centre, 2020. https://pscentre.org/?resource=online-pfa-training-for-covid-19 Google Scholar

25. Wind TR, Rijkeboer M, Andersson G, et al.: The COVID-19 pandemic: the “black swan” for mental health care and a turning point for e-health. Internet Interv 2020; 20:100317Crossref, MedlineGoogle Scholar

26. Kola L, Kohrt BA, Acharya B, et al.: The path to global equity in mental health care in the context of COVID-19. Lancet 2021; 398:1670–1672Crossref, MedlineGoogle Scholar

27. Jordans MJD, Kohrt BA: Scaling up mental health care and psychosocial support in low-resource settings: a roadmap to impact. Epidemiol Psychiatr Sci 2020; 29:e189Crossref, MedlineGoogle Scholar

28. Edgar L, Mclean S, Hogan SO, et al.: The Milestones Guidebook. Chicago, Accreditation Council for Graduate Medical Education, 2020. https://www.acgme.org/globalassets/milestonesguidebook.pdfGoogle Scholar

29. Development of a Global Competency Framework for UHC. Geneva, World Health Organization, 2019. https://www.who.int/news/item/30-04-2019-development-of-a-global-competency-framework-for-uhcGoogle Scholar

30. Mills JA, Middleton JW, Schafer A, et al.: Proposing a re-conceptualisation of competency framework terminology for health: a scoping review. Hum Resour Health 2020; 18:15Crossref, MedlineGoogle Scholar

31. Alloh FT, Regmi P, Onche I, et al.: Mental health in low-and middle income countries (LMICs): going beyond the need for funding. Health Prospect 2018; 17:12–17CrossrefGoogle Scholar

32. Prydz EB, Wadhwa D: Classifying Countries by Income. Washington, DC, World Bank, 2019. https://datatopics.worldbank.org/world-development-indicators/stories/the-classification-of-countries-by-income.htmlGoogle Scholar

33. Tricco AC, Antony J, Zarin W, et al.: A scoping review of rapid review methods. BMC Med 2015; 13:224Crossref, MedlineGoogle Scholar

34. Konnyu KJ, Kwok E, Skidmore B, et al.: The effectiveness and safety of emergency department short stay units: a rapid review. Open Med 2012; 6:e10–e16MedlineGoogle Scholar

35. Stevens A, Garritty C, Hersi M, et al.: Developing PRISMA-RR, A Reporting Guideline for Rapid Reviews of Primary Studies (Protocol). Oxford, Equator Network, 2018. https://www.equator-network.org/wp-content/uploads/2018/02/PRISMA-RR-protocol.pdf Google Scholar

36. Sunderji N, Crawford A, Jovanovic M: Telepsychiatry in graduate medical education: a narrative review. Acad Psychiatry 2015; 39:55–62Crossref, MedlineGoogle Scholar

37. Chike-Harris KE, Durham C, Logan A, et al.: Integration of telehealth education into the health care provider curriculum: a review. Telemed J E Health 2020; 27:137–149Crossref, MedlineGoogle Scholar

38. Miller GE: The assessment of clinical skills/competence/performance. Acad Med 1990; 65:S63–S67Crossref, MedlineGoogle Scholar

39. Fairburn CG, Cooper Z: Therapist competence, therapy quality, and therapist training. Behav Res Ther 2011; 49:373–378Crossref, MedlineGoogle Scholar

40. Kohrt BA, Schafer A, Willhoite A, et al.: Ensuring Quality in Psychological Support (WHO EQUIP): developing a competency global workforce. World Psychiatry 2020; 19:115–116Crossref, MedlineGoogle Scholar

41. Ottman KE, Kohrt BA, Pedersen GA, et al.: Use of role plays to assess therapist competency and its association with client outcomes in psychological interventions: a scoping review and competency research agenda. Behav Res Ther 2020; 130:103531Crossref, MedlineGoogle Scholar

42. Gifford V, Niles B, Rivkin I, et al.: Continuing education training focused on the development of behavioral telehealth competencies in behavioral healthcare providers. Rural Remote Health 2012; 12:2108MedlineGoogle Scholar

43. Dorsey S, Lyon AR, Pullmann MD, et al.: Behavioral rehearsal for analogue fidelity: feasibility in a state-funded children’s mental health initiative. Adm Policy Ment Health 2017; 44:395–404Crossref, MedlineGoogle Scholar

44. Beidas RS, Cross W, Dorsey S: Show me, don’t tell me: behavioral rehearsal as a training and analogue fidelity tool. Cogn Behav Pract 2014; 21:1–11Crossref, MedlineGoogle Scholar

45. Cross WF, Seaburn D, Gibbs D, et al.: Does practice make perfect? A randomized control trial of behavioral rehearsal on suicide prevention gatekeeper skills. J Prim Prev 2011; 32:195–211Crossref, MedlineGoogle Scholar

46. EndNote, X9 ed. Philadelphia, Clarivate, 2013Google Scholar

47. Covidence Systematic Review Software. Melbourne, Veritas Health Innovation, 2021Google Scholar

48. DeJong SM: Professionalism and technology: competencies across the tele-behavioral health and e-behavioral health spectrum. Acad Psychiatry 2018; 42:800–807Crossref, MedlineGoogle Scholar

49. Hames JL, Bell DJ, Perez-Lima LM, et al.: Navigating uncharted waters: considerations for training clinics in the rapid transition to telepsychology and telesupervision during COVID-19. J Psychother Integr 2020; 30:348–365CrossrefGoogle Scholar

50. McCord CE, Saenz JJ, Armstrong TW, et al.: Training the next generation of counseling psychologists in the practice of telepsychology. Couns Psychol Q 2015; 28:324–344CrossrefGoogle Scholar

51. Shore JH, Yellowlees P, Caudill R, et al.: Best practices in videoconferencing-based telemental health April 2018. Telemed J E Health 2018; 24:827–832Crossref, MedlineGoogle Scholar

52. Best Practices in Videoconferencing-Based Telemental Health (April 2018). Washington, DC, and Arlington, VA, American Psychiatric Association and American Telemedicine Association, 2018. https://www.psychiatry.org/File%20Library/Psychiatrists/Practice/Telepsychiatry/APA-ATA-Best-Practices-in-Videoconferencing-Based-Telemental-Health.pdfGoogle Scholar

53. Hilty DM, Crawford A, Teshima J, et al.: A framework for telepsychiatric training and e-health: competency-based education, evaluation and implications. Int Rev Psychiatry 2015; 27:569–592Crossref, MedlineGoogle Scholar

54. Hilty DM, Maheu MM, Drude KP, et al.: The need to implement and evaluate telehealth competency frameworks to ensure quality care across behavioral health professions. Acad Psychiatry 2018; 42:818–824Crossref, MedlineGoogle Scholar

55. Sabin JE, Skimming K: A framework of ethics for telepsychiatry practice. Int Rev Psychiatry 2015; 27:490–495Crossref, MedlineGoogle Scholar

56. McCord C, Bernhard P, Walsh M, et al.: A consolidated model for telepsychology practice. J Clin Psychol 2020; 76:1060–1082Crossref, MedlineGoogle Scholar

57. Alqahtani MMJ, Alkhamees HA, Alkhalaf AM, et al.: Toward establishing telepsychology guideline. Turning the challenges of COVID-19 into opportunity. Ethics Med Public Health 2021; 16:100612Crossref, MedlineGoogle Scholar

58. Barnett JE, Kolmes K: The practice of tele-mental health: ethical, legal, and clinical issues for practitioners. Pract Innov 2016; 1:53–66CrossrefGoogle Scholar

59. Danesh V, Rolin D, Hudson SV, et al.: Telehealth in mental health nursing education: health care simulation with remote presence technology. J Psychosoc Nurs Ment Health Serv 2019; 57:23–28Crossref, MedlineGoogle Scholar

60. IASC Guidelines on Mental Health and Psychosocial Support in Emergency Settings, 2007. Geneva, Inter-Agency Standing Committee, 2007Google Scholar

61. COVID-19 Disrupting Mental Health Services in Most Countries, WHO Survey. Geneva, World Health Organization, 2020. https://www.who.int/news/item/05-10-2020-covid-19-disrupting-mental-health-services-in-most-countries-who-survey. Updated Oct 5, 2020Google Scholar

62. Connecting for Inclusion: Broadband Access for All World Bank Group. Washington, DC, World Bank, 2022. https://www.worldbank.org/en/topic/digitaldevelopment/brief/connecting-for-inclusion-broadband-access-for-allGoogle Scholar

63. Fairburn CG, Patel V: The impact of digital technology on psychological treatments and their dissemination. Behav Res Ther 2017; 88:19–25Crossref, MedlineGoogle Scholar

64. Road Map for Digital Cooperation. New York, United Nations, 2020. https://www.un.org/en/content/digital-cooperation-roadmap/assets/pdf/Roadmap_for_Digital_Cooperation_EN.pdfGoogle Scholar

65. Kohrt BA, Jordans MJD, Rai S, et al.: Therapist competence in global mental health: development of the ENhancing Assessment of Common Therapeutic factors (ENACT) rating scale. Behav Res Ther 2015; 69:11–21Crossref, MedlineGoogle Scholar

66. Kohrt BA, Mutamba BB, Luitel NP, et al.: How competent are non-specialists trained to integrate mental health services in primary care? Global health perspectives from Uganda, Liberia, and Nepal. Int Rev Psychiatry 2018; 30:182–198Crossref, MedlineGoogle Scholar

67. Pedersen GA, Lakshmin P, Schafer A, et al.: Common factors in psychological treatments delivered by non-specialists in low- and middle-income countries: manual review of competencies. J Behav Cogn Ther 2020; 30:165–186Crossref, MedlineGoogle Scholar

68. Sikander S, Lazarus A, Bangash O, et al.: The effectiveness and cost-effectiveness of the peer-delivered Thinking Healthy Programme for perinatal depression in Pakistan and India: the SHARE study protocol for randomised controlled trials. Trials 2015; 16:534Crossref, MedlineGoogle Scholar

69. Zafar S, Sikander S, Hamdani SU, et al.: The effectiveness of Technology-assisted Cascade Training and Supervision of community health workers in delivering the Thinking Healthy Program for perinatal depression in a post-conflict area of Pakistan—study protocol for a randomized controlled trial. Trials 2016; 17:188Crossref, MedlineGoogle Scholar

70. Hamdani U, Akhtar P, Zill EH, et al.: WHO Parents Skills Training (PST) programme for children with developmental disorders and delays delivered by Family Volunteers in rural Pakistan: study protocol for effectiveness implementation hybrid cluster randomized controlled trial. Glob Ment Health 2017; 4:e11Crossref, MedlineGoogle Scholar

71. Sangraula M, Turner EL, Luitel NP, et al.: Feasibility of Group Problem Management Plus (PM+) to improve mental health and functioning of adults in earthquake-affected communities in Nepal. Epidemiol Psychiatr Sci 2020; 29:e130Crossref, MedlineGoogle Scholar

72. Jordans MJD, Aldridge L, Luitel NP, et al.: Evaluation of outcomes for psychosis and epilepsy treatment delivered by primary health care workers in Nepal: a cohort study. Int J Ment Health Syst 2017; 11:70Crossref, MedlineGoogle Scholar

73. Jordans MJD, Coetzee A, Steen HF, et al.: Assessment of service provider competency for child and adolescent psychological treatments and psychosocial services in global mental health: evaluation of feasibility and reliability of the WeACT tool in Gaza, Palestine. Glob Ment Health 2021; 8:e7Crossref, MedlineGoogle Scholar

74. DeJong SM: Pediatric Telepsychiatry Curriculum: Graduate Medical Education (GME) and Continuing Medical Education (CME). Washington, DC, American Academy of Child and Adolescent Psychiatry, 2020. https://www.aacap.org/App_Themes/AACAP/Docs/clinical_practice_center/business_of_practice/Telepsych/Pediatric_Telepsychiatry_Curriculum_Oct_2020-web.pdfGoogle Scholar