The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
ArticlesFull Access

E-Mental Health: A Rapid Review of the Literature

Published Online:https://doi.org/10.1176/appi.ps.201300009

Abstract

Objective

The authors conducted a review of the literature on e-mental health, including its applications, strengths, limitations, and evidence base.

Methods

The rapid review approach, an emerging type of knowledge synthesis, was used in response to a request for information from policy makers. MEDLINE was searched from 2005 to 2010 by using relevant terms. The search was supplemented with a general Internet search and a search focused on key authors.

Results

A total of 115 documents were reviewed: 94% were peer-reviewed articles, and 51% described primary research. Most of the research (76%) originated in the United States, Australia, or the Netherlands. The review identified e-mental health applications addressing four areas of mental health service delivery: information provision; screening, assessment, and monitoring; intervention; and social support. Currently, applications are most frequently aimed at adults with depression or anxiety disorders. Some interventions have demonstrated effectiveness in early trials. Many believe that e-mental health has enormous potential to address the gap between the identified need for services and the limited capacity and resources to provide conventional treatment. Strengths of e-mental health initiatives noted in the literature include improved accessibility, reduced costs (although start-up and research and development costs are necessary), flexibility in terms of standardization and personalization, interactivity, and consumer engagement.

Conclusions

E-mental health applications are proliferating and hold promise to expand access to care. Further discussion and research are needed on how to effectively incorporate e-mental health into service systems and to apply it to diverse populations.

Innovations in information and communication technology (ICT) are transforming the landscape of health service delivery. This emerging field, often referred to as “e-health,” includes key features, such as electronic, efficient, enhancing quality, evidence based, empowering, encouraging, education, enabling, extending, ethics, and equity (1). E-health is a broader concept than telehealth (and telemedicine), which involves the use of ICT to connect patients and providers in real time across geographical distances (2) for the delivery of typical care and where the use of real-time video is the main modality (3).

Interest is also increasing in the application of ICT in mental health care. For example, the first international e-mental health summit was held in 2009 in Amsterdam, and a summit-specific issue of the Journal of Medical Internet Research was published (4). Christensen and colleagues (5) defined e-mental health as “mental health services and information delivered or enhanced through the Internet and related technologies.” However, there is no agreement on a field-specific definition. Some scholars consider e-mental health to include only initiatives delivered directly to mental health service users (6) and only on the Internet (6,7) (as opposed to, for example, delivery via stand-alone computers or video seminars). Others adopt a wider definition that includes frontline delivery activities related to screening, mental health promotion and prevention, provision of treatment, staff training, administrative support (for example, patient records), and research (4).

Because of the growth of the e-mental health field, it is difficult for policy makers and practitioners to stay abreast of available applications and the evidence for their effectiveness. In response to a request from a Canadian executive-level policy maker, we conducted a rapid review of the literature on e-mental health. In this article, we report briefly on the review methods and summarize key findings.

Methods

Rapid reviews are an emerging type of knowledge synthesis used to inform health-related policy decisions and discussions, especially when information needs are immediate (811). Rapid reviews streamline systematic review methods—for example, by focusing the literature search (8) while still aiming to produce valid conclusions. The requirements for the review, which was undertaken with a two-week deadline, were for a short (maximum eight pages) but in-depth synthesis of the current state of the science on the topic. The personnel available was one senior (doctoral-level) mental health services researcher (CEA). Later, a second (doctoral-level) mental health services researcher (SL) validated the conclusions by screening all titles and abstracts, extracting and synthesizing additional data, and reviewing the findings.

The overarching review question was: What is currently known on the topic of e-mental health? (Even though telepsychiatry is typically included in e-mental health definitions, we did not include this subtopic because its literature is already well developed with several systematic reviews and reviews of reviews.)

Several secondary questions were developed and refined as the review progressed: What types of e-mental health initiatives have been developed? What are the strengths and benefits of e-mental health? What are the concerns with and barriers to use of e-mental health? What is the state of the evidence for the effectiveness of e-mental health? How has e-mental health been integrated in service systems and policy?

The rapid review method used is similar to Khangura and colleagues’ (10) seven-step process. Briefly, the search focused on English, peer-reviewed full abstracts in MEDLINE from 2005 to 2010 and used the MESH terms mental disorders and internet and the following non-MESH key words: e-mental health, e-therapy, computer, computer-based therapy, computer-based treatment, web-based therapy, web-based treatment. We excluded search terms related to telehealth because that is a distinct, and well-established subset of the e-health field that mainly considers the use of telecommunications to connect service providers and patients across geographical distances (3) (as opposed to delivering automated, self-management interventions, for example). The search was run in MEDLINE because of time constraints and because it is the most widely searched database for health-related topics, has comprehensive coverage (more than 5,500 journals), and has substantial capture of the content of health services research and overlap with similar sources.

The initial search (December 2010) yielded 158 titles or abstracts. Similar keywords were also used in a brief on-line grey literature search, which retrieved additional relevant documents, such as a list of in-progress trials, a policy report, and recent conference proceedings. Two experts on e-mental health were also contacted by e-mail for comment on the appropriateness of the identified literature and additional articles. Final searches focused on the work of prominent authors (for example, Christensen, Hickie, and Titov). These searches yielded an additional 50 titles and abstracts, resulting in 208 titles and abstracts screened for duplicates and relevancy.

Further details on the rapid review method and our search and selection strategy are provided in an online data supplement to this article.

Results

General description of the literature

The screening process resulted in 115 documents, which were reviewed. Of these, 108 (94%) had been peer reviewed. Publication dates were from 2000 to 2010, with most (N=91, 79%) published between 2007 and 2010, which confirmed an expected increase in the volume of literature on the topic over time. Of the 115 documents, 59 (51%) reported primary empirical studies, of which 25 (42%) were conducted in the United States, 13 (22%) in Australia, and seven (12%) in the Netherlands.

Types of e-mental health initiatives

The review identified e-mental health applications addressing four areas of mental health service delivery: information provision (6,12); screening, assessment, and monitoring (1320); intervention (2124); and social support (25). Many applications addressed several areas of mental health service delivery concurrently (2629). [A table listing examples of these e-mental health programs and initiatives is provided in the online data supplement. It summarizes information on the purpose of the application, the health conditions and populations targeted, and the components and technologies used.]

With respect to information provision, there is an identified need to ensure the quality of information about mental health. Therefore, tools such as the Brief DISCERN (13) have been developed to help users assess the quality of mental health–related content on Web sites.

Screening and assessment tools have been available for many years on stand-alone computers, but more recent developments are Internet-based screening tools to provide broader access to individuals for self-assessment (particularly to underserved or hard-to-reach groups) or for use by professionals in specific settings (for example, primary care) (30). For example, Diamond and colleagues (16) described an Internet-based behavioral health screening tool for adolescents and young adults in primary care. It requires minimal time to complete; addresses a broad spectrum of psychiatric symptoms, risk behaviors, and patient strengths; is automatically scored online; and allows results to be integrated into the patient’s electronic medical record and into system-level performance measurement.

Social support in e-mental health occurs through several types of Web-based formats, including discussion groups, bulletin boards, chat rooms, blogs, and social media. For example, Scharer (25) reported on a pilot study that examined the effectiveness of an online electronic bulletin board to provide social support to parents of children with mental illness. Parents made use of the bulletin board over a four-month period, actively posting messages to each other about their children’s illness or about the group.

E-mental health interventions were classified in our review by stage (promotion, prevention, early intervention, active treatment, maintenance, and relapse prevention), type of relationship (for example, between a professional and a consumer, between consumers, and between professionals), and treatment or therapy modality (for example, cognitive-behavioral therapy [CBT] and psychoeducation). Treatments identified were self-led or led by a therapist or were a combination (for example, self-led and therapist guided). Interventions were provided as the primary therapy or adjunct to conventional in-person therapy and were delivered to individuals or groups or both. For example, MoodGYM is an exemplary Web-based, interactive intervention that has been developed and evaluated in several randomized controlled trials (27,3133). Its purpose is to enhance coping skills in relation to depression, and it includes assessments, workbooks, games, online exercises, and feedback. MoodGYM is freely available to the public and has been translated into several languages.

Most of the interventions studied were situated on a specific point of the continuum of care (for example, prevention, mental health promotion, or intervention) and used a single format; however, a few incorporated several types of approaches. For example, Tillfors and colleagues (34) investigated whether an Internet-delivered self-help intervention in conjunction with minimal e-mail contact was as effective as adding in-person group sessions to the Internet intervention. They found that adding in-person group sessions did not result in significant differences in outcomes.

Typically, e-mental health interventions mimicked traditional treatment approaches in that they often addressed single disorders; none were designed for individuals with comorbid mental and substances use disorders. The most frequent disorders addressed by the 59 empirical studies were depression or anxiety (18 studies, 31%). Several interventions focused on mental health promotion or prevention, including early identification (eight studies, 14%). Most interventions were developed specifically for adults (40 studies, 68%), followed by interventions targeting adolescents or young adults (11 studies, 19%). Recent e-mental health initiatives reflect the shift in the mid-2000s to Web 2.0 technologies (that is, more interactive, multimedia, and user-driven technologies) (35).

Strengths and benefits

Many authors believe that e-mental health has enormous potential to address the gap between the identified need for mental health services in the population and the limited capacity and resources to provide conventional treatment services (13,30). Strengths of e-mental health initiatives noted in the literature include improved accessibility, reduced costs (although start-up and research and development costs are necessary), flexibility in terms of standardization and personalization, interactivity, and consumer engagement (5,30,3438). E-health technologies are considered to be particularly promising for rural and remote populations. They are also promising for subpopulations that have other barriers to access (attitudinal, financial, or temporal) or that avoid treatment because of stigma. For example, by using Internet-based social support, individuals can share their perspectives freely while preserving their anonymity. Further details and examples of benefits are summarized in a box on the next page.

Concerns and barriers

Some concerns and barriers are associated with using e-mental health. There are concerns that e-mental health will replace important and needed conventional services; divert attention away from improvements to or funding for conventional services; and be costly to develop, deploy, and evaluate (5). Another issue raised in the literature is related to the financial interests of developers and researchers, which may produce a risk of publication bias (39). Others have highlighted the limited evidence base for interventions, lack of quality control and care standards, and slow uptake by or reluctance among health care professionals (39,40). Some question the ability of professionals to establish therapeutic relationships on line and the feasibility of online treatment for certain population groups (for example, patients with severe depression) (39). Emmelkamp (39) described “technological phobia,” whereby professionals may be unfamiliar with technology and anxious about its use in professional care. Concerns have also been expressed about the potential to further marginalize individuals who have physical, financial, or cognitive barriers in terms of access to conventional services. Finally, some are concerned that the availability of e-mental health services may lead some individuals to postpone seeking needed conventional care or that some will receive inappropriate or harmful care when there is insufficient quality control over content (7).

Ethical and liability concerns have been cited. For example, when participants are from outside the regulatory jurisdiction, ethical responsibilities cannot be met; other concerns are that participants cannot be reliably identified and that privacy cannot be guaranteed for typed or recorded communications (5,34,37,38,41). To address these issues, several professional organizations (for example, the American Psychological Association) have developed guidelines (38), and an international organization to set standards has been established—the International Society for Mental Health Online. Even so, adherence has been found to be lacking, and concerns remain (7,39,42,43). At the same time, remedies for the above-mentioned concerns are emerging. Technology for the protection of security and confidentiality has improved, and some efforts are being made to review Web site content for quality (35,44,45). In Australia, a Web portal called Beacon has been set up that provides quality ratings for mental health Web sites and recommends evidence-based interventions (46).

Consumer engagement, reach, and response

A handful of recent studies have shed some light on the role of e-mental health providing prevention or intervention programming for particular groups of individuals, such as youths, socioeconomically diverse populations, rural and remote populations, the general public, and patients. One study investigated the preferences for e-mental health services in an online Australian sample (N=218) (47). Among individuals in the general population who were already using the Internet, a large majority (77%) expressed a preference for face-to-face services, but less than 10% indicated that they would not use e-mental health services. The authors highlighted the importance of raising public awareness, knowledge, and understanding about e-mental health services. More than 50% of the sample expressed the need to learn more about e-mental health services and about issues related to confidentiality.

More than 90% of youths now use the Internet, and it is seen as a promising medium for reaching that age group (28,48). In a large population-based sample of 2,000 young people aged 12 to 25 in Australia, 77% reported seeking information about mental health problems whether or not they had the problem themselves (49). In another study among military personnel, who are predominantly younger males, one-third of 352 respondents who reported that they were not willing to talk to a counselor in person indicated that they would be willing to use technology to address their concerns (50).

Preliminary research has also indicated that mental health service users value the use of e-mental health. A qualitative study of 36 participants found that their primary motive for Internet use was to access social support and their secondary motive was for information (51). Respondents noted that hearing about other individuals’ experiences helped them to feel less isolated and more hopeful. Respondents also liked the convenience, privacy, and anonymity of the Internet. On the other hand, several authors have documented low access to and use of the Internet among persons with more serious mental illnesses, such as those with co-occurring substance use and serious mental illness (52,53). Cost, lack of training, and impairment (in cognition, concentration, executive function, and motor control) can present barriers for individuals with serious mental illness, further disenfranchising them from services (54). However, evidence is emerging that with a user-friendly interface, high levels of engagement and positive outcomes can be obtained in online interventions for individuals with serious mental illnesses such as schizophrenia and their families (26). Nonetheless, access to and attitudes toward technology, as well as socioeconomic factors, need to be taken into account in planning Internet-based interventions for specific population groups (55).

Strengths and benefits associated with e-mental health initiatives
Improved accessibility
 For geographically hard-to-reach populations
 For populations with other types of barriers, such as lack of child care, transportation, insurance coverage, and time off work
 For populations desiring anonymity or persons who feel stigma or who are dissatisfied with conventional services
 From multiple locations, such as schools, workplaces, clinics, and hospitals
 In terms of convenience and timing; for example, can be available at any time of day and in private, and the user can control the pace
Reduced costs
 In terms of operating cost (although start-up and research and development costs are necessary)
 In relation to reaching large numbers simultaneously (for example, can be broad scale or stand alone)
 In terms of therapist time optimization and communication efficiencies
Flexibility in terms of standardization and personalization
 Can be implemented with high fidelity and also tailored to individual needs
 Can be developed according to the best research and design evidence
 Can be designed for virtually any mental health issue or topic
Interactivity and consumer engagement
 Through incorporation of multimedia
 Through consumer empowerment
 Can improve continuity of care (for example, can be integrated within a set of services across the service continuum)

Evidence base for e-mental health

Although evaluation of some interventions is limited, an encouraging amount of rigorous research is available, depending on the developmental stage of the intervention. Research on Web-based interventions has both opportunities and challenges. Studies are relatively inexpensive to conduct, and large samples can be used. Interventions are easily standardized, randomized or controlled designs are feasible (often with wait list controls), and data are easily collected. Challenges include low rates of completion because of the relative ease with which participants can drop out of studies. In addition, it is difficult to study both the intervention and the mode of delivery; contamination of the control group is possible because participants can access similar services elsewhere on the Web; the ability to conduct double-blind studies is limited; and biases related to using self-report measures are a problem (5658). Increasingly, resources for optimizing practice and evaluation are available; for example, guidelines for program design and for study methods have been published (36,59).

In the past five years, several reviews, including systematic reviews and meta-analyses of randomized controlled trials, have documented the progress made; effectiveness has been demonstrated in particular for interventions (both therapist assisted and self-directed) addressing depression and anxiety disorders (57,59,60). For example, a systematic review of meta-analyses of the efficacy of Internet-based self-help for depression and anxiety disorders reported that these interventions are effective and that effect sizes are comparable to those observed in similar interventions delivered in person (60). Systematic reviews of Internet-based CBT interventions (prevention and treatment) for anxiety and depression among adults have found that they are as effective as or more effective than treatment as usual (57). Preliminary evidence has also been reported for the effectiveness of Internet-based interventions to address issues such as stress, insomnia, and substance abuse (61). There are still some interventions for which evidence is weak or contrary, such as one CBT-based program for individuals with obsessive-compulsive disorder (62), and not all studies evaluating the effectiveness of Internet-based interventions for depression and anxiety have found positive results (62,63). Lower effect sizes have generally been found for interventions targeting alcohol and smoking cessation compared with those for anxiety and depression (61). There are some indications that programs work best for individuals with mild to moderate disorders; however, this group has been the focus of most research. Despite the popularity of online support groups, concerns about the encouragement of maladaptive behaviors, or support for continuing such behaviors, have surfaced—for example, in a recent survey of members of an eating disorders forum (64).

Systematic reviews are also beginning to appear that address e-health interventions for children and youths. For example, Stinson and colleagues (65) found that symptoms improved in seven of nine identified self-management interventions. A recent narrative review of Internet-based prevention and treatment programs for anxiety and depression among children and adolescents concluded that there was early support for effectiveness but a need for more rigorous research as well as interventions specifically targeting children (66). Recent innovations, such as those that embed prevention and early-intervention content in online games, need more evaluation. A study of one such program found a nonsignificant worsening effect on support seeking, avoidance, and resilience outcomes, especially among males (29). An interactive fantasy gaming approach has also been developed by Sally Merry, M.D., of Auckland, New Zealand (personal communication, Merry S, Dec. 2010). A recently published randomized controlled trial demonstrated its effectiveness among adolescents seeking help for depression in primary care settings (67).

In the area of substance use and abuse, a systematic review of Internet-based interventions for young people found small positive effects for programs aimed at alcohol abuse; the effects were of similar magnitude to those of brief in-person interventions, but the Internet-based interventions had the advantage of much broader delivery (68). However, programs aimed at preventing subsequent development of alcohol-related problems among those who were nondrinkers at baseline were generally not effective.

More research is needed on individual or subgroup predictors of differential outcomes of e-mental health interventions (21,69). Moreover, even though there is some preliminary evidence supporting the lower cost of using e-mental health approaches, true cost-effectiveness studies are just beginning to appear in the literature (70).

E-mental health, systems, and policy

Most of the literature reviewed described the development, implementation, and evaluation of single interventions in isolation. One very important question that has been given limited attention is how e-mental health interventions might best be situated in relation to an array of related services for a broad population. In a rare exception, van Straten and colleagues (71) discussed a stepped-care approach for depression in primary care wherein interventions advance from watchful waiting through self-guided but supported intervention (including Web-based formats), brief face-to-face psychotherapy, and finally longer-term face-to-face psychotherapy with consideration of antidepressant medication. To ensure continuity of care, a care manager monitors patient status at all levels and makes decisions about necessary transitions. Treatments at all levels are evidence based. These authors described trials of two different e-mental health interventions, including one for younger adults, and most important, how they fit within the full stepped-care model. Data on cost-effectiveness of the full model are unavailable, but the authors suggested that the incidence of new cases of depression and anxiety could be halved by introducing this model.

Andrews and Titov (72) described the promotion of Internet-based treatment programs (a virtual clinic) connected to a hospital in Sydney, Australia. The programs are considered to be cost-effective alternatives to medication or face-to-face CBT treatment. Programs are offered for major depression, social phobia, panic disorder, and generalized anxiety disorder. Programs are available free or at very low cost directly to the public; general practitioners and other mental health professionals can use these programs in addition to or instead of conventional care. Trial results show high levels of patient adherence and strong reductions in symptoms with very little investment of clinician time. The authors discuss how e-mental health programs might fit in a broader health service delivery context (for example, in U.S. health maintenance organizations, health care trusts in the United Kingdom, and regional health authorities in Canada). They suggest that the programs could be the first level of treatment for the proportion of the population that desires Internet-based treatment; however, with the support of a small team, individuals who need more support could be identified and referred for more intensive intervention.

An approach that reaches out to the total population but that is not fully connected to conventional services has been described by Bennett and colleagues (27). At its center is “e-hub,” which is an online self-help mental health service available free to the public. The service provides automated Web interventions for several needs, such as symptoms of depression, anxiety, and social anxiety, and an online bulletin board. Programs focus on the prevention and early-intervention end of the spectrum. There is no therapist involvement in the interventions, and the bulletin board is moderated by trained consumers under the supervision of a clinical psychologist. Interested individuals can contact the e-hub by e-mail. The organizers report a high volume of use by individuals with and without mental disorders, some over a lengthy period. The service is considered most suitable for those who prefer to receive help anonymously, prefer self-help, or reside in rural or remote areas. Quality control processes are included.

No peer-reviewed articles had a central focus on policy-level discussions about e-mental health. However, the gray literature search yielded one major report on the topic from Australia, E-Mental Health in Australia: Implications of the Internet and Related Technologies for Policy (5). Although the report was published in 2004, much of the content is relevant for other countries, because many are only at the beginning stages of e-mental health implementation. The report describes the advantages of e-mental health initiatives and barriers to implementation (as described above). Five major recommendations for moving forward are included related to access, ethical issues, quality and effectiveness, technology, and funding.

Articles and studies identified by the rapid review but not discussed here are listed in References (73103).

Discussion

The purpose of this rapid review was to synthesize and describe what is currently known on the topic of e-mental health. On the basis of the findings, several considerations for future research and practice in the field of e-mental health are evident. First, it is important to consider the fit of e-mental health initiatives within the context of the existing service system and to ensure that they complement—and not detract from—needs for direct care. Second, it is important to select interventions and initiatives on the basis of available evidence regarding both design features and effectiveness and to build research and evaluation into any new initiatives. Third, it is important to consider the needs of the population as well as the greatest potential for benefit when choosing or investing in e-mental health initiatives—for example, the intervention’s suitability for a diverse group of participants (in age, ethnocultural status, literacy, and disability) should be considered. Fourth, it is important to ensure that ethical and quality issues are addressed. Fifth, the extent to which interventions have or can be applied in cross-cultural and international contexts is an important consideration. Sixth, the involvement of consumers, as well as other relevant key stakeholder groups (such as families and caregivers, service providers, and policy makers), in the development and deployment of initiatives is paramount. Seventh, further research is needed in relation to conditions other than common disorders, such as psychotic disorders. Eighth, more rigorously conducted research is needed, such as randomized controlled trials, and it is important to understand which groups of individuals will benefit the most from such interventions and to take into account cross-cultural and international factors (for example, cultural adaptations).

It is important to acknowledge the limits of rapid review. They include focusing the search on one electronic database source (although we used the database that contains by far the largest number of health and medical journals). The search was also complemented by gray literature searches on the Internet, focused author searches, and brief key-informant consultations. A second limitation of our review is that only one author (CEA) initially screened the titles and abstracts from the total set of documents retrieved, although this author is knowledgeable about the content area and has experience conducting systematic reviews. However, the second author (SL) rescreened all extracted titles and abstracts from the total set. This rescreening uncovered additional nuances in various content areas, identified further studies for review, and provided the opportunity for incorporating more detailed information in this article (for example, technologies and components of e-mental health initiatives described in the online data supplement). Some minor errors in the initial review were also uncovered. Although the initial review was well received by its sponsors and was reported to inform key policy discussions, the effectiveness of rapid reviews in terms of their ultimate impact on health policy decisions and service outcomes remains to be systematically considered.

Conclusions

This rapid review identified a small but rich set of information on the topic of e-mental health, which was found to be highly useful for its specific intended policy discussion. The apparent promise and pitfalls of e-mental health and the increasing interest of policy makers in its potential for service system transformation indicate that careful monitoring of the evidence base is warranted.

Dr. Lal is with the Department of Psychiatry, McGill University Institute, and the Douglas Mental Health University Institute, Montreal, Quebec, Canada (e-mail: ). Dr. Adair is with the Department of Psychiatry and Community Health Sciences, University of Calgary, Calgary, Alberta, Canada.

Acknowledgments and disclosures

While conducting this review, Dr. Lal was partially supported by a postdoctoral fellowship from Knowledge Translation Canada. Dr. Adair conducted the initial review while under contract with the Mental Health Commission of Canada. The authors acknowledge Jayne Barker, Ph.D., and Janice Popp, M.S.W., for their assistance in refining the research questions to serve a policy purpose. The views expressed herein are solely those of the authors.

The authors report no competing interests.

References

1 Eysenbach G: What is e-health? Journal of Medical Internet Research 3:E20, 2001Crossref, MedlineGoogle Scholar

2 Sood S, Mbarika V, Jugoo S, et al.: What is telemedicine? A collection of 104 peer-reviewed perspectives and theoretical underpinnings. Telemedicine and e-Health 13:573–590, 2007Crossref, MedlineGoogle Scholar

3 Wade VA, Karnon J, Elshaug AG, et al.: A systematic review of economic analyses of telehealth services using real time video communication. BMC Health Services Research 10:233, 2010Crossref, MedlineGoogle Scholar

4 Riper H, Andersson G, Christensen H, et al.: Theme issue on e-mental health: a growing field in Internet research. Journal of Medical Internet Research 12:e74, 2010Crossref, MedlineGoogle Scholar

5 Christensen H, Griffiths K, Evans K: E-Mental Health in Australia: Implications of the Internet and Related Technologies for Policy. Canberra, Commonwealth Department of Health and Ageing, 2002Google Scholar

6 Lambousis E, Politis A, Markidis M, et al.: Development and use of online mental health services in Greece. Journal of Telemedicine and Telecare 8(suppl 2):51–52, 2002Crossref, MedlineGoogle Scholar

7 Ybarra ML, Eaton WW: Internet-based mental health interventions. Mental Health Services Research 7:75–87, 2005Crossref, MedlineGoogle Scholar

8 Watt A, Cameron A, Sturm L, et al.: Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. International Journal of Technology Assessment in Health Care 24:133–139, 2008Crossref, MedlineGoogle Scholar

9 Ganann R, Ciliska D, Thomas H: Expediting systematic reviews: methods and implications of rapid reviews. Implementation Science 5:56, 2010Crossref, MedlineGoogle Scholar

10 Khangura S, Konnyu K, Cushman R, et al.: Evidence summaries: the evolution of a rapid review approach. Systematic Reviews 1:10, 2012Crossref, MedlineGoogle Scholar

11 Konnyu KJ, Kwok E, Skidmore B, et al.: The effectiveness and safety of emergency department short stay units: a rapid review. Open Medicine 6:e10–e16, 2012MedlineGoogle Scholar

12 Santor DA, Poulin C, LeBlanc JC, et al.: Online health promotion, early identification of difficulties, and help seeking in young people. Journal of the American Academy of Child and Adolescent Psychiatry 46:50–59, 2007Crossref, MedlineGoogle Scholar

13 Khazaal Y, Chatton A, Cochand S, et al.: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related Websites. Patient Education and Counseling 77:33–37, 2009Crossref, MedlineGoogle Scholar

14 Becker J, Fliege H, Kocalevent R-D, et al.: Functioning and validity of a Computerized Adaptive Test to measure anxiety (A-CAT). Depression and Anxiety 25:E182–E194, 2008Crossref, MedlineGoogle Scholar

15 Chinman M, Hassell J, Magnabosco J, et al.: The feasibility of computerized patient self-assessment at mental health clinics. Administration and Policy in Mental Health and Mental Health Services Research 34:401–409, 2007Crossref, MedlineGoogle Scholar

16 Diamond G, Levy S, Bevans KB, et al.: Development, validation, and utility of Internet-based, behavioral health screen for adolescents. Pediatrics 126:e163–e170, 2010Crossref, MedlineGoogle Scholar

17 Donker T, van Straten A, Marks I, et al.: A brief Web-based screening questionnaire for common mental disorders: development and validation. Journal of Medical Internet Research 11:e19, 2009Crossref, MedlineGoogle Scholar

18 Gringras P, Santosh P, Baird G: Development of an Internet-based real-time system for monitoring pharmacological interventions in children with neurodevelopmental and neuropsychiatric disorders. Child: Care, Health and Development 32:591–600, 2006Crossref, MedlineGoogle Scholar

19 Gualtieri CT: An Internet-based symptom questionnaire that is reliable, valid, and available to psychiatrists, neurologists, and psychologists. Medscape General Medicine 9:3, 2007MedlineGoogle Scholar

20 Heron KE, Smyth JM: Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. British Journal of Health Psychology 15:1–39, 2010Crossref, MedlineGoogle Scholar

21 Spek V, Nyklícek I, Cuijpers P, et al.: Predictors of outcome of group and Internet-based cognitive behavior therapy. Journal of Affective Disorders 105:137–145, 2008Crossref, MedlineGoogle Scholar

22 Bergström J, Andersson G, Ljótsson B, et al.: Internet- versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial. BMC Psychiatry 10:54, 2010Crossref, MedlineGoogle Scholar

23 Khanna MS, Kendall PC: Computer-assisted cognitive behavioral therapy for child anxiety: results of a randomized clinical trial. Journal of Consulting and Clinical Psychology 78:737–745, 2010Crossref, MedlineGoogle Scholar

24 Khanna MS, Kendall PC: Computer-Assisted CBT for Child Anxiety: the Coping Cat CD-ROM. Cognitive and Behavioral Practice 15:159–165, 2008CrossrefGoogle Scholar

25 Scharer K: An Internet discussion board for parents of mentally ill young children. Journal of Child and Adolescent Psychiatric Nursing 18:17–25, 2005Crossref, MedlineGoogle Scholar

26 Rotondi AJ, Anderson CM, Haas GL, et al.: Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes. Psychiatric Services 61:1099–1105, 2010LinkGoogle Scholar

27 Bennett K, Reynolds J, Christensen H, et al.: e-hub: an online self-help mental health service in the community. Journal of Medical Internet Research 192(suppl):S48–S52, 2010Google Scholar

28 Burns JM, Durkin LA, Nicholas J: Mental health of young people in the United States: what role can the Internet play in reducing stigma and promoting help seeking? Journal of Adolescent Health 45:95–97, 2009Crossref, MedlineGoogle Scholar

29 Shandley K, Austin D, Klein B, et al.: An evaluation of “Reach Out Central”: an online gaming program for supporting the mental health of young people. Health Education Research 25:563–574, 2010Crossref, MedlineGoogle Scholar

30 Farrell SP, Mahone IH, Zerull LM, et al.: Electronic screening for mental health in rural primary care: implementation. Issues in Mental Health Nursing 30:165–173, 2009Crossref, MedlineGoogle Scholar

31 Christensen H, Griffiths KM, Jorm AF: Delivering interventions for depression by using the Internet: randomised controlled trial. British Medical Journal 328:265, 2004Crossref, MedlineGoogle Scholar

32 O’Kearney R, Gibson M, Christensen H, et al.: Effects of a cognitive-behavioural Internet program on depression, vulnerability to depression and stigma in adolescent males: a school-based controlled trial. Cognitive Behaviour Therapy 35:43–54, 2006Crossref, MedlineGoogle Scholar

33 Hickie IB, Davenport TA, Luscombe GM, et al.: Practitioner-supported delivery of Internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Medical Journal of Australia 192(suppl):S31–S35, 2010Crossref, MedlineGoogle Scholar

34 Tillfors M, Carlbring P, Furmark T, et al.: Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions. Depression and Anxiety 25:708–717, 2008Crossref, MedlineGoogle Scholar

35 Ginn S: Evidence based mental health and Web 2.0. Evidence-Based Mental Health 13:69–72, 2010Crossref, MedlineGoogle Scholar

36 Coyle D, Doherty G, Matthews M, et al.: Computers in talk-based mental health interventions. Interacting with Computers 19:545–562, 2007CrossrefGoogle Scholar

37 Christensen H, Hickie IB: Using e-health applications to deliver new mental health services. Medical Journal of Australia 192(suppl):S53–S56, 2010MedlineGoogle Scholar

38 Alleman JR: Online counseling: the Internet and mental health treatment. Psychotherapy 39:199–209, 2002CrossrefGoogle Scholar

39 Emmelkamp PM: Technological innovations in clinical assessment and psychotherapy. Psychotherapy and Psychosomatics 74:336–343, 2005Crossref, MedlineGoogle Scholar

40 Christensen H, Griffiths K: The internet and mental health practice. Evidence-Based Mental Health 6:66–69, 2003Crossref, MedlineGoogle Scholar

41 Perecherla S: Web matters. Evidence-Based Mental Health 12:4–6, 2009Crossref, MedlineGoogle Scholar

42 Humphreys K, Winzelberg A, Klaw E: Psychologists’ ethical responsibilities in Internet-based groups: issues, strategies, and a call for dialogue. Professional Psychology, Research and Practice 31:493–496, 2000Crossref, MedlineGoogle Scholar

43 Recupero P, Rainey SE: Forensic aspects of e-therapy. Journal of Psychiatric Practice 11:405–410, 2005Crossref, MedlineGoogle Scholar

44 Taylor C, Luce K: Computer- and Internet-based psychotherapy interventions. Current Directions in Psychological Science 12:18–22, 2003CrossrefGoogle Scholar

45 Christensen H, Hickie IB: E-mental health: a new era in delivery of mental health services. Medical Journal of Australia 192(suppl):S2–S3, 2010MedlineGoogle Scholar

46 Santhiveeran J: Compliance of social work e-therapy websites to the NASW Code of Ethics. Social Work in Health Care 48:1–13, 2009Crossref, MedlineGoogle Scholar

47 Klein B, Cook S: Preferences for e-mental health services amongst an online Australian sample. Electronic Journal of Applied Psychology 6:27–38, 2010Google Scholar

48 Horgan A, Sweeney J: Young students’ use of the Internet for mental health information and support. Journal of Psychiatric and Mental Health Nursing 17:117–123, 2010Crossref, MedlineGoogle Scholar

49 Burns JM, Davenport TA, Durkin LA, et al.: The Internet as a setting for mental health service utilisation by young people. Journal of Medical Internet Research 192(suppl):S22–S26, 2010Google Scholar

50 Wilson JA, Onorati K, Mishkind M, et al.: Soldier attitudes about technology-based approaches to mental health care. Cyberpsychology and Behavior 11:767–769, 2008Crossref, MedlineGoogle Scholar

51 Powell J, Clarke A: Investigating Internet use by mental health service users: interview study. Studies in Health Technology and Informatics 129:1112–1116, 2007MedlineGoogle Scholar

52 Borzekowski DLG, Leith J, Medoff DR, et al.: Use of the Internet and other media for health information among clinic outpatients with serious mental illness. Psychiatric Services 60:1265–1268, 2009LinkGoogle Scholar

53 Clayton S, Borzekowski D, Himelhoch S, et al.: Media and internet ownership and use among mental health outpatients with serious mental illness. American Journal of Drug and Alcohol Abuse 35:364–367, 2009Crossref, MedlineGoogle Scholar

54 Nicholson JRA, Rotondi AJ: The Internet, health promotion, and community participation. Psychiatric Services 61:96–97, 2010LinkGoogle Scholar

55 Yellowlees P, Marks S, Hilty D, et al.: Using e-health to enable culturally appropriate mental healthcare in rural areas. Telemedicine Journal and e-Health 14:486–492, 2008Crossref, MedlineGoogle Scholar

56 Eysenbach G: Issues in evaluating health websites in an Internet-based randomized controlled trial. Journal of Medical Internet Research 4:E17, 2002Crossref, MedlineGoogle Scholar

57 Kaltenthaler E, Parry G, Beverley C, et al.: Computerised cognitive-behavioural therapy for depression: systematic review. British Journal of Psychiatry 193:181–184, 2008Crossref, MedlineGoogle Scholar

58 Christensen H, Griffiths KM, Farrer L: Adherence in Internet interventions for anxiety and depression. Journal of Medical Internet Research 11:e13, 2009Crossref, MedlineGoogle Scholar

59 Smit F, Riper H: E-Mental Health: Presence and Future. Utrecht, Netherlands, Innovation Centre of Mental Health and Technology, 2010Google Scholar

60 Van’t Hof E, Cuijpers P, Stein DJ: Self-help and Internet-guided interventions in depression and anxiety disorders: a systematic review of meta-analyses. CNS Spectrums 14(suppl 3):34–40, 2009Crossref, MedlineGoogle Scholar

61 Amstadter AB, Broman-Fulks J, Zinzow H, et al.: Internet-based interventions for traumatic stress-related mental health problems: a review and suggestion for future research. Clinical Psychology Review 29:410–420, 2009Crossref, MedlineGoogle Scholar

62 Computerised Cognitive Behaviour Therapy for Depression and Anxiety (review). London, National Institute for Health and Clinical Excellence, 2008Google Scholar

63 Griffiths KM, Farrer L, Christensen H: The efficacy of Internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Medical Journal of Australia 192(suppl):S4–S11, 2010Crossref, MedlineGoogle Scholar

64 Ransom DC, La Guardia JG, Woody EZ, et al.: Interpersonal interactions on online forums addressing eating concerns. International Journal of Eating Disorders 43:161–170, 2010MedlineGoogle Scholar

65 Stinson J, Wilson R, Gill N, et al.: A systematic review of Internet-based self-management interventions for youth with health conditions. Journal of Pediatric Psychology 34:495–510, 2009Crossref, MedlineGoogle Scholar

66 Calear AL, Christensen H: Review of Internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Medical Journal of Australia 192(suppl):S12–S14, 2010Crossref, MedlineGoogle Scholar

67 Merry SN, Stasiak K, Shepherd M, et al.: The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. British Medical Journal 344:e2598, 2012Crossref, MedlineGoogle Scholar

68 Tait RJ, Christensen H: Internet-based interventions for young people with problematic substance use: a systematic review. Medical Journal of Australia 192(suppl):S15–S21, 2010Crossref, MedlineGoogle Scholar

69 Postel M, De Haan H, De Jong C: E-therapy for mental health problems: a systematic review. Telemedicine and e-Health 14:707–714, 2008Crossref, MedlineGoogle Scholar

70 Woolderink M, Smit F, van der Zanden R, et al.: Design of an Internet-based health economic evaluation of a preventive group-intervention for children of parents with mental illness or substance use disorders. BMC Public Health 10:470, 2010Crossref, MedlineGoogle Scholar

71 van Straten A, Seekles W, Beekman ATF, et al.: Stepped care for depression in primary care: what should be offered and how? Medical Journal of Australia 192(suppl 11):S36–S39, 2010Crossref, MedlineGoogle Scholar

72 Andrews G, Titov N: Is Internet treatment for depressive and anxiety disorders ready for prime time? Medical Journal of Australia 192(suppl):S45–S47, 2010Crossref, MedlineGoogle Scholar

73 Barnes DE, Yaffe K, Belfor N, et al.: Computer-based cognitive training for mild cognitive impairment: results from a pilot randomized, controlled trial. Alzheimer Disease and Associated Disorders 23:205–210, 2009Crossref, MedlineGoogle Scholar

74 Swanton R, Collin P, Burns J, et al.: Engaging, understanding and including young people in the provision of mental health services. International Journal of Adolescent Medicine and Health 19:325–332, 2007Crossref, MedlineGoogle Scholar

75 Carroll KM, Ball SA, Martino S, et al.: Computer-assisted delivery of cognitive-behavioral therapy for addiction: a randomized trial of CBT4CBT. American Journal of Psychiatry 165:881–888, 2008LinkGoogle Scholar

76 Crilly J, Lewis J: Internet-based psychiatric interventions: applications for rural veterans at risk for suicide. Presented at the International Conference on Society and Information Technology, Orlando, Fla, April 6–9, 2010Google Scholar

77 Cukrowicz KC, Smith PN, Hohmeister HC, et al.: The moderation of an early intervention program for anxiety and depression by specific psychological symptoms. Journal of Clinical Psychology 65:337–351, 2009Crossref, MedlineGoogle Scholar

78 Deegan PE, Rapp C, Holter M, et al.: A program to support shared decision making in an outpatient psychiatric medication clinic. Psychiatric Services 59:603–605, 2008LinkGoogle Scholar

79 Deegan PE: A Web application to support recovery and shared decision making in psychiatric medication clinics. Psychiatric Rehabilitation Journal 34:23–28, 2010Crossref, MedlineGoogle Scholar

80 Deitz DK, Cook RF, Billings DW, et al.: A Web-based mental health program: reaching parents at work. Journal of Pediatric Psychology 34:488–494, 2009Crossref, MedlineGoogle Scholar

81 Freeman E, Barker C, Pistrang N: Outcome of an online mutual support group for college students with psychological problems. Cyberpsychology and Behavior 11:591–593, 2008Crossref, MedlineGoogle Scholar

82 Golkaramnay V, Bauer S, Haug S, et al.: The exploration of the effectiveness of group therapy through an Internet chat as aftercare: a controlled naturalistic study. Psychotherapy and Psychosomatics 76:219–225, 2007Crossref, MedlineGoogle Scholar

83 Horgan D: Www.DoctorsHealth.com.au. Australian and New Zealand Journal of Psychiatry 42:173–174, 2008MedlineGoogle Scholar

84 Clarke G, Eubanks D, Reid E, et al.: Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. Journal of Medical Internet Research 7:e16, 2005Crossref, MedlineGoogle Scholar

85 Matano RA, Koopman C, Wanat SF, et al.: A pilot study of an interactive Web site in the workplace for reducing alcohol consumption. Journal of Substance Abuse Treatment 32:71–80, 2007Crossref, MedlineGoogle Scholar

86 Kessler D, Lewis G, Kaur S, et al.: Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet 374:628–634, 2009Crossref, MedlineGoogle Scholar

87 Klein B, Richards J: A brief Internet-based treatment for panic disorder. Behavioural and Cognitive Psychotherapy 29:113–117, 2001CrossrefGoogle Scholar

88 Klein B, Mitchell J, Gilson K, et al.: A therapist-assisted Internet-based CBT intervention for posttraumatic stress disorder: preliminary results. Cognitive Behaviour Therapy 38:121–131, 2009Crossref, MedlineGoogle Scholar

89 Klinger E, Bouchard S, Légeron P, et al.: Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychology and Behavior 8:76–88, 2005Crossref, MedlineGoogle Scholar

90 Lange A, Rietdijk D, Hudcovicova M, et al.: Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the Internet. Journal of Consulting and Clinical Psychology 71:901–909, 2003Crossref, MedlineGoogle Scholar

91 Lin C-C, Bai Y-M, Liu C-Y, et al.: Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms. BMC Psychiatry 7:12, 2007Crossref, MedlineGoogle Scholar

92 Linke S, Murray E, Butler C, et al.: Internet-based interactive health intervention for the promotion of sensible drinking: patterns of use and potential impact on members of the general public. Journal of Medical Internet Research 9:e10, 2007Crossref, MedlineGoogle Scholar

93 McCrone P, Knapp M, Proudfoot J, et al.: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. British Journal of Psychiatry 185:55–62, 2004Crossref, MedlineGoogle Scholar

94 Perini S, Titov N, Andrews G: Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Australian and New Zealand Journal of Psychiatry 43:571–578, 2009Crossref, MedlineGoogle Scholar

95 Piasecki TM, Hufford MR, Solhan M, et al.: Assessing clients in their natural environments with electronic diaries: rationale, benefits, limitations, and barriers. Psychological Assessment 19:25–43, 2007Crossref, MedlineGoogle Scholar

96 Rabiner DL, Murray DW, Skinner AT, et al.: A randomized trial of two promising computer-based interventions for students with attention difficulties. Journal of Abnormal Child Psychology 38:131–142, 2010Crossref, MedlineGoogle Scholar

97 Ritterband LM, Thorndike FP, Gonder-Frederick LA, et al.: Efficacy of an Internet-based behavioral intervention for adults with insomnia. Archives of General Psychiatry 66:692–698, 2009Crossref, MedlineGoogle Scholar

98 Ruggiero KJ, Resnick HS, Acierno R, et al.: Internet-based intervention for mental health and substance use problems in disaster-affected populations: a pilot feasibility study. Behavior Therapy 37:190–205, 2006Crossref, MedlineGoogle Scholar

99 Spence SH, Holmes JM, March S, et al.: The feasibility and outcome of clinic plus Internet delivery of cognitive-behavior therapy for childhood anxiety. Journal of Consulting and Clinical Psychology 74:614–621, 2006Crossref, MedlineGoogle Scholar

100 Titov N, Andrews G, Johnston L, et al.: Shyness programme: longer term benefits, cost-effectiveness, and acceptability. Australian and New Zealand Journal of Psychiatry 43:36–44, 2009Crossref, MedlineGoogle Scholar

101 van Spijker BAJ, van Straten A, Kerkhof AJFM: The effectiveness of a Web-based self-help intervention to reduce suicidal thoughts: a randomized controlled trial. Trials 11:25, 2010Crossref, MedlineGoogle Scholar

102 Van Voorhees BW, Fogel J, Reinecke MA, et al.: Randomized clinical trial of an Internet-based depression prevention program for adolescents (Project CATCH-IT) in primary care: 12-week outcomes. Journal of Developmental and Behavioral Pediatrics 30:23–37, 2009Crossref, MedlineGoogle Scholar

103 Wims E, Titov N, Andrews G, et al.: Clinician-assisted Internet-based treatment is effective for panic: a randomized controlled trial. Australian and New Zealand Journal of Psychiatry 44:599–607, 2010Crossref, MedlineGoogle Scholar