Empirical Articles

Patients’ Perspectives About the Design of a Mobile Application for Psychotic Disorders

Perspetivas dos pacientes sobre o design de uma aplicação móvel para perturbações psicóticas

Raquel Simões de Almeida*ab, Tiago Sousaa, António Marquesa, Cristina Queirósb

Abstract

Aim: Based on the design of applications for psychotic disorders illness self-management, this study aimed to understand patients’ patterns of technology usage, as well as their expectations and requirements concerning the design of an app for rehabilitation and illness management purposes. It also aimed to identify guidelines for mobile application development for this population.

Method: After a literature review, a questionnaire was developed, focused on behaviours and opinions about technology usage. It was applied, through a cross-sectional study, to a sample of 102 users of mental health services with psychotic disorders (62% men; with ages between 22 and 66 years old).

Results: Nearly 59% of the participants were willing to download an app for illness self-management, and 51% evaluated as essential the self-management of their mental health condition. However, correlation analysis revealed that the more years with mental illness, the less importance is given to an app for this purpose.

Conclusion: The use of mobile technologies seems to the have potential to empower individuals with mental health problems, especially younger ones and those in early disease stages. Concerns about privacy/security should be considered, as well as simple screening designs and texts. The results also reveal the importance of user participatory design.

Keywords: mobile technologies, patients’ perspectives, psychotic disorders, user participatory design, app development

Resumo

Objetivo: Baseado no desenho de aplicações para autogestão da doença face a perturbações psicóticas, este estudo teve como objetivo conhecer os padrões de uso de tecnologia dos pacientes, bem como suas expectativas e requisitos quanto ao desenho de aplicações para fins de reabilitação e gestão da doença. Também visou identificar diretrizes para o desenvolvimento de aplicações móveis para essa população.

Método: Após uma revisão da literatura, foi desenvolvido um questionário, focado em comportamentos e opiniões sobre o uso da tecnologia. Foi aplicado, através de estudo transversal, a uma amostra de 102 utilizadores de serviços de saúde mental com perturbações psicóticas (62% homens; com idades entre 22 e 66 anos).

Resultados: Quase 59% dos participantes estavam dispostos a descarregar uma aplicação para autogestão da doença, e 51% avaliaram como essencial a auto-gestão da sua condição de saúde mental. No entanto, a análise de correlação revelou que quanto mais anos de doença mental, menos importância era dada a uma aplicação para esse fim.

Conclusão: O uso de tecnologias móveis parece ter potencial para capacitar indivíduos com problemas de saúde mental, principalmente os mais jovens e os que estão em estádios iniciais da doença. Preocupações sobre privacidade/segurança devem ser consideradas, assim como desenhos simples de diagnóstico e textos. Os resultados também revelam a importância do desenho participativo do utilizador.

Palavras-Chave: tecnologias móveis, perspetivas dos pacientes, perturbações psicóticas, desenho participativo do utilizador, desenvolvimento de aplicações

Psychology, Community & Health, 2018, Vol. 7(1), doi:10.5964/pch.v7i1.192

Received: 2016-03-28. Accepted: 2018-02-12. Published (VoR): 2018-08-03.

Handling Editor: Sara Monteiro, Departamento de Educação e Psicologia, Universidade de Aveiro, Aveiro, Portugal; CINTESIS - Center for Health Technology and Services Research, Faculdade de Medicina da Universidade do Porto, Porto, Portugal

*Corresponding author at: Rua Dr. António Bernardino de Almeida, 400. 4200 - 072. E-mail: afa@ess.ipp.pt

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Mental health problems are a growing global concern according to the World Mental Health Survey Initiative (Kessler et al., 2009). In Europe, psychotic disorders in particular have a prevalence of 1.2% (Dominguez, Wichers, Lieb, Wittchen, & van Os, 2011) and the costs of its management amounted to €93.9 billion in 2010 (Olesen, Gustavsson, Svensson, Wittchen, & Jönsson, 2012). These costs are particularly high due to specific characteristics of the disease such as early onset, frequently chronic course, early retirement, recurrent readmissions to hospital, and high rate of disability.

Although mental health is considered a public health priority, there is a clear inadequacy and insufficiency of existing services to the needs of people with mental health problems. Most patients live with their families, in a complicated socio-economic panorama, with poor access to information and other resources which generally elicit a low level of autonomy in several life contexts (Shah, Wadoo, & Latoo, 2010). The Mental Health Action Plan for 2013-2020 (World Health Organization [WHO], 2013) recommend a set of guidelines coherent with a recovery paradigm, emphasizing the importance of considering patients’ choices and options, thus promoting their empowerment, self-determination, and active participation in all aspects of their lives and, therefore, of their recovery. These guidelines established the need to promote an integrated approach, focusing not only on patients and their needs and decisions, but also appeal to their involvement in illness management. Self-management refers to the patient's ability, together with family, community, and health professionals, to manage symptoms, treatments, changes in lifestyle, as well as psychological, cultural and spiritual consequences of health condition (Richard & Shea, 2011; van Hooft, Dwarswaard, Jedeloo, Bal, & van Staa, 2015).

Illness self-management programs are based on the self-efficacy concept (Lorig & Holman, 2003; Sterling, Silke, Tucker, Fricks, & Druss, 2010) and aim to: 1) enhance engagement in activities that promote health; 2) monitor and manage symptoms and signs of disease; 3) manage the disease's impact on functionality; 4) promote informed decisions; 5) ameliorate the adherence to medication; and 6) ameliorate the collaboration with professionals to choose the best possible health care. During the last decade, the concept of self-management gained ground in the mental health context and, consequently, new strategies emerged in this field (Lurie, 2012; Sterling et al., 2010), being precisely one of them the use of technology.

Technology, in general, has the potential to improve quality of mental health services (Ben-Zeev, 2012) and can play an important role in psychological interventions aimed at fostering positive emotions, promoting engagement in empowerment and self-actualization experiences, and supporting connectedness between individuals and communities (Riva, Villani, Cipresso, & Gaggioli, 2016). However, few scientific evidence and recommendations are given to its incorporation into services (Ben-Zeev, 2012). Nevertheless, technology-based interventions are emerging and eliciting the attention of researchers and clinicians (Ben-Zeev, 2014). Several interventions have been recently developed, namely psychotherapeutic interventions based on the Internet (Alvarez-Jimenez et al., 2013; Proudfoot et al., 2007; Rotondi et al., 2010), SMS to support psychiatric care (Bauer et al., 2003; Granholm et al., 2012; Sims et al., 2012), treatment applications via phone and video conferencing (Mohr et al., 2012; Nelson et al., 2003), virtual paradigms for skills training (Freeman, 2008; McLay et al., 2011) and applications that promote autonomy of individuals with mental illness (Ben-Zeev, 2014; Burns et al., 2011; Rizvi et al., 2011). Although more research is needed, some interventions showed similar effectiveness to traditional models, as suggested by some studies: 1) in patients with depression, cognitive behavioural therapy (CBT) using the phone, when compared with face-to-face, demonstrated comparable improvement at posttreatment (Mohr et al., 2012); and 2) comparing CBT delivered through health technologies and therapist-administered CBT, a study revealed no significant differences regarding efficacy, on patients with obsessive-compulsive disorder symptoms (Dèttore, Pozza, & Andersson, 2015).

Regarding mobile applications, recent research demonstrated that its development must be done according to the needs, features and preferences of their final users, in order to develop a tool that will, more likely, be used successfully (Ben-Zeev, 2014), and that the users’ experience to have the same importance as the expertise of professionals (Ornelas, Aguiar, Sacchetto, & Jorge-Monteiro, 2012). Thus, user participatory design aims to empower patients, allowing a transition from a passive role where the user is the receiver of care services to an active role. This approach involves users throughout the development process, assuring that technology functionalities are easy to operate and are valued by them (Maguire, 2001). As a principle of mental health care policy, users’ involvement is crucial to ensure that services are provided according to patients’ needs and enhancing patients’ control over their health care. Thus, professionals cannot decide on behalf of their patients without involving them in the process given that users’ experience is different from professionals’ expertise (Petersen, Hounsgaard, Borg, & Nielsen, 2012).

However, some mental health practitioners are concerned about the ability and willingness of people with psychotic disorders to receive this type of intervention and are apprehensive that positive symptoms such as hallucinations and deliriums, thought disorganization, and cognitive deficits may limit the feasibility of mobile health interventions (Firth & Torous, 2015). In fact, there is a lack of guidelines to develop such technologies for people with psychotic disorders with lower technology literacy (Rotondi et al., 2007) because, usually, self-reported technology skills are higher than demonstrated in task analyses. There are also a few implications for making these tools’ usage more reasonable and acceptable for people with severe mental illness, such as having no costs, giving simple instructions to navigate, adequate font size, specific buttons and links, etc. (Black, Serowik, Schensul, Bowen, & Rosen, 2013).

Nowadays, more patients own smartphones and are interested to use them to monitor their health (Torous, Chan, et al., 2014; Torous, Friedman, & Keshavan, 2014). According to Ben-Zeev and colleagues (2013) advanced technologies can support self-management of mental illnesses, but to be feasible they need to be designed addressing real requirements and specific preferences of their final user.

Based on our activity as mental health professionals working with patients with psychotic disorders, we were included on a team whose work aims to develop a mobile application for the rehabilitation and illness management for these patients. In the first stage, and following similar procedures of Torous, Friedman, and Keshavan (2014) and the user participatory design previously referred, this study aims to know patients’ patterns of technologies usage, and their expectations and requirements considering the design of an app for rehabilitation and illness management purposes. Additionally, the study tries to identify issues related to guidelines for mobile application development for this population.

Method [TOP]

Participants [TOP]

The sample consisted of 102 users of mental health services with psychotic disorders (62% men; with ages between 22 and 66 years old: Mage = 42.4 years, SD = 9.6) that participated in this study (Table 1). All participants were diagnosed with a psychotic disorder and were in rehabilitation. In average they were ill for 17.6 years (SD = 9.8).

Table 1

Sample Characteristics

Characteristic Frequency Percentage
Education Level
No education 3 2.94
Until 4 years 11 10.78
Basic 41 40.20
Secondary 39 38.24
Graduated or more 8 7.84
Employment Status
Student 3 2.94
Retired 54 52.94
Employed 3 2.94
Unemployed 42 41.18
Residence location
Big city 65 63.73
Small city 37 36.27

Note. Big city has more than 200.000 inhabitants.

Materials and Procedure [TOP]

A literature review was done on EBSCO, Medline and PsychInfo databases, searching papers about research or developments in mental health and mobile technologies published since 2000. Descriptors (text words) were: smartphone; mobile phone; mobile device*; mobile technolog*; mhealth; mobile app; crossed with schizo*, psychotic disorder*, psychosis, voices, and hallucinations. We identified 47 papers, which discussed the use of mobile technologies on health, user groups (health professionals and patients), advantages and disadvantages, clinical applications, and user self-determination. We also analysed mobile phone consumer surveys.

Using these topics, an online questionnaire was developed to assess patients’ interest to use smartphones to support their rehabilitation process and to know users’ expectations and requirements considering mobile applications design. The questionnaire was structured in three groupsi. The first was about sociodemographic data where respondents were asked to provide information such as gender, age, city of residence, employment status, years with mental illness, and education level. These social determinants and sociodemographic variables are important in order to analyse electronic device use and interest in mobile technologies according. The second group explored participants’ technology usage patterns, and how often in the last month they used certain equipment (mobile phone, computer, console, ...), which activities they conducted in the mobile phone and in which contexts. We used a Likert type scale (ranging from 1 = never to 5 = almost always). Questions about internet use and about phone’s capacity to download applications were also presented, as well as the perception level of how difficult the mobile phone use was (ranging from 1 = very easy to 5 = very difficult). This group aims to know if the sample has digital literacy, i.e., their ability to use information and communication technologies to find, evaluate, create, and communicate information, even if they do not have or use a mobile phone. Thus, being at ease in the use of more generic technologies, they can have more ease in using a smartphone hereafter. The third group aimed to know participants’ opinion about the development of a mobile application to support their mental illness’ management. We questioned whether the participant would download an application for this purpose and the frequency of its possible usage. We also included open questions about their motivation to use this application and what could hinder its use. Participants were also asked to rate the importance some requirements’ importance related with the application development and its features (ranging from 1 = not important at all to 5 = very important). Finally, we asked about what information patients would like to share with their professional and at what times, using multiple-choice questions. This kind of information would be very useful when designing and implementing a mobile application for people with psychotic disorders. As initial information of the questionnaire, it was explained that: “The use of Information and Communication Technologies (ICT) in the provision of health care has become a widespread significant strategy for increasing accessibility and complementarity to face-to-face care. We would like to know your opinion about developing an app for support in managing their mental illness”. Since the questionnaire assessed mainly behaviours frequency, psychometric properties were not analysed.

An initial pilot study to evaluate if they understood the questions as expected and to obtain recommendations for questionnaire improvement was completed by five patients. After this procedure some words were changed, and it was added a “other” option due to the fact that some of the respondents did not found their answer within the given options. Since the study population is difficult to access, we only included five people in the pilot. However, there was a thoughtful selection of these patients, as we tried to present different characteristics regarding the institutions of origin, use of technology, age, and other variables. We asked professionals from different institutions to indicate several users following these requirements and five were randomly invited to participate.

After this pilot study, an email was sent to several rehabilitation services in Portugal, especially FNERDM (national organization that gathers 21 mental health institutions) and São João Hospital Psychiatry Service, introducing the study with a link to the questionnaire posted online using Google Docs. We asked these institutions (with whom the authors regularly collaborate) to send to their patients the questionnaire inviting them to participate. Thus, the authors did not directly contact the patients. In addition, due to the vulnerable nature of this population it was requested an ethical opinion, having the study been approved by São João Hospital Ethics Committee and other organizations own ethics committees’ that introduced the study to its users. The survey was made available for eight weeks between the months of September and October of 2015 and took an average of 25 minutes to be completed.

Results [TOP]

Regarding patients’ technologies usage patterns (Table 2), the equipment used more often by participants in the last month was the mobile phone, followed by desktop computers and laptops. Among the 77.5% of respondents that owned a mobile phone, we verified that 34.3% were able to access the Internet and use the mobile phone also to make phone calls, set alarms for medication/appointments, send messages, search for information, see their e-mails and play games. Only 27.5% reported having some difficulty using a mobile phone. Concerning internet use, 57.8% used internet in the last month and the places where they accessed it more frequently were at home and social/health institutions, mainly using laptops or desktop computers. The 29.2% patients that used mobile applications reported that the most frequent purposes are related to games or other type of entertainment, music, and photography. In total, 58.8% of respondents reported that they would download an application for mental illness self-management.

Table 2

Usage Pattern of Information and Communication Technologies

Usage Pattern Frequency Percentage
Most used equipment last month
Mobile phone 69 67.6
Desktop computers 27 26.5
Laptop 27 26.5
Owned a mobile phone
Yes 79 77.5
No 23 22.5
Mobile phone with internet access
Yes 35 34.3
No 67 65.7
Location of internet access
Home 31 30.4
Health/Social institutions 10 10.0
Activities using mobile phone (many times or almost always)
Calls 38 37.2
SMS 18 17.6
Social networks 11 10.8
Emails 13 12.7
Music 28 27.5
Set alarms 26 25.5

Concerning the participants’ expectations to the development of a mental health mobile application (Table 3), they identified features associated with autonomy as being the most important to be included in the mobile application, emphasizing: symptom monitoring, providing information about the disease and its treatment, the ability to record daily moods, stress management and strategies to promote relaxation, reminders for appointments and medication adherence, and being able to track treatment progression (Table 3).

Table 3

Importance Given to Several Aspects and Requirements to Develop an App for Psychotic Disorders

Aspect / Requirement Not Important
A Bit Important
Important
Very Important
Indispensable
n % n % n % n % n %
Monitor symptoms 26 25.5 10 9.8 27 26.5 27 26.5 12 11.8
Provide information 29 28.4 3 2.9 33 32.4 25 24.5 12 11.8
Record daily moods 29 28.4 6 5.9 31 30.4 27 26.5 9 8.8
Stress management 29 28.4 7 6.9 31 30.4 23 22.5 12 11.8
Meds/appointments 32 31.4 7 6.9 28 27.5 25 24.5 10 9.8
Track progress 27 26.5 7 6.9 33 32.4 23 22.5 12 11.8
Being interactive 31 30.4 8 7.8 29 28.4 26 25.5 8 7.8
Answer a need 27 26.5 8 7.8 31 30.4 25 24.5 11 10.8
Being private 39 38.2 11 10.8 24 23.5 18 16.7 10 9.8
Being safe 42 41.2 15 14.7 22 21.6 18 17.6 5 4.9
Do not need internet 31 30.4 5 4.9 17 16.7 24 23.5 25 24.5

Aspects such as responding to a specific need, being safe and private, being interactive, and not depending on the internet were the most important factors rated by participants to consider for application development according to respondents (Table 4). Several characteristics were pointed out in an open question as facilitators of application use such as being free, easy to access and use (simple screen, short sentences, few steps to perform an action), and being effective in improving the management of their health condition. On the other hand, the barriers mentioned were the user being in the acute phase of the disease, being paid, requiring a lot of cognitive effort, and not being intuitive to use. These are guidelines that should be taken into account in future app development.

Table 4

Importance Given to Several Aspects and Requirements to Develop an App for Psychotic Disorders

Aspects regarding the app use M SD
Being interactive 2.73 1.344
Answer a need 2.85 1.345
Allow the use of a pin or password 2.50 1.405
Being private 2.33 1.417
Being safe 3.07 1.581
Do not need internet 2.30 1.303
Requirement for an app for illness self-management M SD
Monitor symptoms 2.89 1.364
Notifications for meds/appointments 2.75 1.384
Direct line with professionals 2.88 1.374
Provide information about illness/ treatment 2.81 1.340
Record daily moods 2.53 1.287
Stress management/ relaxation 2.82 1.375
Track progress 2.86 1.350

Specifically, regarding the medication adherence, most participants would like to receive notifications once a day (34.3%) or more than once a day (23.5%), and 61.8% said that these should preferably be received in the morning. Participants had very different perspectives regarding to the information they would like to share with significant others (informal and formal carers). In total, 31.4% of participants indicated they would like their formal carers, such as psychiatrists, to receive a weekly or monthly report; 37.3% indicated they only would like to share information when a record is considered out of normal parameter. They were willing to share usage data, progress on modules, response to mood records, journal entries, goals, and achievements. Also, 25.5% said they would not share information with their clinicians.

The importance given to self-managing their mental health condition was high: 51% said that it was essential, 25.5% very important, and 16.7% important. The importance given to the use of an application for supporting illness self-management was also high: 34.3% referred it is essential, 19.6% very important, and 13.7% important. Finally, Pearson correlation analysis showed several significant correlations between variables such as difficulty in using mobile phone, age, years with mental illness, the importance given to illness self-management, and importance given to a mobile application for illness self-management (Table 5).

Table 5

Pearson Correlations Between Some Variables

Variable Age Years with illness Difficulty use Importance autonomy
Years with illness .522**
Difficulty use .252* .209*
Importance autonomy .045 -.021 -.317**
Importance application -.141 -.244* -.446** .530**

*p < .05. **p < .01.

Discussion [TOP]

Regarding technology usage, results revealed that mobile phones and computers are the most commonly used equipment by our participants with psychotic disorders. The majority of participants were already using mobile technologies and many are open to self-managing their illness with an application, results that are similar to other studies (Ben-Zeev et al., 2013; Whitehead & Seaton, 2016). Only 23% of the participants did not have a mobile phone, a relatively low number. Regarding patients’ smartphone ownership in Portugal (34%), the number is almost half of global mobile phone owners residing in the country (59%), according to Marktest’ Telecommunications Barometer (2015). The percentage is below the average in USA but higher than Europe. In 2014, 64% of American adults owned a smartphone (Pew Research Center, 2015) and, in Europe, the smartphone penetration was 25% (eMarketer, 2014). Based on prior research (Depp, Harmell, Vahia, & Mausbach, 2016), we expected that patients with psychotic disorders would have a lower prevalence of mobile phones ownership than people without a psychiatric diagnosis, especially the older patients. For younger patients the use of mobile applications seems to be a pertinent intervention, while for older people initial digital literacy courses may be required. For older patients and patients who have lived more years with the disease the ownership and willingness to use a mobile phone to manage their illness was lower, as initial anticipated. This could be due to some traditional services culture that do not yet promote self-determination and empowerment and block the patients’ right to make their own decisions about treatment and about their recovery path. These results are important as they suggest that patients are receptive to mobile technologies, which is a growing area in the health field, due to its low cost and ubiquity (East & Havard, 2015).

Although we did not evaluate the socio-economic condition in the questionnaire, we considered the responses regarding situation towards work enlightening, since 94% of participants were retired or unemployed. This shows us that low-income situations or dependence on other people such as families is, in fact, a reality in this sample. Although mobile phones use is spreading due to declining prices, we acknowledge that the lack of resources can indeed be an unfavourable factor to access these kinds of interventions. Moreover, our sample is characterized by people with a reasonable level of education (46% with secondary or higher level of education) which may also explain the higher level of digital literacy and greater willingness to use technology.

There are factors that could contribute to mobile health services adoption such as perceived ease of use and self-efficacy (mobile apps should be easily learned and used) and provide these tools with an appropriate service price, one which would be accepted by potential users. Also, people with psychotic disorders could be positively affected in their acceptance behaviours not only by other mHealth users but also by professionals’ perspectives attitudes towards mobile technologies (Sun, Wang, Guo, & Peng, 2013).

Despite the benefits they could offer, better standards and validation practices regarding mental health mobile apps need to be established to ensure proper use and integration of these tools into practice. Concerns about privacy and security should also be considered, since patient information must be secure in case the smartphone is lost or stolen. Few steps to perform actions, memory aids, simple screen design and short sentences minimizing abstract thinking are crucial to overcome possible cognitive issues of this population. A recent review (Bakker, Kazantzis, Rickwood, & Rickard, 2016) pointed out sixteen recommendations for mental health smartphone apps, such as: cognitive behavioural therapy based interventions, automated tailoring, recommend activities, especially nontechnology-based ones (behavioural activation), or links to crisis support services. Experimental trials to establish efficacy were also mentioned.

The study has some limitations: we did not collect data from patients that did not attend a rehabilitation service, because it would be more difficult to reach these people; we did not include questions about economic condition but most participants were retired or unemployed which can be reflected in relatively low incomes, as mentioned before; the sample is not representative, but composed by participants who voluntarily accepted to collaborate on the study, therefore, it does not allow to gather scientific evidence that might sustain further decisions in this area. Nevertheless, it can be regarded as a significant contribution to collect information about this emerging field. Future research should consider users’ perspectives to design an application that could meet their needs and expectations.

Self-management strategies are emerging due to rising levels in chronic diseases. The recovery model allows patients to take control of their lives and make health choices in a more informed way which is the aim of these technologies (Sterling et al., 2010; Zou et al., 2013). A partnership between clinicians and users concerning mobile applications use as part of a shared decision-making process could benefit people with psychotic disorders recovery. Thus, mobile applications could take an important role in supporting illness self-management as long as developers follow a comprehensive user participatory development process.

Notes [TOP]

i) The questionnaire can be available by asking the authors.

Funding [TOP]

The authors have no funding to report.

Competing Interests [TOP]

The authors have declared that no competing interests exist.

Acknowledgments [TOP]

The authors have no support to report.

References [TOP]

  • Alvarez-Jimenez, M., Bendall, S., Lederman, R., Wadley, G., Chinnery, G., Vargas, S., & Gleeson, J. (2013). On the HORYZON: Moderated online social therapy for long-term recovery in first episode psychosis. Schizophrenia Research, 143(1), 143-149. doi:10.1016/j.schres.2012.10.009

  • Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016). Mental health smartphone apps: Review and evidence-based recommendations for future developments. JMIR Mental Health, 3(1), Article e7. doi:10.2196/mental.4984

  • Bauer, S., Percevic, R., Okon, E., Meermann, R. U., & Kordy, H. (2003). Use of text messaging in the aftercare of patients with bulimia nervosa. European Eating Disorders Review, 11(3), 279-290. doi:10.1002/erv.521

  • Ben-Zeev, D. (2012). Mobile technologies in the study, assessment, and treatment of schizophrenia. Schizophrenia Bulletin, 38(3), 384-385. doi:10.1093/schbul/sbr179

  • Ben-Zeev, D. (2014). Technology-based interventions for psychiatric illnesses: Improving care, one patient at a time. Epidemiology and Psychiatric Sciences, 23(4), 317-321. doi:10.1017/S2045796014000432

  • Ben-Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M., Duffecy, J., & Mohr, D. C. (2013). Development and usability testing of FOCUS: A smartphone system for self-management of schizophrenia. Psychiatric Rehabilitation Journal, 36(4), 289-296. doi:10.1037/prj0000019

  • Black, A. C., Serowik, K. L., Schensul, J. J., Bowen, A. M., & Rosen, M. I. (2013). Build a better mouse: Directly-observed issues in computer use for adults with SMI. The Psychiatric Quarterly, 84(1), 81-92. doi:10.1007/s11126-012-9229-z

  • Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011). Harnessing context sensing to develop a mobile intervention for depression. Journal of Medical Internet Research, 13(3), Article e55. doi:10.2196/jmir.1838

  • Depp, C. A., Harmell, A. L., Vahia, I. V., & Mausbach, B. T. (2016). Neurocognitive and functional correlates of mobile phone use in middle-aged and older patients with schizophrenia. Aging & Mental Health, 20(1), 29-35. doi:10.1080/13607863.2015.1008987

  • Dèttore, D., Pozza, A., & Andersson, G. (2015). Efficacy of technology-delivered cognitive behavioural therapy for OCD versus control conditions, and in comparison with therapist-administered CBT: Meta-analysis of randomized controlled trials. Cognitive Behaviour Therapy, 44(3), 190-211. doi:10.1080/16506073.2015.1005660

  • Dominguez, M. D., Wichers, M., Lieb, R., Wittchen, H. U., & van Os, J. (2011). Evidence that onset of clinical psychosis is an outcome of progressively more persistent subclinical psychotic experiences: An 8-year cohort study. Schizophrenia Bulletin, 37, 84-93. doi:10.1093/schbul/sbp022

  • East, M. L., & Havard, B. C. (2015). Mental health mobile apps: From infusion to diffusion in the mental health social system. JMIR Mental Health, 2(1), Article e10. doi:10.2196/mental.3954

  • eMarketer. (2014, June). Worldwide smartphone usage to grow 25% in 2014. Retrieved from http://www.emarketer.com/Article/Worldwide-Smartphone-Usage-Grow-25-2014/1010920

  • Firth, J., & Torous, J. (2015). Smartphone apps for schizophrenia: A systematic review. JMIR mHealth uHealth, 3(4), Article e102. doi:10.2196/mhealth.4930

  • Freeman, D. (2008). Studying and treating schizophrenia using virtual reality: A new paradigm. Schizophrenia Bulletin, 34(4), 605-610. doi:10.1093/schbul/sbn020

  • Granholm, E., Ben-Zeev, D., Link, P. C., Bradshaw, K. R., & Holden, J. L. (2012). Mobile Assessment and Treatment for Schizophrenia (MATS): A pilot trial of an interactive text-messaging intervention for medication adherence, socialization, and auditory hallucinations. Schizophrenia Bulletin, 38(3), 414-425. doi:10.1093/schbul/sbr155

  • Kessler, R. C., Aguilar-Gaxiola, S., Alonso, J., Chatterji, S., Lee, S., Ormel, J., . . . Wang, P. S., (2009). The global burden of mental disorders: An update from the WHO World Mental Health (WMH) surveys. Epidemiology and Psychiatric Sciences, 18(1), 23-33. doi:10.1017/S1121189X00001421

  • Lorig, K. R., & Holman, H. R. (2003). Self-management education: History, definition, outcomes, and mechanisms. Annals of Behavioral Medicine, 26(1), 1-7. doi:10.1207/S15324796ABM2601_01

  • Lurie, S. (2012). And now for something completely different… self-management. Canadian Journal of Psychiatry, 57(4), 201-202. doi:10.1177/070674371205700401

  • Maguire, M. (2001). Methods to support human-centered design. International Journal of Human-Computer Studies, 55, 587-634. doi:10.1006/ijhc.2001.0503

  • Marktest’ Telecommunications Barometer. (2015). Maioria usa smartphone [Majority use smartphone]. Retrieved from http://www.marktest.com/wap/a/n/id~1f2a.aspx

  • McLay, R. N., Wood, D. P., Webb-Murphy, J. A., Spira, J. L., Wiederhold, M. D., Pyne, J. M., & Wiederhold, B. K. (2011). A randomized, controlled trial of virtual reality-graded exposure therapy for post-traumatic stress disorder in active duty service members with combat-related post-traumatic stress disorder. Cyberpsychology, Behavior, and Social Networking, 14(4), 223-229. doi:10.1089/cyber.2011.0003

  • Mohr, D. C., Ho, J., Duffecy, J., Reifler, D., Sokol, L., Burns, M. N., . . . Siddique, J., (2012). Effect of telephone-administered vs face-to-face cognitive behavioral therapy on adherence to therapy and depression outcomes among primary care patients: A randomized trial. Journal of the American Medical Association, 307(21), 2278-2285. doi:10.1001/jama.2012.5588

  • Nelson, E. L., Barnard, M., & Cain, S. (2003). Treating childhood depression over videoconferencing. Telemedicine Journal and e-Health, 9(1), 49-55. doi:10.1089/153056203763317648

  • Olesen, J., Gustavsson, A., Svensson, M., Wittchen, H.-U., & Jönsson, B. (2012). The economic cost of brain disorders in Europe. European Journal of Neurology, 19, 155-162. doi:10.1111/j.1468-1331.2011.03590.x

  • Ornelas, J., Aguiar, R., Sacchetto, B., & Jorge-Monteiro, M. (2012). Community-based participatory research: A collaborative study to measure capabilities towards recovery in mental health community organizations. Psychology, Community & Health, 1(1), 3-18. doi:10.5964/pch.v1i1.5

  • Petersen, K., Hounsgaard, L., Borg, T., & Nielsen, C. V. (2012). User involvement in mental health rehabilitation: A struggle for self-determination and recognition. Scandinavian Journal of Occupational Therapy, 19, 59-67. doi:10.3109/11038128.2011.556196

  • Pew Research Center. (2015, April). U.S. Smartphone Use in 2015: Report. Retrieved from http://www.pewinternet.org/files/2015/03/PI_Smartphones_0401151.pdf

  • Proudfoot, J., Parker, G., Hyett, M., Manicavasagar, V., Smith, M., Grdovic, S., & Greenfield, L. (2007). Next generation of self-management education: Web-based bipolar disorder program. Australian & New Zealand Journal of Psychiatry, 41(11), 903-909. doi:10.1080/00048670701634911

  • Richard, A. A., & Shea, K. (2011). Delineation of self-care and associated concepts. Journal of Nursing Scholarship, 43(3), 255-264. doi:10.1111/j.1547-5069.2011.01404.x

  • Riva, G., Villani, D., Cipresso, P., & Gaggioli, R. (2016). Positive technology: The use of technology for improving and sustaining personal change. In D. Villani, P. Cipresso, A. Gaggioli, & G. Riva (Eds.), Integrating technology in positive psychology practice (pp. 1-37). Hershey, PA, USA: Information Science Reference (IGI Global).

  • Rizvi, S. L., Dimeff, L. A., Skutch, J., Carroll, D., & Linehan, M. M. (2011). A pilot study of the DBT coach: An interactive mobile phone application for individuals with borderline personality disorder and substance use disorder. Behavior Therapy, 42(4), 589-600. doi:10.1016/j.beth.2011.01.003

  • Rotondi, A. J., Anderson, C. M., Haas, G. L., Eack, S. M., Spring, M. B., Ganguli, R., & Rosenstock, J. (2010). Web-based psychoeducational intervention for persons with schizophrenia and their supporters: One-year outcomes. Psychiatric Services, 61, 1099-1105. doi:10.1176/ps.2010.61.11.1099

  • Rotondi, A. J., Sinkule, J., Haas, G. L., Spring, M. B., Litschge, C. M., Newhill, C. E., & Anderson, C. M. (2007). Designing websites for persons with cognitive deficits: Design and usability of a psychoeducational intervention for persons with severe mental illness. Psychological Services, 4, 202-224. doi:10.1037/1541-1559.4.3.202

  • Shah, A. J., Wadoo, O., & Latoo, J. (2010). Psychological distress in carers of people with mental disorders. British Journal of Medical Practitioners, 3(3), Article a327. Retrieved from http://www.bjmp.org/content/psychological-distress-carers-people-mental-disorders.

  • Sims, H., Sanghara, H., Hayes, D., Wandiembe, S., Finch, M., Jakobsen, H., . . . Kravariti, E., (2012). Text message reminders of appointments: A pilot intervention at four community mental health clinics in London. Psychiatric Services, 63(2), 161-168. doi:10.1176/appi.ps.201100211

  • Sterling, E. W., Silke, A., Tucker, S., Fricks, L., & Druss, B. G. (2010). Integrating wellness, recovery, and self-management for mental health consumers. Community Mental Health Journal, 46(2), 130-138. doi:10.1007/s10597-009-9276-6

  • Sun, Y., Wang, N., Guo, X., & Peng, Z. (2013). Understanding the acceptance of mobile health services: A comparison and integration of alternative models. Journal of Electronic Commerce Research, 14(2), 183-200.

  • Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., . . . Keshavan, M., (2014). Patient smartphone ownership and interest in mobile apps to monitor symptoms of mental health conditions: A survey in four geographically distinct psychiatric clinics. Journal of Medical and Internet Research Mental Health, 1(1), Article e5. doi:10.2196/mental.4004

  • Torous, J., Friedman, R., & Keshavan, M. (2014). Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. Journal of Medical and Internet Research Mental Health, 2(1), Article e2. doi:10.2196/mhealth.2994

  • van Hooft, S. M., Dwarswaard, J., Jedeloo, S., Bal, R., & van Staa, A. (2015). Four perspectives on self-management support by nurses for people with chronic conditions: A Q-methodological study. International Journal of Nursing Studies, 52(1), 157-166. doi:10.1016/j.ijnurstu.2014.07.004

  • Whitehead, L., & Seaton, P. (2016). The effectiveness of self-management mobile phone and tablet apps in long-term condition management: A systematic review. Journal of Medical Internet Research, 18(5), Article e97. doi:10.2196/jmir.4883

  • World Health Organization. (2013). Mental Health Action Plan 2013-2020. Geneva, Switzerland: Author.

  • Zou, H., Li, Z., Nolan, M., Arthur, D., Wang, H., & Hu, L. (2013). Self-management education interventions for persons with schizophrenia: A meta-analysis. International Journal of Mental Health Nursing, 22, 256-271. doi:10.1111/j.1447-0349.2012.00863.x