Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Apr 29, 2021
Open Peer Review Period: Apr 29, 2021 - Jun 24, 2021
Date Accepted: Sep 19, 2021
Date Submitted to PubMed: Dec 2, 2021
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

A Conversational Artificial Intelligence Agent for a Mental Health Care App: Evaluation Study of Its Participatory Design

Danieli M, Ciulli T, Mousavi SM, Riccardi G

A Conversational Artificial Intelligence Agent for a Mental Health Care App: Evaluation Study of Its Participatory Design

JMIR Form Res 2021;5(12):e30053

DOI: 10.2196/30053

PMID: 34855607

PMCID: 8686486

A Participatory Design of Conversational Artificial Intelligence Agents for Mental Healthcare Application

  • Morena Danieli; 
  • Tommaso Ciulli; 
  • Seyed Mahed Mousavi; 
  • Giuseppe Riccardi

ABSTRACT

Background:

Mobile applications for mental health are available on the market. While they seem to be promising for improving the accessibility of mental health care, little is known about their acceptance, design methodology, evaluation, and integration into protocolized psychotherapy. This makes it difficult for the healthcare professionals to judge whether these applications may help them and their patients.

Objective:

Describing and evaluating a protocol for the participatory design of mobile applications for mental health (m-health app). In this study, participants and psychotherapists are engaged in the early phases of the design and development of the application empowered by Conversational Artificial Intelligence (AI). The application supports interventions for Stress Management Training based on Cognitive Behavioral Theory.

Methods:

21 participants aged 33-61 with mild to moderate levels of stress, anxiety and depression (assessed by submitting them with the Italian version of SCL-90-R, OSI, and PSS scale) were assigned to two groups, A and B. Both groups received stress management training sessions along with cognitive behavioral treatment, but only participants assigned to Group A received support by a mobile personal healthcare agent, designed for mental care and empowered by AI techniques. Psychopathological outcomes were assessed by submitting those tests at baseline (T1), following eight weeks of treatment (T2), and after three months post-treatment (T3). A focus group with psychotherapists who administered the therapy was held post-treatment to collect their impressions and suggestions.

Results:

While the inter-group statistical analysis showed that Group B participants could rely on better coping strategies at T3, Group A subjects reported significant improvements in Obsessivity and Compulsivity assessment between T1 and T3. Psychotherapists’ acceptance of the protocol was good. In particular they were in favor of integrating an AI based m-health application in their practice because they could appreciate the increased engagement of patients in pursuing therapy goals.

Conclusions:

The integration of an AI-based mobile application for m-health showed to be effective in improving participants’ strategies for coping with stress and anxiety. At the same time, the mental health professionals involved in the experiment reported interest and acceptance of the proposal of integrating AI-based conversational support in their daily practice. Clinical Trial: The protocol and the experimental plan were approved by the Ethical Committee of the University of Trento, Italy. The research described in this paper was the initial and exploratory phase of a larger intervention protocol that is currently registered in Clinical Trials, with reference NCT04809090.


 Citation

Please cite as:

Danieli M, Ciulli T, Mousavi SM, Riccardi G

A Conversational Artificial Intelligence Agent for a Mental Health Care App: Evaluation Study of Its Participatory Design

JMIR Form Res 2021;5(12):e30053

DOI: 10.2196/30053

PMID: 34855607

PMCID: 8686486

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.

Advertisement