Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders
- PMID:28796781
- PMCID: PMC5552034
- DOI: 10.1371/journal.pone.0182151
Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders
Abstract
Social skills training, performed by human trainers, is a well-established method for obtaining appropriate skills in social interaction. Previous work automated the process of social skills training by developing a dialogue system that teaches social communication skills through interaction with a computer avatar. Even though previous work that simulated social skills training only considered acoustic and linguistic information, human social skills trainers take into account visual and other non-verbal features. In this paper, we create and evaluate a social skills training system that closes this gap by considering the audiovisual features of the smiling ratio and the head pose (yaw and pitch). In addition, the previous system was only tested with graduate students; in this paper, we applied our system to children or young adults with autism spectrum disorders. For our experimental evaluation, we recruited 18 members from the general population and 10 people with autism spectrum disorders and gave them our proposed multimodal system to use. An experienced human social skills trainer rated the social skills of the users. We evaluated the system's effectiveness by comparing pre- and post-training scores and identified significant improvement in their social skills using our proposed multimodal system. Computer-based social skills training is useful for people who experience social difficulties. Such a system can be used by teachers, therapists, and social skills trainers for rehabilitation and the supplemental use of human-based training anywhere and anytime.
Conflict of interest statement
Figures
Similar articles
- Automated social skills training with audiovisual information.Tanaka H, Sakti S, Neubig G, Negoro H, Iwasaka H, Nakamura S.Tanaka H, et al.Annu Int Conf IEEE Eng Med Biol Soc. 2016 Aug;2016:2262-2265. doi: 10.1109/EMBC.2016.7591180.Annu Int Conf IEEE Eng Med Biol Soc. 2016.PMID:28268779
- Increasing appropriate conversation skills using a behavioral skills training package for adults with intellectual disability and autism spectrum disorder.Ryan G, Brady S, Holloway J, Lydon H.Ryan G, et al.J Intellect Disabil. 2019 Dec;23(4):567-580. doi: 10.1177/1744629517750744. Epub 2018 Jan 1.J Intellect Disabil. 2019.PMID:29291670
- [Prosocial intervention in children and adolescents with autism spectrum disorder without intellectual disability: benefits of videotaping therapy sessions].Vesperini S, Askenazy F, Renaudo N, Staccini P, Hun S, Legall E, Serret S.Vesperini S, et al.Encephale. 2015 Feb;41(1):47-55. doi: 10.1016/j.encep.2013.04.015. Epub 2014 Oct 28.Encephale. 2015.PMID:25439857French.
- [Vocational Training and Job Placement for People with Autism Spectrum Disorders in the Business Sector].Suzuki K.Suzuki K.Seishin Shinkeigaku Zasshi. 2015;117(3):221-7.Seishin Shinkeigaku Zasshi. 2015.PMID:26524849Review.Japanese.
- Social skills training for youth with autism spectrum disorders: a follow-up.Otero TL, Schatz RB, Merrill AC, Bellini S.Otero TL, et al.Child Adolesc Psychiatr Clin N Am. 2015 Jan;24(1):99-115. doi: 10.1016/j.chc.2014.09.002. Epub 2014 Oct 11.Child Adolesc Psychiatr Clin N Am. 2015.PMID:25455578Review.
Cited by
- Natural Language Processing for Covid-19 Consulting System.Tripathy S, Singh R, Ray M.Tripathy S, et al.Procedia Comput Sci. 2023;218:1335-1341. doi: 10.1016/j.procs.2023.01.112. Epub 2023 Jan 31.Procedia Comput Sci. 2023.PMID:36743786Free PMC article.
- Preliminary Evaluation of a Conversational Agent to Support Self-management of Individuals Living With Posttraumatic Stress Disorder: Interview Study With Clinical Experts.Han HJ, Mendu S, Jaworski BK, Owen JE, Abdullah S.Han HJ, et al.JMIR Form Res. 2023 May 29;7:e45894. doi: 10.2196/45894.JMIR Form Res. 2023.PMID:37247220Free PMC article.
- The Personalization of Conversational Agents in Health Care: Systematic Review.Kocaballi AB, Berkovsky S, Quiroz JC, Laranjo L, Tong HL, Rezazadegan D, Briatore A, Coiera E.Kocaballi AB, et al.J Med Internet Res. 2019 Nov 7;21(11):e15360. doi: 10.2196/15360.J Med Internet Res. 2019.PMID:31697237Free PMC article.Review.
- Conversational Interfaces for Health: Bibliometric Analysis of Grants, Publications, and Patents.Xing Z, Yu F, Du J, Walker JS, Paulson CB, Mani NS, Song L.Xing Z, et al.J Med Internet Res. 2019 Nov 18;21(11):e14672. doi: 10.2196/14672.J Med Internet Res. 2019.PMID:31738171Free PMC article.Review.
- Automatic evaluation-feedback system for automated social skills training.Saga T, Tanaka H, Matsuda Y, Morimoto T, Uratani M, Okazaki K, Fujimoto Y, Nakamura S.Saga T, et al.Sci Rep. 2023 Apr 26;13(1):6856. doi: 10.1038/s41598-023-33703-0.Sci Rep. 2023.PMID:37100886Free PMC article.
References
- American Psychiatric Association A. Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub; 2013.
- Liberman R, Wallace C. Social and independent living skills: Basic conversation skills module. Camarillo, Calif: Author; 1990.
- Bellack AS. Social skills training for schizophrenia: A step-by-step guide. Guilford Press; 2004.
- Baron-Cohen S, Richler J, Bisarya D, Gurunathan N, Wheelwright S. The systemizing quotient: an investigation of adults with Asperger syndrome or high–functioning autism, and normal sex differences. Philosophical Transactions of the Royal Society of London B: Biological Sciences. 2003;358(1430):361–374. 10.1098/rstb.2002.1206 - DOI - PMC - PubMed
- Bishop J. The Internet for educating individuals with social impairments. Journal of Computer Assisted Learning. 2003;19(4):546–556. 10.1046/j.0266-4909.2003.00057.x - DOI
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
Miscellaneous