Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Interactive video-player to improve social smile in individuals with autism spectrum disorder

Interactive video-player to improve social smile in individuals with autism spectrum disorder The purpose of this paper is to propose and develop a live interaction-based video player system named LIV4Smile for the improvement of the social smile in individuals with autism spectrum disorder (ASD).Design/methodology/approachThe proposed LIV4Smile intervention was a video player that operated by detecting smile using a convolutional neural network (CNN)-based algorithm. To maintain a live interaction, a CNN-based smile detector was configured and used in this system. The statistical test was also conducted to validate the performance of the system.FindingsThe significant improvement was observed in smile responses of individuals with ASD with the utilization of the proposed LIV4Smile system in a real-time environment.Research limitations/implicationsA small sample size and clinical utilizing for validation and initial training of ASD individuals for LIV4Smile could be considered under implications.Originality/valueThe main aim of this study was to address the inclusive practices for children with autism. The proposed CNN algorithm-based LIV4Smile intervention resulted in high accuracy in facial smile detection. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Advances in Autism Emerald Publishing

Interactive video-player to improve social smile in individuals with autism spectrum disorder

Khullar, Vikas; Bala, Manju; Singh, Harjit Pal
Advances in Autism , Volume 6 (2): 11 – Apr 21, 2020
Download PDF
11 pages

Loading next page...
 
/lp/emerald-publishing/interactive-video-player-to-improve-social-smile-in-individuals-with-dV15iUntT1
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
2056-3868
DOI
10.1108/aia-05-2019-0014
Publisher site
See Article on Publisher Site

Abstract

The purpose of this paper is to propose and develop a live interaction-based video player system named LIV4Smile for the improvement of the social smile in individuals with autism spectrum disorder (ASD).Design/methodology/approachThe proposed LIV4Smile intervention was a video player that operated by detecting smile using a convolutional neural network (CNN)-based algorithm. To maintain a live interaction, a CNN-based smile detector was configured and used in this system. The statistical test was also conducted to validate the performance of the system.FindingsThe significant improvement was observed in smile responses of individuals with ASD with the utilization of the proposed LIV4Smile system in a real-time environment.Research limitations/implicationsA small sample size and clinical utilizing for validation and initial training of ASD individuals for LIV4Smile could be considered under implications.Originality/valueThe main aim of this study was to address the inclusive practices for children with autism. The proposed CNN algorithm-based LIV4Smile intervention resulted in high accuracy in facial smile detection.

Journal

Advances in Autism – Emerald Publishing

Published: Apr 21, 2020

Keywords: Autism spectrum disorder; Convolutional neural network; Behavioral improvement; Facial emotion; Social smile; Video player

References

  • Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals
    Acharya, U.R.; Oh, S.L.; Hagiwara, Y.; Tan, J.H.; Adeli, H.
  • The effects of autism and alexithymia on physiological and verbal responsiveness to music
    Allen, R.; Davis, R.; Hill, E.
  • Focus: austism spectrum disorders
    Ardhanareeswarana, K.; Volkmar, F.
  • Pilot clinical application of an adaptive robotic system for young children with autism
    Bekele, E.; Crittendon, J.A.; Swanson, A.; Sarkar, N.; Warren, Z.E.
  • Robust smile detection using convolutional neural networks networks
    Bianco, S.; Celona, L.; Schettini, R.
  • Autism: an early neurodevelopmental disorder
    Bonnet-Brilhault, F.
  • Designing computer-based rewards with and for children with autism spectrum disorder and/or intellectual disability
    Constantin, A.; Johnson, H.; Smith, E.; Lengyel, D.; Brosnan, M.
  • Early commitment of neural substrates for face recognition
    Farah, M.J.; Rabinowitz, C.; Quinn, G.E.; Liu, G.T.
  • Basic and complex emotion recognition in children with autism: cross-cultural findings
    Fridenson-Hayo, S.; Berggren, S.; Lassalle, A.; Tal, S.; Pigat, D.; Bölte, S.; Baron-Cohen, S.; Golan, O.
  • Brief report: the smiles of a child with autism spectrum disorder during an animal-assisted activity may facilitate social positive behaviors–quantitative analysis with smile-detecting interface
    Funahashi, A.; Gruebler, A.; Aoki, T.; Kadone, H.; Suzuki, K.
  • Challenges in representation learning: a report on three machine learning contests
    Goodfellow, I.J.; Erhan, D.; Luc Carrier, P.; Courville, A.; Mirza, M.; Hamner, B.; Cukierski, W.
  • Self-monitoring of gaze in high functioning autism
    Grynszpan, O.; Nadel, J.; Martin, J.C.; Simonin, J.; Bailleul, P.; Wang, Y.; Gepner, D.; Le Barillier, F.; Constant, J.
  • Reliability and validity of the chinese version of modified checklist for autism in toddlers, revised, with follow-up ( M-CHAT-R / F )
    Guo, C.; Luo, M.; Wang, X.; Huang, S.; Meng, Z.; Shao, J.; Zhang, X.
  • The effect of parenting style on social smiling in infants at high and low risk for ASD
    Harker, C.M.; Iban, L.V.; Stone, W.L.
  • Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies
    Harms, M.B.; Martin, A.; Wallace, G.L.
  • One-dimensional convolutional neural networks for Android malware detection
    Hasegawa, C.; Iyatomi, H.
  • Locating events in space and time: experiments with autistic, blind, and deaf children
    Hermelin, B.
  • Review article autism spectrum disorder – advances in genomics and impact of early behavioral intervention
    Johnson, B.
  • Autistic disturbances of affective contact
    Kanner, L.
  • Early infantile autism
    Kanner, L.
  • Virtual-reality-based social interaction training for children with high-functioning autism
    Ke, F.; Im, T.
  • ASD faces are less explainable
    Khullar, V.; Singh, H.P.; Bala, M.
  • New autism diagnostic interview-revised algorithms for toddlers and young preschoolers from 12 to 47 months of age
    Kim, S.H.; Lord, C.
  • Improving social initiations in young children with autism using reinforcers with embedded social interactions
    Koegel, R.L.; Vernon, T.W.; Koegel, L.K.
  • Understanding the psycho-physiological implications of interaction with a virtual reality-based system in adolescents with autism: a feasibility study
    Kuriakose, S.; Lahiri, U.
  • A physiologically informed virtual reality based social communication system for individuals with autism
    Lahiri, U.; Bekele, E.; Dohrmann, E.; Warren, Z.; Sarkar, N.
  • Labeled faces in the wild: a survey
    Learned-Miller, E.; Huang, G.B.; RoyChowdhury, A.; Li, H.; Hua, G.; Kawulok, M.; Celebi, M.E.; Smolka, B.
  • Gradient-based learning applied to document recognition
    Lecun, Y.; Bottou, L.; Bengio, Y.; Haffner, P.
  • Social engagement with peers and stereotypic behavior of children with autism
    Lee, S.; Odom, S.L.; Loftin, R.
  • A comparison of machine learning algorithms for the surveillance of autism spectrum disorder
    Lee, S.H.; Maenner, M.J.; Heilig, C.M.
  • The Child Affective Facial Expression (CAFE) set: Validity and reliability from untrained adults
    LoBue, V.; Thrasher, C.
  • Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders
    Lord, C.; Rutter, M.; Couteur, A. Le.
  • Impairments in facial affect recognition associated with autism spectrum disorders: a meta-analysis
    Lozier, L.M.; Vanmeter, J.W.; Marsh, A.A.
  • The Extended Cohn-Kanade Dataset (CK+): a complete dataset for action unit and emotion-specified expression
    Lucey, P.; Cohn, J.F.; Kanade, T.; Saragih, J.; Ambadar, Z.; Matthews, I.
  • The Japanese Female Facial Expression (JAFFE) database
    Lyons, M.J.; Akamatsu, S.; Kamachi, M.; Gyoba, J.; Budynek, J.
  • AFFDEX SDK: a cross-platform real- time multi-face expression recognition toolkit
    Mcduff, D.; Mahmoud, A.; Mavadati, M.; Amr, M.; Turcot, J.; Kaliouby, R.el.
  • One-dimensional convolutional neural networks for spectroscopic signal regression
    Malek, S.; Melgani, F.; Bazi, Y.
  • Automatic recognition of posed facial expression of emotion in individuals with autism spectrum disorder
    Manfredonia, J.; Bangerter, A.; Manyakov, N.V.; Ness, S.; Lewin, D.; Skalkin, A.; Boice, M.; Goodwin, M.S.; Dawson, G.; Hendren, R.; Leventhal, B.; Shic, F.; Pandina, G.
  • Annotated facial landmarks in the wild: a large-scale, real-world database for facial landmark localization
    Martin, K.; Wohlhart, P.; Roth, P.M.; Bischof, H.
  • Subject independent facial expression recognition with robust face detection using a convolutional neural network
    Matsugu, M.; Mori, K.; Mitari, Y.; Kaneda, Y.
  • Evaluation of convolutional neural networks for visual recognition
    Neubauer, C.
  • Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review
    Nuske, H.J.; Vivanti, G.; Dissanayake, C.
  • Web-based database for facial expression analysis
    Pantic, M.; Valstar, M.; Rademaker, R.; Maat, L.
  • Deep learning based recognition of meltdown in autistic kids
    Patnam, V.S.P.; George, F.T.; George, K.; Verma, A.
  • Baseline CNN structure analysis for facial expression recognition
    Shin, M.; Kim, M.; Kwon, D.-S.
  • Social and cardiac responses of young children with autism
    Sigman, M.; Dissanayake, C.; Corona, R.; Espinosa, M.
  • Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let’s Face It! program
    Tanaka, J.W.; Wolf, J.M.; Klaiman, C.; Koenig, K.; Cockburn, J.; Herlihy, L.; Brown, C.; Sherin, S.; Martha, D.K.; Robert, S.T.
  • The perception and identification of facial emotions in individuals with autism spectrum disorders using the let’s face it! emotion skills battery
    Tanaka, J.W.; Wolf, J.M.; Klaiman, C.; Koenig, K.; Cockburn, J.; Herlihy, L.; Brown, C.; Sherin, S.; Martha, D.K.; Robert, S.T.
  • The added value of the combined use of the autism diagnostic interview-revised and the autism diagnostic observation schedule: diagnostic validity in a clinical Swedish sample of toddlers and young preschoolers
    Zander, E.; Sturm, H.; Bölte, S.