A Multi‐Model Approach for Attention Prediction in Gaming Environments for Autistic Children

A Multi‐Model Approach for Attention Prediction in Gaming Environments for Autistic Children P. Valarmathi Department of Computer Science and Engineering Vels Institute of Science & Technology & Advanced Studies Chennai Tamilnadu India https://orcid.org/0009-0000-8587-0774 A. Packialatha Department of Computer Science and Engineering Vels Institute of Science & Technology & Advanced Studies Chennai Tamilnadu India ABSTRACT

Autism spectrum disorder (ASD) is a neurological condition that affects an individual's mental development. This research work implements a multimodality input‐based virtual reality (VR)‐enabled attention prediction approach in gaming for children with autism. Initially, the multimodal inputs such as face image, electroencephalogram (EEG) signal, and data are individually processed by both the preprocessing and feature extraction procedures. Subsequently, a hybrid classification model with classifiers such as improved deep convolutional neural network (IDCNN) and long short term memory (LSTM) is utilized in expression detection by concatenating the resultant features obtained from the feature extraction procedure. Here, the conventional deep convolutional neural network (DCNN) approach is improved by a novel block‐knowledge‐based processing with a proposed sine‐hinge loss function. Finally, an improved weighted mutual information process is employed in attention prediction. Moreover, this proposed attention prediction model is analyzed by simulation and experimental analyses. The effectiveness of the proposed model is significantly proved by the experimental results obtained from various analyses.
01 28 2025 01 2025 e70010 10.1002/cav.70010 2 10.1002/crossmark_policy onlinelibrary.wiley.com true 2024-03-02 2025-01-06 2025-01-28 http://onlinelibrary.wiley.com/termsAndConditions#vor 10.1002/cav.70010 https://onlinelibrary.wiley.com/doi/10.1002/cav.70010 https://onlinelibrary.wiley.com/doi/pdf/10.1002/cav.70010 10.1007/s11257‐023‐09371‐0 10.1145/3337066 10.1007/s41666‐021‐00101‐y 10.3390/robotics7020025 10.1101/2023.06.13.23286416 R. A. J.deBelen V.Eapen T.Bednarz andA.Sowmya “Using Visual Attention Estimation on Videos for Automated Prediction of Autism Spectrum Disorder and Symptom Severity in Preschool Children ”2023 https://doi.org/10.1101/2023.06.13.23286416. 10.34768/amcs-2020-0032 10.1016/j.psycom.2022.100045 10.3390/app11167426 10.3389/fpsyt.2022.993077 10.3390/app11083636 10.1371/journal.pone.0250763 10.1016/j.image.2021.116186 10.3390/brainsci12010041 10.1016/j.health.2023.100211 10.1155/2020/1357853 10.1155/2022/9213526 10.1016/j.heliyon.2023.e16763 10.3389/fpubh.2022.1029392 10.1155/2022/3941049 10.1007/s10803‐010‐1033‐8 10.1038/s41598‐021‐89023‐8 10.1007/s42979‐021‐00815‐1 10.1007/s10462‐023‐10466‐8 10.1177/1362361320951370 10.1111/j.1469‐7610.2012.02547.x 10.1016/j.procs.2020.04.029 Pertanika Journal of Science and Technology Kalaivani K. 1005 26 3 2018 Modifed Wiener Filter for Restoring Landsat Images in Remote Sensing Applications 10.17148/IARJSET.2015.2305 S. G. K.PatroandK. K.sahu "Normalization: A Preprocessing Stage " 1503.06462(2015). 10.1088/1757‐899X/332/1/012032 10.1007/s42979‐021‐00586‐9 10.1109/ICMA.2015.7237812 10.1038/s41598‐022‐15813‐3 10.1109/ICDAR.2015.7333822 S.Verma “Understanding Different Loss Functions for Neural Networks ”2019 https://shiva‐verma.medium.com/understanding‐different‐loss‐functions‐for‐neural‐networks‐dd1ed0274718. Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science Yao Y. 2016 10.1016/j.eswa.2014.04.019 10.1016/j.jksuci.2018.08.006 A. R.Levin L. J.Gabard‐Durnam M.Leal et al. “Infant Sibling Project: Sample Files ”2018 https://zenodo.org/record/998965. Autism Data for Infants Classification “Autism Screening Data for Toddlers ”https://www.kaggle.com/datasets/fabdelja/autism‐screening‐for‐toddlers. Face Image Dataset https://drive.google.com/drive/folders/1XQU0pluL0m3TIlXqntano12d68peMb8A. 10.1111/j.1460‐9568.2010.07102.x 10.1016/j.newideapsych.2011.11.001