files/journal/2022-09-02_12-54-44-000000_354.png

Journal of Engineering and Applied Sciences

ISSN: Online 1818-7803
ISSN: Print 1816-949x
101
Views
0
Downloads

Automatic Recognition of Cognitive States Using Multimodal Approaches in e-Learning Environments

H.S. Gunavathi and M. Siddappa
Page: 1286-1294 | Received 21 Sep 2022, Published online: 21 Sep 2022

Full Text Reference XML File PDF File

Abstract

Cognitive state recognition is one of the active science researches all around the world and it has grown spontaneously in recent years. However, most research focuses on posed expressions, near frontal recordings and they ignore eye gaze, head pose and considers hand occlusions as noise. It makes tough to tell how the existing methods perform underneath conditions where faces appear in a wide range of poses and occluded by hands. In this study, we propose multimodal approaches for building a real-time cognitive state recognition system in e-Learning environments by integrating hand-over-face gesture with facial expression. Our proposed system performs an average recognition rate of 90.51% with 15.8 fps is robust to variations in facial expressions, hand shapes and occlusions.


How to cite this article:

H.S. Gunavathi and M. Siddappa. Automatic Recognition of Cognitive States Using Multimodal Approaches in e-Learning Environments.
DOI: https://doi.org/10.36478/jeasci.2019.1286.1294
URL: https://www.makhillpublications.co/view-article/1816-949x/jeasci.2019.1286.1294