MULTIMODAL EMOTION RECOGNITION: A COMPREHENSIVE SURVEY WITH DEEP LEARNING
PDF
DOI

Keywords

Deep learning,
EEG,
Multimodal Emotion Recognition,
Speech Emotion Recognition,
Facial Expression Recognition,
GSR, Gesture-based Emotion,
AffectNet,
IEMOCAP,
SEMAINE

How to Cite

KURBANOV, A. (2023). MULTIMODAL EMOTION RECOGNITION: A COMPREHENSIVE SURVEY WITH DEEP LEARNING. Journal of Research and Innovations, 1(9), 43–47. Retrieved from https://imfaktor.com/jorai/article/view/669

Abstract

Multimodal emotion recognition involves the integration of data from multiple sources Deep learning, or modalities, such as facial expressions, vocal tone, body language, and physiological signals. This holistic approach aims to capture a more accurate and comprehensive understanding of emotional states. Deep learning, with its ability to extract intricate patterns from diverse data types, has become an invaluable tool in this pursuit.

PDF
DOI

References

Abdullah et al., 2021 S.M.S.A. Abdullah, S.Y.A. Ameen, M.A.M. Sadeeq, S. Zeebaree Multimodal emotion recognition using deep learning Journal of Applied Science and Technology Trends, 2 (02) (2021), pp. 52-58

Aiswaryadevi et al., 2021 V.J. Aiswaryadevi, G. Priyanka, S. Sathya Bama, S. Kiruthika, S. Soundarya, M. Sruthi, et al. Smart iot multimodal emotion recognition system using deep learning networks Artificial Intelligence and IoT Smart Convergence for Eco Friendly Topography (2021), pp. 3-19

Alswaidan and Menai, 2020 N. Alswaidan, M. El Bachir Menai A survey of state-of-the-art approaches for emotion recognition in text Knowledge & Information Systems, 62 (8) (2020)

Baltrušaitis et al., 2018 T. Baltrušaitis, C. Ahuja, L.P. Morency Multimodal machine learning: A survey and taxonomy IEEE Transactions on Pattern Analysis and Machine Intelligence, 41 (2) (2018), pp. 423-443

Bazgir et al., 2018 O. Bazgir, Z. Mohammadi, S.A.H. Habibi Emotion recognition with machine learning using eeg signals Proceedings of the 25th national and 3rd international iranian conference on biomedical engineering (ICBME), IEEE (2018), pp. 1-5

Bosch, Käthner, & Drewitz, 2021 E.J. Bosch, D. Käthner, U. Drewitz Evidence for individual-specific expressions of frustration Proceedings of the European Society for Cognitive and Affective Neuroscience (2021) https://elib.dlr.de/143073/

Bota et al., 2019

P.J. Bota, C. Wang, A.L.N. Fred, HPDa Silva A review, current challenges, and future possibilities on emotion recognition using machine learning and physiological signals IEEE Access Practical Innovations Open Solutions, 7 (2019), pp. 140990-141020

Chaparro et al., 2018 V. Chaparro, A. Gomez, A. Salgado, O. Lucia Quintero, N. Lopez, L.F. Villa Emotion recognition from eeg and facial expressions: A multimodal approach

Proceedings of the 40th annual international conference of the IEEE engineering in medicine and biology society (EMBC), IEEE (2018), pp. 530-533

Chen and Zhang, 2017 P. Chen, J. Zhang Performance comparison of machine learning algorithms for eeg-signal-based emotion recognition Proceedings of the international conference on artificial neural networks, Springer (2017), pp. 208-216

Cimtay et al., 2020 Y. Cimtay, E. Ekmekcioglu, S. Caglar-Ozhan Cross-subject multimodal emotion recognition based on hybrid fusion IEEE Access Practical Innovations Open Solutions, 8 (2020), pp. 168865-168878