The week's pick
Reseach Article
Survey of Approaches for Building Emotion Detection Applications using a Multi-modal Approach
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 179 - Number 37 |
| Year of Publication: 2018 |
| Authors: Siddhesh More, Shruti Subramanyam, Kalyani Reddy, Komal Patil, Archana Chaugule |
10.5120/ijca2018916849
|
Siddhesh More, Shruti Subramanyam, Kalyani Reddy, Komal Patil, Archana Chaugule . Survey of Approaches for Building Emotion Detection Applications using a Multi-modal Approach. International Journal of Computer Applications. 179, 37 ( Apr 2018), 18-20. DOI=10.5120/ijca2018916849
Abstract
Emotion detection of users is a challenging and exciting field where user’s data is analyzed to recognize emotions such as happy, sad, angry etc. This data could be in one or multiple formats such as audio, video, text, still images etc. Relevant features are extracted and fused together to give a label. Fusing data from two or more sources(modalities) is another challenge, feature level or decision level fusion is employed. This paper inspects and studies the various approaches to multi-modal extraction of emotions.
References
- R. Zatarain-Cabada, M. Lucia Barrn-Estrada, J. Garca-Lizrraga, G.Muoz-Sandoval, “Java Tutoring System with Facial and Text Emotion Recognition”, Instituto Tecnolgico de Culiacn,pp. 49–58”2015.
- C. Busso, Z. Deng , S. Yildirim, M. Bulut, C. Min Lee, A. Kazemzadeh, S. Lee, U. Neumann, S.Narayanan , “Analysis of Emotion Recognition Using Facial Expressions, Speech and Multimodal Information”, Proceedings of the 6th international conference on Multimodal interfaces,Pages 205-211,2004 .
- S. Emerich1, E. Lupu1, A. Apatean1, “Emotions recognition by speech and facial expression analysis” , Signal Processing Conference, 2009 17th European,2009.
- S. Poria, A. Hussain, E. Cambria, ”Text-based sentiment analysis: Towards multimodal systems,”Proceedings of the 13th international conference on multimodal interfaces, Pages 169-176, 2011.
- L. Tian, D. Zheng, C. Zhu, “Image Classification Based on the Combination of Text Features and Visual Features”, ISI Journal, Volume 28, Pages 242–256, 2013.
- L. Philippe Morency, R. Mihalcea, P. Doshi, “Multimodal Sentiment Analysis: Harvesting Opinions from the Web”, ICMI '11 Proceedings of the 13th international conference on multimodal interfaces, Pages 169-176, 2011.
- P. Khorrami, T. Le Paine, K. Brady, C. Dagli, T.S. Huang1, “HOW DEEP NEURALNETWORKS CAN IMPROVE EMOTION RECOGNITION ON VIDEO DATA”, Image Processing (ICIP), 2016 IEEE International Conference in 2016.
- R. Gupta, N. Malandrakis, and B. Xiao.,” Multimodal prediction of affective dimensions and depression in human-computer interactions”, Proceeding AVEC '14 Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, Pages 33-40,2014.
Index Terms
Keywords