|
|
Towards Efficient Multi-Modal Emotion Recognition : Verso un riconoscimento multi-modale efficiente dell'emozione, in: International Journal of Advanced Robotic Systems |
Open document
|
General information |
| Author |
Dobrišek, Simon; Gajšek, Rok; Mihelič, France; Pavešic, Nikola; Štruc, Vitomir |
| Published |
InTech Open Access Publisher, 2013
|
| Edition |
|
| Extend |
|
| ISBN |
|
| Abstract |
The paper presents a multi‐modal emotion
recognition system exploiting audio and video (i.e.,
facial expression) information. The system first
processes both sources of information individually to
produce corresponding matching scores and then
combines the computed matching scores to obtain a
classification decision. For the video part of the system,
a novel approach to emotion recognition, relying on
image‐set matching, is developed. The proposed
approach avoids the need for detecting and tracking
specific facial landmarks throughout the given video
sequence, which represents a common source of error in
video‐based emotion recognition systems, and,
therefore, adds robustness to the video processing
chain. The audio part of the system, on the other hand,
relies on utterance‐specific Gaussian Mixture Models
(GMMs) adapted from a Universal Background Model
(UBM) via the maximum a posteriori probability (MAP)
estimation. It improves upon the standard UBM‐MAP
procedure by exploiting gender information when
building the utterance‐specific GMMs, thus ensuring
enhanced emotion recognition performance. Both the
uni‐modal parts as well as the combined system are
assessed on the challenging multi‐modal
eNTERFACEʹ05 corpus with highly encouraging results.
The developed system represents a feasible solution to
emotion recognition that can easily be integrated into
various systems, such as humanoid robots, smart
surveillance systems and alike. |
|
| Collections |
| |
|
| Superordinate work |
| |
|
International Journal of Advanced Robotic Systems
Author: Ottaviano, Erika; Ceccarelli, Marco; Husty, Manfred; Yu, Sung-Hoon; Kim, Yong-Tae; Park, Chang-Woo; Hyun, Chang-Ho; Chen, Xiulong; Feng, Weiming; Sun, Xianyang; Gao, Qing; Grigorescu, Sorin M.; Pozna, Claudiu; Liu, Wanli; Zhankui, Wang; Guo, Meng; Fu, Guoyu; Zhang, Jin; Chen, Wenyuan; Peng, Fengchao; Yang, Pei; Chen, Chunlin; Ding, Rui; Yu, Junzhi; Yang, Qinghai; Tan, Min; Polden, Joseph; Pan, [...]
Published: 2004
|
|
| Linked items |
|
|
| Permanent links |
| |
|
| Data provider |
| |
|
| Administrative information |
| |
|
Newsletter
DMG-Lib
Europeana
PDF
Univ. Cassino
