BNU-LSVED: a multimodal spontaneous expression database in educational environment

Bo Sun; Qinglan Wei; Jun He; Lejun Yu; Xiaoming Zhu

doi:10.1117/12.2235892

14 September 2016 BNU-LSVED: a multimodal spontaneous expression database in educational environment

Bo Sun, Qinglan Wei, Jun He, Lejun Yu, Xiaoming Zhu

Proceedings Volume 9970, Optics and Photonics for Information Processing X; 997016 (2016) https://doi.org/10.1117/12.2235892
Event: SPIE Optical Engineering + Applications, 2016, San Diego, California, United States

Abstract

In the field of pedagogy or educational psychology, emotions are treated as very important factors, which are closely associated with cognitive processes. Hence, it is meaningful for teachers to analyze students’ emotions in classrooms, thus adjusting their teaching activities and improving students ’ individual development. To provide a benchmark for different expression recognition algorithms, a large collection of training and test data in classroom environment has become an acute problem that needs to be resolved. In this paper, we present a multimodal spontaneous database in real learning environment. To collect the data, students watched seven kinds of teaching videos and were simultaneously filmed by a camera. Trained coders made one of the five learning expression labels for each image sequence extracted from the captured videos. This subset consists of 554 multimodal spontaneous expression image sequences (22,160 frames) recorded in real classrooms. There are four main advantages in this database. 1) Due to recorded in the real classroom environment, viewer’s distance from the camera and the lighting of the database varies considerably between image sequences. 2) All the data presented are natural spontaneous responses to teaching videos. 3) The multimodal database also contains nonverbal behavior including eye movement, head posture and gestures to infer a student ’ s affective state during the courses. 4) In the video sequences, there are different kinds of temporal activation patterns. In addition, we have demonstrated the labels for the image sequences are in high reliability through Cronbach's alpha method.

Citation Download Citation

Bo Sun, Qinglan Wei, Jun He, Lejun Yu, and Xiaoming Zhu "BNU-LSVED: a multimodal spontaneous expression database in educational environment", Proc. SPIE 9970, Optics and Photonics for Information Processing X, 997016 (14 September 2016); https://doi.org/10.1117/12.2235892

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available