Automatic recognition of student emotions from facial expressions during a lecture

Creative Commons License

Tonguç G., Ozkara B. O.

COMPUTERS & EDUCATION, cilt.148, 2020 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 148
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1016/j.compedu.2019.103797
  • Dergi Adı: COMPUTERS & EDUCATION
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Scopus, Academic Search Premier, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, EBSCO Education Source, Education Abstracts, Educational research abstracts (ERA), INSPEC, Metadex, Psycinfo, DIALNET, Civil Engineering Abstracts
  • Anahtar Kelimeler: Data science applications in education, Applications in subject areas, Architectures for educational, Technology system, Improving classroom teaching, Teaching/learning strategies, ACHIEVEMENT GOALS, CLASS-A, CLASSROOM, BEHAVIORS, ATTENTION, MODEL, ENGAGEMENT, SIDE
  • Akdeniz Üniversitesi Adresli: Evet

Özet

Emotions are of great significance in education as in all areas of human life. It is acknowledged that, although the cultures of people, the environment where they live, and the language they use vary, emotions that are evaluated as universal do exist. In this study, we examined the changes in the emotions of 67 students during the lectures of Basic Information Technologies who studied in three different departments in a state university in Mediterranean region. The facial expressions of the students were analyzed and digitalized in terms of the feelings of disgust, sadness, happiness, fear, contempt, anger and surprise by means of a software developed through Microsoft Emotion Recognition API and C # programming language. During the lecture, we studied how student emotions varied and whether this change was statistically significant according to their departments, gender, lecture hours, the location of the computer in the classroom, lecture type and session information. The lesson plan consisted of three stages: introduction, activities and closure. The significance of the difference in emotions and the relationship between emotion change and achievement were examined according to three different stages. The research showed that feelings of contempt, anger, fear and confusion increased, while feelings of happiness, sadness and disgust decreased in the first stage of the lecture. It was determined that the feeling of happiness increased rapidly, whereas all other emotions decreased during the closure section of the lecture. We found that only the feeling of sadness displayed a significant difference according to the departments. It can be suggested that the equipment that provides instant feedback to the lecturer by monitoring the students' emotions automatically throughout the lecture can be made available throughout the educational institutions, thus contributing to the increase in the quality of education.