Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Measuring emotions during learning: lack of coherence between automated facial emotion recognition and emotional experience

Measuring emotions during learning: lack of coherence between automated facial emotion... AbstractMeasuring emotions non-intrusively via affective computing provides a promising source of information for adaptive learning and intelligent tutoring systems. Using non-intrusive, simultaneous measures of emotions, such systems could steadily adapt to students emotional states. One drawback, however, is the lack of evidence on how such modern measures of emotions relate to traditional self-reports. The aim of this study was to compare a prominent area of affective computing, facial emotion recognition, to students’ self-reports of interest, boredom, and valence. We analyzed different types of aggregation of the simultaneous facial emotion recognition estimates and compared them to self-reports after reading a text. Analyses of 103 students revealed no relationship between the aggregated facial emotion recognition estimates of the software FaceReader and self-reports. Irrespective of different types of aggregation of the facial emotion recognition estimates, neither the epistemic emotions (i.e., boredom and interest), nor the estimates of valence predicted the respective self-report measure. We conclude that assumptions on the subjective experience of emotions cannot necessarily be transferred to other emotional components, such as estimated by affective computing. We advise to wait for more comprehensive evidence on the predictive validity of facial emotion recognition for learning before relying on it in educational practice. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Open Computer Science de Gruyter

Measuring emotions during learning: lack of coherence between automated facial emotion recognition and emotional experience

Download PDF
10 pages

Loading next page...
 
/lp/de-gruyter/measuring-emotions-during-learning-lack-of-coherence-between-automated-dWjET7KA5W
Publisher
de Gruyter
Copyright
© 2019 Franziska Hirt et al., published by De Gruyter
eISSN
2299-1093
DOI
10.1515/comp-2019-0020
Publisher site
See Article on Publisher Site

Abstract

AbstractMeasuring emotions non-intrusively via affective computing provides a promising source of information for adaptive learning and intelligent tutoring systems. Using non-intrusive, simultaneous measures of emotions, such systems could steadily adapt to students emotional states. One drawback, however, is the lack of evidence on how such modern measures of emotions relate to traditional self-reports. The aim of this study was to compare a prominent area of affective computing, facial emotion recognition, to students’ self-reports of interest, boredom, and valence. We analyzed different types of aggregation of the simultaneous facial emotion recognition estimates and compared them to self-reports after reading a text. Analyses of 103 students revealed no relationship between the aggregated facial emotion recognition estimates of the software FaceReader and self-reports. Irrespective of different types of aggregation of the facial emotion recognition estimates, neither the epistemic emotions (i.e., boredom and interest), nor the estimates of valence predicted the respective self-report measure. We conclude that assumptions on the subjective experience of emotions cannot necessarily be transferred to other emotional components, such as estimated by affective computing. We advise to wait for more comprehensive evidence on the predictive validity of facial emotion recognition for learning before relying on it in educational practice.

Journal

Open Computer Science – de Gruyter

Published: Jan 1, 2019

References

  • Towards a learning companion that recognizes affect Technical Report
    Kapoor
  • of affective in learning Trends challenges bjet
    Wu
  • Appraisal theories of emotion State of the art and future development
    Moors
  • Team language and environment for statistical
    Core
  • Constructing an Affective Tutoring System for Designing Course Learning and Evaluation
    Wang
  • FaceReader a promising instrument for measuring facial emotion expression comparison to facial electromyography and self - reports Ph thesis Master thesis Utrecht University
    Suhr
  • Relations between students approaches to learning experienced emotions and outcomes of learning in
    Trigwell
  • Evaluating the Relationship Between Boredom and Academic Outcomes
    Daniels
  • Facial Features for Affective State Detection in Learning Environments Permalink in Proceedings of the th
    McDaniel
  • Detecting cognitive appraisals from facial expressions for interest recognition preprint arXiv arXiv
    Soleymani
  • The affective computing approach to affect measurement
    Mello
  • Affective rationale for measuring mood with mouse and keyboard and
    Zimmermann
  • Homepage
    Noldus
  • Heino Bayesian evaluation of behavior change interventions : a brief introduction and a practical example
    Vuorre
  • Interest learning and development in The role of interest in learning and development Erlbaum Hilsdale
    Krapp
  • Color and emotion - a study on the affective judgment across media and in relation to visual stimuli Ph thesis Doctoral dissertation University of Mannheim
  • Ordinal regression models in tutorial Advances in Practices in
    Bürkner
  • What is meant by calling emotions basic
    Ekman
  • new readability yardstick of
    Flesch
  • What emotions do novices experience during their first computer programming learning session Technical report
    Bosch
  • Homepage
    Affectiva
  • Measuring facial movement Environmental Nonverbal Behavior
    Ekman
  • Emotional expressions reconsidered : challenges to inferring emotion from human facial movements in the Public Interest
    Feldman Barrett
  • Wie verständlich sind unsere Zeitungen Studenten Schreib Service
    Amstad
  • sensitivity and self - reports of emotional experience of and molcel The
    Feldman Barrett
  • circumplex model of affect of and
  • Don t look blank happy or sad Patterns of facial expressions of speakers in banks YouTube Videos predict video s popularity over time of
    Lewinski
  • Using video to automatically detect learner affect in computer - enabled classrooms
    Bosch
  • Brief Report The coherence of emotion systems : Comparing on - line measures of appraisal and facial expressions and self - report
    Bonanno
  • Longitudinal Data Analysis Examples with Random Coefficient Models of and https org
    Rogosa
  • Weinreich Schuber Facial Electromyography reveals dissociable affective responses in social and non - social cooperation and
    Soutschek
  • Methodology Note white paper by Technology Technical report Amsterdam
    Loijens
  • Measuring emotions during epistemic activities the Related
    Pekrun
  • Automatically recognizing facial expression : predicting engagement and frustration Educational Data Mining
    Grafsgaard