Emotion recognition via face tracking with RealSense 3D camera for children with autism

Document Type

Conference Proceeding

Publication Date



Although there is a growing recognition of the differences, not diminished abilities, of facial affective expressivity between Typically Developing (TD) and Autism Spectrum Disorder (ASD) individuals, which might lead to the varied recognizability of conveyed emotion by both TD and ASD individuals, little is explored on the ecological validity of these findings; that is, whether spontaneous affective facial expressions can better be produced and recognized by both populations. We aimed to address these issues in the present study, using children's cartoon clips to assess two aspects of spontaneous emotion production and recognition in a context closer to real-life children's cartoon movie watching (at home or a classroom). Based on the facial landmark data and a teacher/parent's manual emotion tags (happy), we performed a computational analysis to compare the happy emotion labels generated by the automated algorithm and the human TD rater. Two pilot studies of six ASD children revealed the potential as well as challenges of such an approach.

Publication Title

IDC 2017 - Proceedings of the 2017 ACM Conference on Interaction Design and Children

First Page Number


Last Page Number




This document is currently not available here.