Takegawa, Y;
Tokuda, Y;
Umezawa, A;
Suzuki, K;
Masai, K;
Sugiura, Y;
Sugimoto, M;
... Hirata, K; + view all
(2020)
Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays.
In:
Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2020.
(pp. pp. 101-108).
IEEE: Porto de Galinhas, Brazil.
Preview |
Text
ismar20a-sub1390-cam-i5 (1).pdf - Accepted Version Download (6MB) | Preview |
Abstract
This paper presents a thin digital full-face mask display that can reflect an entire facial expression of a user onto an avatar to support augmented face-to-face communication in real environments. Although camera-based facial expression recognition technology has enabled people to augment their faces with avatars, application was limited to face-to-face communication in virtual environments. To enable digital facial augmentation with an avatar in a real space, we propose a digital face mask display system that integrates a lightweight flexible display with a thin facial expression recognition system. The thin wearable facial expression recognition system was implemented with photo reflective sensor arrays which can measure facial expressions at 40 feature points distributed across an entire face. We investigated a ten-class facial expression identification model based on an SVM training algorithm. The trained model achieved an average accuracy of 79% when identifying the facial expressions of multiple users. User experiments indicated that the proposed thin digital full-face mask display allows the wearer to control the facial expression of the avatar with a fast response rate and create a positive sense of self-agency and self-ownership toward the augmented avatar face.
| Type: | Proceedings paper |
|---|---|
| Title: | Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays |
| Event: | IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2020 |
| Location: | Porto de Galinhas, Brazil |
| Dates: | 9th-13th November 2020 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/ISMAR50242.2020.00030 |
| Publisher version: | https://doi.org/10.1109/ISMAR50242.2020.00030 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10110413 |
Archive Staff Only
 |
View Item |
