Yang, J;
Wang, Y;
Lv, Z;
Jiang, N;
Steed, A;
(2018)
Interaction with Three-Dimensional Gesture and Character Input in Virtual Reality Recognizing gestures in different directions and improving user input.
IEEE Consumer Electronics Magazine
, 7
(2)
pp. 64-72.
10.1109/MCE.2017.2776500.
Preview |
Text
gesture_paper.pdf - Accepted Version Download (1MB) | Preview |
Abstract
Hand gesture recognition is a key aspect to make interaction of virtual reality more convenient. A good way to make users’ idea understood by computers including characters input plays an important role in interaction. Current methods of hand gesture and character input are too limited to make full use of powerful capacity that computers have nowadays. In this paper, we propose a natural 3D input method based on stereo cameras as an interface of human and machine. We segment the hand out based on skin-color detection and train a neural network based on Hu moments to recognize valid and invalid gestures defined in our paper. For valid gestures, we implement stereo matching and 3D coordinate calculation and line them up to formulate characters. Our method can robustly recognize 3D gestures in different directions and make users’ input more free compared with traditional ways.
| Type: | Article |
|---|---|
| Title: | Interaction with Three-Dimensional Gesture and Character Input in Virtual Reality Recognizing gestures in different directions and improving user input |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/MCE.2017.2776500 |
| Publisher version: | http://dx.doi.org/10.1109/MCE.2017.2776500 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Telecommunications, Computer Science, Engineering, FACE RECOGNITION, WEARABLE DEVICE, NEURAL-NETWORKS, HAND, SYSTEM, virtual reality, consumer electronics, three dimension interface, gesture recognition, binocular camera, character input. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10057122 |
Archive Staff Only
 |
View Item |
