Brunel University Research Archive(BURA) preserves and enables easy and open access to all
types of digital content. It showcases Brunel's research outputs.
Research contained within BURA is open access, although some publications may be subject
to publisher imposed embargoes. All awarded PhD theses are also archived on BURA.
Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/22090| Title: | A Novel pseudo viewpoint based Holoscopic 3D Micro-gesture Recognition |
| Authors: | Liu, Y Yang, S Meng, H Swash, MR Shan, S |
| Keywords: | holoscopic 3D imaging;pseudo view points;micro-gesture recognition |
| Issue Date: | 25-Oct-2020 |
| Publisher: | Association for Computing Machinery |
| Citation: | Liu, Y. et al. (2020) 'A Novel pseudo viewpoint based Holoscopic 3D Micro-gesture Recognition', ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal Interaction, Virtual Event Netherlands, 25-29 October, pp. 77 - 81. doi: 10.1145/3395035.3425249. |
| Abstract: | Recently, video-based micro-gesture recognition with the data captured by holoscopic 3D (H3D) sensors is getting more and more attention, mainly because of their particular advantages to use a single aperture camera to embed the 3D information in 2D images. However, it is not easy to use the embedded 3D information in an efficient manner due to the special imaging principles of H3D sensors. In this paper, an efficient Pseudo View Points (PVP) based method is proposed to introduce the embedded 3D information in H3D images into a new micro-gesture recognition framework. Specifically, we obtain several pseudo view points based frames by composing all the pixels at the same position in each elemental image(EI) in the original H3D frames. This is a very efficient and robust step, and could mimic the real view points so as to represent the 3D information in the frames. Then, a new recognition framework based on 3D DenseNet and Bi-GRU networks is proposed to learn the dynamic patterns of different micro-gestures based on the representation of the pseudo view points. Finally, we perform a thorough comparison of the related benchmark, which demonstrates the effectiveness of our method and also reports a new state of the art performance. |
| URI: | https://bura.brunel.ac.uk/handle/2438/22090 |
| DOI: | https://doi.org/10.1145/3395035.3425249 |
| ISBN: | 978-1-4503-8002-7 |
| Other Identifiers: | ORCiD: Hongying Meng https://orcid.org/0000-0002-8836-1382 ORCiD: Mohammad Rafiq Swash https://orcid.org/0000-0003-4242-7478 |
| Appears in Collections: | Brunel Design School Research Papers Dept of Electronic and Electrical Engineering Research Papers |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| FullText.pdf | Copyright © 2020 Association for Computing Machinery (see: https://www.acm.org/publications/policies/copyright-policy).This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record, Liu, Y. et al. (2020) 'A Novel pseudo viewpoint based Holoscopic 3D Micro-gesture Recognition', was published in In Companion Publication of the 2020 International Conference on Multimodal Interaction (ICMI '20 Companion). Association for Computing Machinery, New York, NY, USA, 77–81. https://doi.org/10.1145/3395035.3425249. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. | 1.63 MB | Adobe PDF | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.