Detecting deictic gestures for control of mobile robots

For industrial environments esp. under conditions of "Industry 4.0" it is necessary to have a mobile and hands-free controlled interaction solution. Within this project a mobile robot system (for picking, lifting and transporting of small boxes) in logistic domains was created. It consists...

Full description

Bibliographic Details
Published in:Advances in human factors in robots and unmanned systems, (2017), Seite 87-96
Main Author: Nowack, Tobias (Author)
Other Involved Persons: Lutherdt, Stefan ; Jehring, Stefan ; Xiong, Yue ; Wenzel, Sabine ; Kurtz, Peter
Format: electronic Article
Language:English
Published: 2017
DOI:10.1007/978-3-319-41959-6_8
Local Subject Headings:
QR Code: Show QR Code
Description:
  • For industrial environments esp. under conditions of "Industry 4.0" it is necessary to have a mobile and hands-free controlled interaction solution. Within this project a mobile robot system (for picking, lifting and transporting of small boxes) in logistic domains was created. It consists of a gesture detection and recognition system based on Microsoft Kinectâ„¢ and gesture detection algorithms. For implementing these algorithms several studies about the intuitive use, executing and understanding of mid-air-gestures were processed. The base of detection was to define, if a gesture is executed dynamically or statically and to derive a mathematical model for these different kinds of gestures. Fitting parameters to describe several gesture phases could be found and will be used for their robust recognition. A first prototype with an implementation of this technology also is shown in this paper.