Mobile manipulator control based on voice and visual signal

In this paper, two kinds of methods are used to control the mobile manipulator in terms of voice signal control approach and visual signal control approach. In voice signal control approach, the mobile manipulator can perform some actions according to the operator's speaking voice input through...

Full description

Saved in:
Bibliographic Details
Published inProceedings of the 32nd Chinese Control Conference pp. 4286 - 4291
Main Authors Kong Kam Fong, Li Yangmin
Format Conference Proceeding
LanguageEnglish
Published TCCT, CAA 01.07.2013
Subjects
Control
Joints
Kinematics
Manipulators
Mobile manipulator
Mobile robots
Robot sensing systems
Speech recognition
Visual signal
Voice signal
Online AccessGet full text

Cover

More Information
Summary:In this paper, two kinds of methods are used to control the mobile manipulator in terms of voice signal control approach and visual signal control approach. In voice signal control approach, the mobile manipulator can perform some actions according to the operator's speaking voice input through a microphone. For example, the robot can be commanded to go forward or backward in specified distance, turn left or right with specified angle, even can follow up "8" shape trajectory and catch a ball. In visual approach, the mobile robot can accomplish some actions according to the operator's gestures of two hands using Kinect sensor information. It gets the depth image of two hands in spatial coordinates and calculates the relative distance of them to take some actions by an onboard computer. An embedded single board computer is installed in mobile robot Pioneer2 DX for enhancing remote control and running program's ability.
ISSN:2161-2927