Automatic control for a miniature manipulator based on 3D vision servo of soft objects

• Published in: Mechatronics (Oxford) Vol. 22; no. 4; pp. 468 - 480
• Main Authors: Jaradat, Mohammad Abdel Kareem, Al-Fandi, Mohamed, Nasir, Mohammad Tariq
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.06.2012
• Subjects: Contour based recognition; Control systems; Depth of focus; Feedback; Manipulators; Miniature manipulator; Nanostructure; Occlusion; Recognition; Robot arms; Scanning electron microscopy; Vision control; Visual; Occlusion; Miniature manipulator; Contour based recognition; Vision control; Depth of focus
• ISSN: 0957-4158; 1873-4006
• DOI: 10.1016/j.mechatronics.2011.10.004

This paper presents a new strategy for automating three-dimensional miniaturized manipulators using a visual feedback. This automation scheme can be used to handle the challenges associated with manipulation of minute soft components such as biological entities. The developed vision control system combines a depth and planar motion control using a single camera and an auto focus algorithm. This visual process was conducted by applying image segmentation and probe recognition along with depth alignment. To demonstrate the feasibility, reliability and robustness of this newly proposed strategy, extensive computer simulations were performed on images of a Zyvex® nanomanipulator obtained using a Scanning Electron Microscope (SEM). Also, a prototype manipulator with a visual feedback and an automatic controller was constructed and tested using soft elements. The results showed good accuracy and robustness of the end-effector recognition, positioning and aligning without occlusion difficulties.