期刊論文
| 學年 | 107 |
|---|---|
| 學期 | 1 |
| 出版（發表）日期 | 2018-11-15 |
| 作品名稱 | Visual Object Recognition and Pose Estimation Based on a Deep Semantic Segmentation Network |
| 作品名稱（其他語言） | |
| 著者 | C.M. Lin; C.Y. Tsai; Y.-C. Lai; S.A. Li; C.C. Wong |
| 單位 | |
| 出版者 | |
| 著錄名稱、卷期、頁數 | IEEE Sensors Journal 18(22), p.9370-9381 |
| 摘要 | In recent years, deep learning-based object recognition algorithms become emerging in robotic vision applications. This paper addresses the design of a novel deep learning-based visual object recognition and pose estimation system for a robot manipulator to handle random object picking tasks. The proposed visual control system consists of a visual perception module, an object pose estimation module, a data argumentation module, and a robot manipulator controller. The visual perception module combines deep convolution neural networks (CNNs) and a fully connected conditional random field layer to realize an image semantic segmentation function, which can provide stable and accurate object classification results in cluttered environments. The object pose estimation module implements a model-based pose estimation method to estimate the 3D pose of the target for picking control. In addition, the proposed data argumentation module automatically generates training data for training the deep CNN. Experimental results show that the proposed scene segmentation method used in the data argumentation module reaches a high accuracy rate of 97.10% on average, which is higher than other state-of-the-art segment methods. Moreover, with the proposed data argumentation module, the visual perception module reaches an accuracy rate over than 80% and 72% in the case of detecting and recognizing one object and three objects, respectively. In addition, the proposed model-based pose estimation method provides accurate 3D pose estimation results. The average translation and rotation errors in the three axes are all smaller than 0.52 cm and 3.95 degrees, respectively. These advantages make the proposed visual control system suitable for applications of random object picking and manipulation. |
| 關鍵字 | Pose estimation;Three-dimensional displays;Robots;Visual perception;Image segmentation;Object recognition;Semantics |
| 語言 | en_US |
| ISSN | 1558-1748 |
| 期刊性質 | 國外 |
| 收錄於 | SCI |
| 產學合作 | |
| 通訊作者 | |
| 審稿制度 | 否 |
| 國別 | TWN |
| 公開徵稿 | |
| 出版型式 | ,電子版,紙本 |
| 相關連結 |
機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/118486 ) |