A Real-time Sign Language Recognition System for Hearing and Speaking Challengers
學年 102
學期 2
發表日期 2014-07-11
作品名稱 A Real-time Sign Language Recognition System for Hearing and Speaking Challengers
作品名稱（其他語言）
著者 Hsieh, Chieh-Fu; Chen, Li-Ming; Huang, Ku-Chen; Hsieh, Ching-Tang; Yih, Chi-Hsiao
作品所屬單位 淡江大學電機工程學系; 淡江大學體育事務處體
出版者 Taipei: Asia-Pacific Education & Research Association
會議名稱 International Research Conference on Information Technology and Computer Sciences 2014 (IRCITCS 2014)
會議地點 普吉島, 泰國
摘要 Sign language is the primary means of communication between deaf people and hearing/speaking challengers. There are many varieties of sign language in different challenger community, just like an ethnic community within society. Unfortunately, few people have knowledge of sign language in our daily life. In general, interpreters can help us to communicate with these challengers, but they only can be found in Government Agencies, Hospital, and etc. Moreover, it is expensive to employ interpreter on personal behalf and inconvenient when privacy is required. It is very important to develop a robust Human Machine Interface (HMI) system that can support challengers to enter our society. A novel sign language recognition system is proposed. This system is composed of three parts. First, initial coordinate locations of hands are obtained by using joint skeleton information of Kinect. Next, we extract features from joints of hands that have depth information and translate handshapes. Then we train Hidden Markov Model-based Threshold Model by three feature sets. Finally, we use Hidden Markov Model-based Threshold Model to segment and recognize sign language. Experimental results show, average recognition rate for signer-dependent and signer-independent are 95% and 92%, respectively. We also find that feature sets including handshape can achieve better recognition result.
關鍵字 Sign language;Kinect;Human Machine Interface (HMI);hidden Markov model (HMM)
語言 en
收錄於
會議性質 國際
校內研討會地點
研討會時間 20140711~20140713
通訊作者 Chieh-Fu Hsieh
國別 THA
公開徵稿 Y
出版型式 紙本
出處 Proceedings of International Research Conference on Information Technology and Computer Sciences, pp.24-31
相關連結

機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/98490 )

機構典藏連結