期刊論文
| 學年 | 114 |
|---|---|
| 學期 | 1 |
| 出版（發表）日期 | 2025-08-21 |
| 作品名稱 | Teaching Authentic Sign Language Through Multiple Representation Learning |
| 作品名稱（其他語言） | |
| 著者 | Q. Zhang; C. Y. Chang; C. Chuang; W. H. Liao; D. S. Roy |
| 單位 | |
| 出版者 | |
| 著錄名稱、卷期、頁數 | Multimedia Systems 31(327), p.1-18 |
| 摘要 | Sign language recognition plays a crucial role in bridging the communication gap between hearing-impaired and hearing individuals. However, traditional teaching systems often rely on expert systems or rule-based approaches for recognition, which struggle to meet the needs of learners at different levels. This paper introduces a novel Sign Language Teaching and Scoring System (SLTS) based on multi-model collaboration, aimed at improving learning efficiency and accuracy for diverse learners. The proposed SLTS employs teaching strategies suitable for both beginners and advanced learners, offering a comprehensive solution for sign language education through multiple representation learning. Specifically, for beginners, it uses an improved Siamese Long Short-Term Memory (LSTM) module to facilitate passive learning. This approach analyzes individual gestures by comparing them to conventional sign language, allowing novices to focus on mimicking movements and establishing a solid foundation in sign language norms. For advanced learners, the proposed SLTS implements an active learning approach using an enhanced Convolutional LSTM (ConvLSTM) module to handle more complex sign language vocabulary. The system captures both spatial and temporal features of gestures, enhancing learners' fluency and expressiveness in real communication scenarios. The experimental results in real-world environments demonstrate that the proposed SLTS significantly outperforms existing methods in recognition accuracy, proving its effectiveness and advanced nature. |
| 關鍵字 | |
| 語言 | en |
| ISSN | 1432-1882 |
| 期刊性質 | 國內 |
| 收錄於 | SCI |
| 產學合作 | |
| 通訊作者 | |
| 審稿制度 | 否 |
| 國別 | USA |
| 公開徵稿 | |
| 出版型式 | ,電子版 |
| 相關連結 |
機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/128635 ) |