Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations | |
---|---|
學年 | 109 |
學期 | 1 |
出版(發表)日期 | 2020-10-19 |
作品名稱 | Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations |
作品名稱(其他語言) | |
著者 | Chien-Hsing Chou; Yu-Sheng Su; Che-Ju Hsu; Kong-Chang Lee; Ping-Hsuan Han |
單位 | |
出版者 | |
著錄名稱、卷期、頁數 | Symmetry 12(10), 1718 |
摘要 | In this study, we designed a four-dimensional (4D) audiovisual entertainment system called Sense. This system comprises a scene recognition system and hardware modules that provide haptic sensations for users when they watch movies and animations at home. In the scene recognition system, we used Google Cloud Vision to detect common scene elements in a video, such as fire, explosions, wind, and rain, and further determine whether the scene depicts hot weather, rain, or snow. Additionally, for animated videos, we applied deep learning with a single shot multibox detector to detect whether the animated video contained scenes of fire-related objects. The hardware module was designed to provide six types of haptic sensations set as line-symmetry to provide a better user experience. After the system considers the results of object detection via the scene recognition system, the system generates corresponding haptic sensations. The system integrates deep learning, auditory signals, and haptic sensations to provide an enhanced viewing experience. |
關鍵字 | audiovisual entertainment system;deep learning;four-dimensional (4D);haptics;scene recognition;audiovisual entertainment system |
語言 | en |
ISSN | 2073-8994 |
期刊性質 | 國外 |
收錄於 | SCI SSCI |
產學合作 | |
通訊作者 | |
審稿制度 | 是 |
國別 | TWN |
公開徵稿 | |
出版型式 | ,電子版 |
相關連結 |
機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/120019 ) |
SDGS | 良好健康和福祉,尊嚴就業與經濟發展 |