Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations
學年 109
學期 1
出版（發表）日期 2020-10-19
作品名稱 Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations
作品名稱（其他語言）
著者 Chien-Hsing Chou; Yu-Sheng Su; Che-Ju Hsu; Kong-Chang Lee; Ping-Hsuan Han
單位
出版者
著錄名稱、卷期、頁數 Symmetry 12(10), 1718
摘要 In this study, we designed a four-dimensional (4D) audiovisual entertainment system called Sense. This system comprises a scene recognition system and hardware modules that provide haptic sensations for users when they watch movies and animations at home. In the scene recognition system, we used Google Cloud Vision to detect common scene elements in a video, such as fire, explosions, wind, and rain, and further determine whether the scene depicts hot weather, rain, or snow. Additionally, for animated videos, we applied deep learning with a single shot multibox detector to detect whether the animated video contained scenes of fire-related objects. The hardware module was designed to provide six types of haptic sensations set as line-symmetry to provide a better user experience. After the system considers the results of object detection via the scene recognition system, the system generates corresponding haptic sensations. The system integrates deep learning, auditory signals, and haptic sensations to provide an enhanced viewing experience.
關鍵字 audiovisual entertainment system;deep learning;four-dimensional (4D);haptics;scene recognition;audiovisual entertainment system
語言 en
ISSN 2073-8994
期刊性質 國外
收錄於 SCI SSCI
產學合作
通訊作者
審稿制度 是
國別 TWN
公開徵稿
出版型式 ,電子版
相關連結

機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/120019 )

SDGS 良好健康和福祉,尊嚴就業與經濟發展