Implementation of Lambda Architecture: A Restaurant Recommender System over Apache Mesos | |
---|---|
學年 | 105 |
學期 | 2 |
發表日期 | 2017-03-27 |
作品名稱 | Implementation of Lambda Architecture: A Restaurant Recommender System over Apache Mesos |
作品名稱(其他語言) | |
著者 | Chung-Ho Lee; Chi-Yi Lin |
作品所屬單位 | |
出版者 | |
會議名稱 | The 31st IEEE International Conference on Advanced Information Networking and Applications (AINA-2017) |
會議地點 | Taipei, Taiwan |
摘要 | With the rapid development of web, mobile apps and IoT devices, a huge volume of data are created every day. In fact, these data are not only large, but also generated quickly and with a variety of different formats. Many companies are forced to face the problem of processing these large data in near real-time. Within different application domains, some data are required to be processed in real-time, while the others can use offline batch processing. In this research, we will follow the Lambda Architecture to design and implement a restaurant recommender system by using several open-source software. We will use Apache Mesos to manage the cluster automatically instead of manually setting up the cluster, which can allocate cluster resources dynamically and scale up or down easily. Deploying Lambda architecture on Mesos has the advantage of resource sharing and fault tolerance. Since the Lambda Architecture is a generic data processing architecture, the system we built not only can serve as a recommender system, but also is extensible for various applications. |
關鍵字 | Lambda Architecture;Apache Spark;Apache Mesos;recommender system |
語言 | en |
收錄於 | |
會議性質 | 國際 |
校內研討會地點 | 台北校園 |
研討會時間 | 20170327~20170329 |
通訊作者 | Chi-Yi Lin |
國別 | TWN |
公開徵稿 | |
出版型式 | |
出處 | Proceedings of IEEE AINA 2017, p.979-985 |
相關連結 |
機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/110365 ) |