不同於傳統的故事書,只顯示文字和靜止圖像,我們提出了一套「互動式多媒體故事書展示系統」,允許用戶與系統互動,在許多方面。我們的目標是能夠讓系統被普遍的觀眾使用,以令人印象深刻的方式以教育或商業為目的來展示系統。我們的系統是以電腦視覺為基礎,旨在支持三大功能:(一)頁碼識別;(二)紅外互動;及(c)虛擬鍵盤。系統設計可分為硬件配置和軟體流程兩部分。在硬件配置方面,我們的系統採用一台投影機,兩個數位攝影機,一個紅外攝影機,一個互動平台(即故事書),和一台個人電腦。從技術上講,我們的軟體軟件的設計是基於有限狀態機的實現使用計算機視覺技術的組合,C / C ++程式設計及OpenCV函式庫,從而在相對較低的成本和接近即時的互動系統。我們的系統已成功地在大型展覽,有超過一千個用戶交互和經驗,這清楚地表明了我們的系統在眾多應用中的巨大潛力。
Different from traditional storybooks that show texts and still pictures only, we present an Interactive Multimedia Storybook Demonstration System that allows the user to interact with the system in many aspects. The objective is to generate impressive demonstration to general audience for educational or commercial purpose. Our system is vision-based and designed to support the three major functionalities: (a) page number recognition; (b) infrared interaction; and (c) virtual keyboard. System design can be described in two parts, namely hardware configuration and software design. In the hardware configuration, our system incorporates a projector, two digital webcams, an infrared camera, an interactive platform (i.e., the storybook), and a personal computer. Technically, the software design is based on finite-state machines with a combination of computer vision techniques that are implemented using C/C++ programming and the OpenCV library, resulting in a relatively low-cost and near real-time interactive system. Our system has been successfully demonstrated in a large exhibition with over a thousand of user interaction and experience, which clearly shows the great potential of our system in numerous applications.