Implementation of Smart-Space Middleware Supporting Natural User Interface/Natural User Experience

A smart space unites the physical world and digital world, and changes the lifestyles of its users. Enhanced sensors and digital devices interact with users to provide the best service. However, different types of devices and communication are essential for users to configure a smart space because they want the most natural interface. Therefore, a context-aware middleware architecture supporting NUL/NUX (Natural User Interface/Natural User eXperience) will be proposed in this paper. This middleware can control all of the general-purpose devices through an XML-based HIML (Human Interaction Markup Language), which is designed in this paper. The appliance control scenario is configured through EEG (electroencephalogram), which is one of the NUL models, in order to effectively serve a smart space using the middleware and HIML.