Design and Implementation of Rover Controller and Music Player Control using Sixth Sense Technology

In this paper, the design and development of input devices based on Sixth sense technology using dynamic air gestures are deliberated. Using sixth sense technology we can control number of applications and it connects the physical world to digital world. This paper eliminating the using of input keyboard and proposes the implementation of Rover controller and control the music player using dynamic air gestures. The entire design has been coded using MATLAB and Embedded C language and the result of the rover controller has been verified through Proteus Simulator. Keywords— Sixth sense technology, MATLAB, Embedded C, Proteus Simulator.


INTRODUCTION
Here we are imitating sixth sense technology by dynamic air gestures. There are two types of gestures, static gestures and dynamic gestures; the proposed method uses the concept of the dynamic air gestures by binary large object analysis and connected component property. The main objective of this paper is to implement Human machine communication for digital and computing systems without involving the hardware. Image processing technique is an important basis for the implementation of this technology. The applications of this technology include the virtual painting, virtual keyboard, Virtual keypad for calling function, music player and Rover controller applications. Here we are concentrating on two major applications such as music player and Rover controller.

II. LITERATURE SURVEY
In [1], authors explain the concept of sixth sense is a wearable gesture interface that enhances the physical world around us with digital world. They determine the word "Wearable computer" is a sixth sense technology and it consists of number of components such as phone, projector, Marker, camera, and a mirror to control the number of applications. Authors executed the sixth sense technology as neck warn projector with a webcam. Earlier the word sixth sense knowledge there is no direct connection between human to digital world. Now sixth sense technology is filling the gap between the physical to digital world. Using static air gestures and dynamic air gestures, we are controlling the many applications such as Viewing map, Taking picture, Drawing applications, Making calls, Flight applications, Checking the mail, Check the time.
In [2], the people are wondering "what is sixth sense technology", the answer is sixth sense technology is a wearable signal interface method and it is connect to something which gives greater than that what we are expending in physical sense. The prototype of sixth sense is developed using mirror and a camera, it makes the system as user approachable. Webcam is used to capture the input markers tied at the human hand and it recognizes the color to select the appropriate keywords in fundamental keyboard. They can collect the material on any place by using a webcam. This technology has number of applications such as Newspaper reading, Google mapping, Watch the time, Virtual cellphone for calling and messaging. Advantages of this technology are people can carry the system easily at wherever and less cost.
In [3], in this paper authors proposed the concept of how to eliminate the input hardware device like mouse using sixth sense technology. Use colored devices, motion sensors and they are able to operate same working procedure of mouse. Using the camera they are capturing the motion recognition of colored substances and detecting the RGB colored matrix to implement the hand tracking in real time. The further enhancement of this technique such as zoom in, zoom out functions will be implemented.
In [4], authors mainly focused on sixth sense technology for safety determination. To develop sixth sense authors used the components such as projector and a camera. Whenever the attacks found on the social media like internet, it"s going to detect the attacks. This paper is useful in military applications, and also helpful to find the originality of the products. They continued to add few more applications to this paper namely make a call, Flight updates, Motion capture, the map, the clock, Book evidence and drawing applications.
In [5], authors explain the concept of sixth sense by using projector attached with a webcam or camera, which acts as the PC and connected to many devices, here the information stored on the social media. The webcam identifies materials around a human being suddenly, with the projector covering the evidence on any surface, including the device itself or hand. The software of sixth sense technology is developed using the C++ and C# programming languages. The hardware components used to implement this technology are Camera, Microphone, projector, Mirror, Color components, mobile phone. The applications of this paper such as, Create a Zooming features, multimedia applications, Take a picture, Give the technology information to people, Develop the email information, product information details, book information details. An advantage of this technique is an Open source. The disadvantage is required high resolution camera.
In [6], this paper implements the sixth sense technology for education field. It overcomes the old technique that is instead of getting the information on notice board get the information digitally. Anybody can study the books that are available in the library by using this technology. We can check the quality of the books or products like ISI mark. Authors implemented the Sixth sense by using the concept of Radio frequency identification and Computer vision. The advantages of this technology are Video newspaper, check the quality of the information and make a call.
In [7], authors explain the concept of air gestures for mobile devices. Our aim is that to combine the both touch screen and voice signal to control the smartphones and it makes the device is comfortable. This concept avoids the difficult switching mode by adopting the voice commands or air signals. Instead of using software, apply the method "software pipeline" to work efficiently. The other method is to control the mobile by using hand movements which is using the concept of image processing technique. Pre-processing and segmentation are the two processes can be takes place in image processing to extract the edges of hand. The main controlling applications are Navigation controller, menu switch controller, Manage the Memory alignment etc. The results have been verified by different users in different lighting conditions.
In [8], air gestures method is already implemented, thing is that authors looking for how to make a proper curser on to the screen to improve the performance of sixth sense technology. The steps are involved to implement this technology, yield the video from camera and transfer it as images then process the image or extract the color from the image. To extract the color, Morphological processing to eliminate noise, color thresholding, large object detection, Size detection and Centroid calculations are required. The applications are: zooming the images, close a window and reduction the window. The advantages are: speed, accuracy and good device usage.

III. DESIGN OF ROVER CONTROLLER
Sixth sense technology is a technique is used to establish a communication between the physical worlds and digital world. It makes us dynamic air gestures to control the applications like Rover controller, music player control, virtual mobile phone, etc. One of the major applications of sixth sense technology is to control the Rover controller using hand movements and it is shown in figure 1. The above block diagram consists of Input device, camera, PC and Robot or Rover controller.
Input device is the color device that is red color device is usually desirable, instead of this color we can use remaining two colors of RGB, Green or blue color is also used as input device.
A PC or system is the heart of designing the Rover controller. It is used to process the user inputs. Real time camera acts as an eye which connects to the digital world. It is used to capture the input color component and also for the morphological processing to eliminate unwanted signal. Rover controller or Robot is designed using the components such as PIC micro controller, Bluetooth device, DC motor and DC motor driver is as shown in figure 1.
PIC microcontroller (PIC18F452) is interfaced with DC motors, and Bluetooth device (HC 05) which controls or manages the entire Rover controller part. For an each DC motor there should be a driver, here L293D is the DC motor driver. L293D has the capability to drive the two dc motors simultaneously. DC motors are used to run the Rover in a specified direction like Forward, Backward, Left and Right directions. Bluetooth device is used to establish a wireless communication between the Rover controller and PC.

A. Design steps
Steps to design the Rover controller is as follow  Use one of the basic colors (preferred red color) as input device  Color component is the two dimensional signal and it is captured by using real time camera. In order to obtain a good result, use the camera with good resolution.  The captured signal (image) is sent to the PC for processing the signal. The processing includes color extraction and noise removal (morphological processing)  Find the centroid of the input colored device, depending upon the centroid value; it develops the communication between the human and system. But input colored device has to be at certain distance otherwise it unable to find the centroid value of input device.  After obtained the centroid value, a point will be created.
Using this point we are able to determine the directions of the Rover controller.  A Bluetooth which is installed in PC is used to send the direction signals to Rover controller which is received by another Bluetooth device (HC-05) is interfaced in the Rover controller.  Based on the received signal to the Rover, PIC microcontroller is going handle the DC motors to run the Rover controller in a specified direction with the help of DC motor driver.

B. Flowchart for Rover controller
The flowchart for music player control is as shown in figure 2. Music player control application implements the sixth sense technology by using input device, camera and PC. The working procedure of music player control is almost same as Rover controller but it has no hardware devices.
In figure 3, Input device is the color device that is red color device is usually desirable, instead of this color we can use remaining two colors of RGB i.e. Green or blue color is also used as input device. Input device is used to send a signal to PC or a Laptop. PC is used to process the user inputs. Camera acts as an eye which connects to the digital world. It is used to capture the input color component and also for the morphological processing to eliminate unwanted signal. Music player buttons can be controlled by using dynamic air gestures.

A. Design steps for music player control
Steps to design the music player control is as follow  Use one of the basic colors (preferred red color) as input device  Color component is the two dimensional signal and it is captured by using real time camera. In order to obtain a good result, use camera with good resolution.  The captured signal (image) is sent to the PC for processing the signal. The processing includes color extraction and noise removal (morphological processing)  Find the centroid of the input colored device, depending upon the centroid calculations; it develops the communication between the human and system. But input colored device has to be at certain distance otherwise it unable to find the centroid value of input device.  After obtained the centroid value, a point will be created. Using

B. Flowchart for Music player control
The flowchart for music player control is as shown in

A. Rover controller
The entire design has been coded in both MATLAB and embedded C language.
The figures 5 to 8 shows the snapshots of simulated results of the different cases like forward, back, left and right directions to control the Rover controller.
In figures 5 to 8, we can observe that the snapshot contains a window, with 4 images. First one shows the direction to be controlled is shown as black image. The second one shows that a red color device is an input device. Third one represents the difference image of the input device and fourth one represents the direction of the Rover controller to control its directions with the help of PIC microcontroller.

B. Music player
The control operations for music player are designed using MATLAB and the simulated results are shown in figure  9 to 12.
In figures 9 to 12, each figure has two window shows the music player window and music player buttons control window using dynamic air gestures. Depending upon the hand movement we can control the music player buttons without using input keyboard. Snapshots shows that simulated results of the different cases like Next, Pause, Play and Previous buttons to control the music player. By making the trial and error method we got the many of the obstacles after that simulation result is obtained for Rover controller and music player control by using dynamic air gestures. From the results obtained we can concluded that, using sixth sense technology is helps to overcome the using of input peripheral device like keyboard and there is continuous touch with human machine interaction. Future scope: Instead of developing the applications of sixth sense technology by using laptop, create a new Operating System for Tab.