Design and research of somatosensory wristband based on people with language barriers

Because of their physical defects, people with language barriers are difficult to communicate smoothly with ordinary people who are not familiar with sign language. Therefore, there is an urgent need for a tool that can realize the conversion between the sign language and normal language, so as to meet their needs of exchanging information with the outside world and freely expressing their emotions. Considering the plight faced by people with language barriers, this paper, based on the gesture recognition technology, proposes a set of solutions, which is the comprehensive application of the somatosensory wristband and mobile terminal APP.


Introduction
On the one hand, the needs of the audience need to be met urgently.According to the report of the World Health Organization, about 15% of the world's total population has some form of disability.Among them, 40.55% of the disabled belong to the category of language barrier.Due to physical barriers, they can only communicate in a limited and single way, such as sign language or written language supplemented by action and expression.However, physical illness indirectly increases their mental stress, making them unable to express their wishes and obtain information smoothly.To a certain extent, limiting their way to relax.The vicious circle of the past has led to the increasing vulnerability of language barriers.
On the other hand, there is a lack of emotion at the design level.In recent years, the attention of the society to the disabled has been increasing day by day.As a result, a large number of products have been created and put into use.However, most of the current designs for the disabled focus on the field of tools for the disabled and visually impaired.There are few products for people with language barriers, and they do not pay enough attention to the emotional care of the target group.

Experimental objects
Language barrier refers to the language barrier caused by various reasons.After one year of treatment or more than two years of illness, people can not carry out normal speech communication activities, thus affecting their normal life and social life.For the congenital deaf or the unfortunate deaf before they learn the sound language, they can not imitate the sound they hear, and often can only speak sign language as the first language.The other part of the people with less language barrier, although they can use part of the voiced language to communicate, because of physiological or psychological factors, they can not communicate smoothly with others.There are also some people who have no hearing impairment, but whose vocal organs are impaired.Such as those caused by cleft palate and facial surgery.This paper will take the group of language barriers as the starting point, and put forward the design of assistant programs to meet their physiological and psychological needs.

Design position
The APP designed in this subject is mainly used in combination with the somatosensory bracelets.They together constitute a complete system of products for people with language disabilities, and they complement each other.

Wristband appearance design
The key of product design is to give users the first impression of the emotional effect.For users, the aesthetic appearance of the somatosensory hand ring, clean color and comfortable materials directly affect their user experience.
3.1.1.Style.Cluster analysis was used to screen the words collected about the emotions of somatosensory hand rings, and determine the direction of emotional design of somatosensory hand rings for language impaired people under the guidance of several vocabulary.
Fifteen respondents were invited to classify 15 emotional words.The vocabulary that they think is the same in nature is classified into four categories.The number of words in each category is not limited, but it requires that all 15 words should be categorized without repetition or omission.The classified data are imported into SPSS software for multi-dimensional scale analysis, and the final coordinate data are obtained.
Cluster analysis was carried out with SPSS software.Fifteen words were divided into four dimensions.The results are shown in the table 1.
Choose the representative vocabulary closest to zero, and get four groups: soft, durable, unified; safe, natural, fluent; light, comfortable, friendly; modern, simple, delicate, coordinated, smooth.Among the four groups, the words with the smallest distance are: V4 soft, V7 safe, V14 light, V15 modern.
Based on the above analysis, it is concluded that the integration of soft, safe, lightweight and modern elements in the design of styling elements is more conducive to the acceptance of the product by language barriers.Table 1.Clustering results obtained by cluster analysis.3.1.2.Color.On the one hand, color needs to meet the needs of the crowd.People's different psychological needs for products are embodied in the differences in color, weight, softness and hardness.According to the psychological needs of different characteristic groups, the emotional design of color elements of somatosensory hand rings should also be adjusted appropriately.On the other hand, color needs to consider the psychological characteristics of the crowd.Somatosensory hand rings, as an auxiliary tool for language impaired people, should fully take into account the psychological characteristics of the people who are sensitive and do not want to cause too much attention.Choose a neutral color with low profile and no publicity to give people a stable, elegant and implicit color mood and affinity.Therefore, the design of somatosensory hand ring uses concise black and white to meet the physiological and psychological pursuit of language barriers.
Figure 1 Appearance design effect drawing of Bracelet.

Appearance result.
The design of the somatosensory hand ring is shown in Figure 1.The front of the bracelet is a color touch screen, which facilitates user's functional interaction.It has two buttons on the side for switching machine and volume adjustment.Sensors on the back are used to detect gestures, heart rate fluctuations and so on.Then it can realize the functions of sign language translation, guitar playing, daily walking, sleep time, exercise time and so on.

APP Interface Flow.
The design of APP is called "Sound movement", that is, "let the sound move up".By using the homonym with "vivid", I hope that the language barrier can break the psychological and physiological barriers as soon as possible and communicate vividly.Meanwhile, it also implies that voice language and gesture movements can be effectively connected through somatosensory hand rings and APP, so as to define the product target and service population.The main functions of "Sound movement" APP are divided into four modules, and its task flow chart is shown in figure2.
Figure 2 APP Task Flow Chart.

APP Interactive Design.
This design uses multi-panel layout, the classification is clearer.It is convenient for people with language barriers to quickly locate the required function of the plate location, reduce the jump of redundant pages, and avoid the language barriers involving too many irrelevant pages, resulting in reduced user viscidity.The overall interaction design is shown in Figure 3.The voice board is the core module of APP.This section mainly provides voice assistance for users, facilitating barrier-free communication between people with language barriers and ordinary people.Among them, the handwritten translation model is suitable for the two-way communication between the language barriers familiar with sign language and ordinary people.Language handicapped people wear bracelets on both hands, make sign language gestures and recognize the gestures with somatosensory hand rings, and broadcast the translated results to ordinary people through APP to achieve the purpose of communication.Transliteration model is suitable for two-way communication between hearing and speech impaired people and ordinary people.Ordinary people use APP to translate speech into text or to present text directly by hand to hearing and speech impaired people.Hearing and speech impaired people use APP to respond by hand or translate their sign language into voice broadcasting to achieve two-way communication.Substitute telephone is suitable for people with language disabilities to seek help in emergencies.The content can be transmitted to a third-party sign language translator by means of text or sign language video through APP, in order to achieve the purpose of fast transmission of information.At the same time, APP can adjust male and female voices, language types and so on through voice settings, which is more suitable for different users' preferences.
"Music Plate" is an important module of APP.This section mainly provides users with music experience.It can realize the air performance of guitar, make the language handicapped perform rehabilitation exercises in the process of playing and singing, and obtain good entertainment emotional experience.Among them, the song mode is suitable for beginners without foundation.Users can choose songs to play and sing from the music library according to their personal preferences.Wear a bracelet to make a sound with a single wave.The accompaniment is played from APP to the rhythm of sweeping the strings with the wave.Freedom mode is suitable for users with guitar foundation or preference for freedom and free personality.This mode has many chords for users to play freely.When using the left hand to press the chord screen chord button, the right hand to wield the sweep chord can truly simulate the guitar sound.While enriching the user's entertainment needs, it can also help users to carry out oral rehabilitation training by singing loudly.At present, APP has been built in several popular inspirational songs, such as Chengdu, the brightest star in the night sky, and The Tracker.Help to alleviate psychological problems such as overpressure, loneliness and inferiority complex, anxiety and fragility.
The fourth plate is the "my plate".This section is the user's personal center, which can change the information and software settings, including personal information, my goals, my equipment, third party access, feedback, use help and settings module.To facilitate users to use according to preference settings.

Conclusions
This paper focuses on the production of somatosensory hand rings and APP.The function of positioning supporting products is to help language barriers and normal people communicate with each other in terms of language and emotion.Based on user research to obtain the needs of language barriers, and combined with emotional design to lay the user experience, the design positioning of somatosensory hand ring and APP is carried out.And the conclusions drawn from the study are applied to the practical development and design, and finally a set of auxiliary supplies for language barriers with hardware and software is completed.This product is of great practical significance to improve the communication barriers of language barriers.It should be a sponsor to help language barriers build self-confidence, gain respect and praise.

Figure 3 "
Figure 3 "Sound movement" APP Color Matching Proportion.The first plate is the "state plate".The board monitors the users' physical health data in real time, including daily treadmill, heart rate fluctuation, sleep time, exercise time, etc.And provide corresponding health advice for users according to the data.The voice board is the core module of APP.This section mainly provides voice assistance for users, facilitating barrier-free communication between people with language barriers and ordinary people.Among them, the handwritten translation model is suitable for the two-way communication between the language barriers familiar with sign language and ordinary people.Language handicapped people wear bracelets on both hands, make sign language gestures and recognize the gestures with somatosensory hand rings, and broadcast the translated results to ordinary people through APP to achieve the purpose of communication.Transliteration model is suitable for two-way communication between hearing and speech impaired people and ordinary people.Ordinary people use APP to translate speech into text or to present text directly by hand to hearing and speech impaired people.Hearing and speech impaired people use APP to respond by hand or translate their sign language into voice broadcasting to achieve two-way communication.Substitute telephone is suitable for people with language disabilities to seek help in emergencies.The content can be transmitted to a third-party sign language translator by means of text or sign language video through APP, in order to achieve the purpose of fast transmission of information.At the same time, APP can adjust male and female voices, language types and so on through voice settings, which is more suitable for different users' preferences."MusicPlate" is an important module of APP.This section mainly provides users with music experience.It can realize the air performance of guitar, make the language handicapped perform rehabilitation exercises in the process of playing and singing, and obtain good entertainment emotional experience.Among them, the song mode is suitable for beginners without foundation.Users can choose songs to play and sing from the music library according to their personal preferences.Wear a bracelet to make a sound with a single wave.The accompaniment is played from APP to the rhythm of sweeping the strings with the wave.Freedom mode is suitable for users with guitar foundation or preference for freedom and free personality.This mode has many chords for users to play freely.When using the left hand to press the chord screen chord button, the right hand to wield the sweep chord can