WiMi Hologram Cloud Inc (WIMI)

[StockpickerCAPC]

WIMI.US develops a virtual reality multi-channel interactive system to build a harmonious and natural virtual reality human-machine environment.

Source
https://cj.sina.com.cn/articles/view/7651844612/1c815e20402001fybc?from=finance

March 3, 2023

Virtual reality is a computer system that can create and experience a virtual world, which is generated by a computer and acts on the user through sight, hearing, touch, smell, etc., to create an immersive feeling for the user. Among them, immersion, interaction and imagination are the three basic characteristics of virtual reality system. Human-computer interaction is one of the core technologies of virtual reality. The goal of human-computer interaction is to transform the user's behavior and state (input) into a representation that the computer can understand and operate in an appropriate way, and to convert the behavior of the computer into a representation that the computer can understand and operate. And status (output) is transformed into an expression that people can understand and operate, and at the same time give feedback to people through the interface. On the one hand, virtual reality needs to perceive the input information of multiple sensory channels such as user's muscle movement, posture, language and body tracking; on the other hand, it can simulate the realistic real world from multiple sensory channels such as human vision, hearing, touch and smell. feeling, thus establishing a natural and harmonious human-machine environment.

The new generation of interactive mode is characterized by multi-channel and multimedia, which will make human-computer interaction more intelligent. The multi-channel here refers to the use of various human sensory channels and action channels, such as voice, posture, movement, eye movement, lip movement, expression and consciousness. This interactive mode realizes the parallel and imprecise way to interact with the computer, thus greatly improving the naturalness and efficiency of human-computer interaction.

WIMI (NASDAQ: WIMI) has developed a virtual reality multi-channel interactive system. A multi-channel interactive system refers to a collaborative approach that combines two or more input channels (such as voice, video, touch, and gesture) in one system, making full use of different human sensory channels to make the interaction more natural and effective. In a multi-channel user interaction system, users can use natural interaction methods such as voice, gestures, eyes, expressions, lip movements, etc. to work collaboratively with the computer system. Both humans and machines are active participants in information exchange. There are various methods such as serial/parallel, complementary/independent, etc. Human-computer interaction is closer to the form of human-human interaction, which greatly improves the naturalness and efficiency of interaction. This will be the future of virtual reality human-computer interaction mainstream form.

The use of multi-channel interaction in virtual reality has obvious advantages. It can not only reduce the degree of coupling and reduce the cognitive load of users, but also significantly improve the recognition rate of input, provide users with flexible input methods, and improve interaction efficiency.

WIMI holographic virtual reality multi-channel system enables users to use different channels to interact at the same time. These interactions are usually based on voice, gesture or tactile input. In addition, facial expression recognition or lip reading are also used for multi-channel input. The multi-channel interface can combine the advantages of individual channels, or switch channels according to the environmental context. Since the multi-channel technology combines the input streams of multiple channels, the use of multi-channel interactive technology in virtual reality can greatly improve the performance of system control.
There are two main methods of multi-channel fusion, feature fusion and semantic fusion. Feature fusion is based on the fusion of the original input data at the signal level. This method is suitable for closely coupled channels; semantic fusion is to map the input data For the process of semantic interpretation, the input information flow is obtained from the input channel, and a unified data representation is constructed through preliminary preprocessing.

Human-computer interaction is the interactive relationship between the system and the user. It uses the dialogue language between the human and the computer to complete the information exchange process between the human and the computer in a certain interactive way. In human-computer interaction, the natural interaction behavior of human beings and the state change of physical space are multi-channel patterns.

For human-computer interaction in virtual reality scenes, whether it is speech recognition, emotion recognition or human-computer dialogue, deep learning will make the established system more intelligent. WIMI holographic multi-channel user interaction system can enhance the ability of machine models to identify, classify and analyze confusing behaviors. It leads the virtual reality human-computer interaction mode to gradually develop in the direction of intelligence, humanization and scene, and build a harmonious and natural environment. virtual reality man-machine environment.