CN203899120U

CN203899120U - Realistic remote-control experience game system

Info

Publication number: CN203899120U
Application number: CN201420229321.4U
Authority: CN
Inventors: 陈旭
Original assignee: Individual
Current assignee: Individual
Priority date: 2014-05-07
Filing date: 2014-05-07
Publication date: 2014-10-29
Anticipated expiration: 2024-05-07

Abstract

The utility model discloses a realistic remote-control experience game system. The realistic remote-control experience game system comprises a remote-control experience portion and a remotely-controlled portion, wherein the remotely-controlled portion comprises at least one remotely-controlled unit, and the remotely-controlled unit is a remotely-controlled machine or a remotely-controlled model in a scene, and the remotely-controlled unit comprises a panoramic camera-shooting module and a communication module; the experience portion comprises at least one remote-control experience unit, and the remote-control experience unit comprises a panoramic display module, a communication module and an input module; an instruction is received by the input module and sent to the remotely-controlled unit by the communication module in the remote-control experience unit, the instruction is received by the communication module to carry out activities in the remotely-controlled unit, the video information acquired by the panoramic camera-shooting module is sent to the remote-control experience unit by the communication module in the remotely-controlled unit, and the video information is received by the communication module and displayed by the panoramic display module in the remote-control experience unit.

Description

Realistic remote control experience game system

Technical Field

The utility model relates to the field of electronic technology, concretely relates to game system.

Background

At present, electronic games, simulation systems and the like are virtual worlds simulated by computers, have no entities and lack authenticity.

However, a game system composed of entities such as a remote control car, a model airplane and the like lacks the experience of real operation and control in a machine, even if a camera is arranged on the remote control car to obtain some images, the simple scheme still has a plurality of defects:

first, there is a lack of a full and realistic visual experience. Because the visual field of the camera is limited, the fixed camera at the front of a remote control car model and the like can only see the limited visual field at the front, so that the side, the back and the like in driving can not be observed, and the driving can not be really sensed because the visual field is completely different from the wide visual field range and the back vision and the like in actual driving; the camera with the holder is required to be controlled to rotate by a mouse, a controller and the like operated by hands, the process is complex and slow, and the method is greatly different from the method of free, rapid and comprehensive observation in actual driving;

secondly, the experiences of jolting, inclining, rolling and the like in actual driving are not available, and the sense of reality is lacked;

in addition, the remote control model is controlled by a remote controller, a keyboard, a mouse and the like at present, and the control is completely different from the control of a steering wheel, an accelerator pedal and the like for real driving, so that the sense of reality is lacked.

Disclosure of Invention

An object of the utility model is to provide a remote control of sense of reality experiences game system.

The utility model discloses a realize through following technical scheme:

a realistic remote experience gaming system,

the system comprises an experience part and a remote control part;

the remote control part comprises at least one remote control unit, the remote control unit is a remote control machine or a remote control model in a scene, the remote control unit comprises a panoramic camera module and a communication module, and the panoramic camera module is electrically connected with the communication module;

the experience section comprises at least one remote control experience unit, the remote control experience unit comprises: the panoramic display module is electrically connected with the communication module, and the input module is electrically connected with the communication module;

the remote control experience unit is external to and separate from the remotely controlled unit;

one remote controlled unit corresponds to one remote control experience unit, or one remote controlled unit corresponds to a plurality of remote control experience units, or a plurality of remote controlled units correspond to one remote control experience unit;

the remote control experience unit receives an input instruction of an operator through the input module and sends the instruction to the corresponding remote control unit which is remotely controlled by the remote control experience unit through the communication module of the remote control experience unit, the corresponding remote control unit receives the instruction through the communication module of the remote control unit to carry out activities, the remote control unit sends video information obtained by the panoramic camera module to the corresponding remote control experience unit through the communication module of the remote control unit, and the corresponding remote control experience unit receives the video information through the communication module of the remote control experience unit and displays the video information through the panoramic display module;

the panorama camera module with panorama display module corresponds each other, includes:

a) the panoramic camera module comprises a camera unit group which comprises a plurality of camera units for shooting the surroundings from different angles and/or positions; each of the plurality of camera units is a two-dimensional image camera unit and one camera unit comprises at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group; correspondingly, the panoramic display module comprises a plurality of display screens surrounding the operator, or the panoramic display module comprises one display screen surrounding the operator;

or,

b) the panoramic camera module comprises a camera unit group which comprises a plurality of camera units for shooting the surroundings from different angles and/or positions; each of the plurality of camera units is a two-dimensional image camera unit and one camera unit comprises at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group; the panoramic display module comprises a head-worn display module with head tracking; the head-wearing display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module by the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head-wearing display module with head tracking by the communication module for display, or the head-wearing display module with head tracking detects the head angle and/or head position information of the operator and selects and displays the part of videos corresponding to the head angle and/or head position of the operator in the videos shot by the panoramic camera module;

or,

c) the panoramic camera module comprises at least one wide-angle camera unit; correspondingly, the panoramic display module comprises a plurality of display screens surrounding the operator, or the panoramic display module comprises one display screen surrounding the operator;

or,

d) the panoramic camera module comprises at least one wide-angle camera unit; the panoramic display module comprises a head-worn display module with head tracking; the head-wearing display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module by the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head-wearing display module with head tracking by the communication module for display, or the head-wearing display module with head tracking detects the head angle and/or head position information of the operator and selects and displays the part of videos corresponding to the head angle and/or head position of the operator in the videos shot by the panoramic camera module;

or,

e) the panoramic camera module comprises at least one rotatable and/or movable camera unit and a driving motor connected with the rotatable and/or movable camera unit; correspondingly, the panoramic display module comprises a head-mounted display module with head tracking; the head-worn display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module through the communication module, the driving motor of the panoramic camera module, which is connected with the rotatable and/or movable camera unit, drives the rotatable and/or movable camera unit to a corresponding angle and/or position, and the shot video is transmitted to the head-worn display module of the panoramic display module through the communication module to be displayed.

In the realistic remote experience gaming system,

the display screen comprises a display screen or a projection screen;

and/or the presence of a gas in the gas,

the camera shooting unit group included in the panoramic camera shooting module is fixed or movable; the plurality of camera units included in the camera unit group are fixed or movable; the plurality of camera units included in the camera unit group are arranged to shoot outwards around the inside and/or the surface and/or the outside of the remote-controlled machine or the remote-controlled model of the remote-controlled unit, wherein the surrounding comprises the front and/or the back and/or the left and/or the right and/or the upper and/or the lower; each of the plurality of camera units is a two-dimensional image camera unit and one camera unit comprises at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group;

and/or the presence of a gas in the gas,

the panoramic display module comprises a plurality of display screens surrounding the operator or one display screen surrounding the operator, wherein the plurality of display screens surrounding the operator or the one display screen surrounding the operator surrounds the operator and comprises the front and/or the rear and/or the left and/or the right and/or the upper and/or the lower;

and/or the presence of a gas in the gas,

the panoramic camera module comprises at least one wide-angle camera unit, wherein the wide-angle camera unit is a two-dimensional image camera unit and one wide-angle camera unit comprises at least one wide-angle two-dimensional image camera, or the wide-angle camera unit is a stereoscopic image camera unit and one wide-angle camera unit comprises at least one wide-angle stereoscopic image camera group;

and/or the presence of a gas in the gas,

the panoramic camera module comprises at least one rotatable and/or movable camera unit, wherein the rotatable and/or movable camera unit is a two-dimensional image camera unit and one rotatable and/or movable camera unit comprises at least one two-dimensional image camera, or the rotatable and/or movable camera unit is a stereoscopic image camera unit and one rotatable and/or movable camera unit comprises at least one stereoscopic image camera group.

In the realistic remote experience gaming system,

the remote control experience unit comprises a remote control unit and a remote control unit, the remote control unit comprises an audio sensor, the audio sensor is electrically connected with a communication unit of the remote control unit, the corresponding remote control experience unit comprises an audio module, the audio module is electrically connected with a communication module of the remote control experience unit, the audio sensor of the remote control unit sends the obtained audio information to the corresponding remote control experience unit through the communication module of the remote control unit, the corresponding remote control experience unit receives the audio information through the communication module of the remote control experience unit and sends the audio information to the audio module of the remote control experience unit to output the audio information,

and/or the presence of a gas in the gas,

the remote control unit comprises an audio module, the audio module is electrically connected with the communication unit of the remote control unit, the corresponding remote control experience unit comprises an audio sensor, the audio sensor is electrically connected with the communication module of the remote control experience unit, the audio sensor of the remote control experience unit sends the obtained audio information to the corresponding remote control unit through the communication module of the remote control experience unit, the corresponding remote control unit receives the audio information through the communication module of the remote control unit and sends the audio information to the audio module of the remote control unit to output the audio information,

and/or the presence of a gas in the gas,

the remote control unit comprises a vibration sensor, the vibration sensor is electrically connected with a communication unit of the remote control unit, the corresponding remote control experience unit comprises a vibration module for accommodating or bearing the controller, the vibration module is electrically connected with the communication module of the remote control experience unit, the vibration module accommodates or bears the controller, the vibration sensor sends the obtained vibration information of the remote control unit to the corresponding remote control experience unit through the communication module of the remote control unit, the corresponding remote control experience unit receives the vibration information of the remote control unit through the communication module of the remote control experience unit and sends the vibration information to the vibration module to generate corresponding vibration,

and/or the presence of a gas in the gas,

the remote control unit comprises a gesture sensor, the gesture sensor is electrically connected with a communication unit of the remote control unit, the corresponding remote control experience unit comprises a gesture simulation module which contains or bears the operator, the panoramic display module and the input module, the gesture module is electrically connected with the communication module of the remote control experience unit, the gesture sensor sends the obtained gesture information of the remote control unit to the corresponding remote control experience unit through the communication module of the remote control unit, and the corresponding remote control experience unit receives the gesture information of the remote control unit through the communication module of the remote control experience unit and sends the gesture information to the gesture simulation module to simulate a corresponding gesture.

Further, in the above-mentioned case,

in the realistic remote experience gaming system,

the communication module of the remotely controlled unit is a wireless network communication module and the corresponding communication module of the remote control experience unit is a network communication module;

and/or the presence of a gas in the gas,

the remotely controlled unit includes: a vehicle remote control model on the ground, and/or a tank remote control model on the ground, and/or an aircraft remote control model in the air, and/or a ship remote control model on the water surface or under the water, and/or a robot model on the ground, and/or a robot model in the air, and/or a robot model on the water surface or under the water;

and/or the presence of a gas in the gas,

the input module of the remote control experience unit comprises a keyboard and/or a mouse and/or a game operating rod and/or a touch screen and/or buttons;

and/or the presence of a gas in the gas,

when the remote control model is a vehicle remote control model on the ground, the input module comprises a steering wheel and/or an accelerator pedal and/or a brake pedal and/or a gear lever;

and/or the presence of a gas in the gas,

when the remote control model is a tank remote control model on the ground, the input module comprises a steering wheel and/or a joystick and/or an accelerator pedal and/or a brake pedal and/or a gear lever;

and/or the presence of a gas in the gas,

when the remote control model is an aerial aircraft remote control model, the input module comprises a steering column and/or a pedal and/or an accelerator operating rod;

and/or the presence of a gas in the gas,

when the remote control model is a ship remote control model on the water surface or underwater, the input module comprises a rudder.

As can be seen from the technical proposal provided by the utility model,

the embodiment of the utility model provides a game system is experienced in remote control of sense of reality is with the game system who has information feedback such as video by the remote control unit for participating in the body.

The remote control unit adopts a panoramic camera module and a panoramic display module, so that an operator can obtain the same observation effect as real driving and can carry out large-view-range and omnibearing observation in game control;

the multiple screens around the operator or one screen around the operator provides a wide field of view around the operator, allowing the operator to view the surroundings personally, e.g., the operator is in the cab of the remote experience unit, and the multiple screens around the operator replace the window of the cab, so that the operator appears as if the avatar is driving in the remote controlled unit. Compared with a head-worn display module, the remote control module with the cab is more vivid, and the observation is faster and more convenient.

And the head that takes the head tracking wears the display module cooperation including the panorama camera module of the camera unit group, because no longer need the camera rotatory, consequently the real-time performance is better than general by the cooperation of activity camera and head wearing display module. The display module worn on the head has limited vision after all, and is more suitable for being observed around by the head when the remote control unit is a robot, according with the actual limited vision of human eyes and needing to rotate.

Furthermore, when the camera unit is a stereo camera unit, the user can obtain a stereo image experience closer to reality.

Further, the information feedback to the remote control model also includes sound, vibration, posture and the like, the operator avatar can not only listen to and say by the remote control unit, even can talk between the two remote control models, the operator not only experiences panoramic video and sound, but also experiences vibration, inclination, rotation and other posture changes in control and driving, for example, when the remote control model airplane flies in the air, dives, rolls and the like, the operator not only experiences the immersive panoramic video and sound, but also experiences corresponding inclination, rolls and other posture changes.

And for the control of the remote control model, a control mode corresponding to the real machine is adopted, for example, for a steering wheel and an accelerator pedal for a remote control car model, the user adopts the same control mode as real driving, so that the sense of reality is better.

Drawings

Fig. 1 is a schematic structural diagram of one of various embodiments of the present invention.

Fig. 2 is a schematic view of a panoramic camera module and a panoramic display module according to one of the various embodiments of the present invention, in which a plurality of camera units are arranged around the remote control unit, and correspond to a plurality of display screens around the operator.

Fig. 3 is a schematic view of a panoramic camera module and a panoramic display module according to one of the various embodiments of the present invention, wherein a plurality of camera units are arranged around the remote control unit, and a corresponding annular display screen is arranged around the operator.

Fig. 4 is a schematic view of a panoramic camera module and a panoramic display module according to one of the various embodiments of the present invention, in which a plurality of camera units are arranged around the front half part of the remote control unit, and are displayed by corresponding arc-ring display screens or multi-block display screens around the operator.

Fig. 5 is a schematic view of a panoramic display module according to one of the various embodiments of the present invention, which is displayed by a spherical display screen or displayed by six display screens surrounding an operator in a vertical, front, rear, left and right stereoscopic manner.

Fig. 6 shows a panoramic camera module according to one of the embodiments of the present invention, which employs a stereo camera unit.

Fig. 7 is the utility model discloses a panorama camera module and panorama display module schematic diagram of one of the multiple embodiments, in the embodiment panorama camera module adopt wide angle camera unit and panorama display module adopts the head to wear display module and head tracking module, or panorama camera module adopts a plurality of camera units around arranging and panorama display module adopts the head of taking the head tracking to wear display module by remote control unit inner front and back left and right sides annular.

Fig. 8 is the panoramic camera module and the panoramic display module of the present invention according to one of the various embodiments, wherein the panoramic camera module employs a wide-angle camera unit, and displays through an arc ring display screen around the operator or through a plurality of display screens around the operator.

Fig. 9 is the panoramic camera module and the panoramic display module of the present invention according to one of the various embodiments, wherein the panoramic camera module employs a rotatable and/or movable camera unit, and the display module is worn by the head for displaying.

Fig. 10 is a schematic view of a panoramic camera module and a panoramic display module according to one of the various embodiments of the present invention, wherein the display module is worn on the head with head tracking, and the rotatable and/or movable camera unit adopts a stereo camera group.

Fig. 11 is a schematic diagram of a remotely controlled unit with an attitude sensor and a remote experience unit for performing attitude simulation according to one of various embodiments of the present invention.

Fig. 12 is a diagram of a remote control experience unit and a remote control model in a scene in accordance with one of the various embodiments of the present invention.

Detailed Description

In order to make the technical solution of the present invention clearer, the following is described in detail with reference to the accompanying drawings and embodiments, and the specific embodiments are only used for explaining the present invention, but not for limiting the present invention.

A realistic remote experience game system.

The system comprises an experience part and a remote control part;

one of the remote controlled units corresponds to one of the remote control experience units, or one of the remote controlled units corresponds to a plurality of the remote control experience units, or a plurality of the remote controlled units correspond to one of the remote control experience units.

The remote control experience unit receives an instruction input by an operator through the input module and sends the instruction to the corresponding remote control unit remotely controlled by the remote control experience unit through the communication module of the remote control experience unit, the corresponding remote control unit receives the instruction through the communication module of the remote control unit to perform activity, the remote control unit sends video information obtained by the panoramic camera module to the corresponding remote control experience unit through the communication module of the remote control unit, and the corresponding remote control experience unit receives the video information through the communication module of the remote control experience unit and displays the video information through the panoramic display module, as shown in fig. 1.

Therefore, through remote control and information feedback, the user can control the remote controlled body to play games as if the user is personally on the remote controlled unit.

Specifically, a remotely controlled machine or a remotely controlled model such as a remotely controlled racing car, a remotely controlled model airplane, or the like.

Specifically, complex scenes may be arranged, for example, complex tracks may be arranged for racing cars, for example, obstacles, bridges, streets, etc. may be set for the scenes, or a region or space may be simply designated as the scene for the remote control model to move about.

Usually, one remote controlled unit corresponds to one remote control experience unit, that is, one remote control experience unit remotely controls one remote controlled unit and receives information fed back by the remote controlled unit to be fed back to an operator. Sometimes, one remote-controlled unit may correspond to a plurality of remote-control experience units, and a specific implementation, for example, a remote-control model, is controlled by two operators respectively at two remote-control experience units together, and is a remote-control shooting mode and a remote-control driving mode; a set of panoramic camera module and other sensors can be installed in one remote control model, the collected information is shared by two remote control experience units, and at the moment, two operators are equivalent to the same person with the avatar in the remote control model but have different control tasks; or, two sets of panoramic camera modules and other sensors can be installed in one remote control model, the collected information is respectively and correspondingly used by two remote control experience units, and at the moment, two operators are equivalent to two persons such as a driver and a gunman, which represent the remote control model. Sometimes, a plurality of the remote control experience units correspond to one remote control experience unit, that is, a plurality of remote control experience units are remotely controlled through one remote control experience unit, for example, a specific implementation is that the remote control experience unit can remotely control a plurality of remote control units in a time-sharing manner, one remote control unit receives feedback information of the remote control unit at a certain time, and the other remote control unit receives feedback information of the remote control unit at a certain time.

An electrical connection such as a bus connection is embodied.

The remote control experience unit is separated from the remote control unit, so that the communication module also necessarily adopts a wireless communication mode;

the specific communication module is implemented, for example, by using a wireless network communication module, or a wireless communication module. The obtained video, audio, motion information and the like are transmitted to the remote control experience unit by the remote control unit through the communication module, and the video, the audio and the like can be compressed in order to reduce the data volume. And the remote control experience unit can also transmit information instructions and the like to the remote control unit through the communication module. The communication module of the remotely controlled unit and the communication module of the remote control experience unit are not necessarily identical, and only need to communicate correspondingly, for example, both may employ a wireless network communication device, or the communication module of the remotely controlled unit may employ a wireless network communication device, and the communication module of the remote control experience unit employs a wired network communication device connected to the same network. In the communication module, one communication device may be shared, or a plurality of communication devices may be used to transmit different information, for example, transmission of video and commands may be shared, or one communication device may be shared, for example, a wireless network communication device, or one communication device may be used for video, another communication device may be used for commands, or the types of communication devices may be different.

Specifically, a user can input an instruction through the input module to control the remote-controlled unit to move, the input module can be a key, a touch screen, a game operating rod and the like, and a special device corresponding to the remote-control model can be adopted, such as a steering wheel, an accelerator pedal and the like corresponding to the remote-control model. Keys, touch screens, game levers and the like are standard devices which are easily available and can be easily integrated into the system to provide electrical signals, while special devices such as steering wheels, gas pedals and the like can be provided with angle sensors or stroke sensors and the like to convert the mechanical movement thereof into electrical signals if the required electrical signals cannot be directly provided. The specific implementation may further include an analog-to-digital conversion chip, which is easily implemented by an electronic technician and is not described in detail.

The remote control experience unit receives instructions of a user through the input module and sends the instructions to the remote control unit through the communication module to control the remote control unit to carry out activities, such as shooting, moving and the like.

Currently, there are various head-mounted display modules with head tracking, such as a glasses display with head tracking or a helmet display.

Both the display screen and the projector screen belong to the display screen, and a display device such as a liquid crystal display, a projector, and the like is specifically selected within a protection range. Generally, a display is suitable for displaying in a small space, and a projection screen is more suitable for displaying a larger image, and there are various application occasions.

The panoramic camera module corresponds to the panoramic display module, and various schemes can be provided.

In one embodiment, the method comprises the steps of,

the panoramic camera module comprises a camera unit group which comprises a plurality of camera units for shooting the surroundings from different angles and/or positions; each of the plurality of camera units is a two-dimensional image camera unit and one camera unit comprises at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group; correspondingly, the panoramic display module comprises a plurality of display screens surrounding the operator, or the panoramic display module comprises one display screen surrounding the operator.

Both display screens and projector screens belong to the display screen, i.e. both cases belong to the scope of protection of the present invention. Currently, there are arc display screens, flexible display screens, etc., while projector screens can also have multiple faces, rings, spheres, etc., multiple projectors can project a curtain around a user, etc., and the latter is not repeated.

The camera unit group comprises a plurality of camera units, the videos shot by the plurality of camera units are transmitted by the communication module of the remote control unit, in a specific implementation, the plurality of camera units can assemble the shot videos and transmit the collected videos by one communication device of the communication module, such as a wireless network communication device, or each camera unit is transmitted by a single corresponding communication device of the communication module, such as a wireless network communication device.

Two-dimensional images, which are the most common image format at present, are the opposite of stereoscopic images, which are also called three-dimensional images. The stereo images are shot by a stereo image camera group, the stereo image camera group usually adopts double cameras for shooting, a certain physical distance is reserved between the double cameras, and the left eye and the right eye respectively see pictures shot by the left camera and the right camera when a video shot by the double cameras is displayed and projected, so that the stereo impression is obtained. And will not be repeated later.

The image pickup unit group includes a plurality of image pickup units, and captures surroundings from different angles and/or positions, so that video information of a large range of viewing angles of the surroundings can be obtained. Specifically, each of the plurality of camera units is a two-dimensional image camera unit, and one camera unit includes at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, that is, the camera unit group obtains and outputs a two-dimensional image with a large surrounding viewing angle range; or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group, so that the camera unit group obtains and outputs a stereoscopic image with a large surrounding visual angle range.

The panoramic display module herein may, in particular,

firstly, a plurality of display screens surrounding a user are used for displaying, each display screen can be a plane or an arc and the like, generally, the visual angle range of one display screen is limited, but the plurality of display screens can achieve a large visual angle range when being displayed together in a surrounding mode, and can even completely display the surroundings, such as a plurality of display screens surrounding an operator front and back, left and right, and around the operator up and down, front and back, left and right;

the other is to use a display screen surrounding the operator, which is generally a flat display, and cannot surround the operator, and the display screen surrounding the operator is generally a curved screen or a multi-surface screen, such as an arc display screen or a ring display screen surrounding the operator, for example, a spherical display screen surrounding the operator or a six-surface display screen around the operator. At present, arc-shaped display screens exist, the technology of flexible display screens is gradually mature, and projector screens can be made into various shapes more easily.

In one specific implementation, as shown in fig. 2, the camera unit group includes a plurality of camera units, the plurality of camera units can be externally shot around the remote control model, videos shot by different camera units can completely cover the periphery, and the panoramic display module includes a plurality of display screens around the user, so that the scenes around the remote control model are completely reproduced around the user; fig. 2 shows a planar enclosure, i.e. a two-dimensional enclosure with respect to a three-dimensional enclosure, so that the scene around the operator is completely reproduced around the remote control model. Specifically, each display screen and the camera unit may or may not correspond to each other, for example, when the camera unit is a common camera and the general viewing angle range has 60 degrees, the surrounding 6 cameras can form 360-degree complete surrounding, and 6 display screens corresponding to the camera units one to one can be used for panoramic display; if the camera unit is a wide-angle camera, the visual angle range can reach 180 degrees, then 2 wide-angle cameras can form 360-degree complete enclosure, if still adopt 6 display screens, at this moment, because a wide-angle camera corresponds 3 display screens, then need carry out image segmentation to the video that wide-angle camera shot, the video image after the segmentation is displayed on the corresponding display screen. The video shot by the plurality of camera units can also be displayed by a display screen such as a ring or a sphere, as shown in fig. 3; if the annular or spherical display screen is actually formed by splicing a plurality of display screens, the annular or spherical display screen is realized as the plurality of display screens, and for a real annular or spherical display screen which only receives a single complete video, the video shot by a plurality of camera units needs to be subjected to image splicing and then displayed.

The camera shooting unit group included in the panoramic camera shooting module is fixed or movable; the plurality of camera units included in the camera unit group are fixed or movable; the plurality of camera units included in the camera unit group shoot outwards around the inside and/or the surface and/or the outside of the remote-controlled machine or the remote-controlled model of the remote-controlled unit, wherein the surrounding includes the front and/or the back and/or the left and/or the right and/or the above and/or the below. Correspondingly, the plurality of display screens surrounding the operator or the one display screen surrounding the operator, which are included in the panoramic display module, surround the operator, including the front and/or the rear and/or the left and/or the right and/or the upper and/or the lower.

Specifically, the imaging unit group may be fixed; or the camera unit group is movable, that is, a plurality of camera units included in the camera unit group are uniformly movable as a whole, for example, the camera unit group can be controlled to move uniformly or adjust an angle as a whole; the plurality of camera units included in the camera unit group are fixed or movable, which means that each of the plurality of camera units may be fixed or movable, for example, several camera units are fixed, and the other camera units are movable.

A plurality of display screens surrounding the operator, such as a plurality of display screens surrounding the operator front-back, left-right, and the operator; and a display screen surrounding the operator, such as an arc-shaped display screen surrounding the front, left, and right, such as a ring-shaped display screen surrounding the front, left, right, and rear of the operator, such as a spherical display screen surrounding the operator in front, rear, up, down, left, and right, or a hexahedral display screen; at present, arc-shaped display screens exist, the technology of flexible display screens is gradually mature, and projector screens can be made into various shapes more easily. The three-dimensional stereo is surrounded from front to back, up to down, left to right, so that the observation experience of front to back, up to down, left to right can be formed; for example, the display screen surrounds the operator in front, rear, left, and right directions, and the operator looks outward through the window in the cab.

Specifically, the plurality of camera units may completely surround or partially surround the remote control model, or the plurality of camera units may partially surround the remote control model, for example, only surround the remote control model at the most needed front and two sides, as shown in fig. 4, while the panoramic display module correspondingly includes a plurality of display screens partially surrounding the user, or the panoramic display module correspondingly includes a display screen partially surrounding the user, such as an arc display screen, a partial sphere display screen, a multi-surface display screen, or the like, or although the surrounding is complete, the video shot by the camera units is only displayed on the corresponding portion; each display screen and the camera shooting unit can be in one-to-one correspondence or not; if the content that the display screen can display is more than one camera shooting unit, for example, 1 arc-shaped display screen displays the videos shot by 3 surrounding camera shooting units, the videos shot by a plurality of camera shooting units can be spliced and displayed; if the content that can be displayed by the display screen is less than one camera unit, for example, 3 display screens display the video shot by 1 wide-angle camera, the video image can be divided and then displayed on the corresponding display screens; this is handled as such and will not be repeated later.

The plurality of camera units can surround the remote control model by a front-back and left-right plane or a front-back, left-right, upper-lower three-dimensional plane, and the three-dimensional surrounding can shoot the aircraft remote control model in the air, so that the periphery can be comprehensively and three-dimensionally observed by the aircraft remote control model in the air, correspondingly, the panoramic display module comprises a plurality of display screens or spherical display screens surrounding an operator in a three-dimensional way, and the operator can observe the aircraft in the front-back, left-lower and upper-lower directions as shown in fig.; the enclosure may be all around, or may be partial, such as only around the anterior hemisphere.

The imaging unit group and the surrounding arrangement of the plurality of imaging units included in the imaging unit group will not be described repeatedly.

At present, common cameras are two-dimensional image cameras and can shoot two-dimensional image videos, and a stereo image camera group can shoot stereo image videos. Specifically, one camera unit includes at least one two-dimensional image camera, and the camera unit group is a two-dimensional image camera unit group, that is, a two-dimensional image is obtained and output by the camera unit group, or one camera unit includes at least one stereo camera group as shown in fig. 6. At present, stereo shooting is generally carried out by using a stereo image camera group comprising two cameras. If stereo shooting is adopted, the corresponding display module is also in stereo display.

Specifically, for example, when the remote-controlled unit is a remote-controlled car model, a plurality of camera units can be arranged in the remote-controlled car model around the position of the driver, or the camera units can be arranged on the inner sides of the car window and the front and rear windshield; the camera unit can also be installed around the periphery of the remote control unit, for example, when the internal space is insufficient or the outside is more convenient to observe, for example, the camera unit is arranged around the remote control model in a circle around the remote control model, or the camera unit is arranged around the remote control model in a circle, or the camera unit is arranged around the remote control model in a part way, for example, the camera unit is arranged only in front of or behind the remote control model or in the front of or on the side of the remote control model, or the remote control model itself has a plurality of discrete windows around the remote control model and a plurality of camera units are arranged corresponding to the remote control model, and the remote control experience unit is arranged inside the remote control model, the panoramic display module has corresponding display screens at the positions of the remote control experience unit corresponding to the discrete windows.

In another embodiment, the method is carried out in such a way that,

the panoramic camera module comprises a camera unit group which comprises a plurality of camera units for shooting the surroundings from different angles and/or positions; each of the plurality of camera units is a two-dimensional image camera unit and one camera unit comprises at least one two-dimensional image camera and the camera unit group is a two-dimensional image camera unit group, or each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group; the panoramic display module comprises a head-worn display module with head tracking; the head mounted display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module by the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head mounted display module with head tracking by the communication module for display, or the head mounted display module with head tracking detects the head angle and/or head position information of the operator and selects and displays the part of video corresponding to the head angle and/or head position of the operator in the video shot by the panoramic camera module.

The common camera can be used for shooting two-dimensional videos, the common camera is a two-dimensional image camera, and the stereo shooting camera group can be used for shooting stereo videos. The two-dimensional image capturing unit group includes a plurality of two-dimensional image capturing units and obtains and outputs a two-dimensional image. When each of the plurality of camera units is a stereoscopic image camera unit and one camera unit comprises at least one stereoscopic image camera group, the camera unit group obtains and outputs a stereoscopic image.

The head-mounted display module, such as a current head-mounted display, a glasses-type display, etc., has a head tracking function, and will not be described repeatedly.

The specific head tracking method is characterized in that a multi-axis attitude sensor is adopted, three-axis rotation information is obtained through a gyroscope based on a six-axis processing scheme, high-precision three-dimensional motion tracking is provided by combining three-axis linear motion data obtained through a three-axis accelerometer, all motions are sensed to determine the attitude, and therefore the head can be accurately tracked. Specifically, another method is to monitor the head movement from the outside of the head, for example, there are some markers or signal sources such as infrared on the head-worn display module, there are devices for detecting these signal sources or markers in the space where the head is located, and the angular position of the head is determined by detecting the markers or signal sources. There are many mature schemes for tracking and detecting the head, and they will not be described in detail.

The communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator may be common to each other or different from each other, and even if the communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator are common to each other, the same communication device may be used in particular, or different communication devices may be used in each case. Such as a wireless network communication module or a wireless communication module, etc.

The plurality of camera units included in the camera unit group are arranged to shoot outwards around the inside and/or the surface and/or the outside of the remote-controlled machine or the remote-controlled model of the remote-controlled unit, wherein the surrounding comprises the front and/or the back and/or the left and/or the right and/or the upper and/or the lower; such as around the front, back, left and right sides of the remote control model or around the front, back, left, right, up and down sides, or such as around only the front and sides where it is most needed.

In a specific implementation, as shown in fig. 7, the remote-controlled unit is a remote-control model, and the plurality of camera units included in the camera unit group are installed in the remote-control model in a manner of surrounding a circle around the front, the back, the left and the right.

The head-worn display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module through the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head-worn display module with head tracking through the communication module for display. Specifically, for example, the head observation angle of the operator is detected to be 90 degrees, the viewing angle range of the head-mounted display module is 60 degrees, the detected head angle and/or head position information of the operator is transmitted to the panoramic camera module by the communication module, the panoramic camera module transmits the part of the shot video within the 60-degree viewing angle range from 60 degrees to 120 degrees among 90 degrees to the head-mounted display module by the communication module for display, and when the head of the operator rotates to the observation angle of 45 degrees, the panoramic camera module transmits the part of the shot video within the 60-degree viewing angle range from 15 degrees to 75 degrees among 45 degrees to the head-mounted display module by the communication module for display. If the head of the operator rotates out of the visual angle range of the shot video, the head-worn display module may not display or display other image videos and the like.

Or the head wearing display module with head tracking detects head angle and/or head position information of an operator and selects and displays a part of videos corresponding to the head angle and/or head position of the operator in videos shot by the panoramic camera module; specifically, for example, it is detected that the viewing angle of the head of the operator is 90 degrees, and the viewing angle range of the head-mounted display module is 60 degrees, then the head-mounted display module will display the portion of the video within the 60-degree viewing angle range from 60 degrees to 120 degrees in 90 degrees, and when the head of the operator rotates to the viewing angle of 45 degrees, the head-mounted display module will display the portion of the video within the 60-degree viewing angle range from 15 degrees to 75 degrees in 45 degrees. If the head of the operator rotates out of the visual angle range of the shot video, the head-worn display module may not display or display other image videos and the like.

In another embodiment, the method is carried out in the way that,

the panoramic camera module comprises at least one wide-angle camera unit; correspondingly, the panoramic display module comprises a plurality of display screens surrounding the operator, or the panoramic display module comprises one display screen surrounding the operator;

specifically, the surrounding includes front and/or rear and/or left and/or right and/or above and/or below, such as surrounding in front, back, left and right, or surrounding in front, back, left, right, up and down, such as surrounding an operator's ring-shaped display screen or surrounding an operator's ball-shaped display screen to display the video shot by the wide-angle camera unit; a common camera generally has a visual field range of about 60 degrees and can only see the front, and the visual angle range of the wide-angle camera unit is much larger, such as a wide-angle camera unit adopting a fisheye lens; a plurality of display screens may be combined to correspond to the range of the angle of view of the wide-angle camera unit, for example, 3 display screens surround an approximate semicircle, or an arc or spherical display screen may be used to display the video captured by the wide-angle camera unit, as shown in fig. 8. If a wide-angle camera unit cannot achieve full coverage of the surroundings, the corresponding multiple display screens surrounding the operator or one display screen surrounding the operator are also correspondingly partially surrounded, or even completely surrounded, the video captured by the camera unit is displayed on only a corresponding part.

The two-dimensional video can be shot by adopting a common camera, the common wide-angle camera is the wide-angle two-dimensional image camera, and the stereo video can be shot by the stereo shooting camera group. The wide-angle camera unit is two-dimensional image camera unit and includes at least one wide-angle two-dimensional image camera, perhaps the wide-angle camera unit includes at least one wide-angle stereo camera group, but stereo display is also to stereo camera group acquireed stereoscopic video and the display module that corresponds.

In another embodiment, the method is carried out in such a way that,

the panoramic camera module comprises at least one wide-angle camera unit; the panoramic display module comprises a head-worn display module with head tracking; the head-wearing display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module by the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head-wearing display module with head tracking by the communication module for display, or the head-wearing display module with head tracking detects the head angle and/or head position information of the operator and selects and displays the part of videos corresponding to the head angle and/or head position of the operator in the videos shot by the panoramic camera module;

in one specific implementation, the remote-controlled unit is a remote-control model, and the panoramic camera module includes at least one wide-angle camera unit, as shown in fig. 7;

the communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator may be common to each other or different from each other, and even if the communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator are common to each other, the same communication device may be common to each other or different communication devices may be used to each other; common wireless network communication modules or wireless communication modules;

the head-worn display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module through the communication module, and the panoramic camera module transmits the part of video information corresponding to the head angle and/or head position information of the operator to the head-worn display module with head tracking through the communication module for display. Specifically, for example, the head observation angle of the operator is detected to be 90 degrees, the viewing angle range of the head-mounted display module is 60 degrees, the detected head angle and/or head position information of the operator is transmitted to the panoramic camera module by the communication module, the panoramic camera module transmits the part of the shot video within the 60-degree viewing angle range from 60 degrees to 120 degrees among 90 degrees to the head-mounted display module by the communication module for display, and when the head of the operator rotates to the observation angle of 45 degrees, the panoramic camera module transmits the part of the shot video within the 60-degree viewing angle range from 15 degrees to 75 degrees among 45 degrees to the head-mounted display module by the communication module for display. If the head of the operator rotates out of the visual angle range of the shot video, the head wearing display module can not display or display other image videos and the like;

In another embodiment, the method is carried out in such a way that,

the panoramic camera module comprises at least one rotatable and/or movable camera unit and a driving motor connected with the rotatable and/or movable camera unit; correspondingly, the panoramic display module comprises a head-mounted display module with head tracking; the head-worn display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module through the communication module, the driving motor of the panoramic camera module, which is connected with the rotatable and/or movable camera unit, drives the rotatable and/or movable camera unit to a corresponding angle and/or position, and the shot video is transmitted to the head-worn display module of the panoramic display module through the communication module to be displayed.

The communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator may be common to each other or different from each other, and even if the communication module for video transmission and the communication module for transmitting the head angle and/or position information of the operator are common to each other, the same communication device may be used in particular, or different communication devices may be used in each case. Such as a wireless network communication module or a wireless communication module, etc. The driving motor of the panoramic camera module connected with the rotatable and/or movable camera unit drives the rotatable and/or movable camera unit to a corresponding angle and/or position, and transmits video information to the head-mounted display module of the panoramic display module by the communication module for display, as shown in fig. 9.

For example, a multi-axis attitude sensor is adopted, a six-axis motion processing scheme obtains three-axis rotation information through a gyroscope, three-axis linear motion data obtained through a three-axis accelerometer is combined, high-precision three-dimensional motion tracking is provided, all motions are sensed, and attitude determination is included. Or another specific method is to monitor the head movement from the outside of the head, for example, there are some markers or signal sources such as infrared on the head-worn display module, there are devices for detecting these signal sources or markers in the space where the head is located, and the angular position of the head is determined by detecting the markers or signal sources. There are many implementations for tracking and detecting the head, and no detailed description is given.

The head-worn display module with head tracking is electrically connected with the communication module of the remote control experience unit and transmits the detected head angle and/or head position information of the operator to the panoramic camera module through the communication module, the driving motor of the panoramic camera module, which is connected with the rotatable and/or movable camera unit, drives the rotatable and/or movable camera unit to a corresponding angle and/or position, and the shot video is transmitted to the head-worn display module of the panoramic display module through the communication module to be displayed. Specifically, for example, the head observation angle of the operator is detected to be 60 degrees, the detected head angle and/or head position information of the operator is transmitted to the panoramic camera module by the communication module, the driving motor of the panoramic camera module, which is connected with the rotatable and/or movable camera unit, drives the rotatable and/or movable camera unit to the corresponding 60 degrees, and the shot video is observed from the 60 degrees;

the panoramic camera module comprises at least one rotatable and/or movable camera unit, wherein the rotatable and/or movable camera unit is a two-dimensional image camera unit and one rotatable and/or movable camera unit comprises at least one two-dimensional image camera, or the rotatable and/or movable camera unit is a stereoscopic image camera unit and one rotatable and/or movable camera unit comprises at least one stereoscopic image camera group. The image pickup unit includes a stereo camera group as shown in fig. 10. At present, stereo shooting is generally carried out by using a stereo image camera group comprising two cameras. If stereo shooting is adopted, the corresponding display module is also in stereo display.

Further, in the system, the first and second sensors,

and/or the presence of a gas in the gas,

In the specific implementation, the specific communication device for transmitting and receiving the sensing information can be shared with the communication device for transmitting and receiving the panoramic video, or can be independently established. For example, all the information may be transmitted and received by the wireless network communication device in common, or the wireless network communication device may be used for panoramic video and audio information and another wireless communication device may be used for transmission of vibration or attitude information.

Specifically, both can include that audio sensor gives the audio module sound production that remote control experienced the unit with sound transmission by remote control unit, and the audio sensor that also can reverse remote control experienced the unit gives the sound production with sound transmission by remote control unit's audio module, and the person controlled avatar can not only listen to and can say, for example two are conversed by remote control unit in being controlled the unit.

Specifically, an audio sensor such as a miniature microphone, and an audio module such as a speaker.

Specifically, the vibration sensor may detect the intensity of vibration, and the vibration module may accommodate or support the operator, for example, the vibration module may have a cab in which the operator sits and the cab vibrates, or the vibration module may have a seat on which the operator sits and the seat vibrates. The vibration module may reproduce the vibration by electrical or mechanical means, one embodiment of which is for example a motor driving a cam or a ram.

Specifically, the attitude sensor detects the motion attitude such as inclination, rolling and the like, for example, a multi-axis attitude sensor is adopted, a six-axis motion processing scheme obtains three-axis rotation information through a gyroscope, and three-axis linear motion data obtained through a three-axis accelerometer is combined, so that three-dimensional motion tracking can be provided, and attitude determination is included. The attitude sensor is a product in the prior art, has a mature chip product or a module product, is integrated with a plurality of sensors, or can be built by applying related sensors and technologies in implementation. The attitude simulation module accommodates or carries the operator, the panoramic display module and the input module, for example, the attitude simulation module has a cab, the operator sits in the cab, the panoramic display module such as a display screen and the input module such as a steering wheel are also installed in the cab, and the attitude simulation module can enable the cab to simulate a corresponding attitude of the remote control unit such as front-back inclination, left-right inclination, overturning and the like. Or for example, the posture simulation module has a platform on which an operator sits, and the panoramic display module, such as a display screen, and the input module, such as a steering wheel, are also mounted on the platform, that is, the posture simulation module bears the operator, the panoramic display module, and the input module, and the posture simulation module can make the bearing platform simulate the posture corresponding to the remote-controlled unit, such as front-back inclination, left-right inclination, turning, and the like. If the operator uses the head-mounted display module, the posture simulation module accommodates or carries the operator, and naturally the head-mounted display module is also accommodated or carried. The gesture simulation module enables the remote control experience unit to generate tilting, rotating and other movements corresponding to the remote controlled unit through an electric or mechanical device, so that the manipulator and the remote controlled unit can keep corresponding gestures, and specifically, for example, the gesture simulation module can comprise a connecting rod, a gear and the like and a motor connected with the connecting rod to control tilting, rotating and the like, which are easy to implement by electromechanical technicians and are not described in detail.

Specifically, for example, when the remote-controlled unit is a remote-control model, the remote-control model is installed with a panoramic camera module, an audio sensor, a vibration sensor and a posture sensor, the remote-control experience unit has a cab, the operator sits in the cab, the remote-control experience unit controls the remote-control model of the remote-controlled unit remotely by operating input modules of the remote-control experience unit such as a steering wheel and a gear lever and sending information through a communication module, a panoramic display module and a speaker are used for reproducing video and sound obtained by the angle of the driver in the remote-controlled unit, and the vibration, the posture and the like are detected by the corresponding sensors and sent back by the communication module, the remote-control experience unit reproduces the vibration through the vibration module and transmits the vibration to the user, the posture simulation module makes the cab tilt, rotate and the like corresponding to the remote-controlled model, so that the user has an in-, and the audio sensor of the remote control experience unit can receive the voice information of the operator, and the voice information of the operator is sent to the remote control model and played by the audio module of the remote control model.

Further, in the above-mentioned case,

and/or the presence of a gas in the gas,

the input module of the remote experience unit comprises a keyboard and/or a mouse and/or a game joystick and/or a touch screen and/or buttons,

and/or the presence of a gas in the gas,

The communication module of the remote control unit is a wireless network communication module and the corresponding communication module of the remote control experience unit is a network communication module, and the remote control unit is connected to the internet or a large local area network through the wireless network communication modules such as a WiFi module (a brand of wireless network communication technology held by Wi-Fi alliance) in a specific implementation, so that the distribution of the system is not limited by regions, and the remote control experience units which are far away from each other can be connected to the internet or remotely control the remote control model in the same scene through the network communication modules such as the WiFi module and the ethernet module to participate in the game system.

Specifically, a vehicle remote control model on the ground such as a common vehicle, a armed vehicle and the like, a tank remote control model on the ground is a typical participant of an attack type game, and if the tank remote control model is simply replaced by an attack type remote control model such as a self-propelled gun and the like, an aerial aircraft remote control model such as various airplane remote control models is still in a protection range; one implementation is shown in fig. 12.

The specific devices included in these input modules that correspond to specific remote control models can generally obtain input information by converting mechanical motion into electrical signals through angle sensors, stroke sensors, contact switches, and the like. Specifically, for example, the steering wheel or rudder may obtain the turning angle by using an installed angle sensor, and the stepping depth by using a stroke sensor such as an accelerator pedal or a brake pedal. One simple implementation of the gear shift lever is to place contact switches in the corresponding gear positions, to make contact with the gear shift even if the gear shift is performed, or to make contact with the gear shift to perform one upshift or downshift at a time, and to transmit the signals from the communication module to the remote control unit to perform corresponding steering, acceleration, gear shift and other operations. Joysticks, foot pedals, throttle levers and the like can also be used to convert mechanical motion into electrical signals by means of angle sensors, travel sensors, contact switches and the like. The specific implementation may further include an analog-to-digital conversion chip, etc., which are easily implemented by mechanical and electronic technicians and are not described in detail. These input signals are transmitted by the communication module to the remotely controlled unit to remotely control the remotely controlled unit, such as steering, acceleration, shooting, etc. A common communication module is a wireless network communication module, or a wireless communication module.

The foregoing is only for the purpose of illustrating the invention as a specific embodiment and is not to be construed as limiting the invention. All the replacement and improvement based on the utility model are within the protection scope of the utility model.

Claims

1. A realistic remote experience game system is disclosed, characterized in that,

the system comprises an experience part and a remote control part;

or,

2. The system of claim 1,

the display screen comprises a display screen or a projection screen;

and/or the presence of a gas in the gas,

3. The system of claim 1,

and/or the presence of a gas in the gas,

4. The system of claim 2,

and/or the presence of a gas in the gas,

5. The system according to any one of claims 1 to 4,

and/or the presence of a gas in the gas,