TW202444105A - Online live interactive site navigation system - Google Patents

Abstract

An online live interactive field navigation system includes an image database and a server. The image database stores a panoramic environment image of at least one field object; the server generates a live video data according to the panoramic environment image and the video data from a master electronic device, and the live video data has a navigation image and a navigation voice; the server continuously transmits the live video data to a user electronic device, so that the navigation image is displayed on the display module of the user electronic device and the navigation voice is played on the speaker of the user electronic device; the server receives a control authorization instruction sent by the master electronic device, and grants the user electronic device a control authority, so that the user electronic device can control the panoramic environment image of the background image of the live video data.

Description

Online live interactive site navigation system

The present invention relates to online site navigation; in particular, to an online live interactive site navigation system.

In recent years, epidemics have spread severely, and many people are worried about the increased risk of infection due to contact with crowds when going out. In addition, with the development of Internet technology, people's behavior of visiting places outside has gradually evolved into online visits at home. Take house visits as an example. In order to allow consumers to view houses at any time, real estate agents will display videos or photos of the interior environment of the house on the web page, including the living room, kitchen, bedroom and other indoor environments, so that consumers can watch them online at any time.

However, existing online viewing basically involves consumers using electronic devices to view web page-related information on their own. There is a lack of two-way interaction between operators and consumers, so that operators cannot immediately receive feedback from consumers who cancel their online viewing.

In other words, the actual situation of the scene is often missing when presented in online videos or photos. Due to the information in videos and flat photos, it is difficult for users to feel the indoor or outdoor scenes of the scene and generate a specific sense of space. In addition, videos or photos are prone to missing information about the scene due to different shooting angles.

In view of this, the purpose of the present invention is to provide an online live interactive field navigation system, which can allow the live broadcaster to use the panoramic surround image of the field object to live broadcast the field object, and allow users and the live broadcaster to interact with the panoramic surround image of the introduced field object.

In order to achieve the above-mentioned purpose, the present invention provides an online live interactive field navigation system, which is used to signal connect a main control electronic device and at least one user electronic device, wherein the main control electronic device has a camera module, a sound receiving module and a display module, and the main control electronic device obtains a video and audio data of a live broadcaster through the camera module and the sound receiving module, and the video and audio data includes a real-time image and a real-time voice, and the at least one user electronic device has a display module and a speaker; the online live interactive field navigation system includes an image database and a server, wherein:

The image database stores at least one panoramic environment image of at least one scene object;

The server signal is connected to the image database, the main control electronic device and the at least one user electronic device. The server obtains the at least one panoramic environment image of the at least one scene object from the image database and continuously receives the audio and video data from the main control electronic device. The server generates a live audio and video data according to the at least one panoramic environment image and the continuously received audio and video data. The live audio and video data has a navigation image and a navigation image. The navigation image includes a foreground image and a background image, the foreground image includes the real-time image, the background image includes the at least one panoramic environment image, and the navigation voice includes the real-time voice; the server continuously transmits the live video and audio data to the at least one user electronic device, so as to display the navigation image on the display module of the at least one user electronic device and play the navigation voice on the speaker of the at least one user electronic device;

The server controls the panoramic environment image in the background image of the live video data generated according to a first control instruction corresponding to the main control electronic device;

Among them, the server receives a control authorization instruction sent by the main control electronic device, and grants a control permission to the at least one user electronic device according to the control authorization instruction. When the server receives at least one second control instruction sent by the at least one user electronic device, the server controls the panoramic environment image of the background image of the live audio and video data according to the at least one second control instruction, and transmits the live audio and video data to the main control electronic device and the at least one user electronic device, so as to synchronously display the navigation image on the display module of the main control electronic device and the display module of the at least one user electronic device.

The effect of the present invention is that by transmitting live video and audio data to the user's electronic device, the user can watch the live broadcast with real-time images and panoramic environment images and navigation images and navigation voice on the user's electronic device. The live broadcast host and the user can control the panoramic environment image to achieve the purpose of two-way interaction between the live broadcast host and the user. The panoramic environment image can also allow the user to feel the sense of space generated by the scene of the scene.

In order to explain the present invention more clearly, a preferred embodiment is given and described in detail with drawings. Please refer to FIG1, which is an online live interactive field navigation system 1 of a first preferred embodiment of the present invention, which is used to connect a main control electronic device 20 and at least one user electronic device 30. In this embodiment, the field is described by taking a house as an example, but it is not limited to this. The field can also be a museum, a historical site, an educational unit, a public unit, or a financial unit... and other fields with a navigation requirement.

In this embodiment, the main control electronic device 20 and the at least one user electronic device 30 are mobile devices (mobile phones, tablet computers, laptop computers) or personal computers that can connect to the Internet I. The main control electronic device 20 has a camera module 22, a sound receiving module 24, a display module 26, and a speaker 28. The main control electronic device 20 is operated by the live broadcaster, and can obtain audio and video data of the live broadcaster through the camera module 22 and the sound receiving module 24. The audio and video data includes a real-time image and a real-time voice. The camera module 22 is used to shoot the real-time image of the live broadcaster, and the sound receiving module 24 is used to receive the real-time voice of the live broadcaster. Preferably, the main control electronic device 20 removes the background behind the live broadcaster in the real-time image.

The number of the at least one user electronic device 30 is plural, and each user electronic device 30 has a camera module 32, a sound receiving module 34, a display module 36, and a speaker 38. The camera module 32 is used to take a real-time image of the user, and the sound receiving module 34 is used to receive a real-time voice of the user to form the user's audio and video data. The main control electronic device 20 and each user electronic device 30 respectively execute an application to connect to the online live interactive field navigation system 1 through the Internet I.

In this embodiment, the display module 26 of the main control electronic device 20 and the display module 36 of the user electronic device 30 are touch displays for example, so that the live broadcast host and the user can control the main control electronic device 20 and the user electronic device 30, but this is not limited to it. The main control electronic device 20 or the user electronic device 30 can also be connected to an input interface such as a mouse or keyboard for the live broadcast host or the user to control.

The online live interactive field navigation system 1 includes an image database 10 and a server 12. The image database 10 stores at least one panoramic environment image of at least one field object. In this embodiment, the field object is a house object, and the image database 10 stores panoramic environment images of multiple house objects, and the number of panoramic environment images of each house object can be one or more, and these panoramic environment images correspond to multiple spaces of the house object (such as living room, kitchen, bedroom, bathroom, etc.). The merchant end can upload the panoramic environment image to the image database 10 for storage through the Internet I, and the panoramic environment image is a panoramic image taken by a panoramic camera.

The server 12 is connected to the image database 10 by signal, and the signal connection can be wired or wireless, or connected through a local area network or the Internet. The image database 10 can also be built into the server 12. The server 12 is connected to the main control electronic device 20 and the user electronic devices 30 through the Internet I signal.

By using the above-mentioned framework, the online live interactive scene navigation method of this embodiment can be performed, and the method includes the following steps:

In step S11, the live broadcast host controls the main control electronic device 20 to connect to the server 12. Referring to FIG. 2 , a user interface 40 is displayed on the display module 26 of the main control electronic device 20. The user interface 40 includes at least one menu area 42, a navigation area 44, a plurality of control images 46, a plurality of switching space images 48, and a switching object image 50. In this embodiment, the at least one menu area 42 includes two menu areas, namely, an object menu area 422 and a user menu area 424. A list 52 of items of a plurality of house objects is displayed in the object menu area 422, and each of the items of the house objects in the list 52 includes a house image 522 of the house object. The live streamer can select an item of the house object to be introduced from the list 52, such as clicking on the house image 522, and then the server 12 obtains at least one panoramic environment image of the corresponding house object from the image database 10, such as the default panoramic environment image is the panoramic environment image of the living room. The switching space images 48 correspond to different spaces, including the living room, kitchen, bedroom, and bathroom.

In addition, the host electronic device 20 continuously uploads the video data to the server 12, and the server 12 continuously receives the video data from the host electronic device 20. The user electronic device 30 can also transmit the user's video data to the server 12.

In addition, each user also controls each user electronic device 30 to connect to the server 12. As shown in FIG2, after the user electronic devices 30 are connected, a user list 54 is displayed in the user menu area 424 of the menu area 42 of the main control electronic device 20. Each user item in the user list 54 includes a user image 542 of each user. When the number of users is large, the number of other users is displayed in numbers, for example, "+36" is displayed to represent 36 other users. The live broadcast host clicks any position on the user menu area 424, or each user image 542, or the number of users, and a detailed user list 54a as shown in FIG3 is displayed on the main control electronic device 20. Each user item in the user list 54, 54a can be used by the live broadcast host to select the user to whom he wants to grant control authority, which will be described later. After any user item is selected, the corresponding user image 542 is displayed in a striking manner in the user menu area 424 of the user interface 40 of the main control electronic device 20 (see Figure 4).

In step S12, the server 12 generates a live video data according to the panoramic environment image and the continuously received video data, and the live video data has a navigation image and a navigation voice. As shown in FIG2 , the navigation image 56 includes a foreground image 562 and a background image 564, the foreground image 562 includes the real-time image, and the background image 564 includes the panoramic environment image. The navigation voice includes the real-time voice.

In step S13 , the server 12 continuously transmits the live video data to each of the user electronic devices 30 , so as to display the navigation image 56 (see FIG. 5 ) on the display module 36 of each of the user electronic devices 30 and play the navigation voice on the speaker 38 of each of the user electronic devices 30 .

In this embodiment, a user interface 60 displayed by the display module 36 of the user electronic device 30 has a navigation area 62, and the navigation area 62 is used to display the navigation image 56. In addition, the live audio and video data is synchronously transmitted to the main control electronic device 20, so that the navigation image 56 is displayed in the navigation area 42 of the display module 26 of the main control electronic device 20 (see FIG. 2), and the navigation voice can be optionally played on the speaker 28 of the main control electronic device 20. The user interface 60 also has an object menu area 422a and a user menu area 424a, wherein the object menu area 422a is displayed in a smaller area. The list 52 of house objects in the object menu area 422a of the user interface 60 also has house images 522 of house objects that can be selected by the user, and the user menu area 424a also has user images 542 that can be selected by the user. In addition, in FIG. 4 and FIG. 5, the house image 522 of the house object being navigated is displayed in a striking manner.

In step S14, as shown in FIG. 2 , the live streamer can operate the background image 564 of the navigation image 56 in the navigation area 44 by selecting any control image 46 on the user interface 40. In the present embodiment, the control images 46 include a moving image 46a, an enlarged image 46b, a reduced image 46c, and a marked image 46d. After selecting the moving image 46a, the panoramic environment image in the background image 564 can be moved to change the presented viewing angle. Selecting the enlarged image 46b or the reduced image 46c will enlarge or reduce the panoramic environment image in the background image 564. Selecting the marked image 46d will specify the at least one area in the background image 564 corresponding to the panoramic environment image, and attach at least one mark, such as a circle mark, an indication mark, a hand-drawn mark, etc.

The host can click on the control images 46 according to the timing of introducing the house object. When clicking on the moving image 46a, the enlarged image 46b, or the reduced image 46c, the main control electronic device 20 sends a corresponding first control instruction to the server 12 according to the clicked control image 46. When clicking on the marking image 46d, the main control electronic device 20 sends a corresponding marking instruction to the server 12.

When the server 12 receives the first control instruction, the panoramic environment image in the background image 564 of the live video data generated by the control according to the first control instruction of the master electronic device 20. In this way, the background image 564 controlled by the live broadcast host can be displayed on the display module 36 of each user electronic device 30. When the server 12 receives the marking instruction, the server 12 adds a mark to the designated area of the panoramic environment image in the background image 564 of the live video data according to the marking instruction. In this way, the background image 564 marked by the live broadcast host can be displayed on the display module 36 of each user electronic device 30.

When the live streamer wants to switch the space for explanation, he can select the switching space image 48 corresponding to the space to be explained on the user interface 40, and the main control electronic device 20 transmits the corresponding switching space request to the server 12. The switching space request specifies one of the spaces, such as "bathroom". The server 12 takes the panoramic environment image of the corresponding space from the image database, and the server 12 generates the live video data according to the panoramic environment image of the space specified by the switching space request and the continuously received video data. In this way, the changed panoramic environment image in the display module background image 564 of the main control electronic device 20 and the user electronic device 30 can be synchronized.

Through the above steps, the live broadcaster can explain the house objects online and control the panoramic environment images, allowing users to better feel the sense of space and presence created by the scene.

Afterwards, in step S15, the live broadcast host chooses to give the control authority of the background image 564 to the selected user.

For example, as shown in FIG2 , the live broadcast host can select the user to whom the control authority is to be granted in the user list 54 in the user menu area 424 of the menu area 42, for example, by clicking the user image 542 of the user to grant the user the control authority. Alternatively, the live broadcast host can click the user image 542 to whom the control authority is to be granted on the user list 54a shown in FIG3 , or click the corresponding switch image 544. After clicking the confirmation image 546, the control authority can be granted to the user, for example, by selecting “User 1”.

Of course, the live broadcast host can also grant control authority according to the request of each user. Specifically, the user interface 60 of each user electronic device 30 has a request control image 64. After any of the users clicks on the request control image 64, the corresponding user electronic device 30 sends a control authorization request to the server 12. After receiving a control authorization request from any of the corresponding user electronic devices 30, the server 12 sends the control authorization request of the corresponding user electronic device 30 to the master electronic device 20. The master electronic device 20 displays the corresponding prompt on the display module 26 according to the control authorization request, and prompts in a striking manner in the user item of the user list 52, for example, the user image 542 of "User 1" is displayed in a flashing manner. The live streamer can then choose to grant control rights to "User 1".

Then, the main control electronic device 20 transmits a control authorization instruction corresponding to the user item (such as "User 1") to the server 12, and the control authorization instruction includes a designated user instruction, and the designated user instruction specifies one of the user electronic devices 30, such as the user electronic device 30 corresponding to "User 1".

In step S16, after receiving the control authorization instruction sent by the master electronic device 20, the server 12 grants a control permission to the corresponding user electronic device 30 according to the control authorization instruction. More specifically, the server 12 grants the control permission to the corresponding user electronic device 30 according to the designated user instruction of the control authorization instruction. The server 12 waits for the user electronic device 30 to which the control permission is granted to send at least one second control instruction.

In step S17, the user with control authority controls his user electronic device 30 to send the at least one second control instruction to control the background image 564 of the live video data.

In this embodiment, the user image 542 of the user who is granted the control authority is displayed in a striking manner in the user interface 60 on the display module 36 of the user electronic device 30. There are a plurality of control images 66 in the user interface 60 of the user electronic device 30, and these control images 66 include a moving image 66a, an enlarged image 66b, a reduced image 66c and a marked image 66d. After selecting the moving image 66a, the panoramic environment image in the background image 564 can be moved to change the presented viewing angle. Selecting the enlarged image 66b or the reduced image 66c will enlarge or reduce the panoramic environment image in the background image 564. The selection mark image 66d can specify the at least one area in the background image 564 corresponding to the panoramic environment image, and add at least one mark, such as a circle mark, an indication mark, a hand-drawn mark, etc.

The user with the control authority clicks on the control images 66 as required. When the user clicks on the moving image 66a, the enlarged image 66b, or the reduced image 66c, the user electronic device 30 transmits the corresponding second control instruction to the server 12 according to the clicked control image 66.

When the server 12 receives at least one second control instruction sent by a user electronic device 30 with control authority, the server 12 controls the panoramic environment image of the background image 564 of the live audio and video data according to the second control instruction, and transmits the live audio and video data to the main control electronic device 20 and the user electronic devices 30, so as to synchronously display the navigation image 56 on the display module 26 of the main control electronic device 20 and the display modules 36 of the user electronic devices 30.

In this way, the user can manipulate the omni-image environment image in the background image 564, and the live broadcast host can also further explain the area that the user is interested in, so as to achieve the purpose of interaction between the live broadcast host and the user. In addition, the user's real-time voice received by the audio module 34 of the user electronic device 30 can also be transmitted to the main control electronic device 20 via the server 12 and played on the speaker 28 of the main control electronic device 20.

In addition, in this embodiment, when the user with control authority clicks the mark image 66d, the user electronic device 30 with control authority transmits the corresponding mark instruction to the server 12. The server 12 adds a mark to the designated area of the panoramic environment image in the background image 564 of the live video data according to the mark instruction. The user can add a circle mark, an indication mark, or a hand-drawn mark, etc., so that the live broadcast host can explain the user's marked area.

Furthermore, the server 12 captures a regional image of one or more designated areas of the panoramic environment image in the background image 564 of the live video data, and creates a list including the regional image. The main control electronic device 20 connects to the server 12 to obtain the list, and the live broadcast host can reply to the user for one or more regional images listed in the list.

In this embodiment, the user can manipulate the user electronic device 30 to input a dialogue message corresponding to one or more zone images. The dialogue message can be a text or voice message asked by the user. After receiving the dialogue message corresponding to the regional image from the user electronic device 30, the server 12 adds the dialogue message to the list. During or after the live broadcast, the main control electronic device 20 connects to the server 12, and the live broadcast host can manipulate the main control electronic device 20 to input a reply message corresponding to the dialogue message for the regional image and the dialogue message in the list. The reply message can be a text or voice message replied by the live broadcast host. The server 12 receives the reply message corresponding to the dialogue message from the main control electronic device 20, and adds the received reply message to the list.

The user can operate the user electronic device 30 to connect to the server 12 during or after the live broadcast to obtain the list, and can view the regional images in the list and view or listen to the live broadcast host's reply message on the user electronic device 30.

In this embodiment, the control authority granted by the server 12 is temporary. The control authority can also be cancelled by the main control electronic device 20. For example, when the live broadcast host clicks on the user item for which the control authority is to be cancelled on the user list 54, the main control electronic device 20 sends a cancellation authorization command to the server 12. After receiving the cancellation authorization command sent by the main control electronic device 20, the server 12 takes back the control authority of the user electronic device 30 corresponding to the designated user command. In addition to the cancellation of the control authority by the live broadcast host, the server 12 can set an effective time, during which the user electronic device 30 is allowed to control the background image 564. If the effective time is exceeded, the server 12 cancels the control authority and prohibits the user electronic device 30 from controlling the background image 564.

In order to allow the user to choose to let the live streamer introduce a specific space, in this embodiment, the user can control the user electronic device 30 to input a space switching request, and the space switching request specifies one of the spaces. For example, the user interface 60 of the user electronic device 30 has a plurality of space switching images 70, and the space switching images 70 correspond to different spaces, including a living room, a kitchen, a bedroom, and a bathroom.

When the user selects the switching space image 70 corresponding to a specific space on the user interface 60, the user electronic device 30 transmits the corresponding switching space request to the server 12. The server 12 transmits the switching space request to the master electronic device 20, and the master electronic device 20 displays the corresponding prompt on the display module 26, for example, prompting in a striking manner on the corresponding switching space image 48, for example, displaying a prompt image on the corresponding switching space image 48 or displaying the corresponding switching space image 48 in a different color. After the live broadcast host clicks the corresponding switching space image 48, the master electronic device 20 transmits a space switching permission instruction to the server 12, and the space switching permission instruction corresponds to the specified space. After the server 12 receives the space switching permission instruction from the master electronic device, the server 12 generates the live audio and video data according to the panoramic environment image of the space specified by the space switching request and the continuously received audio and video data, that is, the server 12 obtains the panoramic environment image of the corresponding space from the image database 10 to generate the live audio and video data. In this way, the panoramic environment image in the background image 564 of the display module 26, 36 of the master electronic device 20 and the user electronic device 30 can be synchronized. The live broadcast host can then explain the space specified by the user.

When the live broadcast host wants to introduce other house objects, he can click on the switching object icon 50 on the user interface 40. As shown in FIG. 4, a list 52 of house objects is displayed in the menu area 42. After the live broadcast host clicks on other house objects in the list 52, the main control electronic device 20 transmits a switching object request, and the switching object request specifies one of the house objects. The server 12 obtains the panoramic environment image of the corresponding house object from the image database 10, and the server 12 generates the live audio and video data according to the panoramic environment image of the house object specified by the switching object request and the continuously received audio and video data. In addition, the live broadcast host can also directly click on the house image 522 in the object selection menu area 422 of the user interface 40 to make the main control electronic device 20 send the object switching request to switch the house object to be navigated.

The user can also ask the live broadcast host to introduce other housing objects, as shown in FIG5 , the user selects a housing image 522 of other housing objects in the list 52 of housing objects in the object menu area 422a on the user interface 60, and the user electronic device 30 transmits a request to switch objects, and the request to switch objects specifies one of the selected housing objects. The server 12 transmits the request to switch objects to the main control electronic device 20. The main control electronic device 20 displays a corresponding prompt on the display module 26, for example, prompting in a striking manner on the item of the corresponding housing object in the list 52, for example, displaying a prompt image on the item of the corresponding housing object or displaying the item of the corresponding housing object in a different color, or displaying the housing image 522 in a flashing manner. After the live broadcast host clicks on the item of the corresponding house object, the main control electronic device 20 transmits an object switching permission instruction to the server 12, and the object switching permission instruction corresponds to the specified house object. The server 12 obtains the panoramic environment image of the corresponding house object from the image database 10, and the server 12 generates the live audio and video data according to the panoramic environment image of the house object specified by the object switching request and the continuously received audio and video data. In this way, the panoramic environment image of the house object in the background image 564 of the display module 26, 36 of the main control electronic device 20 and the user electronic device 30 can be synchronized. The live broadcast host can then explain the house object specified by the user.

In addition, the user can also click on the house image 522 of the house object to be switched from the object menu area 422a in the user interface 60, and the user electronic device 30 sends a corresponding switch object request to the server 12, so as to switch to the navigation image 56 display of the specified house object after the live broadcast host allows it.

When the user clicks any position on the user menu area 424a in the user interface 60, or each user image 542, or the number of users, a detailed user list 54b as shown in FIG6 is displayed on the user electronic device 30. The user can click other user images 542 on the detailed user list 54b to further view the public information of the clicked user.

In addition, as shown in FIG. 7 , a user with control authority can also control his user electronic device 30 to make the server replace the live broadcaster's real-time image in the foreground image 562 of the navigation image 56 with the user's real-time image. In this way, the user uses the camera module 32 of the user electronic device 30 to shoot a full-body real-time image of the user and transmit it to the server 12. The server 12 generates the navigation image 56 and transmits it to the user electronic device 30 to display the navigation image 56 with the user's real-time image, so that the user can feel the ratio of the user and the panoramic environment image, and have a more immersive experience. Preferably, the user electronic device 30 removes the background behind the user in the user's real-time image.

FIG8 shows a user interface 40a displayed by the display module 26 of the main control electronic device 20 of a second preferred embodiment of the present invention. The difference between this embodiment and the first embodiment is that the live broadcast host can use the camera module 22 of the main control electronic device 20 to shoot a full-body real-time image, so that the user can feel the ratio of the live broadcast host to the panoramic environment image. Preferably, the main control electronic device 20 removes the background behind the live broadcast host in the real-time image.

In order to facilitate the live broadcast host to control the main control electronic device 20, the server 12 recognizes the body posture of the live broadcast host according to the real-time image of the audio and video data received from the main control electronic device 20, and generates the first control instruction according to the recognized body posture to control the panoramic environment image in the background image 564 of the generated live audio and video data. For example, the server 12 has established a plurality of predetermined control body postures, each of which corresponds to a first control instruction, for example, these predetermined control body postures can correspond to movement, enlargement, and reduction. When the server 12 determines that the body posture of the live broadcast host in the real-time image meets a corresponding predetermined control body posture, the corresponding first control instruction is generated to control the panoramic environment image in the background image 564.

Alternatively, the server 12 recognizes the voice of the live streamer based on the real-time voice of the video data received from the main control electronic device 20, and generates the first control command based on the recognized voice. For example, the server 12 has established a plurality of predetermined control voice commands, each of which corresponds to a first control command, for example, the predetermined voice commands may correspond to move, zoom in, and zoom out. When the server 12 determines that the voice of the live streamer in the real-time voice matches a corresponding predetermined control voice command, the corresponding first control command is generated to control the panoramic environment image in the background image 564.

As described above, the online live interactive field navigation system of the present invention can transmit live video and audio data to the user's electronic device. The user can watch the navigation image and navigation voice with real-time images and panoramic environment images during the live broadcast on the user's electronic device. The live broadcast host and the user can control the panoramic environment image to achieve the purpose of two-way interaction between the live broadcast host and the user.

The above description is only the preferred embodiment of the present invention. Any equivalent changes made by applying the present invention specification and the scope of patent application should be included in the patent scope of the present invention.

1: Online live interactive house tour system 10: Image database 12: Server 20: Main control electronic device 22: Camera module 24: Radio module 26: Display module 28: Speaker 30: User electronic device 32: Camera module 34: Radio module 36: Display module 38: Speaker 40,40a: User interface 42: Menu area 422,422a: Object menu area 424,424a: User menu area 44: Navigation area 46: Control image 46a: Move image 46b: Enlarge image 46c: Reduce image 46d: Mark image 48: Switching space images 50: Switching object images 52: List 522: House images 54,54a,54b: User list 542: User images 544: Switch images 546: Confirmation images 56: Navigation images 562: Foreground images 564: Background images 60: User interface 62: Navigation area 64: Request manipulation images 66: Manipulation images 66a: Move images 66b: Enlarge images 66c: Reduce images 66d: Mark images 70: Switching space images I: Internet

FIG. 1 is a schematic diagram of an online live interactive field navigation system of a first preferred embodiment of the present invention. FIG. 2 is a schematic diagram of a user interface displayed by a display module of a master electronic device of a first preferred embodiment of the present invention. FIG. 3 is a schematic diagram of a user list displayed by a display module of a master electronic device of a first preferred embodiment of the present invention. FIG. 4 is a schematic diagram of a user interface displayed by a display module of a master electronic device of a first preferred embodiment of the present invention. FIG. 5 is a schematic diagram of a user interface displayed by a display module of a user electronic device of a first preferred embodiment of the present invention. FIG. 6 is a schematic diagram of a user list displayed by a display module of a user electronic device of a first preferred embodiment of the present invention. FIG. 7 is a schematic diagram of a user interface displayed by a display module of a user electronic device in the first preferred embodiment of the present invention. FIG. 8 is a schematic diagram of a user interface displayed by a display module of a main control electronic device in the second preferred embodiment of the present invention.

1: Online live interactive site navigation system

10: Image database

12: Server

20: Main control electronic device

22: Photography module

24: Radio module

26: Display module

28: Speaker

30: User electronic devices

32: Photography module

34: Radio module

36: Display module

38: Speaker

I: Internet

Claims (10)

An online live interactive field navigation system is used to signal connect a main control electronic device and at least one user electronic device, wherein the main control electronic device has a camera module, a sound module and a display module, and the main control electronic device obtains a video and audio data of a live broadcaster through the camera module and the sound module, and the video and audio data includes a real-time image and a real-time voice, and the at least one user electronic device has a display module and a speaker; the online live interactive field navigation system includes: An image database, storing at least one panoramic environment image of at least one field object; A server is signal-connected to the image database, the main control electronic device and the at least one user electronic device. The server obtains the at least one panoramic environment image of the at least one scene object from the image database and continuously receives the audio and video data from the main control electronic device. The server generates a live audio and video data according to the at least one panoramic environment image and the continuously received audio and video data. The live audio and video data has a navigation image and a navigation image. voice, the navigation image includes a foreground image and a background image, the foreground image includes the real-time image, the background image includes the at least one panoramic environment image, and the navigation voice includes the real-time voice; the server continuously transmits the live video and audio data to the at least one user electronic device to display the navigation image on the display module of the at least one user electronic device and play the navigation voice on the speaker of the at least one user electronic device; Wherein, the server controls the panoramic environment image in the background image of the live video data according to a first control instruction corresponding to the master electronic device; Wherein, the server receives a control authorization instruction sent by the master electronic device, and grants a control authority to the at least one user electronic device according to the control authorization instruction. When the server receives at least one second control instruction sent by the at least one user electronic device, the server controls the panoramic environment image of the background image of the live video data according to the at least one second control instruction, and transmits the live video data to the master electronic device and the at least one user electronic device, so as to synchronously display the navigation image on the display module of the master electronic device and the display module of the at least one user electronic device. An online live interactive site navigation system as described in claim 1, wherein the number of the at least one user electronic device is plural; wherein after the server receives a control authorization request from any of the user electronic devices, the control authorization request of the corresponding user electronic device is transmitted to the master electronic device, and the control authorization instruction received by the server from the master electronic device includes a designated user instruction, and the designated user instruction designates one of the user electronic devices; the server grants the corresponding user electronic device the control authority according to the designated user instruction. An online live interactive site navigation system as described in claim 2, wherein after the server receives a deauthorization command from the master electronic device, it revokes the control authority of the user electronic device corresponding to the designated user command. An online live interactive scene navigation system as described in claim 1, wherein the image database stores a plurality of at least one panoramic environment image, and the panoramic environment images correspond to a plurality of spaces of the at least one scene object; wherein the server receives a space switching request from the at least one user electronic device, and the space switching request specifies one of the spaces; the server transmits the space switching request to the master electronic device, and after the server receives a space switching permission instruction from the master electronic device, the server generates the live audio and video data according to the panoramic environment image of the space specified by the space switching request and the audio and video data continuously received. An online live interactive scene navigation system as described in claim 1, wherein the at least one scene object is plural, and the image database stores the at least one panoramic environment image of each scene object; wherein the server receives all object switching requests from the at least one user electronic device, and the object switching request specifies one of the scene objects; the server transmits the object switching request to the master electronic device, and after the server receives an instruction from the master electronic device allowing object switching, the server generates the live audio and video data based on the panoramic environment image of the scene object specified by the object switching request and the audio and video data continuously received. The online live interactive field navigation system as described in claim 1, wherein the server recognizes the body posture of the live broadcaster based on the real-time image of the audio and video data received from the main control electronic device, and generates the first control instruction based on the recognized body posture. An online live interactive field navigation system as described in claim 1, wherein the server recognizes the voice of the live broadcaster based on the real-time voice of the video data received from the main control electronic device, and generates the first control instruction based on the recognized voice. An online live interactive scene navigation system as described in claim 1, wherein the server receives at least one marking instruction from the at least one user electronic device, and the at least one marking instruction specifies at least one area in the background image corresponding to the panoramic environment image; the server adds at least one mark to the at least one area in the background image of the live video data corresponding to the panoramic environment image according to the at least one marking instruction. An online live interactive scene navigation system as described in claim 8, wherein the server captures a regional image of at least one area of the background image of the live video data corresponding to the panoramic environment image, and creates a list including the regional image. An online live interactive site navigation system as described in claim 9, wherein the server receives a dialogue message corresponding to the area image from the at least one user electronic device, and appends the dialogue message to the list; the server receives a reply message corresponding to the dialogue message from the at least one master electronic device, and appends the reply message to the list.

Images