WO2022107197A1 - 3d virtual real space providing server, 3d virtual real space providing method, 3d virtual real space providing program, 3d virtual real space reproduction control device, 3d virtual real space reproduction control method, 3d virtual real space reproduction control program, and 3d virtual reality space providing system - Google Patents

Abstract

According to one embodiment, provided is a 3D virtual reality space providing server comprising: a 3D virtual reality space generation means for generating a 3D virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars can speak in the 3D virtual reality space by speaking to the corresponding user's microphone; a recording means for recording, on a storage medium, a part including characters and a part including two or more avatars having a conversation among the plurality of avatars in the 3D virtual reality space such that the parts can be reproduced later, and the conversation is composed of remarks of at least one of the plurality of avatars; a search means for searching the storage medium for a remark or character corresponding to a search query from any of the plurality of users; and a reproduction data generation means for generating reproduction data for reproducing at least a part including the found remarks or characters in the 3D virtual reality space recorded in the storage medium by a 3D virtual reality space reproduction control device used by any one of the users.

Description

3D virtual real space providing server, 3D virtual real space providing method, 3D virtual real space providing program, 3D virtual real space reproduction control device, 3D virtual real space reproduction control method, 3D virtual real space reproduction control program , And a 3D virtual reality space providing system

The present invention is a three-dimensional virtual real space providing server, a three-dimensional virtual real space providing method, a three-dimensional virtual real space providing program, a three-dimensional virtual real space reproduction control device, a three-dimensional virtual real space reproduction control method, and a three-dimensional virtual reality. It relates to a space reproduction control program and a three-dimensional virtual reality space providing system.

It is not easy to reproduce the conversations and materials presented in the past later. This is the same in the real world and in the three-dimensional virtual reality space. It should be noted that Patent Documents 1 and 2 only disclose the two-dimensional virtual reality space.

Japanese Unexamined Patent Publication No. 2001-23801 Japanese Unexamined Patent Publication No. 2008-083837

The present invention has been made in view of such problems, and the subject of the present invention is a three-dimensional virtual real space providing server that can easily reproduce statements and / or characters in the three-dimensional virtual real space later. 3D virtual real space provision method, 3D virtual real space provision program, 3D virtual real space reproduction control device, 3D virtual real space reproduction control method, 3D virtual real space reproduction control program, and 3D virtual real space It is to provide a providing system.

According to one embodiment, it is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. A conversation between a 3D virtual reality space generation means capable of speaking in the 3D virtual reality space by speaking to a microphone, a part of the 3D virtual reality space including characters, and a plurality of avatars. It is a recording means for recording a portion including two or more avatars and a storage medium for later reproduction, and the conversation is composed of remarks of at least one avatar among the plurality of avatars. , The recording means, the search means for searching the storage medium for statements or characters corresponding to the search query from any of the plurality of users, and the three-dimensional virtual reality space recorded in the storage medium. A three-dimensional virtual device including, a reproduction data generation means for generating reproduction data for reproducing at least the portion including the searched remark or character by the three-dimensional virtual reality space reproduction control device used by any of the users. A real space providing server is provided.

According to one embodiment, it is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. Two or more of the plurality of avatars in the three-dimensional virtual reality space and the three-dimensional virtual reality space generation means that can speak in the three-dimensional virtual reality space by speaking to the microphone. A recording means for recording a portion including the avatar in a storage medium so that the portion including the avatar can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars, and the plurality of recording means. A search means for searching the storage medium for a statement corresponding to a search query from any of the users, and a portion of the three-dimensional virtual reality space recorded in the storage medium including at least the searched statement. Is provided with a three-dimensional virtual reality space providing server provided with a reproduction data generation means for generating reproduction data for reproduction by the three-dimensional virtual reality space reproduction control device used by any one of the users.

According to one embodiment, a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and a character in the three-dimensional virtual real space are included. A recording means for recording a portion on a storage medium so that the portion can be reproduced later, a search means for searching the storage medium for characters corresponding to a search query from any of the plurality of users, and recording on the storage medium. Reproduction data generation means for generating reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space by the three-dimensional virtual reality space reproduction control device used by any of the users. And, a three-dimensional virtual real space providing server is provided.

The recording means includes a conversation detecting means for detecting that a conversation has started between the two or more avatars, and the recording means records a portion including the two or more avatars in response to the detection of the start of the conversation. You may.

When any of the plurality of avatars speaks, the conversation detection means has another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value. It may be determined that the conversation has started between the two or more avatars.

The recording means may record a portion including the two or more avatars in units of the detected conversation.

The search means may search for a unit of conversation including a statement corresponding to the search query.

The reproduction data generation means may generate the reproduction data for reproducing the searched unit of conversation.

The recording means may record the remarks of at least one avatar in association with the remarked avatar.

The recording means may record text data obtained by performing voice recognition for the remarks of the two or more avatars.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a control means for setting the first time point.

Even after the second time point has elapsed, the search means may search the storage medium for remarks corresponding to the search query, and the reproduction data generation means may generate the reproduction data.

The recording means may record characters in the material presented by any avatar in the three-dimensional virtual reality space.

The recording means may record characters written by any of the avatars in the three-dimensional virtual reality space in response to an operation on the controller of the user corresponding to the avatar of the plurality of avatars.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a control means for setting the first time point.

Even after the second time point has elapsed, the search means may search for characters corresponding to the search query from the storage medium, and the reproduction data generation means may generate the reproduction data.

The search means may perform a keyword search.

The search means may perform a similar search.

The search means may perform a concept search.

The recording means may always record the three-dimensional virtual reality space.

According to one embodiment, it is a three-dimensional virtual reality space generation step for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. Two or more of the plurality of avatars in the three-dimensional virtual reality space and the three-dimensional virtual reality space generation step that can speak in the three-dimensional virtual reality space by speaking to the microphone of The recording step of recording the portion including the avatar in the storage medium so that the portion including the avatar can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars, and the plurality of recording steps. A search step for searching the storage medium for a statement corresponding to a search query from any of the users, and a portion of the three-dimensional virtual reality space recorded in the storage medium including at least the searched statement. Is provided, a three-dimensional virtual reality space providing method including a reproduction data generation step for generating reproduction data for reproduction by the three-dimensional virtual reality space reproduction control device used by any one of the users.

According to one embodiment, a three-dimensional virtual real space generation step for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and a character in the three-dimensional virtual real space are included. A recording step of recording a portion on a storage medium for later reproduction, a search step of searching the storage medium for characters corresponding to a search query from any of the plurality of users, and recording on the storage medium. A reproduction data generation step for generating reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space by the three-dimensional virtual reality space reproduction control device used by any of the users. A method for providing a three-dimensional virtual real space is provided.

According to one embodiment, it is a three-dimensional virtual reality space generation step of generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active on a computer, and each of the plurality of avatars is a step. Have a conversation between the 3D virtual reality space generation step, which can speak in the 3D virtual reality space by speaking to the corresponding user's microphone, and the plurality of avatars in the 3D virtual reality space. A recording step of recording a portion including two or more avatars in a storage medium so that the portion including the two or more avatars can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars. Of the search step of searching the storage medium for a statement corresponding to a search query from any of the plurality of users and the three-dimensional virtual reality space recorded in the storage medium, at least the searched statement. A three-dimensional virtual reality space providing program for executing a reproduction data generation step for generating reproduction data for reproducing the portion including the above in the three-dimensional virtual reality space reproduction control device used by any of the above users is provided. ..

According to one embodiment, of the three-dimensional virtual real space generation step of generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active on a computer, and the three-dimensional virtual real space. A recording step of recording a portion including characters on a storage medium so that the portion including characters can be reproduced later, a search step of searching the storage medium for characters corresponding to a search query from any of the plurality of users, and the storage medium. Reproduction to generate reproduction data for reproducing at least the portion including the searched character in the 3D virtual reality space recorded in the 3D virtual reality space reproduction control device used by any of the users. A three-dimensional virtual real space providing program including a data generation step is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. Sending a search query for searching for statements and characters in space to a 3D virtual real space providing server that records at least a part of the 3D virtual real space on a storage medium so that it can be played back later. From the three-dimensional virtual reality space providing server, the means and the reproduction data for reproducing at least the portion including the remarks or characters corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium. A three-dimensional virtual real space reproduction control device including a reproduction control means for receiving and reproducing the portion to the reproduction device is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. A search query transmission means for transmitting a search query for searching for a statement in space to a 3D virtual reality space providing server that records at least a part of the 3D virtual reality space on a storage medium so that it can be reproduced later. The reproduction data for reproducing at least the portion including the remark corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the said A three-dimensional virtual real space reproduction control device including a reproduction control means for causing the reproduction device to reproduce a portion is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. A search query transmission means for transmitting a search query for searching for characters in space to a 3D virtual real space providing server that records at least a part of the 3D virtual real space on a storage medium so that it can be reproduced later. The reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the said A three-dimensional virtual real space reproduction control device including a reproduction control means for causing the reproduction device to reproduce a portion is provided.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a setting means for accepting the setting of the first time point.

Even after the second time point has passed, the search query transmitting means can transmit the search query, and the reproduction control means may regenerate the portion to the reproduction device.

The three-dimensional virtual reality space reproduction control device may be a glasses-type wearable device.

According to one embodiment, it is a three-dimensional virtual real space reproduction control method in a three-dimensional virtual real space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual real space. A search query for searching for a statement in the three-dimensional virtual real space is transmitted to a three-dimensional virtual real space providing server that records at least a part of the three-dimensional virtual real space on a storage medium so that it can be reproduced later. The search query transmission step and the reproduction data for reproducing at least the portion including the remark corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium are generated by the three-dimensional virtual reality space providing server. Provided is a three-dimensional virtual real space reproduction control method including a reproduction control step of receiving from and causing the reproduction device to reproduce the portion.

According to one embodiment, it is a three-dimensional virtual real space reproduction control method in a three-dimensional virtual real space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual real space. A search query for searching for characters in the three-dimensional virtual real space is transmitted to a three-dimensional virtual real space providing server that records at least a part of the three-dimensional virtual real space on a storage medium so that it can be reproduced later. The search query transmission step and the reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium are generated by the three-dimensional virtual reality space providing server. Provided is a three-dimensional virtual real space reproduction control method including a reproduction control step of receiving from and causing the reproduction device to reproduce the portion.

According to one embodiment, a user uses a three-dimensional virtual real space reproduction control device for activating an avatar corresponding to the user in the three-dimensional virtual real space, and searches for remarks in the three-dimensional virtual real space. A search query transmission step for transmitting a search query for transmission to a server for providing a 3D virtual real space, which is recorded in a storage medium so that at least a part of the 3D virtual real space can be reproduced later, and recording in the storage medium. Reproduction data for reproducing at least the portion including the statement corresponding to the search query is received from the three-dimensional virtual reality space providing server, and the portion is reproduced in the reproduction device. A three-dimensional virtual real space reproduction control program for executing the reproduction control step is provided.

According to one embodiment, a character in the three-dimensional virtual real space is searched for by a three-dimensional virtual real space reproduction control device used by the user and for activating the avatar corresponding to the user in the three-dimensional virtual real space. A search query transmission step for transmitting a search query for transmission to a server for providing a 3D virtual real space, which is recorded in a storage medium so that at least a part of the 3D virtual real space can be reproduced later, and recording in the storage medium. Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space is received from the three-dimensional virtual reality space providing server, and the portion is reproduced in the reproduction device. A three-dimensional virtual real space reproduction control program for executing the reproduction control step is provided.

According to one embodiment, a three-dimensional virtual reality space providing system including the three-dimensional virtual reality space providing server and the three-dimensional virtual reality space reproduction control device is provided.

The block diagram which shows the schematic structure of the VR space provision system which concerns on one Embodiment. The figure which shows an example of the content of the conversation which is recorded in the storage medium 22 by the recording unit 26 schematically.

Hereinafter, embodiments will be exemplified by way of drawing. In this embodiment, a plurality of avatars corresponding to each of the plurality of users are active in a virtual reality (hereinafter referred to as "VR") space. Activities in VR space include talking with other avatars, presenting materials, writing letters, and so on. Then, the VR space including conversations and materials is recorded. The user can search the recorded VR space and play back the scene hit by the search. As a result, conversations held in the VR space, presented materials, and the like can be easily reproduced later.

In this embodiment, a three-dimensional VR space that expands three-dimensionally is assumed, and unless otherwise specified, the term "VR space" simply refers to a three-dimensional VR space.

FIG. 1 is a block diagram showing a schematic configuration of a VR space providing system according to an embodiment. This VR space providing system includes a VR space reproduction control device (hereinafter, simply referred to as "user device 1") used by the user and a VR space providing server (hereinafter, simply referred to as "server 2"). Although only one user device 1 is drawn in FIG. 1, the VR space providing system may actually include two or more user devices 1.

The user device 1 is used by the user, and is used to activate the avatar corresponding to the user in the VR space and to see and hear the state of the VR space. The user device 1 is a VR device such as goggles, smart glasses (glasses-type wearable device), and a lens, and includes a communication unit 11, a display 12, a speaker 13, a controller 14, and a microphone 15.

The communication unit 11 transmits various data and information to the server 2 and receives various data and information from the server 2. There are no particular restrictions on the means of communication with the server 2.

The display 12 reproduces the VR space as an image. More specifically, the display 12 displays the activities of other avatars in the VR space, various materials used in the VR space, and the like. It is desirable that the display 12 can be displayed in three dimensions. When the user device 1 is a smart glass or the like, the display 12 includes a display for the right eye and a display for the left eye.

The speaker 13 reproduces the VR space as voice. More specifically, the speaker 13 outputs the remarks of other avatars in the VR space.

As will be described later, the display 12 and the speaker 13 of the present embodiment can not only reproduce the current VR space in real time, but also reproduce the past VR space. Further, the display 12 and the speaker 13 can also be called a reproduction device. The reproduction data necessary for the display 12 and the speaker 13 to reproduce the VR space is received from the server 2 via the communication unit 11.

The controller 14 is used to activate the avatar corresponding to the user in the VR space. For example, the avatar can move in the VR space according to a predetermined action on the controller 14 by the user. Further, the avatar can present a desired material (that is, open an electronic file) in the VR space according to a predetermined action on the controller 14 by the user. Further, the avatar can write characters in the VR space in response to the user's operation on the controller 14. Information indicating the user's operation with respect to the controller 14 is transmitted from the communication unit 11 to the server 2.

The microphone 15 is used to make the avatar corresponding to the user speak in the VR space. That is, the user's voice picked up by the microphone 15 is reproduced in the VR space as the avatar's remark corresponding to the user. Information indicating the user's voice picked up by the microphone 15 is transmitted from the communication unit 11 to the server 2.

Further, the user device 1 has a setting unit 16, a search query transmission unit 17, and a reproduction control unit 18. Some or all of these functions may be configured in hardware, or may be realized by the processor of the user device 1 executing a predetermined program.

The VR space in this embodiment may be usable only for a specific period such as a rental conference room or a rental office. Note that "use" here means that the user activates the avatar in the VR space.

Then, the setting unit 16 makes a reservation for using the VR space. The setting unit 16 receives the reservation information necessary for the reservation of the VR space via the user operation using the controller 14 or the microphone 15. Then, the setting unit 16 reserves the VR space by transmitting the reservation information to the server 2.

Here, the reservation information may include information indicating information (user ID) that identifies the user at the start time and end time of use of the VR space. The user ID may be only the user ID that identifies itself, or may include the user ID of another user who uses the VR space. The reservation information may include information indicating the period of use of the VR space instead of the time when the use of the VR space ends.

The search query transmission unit 17 accepts an arbitrary search query via a user operation using the controller 14 or the microphone 15. The search query may be textual information or voice information. Then, the search query sends the received search query to the server 2. The details of the search will be described later, but the search query is for searching for statements and characters in the VR space.

The reproduction control unit 18 controls the reproduction device to reproduce at least a part of the VR space. More specifically, the reproduction control unit 18 receives the reproduction data (display data) necessary for reproducing the VR space as an image from the server 2 via the communication unit 11, and displays the image based on the reproduction data. Take control. Further, the reproduction control unit 18 receives reproduction data (voice data) necessary for reproducing the VR space by voice from the server 2, and performs voice output control based on the reproduction data.

On the other hand, the server 2 has a communication unit 21 and a storage medium 22. The communication unit 21 transmits various data and information to the server 2 and receives various data and information from the server 2. There are no particular restrictions on the means of communication with the server 2. The storage medium 22 is, for example, a hard disk, and stores various data, information, VR space, and the like. The storage medium 22 may be a device separate from the server 2.

Further, the server 2 has a control unit 23, a VR space generation unit 24, a conversation detection unit 25, a recording unit 26, a search unit 27, and a reproduction data generation unit 28. Some or all of these functions may be configured in hardware, or may be realized by the processor of the server 2 executing a predetermined program.

The control unit 23 reserves the VR space based on the reservation information from the user device 1. That is, the control unit 23 sets a use start time point and a use end time point in which the user can activate the avatar. As a result, the user specified by the user ID included in the reservation information can activate the avatar corresponding to himself / herself in the VR space.

The VR space generation unit 24 generates a VR space in which avatars corresponding to a plurality of users are active. Further, the VR space generation unit 24 receives the user operation on the controller 14 of the user device 1 and the voice picked up by the microphone 15 via the communication unit 21 and reflects them in the VR space.

For example, when a user performs an operation for moving an avatar to the controller 14, the VR space generation unit 24 moves the avatar corresponding to the user in the VR space according to the operation. That is, the avatar can move in the VR space according to the operation on the controller 14 used by the corresponding user.

Further, when a certain user speaks to the microphone 15, the VR space generation unit 24 causes the avatar corresponding to the user to speak in the VR space according to the utterance. That is, the avatar can speak in the VR space by speaking to the microphone 15 used by the corresponding user.

The conversation detection unit 25 detects that a conversation between avatars has started in the VR space. As an example, the conversation detection unit 25 determines that a conversation has started between these avatars when one or more other avatars are nearby when any avatar speaks in the VR space. Here, the conversation detection unit 25 can determine that the person is "near" when the distance between the speaking avatar and another avatar in the VR space is equal to or less than a predetermined distance. This predetermined distance may be a constant value or may be one according to the loudness of the voice of the avatar who spoke.

Further, the conversation detection unit 25 may detect that the conversation has ended. As an example, the conversation detection unit 25 does not speak for a certain period of time among the avatars having a conversation, or when the distances in the VR space between the avatars having a conversation are all equal to or more than a predetermined distance. The conversation detection unit 25 determines that the conversation has ended.

In addition, the "conversation" in the present specification is not only a mode in which two or more avatars speak to each other, but also a mode in which one avatar unilaterally speaks to another avatar (for example, a lecturer speaks to a student at a seminar). The case of giving a lecture) is also included. In any case, the conversation takes place with two or more avatars and consists of the remarks of at least one of the avatars.

The recording unit 26 records video data and audio data on the storage medium 22 so that at least a part of the VR space can be reproduced later. The recording unit 26 may record the entire VR space on the storage medium 22 at all times, or may record by focusing on conversation and / or characters as described below.

The recording unit 26 may record a portion of the VR space including two or more avatars having a conversation as video data and audio data. More specifically, the recording unit 26 records at least a part of the VR space including two or more avatars having a conversation in response to the conversation detection unit 25 detecting the start of the conversation. May be good. Then, the recording unit 26 may stop recording the conversation when the conversation detection unit 25 detects the end of the conversation or when a predetermined time has elapsed from the start of the conversation. In this case, the recording unit 26 records the VR space in units of conversation.

The recording unit 26 may record the conversation only with voice data, but it is desirable to perform voice recognition and record the text data as well. This is because it is easy to search.

FIG. 2 is a diagram schematically showing an example of the contents of a conversation recorded on the storage medium 22 by the recording unit 26. The recording unit 26 assigns an ID (conversation ID) that identifies the conversation for each conversation. Then, the recording unit 26 records the content of the remark in each conversation at the time of remark and in association with the speaker. In the example of FIG. 2, at exactly 10 o'clock on October 15, 2020, Avatar A says, "Well, we will start the regular meeting in October."

By doing so, it becomes easy to identify the avatar who made the remark corresponding to the search query and to specify the time when the remark was made at the time of the search described later.

Returning to FIG. 1, the recording unit 26 may record a part including characters in the VR space as video data and audio data. The "character" here includes both the characters in the material (electronic file) presented by the avatar and the characters written by the avatar. Letters are also recorded in association with the date and time presented (or written) and the avatar presented (or written).

The search unit 27 searches the storage medium 22 for statements and / or characters corresponding to the search query transmitted from the search query transmission unit 17 of the user device 1. The search unit 27 may perform a keyword search, a similar search, a concept search, or may utilize AI (artificial intelligence) for the search as needed.

The search unit 27 may perform a search in units of remarks or in units of conversations. For example, in FIG. 2, when the search query is "October's regular meeting", the search unit 27 starts the October regular meeting in the avatar A's remark 1 "in the conversation ID" 01 "with the remark as a unit. May be specified. Alternatively, the search unit 27 may specify the conversation ID "01" including the statement corresponding to the search query in units of conversation.

Note that the search query may include information on whether to search only the remarks, only the characters, or both the remarks and the characters.

Returning to FIG. 1, the reproduction data generation unit 28 generates reproduction data for reproducing the portion (scene) including the searched remarks or characters in the VR space recorded in the storage medium 22 on the user device 1. .. The generated reproduction data is transmitted to the user device 1 via the communication unit 21.

For example, when a certain remark is specified by the search unit 27, the replay data generation unit 28 may generate replay data for replaying only the remark, or replay data for replaying a conversation including the remark. May be generated, or reproduction data for reproducing from a predetermined time before to a predetermined time after the time when the statement is made may be generated.

Further, when a certain character is specified by the search unit 27, the reproduction data generation unit 28 may generate reproduction data for reproducing only the time when the character is presented (or written). Reproduction data for reproducing from a predetermined time before to a predetermined time after the time when the character is presented (or written) may be generated.

It is desirable that the reproduction data includes both video data for displaying video on the display 12 of the user device 1 and audio data for outputting audio on the speaker 13 of the user device 1. However, the reproduction data generation unit 28 may generate only audio data when reproducing a remark, or may generate only video data when reproducing characters.

As mentioned above, the user can use the VR space only for a specific period. In this case, it may not be possible to search after the end of use, but it is desirable that the search can be performed even after the end of use. Specifically, even after the expiration date has passed, the search query transmission unit 17 of the user device 1 can send a search query, and the search unit 27 of the server 2 searches for statements and characters corresponding to the search query, and reproduces data. It is desirable that the generation unit 28 generate the reproduction data.

In this way, in this embodiment, remarks and characters in the VR space can be recorded and searched. Therefore, the remarks and characters in the VR space can be easily reproduced later. For example, creating minutes after a meeting is cumbersome and lacks accuracy, but according to this embodiment, such minutes are not required.

The above-described embodiment is described for the purpose of allowing a person having ordinary knowledge in the technical field to which the present invention belongs to carry out the present invention. Various modifications of the above embodiment can be naturally made by those skilled in the art, and the technical idea of the present invention can be applied to other embodiments. Accordingly, the invention is not limited to the described embodiments and should be the broadest scope in accordance with the technical ideas defined by the claims.

1 3D VR space reproduction control device (user device)
11 Communication unit 12 Display 13 Speaker 14 Controller 15 Microphone 16 Setting unit 17 Search query transmission unit 18 Playback control unit 2 3D VR space providing server 21 Communication unit 22 Storage medium 23 Control unit 24 VR space generation unit 25 Conversation detection unit 26 Recording Part 27 Search part 28 Playback data generation part

Claims (35)

It is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
A recording means for recording a part including characters in the three-dimensional virtual reality space and a part including two or more avatars having a conversation among the plurality of avatars on a storage medium so that they can be reproduced later. Therefore, the conversation is composed of the remarks of at least one of the plurality of avatars, and the recording means.
A search means for searching the storage medium for a statement or character corresponding to a search query from any of the plurality of users.
Reproduction for reproducing at least the portion including the searched remarks or characters in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual reality space providing server including a reproduction data generation means for generating data. It is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
A recording means for recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later. A recording means consisting of the remarks of at least one of the avatars of
A search means for searching the storage medium for statements corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A three-dimensional virtual reality space providing server including a reproduction data generation means for generating. A 3D virtual reality space generation means that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active.
A recording means for recording a portion of the three-dimensional virtual reality space containing characters on a storage medium so that it can be reproduced later.
A search means for searching the storage medium for characters corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A three-dimensional virtual reality space providing server including a reproduction data generation means for generating. A conversation detection means for detecting that a conversation has started between the two or more avatars is provided.
The three-dimensional virtual reality space providing server according to claim 1 or 2, wherein the recording means records a portion including the two or more avatars in response to the detection of the start of a conversation. When any of the plurality of avatars speaks, the conversation detection means has another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value. The three-dimensional virtual reality space providing server according to claim 4, wherein it is determined that a conversation has started between the two or more avatars. The three-dimensional virtual reality space providing server according to claim 4 or 5, wherein the recording means records a portion including the two or more avatars in units of detected conversations. The three-dimensional virtual reality space providing server according to claim 6, wherein the search means searches for a unit of conversation including a statement corresponding to the search query. The three-dimensional virtual reality space providing server according to claim 7, wherein the reproduction data generation means generates the reproduction data for reproducing the searched unit of conversation. The three-dimensional virtual reality space providing server according to any one of claims 1, 2, and 4 to 8, wherein the recording means records the remarks of at least one avatar in association with the remarked avatar. The three-dimensional virtual according to any one of claims 1, 2, and 4 to 9, wherein the recording means records text data obtained by performing voice recognition for the remarks of the two or more avatars. Real space providing server. Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point.
The three-dimensional virtual reality space providing server according to any one of claims 1, 2, and 4 to 10, further comprising a control means for setting the first time point. Even after the second time point has passed
The search means searches the storage medium for a statement corresponding to the search query, and then searches for the statement.
The reproduction data generation means generates the reproduction data.
The three-dimensional virtual reality space providing server according to claim 11. The 3D virtual reality space providing server according to claim 1 or 3, wherein the recording means records characters in a material presented by any avatar in the 3D virtual reality space. The recording means records the characters written in the three-dimensional virtual reality space by the one avatar in response to the operation of the user corresponding to the avatar of the plurality of avatars with respect to the controller. , The three-dimensional virtual reality space providing server according to claim 3 or 13. Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point.
The three-dimensional virtual reality space providing server according to claim 1, claim 3 or claim 14, further comprising a control means for setting the first time point. Even after the second time point has passed
The search means searches the storage medium for characters corresponding to the search query, and then searches for the characters.
The reproduction data generation means generates the reproduction data.
The three-dimensional virtual reality space providing server according to claim 15. The search means is the three-dimensional virtual reality space providing server according to any one of claims 1 to 16, which performs a keyword search. The search means is the three-dimensional virtual reality space providing server according to any one of claims 1 to 16, which performs a similar search. The search means is the three-dimensional virtual reality space providing server according to any one of claims 1 to 16, which performs a concept search. The three-dimensional virtual reality space providing server according to any one of claims 1 to 19, wherein the recording means constantly records the three-dimensional virtual reality space. It is a three-dimensional virtual reality space generation step of generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation step that can speak in the 3D virtual reality space,
It is a recording step of recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later, and the conversation is the plurality of avatars. A recording step consisting of the remarks of at least one of the avatars in
A search step for searching the storage medium for statements corresponding to a search query from any of the plurality of users, and a search step.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A three-dimensional virtual reality space providing method including a reproduction data generation step to be generated. A 3D virtual reality space generation step that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active, and
A recording step of recording a portion of the three-dimensional virtual reality space containing characters on a storage medium so that it can be reproduced later.
A search step for searching the storage medium for characters corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A three-dimensional virtual reality space providing method including a reproduction data generation step to be generated. On the computer
It is a three-dimensional virtual reality space generation step of generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation step that can speak in the 3D virtual reality space,
It is a recording step of recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later, and the conversation is the plurality of avatars. A recording step consisting of the remarks of at least one of the avatars in
A search step for searching the storage medium for statements corresponding to a search query from any of the plurality of users, and a search step.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A 3D virtual reality space providing program that executes the playback data generation step to be generated. On the computer
A 3D virtual reality space generation step that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active, and
A recording step of recording a portion of the three-dimensional virtual reality space containing characters on a storage medium so that it can be reproduced later.
A search step for searching the storage medium for characters corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any of the users. A three-dimensional virtual reality space providing program including a reproduction data generation step to be generated. A 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
With a playback device
A search query for searching for statements and characters in the 3D virtual reality space is recorded in a storage medium so that at least a part of the 3D virtual reality space can be reproduced later on the 3D virtual reality space providing server. Search query sending means to send,
Reproduction data for reproducing at least a portion including a statement or a character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server. A three-dimensional virtual reality space reproduction control device including a reproduction control means for causing the reproduction device to reproduce the portion. A 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
With a playback device
A search query for searching for a statement in the 3D virtual reality space is transmitted to a 3D virtual reality space providing server that records at least a part of the 3D virtual reality space on a storage medium so that it can be reproduced later. Search query transmission method and
Reproduction data for reproducing at least the portion including the statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. A three-dimensional virtual reality space reproduction control device including a reproduction control means for causing the reproduction device to reproduce. A 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
With a playback device
A search query for searching for characters in the three-dimensional virtual reality space is transmitted to a three-dimensional virtual reality space providing server that records at least a part of the three-dimensional virtual reality space on a storage medium so that it can be reproduced later. Search query transmission method and
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A three-dimensional virtual reality space reproduction control device including a reproduction control means for causing the reproduction device to reproduce. Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point.
The three-dimensional virtual reality space reproduction control device according to any one of claims 25 to 27, comprising a setting means for receiving the setting at the first time point. Even after the second time point has passed
The search query sending means can send the search query,
The three-dimensional virtual reality space reproduction control device according to claim 28, wherein the reproduction control means causes the reproduction device to reproduce the portion. The three-dimensional virtual reality space reproduction control device according to any one of claims 25 to 29, which is a glasses-type wearable device. It is a 3D virtual reality space reproduction control method in a 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a statement in the 3D virtual reality space is transmitted to a 3D virtual reality space providing server that records at least a part of the 3D virtual reality space on a storage medium so that it can be reproduced later. Search query submission step and
Reproduction data for reproducing at least the portion including the statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. A three-dimensional virtual reality space reproduction control method including a reproduction control step for causing the reproduction device to reproduce. It is a 3D virtual reality space reproduction control method in a 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for characters in the three-dimensional virtual reality space is transmitted to a three-dimensional virtual reality space providing server that records at least a part of the three-dimensional virtual reality space on a storage medium so that it can be reproduced later. Search query submission step and
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A three-dimensional virtual reality space reproduction control method including a reproduction control step for causing the reproduction device to reproduce. A 3D virtual reality space playback control device used by the user to activate the avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a statement in the 3D virtual reality space is transmitted to a 3D virtual reality space providing server that records at least a part of the 3D virtual reality space on a storage medium so that it can be reproduced later. Search query submission step and
Reproduction data for reproducing at least the portion including the statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. A 3D virtual reality space reproduction control program that executes a reproduction control step that causes the reproduction device to reproduce. A 3D virtual reality space playback control device used by the user to activate the avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for characters in the three-dimensional virtual reality space is transmitted to a three-dimensional virtual reality space providing server that records at least a part of the three-dimensional virtual reality space on a storage medium so that it can be reproduced later. Search query submission step and
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A 3D virtual reality space playback control program that causes the playback device to play the playback control step. The three-dimensional virtual reality space providing server according to any one of claims 1 to 20 and
A three-dimensional virtual reality space providing system comprising the three-dimensional virtual reality space reproduction control device according to any one of claims 25 to 30.

Images