[go: up one dir, main page]

WO2018176309A1 - Virtual library device, virtual reality headpiece, and virtual reading system - Google Patents

Virtual library device, virtual reality headpiece, and virtual reading system Download PDF

Info

Publication number
WO2018176309A1
WO2018176309A1 PCT/CN2017/078737 CN2017078737W WO2018176309A1 WO 2018176309 A1 WO2018176309 A1 WO 2018176309A1 CN 2017078737 W CN2017078737 W CN 2017078737W WO 2018176309 A1 WO2018176309 A1 WO 2018176309A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual
dimensional
book
module
dimensional virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/078737
Other languages
French (fr)
Chinese (zh)
Inventor
周木根
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Ar Technologies Co Ltd
Original Assignee
Shenzhen Ar Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Ar Technologies Co Ltd filed Critical Shenzhen Ar Technologies Co Ltd
Priority to PCT/CN2017/078737 priority Critical patent/WO2018176309A1/en
Publication of WO2018176309A1 publication Critical patent/WO2018176309A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof

Definitions

  • the present invention relates to the field of communication technologies, and in particular, to a virtual library device, a virtual reality helmet, and a virtual reading system.
  • Virtual reality technology is an integrated technology that integrates computer graphics, human-computer interaction, and sensing technologies. Through computer graphics, three-dimensional image space, such as visual, auditory, and olfactory, can be sensed. Virtual reality technology can design virtual space into a realistic real world, enabling experience and interaction.
  • the main object of the present invention is to solve the problem that the reading experience and the reading environment of the physical book which are not available in the digital reading in the prior art are solved, and the reading interest and the reading efficiency are effectively improved.
  • the present invention provides a virtual library device, comprising:
  • a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein
  • the three-dimensional virtual book includes a voice playing function
  • a control module configured to transmit the three-dimensional virtual book with the animated page turning function to the display device, so that the display device displays the three-dimensional virtual book with the animated page turning function.
  • the virtual library device further includes:
  • a visor generating module configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image
  • the control module is further configured to transmit the three-dimensional panoramic image to the display device, so that the display device displays the three-dimensional panoramic image.
  • the view generating module is further configured to create a three-dimensional virtual model
  • the control module is further configured to transmit the three-dimensional virtual model to the display device, so that the display device displays the three-dimensional virtual model.
  • control module is further configured to receive a first setting signal, and adjust attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the first setting signal.
  • the virtual library device further includes:
  • a note generation module configured to record note information of the three-dimensional virtual book
  • a virtual bookshelf module for creating a three-dimensional virtual bookshelf, classifying the three-dimensional virtual books, and placing the three-dimensional virtual books on the three-dimensional virtual bookshelf;
  • a sharing module configured to share the note information on the network in real time
  • the sharing module further includes a stylus and a touchpad, and the drawing information input by the stylus on the touchpad is real-time Share;
  • a playback module for playing audio data and/or video data.
  • the somatosensory virtual module is further configured to perform format conversion on the note information, and display the converted format note information in a browsing editor;
  • the control module is further configured to receive query information, and retrieve a corresponding three-dimensional virtual book according to the query information.
  • the present invention also provides a virtual reality helmet, which is connected to a virtual library device, and the virtual reality helmet includes:
  • the display module is configured to perform three-dimensional display of a three-dimensional virtual book, a three-dimensional panoramic image, and a three-dimensional virtual model with an animated page turning function.
  • the virtual reality helmet further comprises:
  • a processing module configured to store a picture including a natural scene, and generate the three-dimensional panoramic image according to the picture that includes a natural scene
  • a setting module configured to receive a second setting signal, and transmit the second setting signal to the virtual library device, for the virtual library device to view the three-dimensional virtual book according to the setting signal, The properties of the 3D panoramic image are adjusted.
  • the display module is further configured to display note information of the three-dimensional virtual book, display a three-dimensional virtual bookshelf, classify the three-dimensional virtual book, display the three-dimensional virtual bookshelf, and play audio data and / or video data.
  • the present invention further provides a virtual reading system, including a virtual library device, a virtual reality helmet, wherein the virtual library device includes:
  • a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein
  • the three-dimensional virtual book includes a voice playing function
  • control module configured to transmit the three-dimensional virtual book with an animated page turning function to the virtual reality helmet
  • the virtual reality helmet includes:
  • a display module configured to perform three-dimensional display of the three-dimensional virtual book with an animated page turning function transmitted by the virtual library device.
  • the virtual library device further includes:
  • a visor generating module configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image
  • the control module is further configured to transmit the three-dimensional panoramic image to the virtual reality helmet;
  • the display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional panoramic image.
  • the virtual reality helmet further comprises:
  • a setting module configured to receive the setting signal, and transmit the setting signal to the virtual library device, wherein the setting signal is used to adjust an attribute of the three-dimensional virtual book and the three-dimensional panoramic image;
  • the control module of the virtual library device is further configured to receive the setting signal transmitted by the setting module of the virtual reality helmet, and the three-dimensional virtual book and the three-dimensional panoramic image according to the setting signal The properties are adjusted.
  • the view generating module of the virtual library device is further configured to create a three-dimensional virtual model
  • the control module is further configured to transmit the three-dimensional virtual model to the virtual display helmet;
  • the display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional virtual model.
  • the virtual library device further includes:
  • a note generation module configured to record input note information of the three-dimensional virtual book
  • a virtual bookshelf module configured to create a three-dimensional virtual bookshelf, and classify the three-dimensional virtual books on the three-dimensional virtual bookshelf;
  • a sharing module for sharing the note information on the network in real time
  • the control module is further configured to receive the first query information, retrieve the corresponding three-dimensional virtual book according to the first query information, receive the second query information, and retrieve the note information of the three-dimensional virtual book according to the second query information. ;
  • the display module of the virtual reality helmet is further configured to display note information of the three-dimensional virtual book, a three-dimensional virtual bookshelf, wherein the three-dimensional virtual book is classified and displayed on the three-dimensional virtual bookshelf, and plays audio data. And / or video data.
  • the invention provides a virtual library device, a virtual reality helmet and a virtual reading system, which can virtualize an e-book in three dimensions, provide a user with a reading experience like a physical book, and also provide a three-dimensional panoramic image to provide an optional reading environment for the user.
  • the user provides a reading atmosphere that is compatible with the book, which makes the reader's reading experience richer and helps to improve readers' reading interest and efficiency.
  • FIG. 1 is a schematic diagram of functional modules of a first embodiment of a virtual library device according to the present invention
  • FIG. 2 is a schematic diagram of functional modules of a second embodiment of a virtual library device according to the present invention.
  • FIG. 3 is a schematic diagram of functional modules of a first embodiment of a virtual reality helmet according to the present invention.
  • FIG. 4 is a schematic diagram of functional modules of a second embodiment of a virtual reality helmet according to the present invention.
  • FIG. 5 is a system architecture diagram of a first embodiment of a virtual reading system according to the present invention.
  • FIG. 6 is a schematic diagram of functional modules of a second embodiment of a virtual reading system according to the present invention.
  • FIG. 7 is a workflow diagram of a first embodiment of a somatosensory virtual module of a virtual library device
  • FIG. 8 is a flowchart of a second embodiment of a somatosensory virtual module of a virtual library device
  • FIG. 9 is a schematic diagram of functional modules of a third embodiment of a virtual reading system according to the present invention.
  • FIG. 10 is a flowchart showing the operation of an embodiment of a view generation module of a virtual library device.
  • the present invention provides a virtual library device.
  • FIG. 1 is a schematic diagram of functional modules of a first embodiment of a virtual library device according to the present invention.
  • the virtual library device 10 shown in FIG. 1 includes a somatosensory virtual module 103 and a control module 104.
  • the virtual library device 10 is connected to the display device.
  • the virtual library device 10 can store a corresponding digital version of a book in a real library collection, and can also store a digital version of a book corresponding to a plurality of real library books.
  • the function modules are described in detail below.
  • the somatosensory virtual module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which specifically includes: correspondingly formatting, rendering, and texting the digitized text. It can read at a close distance and obtain the 3D virtual book through the 3D image processing after the typed digitized text.
  • the 3D virtual book includes the voice playing function.
  • the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online
  • the three-dimensional virtual book further includes a physical model related to the text content of the book, and the somatosensory virtual module 103
  • the animation page turning function is also created for the three-dimensional virtual book, that is, the action of flipping the physical book page, the page turning sound played during the page turning action, and the setting angle of setting the three-dimensional virtual book, and the manner of triggering the animation page turning function includes: simulating the three-dimensional The virtual arm model performs the page turning action through the 3D virtual arm model, or sets the reading time and time, triggers the page turning action after the preset time, can also turn the page by voice command, and can also tap the touchpad by finger Turn the page and play the page turning sound when you turn the page.
  • the control module 104 transmits the three-dimensional virtual book with the animated page turning function to the display device, so that the display device displays the three-dimensional virtual book with the animated page turning function, and the display device includes a mobile device capable of three-dimensional display, a virtual reality helmet and the like. .
  • the virtual library device provided by the invention can virtualize the electronic book in three dimensions, provide the user with the same reading experience as the physical book, and provides an animation page turning function similar to the physical book, which is beneficial to improving the reading interest and efficiency of the reader.
  • FIG. 2 is a schematic diagram of functional modules of a second embodiment of a virtual library device according to the present invention.
  • the virtual library device 10 shown in FIG. 2 includes a somatosensory virtual module 103, a control module 104, a view generation module 105, a note generation module 107, a virtual bookshelf module 109, a sharing module 111, and a play module 113.
  • the virtual library device 10 is connected to a display device.
  • the function modules are described in detail below.
  • the somatosensory simulation module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which comprises: correspondingly formatting, rendering, and texting the digitized text.
  • the invention can read at a close distance, and obtain the three-dimensional virtual book through the three-dimensional image processing by the typed digitized text, wherein the three-dimensional virtual book includes a voice playing function.
  • the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the text content of the book.
  • the somatosensory virtual module 103 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping the pages of the physical book, a page turning sound played when the animated page is turned, and setting a viewing angle of the three-dimensional virtual book.
  • the control module 104 transmits the three-dimensional virtual book with the animated page turning function to the display device for the display device to display the three-dimensional virtual book with the animated page turning function.
  • the visual generation module 105 creates a three-dimensional virtual model including virtual models of various animals, virtual models of various scenery, and the control module 104 transmits the three-dimensional virtual models to the display device for the display device to display the three-dimensional virtual model.
  • the visor generating module 105 is further configured to acquire a picture with a natural scene, and adopt a panoramic generation technology to obtain a three-dimensional panoramic image, for example, using a fisheye lens or a common camera for image collection, and acquiring some features.
  • the natural picture can also update the picture through the network.
  • different three-dimensional panoramic images can be generated, thus providing a variety of three-dimensional panoramic images, creating a variety of reading environments for the user.
  • the control module 104 transmits the three-dimensional panoramic image to the display device for the display device to display the three-dimensional panoramic image, providing the user with a different reading environment.
  • the control module 104 receives the first setting signal, and adjusts attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the first setting signal, for example, controls the text attribute of the three-dimensional virtual book.
  • the control module 104 also receives the query information and retrieves the corresponding three-dimensional virtual book based on the query information.
  • the note generation module 107 records the note information of the three-dimensional virtual book, and the note information includes the reading experience input by the user, the text creation, and the like.
  • the virtual bookshelf module 109 creates a three-dimensional virtual bookshelf, classifies the three-dimensional virtual books, and places them on the three-dimensional virtual bookshelf.
  • the sharing module 111 shares the note information on the network in real time.
  • the sharing module 111 further includes a stylus and a touchpad, and the drawing information input by the stylus on the touchpad is shared in real time.
  • the play module 113 of the virtual library device 10 is also used to play audio data and/or video data.
  • the virtual library device can virtualize the electronic book in three dimensions, provide the user with a reading experience like a physical book, and also provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book. Reading atmosphere, can provide virtual bookshelf and note sharing function, which helps to improve readers' interest and efficiency in reading.
  • the invention further provides a virtual reality helmet.
  • FIG. 3 is a schematic diagram of functional modules of a first embodiment of a virtual reality helmet according to the present invention.
  • the virtual reality helmet 20 of the present embodiment includes a display module 201.
  • the virtual reality helmet is connected to the virtual library device, and the display module 201 accepts a three-dimensional virtual book with an animated page turning function from the virtual library device, a three-dimensional panoramic image, and a three-dimensional virtual book with an animated page turning function and a three-dimensional panoramic image. Perform a three-dimensional display.
  • the three-dimensional virtual book is in a static state when displayed, and the three-dimensional virtual book is placed on the virtual platform, such as a virtual desk, and the position of the three-dimensional virtual book placed on the virtual desk can be adjusted.
  • the virtual library device provided in this embodiment can display a three-dimensional virtual book with an animated page turning function to the user, providing the user with a reading experience like a physical book, and providing the user with a reading atmosphere suitable for the book, which is beneficial to improve.
  • the reader's reading interest and efficiency in addition, because the three-dimensional virtual book in reading is in a static state, can effectively avoid the stun effect and delay effect caused by the movement, greatly reducing the workload of the server.
  • FIG. 4 is a schematic diagram of functional modules of a second embodiment of a virtual reality helmet according to the present invention.
  • the virtual reality helmet 20 of the embodiment includes a display module 201, a setting module 203, and a processing module 205.
  • the virtual reality helmet is connected to the virtual library device.
  • the function modules are described in detail below.
  • the display module 201 accepts a three-dimensional virtual book with an animated page turning function, a three-dimensional panoramic image from the virtual library device, and three-dimensionally displays the three-dimensional virtual book and the three-dimensional panoramic image with the animated page turning function.
  • the setting module 203 receives the second setting signal, and transmits the second setting signal to the virtual library device, so that the virtual library device adjusts the attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the setting signal, for example, adjusting The text attribute of the 3D virtual book.
  • the processing module 205 stores a picture containing a natural scene, and produces a three-dimensional panoramic image from the picture containing the natural scene.
  • the display module 201 also accepts the note information of the three-dimensional virtual book, the three-dimensional virtual bookshelf, and displays the three-dimensional virtual bookshelf, and classifies the three-dimensional virtual books, displays them on the three-dimensional virtual bookshelf, and displays them while displaying the three-dimensional virtual book.
  • the setting module 203 receives the setting information input by the user, adjusts or designs the attributes of the three-dimensional virtual bookshelf, and the display module 201 is further configured to play audio data and/or video data, and provide a function of playing the audio video.
  • the virtual reality helmet provided by the embodiment can display a three-dimensional virtualized book, provide a user with a reading experience like a physical book, and provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book.
  • the reading atmosphere is conducive to improving readers' interest and efficiency in reading.
  • the books in reading are at rest, the stun effect and delay effect caused by image movement can be effectively avoided, and the workload of the server is greatly reduced.
  • the invention further provides a virtual reading system.
  • FIG. 5 is a system architecture diagram of a first embodiment of a virtual reading system according to the present invention.
  • the system shown in FIG. 5 includes a user 1, a virtual library device 10, and a virtual reality helmet 20.
  • the virtual reading system is described in detail below.
  • the virtual library device 10 manages the data of the user 1, and the user 1 can store the relevant data in the virtual library device 10.
  • the virtual library device 10 outputs the data to the virtual reality helmet 20, which virtualizes the three-dimensional simulated image for viewing by the user 1.
  • the user 1 personalizes the three-dimensional simulated image through the virtual reality helmet 20, and the virtual reality helmet 20 receives the corresponding personalized adjustment data, and transmits the corresponding instruction to the virtual library 10, and the virtual library 10 adjusts accordingly according to the instruction. .
  • FIG. 6 is a schematic diagram of functional modules of a second embodiment of a virtual reading system according to the present invention.
  • the virtual reading system 1 shown in FIG. 6 includes a virtual library device 10, a virtual reality helmet 20, a virtual library device 10 including a somatosensory simulation module 103, a control module 104, and a virtual reality helmet 20 including a display module 201.
  • the virtual library device 10 is connected to the virtual reality helmet 20.
  • the function modules are described in detail below.
  • the somatosensory simulation module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which comprises: correspondingly formatting, rendering, and texting the digitized text.
  • the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the book content.
  • the somatosensory virtual module 103 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping the pages of the physical book, a page turning sound played when the animated page is turned, and setting a viewing angle of the three-dimensional virtual book.
  • the control module 104 transmits a three-dimensional virtual book with an animated page turning function to the virtual reality helmet for the virtual reality helmet to display a three-dimensional virtual book with an animated page turning function.
  • the virtual reality helmet 20 display module 201 receives a three-dimensional virtual book with an animated page turning function, a three-dimensional panoramic image from the virtual library device, and three-dimensionally displays the three-dimensional virtual book and the three-dimensional panoramic image with the animated page turning function.
  • the somatosensory virtual module of the virtual library device will be described in detail below with reference to FIG. 7 and FIG. 8.
  • FIG. 7 is a schematic diagram showing the workflow of the first embodiment of the virtual reality module of the virtual library device.
  • the somatosensory simulation module 103 of the virtual library device 10 first stores an electronic version of the book by scanning a book or inputting an electronic document.
  • the character recognition system performs text recognition and text typesetting on the digitized book, and obtains a digital book that can be read at a close distance.
  • the somatosensory simulation module 103 is further configured to perform format conversion on the note information, and display the converted format note information in the browsing editor.
  • the character recognition system of the somatosensory virtual module 103 further includes a format conversion module.
  • the format conversion module is used to convert the format of the text so that the notes can be displayed in commonly used reading and editing.
  • the somatosensory virtual module 103 adds a book flip animation to the digital book through the image recognition processing system, and then generates a three-dimensional virtual book with a page turning function through a virtual reality imaging system by using a digital book with an animated page turning function, a virtual reality imaging system.
  • the three-dimensional virtual book is fed back to the user, and the user adjusts the image recognition processing system to personalize the attributes of the three-dimensional virtual book.
  • FIG. 8 is a schematic flowchart diagram of a second embodiment of a somatosensory virtual module of a virtual library device.
  • the somatosensory simulation module 103 of the virtual library device 10 processes and renders the text information acquired by scanning the book or inputting the electronic document through the character recognition processing system to obtain a digital book that can be read at a close distance, and the somatosensory virtual module 103 passes the digitized book through the image.
  • the recognition processing system increases the book flip animation simulation, sets the page turning action and the sound when the page is turned, and obtains a three-dimensional virtual book showing the original book style, so that the reader has the same experience of reading the physical book when reading the three-dimensional virtual book.
  • the virtual reading system provided by the embodiment can virtualize the electronic book in three dimensions, provide the user with the same reading experience as the physical book, and provide the user with a reading atmosphere suitable for the book, which is beneficial to improving the reader's reading interest and efficiency.
  • FIG. 9 is a schematic diagram of functional modules of a third embodiment of a virtual reading system according to the present invention.
  • the virtual reading system 1 shown in FIG. 9 includes a virtual library device 10, a virtual reality helmet 20, and the virtual library device 10 includes a somatosensory simulation module 103, a control module 104, a view generation module 105, a note generation module 107, and a virtual bookshelf module. 109. Sharing module 111.
  • the virtual reality helmet 20 includes a display module 201 and a setting module 203.
  • the virtual library device 10 is connected to the virtual reality helmet 20.
  • the function modules are described in detail below.
  • the somatosensory simulation module 103 of the virtual library device 10 simulates an e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which specifically includes: correspondingly digitizing the digitized text Typesetting and rendering, so that the text can be read at a close distance, and the digitized text after the typesetting can be processed into a three-dimensional virtual book through three-dimensional image processing.
  • the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the book content.
  • the somatosensory virtual module 103 of the virtual library device 10 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping a book page of a physical book, a page turning sound played when the animated page is turned, and a setting angle of setting a three-dimensional virtual book.
  • the control module 104 of the virtual library device 10 transmits a three-dimensional virtual book with an animated page turning function to the virtual reality helmet 20 for the virtual reality helmet 20 to display a three-dimensional virtual book with an animated page turning function.
  • the virtual reality helmet 20 display module 201 accepts a three-dimensional virtual book with an animated page turning function from the virtual library device, and three-dimensionally displays the three-dimensional virtual book with an animated page turning function.
  • the visual scene generating module 105 of the virtual library device 10 creates a three-dimensional virtual model including a virtual model of various animals, a virtual model of various scenes, and the visual scene generating module 105 is further configured to acquire a picture with a natural scene,
  • the image is processed by panoramic technology to obtain 3D panoramic images.
  • different 3D panoramic images can be generated, thus providing a variety of 3D panoramic images, creating a variety of reading environments for users, creating a variety of 3D virtual models can improve reading fun.
  • the control module 104 of the virtual library device 10 transmits the three-dimensional virtual model and the three-dimensional panoramic image to the virtual reality helmet 20 for the virtual reality helmet 20 to display a three-dimensional virtual model and a three-dimensional panoramic image to provide different reading environments for the user.
  • the specific working mode of the view generation module of the virtual library device will be described below with reference to FIG.
  • FIG. 10 is a flowchart showing the operation of an embodiment of a visual generating module of a virtual library device.
  • the gaze generating module 105 performs image acquisition using a fisheye lens or a normal camera, and generates a three-dimensional panoramic image with a very realistic natural scene and a three-dimensional virtual image corresponding to other images according to the image processing technology and the panoramic technology.
  • the display module 201 of the virtual reality helmet 20 receives the three-dimensional virtual model and the three-dimensional panoramic image from the virtual library device 10 , and displays the three-dimensional virtual model and the three-dimensional panoramic image in three dimensions.
  • the setting module 203 of the virtual reality helmet 20 receives the setting signal and transmits the setting signal to the virtual library device 10, wherein the setting signal is used to adjust the attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model.
  • the control module 104 of the virtual library device 10 receives the setting signal transmitted by the setting module 203 of the virtual reality helmet, and adjusts the attributes of the three-dimensional virtual book and the three-dimensional panoramic image according to the setting signal, for example, adjusting the text attribute of the three-dimensional virtual book.
  • the control module 104 further receives the first query information, retrieves the corresponding three-dimensional virtual book according to the first query information, receives the second query information, and retrieves the note information of the three-dimensional virtual book according to the second query information.
  • the note generation module 107 records the note information of the three-dimensional virtual book, and the note information includes the reading experience input by the user, the text creation, and the like.
  • the virtual bookshelf module 109 of the virtual library device 10 creates a three-dimensional virtual bookshelf, classifies the three-dimensional virtual books, and places them on the three-dimensional virtual bookshelf.
  • the sharing module 111 shares notes information on the network in real time.
  • the virtual reality helmet 20 display module 201 also accepts the three-dimensional virtual book's note information, the three-dimensional virtual bookshelf, and displays the three-dimensional virtual bookshelf, and classifies the three-dimensional virtual book, displays it on the three-dimensional virtual bookshelf, and displays the corresponding corresponding to the three-dimensional virtual book. Note information.
  • the virtual reality helmet 20 display module 201 further includes a video audio playing module, and the video audio playing module is used for playing audio video and providing a video audio playing function.
  • the virtual reading system provided by the embodiment can virtualize the electronic book in three dimensions, provide the user with a reading experience like a physical book, and provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book. Reading atmosphere, can provide virtual bookshelf and note sharing function, which helps to improve readers' interest and efficiency in reading.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a virtual library device, comprising: a somatosensory virtual module, configured to simulate an e-book and generate a 3D virtual book, creating for the 3D virtual book an animated page turning function and a page turning sound played when a page is turned, and setting a placement angle of the 3D virtual book, the 3D virtual book comprising a voice playing function; and a control module, configured to transmit the 3D virtual book having the animated page turning function to a display device for the display device to display the 3D virtual book having the animated page turning function. The present invention further provides a virtual reality headpiece and a virtual reading system. The present invention can virtualize an e-book three-dimensionally and provides a user with the same reading experience as a physical book, with the same page turning functionality, helping to improve the reading experience and reading efficiency.

Description

一种虚拟图书馆设备、虚拟现实头盔及虚拟阅读系统  Virtual library equipment, virtual reality helmet and virtual reading system

技术领域Technical field

本发明涉及通讯技术领域,尤其涉及一种虚拟图书馆设备、虚拟现实头盔及虚拟阅读系统。The present invention relates to the field of communication technologies, and in particular, to a virtual library device, a virtual reality helmet, and a virtual reading system.

背景技术Background technique

虚拟现实技术是一项集计算机图形学、人机交互、传感技术等多项技术的集成技术。通过计算机图形学生成三维的视觉、听觉、嗅觉等感官能够感应的3D影像空间。虚拟现实技术可以将虚拟空间设计成逼真的现实世界,可以实现体验和交互。Virtual reality technology is an integrated technology that integrates computer graphics, human-computer interaction, and sensing technologies. Through computer graphics, three-dimensional image space, such as visual, auditory, and olfactory, can be sensed. Virtual reality technology can design virtual space into a realistic real world, enabling experience and interaction.

在数字博物馆领域,虚拟现实技术可用于图书馆的文献、手稿、照片、录音、影片和博物馆的藏品等文物的数字化保护。典型应用包括纽约大都会博物馆、大英博物馆、中国的国家图书馆、俄罗斯冬宫博物馆和法国卢浮宫。但在图书馆的应用上,其书籍仍是数字化的电子书,没有摆脱传统电子书的缺陷,缺乏纸质书籍的体验感和阅读的沉浸感,并不能实现像纸质书籍一样的感观阅读,且阅读环境单调,容易受到外界的干扰。In the field of digital museums, virtual reality technology can be used for the digital protection of cultural relics such as libraries, manuscripts, photographs, sound recordings, films and museum collections. Typical applications include the Metropolitan Museum of New York, the British Museum, the National Library of China, the Russian Hermitage Museum and the Louvre in France. However, in the application of the library, the books are still digital e-books. They do not get rid of the defects of traditional e-books. They lack the experience of paper books and the immersion of reading. They cannot achieve the same kind of reading as paper books. And the reading environment is monotonous and vulnerable to outside interference.

发明内容Summary of the invention

本发明的主要目的在于解决现有技术中数字阅读中存在的无法提供实体书籍的阅读体验、阅读环境单一的问题,有效提高阅读兴趣和阅读效率。The main object of the present invention is to solve the problem that the reading experience and the reading environment of the physical book which are not available in the digital reading in the prior art are solved, and the reading interest and the reading efficiency are effectively improved.

为实现上述目的,本发明提供一种虚拟图书馆设备,包括: To achieve the above object, the present invention provides a virtual library device, comprising:

体感虚拟模块,用于将电子书模拟生成三维虚拟书,对所述三维虚拟书创建动画翻页功能、动画翻页时播放的翻页声音及设置所述三维虚拟书的摆放角度,其中所述三维虚拟书包括语音播放功能; a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein The three-dimensional virtual book includes a voice playing function;

控制模块,用于将所述带有动画翻页功能的三维虚拟书传输给显示设备,以供所述显示设备展示所述带有动画翻页功能的三维虚拟书。And a control module, configured to transmit the three-dimensional virtual book with the animated page turning function to the display device, so that the display device displays the three-dimensional virtual book with the animated page turning function.

优选地,所述虚拟图书馆设备还包括: Preferably, the virtual library device further includes:

视景生成模块,用于获取具有自然景象的图片,对所述图片采用全景技术处理,获得三维全景图像;a visor generating module, configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image;

所述控制模块,还用于将所述三维全景图像传输给所述显示设备,以供所述显示设备展示所述三维全景图像。The control module is further configured to transmit the three-dimensional panoramic image to the display device, so that the display device displays the three-dimensional panoramic image.

优选地,所述视景生成模块,还用于创建三维虚拟模型; Preferably, the view generating module is further configured to create a three-dimensional virtual model;

所述控制模块,还用于将所述三维虚拟模型传输给所述显示设备,以供所述显示设备展示所述三维虚拟模型。The control module is further configured to transmit the three-dimensional virtual model to the display device, so that the display device displays the three-dimensional virtual model.

优选地,所述控制模块,还用于接收第一设置信号,根据所述第一设置信号对所述三维虚拟书、所述三维全景图像、所述三维虚拟模型的属性进行调节。 Preferably, the control module is further configured to receive a first setting signal, and adjust attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the first setting signal.

优选地,所述虚拟图书馆设备还包括: Preferably, the virtual library device further includes:

笔记生成模块,用于记录所述三维虚拟书的笔记信息;a note generation module, configured to record note information of the three-dimensional virtual book;

虚拟书架模块,用于建立三维虚拟书架,将所述三维虚拟书进行分类,摆放在所述三维虚拟书架上;a virtual bookshelf module for creating a three-dimensional virtual bookshelf, classifying the three-dimensional virtual books, and placing the three-dimensional virtual books on the three-dimensional virtual bookshelf;

分享模块,用于实时在网络上分享所述笔记信息,其中,所述分享模块还包括触控笔和触控板,并将所述触控笔在所述触控板上输入的绘图信息实时进行分享;a sharing module, configured to share the note information on the network in real time, wherein the sharing module further includes a stylus and a touchpad, and the drawing information input by the stylus on the touchpad is real-time Share;

播放模块,用于播放音频数据和/或视频数据。A playback module for playing audio data and/or video data.

优选地,所述体感虚拟模块,还用于对所述笔记信息进行格式转换,并将转换格式后的笔记信息显示在阅览编辑器中; Preferably, the somatosensory virtual module is further configured to perform format conversion on the note information, and display the converted format note information in a browsing editor;

所述控制模块,还用于接收查询信息,根据所述查询信息检索对应的三维虚拟书。The control module is further configured to receive query information, and retrieve a corresponding three-dimensional virtual book according to the query information.

此外,为实现上述目的,本发明还提供一种虚拟现实头盔,所述虚拟现实头盔与虚拟图书馆设备相连,所述虚拟现实头盔包括:In addition, in order to achieve the above object, the present invention also provides a virtual reality helmet, which is connected to a virtual library device, and the virtual reality helmet includes:

显示模块,用于将带有动画翻页功能的三维虚拟书、三维全景图像、三维虚拟模型进行三维显示。 The display module is configured to perform three-dimensional display of a three-dimensional virtual book, a three-dimensional panoramic image, and a three-dimensional virtual model with an animated page turning function.

优选地,所述虚拟现实头盔还包括:Preferably, the virtual reality helmet further comprises:

处理模块,用于存储包含自然景象的图片,根据所述包含自然景象的图片生产所述三维全景图像;a processing module, configured to store a picture including a natural scene, and generate the three-dimensional panoramic image according to the picture that includes a natural scene;

设置模块,还用于接收第二设置信号,将所述第二设置信号传输给所述虚拟图书馆设备,以供所述虚拟图书馆设备根据所述设置信号对所述三维虚拟书、所述三维全景图像的属性进行调节。a setting module, configured to receive a second setting signal, and transmit the second setting signal to the virtual library device, for the virtual library device to view the three-dimensional virtual book according to the setting signal, The properties of the 3D panoramic image are adjusted.

优选地,所述显示模块,还用于显示所述三维虚拟书的笔记信息,显示三维虚拟书架,并将所述三维虚拟书进行分类,显示在所述三维虚拟书架上,以及播放音频数据和/或视频数据。Preferably, the display module is further configured to display note information of the three-dimensional virtual book, display a three-dimensional virtual bookshelf, classify the three-dimensional virtual book, display the three-dimensional virtual bookshelf, and play audio data and / or video data.

此外,为实现上述目的,本发明还提供一种虚拟阅读系统,包括虚拟图书馆设备、虚拟现实头盔,其中,所述虚拟图书馆设备包括: In addition, in order to achieve the above object, the present invention further provides a virtual reading system, including a virtual library device, a virtual reality helmet, wherein the virtual library device includes:

体感虚拟模块,用于将电子书模拟生成三维虚拟书,对所述三维虚拟书创建动画翻页功能、动画翻页时播放的翻页声音及设置所述三维虚拟书的摆放角度,其中所述三维虚拟书包括语音播放功能; a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein The three-dimensional virtual book includes a voice playing function;

控制模块,用于将所述带有动画翻页功能的三维虚拟书传输给所述虚拟现实头盔; a control module, configured to transmit the three-dimensional virtual book with an animated page turning function to the virtual reality helmet;

所述虚拟现实头盔包括: The virtual reality helmet includes:

显示模块,用于将所述虚拟图书馆设备传输的带有动画翻页功能的三维虚拟书进行三维显示。 And a display module, configured to perform three-dimensional display of the three-dimensional virtual book with an animated page turning function transmitted by the virtual library device.

优选地,所述虚拟图书馆设备还包括: Preferably, the virtual library device further includes:

视景生成模块,用于获取具有自然景象的图片,对所述图片采用全景技术处理,获得三维全景图像;a visor generating module, configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image;

所述控制模块,还用于将所述三维全景图像传输给所述虚拟现实头盔;The control module is further configured to transmit the three-dimensional panoramic image to the virtual reality helmet;

所述虚拟现实头盔的所述显示模块,还用于将所述三维全景图像进行三维显示。The display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional panoramic image.

优选地,所述虚拟现实头盔还包括:Preferably, the virtual reality helmet further comprises:

设置模块,用于接收设置信号,将所述设置信号传输给所述虚拟图书馆设备,其中,所述设置信号用于对所述三维虚拟书、所述三维全景图像的属性进行调节;a setting module, configured to receive the setting signal, and transmit the setting signal to the virtual library device, wherein the setting signal is used to adjust an attribute of the three-dimensional virtual book and the three-dimensional panoramic image;

所述虚拟图书馆设备的所述控制模块,还用于接收所述虚拟现实头盔的所述设置模块传输的所述设置信号,根据所述设置信号对所述三维虚拟书、所述三维全景图像的属性进行调节。The control module of the virtual library device is further configured to receive the setting signal transmitted by the setting module of the virtual reality helmet, and the three-dimensional virtual book and the three-dimensional panoramic image according to the setting signal The properties are adjusted.

优选地,所述虚拟图书馆设备的所述视景生成模块,还用于创建三维虚拟模型; Preferably, the view generating module of the virtual library device is further configured to create a three-dimensional virtual model;

所述控制模块,还用于将所述三维虚拟模型传输给所述虚拟显示头盔;The control module is further configured to transmit the three-dimensional virtual model to the virtual display helmet;

所述虚拟现实头盔的所述显示模块,还用于将所述三维虚拟模型进行三维显示。The display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional virtual model.

优选地,所述虚拟图书馆设备还包括: Preferably, the virtual library device further includes:

笔记生成模块,用于记录输入的所述三维虚拟书的笔记信息;a note generation module, configured to record input note information of the three-dimensional virtual book;

虚拟书架模块,用于建立三维虚拟书架,将所述三维虚拟书进行分类摆放在所述三维虚拟书架上;a virtual bookshelf module, configured to create a three-dimensional virtual bookshelf, and classify the three-dimensional virtual books on the three-dimensional virtual bookshelf;

分享模块,用于实时在网络上分享所述笔记信息;a sharing module for sharing the note information on the network in real time;

所述控制模块,还用于接收第一查询信息,根据所述第一查询信息检索对应的三维虚拟书,接收第二查询信息,根据所述第二查询信息检索所述三维虚拟书的笔记信息;The control module is further configured to receive the first query information, retrieve the corresponding three-dimensional virtual book according to the first query information, receive the second query information, and retrieve the note information of the three-dimensional virtual book according to the second query information. ;

所述虚拟现实头盔的所述显示模块,还用于显示所述三维虚拟书的笔记信息、三维虚拟书架,其中,所述三维虚拟书进行分类显示在所述三维虚拟书架上,以及播放音频数据和/或视频数据。 The display module of the virtual reality helmet is further configured to display note information of the three-dimensional virtual book, a three-dimensional virtual bookshelf, wherein the three-dimensional virtual book is classified and displayed on the three-dimensional virtual bookshelf, and plays audio data. And / or video data.

本发明提供虚拟图书馆设备、虚拟现实头盔、虚拟阅读系统能将电子书三维虚拟化,为用户提供像实体书一样的阅读体验,还提供三维全景图像,为用户提供可选的阅读环境,为用户提供与书籍相适应的阅读氛围,使读者的阅读体验更加丰富,有利于提高读者的阅读兴趣和效率。The invention provides a virtual library device, a virtual reality helmet and a virtual reading system, which can virtualize an e-book in three dimensions, provide a user with a reading experience like a physical book, and also provide a three-dimensional panoramic image to provide an optional reading environment for the user. The user provides a reading atmosphere that is compatible with the book, which makes the reader's reading experience richer and helps to improve readers' reading interest and efficiency.

附图说明DRAWINGS

图1为本发明虚拟图书馆设备第一实施例的功能模块示意图;1 is a schematic diagram of functional modules of a first embodiment of a virtual library device according to the present invention;

图2为本发明虚拟图书馆设备第二实施例的功能模块示意图;2 is a schematic diagram of functional modules of a second embodiment of a virtual library device according to the present invention;

图3为本发明虚拟现实头盔第一实施例的功能模块示意图;3 is a schematic diagram of functional modules of a first embodiment of a virtual reality helmet according to the present invention;

图4为本发明虚拟现实头盔第二实施例的功能模块示意图;4 is a schematic diagram of functional modules of a second embodiment of a virtual reality helmet according to the present invention;

图5为本发明虚拟阅读系统第一实施例的系统架构图;FIG. 5 is a system architecture diagram of a first embodiment of a virtual reading system according to the present invention; FIG.

图6为本发明虚拟阅读系统第二实施例的功能模块示意图;6 is a schematic diagram of functional modules of a second embodiment of a virtual reading system according to the present invention;

图7为虚拟图书馆设备的体感虚拟模块第一实施例的工作流程图;7 is a workflow diagram of a first embodiment of a somatosensory virtual module of a virtual library device;

图8为虚拟图书馆设备的体感虚拟模块第二实施例的工作流程图;8 is a flowchart of a second embodiment of a somatosensory virtual module of a virtual library device;

图9为本发明虚拟阅读系统第三实施例的功能模块示意图;9 is a schematic diagram of functional modules of a third embodiment of a virtual reading system according to the present invention;

图10所示为虚拟图书馆设备的视景生成模块一实施例的工作流程图。FIG. 10 is a flowchart showing the operation of an embodiment of a view generation module of a virtual library device.

本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

具体实施方式detailed description

以下结合说明书附图对本发明的优选实施例进行说明,应当理解,此处所描述的优选实施例仅用于说明和解释本发明,并不用于限定本发明,并且在不冲突的情况下,本发明中的实施例及实施例中的特征可以相互组合。The preferred embodiments of the present invention are described in conjunction with the accompanying drawings, and the preferred embodiments described herein are intended to illustrate and explain the invention, and not to limit the invention, and The embodiments and the features in the embodiments can be combined with each other.

本发明提供一种虚拟图书馆设备。The present invention provides a virtual library device.

参照图1,图1为本发明虚拟图书馆设备第一实施例的功能模块示意图。在图1所示的虚拟图书馆设备10包括体感虚拟模块103、控制模块104。虚拟图书馆设备10与显示设备相连,虚拟图书馆设备10可以存储一个真实图书馆藏书的对应数字版书籍,也可存储多个真实图书馆藏书对应的数字版书籍。下面对各功能模块进行详细说明。Referring to FIG. 1, FIG. 1 is a schematic diagram of functional modules of a first embodiment of a virtual library device according to the present invention. The virtual library device 10 shown in FIG. 1 includes a somatosensory virtual module 103 and a control module 104. The virtual library device 10 is connected to the display device. The virtual library device 10 can store a corresponding digital version of a book in a real library collection, and can also store a digital version of a book corresponding to a plurality of real library books. The function modules are described in detail below.

体感虚拟模块103将电子书模拟生成三维虚拟书,即将相关的数字化书籍转化为对应的虚拟实体书,将电子书模拟生成三维虚拟书具体包括:对数字化的文字进行相应的排版、渲染,使文字能够近距离阅读,将排版后的数字化文字通过三维图像处理获得三维虚拟图书,三维虚拟书包括语音播放功能。需要说明的是,数字化书籍可以通过扫描仪将实体书的文字录入虚拟图书馆设备,或者直接从网上将电子书导入,三维虚拟书中还包括与书籍文字内容相关的实物模型,体感虚拟模块103还对三维虚拟书创建动画翻页功能,即模拟翻动实体书页的动作、翻页动作时播放的翻页声音及设置三维虚拟书的摆放角度,触发动画翻页功能的方式包括:模拟出三维虚拟手臂模型,通过三维虚拟手臂模型进行翻页动作,或者对阅读时间时间设置,在预设时间后触发翻页动作,也可以通过语音指令进行翻页,还可以通过手指敲击触控板来翻页,进行翻页动作时播放翻页声音。控制模块104将带有动画翻页功能的三维虚拟书传输给显示设备,以供显示设备展示带有动画翻页功能的三维虚拟书,显示设备包括可以三维显示的移动设备、虚拟现实头盔等设备。The somatosensory virtual module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which specifically includes: correspondingly formatting, rendering, and texting the digitized text. It can read at a close distance and obtain the 3D virtual book through the 3D image processing after the typed digitized text. The 3D virtual book includes the voice playing function. It should be noted that the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book further includes a physical model related to the text content of the book, and the somatosensory virtual module 103 The animation page turning function is also created for the three-dimensional virtual book, that is, the action of flipping the physical book page, the page turning sound played during the page turning action, and the setting angle of setting the three-dimensional virtual book, and the manner of triggering the animation page turning function includes: simulating the three-dimensional The virtual arm model performs the page turning action through the 3D virtual arm model, or sets the reading time and time, triggers the page turning action after the preset time, can also turn the page by voice command, and can also tap the touchpad by finger Turn the page and play the page turning sound when you turn the page. The control module 104 transmits the three-dimensional virtual book with the animated page turning function to the display device, so that the display device displays the three-dimensional virtual book with the animated page turning function, and the display device includes a mobile device capable of three-dimensional display, a virtual reality helmet and the like. .

本发明提供的虚拟图书馆设备能将电子书三维虚拟化,为用户提供像实体书一样的阅读体验,提供与实体书类似的动画翻页功能,有利于提高读者的阅读兴趣和效率。The virtual library device provided by the invention can virtualize the electronic book in three dimensions, provide the user with the same reading experience as the physical book, and provides an animation page turning function similar to the physical book, which is beneficial to improving the reading interest and efficiency of the reader.

参照图2,图2为本发明虚拟图书馆设备第二实施例的功能模块示意图。在图2所示的虚拟图书馆设备10包括体感虚拟模块103、控制模块104、视景生成模块105、笔记生成模块107、虚拟书架模块109、分享模块111、播放模块113。虚拟图书馆设备10与显示设备相连。下面对各功能模块进行详细说明。 Referring to FIG. 2, FIG. 2 is a schematic diagram of functional modules of a second embodiment of a virtual library device according to the present invention. The virtual library device 10 shown in FIG. 2 includes a somatosensory virtual module 103, a control module 104, a view generation module 105, a note generation module 107, a virtual bookshelf module 109, a sharing module 111, and a play module 113. The virtual library device 10 is connected to a display device. The function modules are described in detail below.

体感模拟模块103将电子书模拟生成三维虚拟书,即将相关的数字化书籍转化为对应的虚拟实体书,将电子书模拟生成三维虚拟书具体包括:对数字化的文字进行相应的排版、渲染,使文字能够近距离阅读,将排版后的数字化文字通过三维图像处理获得三维虚拟图书,其中,三维虚拟书包括语音播放功能。需要说明的是,数字化书籍可以通过扫描仪将实体书的文字录入虚拟图书馆设备,或者直接从网上将电子书导入,三维虚拟书中包括与书籍文字内容相关的实物模型。体感虚拟模块103还对三维虚拟书创建动画翻页功能,即模拟翻动实体书的书页的动作、动画翻页时播放的翻页声音及设置三维虚拟书的摆放角度。控制模块104将带有动画翻页功能的三维虚拟书传输给显示设备,以供显示设备展示带有动画翻页功能的三维虚拟书。视景生成模块105创建三维虚拟模型,三维虚拟模型包括各种动物的虚拟模型,各种景色的虚拟模型,控制模块104将三维虚拟模型传输给显示设备,以供显示设备展示三维虚拟模型。 The somatosensory simulation module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which comprises: correspondingly formatting, rendering, and texting the digitized text. The invention can read at a close distance, and obtain the three-dimensional virtual book through the three-dimensional image processing by the typed digitized text, wherein the three-dimensional virtual book includes a voice playing function. It should be noted that the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the text content of the book. The somatosensory virtual module 103 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping the pages of the physical book, a page turning sound played when the animated page is turned, and setting a viewing angle of the three-dimensional virtual book. The control module 104 transmits the three-dimensional virtual book with the animated page turning function to the display device for the display device to display the three-dimensional virtual book with the animated page turning function. The visual generation module 105 creates a three-dimensional virtual model including virtual models of various animals, virtual models of various scenery, and the control module 104 transmits the three-dimensional virtual models to the display device for the display device to display the three-dimensional virtual model.

需要说明的是,视景生成模块105还用于获取具有自然景象的图片,对图片采用全景生成技术,获得三维全景图像,例如,利用鱼眼镜头或者普通相机进行图像采集,获取一些具有特征的自然画面,也可以通过网络对图片进行更新,根据不同的自然景象图片,可以生成不同的三维全景图像,因而能提供多种三维全景图像,为用户创造多种多样的阅读环境。控制模块104将三维全景图像传输给显示设备,以供显示设备展示三维全景图像,为用户提供不同的阅读环境。 It should be noted that the visor generating module 105 is further configured to acquire a picture with a natural scene, and adopt a panoramic generation technology to obtain a three-dimensional panoramic image, for example, using a fisheye lens or a common camera for image collection, and acquiring some features. The natural picture can also update the picture through the network. According to different natural scene pictures, different three-dimensional panoramic images can be generated, thus providing a variety of three-dimensional panoramic images, creating a variety of reading environments for the user. The control module 104 transmits the three-dimensional panoramic image to the display device for the display device to display the three-dimensional panoramic image, providing the user with a different reading environment.

控制模块104接收第一设置信号,根据第一设置信号对三维虚拟书、三维全景图像、三维虚拟模型的属性进行调节,例如,对三维虚拟书的文字属性进行调控。控制模块104还接收查询信息,根据查询信息检索对应的三维虚拟书。笔记生成模块107记录三维虚拟书的笔记信息,笔记信息包括用户输入的阅读体会、文字创作等内容。 The control module 104 receives the first setting signal, and adjusts attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the first setting signal, for example, controls the text attribute of the three-dimensional virtual book. The control module 104 also receives the query information and retrieves the corresponding three-dimensional virtual book based on the query information. The note generation module 107 records the note information of the three-dimensional virtual book, and the note information includes the reading experience input by the user, the text creation, and the like.

虚拟书架模块109建立三维虚拟书架,将三维虚拟书进行分类,摆放在三维虚拟书架上。分享模块111实时在网络上分享笔记信息,分享模块111还包括触控笔和触控板,将触控笔在触控板上输入的绘图信息实时进行分享。虚拟图书馆设备10的播放模块113还用于播放音频数据和/或视频数据。The virtual bookshelf module 109 creates a three-dimensional virtual bookshelf, classifies the three-dimensional virtual books, and places them on the three-dimensional virtual bookshelf. The sharing module 111 shares the note information on the network in real time. The sharing module 111 further includes a stylus and a touchpad, and the drawing information input by the stylus on the touchpad is shared in real time. The play module 113 of the virtual library device 10 is also used to play audio data and/or video data.

本发明提供的虚拟图书馆设备能将电子书三维虚拟化,为用户提供像实体书一样的阅读体验,还提供三维全景图像,为用户提供可选的阅读环境,为用户提供与书籍相适应的阅读氛围,能提供虚拟书架及笔记分享功能,有利于提高读者的阅读兴趣和效率。The virtual library device provided by the invention can virtualize the electronic book in three dimensions, provide the user with a reading experience like a physical book, and also provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book. Reading atmosphere, can provide virtual bookshelf and note sharing function, which helps to improve readers' interest and efficiency in reading.

本发明进一步提供一种虚拟现实头盔。The invention further provides a virtual reality helmet.

参照图3,图3为本发明虚拟现实头盔第一实施例的功能模块示意图。本实施例的虚拟现实头盔20包括显示模块201。虚拟现实头盔与虚拟图书馆设备相连,显示模块201从虚拟图书馆设备接受带有动画翻页功能的三维虚拟书、三维全景图像,并将带有动画翻页功能的三维虚拟书、三维全景图像进行三维显示。需要说明的是,三维虚拟书显示时处于静止状态,三维虚拟书放置在虚拟平台上,例如虚拟书桌上,可以调节三维虚拟书放置在虚拟书桌上的位置。 Referring to FIG. 3, FIG. 3 is a schematic diagram of functional modules of a first embodiment of a virtual reality helmet according to the present invention. The virtual reality helmet 20 of the present embodiment includes a display module 201. The virtual reality helmet is connected to the virtual library device, and the display module 201 accepts a three-dimensional virtual book with an animated page turning function from the virtual library device, a three-dimensional panoramic image, and a three-dimensional virtual book with an animated page turning function and a three-dimensional panoramic image. Perform a three-dimensional display. It should be noted that the three-dimensional virtual book is in a static state when displayed, and the three-dimensional virtual book is placed on the virtual platform, such as a virtual desk, and the position of the three-dimensional virtual book placed on the virtual desk can be adjusted.

本实施例提供的虚拟图书馆设备能将带有动画翻页功能的三维虚拟书显示给用户,为用户提供像实体书一样的阅读体验,为用户提供与书籍相适应的阅读氛围,有利于提高读者的阅读兴趣和效率,另外,由于阅读中三维虚拟书处于静止状态,可以有效避免由于运动带来的眩晕效果和延迟效应,大大减少服务器的工作量。The virtual library device provided in this embodiment can display a three-dimensional virtual book with an animated page turning function to the user, providing the user with a reading experience like a physical book, and providing the user with a reading atmosphere suitable for the book, which is beneficial to improve. The reader's reading interest and efficiency, in addition, because the three-dimensional virtual book in reading is in a static state, can effectively avoid the stun effect and delay effect caused by the movement, greatly reducing the workload of the server.

参照图4,图4为本发明虚拟现实头盔第二实施例的功能模块示意图。本实施例的虚拟现实头盔20包括显示模块201、设置模块203、处理模块205。虚拟现实头盔与虚拟图书馆设备相连。下面对各功能模块进行详细说明。Referring to FIG. 4, FIG. 4 is a schematic diagram of functional modules of a second embodiment of a virtual reality helmet according to the present invention. The virtual reality helmet 20 of the embodiment includes a display module 201, a setting module 203, and a processing module 205. The virtual reality helmet is connected to the virtual library device. The function modules are described in detail below.

显示模块201从虚拟图书馆设备接受带有动画翻页功能的三维虚拟书、三维全景图像,并将带有动画翻页功能的三维虚拟书、三维全景图像进行三维显示。设置模块203接收第二设置信号,将第二设置信号传输给虚拟图书馆设备,以供虚拟图书馆设备根据设置信号对三维虚拟书、三维全景图像、三维虚拟模型的属性进行调节,例如,调节三维虚拟书的文字属性。 处理模块205存储包含自然景象的图片,根据包含自然景象的图片生产三维全景图像。The display module 201 accepts a three-dimensional virtual book with an animated page turning function, a three-dimensional panoramic image from the virtual library device, and three-dimensionally displays the three-dimensional virtual book and the three-dimensional panoramic image with the animated page turning function. The setting module 203 receives the second setting signal, and transmits the second setting signal to the virtual library device, so that the virtual library device adjusts the attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model according to the setting signal, for example, adjusting The text attribute of the 3D virtual book. The processing module 205 stores a picture containing a natural scene, and produces a three-dimensional panoramic image from the picture containing the natural scene.

需要说明的是,显示模块201还接受三维虚拟书的笔记信息、三维虚拟书架,并显示三维虚拟书架,并将三维虚拟书进行分类,显示在三维虚拟书架上,在显示三维虚拟书的同时显示对应的笔记信息,其中,设置模块203接收用户输入的设置信息,对三维虚拟书架的属性进行调节或者设计,显示模块201还用于播放音频数据和/或视频数据,提供播放音频视频的功能。It should be noted that the display module 201 also accepts the note information of the three-dimensional virtual book, the three-dimensional virtual bookshelf, and displays the three-dimensional virtual bookshelf, and classifies the three-dimensional virtual books, displays them on the three-dimensional virtual bookshelf, and displays them while displaying the three-dimensional virtual book. Corresponding note information, wherein the setting module 203 receives the setting information input by the user, adjusts or designs the attributes of the three-dimensional virtual bookshelf, and the display module 201 is further configured to play audio data and/or video data, and provide a function of playing the audio video.

本实施例提供的虚拟现实头盔能显示三维虚拟化的书籍,为用户提供像实体书一样的阅读体验,还提供三维全景图像,为用户提供可选的阅读环境,为用户提供与书籍相适应的阅读氛围,有利于提高读者的阅读兴趣和效率,另外,由于阅读中书籍处于静止状态,可以有效避免图像运动带来的眩晕效果和延迟效应,大大减少服务器的工作量。The virtual reality helmet provided by the embodiment can display a three-dimensional virtualized book, provide a user with a reading experience like a physical book, and provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book. The reading atmosphere is conducive to improving readers' interest and efficiency in reading. In addition, because the books in reading are at rest, the stun effect and delay effect caused by image movement can be effectively avoided, and the workload of the server is greatly reduced.

本发明进一步提供一种虚拟阅读系统。The invention further provides a virtual reading system.

参阅图5,图5为本发明虚拟阅读系统第一实施例的系统架构图。图5所示的系统中包括用户1,虚拟图书馆设备10、虚拟现实头盔20。下面对虚拟阅读系统进行详细说明。虚拟图书馆设备10对用户1的数据进行管理,用户1能够将相关数据存储在虚拟图书馆设备10中。虚拟图书馆设备10将数据输出给虚拟现实头盔20,虚拟现实头盔20将三维模拟图像现实出来,以供用户1进行观看。用户1通过虚拟现实头盔20对三维模拟图像进行个性化调节,虚拟现实头盔20接收对应的个性化调节数据,并将对应的指令传输个虚拟图书馆10,虚拟图书馆10根据指令进行相应的调节。Referring to FIG. 5, FIG. 5 is a system architecture diagram of a first embodiment of a virtual reading system according to the present invention. The system shown in FIG. 5 includes a user 1, a virtual library device 10, and a virtual reality helmet 20. The virtual reading system is described in detail below. The virtual library device 10 manages the data of the user 1, and the user 1 can store the relevant data in the virtual library device 10. The virtual library device 10 outputs the data to the virtual reality helmet 20, which virtualizes the three-dimensional simulated image for viewing by the user 1. The user 1 personalizes the three-dimensional simulated image through the virtual reality helmet 20, and the virtual reality helmet 20 receives the corresponding personalized adjustment data, and transmits the corresponding instruction to the virtual library 10, and the virtual library 10 adjusts accordingly according to the instruction. .

参照图6,图6为本发明虚拟阅读系统第二实施例的功能模块示意图。图6所示的虚拟阅读系统1包括虚拟图书馆设备10、虚拟现实头盔20,虚拟图书馆设备10包括体感模拟模块103、控制模块104,虚拟现实头盔20包括显示模块201。虚拟图书馆设备10与虚拟现实头盔20相连。下面对各功能模块进行详细说明。Referring to FIG. 6, FIG. 6 is a schematic diagram of functional modules of a second embodiment of a virtual reading system according to the present invention. The virtual reading system 1 shown in FIG. 6 includes a virtual library device 10, a virtual reality helmet 20, a virtual library device 10 including a somatosensory simulation module 103, a control module 104, and a virtual reality helmet 20 including a display module 201. The virtual library device 10 is connected to the virtual reality helmet 20. The function modules are described in detail below.

体感模拟模块103将电子书模拟生成三维虚拟书,即将相关的数字化书籍转化为对应的虚拟实体书,将电子书模拟生成三维虚拟书具体包括:对数字化的文字进行相应的排版、渲染,使文字能够近距离阅读,将排版后的数字化文字通过三维图像处理获得三维虚拟书。需要说明的是,数字化书籍可以通过扫描仪将实体书的文字录入虚拟图书馆设备,或者直接从网上将电子书导入,三维虚拟书中包括与书籍内容相关的实物模型。体感虚拟模块103还对三维虚拟书创建动画翻页功能,即模拟翻动实体书的书页的动作、动画翻页时播放的翻页声音及设置三维虚拟书的摆放角度。控制模块104将带有动画翻页功能的三维虚拟书传输给虚拟现实头盔,以供虚拟现实头盔展示带有动画翻页功能的三维虚拟书。虚拟现实头盔20显示模块201从虚拟图书馆设备接受带有动画翻页功能的三维虚拟书、三维全景图像,并将带有动画翻页功能的三维虚拟书、三维全景图像进行三维显示。下面结合图7、图8对虚拟图书馆设备的体感虚拟模块进行详细说明。The somatosensory simulation module 103 simulates the e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which comprises: correspondingly formatting, rendering, and texting the digitized text. The ability to read at a close distance and obtain a three-dimensional virtual book through three-dimensional image processing of the typed digitized text. It should be noted that the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the book content. The somatosensory virtual module 103 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping the pages of the physical book, a page turning sound played when the animated page is turned, and setting a viewing angle of the three-dimensional virtual book. The control module 104 transmits a three-dimensional virtual book with an animated page turning function to the virtual reality helmet for the virtual reality helmet to display a three-dimensional virtual book with an animated page turning function. The virtual reality helmet 20 display module 201 receives a three-dimensional virtual book with an animated page turning function, a three-dimensional panoramic image from the virtual library device, and three-dimensionally displays the three-dimensional virtual book and the three-dimensional panoramic image with the animated page turning function. The somatosensory virtual module of the virtual library device will be described in detail below with reference to FIG. 7 and FIG. 8.

参阅图7,图7所示为虚拟图书馆设备的体感虚拟模块第一实施例的工作流程示意图。虚拟图书馆设备10的体感模拟模块103首先通过扫描书籍或者输入电子文档的方式存储电子版书籍,文字识别系统对数字化书籍进行文字识别、文字排版,获取能够近距离阅读的数字化书籍,需要说明的是,体感模拟模块103还用于对所述笔记信息进行格式转换,并将转换格式后的笔记信息显示在阅览编辑器中,具体地,体感虚拟模块103的文字识别系统还包括格式转换模块,格式转换模块用于对文字的格式进行转换,使得笔记可以在常用的阅览和编辑器中显示。 体感虚拟模块103将数字化书籍通过图像识别处理系统增加书籍翻页动画仿真,然后将增加了动画翻页功能的数字化书籍通过虚拟现实成像系统生成带有翻页功能的三维虚拟书,虚拟现实成像系统将三维虚拟书反馈给用户,用户通过图像识别处理系统进行调节,对三维虚拟书的属性进行个性化设置。 Referring to FIG. 7, FIG. 7 is a schematic diagram showing the workflow of the first embodiment of the virtual reality module of the virtual library device. The somatosensory simulation module 103 of the virtual library device 10 first stores an electronic version of the book by scanning a book or inputting an electronic document. The character recognition system performs text recognition and text typesetting on the digitized book, and obtains a digital book that can be read at a close distance. The somatosensory simulation module 103 is further configured to perform format conversion on the note information, and display the converted format note information in the browsing editor. Specifically, the character recognition system of the somatosensory virtual module 103 further includes a format conversion module. The format conversion module is used to convert the format of the text so that the notes can be displayed in commonly used reading and editing. The somatosensory virtual module 103 adds a book flip animation to the digital book through the image recognition processing system, and then generates a three-dimensional virtual book with a page turning function through a virtual reality imaging system by using a digital book with an animated page turning function, a virtual reality imaging system. The three-dimensional virtual book is fed back to the user, and the user adjusts the image recognition processing system to personalize the attributes of the three-dimensional virtual book.

参阅图8,图8所示为虚拟图书馆设备的体感虚拟模块第二实施例的流程示意图。虚拟图书馆设备10的体感模拟模块103通过文字识别处理系统对通过扫描书籍或者输入电子文档获取的文字信息进行处理和渲染,获取能够近距离阅读的数字化书籍,体感虚拟模块103将数字化书籍通过图像识别处理系统增加书籍翻页动画仿真、设置翻页动作及翻页时的声音,获得展现原书风貌的三维虚拟书,使得阅读者在阅读三维虚拟书时有阅读实体书一样的体验。Referring to FIG. 8, FIG. 8 is a schematic flowchart diagram of a second embodiment of a somatosensory virtual module of a virtual library device. The somatosensory simulation module 103 of the virtual library device 10 processes and renders the text information acquired by scanning the book or inputting the electronic document through the character recognition processing system to obtain a digital book that can be read at a close distance, and the somatosensory virtual module 103 passes the digitized book through the image. The recognition processing system increases the book flip animation simulation, sets the page turning action and the sound when the page is turned, and obtains a three-dimensional virtual book showing the original book style, so that the reader has the same experience of reading the physical book when reading the three-dimensional virtual book.

本实施例提供的虚拟阅读系统能将电子书三维虚拟化,为用户提供像实体书一样的阅读体验,为用户提供与书籍相适应的阅读氛围,有利于提高读者的阅读兴趣和效率The virtual reading system provided by the embodiment can virtualize the electronic book in three dimensions, provide the user with the same reading experience as the physical book, and provide the user with a reading atmosphere suitable for the book, which is beneficial to improving the reader's reading interest and efficiency.

参照图9,图9为本发明虚拟阅读系统第三实施例的功能模块示意图。图9所示的虚拟阅读系统1包括虚拟图书馆设备10、虚拟现实头盔20,虚拟图书馆设备10包括体感模拟模块103、控制模块104、视景生成模块105、笔记生成模块107、虚拟书架模块109、分享模块111。虚拟现实头盔20包括显示模块201、设置模块203。虚拟图书馆设备10与虚拟现实头盔20相连。下面对各功能模块进行详细说明。Referring to FIG. 9, FIG. 9 is a schematic diagram of functional modules of a third embodiment of a virtual reading system according to the present invention. The virtual reading system 1 shown in FIG. 9 includes a virtual library device 10, a virtual reality helmet 20, and the virtual library device 10 includes a somatosensory simulation module 103, a control module 104, a view generation module 105, a note generation module 107, and a virtual bookshelf module. 109. Sharing module 111. The virtual reality helmet 20 includes a display module 201 and a setting module 203. The virtual library device 10 is connected to the virtual reality helmet 20. The function modules are described in detail below.

虚拟图书馆设备10的体感模拟模块103将电子书模拟生成三维虚拟书,即将相关的数字化书籍转化为对应的虚拟实体书,将电子书模拟生成三维虚拟书具体包括:对数字化的文字进行相应的排版、渲染,使文字能够近距离阅读,将排版后的数字化文字通过三维图像处理获得三维虚拟图书。需要说明的是,数字化书籍可以通过扫描仪将实体书的文字录入虚拟图书馆设备,或者直接从网上将电子书导入,三维虚拟书中包括与书籍内容相关的实物模型。虚拟图书馆设备10的体感虚拟模块103还对三维虚拟书创建动画翻页功能,即模拟翻动实体书的书页的动作、动画翻页时播放的翻页声音及设置三维虚拟书的摆放角度。虚拟图书馆设备10的控制模块104将带有动画翻页功能的三维虚拟书传输给虚拟现实头盔20,以供虚拟现实头盔20展示带有动画翻页功能的三维虚拟书。The somatosensory simulation module 103 of the virtual library device 10 simulates an e-book to generate a three-dimensional virtual book, that is, converts the related digital book into a corresponding virtual physical book, and simulates the e-book to generate a three-dimensional virtual book, which specifically includes: correspondingly digitizing the digitized text Typesetting and rendering, so that the text can be read at a close distance, and the digitized text after the typesetting can be processed into a three-dimensional virtual book through three-dimensional image processing. It should be noted that the digital book can input the text of the physical book into the virtual library device through the scanner, or directly import the electronic book from the online, and the three-dimensional virtual book includes the physical model related to the book content. The somatosensory virtual module 103 of the virtual library device 10 also creates an animated page turning function for the three-dimensional virtual book, that is, an action of flipping a book page of a physical book, a page turning sound played when the animated page is turned, and a setting angle of setting a three-dimensional virtual book. The control module 104 of the virtual library device 10 transmits a three-dimensional virtual book with an animated page turning function to the virtual reality helmet 20 for the virtual reality helmet 20 to display a three-dimensional virtual book with an animated page turning function.

虚拟现实头盔20显示模块201从虚拟图书馆设备接受带有动画翻页功能的三维虚拟书,并将带有动画翻页功能的三维虚拟书进行三维显示。The virtual reality helmet 20 display module 201 accepts a three-dimensional virtual book with an animated page turning function from the virtual library device, and three-dimensionally displays the three-dimensional virtual book with an animated page turning function.

虚拟图书馆设备10的视景生成模块105创建三维虚拟模型,三维虚拟模型包括各种动物的虚拟模型,各种景色的虚拟模型,视景生成模块105还用于获取具有自然景象的图片,对图片采用全景技术处理,获得三维全景图像,根据不同的自然景象图片,可以生成不同的三维全景图像,因而能提供多种三维全景图像,为用户创造多种多样的阅读环境,创建多种多样的三维虚拟模型可以提高阅读趣味性。虚拟图书馆设备10的控制模块104将三维虚拟模型、三维全景图像传输给虚拟现实头盔20,以供虚拟现实头盔20展示三维虚拟模型、三维全景图像,为用户提供不同的阅读环境。下面结合图10对虚拟图书馆设备的视景生成模块的具体工作方式进行说明。The visual scene generating module 105 of the virtual library device 10 creates a three-dimensional virtual model including a virtual model of various animals, a virtual model of various scenes, and the visual scene generating module 105 is further configured to acquire a picture with a natural scene, The image is processed by panoramic technology to obtain 3D panoramic images. According to different natural scene images, different 3D panoramic images can be generated, thus providing a variety of 3D panoramic images, creating a variety of reading environments for users, creating a variety of 3D virtual models can improve reading fun. The control module 104 of the virtual library device 10 transmits the three-dimensional virtual model and the three-dimensional panoramic image to the virtual reality helmet 20 for the virtual reality helmet 20 to display a three-dimensional virtual model and a three-dimensional panoramic image to provide different reading environments for the user. The specific working mode of the view generation module of the virtual library device will be described below with reference to FIG.

参阅图10,图10所示为虚拟图书馆设备的视景生成模块一实施例的工作流程图。视景生成模块105利用鱼眼镜头或者普通相机进行图像采集,根据图像处理技术及全景技术生成真实感极强大的自然景象的三维全景图像、其他图像对应的三维虚拟图像。Referring to FIG. 10, FIG. 10 is a flowchart showing the operation of an embodiment of a visual generating module of a virtual library device. The gaze generating module 105 performs image acquisition using a fisheye lens or a normal camera, and generates a three-dimensional panoramic image with a very realistic natural scene and a three-dimensional virtual image corresponding to other images according to the image processing technology and the panoramic technology.

请继续参阅图9,虚拟现实头盔20的显示模块201从虚拟图书馆设备10接受三维虚拟模型、三维全景图像,并将三维虚拟模型、三维全景图像进行三维显示。Referring to FIG. 9 , the display module 201 of the virtual reality helmet 20 receives the three-dimensional virtual model and the three-dimensional panoramic image from the virtual library device 10 , and displays the three-dimensional virtual model and the three-dimensional panoramic image in three dimensions.

虚拟现实头盔20的设置模块203接收设置信号,将设置信号传输给虚拟图书馆设备10,其中,设置信号用于对三维虚拟书、三维全景图像、三维虚拟模型的属性进行调节。The setting module 203 of the virtual reality helmet 20 receives the setting signal and transmits the setting signal to the virtual library device 10, wherein the setting signal is used to adjust the attributes of the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model.

虚拟图书馆设备10的控制模块104接收虚拟现实头盔的设置模块203传输的设置信号,根据设置信号对三维虚拟书、三维全景图像的属性进行调节,例如对三维虚拟书的文字属性进行调节。控制模块104还接收第一查询信息,根据第一查询信息检索对应的三维虚拟书,接收第二查询信息,根据第二查询信息检索三维虚拟书的笔记信息。笔记生成模块107记录三维虚拟书的笔记信息,笔记信息包括用户输入的阅读体会、文字创作等内容。 The control module 104 of the virtual library device 10 receives the setting signal transmitted by the setting module 203 of the virtual reality helmet, and adjusts the attributes of the three-dimensional virtual book and the three-dimensional panoramic image according to the setting signal, for example, adjusting the text attribute of the three-dimensional virtual book. The control module 104 further receives the first query information, retrieves the corresponding three-dimensional virtual book according to the first query information, receives the second query information, and retrieves the note information of the three-dimensional virtual book according to the second query information. The note generation module 107 records the note information of the three-dimensional virtual book, and the note information includes the reading experience input by the user, the text creation, and the like.

虚拟图书馆设备10的虚拟书架模块109建立三维虚拟书架,将三维虚拟书进行分类,摆放在三维虚拟书架上。分享模块111实时在网络上分享笔记信息。The virtual bookshelf module 109 of the virtual library device 10 creates a three-dimensional virtual bookshelf, classifies the three-dimensional virtual books, and places them on the three-dimensional virtual bookshelf. The sharing module 111 shares notes information on the network in real time.

虚拟现实头盔20显示模块201还接受三维虚拟书的笔记信息、三维虚拟书架,并显示三维虚拟书架,并将三维虚拟书进行分类,显示在三维虚拟书架上,在显示三维虚拟书的同时显示对应的笔记信息。虚拟现实头盔20显示模块201还包括视频音频播放模块,视频音频播放模块用于播放音频视频,提供视频音频播放功能。The virtual reality helmet 20 display module 201 also accepts the three-dimensional virtual book's note information, the three-dimensional virtual bookshelf, and displays the three-dimensional virtual bookshelf, and classifies the three-dimensional virtual book, displays it on the three-dimensional virtual bookshelf, and displays the corresponding corresponding to the three-dimensional virtual book. Note information. The virtual reality helmet 20 display module 201 further includes a video audio playing module, and the video audio playing module is used for playing audio video and providing a video audio playing function.

本实施例提供的虚拟阅读系统能将电子书三维虚拟化,为用户提供像实体书一样的阅读体验,还提供三维全景图像,为用户提供可选的阅读环境,为用户提供与书籍相适应的阅读氛围,能提供虚拟书架及笔记分享功能,有利于提高读者的阅读兴趣和效率。The virtual reading system provided by the embodiment can virtualize the electronic book in three dimensions, provide the user with a reading experience like a physical book, and provide a three-dimensional panoramic image, providing an optional reading environment for the user, and providing the user with the book. Reading atmosphere, can provide virtual bookshelf and note sharing function, which helps to improve readers' interest and efficiency in reading.

以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (14)

一种虚拟图书馆设备,其特征在于,包括: A virtual library device, comprising: 体感虚拟模块,用于将电子书模拟生成三维虚拟书,对所述三维虚拟书创建动画翻页功能、动画翻页时播放的翻页声音及设置所述三维虚拟书的摆放角度,其中所述三维虚拟书包括语音播放功能; a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein The three-dimensional virtual book includes a voice playing function; 控制模块,用于将所述带有动画翻页功能的三维虚拟书传输给显示设备,以供所述显示设备展示所述带有动画翻页功能的三维虚拟书 。a control module, configured to transmit the three-dimensional virtual book with an animated page turning function to the display device, for the display device to display the three-dimensional virtual book with an animated page turning function . 如权利要求1所述的虚拟图书馆设备,其特征在于,还包括:The virtual library device of claim 1 further comprising: 视景生成模块,用于获取具有自然景象的图片,对所述图片采用全景技术处理,获得三维全景图像;a visor generating module, configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image; 所述控制模块,还用于将所述三维全景图像传输给所述显示设备,以供所述显示设备展示所述三维全景图像。The control module is further configured to transmit the three-dimensional panoramic image to the display device, so that the display device displays the three-dimensional panoramic image. 如权利要求2所述的虚拟图书馆设备,其特征在于,所述视景生成模块,还用于创建三维虚拟模型;The virtual library device according to claim 2, wherein the view generating module is further configured to create a three-dimensional virtual model; 所述控制模块,还用于将所述三维虚拟模型传输给所述显示设备,以供所述显示设备展示所述三维虚拟模型。The control module is further configured to transmit the three-dimensional virtual model to the display device, so that the display device displays the three-dimensional virtual model. 如权利要求3所述的虚拟图书馆设备,其特征在于,所述控制模块,还用于接收第一设置信号,根据所述第一设置信号对所述三维虚拟书、所述三维全景图像、所述三维虚拟模型的属性进行调节。The virtual library device according to claim 3, wherein the control module is further configured to receive a first setting signal, and the three-dimensional virtual book, the three-dimensional panoramic image, according to the first setting signal, The properties of the three-dimensional virtual model are adjusted. 如权利要求2所述的虚拟图书馆设备,其特征在于,还包括:The virtual library device of claim 2, further comprising: 笔记生成模块,用于记录所述三维虚拟书的笔记信息;a note generation module, configured to record note information of the three-dimensional virtual book; 虚拟书架模块,用于建立三维虚拟书架,将所述三维虚拟书进行分类,摆放在所述三维虚拟书架上;a virtual bookshelf module for creating a three-dimensional virtual bookshelf, classifying the three-dimensional virtual books, and placing the three-dimensional virtual books on the three-dimensional virtual bookshelf; 分享模块,用于实时在网络上分享所述笔记信息,其中,所述分享模块还包括触控笔和触控板,并将所述触控笔在所述触控板上输入的绘图信息实时进行分享;a sharing module, configured to share the note information on the network in real time, wherein the sharing module further includes a stylus and a touchpad, and the drawing information input by the stylus on the touchpad is real-time Share; 播放模块,用于播放音频数据和/或视频数据。A playback module for playing audio data and/or video data. 如权利要求5所述的虚拟图书馆设备,其特征在于,所述体感虚拟模块,还用于对所述笔记信息进行格式转换,并将转换格式后的笔记信息显示在阅览编辑器中;The virtual library device according to claim 5, wherein the somatosensory virtual module is further configured to perform format conversion on the note information, and display the converted format note information in a browsing editor; 所述控制模块,还用于接收查询信息,根据所述查询信息检索对应的三维虚拟书。 The control module is further configured to receive query information, and retrieve a corresponding three-dimensional virtual book according to the query information. 一种虚拟现实头盔,其特征在于,包括:A virtual reality helmet, comprising: 显示模块,用于将带有动画翻页功能的三维虚拟书、三维全景图像、三维虚拟模型进行三维显示。The display module is configured to perform three-dimensional display of a three-dimensional virtual book, a three-dimensional panoramic image, and a three-dimensional virtual model with an animated page turning function. 如权利要求7所述虚拟现实头盔,其特征在于,还包括:The virtual reality helmet of claim 7 further comprising: 处理模块,用于存储包含自然景象的图片,根据所述包含自然景象的图片生产所述三维全景图像; a processing module, configured to store a picture including a natural scene, and generate the three-dimensional panoramic image according to the picture that includes a natural scene; 设置模块,还用于接收第二设置信号,将所述第二设置信号传输给虚拟图书馆设备,以供所述虚拟图书馆设备根据所述第二设置信号对所述三维虚拟书、所述三维全景图像、所述三维虚拟模型的属性进行调节。a setting module, configured to receive a second setting signal, and transmit the second setting signal to the virtual library device, for the virtual library device to view the three-dimensional virtual book according to the second setting signal, The three-dimensional panoramic image and the attributes of the three-dimensional virtual model are adjusted. 如权利要求7所述虚拟现实头盔,其特征在于,所述显示模块,还用于显示所述三维虚拟书的笔记信息,显示三维虚拟书架,并将所述三维虚拟书进行分类,显示在所述三维虚拟书架上,以及播放音频数据和/或视频数据。The virtual reality helmet according to claim 7, wherein the display module is further configured to display note information of the three-dimensional virtual book, display a three-dimensional virtual bookshelf, and classify the three-dimensional virtual book and display the same in the virtual reality book. On a three-dimensional virtual bookshelf, and playing audio data and/or video data. 一种虚拟阅读系统,其特征在于,包括虚拟图书馆设备、虚拟现实头盔,其中,所述虚拟图书馆设备包括:A virtual reading system, comprising: a virtual library device, a virtual reality helmet, wherein the virtual library device comprises: 体感虚拟模块,用于将电子书模拟生成三维虚拟书,对所述三维虚拟书创建动画翻页功能、动画翻页时播放的翻页声音及设置所述三维虚拟书的摆放角度,其中所述三维虚拟书包括语音播放功能; a somatosensory virtual module for simulating an e-book to generate a three-dimensional virtual book, an animated page turning function for the three-dimensional virtual book, a page turning sound played when the animated page is flipped, and setting a viewing angle of the three-dimensional virtual book, wherein The three-dimensional virtual book includes a voice playing function; 控制模块,用于将所述带有动画翻页功能的三维虚拟书传输给所述虚拟现实头盔; a control module, configured to transmit the three-dimensional virtual book with an animated page turning function to the virtual reality helmet; 所述虚拟现实头盔包括: The virtual reality helmet includes: 显示模块,用于将所述虚拟图书馆设备传输的带有动画翻页功能的三维虚拟书进行三维显示。 And a display module, configured to perform three-dimensional display of the three-dimensional virtual book with an animated page turning function transmitted by the virtual library device. 如权利要求10所述的虚拟阅读系统,其特征在于,所述虚拟图书馆设备还包括:The virtual reading system of claim 10, wherein the virtual library device further comprises: 视景生成模块,用于获取具有自然景象的图片,对所述图片采用全景技术处理,获得三维全景图像;a visor generating module, configured to acquire a picture with a natural scene, and use the panoramic technology to process the picture to obtain a three-dimensional panoramic image; 所述控制模块,还用于将所述三维全景图像传输给所述虚拟现实头盔;The control module is further configured to transmit the three-dimensional panoramic image to the virtual reality helmet; 所述虚拟现实头盔的所述显示模块,还用于将所述三维全景图像进行三维显示。The display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional panoramic image. 如权利要求11所述的虚拟阅读系统,其特征在于,所述虚拟图书馆设备的所述视景生成模块,还用于创建三维虚拟模型;The virtual reading system of claim 11, wherein the view generating module of the virtual library device is further configured to create a three-dimensional virtual model; 所述控制模块,还用于将所述三维虚拟模型传输给所述虚拟显示头盔;The control module is further configured to transmit the three-dimensional virtual model to the virtual display helmet; 所述虚拟现实头盔的所述显示模块,还用于将所述三维虚拟模型进行三维显示。The display module of the virtual reality helmet is further configured to perform three-dimensional display on the three-dimensional virtual model. 如权利要求12所述的虚拟阅读系统,其特征在于,所述虚拟现实头盔还包括:The virtual reading system of claim 12, wherein the virtual reality helmet further comprises: 设置模块,用于接收设置信号,将所述设置信号传输给所述虚拟图书馆设备,其中,所述设置信号用于对所述三维虚拟书、所述三维全景图像、所述三维虚拟模型的属性进行调节;a setting module, configured to receive a setting signal, and transmit the setting signal to the virtual library device, wherein the setting signal is used for the three-dimensional virtual book, the three-dimensional panoramic image, and the three-dimensional virtual model Attribute adjustment; 所述虚拟图书馆设备的所述控制模块,还用于接收所述虚拟现实头盔的所述设置模块传输的所述设置信号,根据所述设置信号对所述三维虚拟书、所述三维全景图像、所述三维虚拟模型的属性进行调节。The control module of the virtual library device is further configured to receive the setting signal transmitted by the setting module of the virtual reality helmet, and the three-dimensional virtual book and the three-dimensional panoramic image according to the setting signal The properties of the three-dimensional virtual model are adjusted. 如权利要求11所述的虚拟阅读系统,其特征在于,所述虚拟图书馆设备还包括:The virtual reading system of claim 11 further comprising: 笔记生成模块,用于记录输入的所述三维虚拟书的笔记信息;a note generation module, configured to record input note information of the three-dimensional virtual book; 虚拟书架模块,用于建立三维虚拟书架,将所述三维虚拟书进行分类摆放在所述三维虚拟书架上;a virtual bookshelf module, configured to create a three-dimensional virtual bookshelf, and classify the three-dimensional virtual books on the three-dimensional virtual bookshelf; 分享模块,用于实时在网络上分享所述笔记信息; a sharing module for sharing the note information on the network in real time; 所述虚拟图书馆设备的所述控制模块,还用于接收第一查询信息,根据所述第一查询信息检索对应的三维虚拟书,接收第二查询信息,根据所述第二查询信息检索所述三维虚拟书的笔记信息; The control module of the virtual library device is further configured to receive first query information, retrieve a corresponding three-dimensional virtual book according to the first query information, receive second query information, and search for the second query information according to the second query information. The note information of the three-dimensional virtual book; 所述虚拟现实头盔的所述显示模块,还用于显示所述三维虚拟书的笔记信息、三维虚拟书架,其中,将所述三维虚拟书进行分类显示在所述三维虚拟书架上,以及播放音频数据和/或视频数据。The display module of the virtual reality helmet is further configured to display note information of the three-dimensional virtual book, a three-dimensional virtual bookshelf, wherein the three-dimensional virtual book is classified and displayed on the three-dimensional virtual bookshelf, and the audio is played. Data and / or video data.
PCT/CN2017/078737 2017-03-30 2017-03-30 Virtual library device, virtual reality headpiece, and virtual reading system Ceased WO2018176309A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/078737 WO2018176309A1 (en) 2017-03-30 2017-03-30 Virtual library device, virtual reality headpiece, and virtual reading system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/078737 WO2018176309A1 (en) 2017-03-30 2017-03-30 Virtual library device, virtual reality headpiece, and virtual reading system

Publications (1)

Publication Number Publication Date
WO2018176309A1 true WO2018176309A1 (en) 2018-10-04

Family

ID=63673823

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/078737 Ceased WO2018176309A1 (en) 2017-03-30 2017-03-30 Virtual library device, virtual reality headpiece, and virtual reading system

Country Status (1)

Country Link
WO (1) WO2018176309A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111182284A (en) * 2020-01-19 2020-05-19 铁道警察学院 A library VR simulation image preview terminal
CN112348970A (en) * 2020-11-11 2021-02-09 华南农业大学 Book virtual reality interaction method in closed book collection room

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101063971A (en) * 2006-04-26 2007-10-31 英福达科技股份有限公司 Method and system for making shared notes and content errata difference update e-book
CN103823818A (en) * 2012-11-19 2014-05-28 大连鑫奇辉科技有限公司 Book system on basis of virtual reality
CN104272246A (en) * 2012-03-02 2015-01-07 三星电子株式会社 Method and device for turning pages in a terminal
CN105511632A (en) * 2016-01-25 2016-04-20 京东方科技集团股份有限公司 Signal acquisition device and virtual reality apparatus and control method thereof
CN105934730A (en) * 2014-01-23 2016-09-07 微软技术许可有限责任公司 Automated content scrolling

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101063971A (en) * 2006-04-26 2007-10-31 英福达科技股份有限公司 Method and system for making shared notes and content errata difference update e-book
CN104272246A (en) * 2012-03-02 2015-01-07 三星电子株式会社 Method and device for turning pages in a terminal
CN103823818A (en) * 2012-11-19 2014-05-28 大连鑫奇辉科技有限公司 Book system on basis of virtual reality
CN105934730A (en) * 2014-01-23 2016-09-07 微软技术许可有限责任公司 Automated content scrolling
CN105511632A (en) * 2016-01-25 2016-04-20 京东方科技集团股份有限公司 Signal acquisition device and virtual reality apparatus and control method thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111182284A (en) * 2020-01-19 2020-05-19 铁道警察学院 A library VR simulation image preview terminal
CN112348970A (en) * 2020-11-11 2021-02-09 华南农业大学 Book virtual reality interaction method in closed book collection room

Similar Documents

Publication Publication Date Title
WO2021242005A1 (en) Electronic device and method for generating user avatar-based emoji sticker
CN107851299B (en) Information processing apparatus, information processing method, and program
CN110636365B (en) Video character adding method and device, electronic equipment and storage medium
WO2021221394A1 (en) Method and electronic device for image augmentation
WO2017057960A1 (en) Electronic device and method for controlling the same
WO2019027090A1 (en) Mobile terminal and control method thereof
WO2021054589A1 (en) Electronic apparatus and controlling method thereof
JP6683864B1 (en) Content control system, content control method, and content control program
WO2021025509A1 (en) Apparatus and method for displaying graphic elements according to object
WO2019035582A1 (en) Display apparatus and server, and control methods thereof
WO2020153772A1 (en) Electronic device and method of providing content therefor
WO2020242064A1 (en) Mobile device and mobile device control method
WO2021133053A1 (en) Electronic device and method for controlling same
WO2019066537A1 (en) Device for displaying content and operation method therefor
WO2017175910A1 (en) Method and apparatus for processing image
WO2016126083A1 (en) Method, electronic device, and recording medium for notifying of surrounding situation information
WO2018176309A1 (en) Virtual library device, virtual reality headpiece, and virtual reading system
EP3707678A1 (en) Method and device for processing image
WO2020122513A1 (en) Method for processing two-dimensional image and device for executing method
WO2019190142A1 (en) Method and device for processing image
WO2021075705A1 (en) Electronic device and control method therefor
WO2021256800A1 (en) Electronic apparatus and method for generating image in electronic apparatus
WO2024232537A1 (en) Method and electronic device for providing content
WO2023224212A1 (en) Image processing method and image processing device for facilitating three-dimensional object editing by user
WO2024058405A1 (en) Electronic device and method for controlling electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17903839

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17903839

Country of ref document: EP

Kind code of ref document: A1