TW201324332A - Transparent display using augmented reality and wireless identification technologies - Google Patents

Abstract

A transparent display using augmented reality (AR) and wireless identification technologies is adapted for a transparent surface of a fixed space containing an organism having a wireless identification tag. The transparent display uses a wireless identification reader to receive data transmitted from the wireless identification tag of the organism and, when receiving the transmitted data, reads introduction data corresponding to the organism from a storage unit. The transparent display then uses the AR technology to generate, according to a real-scene image in the fixed space captured by an image sensor and the introduction data of the organism read from the storage unit, an augmented image of the introduction data of the organism and displays the augmented image on transparent display unit. Accordingly, when a user looks into the fixed space through the transparent display unit, he or she will see not only the real-scene behind the transparent display unit but also the augmented image on transparent display unit. The augmented image includes the introduction data corresponding to the organism in the real-scene so that it implements a real-scene tour-guide function for organisms.

Description

Transparent display combined with augmented reality and wireless identification technology

The present invention relates to a display capable of displaying images, and more particularly to a transparent display capable of displaying images.

The transparent display means that the display itself has a certain degree of transparency, allowing the user to view the image displayed on the display while still seeing the background behind the display to a certain extent. Currently, transparent displays are mainly used in applications that are not suitable for setting up displays, such as on shop windows to provide product information in the window, for use on bus or MRT windows to provide advertising or living information for use on car windshields. Provide navigation information. Of course, transparent displays can be used in existing applications such as televisions, monitors, notebook computers, and tablets, and thus have considerable applicability and growth potential.

The object of the present invention is to propose a new application of a transparent display, which combines augmented reality (AR) and wireless identification technology to provide a biological reality navigation function in a fixed space such as an aquarium, wherein AR technology It is a technology that adds real-world real scenes or images to corresponding virtual images on the display screen. It can combine and interact with virtual and reality. The wireless identification technology can be radio-frequency identification (RFID) technology. It can also be a near field communication (NFC) technology developed based on RFID and interconnection technology.

In order to achieve the above object or other objects, the present invention provides a transparent display combining AR and wireless identification technology, which is suitable for a transparent surface of a fixed space, and the fixed space accommodates at least one creature with a wireless identification tag, wherein The wireless identification technology can be either RFID technology or NFC technology. The transparent display comprises a wireless identification reader, a storage unit, an image sensor, a transparent display unit, a touch sensor, a brightness sensor, an auxiliary backlight and a control unit. The wireless identification reader is configured to receive data transmitted by the wireless identification tag carried by the living being. The storage unit is configured to store the introduction material of the living being. The image sensor is used to capture images of real scenes in a fixed space. A transparent display unit is used to display images. The touch sensor is used to sense whether the user has a touch input on the transparent display unit. The brightness sensor is used to sense the ambient light intensity outside the fixed space. A secondary backlight is used to provide an auxiliary backlight. The control unit is configured to read the introduction material of the living item from the storage unit according to the data sent by the wireless identification tag of the living body received by the wireless identification reader, and take the real scene in the fixed space taken by the image sensor The image and the introduction material of the living body generate an amplified image of the introduction material of the living body by the AR technology, and control the transparent display unit to display the amplified image of the introduction material of the living body. The control unit is further configured to perform a corresponding operation when receiving the touch input sensed by the touch sensor, and control the auxiliary backlight to provide the auxiliary backlight when the ambient light intensity sensed by the brightness sensor is insufficient.

The transparent display of the present invention combines the AR and the RFID/NFC technology to allow the user to see the transparent display unit in a fixed space such as an aquarium, in addition to seeing the real scene behind the transparent display unit, and also seeing the transparent display unit. Augmented images of the introduction materials corresponding to the creatures in the real scene displayed on the display, realizing the biological reality navigation function.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

FIG. 1 is a circuit block diagram of a transparent display incorporating AR and wireless identification technology according to a preferred embodiment of the present invention. Referring to FIG. 1, the transparent display 1 is applied to a transparent surface of a fixed space, and the fixed space accommodates at least one creature with a wireless identification tag. For example, as shown in FIG. 2, the transparent display 1 is applied to a public aquarium 2, and the fixed space defined by the aquarium 2 accommodates creatures with wireless identification tags including animals such as fish 31a, 31b, 31c and plants such as water plants 32a, 32b. The front surface 21 of the fixed space defined by the aquarium 2 is provided with transparent glass and at least one transparent display unit 14 is attached or embedded thereon, or the transparent glass provided on the front surface 21 is replaced by a transparent display unit, and the rest is replaced. For example, the rear surface 22, the left surface 23, the right surface 24, and the lower surface 26 are provided with opaque glass, and the upper surface 25 is an open surface as the fixed space entrance and exit. However, this embodiment is not intended to limit the present invention. For example, the transparent display can also be applied to a fixed space defined by a zoo area in a public place such as a koala, or a fixed space defined by a botanical garden such as a rainforest greenhouse.

The transparent display 1 includes a wireless identification reader 11, a storage unit 12, an image sensor 13, a transparent display unit 14, a touch sensor 15, a brightness sensor 16, an auxiliary backlight 17, a control unit 18, and a wireless device. Transmitter 19. The control unit 18 is electrically connected to the wireless identification reader 11, the storage unit 12, the image sensor 13, the transparent display unit 14, the touch sensor 15, the brightness sensor 16, the auxiliary backlight 17, and the wireless transmitter. 19.

The wireless identification reader 11 is for receiving data transmitted by the wireless identification tag carried by the creatures 31a, 31b, 31c, 32a, 32b in the aquarium 2. When the RFID technology is adopted, the wireless identification reader 11 is an RFID reader, and the wireless identification tag is an RFID tag. The RFID tag is classified into a passive type, a semi-passive type, and an active type. There is no battery inside the passive RFID tag, which drives an internal integrated circuit (IC) by receiving electromagnetic waves emitted by the RFID reader. When the IC receives electromagnetic waves of sufficient intensity, it can send data to the RFID reader. It includes not only unique ID codes, but also data pre-stored in internal memory. The semi-passive RFID tag has a small battery inside, and its power can drive the internal IC, making it more efficient than passive. The active RFID tag has a power supply inside that allows it to work longer distances and usually has larger internal memory. When using the NFC technology, the wireless identification reader 11 is an NFC reader, the wireless identification tag is an NFC tag, and the NFC tag is usually passive.

The storage unit 12 is configured to store introduction materials of a plurality of creatures, for example, at least the introduction materials of the existing organisms 31a, 31b, 31c, 32a, 32b in the aquarium 2 are stored. This introduction can include basic information about the organism, such as scientific name, common name, nickname, gender, age, time to enter the aquarium, etc. It can also include advanced data of the organism, such as distribution area, characteristics, ecology, economic utilization, etc. Including hyperlinks between materials or hyperlinks to related web pages, such as linking from basic information to advanced materials or linking to the respective fan club pages of the creature. In an embodiment, the storage unit 12 may be a non-volatile memory such as an electrically erasable programmable read-only memory (EEPROM) or a flash memory.

The image sensor 13 is for taking in an image of a real scene in the aquarium 2. In an embodiment, the image sensor 13 may be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) image sensor.

The transparent display unit 14 is for displaying an image. In an embodiment, the transparent display unit may be an organic light-emitting diode (OLED) display unit.

The touch sensor 15 is configured to sense whether the user has a touch input on the transparent display unit. In an embodiment, the touch sensor can be a touch sensor such as a resistive type, a surface acoustic wave type, a capacitive type, an infrared scanning type, or an infrared image sensing type.

The brightness sensor 16 is used to sense the ambient light intensity outside the aquarium 2. In an embodiment, the brightness sensor may be a brightness sensor using a photonic crystal or a photodiode or the like.

A secondary backlight 17 is used to provide an auxiliary backlight. In an embodiment, the auxiliary backlight 17 may be an auxiliary backlight using a light-emitting diode (LED) or the like as a light source.

The control unit 18 is configured to read the corresponding biometrics from the storage unit 12 according to the information transmitted by the wireless identification reader 11 receiving the wireless identification tag carried by the organisms 31a, 31b, 31c, 32a, 32b in the aquarium 2. The data is generated by both the image of the real scene in the aquarium 2 taken by the image sensor 13 and the introduction material of the recorded organism, and the amplified image of the introduction material of the biological object is generated by the AR technology, and the display of the display by the transparent display unit 14 is controlled. Amplified images of the presentation materials of the creatures.

For example, at a certain point in time, the real scene 31 in the aquarium 2 is as shown in Fig. 3A. At this time, the control unit 18 receives the image of the real scene 31 in the aquarium 2 taken by the image sensor 13, and cooperates with the introduction material of the living matter read from the storage unit 12 to generate an augmentation image 32 of the introduction material of the living body by the AR technology. As shown in FIG. 3B, in this embodiment, the augmentation image 32 includes only the common names and nicknames in the introduction materials of the creature. Moreover, the control unit 18 also controls the transparent display unit 14 to display the amplified image 32. Therefore, the user sees the image 33 seen by the transparent display unit 14 toward the aquarium 2, as shown in FIG. 3C, except that the real scene 31 behind the transparent display unit 14 is seen, and the transparent display unit 14 is also seen. The expanded image 32 of the introduction material corresponding to the creature in the real scene 31 is displayed, and the biological reality navigation function is realized.

The control unit 18 is further configured to perform a corresponding operation when receiving the touch input sensed by the touch sensor 15 . For example, as shown in FIG. 4, when the user sees the image 33 as shown in FIG. 3C, the control unit 18 can be further moved from the place where the princess clownfish "flower" is displayed on the transparent display unit 14. The storage unit 12 reads other materials in the introduction materials of the corresponding creatures, such as scientific name, gender, age, time of entering the aquarium, advanced data hyperlinks, and hyperlinks of the webpage, and then controls the transparent display unit 14 to display. Therefore, the user can operate the transparent display 1 by touching the transparent display unit 14, such as displaying more introduction materials, turning on or off the biological reality navigation function, and the like. The control unit 18 is further configured to control the auxiliary backlight 17 to provide an auxiliary backlight when the ambient light intensity sensed by the brightness sensor 16 is insufficient. In an embodiment, control unit 18 may be a microcontroller unit (MCU).

The wireless transmitter 19 is used to provide an audio guide to a user who is equipped with a wireless receiver. In an embodiment, the wireless transmitter 19 and the wireless receiver can be a Bluetooth transmitter and a Bluetooth receiver, respectively, and the Bluetooth receiver is disposed on an audio navigation device such as a headset, and the user has a Bluetooth device through the belt. The audio navigation device of the receiver receives the audio guide transmitted by the wireless transmitter 19.

In summary, the transparent display of the present invention combines the AR and the RFID/NFC technology to allow the user to see the transparent display unit in a fixed space such as an aquarium, in addition to seeing the real scene behind the transparent display unit, The biological live view navigation function is realized by amplifying the image of the introduction material corresponding to the living creature displayed on the transparent display unit.

While the present invention has been described above in terms of the preferred embodiments thereof, it is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

1. . . Transparent display

11. . . Wireless identification reader

12. . . Storage unit

13. . . Image sensor

14. . . Transparent display unit

15. . . Touch sensor

16. . . Brightness sensor

17. . . Auxiliary backlight

18. . . control unit

19. . . Wireless transmitter

2. . . Aquarium

twenty one. . . Front surface

twenty two. . . Back surface

twenty three. . . Left surface

twenty four. . . Right surface

25. . . Upper surface

26. . . lower surface

31a, 31b, 31c, 32a, 32b. . . biological

31. . . Real scene

32. . . Amplified image

33. . . Image seen by the user

FIG. 1 is a circuit block diagram of a transparent display incorporating AR and wireless identification technology according to a preferred embodiment of the present invention.

2 is a schematic view of the transparent display shown in FIG. 1 applied to an aquarium.

3A-3C are schematic diagrams of the transparent display shown in FIG. 2 generating an augmented image to realize a biological reality tour.

4 is a schematic diagram of the transparent display shown in FIG. 2 being touched by a user to display more introductory materials.

1. . . Transparent display

11. . . Wireless identification reader

12. . . Storage unit

13. . . Image sensor

14. . . Transparent display unit

15. . . Touch sensor

16. . . Brightness sensor

17. . . Auxiliary backlight

18. . . control unit

19. . . Wireless transmitter

Claims (10)

A transparent display combined with augmented reality and wireless identification technology is applied to a transparent surface of a fixed space, the fixed space accommodating at least one creature with a wireless identification tag, the transparent display comprising:
a wireless identification reader for receiving data sent by the wireless identification tag carried by the at least one creature;
a storage unit for storing the introduction material of the at least one creature;
An image sensor for capturing an image of a real scene in the fixed space;
a transparent display unit for displaying an image;
a touch sensor for sensing whether the user has a touch input on the transparent display unit;
a brightness sensor for sensing ambient light intensity outside the fixed space;
An auxiliary backlight for providing an auxiliary backlight; and a control unit for reading the at least the wireless identification tag received by the wireless identification reader from the storage unit An introduction material of the living body, the image of the real scene in the fixed space taken by the image sensor and the introduction material of the at least one creature are generated by the augmented reality technology to generate an amplified image of the introduction material of the at least one creature, and Controlling the transparent display unit to display an augmented image of the at least one biological presentation material, performing a corresponding operation upon receiving the touch input sensed by the touch sensor, and receiving the brightness sensor sensing The auxiliary backlight is controlled to provide an auxiliary backlight when the ambient light intensity is insufficient. A transparent display combined with augmented reality and wireless identification technology as described in claim 1 wherein the wireless identification technology comprises radio frequency identification technology or near field communication technology. A transparent display incorporating augmented reality and wireless identification technology as described in claim 1, wherein the fixed space comprises a fixed space of an aquarium, a zoo area or a botanical garden area. A transparent display incorporating augmented reality and wireless identification technology as described in claim 1, wherein the at least one organism comprises an animal or a plant. The transparent display combined with the augmented reality and the wireless identification technology, as described in claim 1, wherein the at least one biological introduction material includes basic materials, optional advanced materials, and an optional web hyperlink. The transparent display according to claim 1, wherein the image sensor comprises a charge coupled device image sensor or a complementary metal oxide semiconductor image sensor. The transparent display combined with the augmented reality and the wireless identification technology according to claim 1, wherein the transparent display unit comprises an organic light emitting diode display unit. The transparent display combined with the augmented reality and the wireless identification technology, as described in claim 1, wherein the touch sensor comprises a resistive touch sensor, a surface acoustic wave touch sensor, and a capacitive type Touch sensor, infrared scanning touch sensor or infrared image sensing touch sensor. The transparent display combined with the augmented reality and the wireless identification technology as described in claim 1, wherein the brightness sensor comprises a brightness sensor using a photoelectric crystal or a brightness sensor using a photodiode. The transparent display combined with the augmented reality and the wireless identification technology according to claim 1, wherein the transparent display further comprises a wireless transmitter for providing an audio guide to the wireless receiver. user.