WO2024140554A1 - Display method and apparatus, and ar device - Google Patents

Abstract

The present application relates to the technical field of electronics, and discloses a display method and apparatus, and an AR device. The display method is applied to an AR device. The display method comprises: identifying the date on a calendar when it is detected that the calendar is present in the field of view; and displaying notification information at a target position corresponding to a target date.

Description

Display method, device and AR equipment

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to a Chinese patent application filed with the China Patent Office on December 27, 2022, with application number 202211685792.1 and invention name “Display method, device and AR device”. The entire contents of the Chinese patent application are incorporated herein by reference.

Technical Field

The present application belongs to the field of electronic technology, and specifically relates to a display method, device and AR equipment.

Background technique

With the development of electronic products, new intelligent terminal devices such as augmented reality (AR) have developed rapidly. They are used by more and more users and can be applied to more and more scenarios.

However, in the related art, when a user wears an AR device to view a calendar, he or she can only see the same content as when not wearing the AR device, that is, only date information. If the user wants to obtain more other information, such as schedule, etc., he or she can only obtain it through other means, which is extremely inconvenient.

Summary of the invention

The embodiments of the present application provide a display method, an apparatus, and an AR device, which can solve the problem that the existing AR device cannot obtain information other than the content displayed on the calendar.

In a first aspect, an embodiment of the present application provides a display method, which is applied to an AR device, and the method includes:

Upon detecting the presence of a calendar in the field of view, identifying a date on the calendar;

The target location information corresponding to the target date is notified.

In a second aspect, an embodiment of the present application provides a display device, which is applied to an AR device, and the device includes:

An identification module, configured to identify a date on a calendar when a calendar is detected in the field of view;

The display module is used to display the notification information at the target location corresponding to the target date.

In a third aspect, an embodiment of the present application provides an AR device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

In the embodiment of the present application, when the existence of a calendar is detected in the field of view, the date on the calendar is identified, and then the notification information is displayed at the target position corresponding to the target date. The embodiment of the present application uses AR display technology to display the notification information at the target position corresponding to the target date in the calendar in the field of view of the AR device, so that the notification information is combined with the calendar. Through the combination of virtual and real, the user can easily obtain the notification information corresponding to the target date, and can see the desired multiple information without having to use other devices, thereby improving the user's interactive experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a flow chart of a display method provided by an embodiment of the present application;

FIG2 is a display schematic diagram provided by an embodiment of the present application;

FIG3 is a display schematic diagram provided by an embodiment of the present application;

FIG4 is a display schematic diagram provided by an embodiment of the present application;

FIG5 is a display schematic diagram provided by an embodiment of the present application;

FIG6 is a display schematic diagram provided by an embodiment of the present application;

FIG7 is a display schematic diagram provided by an embodiment of the present application;

FIG8 is a schematic diagram of a display device provided by an embodiment of the present application;

FIG9 is a schematic diagram of the structure of an AR device provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of the hardware structure of an AR device provided by an embodiment of the present application.

Among them, 101-AR device, 102-electronic device, 103-calendar, 104-notification information, 105-schedule information, 106-weather information, 107-Bluetooth communication, 108-combined calendar, 110-calendar, 111-weather information, 112-schedule information, 120-cloud communication.

Detailed ways

The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and/or" in the specification and claims represents at least one of the connected objects, and the character "/" generally indicates that the objects associated with each other are in an "or" relationship.

In the following, in combination with the accompanying drawings, a display method, an apparatus and an AR device 101 provided in an embodiment of the present application are described in detail through specific embodiments and their application scenarios.

A display method provided in an embodiment of the present application is applied to an AR device 101, wherein the AR device 101 may be AR glasses, an AR helmet, etc.

As shown in FIG. 1 , it is a flow chart of a display method provided in an embodiment of the present application. As shown in FIG. 1 , the display method may include the contents shown in S101 to S102 .

In S101 , when it is detected that a calendar exists in the field of view, a date on the calendar is identified.

In this embodiment, the calendar can be a physical calendar, such as a desktop calendar, a wall calendar, etc., or an electronic calendar. The calendar can be a single-date display calendar, that is, a calendar that only displays the date of a certain day on a sheet, or a multi-date display calendar, that is, a sheet that can display the dates of a week, or a sheet that displays the dates of a month. The date on the calendar can be a target date, or multiple dates including the target date, which can be determined specifically according to the type of calendar, or according to the type of notification information 104 to be displayed.

The target date may be the current date, any day on the calendar, or all dates on the calendar. The target date may be determined based on actual conditions and is not limited in this application.

For example, if the calendar is a single-date calendar, the currently displayed date is the target date; if the calendar is a multiple-date calendar, all dates on the calendar can be target dates; the current date can also be obtained by communicating with the electronic device 102, or by obtaining the current date in the cloud, and then the location of the current date on the calendar is determined by identification to determine the target date, that is, the current date is the target date.

In S102, notification information is displayed at the target location corresponding to the target date.

The notification information 104 may be weather information, schedule information, important news of the day, received information, etc.

In this embodiment, the notification information 104 corresponding to the target date may be acquired by communicating with the electronic device 102 via Bluetooth or the like, or may be acquired through the cloud.

Specifically, after the AR device 101 detects the presence of a calendar in the field of view, it identifies the date on the calendar, then communicates with the electronic device 102 via Bluetooth communication 107 or cloud communication 120 and requests notification information 104 of the corresponding date. After receiving the request, the electronic device 102 sends the notification information 104 to the AR device 101, and the AR device 101 generates notification information 104 to be displayed.

If the calendar is a calendar that displays multiple dates, the electronic device 102 can communicate via Bluetooth or the cloud and request the notification information 104 corresponding to each date, or request the current date and the notification information 104 corresponding to the current date. After receiving the request, the electronic device 102 sends the notification information corresponding to each date to the user. 104, or the current date and the notification information 104 of the current date are sent to the AR device 101. The AR device 101 searches for the corresponding position in the calendar according to the notification information 104 corresponding to each date received, or the current date, and generates the notification information 104 to be displayed from the received notification information 104. If the target date is a single date, the target date can also be marked for the convenience of the user to view.

The notification information 104 may also be information stored in the AR device 101 , which can be directly obtained when needed. The specific acquisition method is not limited in the embodiment of the present application and is subject to actual application.

Among them, the target position can be a blank position on the calendar, or a peripheral position of the calendar, etc., as long as the position of the notification information 104 can be fully displayed. It can be determined according to actual conditions and is not limited in this application.

In this embodiment, the notification information 104 is displayed at the target position corresponding to the target date of the calendar in the field of view of the AR device 101, so that the user can see the calendar date and the notification information 104 combined on the screen through the AR device 101, allowing the user to easily obtain various information corresponding to the target date without having to use other devices to see the desired information.

In the embodiment of the present application, first, when the existence of a calendar is detected in the field of view, the date on the calendar is identified, and then the notification information 104 is displayed at the target position corresponding to the target date. The embodiment of the present application uses AR display technology to display the notification information 104 at the target position corresponding to the target date in the calendar in the field of view of the AR device, so that the notification information 104 is combined with the calendar. Through the combination of virtual and real, the user can easily obtain the notification information 104 corresponding to the target date, and can see the desired multiple information without having to use other devices, thereby improving the user's interactive experience.

Since the calendar can be a calendar that displays a single date or a calendar that displays multiple dates, in the case of a calendar that displays a single date, the date on the calendar can be identified by recognizing the text on the calendar, and then the target date can be determined. In the case of a calendar that displays multiple dates, the dates on the calendar can be identified by recognizing the text on the calendar, and if the target date is all dates, the target date can be determined, and if the target date is a single date, the target date can be determined by communicating with the electronic device or receiving a user's designation.

In other words, the date on the calendar can be identified by recognizing the text on the calendar. If it is a calendar that displays multiple dates, the date on the calendar can be directly identified and the date can be used as the target date. If it is a calendar that displays multiple dates and the target date is a single date, multiple dates can be identified by identifying the text on the calendar, and the multiple dates include the target date. If it is necessary to determine which specific date the target date is, the target date can be obtained through Bluetooth (as shown in Figures 2, 3, and 5) or the cloud (as shown in Figure 4), and then determined from the multiple dates. The target date can also be determined by receiving user input.

In a possible implementation of the present application, after identifying the date on the calendar, the display method may further include: when the calendar displays multiple dates, receiving a first input from the user; in response to the first input, selecting a date from multiple dates in the calendar as the target date.

That is, if the calendar is a calendar that displays multiple dates, and the target date is a single date, the target date can be determined by receiving a first input from the user and based on the first input.

For example, the date at which the user's finger is pointing may be identified and used as the target date.

That is, any day on the calendar displaying multiple dates may be used as the target date, so that the user can conveniently view the notification information 104 of any day.

The embodiment of the present application is applicable not only to calendars with a single date display, but also to calendars with multiple dates display, with a wide range of applications and convenient for users. As shown in FIG2 , a calendar 103 with a single date display is shown, and as shown in FIG5 , a calendar 110 with multiple dates display is shown.

In a possible implementation of the present application, the AR device 101 may include an image acquisition device. Before displaying the notification information 104 at the target position corresponding to the target date, the display method may also include: acquiring the position of each object in the field of view through the image acquisition device; determining a first relative spatial position of the calendar in the field of view according to a Simultaneous Localization and Mapping (SLAM) algorithm; acquiring text information on the surface of the calendar through the image acquisition device; and determining the target position corresponding to the target date according to the first relative spatial position of the calendar and the text information on the surface of the calendar.

The first relative spatial position is the position of the calendar and the objects around the calendar in the field of view of the AR device 101. The relative spatial position of the calendar and the objects around it, as well as the spatial relative position of virtual information and real objects, can be determined through the SLAM algorithm. The virtual objects in the field of view can also be rendered so that the superimposed virtual information can be presented more realistically on the real objects.

The image acquisition device may be a camera on an AR device, which is used to capture the real scene and obtain text information on the calendar surface. The text position, blank position and surrounding position on the calendar can be determined by combining with the SLAM algorithm, and then the target position can be determined. The target position may be a blank position on the calendar, a blank position on the calendar and a surrounding position on the calendar, or just a surrounding position on the calendar, which may be determined specifically according to the type of calendar.

For example, if the calendar is a single-date calendar 103, the target position can be a blank position on the calendar. Since the calendar only displays one day's date, there are many blank positions on it, and a single or multiple types of notification information 104 can be displayed, so the blank position can be used as the target position, as shown in Figures 3-4. If the calendar is a multi-date calendar 110, the target position can be the surrounding position of each date and the surrounding position of the calendar. Since there are few blank positions on the multi-date calendar, if the content of the notification information 104 is large and the blank positions cannot be fully displayed, it can be displayed at the surrounding position of the calendar.

In the embodiment of the present application, the position of each object in the field of view and the text information on the calendar surface can be obtained through the image acquisition device, and then the first relative spatial position of the calendar in the field of view can be determined according to the SLAM algorithm. According to the first relative spatial position of the calendar and the text information on the calendar surface, the blank position on the calendar surface and the surrounding area can be determined, and then it can be determined whether the target position is placed in the blank position on the calendar or in the position around the calendar. This allows the notification information 104 to be better combined with the calendar to enhance the AR experience.

In a possible implementation of the present application, displaying notification information at a target position corresponding to a target date may include: in the case where a calendar displays multiple dates, determining the position of the target date in a first relative position and marking the target date; acquiring surrounding information of the target date through an image acquisition device, the surrounding position information of the target date including a first blank position located on the calendar surface and a second blank position located around the calendar; parsing the notification information to determine the amount of information contained in the notification information; and displaying the notification information in the first blank position of the target date in the field of view according to the amount of information contained in the notification information. position and/or a second empty position.

That is, if the calendar is a calendar that displays multiple dates, the position of the target date is first determined and marked so that the user can intuitively view the target date, and then the first blank position and the second blank position around the target date are obtained through the image acquisition device, and then the amount of information contained in the notification information 104 is determined by parsing the notification information 104, and finally the notification information 104 is displayed in the first blank position and/or the second blank position of the target date according to the amount of information in the notification information 104. For example, as shown in FIG5, if the target date is the 13th, the area below the 13th and the right side of the calendar can be used as the target position, the weather information 111 can be displayed in the area corresponding to the area below the 13th in the field of view of the AR device 101, and the schedule information 112 can be displayed in the area corresponding to the right side of the calendar in the field of view of the AR device 101.

That is to say, virtual notification information 104 such as weather information, schedule information, news information, etc. is ultimately presented in the screen presented by the AR device 101, and the specific presentation location is determined according to the content of the notification information 104 and the type of calendar.

For example, the calendar in Figure 2 is a calendar 103 that displays a single date. The text position and blank position on the calendar can be determined through the SLAM algorithm. The target date, that is, the notification information 104 corresponding to the 13th, can be obtained by communicating with the electronic device 102. By parsing the content of the notification information 104, the weather information 106 and the schedule information 105 are obtained. Since the blank position on the calendar is relatively large, the above-mentioned weather information 106 and schedule information 105 can be directly displayed in the area corresponding to the blank position of the calendar 103 in the field of view of the AR device 101, as shown in Figures 3 and 4, which is the screen in which the notification information 104 and the date information on the calendar are integrated, that is, the calendars in Figures 3 and 4 are the combined calendars 108.

For another example, the calendar in FIG5 is a calendar that displays multiple dates. The text position, blank position, and surrounding position on the calendar can be determined by the SLAM algorithm. The target date, that is, notification information 104 corresponding to the 13th, can be obtained by communicating with the electronic device 102. The weather information and schedule information can be obtained by parsing the content of the notification information 104. Since the blank position on the calendar is small, it is impossible to display both the weather information and the schedule information in the area corresponding to the blank position of the calendar in the field of view of the AR device 101. Therefore, only the weather information is displayed in the area corresponding to the blank position of the calendar in the field of view of the AR device 101. In the field, information with more content, such as schedule information, is displayed in an area corresponding to the right side of the calendar in the field of view of the AR device 101, as shown in FIG. 5 , which is a screen in which the notification information 104 seen by the user is integrated with the date information on the calendar.

In the embodiment of the present application, the blank position can be determined according to the type of calendar, and the target position for displaying the notification information 104 can be determined according to the amount of information in the notification information 104, so that the final screen effect presented to the user is better.

It is worth noting that if the calendar is a calendar 110 that displays multiple dates, the target date can be marked for the convenience of the user. As shown in FIG. 5 , the number 13 can be circled as a mark for the convenience of the user.

In a possible implementation of the present application, the AR device also includes an angle sensor, and the display method may further include: when the rotation of the AR device is detected, obtaining the rotation angle of the AR device through the angle sensor; determining a second relative spatial position of the calendar in the field of view based on the angle; and displaying the notification information at a target position corresponding to the target date in the field of view based on the second relative spatial position of the calendar.

In an embodiment of the present application, when the rotation of the AR device 101 is detected, the angle of rotation of the AR device can be obtained through the angle sensor of the AR device, and then the second relative spatial position of the calendar in the field of view is determined based on the angle, so that the notification information 104 can be displayed at the target position corresponding to the target date in the field of view.

That is to say, when the AR device 101 is rotated, the notification information 104 can also be accurately displayed at the target position corresponding to the target date of the calendar in the field of view of the AR device 101, and the relative position of the notification information 104 and the calendar can be kept unchanged, so that no matter at which angle the user looks at the calendar, the notification information 104 seen always remains at the target position of the target date of the calendar, that is, the target position relative to the target date does not change, thereby improving the authenticity of the user's viewing.

In another possible implementation of the present application, when the rotation of the AR device is detected, the position of each object in the field of view can also be obtained by the image acquisition device; the second relative spatial position of the calendar in the field of view is determined according to the SLAM algorithm; and the text on the calendar surface is obtained by the image acquisition device. According to the second relative spatial position of the calendar and the text information on the calendar surface, the target position corresponding to the target date is determined. Specific details have been described in detail in the above embodiment, and this embodiment will not be repeated.

In a possible implementation of the present application, the display method may further include: acquiring gesture information of the user through an image acquisition device, the gesture information including a sliding gesture and a designated gesture; when the gesture information is a sliding gesture, moving the marked target date forward or backward by one day according to the sliding gesture; when the gesture information is a designated gesture, moving the marked target date to the date specified by the designated gesture.

That is, if the calendar is a calendar that displays multiple dates, the dates can be switched through gesture control, and then virtual notification information 104 such as schedule information, weather information, news information, etc. corresponding to different dates can be displayed in the field of view of the AR device 101. Specifically, the marked target date can be switched to the previous day or the next day by swiping left or right, or the marked target date can be switched to the previous day or the next day by swiping up or down, or a designated gesture can be used to directly point to any date on the calendar interface, so that the AR device 101 display information can be directly moved to the position of the date specified by the designated gesture, and the weather information and schedule information of the corresponding date can be displayed.

For example, the gesture information in Figure 6 is sliding to the left. When the image acquisition device of the AR device 101 recognizes that the gesture is sliding to the left, the target date is changed from the 13th to the 12th, and then the notification information 104 corresponding to the 12th is obtained and displayed at the target position corresponding to the 12th in the field of view of the AR device 101.

As shown in Figure 7, the gesture information is a designated gesture, and the designated gesture can be a finger pointing directly. When the image acquisition device of the AR device 101 recognizes that the designated gesture (finger pointing directly) points to a certain date, such as the 18th, the target date is switched from the 13th to the 18th, and then the notification information 104 corresponding to the 18th is obtained and displayed at the target position corresponding to the 18th in the field of view of the AR device 101.

In the embodiment of the present application, the target date can be freely switched through gesture information to obtain notification information 104 of the corresponding date, and the notification information 104 corresponding to different dates can be displayed in the field of view of the AR device 101, so as to facilitate the user to view the notification information 104 of different dates and enhance the interactive experience.

It is worth noting that the electronic device 102 in the present application may store schedule information, weather information, The electronic device 102 may be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device 102, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. The non-mobile electronic device 102 may be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application do not make specific limitations.

It should be noted that the display method provided in the embodiment of the present application can be executed by a display device or a control module in the display device for executing the display method. In the embodiment of the present application, the display device provided in the embodiment of the present application is described by taking the display device executing the display method as an example.

As shown in FIG. 8 , it is a structural block diagram of a display device provided in the present application. The display device is applied to an AR device 101 , and the display device may include: an identification module 801 and a display module 802 .

Among them, the identification module 801 is used to identify the date on the calendar when a calendar is detected in the field of view; the display module 802 is used to display the notification information at the target position corresponding to the target date.

In the embodiment of the present application, the recognition module 801 first recognizes the date on the calendar when detecting the presence of a calendar in the field of view, and then the display module 802 displays the notification information at the target position corresponding to the target date. The embodiment of the present application uses AR display technology to display the notification information at the target position corresponding to the target date in the calendar in the field of view of the AR device, so that the notification information is combined with the calendar. Through the combination of virtual and real, the user can easily obtain the notification information corresponding to the target date, and can see the desired multiple information without using other devices, thereby improving the user's interactive experience.

In a possible implementation manner of the present application, the display device may further include: a receiving module and a selecting module.

The receiving module is used to receive a first input from a user when the calendar displays multiple dates; the selecting module is used to respond to the first input and select a date from multiple dates in the calendar as a target date.

In a possible implementation of the present application, the AR device includes an image acquisition device. The display device may also include: a first acquisition module, a first determination module, a second acquisition module and a second determination module.

Among them, the first acquisition module is used to obtain the position of each object in the field of view through the image acquisition device; the first determination module is used to determine the first relative spatial position of the calendar in the field of view according to the SLAM algorithm; the second acquisition module is used to obtain the text information on the surface of the calendar through the image acquisition device; the second determination module is used to determine the target position corresponding to the target date according to the first relative spatial position of the calendar and the text information on the surface of the calendar.

In a possible implementation of the present application, the display module 802 may be used to: when the calendar displays multiple dates, determine the location of the target date in the first relative spatial position and mark the target date; obtain the surrounding position information of the target date through an image acquisition device, the surrounding position information of the target date including a first blank position located on the calendar surface and a second blank position located around the calendar; parse the type of notification information and determine the amount of information contained in the notification information; preset the location of the date and the type of notification information according to the amount of information contained in the notification information, and display the notification information in an area corresponding to the first blank position and/or the second blank position target position of the target date in the field of view.

In a possible implementation manner of the present application, the AR device further includes an angle sensor, and the display apparatus may further include: a third acquisition module, a third determination module, and a second display module.

Among them, the third acquisition module is used to obtain the rotation angle of the AR device through the angle sensor when the rotation of the AR device is detected; the third determination module is used to determine the second relative spatial position of the calendar in the field of view according to the angle; the second display module is used to display the notification information at the target position corresponding to the target date in the field of view according to the second relative spatial position of the calendar.

In a possible implementation manner of the present application, the display device may further include: a fourth acquisition module, a fourth determination module and a fifth determination module.

The fourth acquisition module is used to acquire the user's gesture information through the image acquisition device, and the gesture information includes a sliding gesture and a designated gesture; the fourth determination module is used to move the marked target date forward or backward by one day according to the sliding gesture when the gesture information is a sliding gesture; the fifth determination module is used to move the marked target date to the designated gesture when the gesture information is a designated gesture. The date specified by the gesture.

The display device in the embodiment of the present application may be a device, or a component, an integrated circuit, or a chip in a terminal.

The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 1 to 7, and will not be described again here to avoid repetition.

Optionally, as shown in Figure 9, an embodiment of the present application also provides an AR device 900, including a processor 901, a memory 902, and a program or instruction stored in the memory 902 and executable on the processor 901. When the program or instruction is executed by the processor 901, each process of the above-mentioned display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

FIG. 10 is a schematic diagram of the hardware structure of an AR device 1000 implementing an embodiment of the present application.

The AR device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

Those skilled in the art can understand that the AR device 1000 can also include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 1010 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The structure of the AR device 1000 shown in FIG10 does not constitute a limitation on the AR device 1000. The AR device 1000 can include more or fewer components than shown in the figure, or combine certain components, or arrange components differently, which will not be described in detail here.

The processor 1010 is used to identify the date on the calendar when detecting the presence of the calendar in the field of view; and display the notification information at the target position corresponding to the target date.

In the embodiment of the present application, first, when a calendar is detected in the field of view, the date on the calendar is identified, and then the notification information is displayed at the target position corresponding to the target date. By using AR display technology, notification information can be displayed in the field of view of the AR device at the target position corresponding to the target date in the calendar, so that the notification information is combined with the calendar. Through the combination of virtual and real, users can easily obtain the notification information corresponding to the target date, and can see the desired information on other devices, thereby improving the user's interactive experience.

It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include but are not limited to a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to application programs and operating systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.

An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

The processor is the processor in the AR device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

The present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the above The various processes of the display method embodiment can achieve the same technical effect, and will not be described again here to avoid repetition.

It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims (12)

A display method, applied to an AR device, comprising: Upon detecting the presence of a calendar in the field of view, identifying a date on the calendar; The notification information is displayed at the target position corresponding to the target date. The display method according to claim 1, wherein after said identifying a date on said calendar, said method further comprises: When the calendar displays multiple dates, receiving a first input from a user; In response to the first input, a date is selected from a plurality of dates in the calendar as the target date. The display method according to claim 1, wherein the AR device includes an image acquisition device, and before displaying the notification information at the target location corresponding to the target date, the method further includes: Acquire the position of each object in the field of view by the image acquisition device; Determine a first relative spatial position of the calendar in the field of view according to a SLAM algorithm; Acquiring text information on the calendar surface through the image acquisition device; The target position corresponding to the target date is determined according to the first relative spatial position of the calendar and the text information on the calendar surface. The display method according to claim 3, wherein the displaying of the notification information at the target location corresponding to the target date comprises: In the case where the calendar displays multiple dates, determining the location of the target date in the first relative spatial position, and marking the target date; Acquiring the surrounding position information of the target date by the image acquisition device, wherein the surrounding position information of the target date includes a first blank position located on the calendar surface and a second blank position located around the calendar; Parsing the notification information to determine the amount of information contained in the notification information; According to the amount of information contained in the notification information, the notification information is displayed in the field of view. The first blank position and/or the second blank position of the target date. The display method according to claim 3, wherein the AR device further includes an angle sensor, and the method further includes: When the rotation of the AR device is detected, obtaining the rotation angle of the AR device through the angle sensor; determining a second relative spatial position of the calendar in the field of view according to the angle; The notification information is displayed at the target position corresponding to the target date in the field of view according to the second relative spatial position of the calendar. The display method according to claim 4, wherein the method further comprises: Acquiring gesture information of the user through the image acquisition device, wherein the gesture information includes a sliding gesture and a designated gesture; In a case where the gesture information is a sliding gesture, moving the marked target date forward or backward by one day according to the sliding gesture; When the gesture information is a designated gesture, the marked target date is moved to a date designated by the designated gesture. A display device, applied to an AR device, comprising: An identification module, configured to identify a date on a calendar when a calendar is detected in the field of view; The display module is used to display the notification information at the target location corresponding to the target date. The display device according to claim 7, wherein the device further comprises: A receiving module, configured to receive a first input from a user when the calendar displays multiple dates; A selection module is used for selecting a date from a plurality of dates in the calendar as the target date in response to the first input. The display device according to claim 7, wherein the AR device includes an image acquisition device, and the display device further includes: A first acquisition module, used for acquiring the position of each object in the field of view through the image acquisition device; A first determination module, configured to determine a first relative spatial position of the calendar in the field of view according to a SLAM algorithm; A second acquisition module, used to acquire text information on the calendar surface through the image acquisition device; The second determination module is used to determine the target position corresponding to the target date according to the first relative spatial position of the calendar and the text information on the calendar surface. An AR device comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the display method according to any one of claims 1 to 6. A readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the display method according to any one of claims 1 to 6 are implemented. A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the display method according to any one of claims 1 to 6.