JP2015114798A - Information processing apparatus, information processing method, and program - Google Patents

Abstract

Extended information corresponding to the degree of gaze of a document viewed by a viewer is displayed. The viewpoint information input unit obtains the viewpoint information of the document viewer (7010), specifies which document area the viewpoint coordinates are in (7020), and adds the viewpoint dwell time for each area (7020). 7030), the viewer's gaze degree is calculated based on the value of the viewpoint dwell time counter (7040), and when a predetermined time has passed (7050, Yes) and the gaze degree exceeds the set level (7070, Yes). The AR content associated with the area is acquired (7080), and the acquired AR content is displayed on the display unit of the AR terminal in a display form according to the gaze degree level (7090). [Selection] Figure 7

Description

  The present invention relates to an information processing method, information processing apparatus, and program for outputting extended information related to displayed information.

  An augmented reality display technology called Augmented Reality (hereinafter referred to as AR), which is provided in a smart terminal such as a tablet terminal or a smartphone and displays information related to a subject captured by a camera on the screen of the smart terminal, is known. In this technique, information related to a subject imaged by a camera is specified, and the specified related information is superimposed on a screen on which a real-world object imaged by the camera is displayed. Furthermore, a service is also developed in which related information (hereinafter also referred to as AR content) is superimposed on a screen on which a captured paper document is displayed when the subject is a paper document and the captured paper document is captured. . In a paper document, content such as moving images cannot be expressed (reproduced) on paper. However, a moving image is specified as AR content of a still image printed on a paper document, and the moving image is displayed on the screen of a smart terminal. Can be displayed in a superimposed manner.

  Patent Document 1 discloses a method for detecting a region in a visual field in a system that displays augmented reality on paper using a head-mounted display HMD (Head Mounted Display).

JP 2001-142604 A JP-A-4-242624

  The above-described conventional augmented reality display technology is effective in making it possible to present information to a viewer without leaking the information if there is extended information for the document. On the other hand, when a viewer browses a document associated with a plurality of pieces of extended information with his / her intention to browse, the viewer may feel troublesome if all the extended information is presented. Therefore, there has been a problem that it is required to present extended information to the viewer as appropriate.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an information processing apparatus that can provide extended information to a viewer appropriately according to the viewpoint area of the viewer. Moreover, it aims at providing the method and program.

  An information processing apparatus for solving the above-described problems has the following configuration. That is, the specifying means for specifying the viewer's viewpoint area for browsing the displayed information, the acquisition means for acquiring the extended information associated with the viewpoint area, and the viewer's gaze degree in the viewpoint area has a predetermined level. Display control means for superimposing and displaying the acquired extended information on the information when it is determined that it has been exceeded.

  ADVANTAGE OF THE INVENTION According to this invention, extended information can be suitably shown with respect to a browser according to a viewer's viewpoint area | region.

The block diagram which shows an example of the hardware constitutions in embodiment of this invention The figure which shows the example of the document of the superimposition display object in embodiment of this invention The figure which shows the example of the superimposed display of AR content in embodiment of this invention The figure which shows the structural example of the document area information storage table in embodiment of this invention. The figure which shows the structural example of AR content list table in embodiment of this invention. The figure which shows the structural example of the AR content management table in embodiment of this invention. The flowchart which shows the flow of the process in Embodiment 1 of this invention. The graph which shows the example of a time-dependent transition of the viewer's gaze degree in embodiment of this invention The figure which shows the example of the AR content display state in each browsing elapsed time in embodiment of this invention

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a configuration diagram illustrating an augmented reality display system as an example of an information processing apparatus to which the present embodiment is applied. The augmented reality display system can superimpose and display augmented information that gives augmented reality to a captured real image. The augmented reality display system of this embodiment includes an augmented reality display terminal (hereinafter also referred to as an AR terminal) 101 and a server 109. The AR terminal 101 and the server 109 include a communication unit 108 and a communication unit 114. Via the Internet or an intranet. The extended information related to the subject imaged by the captured image input unit 105 of the AR terminal 101 is specified from the server 109, and the specified extended information is superimposed on the screen on which the subject is displayed.

  The AR terminal 101 of the present embodiment can superimpose and display digital data with a real-time imaging function and a viewpoint information input unit that detects which part of the imaging range the AR terminal user is looking at, and a captured image input unit. A display unit. As a preferred embodiment, a smart terminal is used, or a glasses / goggles type equipped with a head-mounted camera and display disclosed in Patent Document 1. In such a smart terminal or a head-mounted display, an image, a video, or the like (hereinafter also referred to as AR content) that is augmented information that gives augmented reality to the captured video can be superimposed and displayed.

  When a document is displayed using the AR terminal 101 of the present embodiment, the document is displayed using a document file stored in the ROM 103 of the AR terminal 101 as well as displaying a video image of a paper document. You can also

  The CPU 102 controls the AR terminal 101 by executing a control program stored in the ROM 103. The ROM 103 is a storage unit for storing programs executed by the AR terminal 101, document files, and the like. When the AR terminal 101 executes the program, the system functions as various means for executing each process shown in a flowchart described later. The RAM 104 temporarily stores various data from each component. Further, the program is expanded and executed by the AR terminal 101. The captured image input unit 105 includes an optical device, an image sensor, and the like, and captures an image of a subject in response to an instruction from the CPU 102. The viewpoint information input unit 106 detects a viewpoint area by using a known method for detecting a viewpoint area (see, for example, Patent Document 2).

  The display unit 107 is configured by a liquid crystal panel or the like, and superimposes and displays the video captured by the captured image input unit 105 and the AR content. A bus 130 transmits a digital signal between 102 and 108. The server 109 manages AR content provided to the AR terminal 101 and generates superimposed display data to be displayed on the display unit 107. The CPU 110 controls the server 109 by executing a control program stored in the ROM 111. The ROM 111 stores a program executed by the server 109. When the server 109 executes the program, the system functions as various means for executing each process shown in a flowchart described later. The RAM 112 temporarily stores various data from each component. Further, the program is expanded and executed by the server 109. The storage unit 113 holds data to be processed in the present embodiment. For example, identification information for identifying AR content and AR content data are held. As the storage unit 113, a flash memory, an HDD, or the like can be used. Reference numeral 131 denotes a bus for transmitting a digital signal between 110 and 114.

  In this embodiment, processing corresponding to each step of the flowchart described later is realized by software using the CPU 102 and CPU 110, but part or all of the processing is realized by hardware such as an electronic circuit. Also good.

  FIG. 2 is an example of a document that is a target for superimposed display of AR content in the first embodiment. A frame 201 is a document frame serving as a page edge. Regions 202 to 205 indicate individual character regions of a character block such as a paragraph. Reference numeral 206 denotes a table area, and reference numeral 207 denotes a graphic area or an image area. That is, as an example of the present embodiment, the document 201 is composed of six areas 202 to 207. However, the document 201 is not necessarily limited to the case where these areas are included. For example, only a plurality of character areas or only a map or an image area may be included.

  FIG. 3 is an example of a superimposed display form of AR content with respect to the document shown in FIG. 2 in the first embodiment. Frames 301 and 305 correspond to the document frame 201 in FIG. 2, and regions 302 and 306 correspond to the region 206 in the document in FIG.

  Lines 303 and 307 are visible link connectors that clearly indicate which area in the documents 301 and 305 the AR contents 304 and 308 are associated with. In this embodiment, the corresponding area and the AR contents Are combined and displayed as line segments. An area 304 shows a display example of AR content associated with the area 302. This is a display form in a case where it is determined that the gaze degree in the area 302 of the viewer who browses the document 301 exceeds the level 1 shown in FIG.

  An area 308 shows a display example of AR content associated with the area 306. This is a case where it is determined that the gaze degree in the area 306 of the viewer who views the document 305 exceeds level 2 shown in FIG. 8, and the AR content display form when the gaze degree exceeds level 2 shown in FIG. It becomes a display form different from the display form when exceeding. In FIG. 3, the AR content display 308 when the gaze degree exceeds level 2 has a relatively larger display area than the AR content display 304 when the gaze degree exceeds level 1. That is, in the present embodiment, the display form is changed depending on the difference in the area gaze level. Moreover, the display method of the AR content due to the difference in the gaze level may be a presentation method other than the change of the display area. For example, by changing the length and width of the link connector and making the link connector at the gaze level 2 shorter or thicker than the link connector at the gaze level 1, it is possible to guide the link connector so that it is easy to see. Alternatively, it is possible to adopt a display form in which the display is performed closer to the related area.

  That is, the extended information related to the region with a high gaze degree is displayed with priority over the region with a short gaze degree. In addition to the method of increasing the display area as described above, for example, the layout of the display area is determined so that display of extended information is not overlapped as much as possible. Extended information regarding the longer region is displayed on top of other extended information.

  FIG. 4 is a document area information table for storing information of the document areas 202 to 207 shown in FIG. 2 in the first embodiment, and is stored in the storage unit 113 of FIG. An area number 401 is a label for identifying each area. The area coordinates 402 store the upper left coordinates of each area in a coordinate system having positive values in the horizontal and vertical directions with the lower left corner point of the document 201 as the origin. The area coordinate 403 stores the lower right coordinate of each area in the same coordinate system. The position and size of the rectangular area in the document 201 are determined by the area coordinates 402 and 403. The AR content number 404 stores the number of AR contents stored in association with the area. For example, the AR content associated with the region corresponding to the region number r1 is not retained, and two AR contents associated with the region corresponding to the region number r6 are retained.

  FIG. 5 is an AR content list table that stores a list of AR content held in each area in the first embodiment, and is stored in the storage unit 113 of FIG. The area number 501 is the same as the area number defined in 401 of FIG. Reference numeral 502 denotes an AR content number, which stores an AR content identification number that identifies the AR content associated with the area having the area number. For example, two AR contents of AR content numbers C3 and C5 are associated with the area number r6 and stored.

  FIG. 6 is an AR content management table storing AR content information referred to in the AR content list table of FIG. 5 in the first embodiment, and is stored in the storage unit 113 of FIG. The AR content number 601 is an identification number for identifying the AR content, and is the same as the AR content number 502 in FIG. The horizontal width 602 stores the horizontal width of the initial display size of the AR content, and the vertical width 603 stores the vertical width of the initial display size of the AR content. The initial display size is a display size of gaze level 1. Reference numeral 604 denotes a URL (Universal Resource Locator) indicating the location where the data entity of the AR content is stored. As long as it can be indicated by a URL and data can be acquired, it may be stored in a storage unit (not shown in FIG. 1) on the network or may be stored in the storage unit 113 in FIG. .

  FIG. 7 is a flowchart showing a processing procedure performed by the AR terminal 101 and the server 109 in the first embodiment. This flowchart is realized when the CPU executes a control program.

  The system is activated, various initialization processes of the AR terminal 101 and the server 109 are performed, and the connection between the AR terminal 101 and the server 109 is established. The viewer wears the AR terminal 101 and starts browsing the paper document 201 through a view that is transmitted and superimposed on the display unit 107 of the AR terminal 101. Note that the display unit 107 of the AR terminal 101 can also display the document 201 based on the original electronic data. An image obtained by capturing an object other than a document can also be displayed.

  In step S7010, the viewpoint information input unit 106 acquires the viewpoint information of the document viewer. That is, the viewpoint coordinates on the document 201 at time Ti are acquired. Acquisition of a viewpoint can be detected by a method disclosed in Patent Document 2. The acquired viewpoint coordinates are transmitted to the server 109 via the communication unit 108.

  In step S7020, the document area information storage table of FIG. 4 stored in the storage unit 113 is referred to by the calculation of the CPU 110 of the server 109, and in which document area the viewpoint coordinates acquired in step S7010 are located, or the vicinity of the viewpoint Is identified, and an area number is obtained with the identified document area as the existence area of the viewer's viewpoint.

  In step S7030, the viewpoint residence time counter is added for each area (not shown) secured in the RAM 112. At that time, the previous viewpoint stay area is stored, and if it is the same area as the previous viewpoint stay area, the counter value of the area is multiplied by 1.5 to weight when the same area is viewed continuously. Turn on. If it is different from the previous viewpoint retention area, the previous viewpoint retention area number is updated to the current viewpoint retention area number, and 1 is added to the counter value of the area.

  Next, in step S7040, the viewpoint staying time counter value of the other area of the document 201 where the viewpoint has not stayed at the time Ti is decreased by one. In this embodiment, in step S7030 and step S7040, the viewer's gaze degree is obtained based on the value of the viewpoint dwell time counter obtained for each region. As an example of the calculation, the value of the viewpoint dwell time counter is multiplied by a certain coefficient to obtain the viewer's gaze degree. The coefficient is 1, for example.

  In step S7050, the CPU 110 determines whether or not the predetermined time Tm shown in FIG. If the predetermined time Tm has elapsed, the process proceeds to step S7060. If the predetermined time Tm has not elapsed, the process loops to step S7010. If the predetermined time Tm has elapsed, it is determined whether or not to display AR content for all the areas 201 to 207 of the document 201 in the processing after step S7060. If the determination of whether to display all areas is completed, the process proceeds to step S7100, and if not completed, the process proceeds to step S7070. When AR content is associated with some of the entire regions 201 to 207, it may be determined whether or not the AR content needs to be displayed only for the region associated with the AR content.

  Step S7070 refers to the viewpoint dwell time counter value of the determination target area obtained in steps S7030 and S7040, and determines the gaze level of the area. That is, it is determined whether the gaze degree of each area exceeds the gaze level 1 shown in FIG. As a result of the determination, if the gaze degree of a certain area exceeds the set level, the process loops to step S7080, and if not, the process loops to step S7060 to check the gaze degree of another area.

  In step S7080, AR content associated with an area where the gaze degree exceeds level 1 shown in FIG. 8 is acquired. That is, it is checked whether or not the area number 501 of the AR content list table in FIG. 5 that matches the area number of the area exists, and if it does not exist, it is determined that there is no AR content to be displayed. If the matching area number 501 exists, the matching AR content number 502 is acquired from the AR content list. Next, AR content corresponding to the acquired AR content number 502 is acquired.

  Next, the AR content display data of the acquired AR content number is acquired from the AR content management table of FIG. The display data of the AR content is acquired from the storage unit of the server 109 storing the AR content or the AR terminal 101. The display data is acquired from the address indicated by the URL 604, and the display area size of the AR content indicated by the horizontal width 602 and the vertical width 603 is acquired as the display size for the interest level 1. In step S7090, the AR content acquired in step S7080 is displayed on the display unit 107 of the AR terminal 101 in a display form corresponding to the gaze degree level.

  When a plurality of AR contents are associated with one document area, AR content numbers 502 on the AR content list are acquired in order according to the levels shown in FIG. For example, when the gaze degree exceeds level 1, the first AR content number 502 on the AR content list is acquired, and when the gaze degree exceeds level 2, the second AR content number 502 on the AR content list is obtained. Or all AR content numbers 502 are acquired.

  If it is determined in step S7080 that there is no AR content, the process loops to step S7060. If AR content is acquired in step S7080, if it is gaze level 1, the display size is obtained from the horizontal width 602 and vertical width 603 in FIG. Alternatively, if the gaze level is 2, the display size obtained from the horizontal width 602 and the vertical width 603 in FIG. 6 is set to a display size enlarged 1.5 times in length and width, and the gaze document area and other AR contents in the display screen are displayed. Arrange the layout so that it does not overlap the display area.

  Then, display coordinate information on the display unit 107 at the determined arrangement position is stored in the RAM 112 as AR content display area information (not shown). The CPU 110 transmits the display data obtained by connecting the AR content display area and the document area associated with the link connector and the display coordinate information to the AR terminal 101, and the AR content is displayed on the display unit 107 as in the example illustrated in FIG. Is superimposed on the document 201.

  When the AR content display process in step S7090 ends, the process loops to step S7060 and the same process is performed for the other process target areas. If the viewer ends the augmented reality display system in step S7100, the system is terminated. If not, the process loops to step S7010 to continue the document browsing process using the augmented reality display.

  FIG. 8 is a graph showing an example of the temporal transition of the viewer's gaze degree in the regions 204 and 206 when the viewer browses the document 201 according to the operation flow (FIG. 7) in the first embodiment. In FIG. 8, the vertical axis represents the gaze degree obtained in steps S7030 and 7040 in FIG. 7, and indicates level 1 and level 2. The horizontal axis represents the browsing elapsed time, and the predetermined value tm on the axis represents the display reservation time of the AR content. The time tm may be set to the same value as the predetermined time Tm in step S7050 of FIG.

  After the elapse of time tm, the AR content is controlled to be displayed. On-axis times t1, t2, t3, and t4 mean times after a certain period of time has elapsed. A dotted line 801 is an example showing the transition of the viewer's gaze degree with respect to the area 206 in FIG. 2, and a solid line 802 is an example showing the transition of the viewer's gaze degree with respect to the area 204 in FIG. Although omitted in FIG. 8, it is possible to see the transition of the gaze degree in the same manner for the other areas 202, 203, 205, and 207 in FIG. 2.

FIG. 9 shows an AR content display state at times t ₁ , t ₂ , t ₃ , and t ₄ after the browsing time in FIG. 8 in the first embodiment. FIG. 9A shows the display state at time t ₁ . A frame 901 corresponds to the document 201, and an area 902 corresponds to the area 206. Time t ₁ is the time after the display reserved time, since attention degree 801 are above the level 1 to the area 902 at that time, AR content 903 is displayed in the display form of level 1. There are no other areas beyond Level 1.

9 (b) is a display state at time _{t 2.} Since attention degree 801 exceeds the level 2 with respect to time _{t 2} in the area 902, AR content 904 is displayed in the display form of level 2. When comparing the AR contents 903 and 904, the AR contents 904 are displayed relatively larger than the AR contents 903.

Figure 9 (c) is a display state at time _{t 3.} At time t ₃ , the gaze degree 801 for the area 902 is below the level 2, and thus the AR content 906 is displayed in the level 1 display form having the same size as the AR content 903 in FIG. On the other hand, since the gaze degree 802 of the area 905 corresponding to the area 204 exceeds the level 1, the AR content 907 is displayed in the level 1 display form. Thus, when a plurality of AR contents are displayed, the display position is determined so that the AR contents do not overlap each other. When the display form difference between level 1 and level 2 is changed by the length of the link connector, the length of the link connector may not reflect the degree of interest if it is arranged so as not to overlap. In this case, the degree of interest can be expressed by changing the thickness and color of the link connector.

FIG. 9D shows the display state at time t4. Although attention degree 801 for the time _{t 4} in the region 902 is above the level 1, attention degree 802 for the region 905 only AR content 908 because it falls below the level 1 are superimposed and displayed.

  Further, instead of the gaze degree 801 for the area 902, the gaze degree for the AR contents 903 and 904 may be used. Similarly, the gaze degree for the AR contents 906 and 908 may be used instead of the area gaze degree 801 for the area 905.

  As described above in detail, based on the degree of gaze for each area of the displayed document, the presence / absence and display mode of the AR content, which is the extended information, are dynamically changed to meet the needs of the viewer It becomes possible to display augmented reality.

  In the first embodiment, a method has been described in which AR content to be displayed is determined for each region in advance when browsing a predetermined single document, and whether to display or not display the AR content.

  On the other hand, even for a plurality of types of documents, the AR content can be associated and held by specifying a region with a difference in unique local feature amount for each region of the document. The plurality of types of documents include a text document including a character area, a table sentence including a table area, a sentence including a graphic area, a document including an image area, or a document including different areas simultaneously.

  According to the first embodiment, unnecessary extension information display can be suppressed, unnecessary extension information display can be suppressed, and the extension information necessary for the viewer can be appropriately displayed.

<Second Embodiment>
In the first embodiment, an aspect of augmented reality display using a glasses / goggles type display device has been described. In the present embodiment, an aspect of augmented reality display using a device in which a tablet terminal or smartphone terminal including the captured image input unit 105 and the display unit 107 and a viewpoint input device having the viewpoint information input unit 106 are separated will be described. . The hardware configuration is the same as that of the first embodiment.

  Steps S7010 to S7060 in FIG. 7, which are processes for obtaining a gaze degree for each area of the viewer in the present embodiment, are the same as those in the first embodiment. In steps S7070 to S7090, processing different from that of the first embodiment will be described. In step S7070, it is determined whether or not the target area is in the range displayed on the display unit 107. If the target area is within the display range, the process proceeds to step S7080, and if not, processing is performed so as to loop to step S7060. Is done. Since the viewing angle of the display of the tablet terminal or smartphone terminal which is the display unit 107 of the second embodiment is relatively narrow, such processing is necessary.

  As described above, it is necessary for viewers to suppress unnecessary extended information display and suppress unnecessary extended information display even for augmented reality display devices with a limited display range such as tablet terminals. Therefore, it is possible to display the information as appropriate by narrowing down the extended information.

<Other embodiments>
In the first embodiment and the second embodiment of the present invention, the AR terminal has been described as an example. However, in an information processing apparatus having a display device other than the AR terminal, for example, a document display device and an extended information display device. Even when these are provided separately, the present invention can be implemented.

In the first embodiment and the second embodiment of the present invention, image data of a paper document is displayed on a display device. However, an environment in which an original electronic file (original document data) of the document can be used. In the method, the original electronic file of the document can be displayed on the display device instead of the captured paper document image.
The object of the embodiment of the present invention is achieved by the following way. That is, a recording medium (or storage medium) that records a program code (computer program) of software that implements the functions of the above-described embodiments is supplied to the system or apparatus. Needless to say, such a storage medium is a computer-readable storage medium. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the embodiment of the present invention.

  An operating system (OS) running on the computer performs part or all of the actual processing based on the instruction of the program code read by the computer. The case where the function of the above-described embodiment is realized by the processing is also included.

  Furthermore, it is assumed that the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized by the processing. It is.

  When the embodiment of the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the flowcharts described above.

101 AR terminal 102 CPU
103 ROM
104 RAM
105 Captured Image Input Unit 106 Viewpoint Information Input Unit 107 Display Unit 108 Communication Unit 109 Server

Claims (14)

A specifying means for specifying a viewer's viewpoint area for browsing the displayed information;
Obtaining means for obtaining extended information associated with the viewpoint area;
Display control means for superimposing and displaying the acquired extended information on the information when it is determined that the gaze degree of the viewer in the viewpoint area exceeds a predetermined level;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the gaze degree is calculated based on a value of the viewer's viewpoint dwell time counter in the viewpoint region.   The information processing apparatus according to claim 1, wherein the display control unit changes a display form of the extended information according to a change in the gaze degree.   The information processing apparatus according to claim 3, wherein the display control unit changes a display form of the extension information by changing a display size of the extension information.   The information processing apparatus according to claim 3, wherein the display control unit changes a display form of the extended information by bringing a display position of the extended information closer to a viewpoint area of the viewer.   The information processing apparatus according to claim 1, wherein the display control unit displays the extended information superimposed on the displayed information.   7. The information processing apparatus according to claim 1, wherein when displaying a plurality of pieces of extension information, the display control unit displays the extension information at a display position that does not overlap each other. .   2. The display control unit according to claim 1, wherein when displaying a plurality of pieces of extended information, the display control unit preferentially displays extended information associated with an area determined to have a higher gaze degree. Information processing device.   The information processing apparatus according to claim 1, wherein the information is a document displayed based on an original electronic file.   The information processing apparatus according to claim 1, wherein the information is a document displayed based on imaging data captured by an imaging unit.   The document includes at least one of a character area, a table area, a graphic area, and an image area, and the gaze area is any one of the character area, the table area, the graphic area, and the image area. The information processing apparatus according to claim 9 or 10, wherein:   The information processing apparatus according to claim 1, further comprising a storage unit, wherein the document is stored in the storage unit. An information processing method of an information processing apparatus for displaying a document,
A specifying step for specifying a viewpoint area of a viewer who browses the displayed document;
An acquisition step of acquiring extended information associated with the viewpoint region;
A display control step of superimposing and displaying the acquired extended information on the document when it is determined that the gaze degree of the viewer in the viewpoint area exceeds a predetermined level;
An information processing method for an information processing apparatus, comprising: On the computer,
A display procedure for displaying a document on the information processing apparatus;
A specific procedure for identifying a viewpoint area of a viewer who browses the displayed document;
An acquisition procedure for acquiring extended information associated with the viewpoint area;
When it is determined that the viewer's gaze degree in the viewpoint region exceeds a predetermined level, a display control procedure for displaying the acquired extended information superimposed on the document;
A program for running

Images