WO2013183222A1 - Information processing device, information processing method, and information processing program - Google Patents

Abstract

[Problem] To provide an information processing device, information processing method, and information processing program capable of easily searching a specific location at playback time of an operation history in which operations of a user have been recorded. [Solution] The invention is equipped with: an acquisition unit which acquires a pathology image; a display control unit which displays the acquired pathology image upon a screen; a first input unit which receives a series of operations including at least an operation for setting an annotation by a user during viewing by the user of the pathology image displayed upon the screen; a generation unit which, with respect to each of the operations received by the first input unit, associates a view time and generates an operation history; a second input unit which treats the screen, which was being viewed at the point in time at which the annotation was set, as a viewed screen, and accepts an instruction for movement to the viewed screen from the user; and a reconstruction unit which references the operation history on the basis of the instructions for movement which have been input and reconstructs the viewed screen for the movement destination.

Description

Information processing apparatus, information processing method, and information processing program

The present technology relates to an information processing apparatus, an information processing method, and an information processing program for recording / reproducing a viewer operation for observing a virtual slide image.

Conventionally, operations performed by a user on an application on a screen have been recorded and played back.

For example, in Patent Document 1, information on a Web browsing operation performed by a user is stored in a macro storage unit, and the Web browsing operation reproduction unit stores a window on the user's display device and a Web set for each window. The browsing operation information is written in the window management table and stored in the macro storage unit in accordance with the Web browsing operation of the user recorded in the window management table and the content of the Web page being displayed on the display device. A technique for executing a series of web browsing operations based on information on a series of web browsing operations is disclosed.

JP 2006-139509 A

However, in the conventional method, even if there is a means for fast-forwarding the reproduction of the operation when the operation recording becomes long, there is a point to be improved regarding the operability such as a work for the user to search for a specific part. .

In view of the circumstances as described above, an object of the present technology is to provide an information processing apparatus, an information processing method, and an information processing program capable of improving the operability of a viewer that observes a virtual slide image. .

(1) In order to achieve the above object, an information processing apparatus according to an aspect of the present technology includes an acquisition unit that acquires a pathological image, a display control unit that displays the acquired pathological image on a screen, and the screen. A first input unit that receives a series of operations including at least an operation for setting an annotation from the user during browsing of the displayed pathological image by the user, and each of the operations received by the first input unit A generation unit that generates an operation history by associating a viewing time with the second input for accepting an instruction to move to the browsing screen from the user with the screen being browsed when the annotation is set as the browsing screen And a reproduction unit that reproduces the browsing screen of the movement destination with reference to the operation history based on the input movement instruction.

In the present technology, first, the operation performed when the user browses the pathological image is recorded as an operation history by the generation unit. Next, the user causes the reproduction unit to reproduce the browsing performed based on the recorded operation history. When reproduction of browsing is performed, the time at which the annotation is set is used as a mark for finding a specific location. Since the annotation is set at the timing when the diagnosis for one lesioned part of the pathological image is completed and the diagnosis result is left on the pathological image, it is optimal as a mark. This is because after this mark, a search for a new lesion site and its diagnosis, which are a series of flows, continue. Since the second input unit accepts an instruction to move to the browsing screen from the user, and the reproduction unit reproduces the browsing screen at the time when the annotation is set, the user can easily reproduce the location where the series of flows is divided. it can. Therefore, it is possible to easily find a specific place when reproducing the operation history in which the user's operation is recorded.

(2) Moreover, in order to achieve the said objective, in the information processing apparatus which concerns on one form of this technique, the said path | history image when the said operation history is displayed on the said browsing screen matched with browsing time The display control unit uses the center coordinate value and the browsing magnification to display the pathological image that is the browsing screen acquired by the acquiring unit. The browsing screen is reproduced by displaying on the screen.

In the present technology, the operation history has the center coordinates of the pathological image displayed on the browsing screen and the browsing magnification at the time of display. Therefore, the pathological image to be acquired can be specified only by using these two pieces of information, and the browsing screen can be easily reproduced.

(3) In order to achieve the above object, in the information processing apparatus according to an embodiment of the present technology, the second input unit includes a seek bar in which the time when the annotation is set is clearly indicated as a mark, and the seek bar The instruction is received from the user using a GUI having a slider that can be moved by the user.

In this technology, an instruction to move to the browsing screen is received using a GUI having a seek bar and a slider. At that time, since the time when the annotation is set is clearly indicated on the seek bar as a mark, the user can give an instruction to move while visually checking the mark. Therefore, the user can easily issue a movement instruction.

(4) In order to achieve the above object, in the information processing apparatus according to an embodiment of the present technology, the second input unit displays a mark indicating the time when the annotation is set on the seek bar. At this time, at least one of the color and shape of the mark is changed according to the difference in the attribute of the annotation.

In this technology, the color and shape of the mark indicating the time when the annotation is set shown on the seek bar are changed to different colors and shapes depending on, for example, the user who made the annotation and the importance of the annotation. By doing so, the user who gives an instruction to move to the browsing screen can easily distinguish the plurality of marks and move the reproduction screen to the browsing screen corresponding to the annotation having the target attribute. .

(5) Moreover, in order to achieve the said objective, in the information processing method which concerns on one form of this technique, an acquisition part acquires a pathological image and a display control part displays the acquired pathological image on a screen. The first input unit accepts a series of operations including at least an operation for setting an annotation from the user while the pathological image displayed on the screen is viewed by the user, and the generation unit receives the first input The operation history is generated by associating the browsing time with each of the operations received by the unit, and the second input unit uses the screen that is being browsed when the annotation is set as the browsing screen. An instruction to move to is received from the user, and the reproduction unit reproduces the browsing screen of the movement destination with reference to the operation history based on the input movement instruction.

(6) In order to achieve the above object, an information processing program according to an aspect of the present technology includes an acquisition unit that acquires a pathological image, a display control unit that displays the acquired pathological image on a screen, and the screen A first input unit that receives a series of operations including at least an operation for setting an annotation from the user during browsing of the displayed pathological image by the user, and for each of the operations received by the first input unit A generation unit that generates an operation history in association with the browsing time, a second input unit that accepts an instruction to move to the browsing screen from the user, with the screen being browsed when the annotation is set as a browsing screen, The computer is caused to function as a reproduction unit that reproduces the browsing screen of the movement destination by referring to the operation history based on the input movement instruction.

As described above, according to the present technology, it is possible to improve the operability of the viewer that observes the virtual slide image.

It is a figure showing the typical use environment of the viewer computer 500 which concerns on this technique. It is a block diagram showing the hardware constitutions of viewer computer 500 concerning this art. 3 is a diagram showing functional blocks of an image management server 400. FIG. It is a figure which shows the functional block of the viewer computer. It is a figure which shows the example of a viewer screen. It is a figure which shows the example of the arrow showing the location of an annotation. It is a figure which shows the example of the ruler showing the location of an annotation. It is a figure which shows the example of the rectangle showing the location of an annotation. It is a figure which shows the example of the freehand showing the location of an annotation. It is a figure which shows the detail of the data which one annotation added to the pathological image has. It is a figure which shows the example of operation recording / reproducing GUI. It is a figure which shows the example which moves a reproduction | regeneration position to the next chapter position using a chapter feed button. FIG. 11 is a sequence diagram for explaining a flow of recording / reproducing an operation history of a viewer operation and a flow of adding an annotation or sending a chapter at the time of adding an annotation.

Hereinafter, embodiments according to the present technology will be described with reference to the drawings.
<First Embodiment>
[Viewer computer usage environment]
First, in a pathological diagnosis, an overall image of an environment in which a pathologist makes a diagnosis using a virtual slide image (pathological image) obtained by photographing a specimen using a microscope will be described. The pathologist uses a viewer on a viewer computer to observe a pathological image and perform image diagnosis. FIG. 1 is a diagram illustrating a typical usage environment of a viewer computer 500 according to the present technology.

A scanner 100 including a microscope 10 and a scanner computer 20 is installed in a histology laboratory HL in a hospital. The RAW image photographed by the microscope 10 is subjected to image processing such as development processing, shading processing, color balance correction, gamma correction, and 8-bit processing on the scanner computer 20. Thereafter, the image is divided into tiles of 256 pixels in length and width, converted into JPEG (Joint Photographic Experts Group) images, compressed, and stored on the hard disk HD1.

The JPEG image stored in the hard disk HD1 of the scanner computer 20 is then uploaded via the network 300 to the hard disk HD2 on the image management server 400 in the data center DC in the same hospital.

The pathologist who is an observer is stored in the hard disk HD2 of the image management server 400 using the viewer computer 500 connected to the image management server 400 and the network 300 in the pathology room PR in the hospital or the building EX outside the hospital. Observe the JPEG image.

In addition, the pathologist who is an observer can record the operation performed when he / she observes the JPEG image and the sound generated by instructing the viewer computer 500. The recorded operation history and sound are sent to the image management server 400 via the network 300 and stored.

[Configuration of Viewer Computer 500]
Next, the hardware configuration of the viewer computer 500 will be described.
FIG. 2 is a block diagram illustrating a hardware configuration of the viewer computer 500 according to the present technology.

In the viewer computer 500, a CPU (Central Processing Unit) 21 that performs arithmetic control, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23 that is a work memory of the CPU 21, and instructions according to user operations are input. An operation input unit 24 (first input unit) is provided. The viewer computer 500 further includes an interface unit 25, an output unit 26 (display control unit), a storage unit 27, a network interface unit 28, and a bus 29 for connecting them together.

The ROM 22 stores programs for executing various processes. A network 300 is connected to the network interface unit 28. For the output unit 26, a liquid crystal display, an EL (Electro Luminescence) display, a plasma display, or the like is applied for image display, and a speaker or the like is applied for audio output. For the storage unit 27, a magnetic disk represented by HDD (Hard Disk Drive), a semiconductor memory, an optical disk, or the like is applied.

The CPU 21 develops a program corresponding to an instruction given from the operation input unit 24 among the plurality of programs stored in the ROM 22, and appropriately controls the output unit 26 and the storage unit 27 according to the developed program. .

CPU 21 realizes each functional block described later. The CPU 21 executes programs stored in the ROM 22, the storage unit 27, and the like, and controls each of the above members as necessary. Thereby, the viewer computer 500 can implement | achieve various functional blocks, and can operate each said member as the viewer computer 500. FIG.

[Configuration of Image Management Server 400]
Next, the hardware configuration of the image management server 400 will be described.
The hardware configuration of the image management server is basically the same as the hardware configuration of the viewer computer 500. Therefore, detailed description is omitted.

[Functional Block of Image Management Server 400]
Next, functional blocks of the image management server 400 will be described. First, the main function of the image management server 400 is to provide a pathological image according to a request from the viewer computer 500. Secondly, the operation history acquired from the viewer computer 500 is stored and provided according to a request from the viewer computer 500. Thirdly, a comment (hereinafter referred to as an annotation) attached by a pathologist to a specific portion of a pathological image on the viewer is saved. FIG. 3 is a diagram showing functional blocks of the image management server 400.

The image management server 400 includes functional blocks of an image storage unit 41, an image providing unit 42, an operation history storage unit 43, and an operation history management unit 44.

The image storage unit 41 stores pathological images that are divided into tiles and compressed by JPEG. The stored pathological image is provided to the viewer computer 500 via the image providing unit 42 in accordance with a request from the viewer computer 500. Also, annotations attached to the pathological image by the user using the viewer on the viewer computer 500 are stored here.

The image providing unit 42 acquires a pathological image (including an annotation) corresponding to an image request transmitted from the viewer computer 500 via the network 300 from the image storage unit 41 and transmits the acquired pathological image to the viewer computer 500 via the network 300. To do.

The operation history storage unit 43 stores a history of viewer operations performed by the user on the viewer computer 500.

The operation history management unit 44 acquires the operation history recorded on the viewer computer 500 and once collected via the network 300. Then, the operation history management unit 44 stores the acquired operation history in the operation history storage unit 43. Further, the operation history management unit 44 receives an operation history request from the viewer computer 500, acquires an operation history corresponding to the operation history request from the operation history storage unit 43, and transmits the operation history to the viewer computer 500 via the network 300. .

Since the image management server 400 and the viewer computer 500 constitute a client-server system, it is a design matter which function is given to the client side and which function is given to the server side. Therefore, the execution location of each functional block is not limited to the above-described image management server 400, but may be configured to be executed on the viewer computer 500 on the client side.

[Function Blocks of Viewer Computer 500]
Next, functional blocks of the viewer computer 500 will be described. The main function of the viewer computer 500 is to first accept an operation instruction from a user who is a pathologist, acquire a corresponding pathological image (including annotation) from the image management server 400, and display it to the user. is there. Second, the viewer operation when the user performs image diagnosis is recorded, and the operation history is sent to the image management server 400 for storage. Third, in accordance with a request from the user, an operation history stored in the image management server 400 is acquired, and an operation performed by the user is reproduced based on the operation history.
FIG. 4 is a diagram illustrating functional blocks of the viewer computer 500.

The viewer computer 500 includes functional blocks of an image acquisition unit 51 (acquisition unit) and an operation history control unit 52 (generation unit, reproduction unit).

The image acquisition unit 51 acquires a pathology image (including annotations) input from the operation input unit 24 and corresponding to a user's instruction as a pathologist from the image management server 400 via the network 300, and acquires the acquired pathology. The image is presented to the user via the output unit 26.

The operation history control unit 52 records the viewer operation when the user observes the pathological image and records the sound being observed according to the user's instruction. Recording and recording are first saved using the RAM 23 or the storage unit 27 of the viewer computer 500. In response to the recording and recording stop instruction, the recording and recording are combined, sent to the image management server 400 as an operation history, and stored.

The operation history control unit 52 also acquires an operation history corresponding to the instruction from the image management server 400 according to a user instruction, and outputs the operation of the viewer and the sound during the operation recorded in the acquired operation history. The information is presented to the user via the unit 26.

Note that the user's instruction regarding the recording / reproducing of the operation history of the viewer and the recording / reproducing of the sound during operation performed by the operation history control unit 52 is performed using an operation recording / reproducing GUI described later.

[About Viewer Screen]
Next, a viewer screen used for the user to observe a pathological image on the viewer computer 500 will be described. FIG. 5 is a diagram illustrating an example of a viewer screen.

The viewer window 60 includes a thumbnail map 61 indicating which part of the pathological image is enlarged, an observation area 62 for observing the pathological image, and an operation recording / reproducing GUI 63 (second input unit). ing. The thumbnail map 61 includes a reduced image of the entire virtual slide image and a frame FR that equivalently shows the range of the image displayed in the viewer window 60 on the thumbnail map 61.

The frame FR can be moved on the thumbnail map 61 by an arbitrary amount in an arbitrary direction according to an instruction from the user. In the thumbnail map 61, the operation of moving the frame can also be performed by a drag operation with a mouse or the like.

The operation recording / reproducing GUI 63 accepts a recording start instruction or recording stop instruction of a viewer operation, an audio recording start instruction or a recording stop instruction during a viewer operation by the user, and transmits the received instruction to the operation history control unit 52. Details of the operation recording / reproducing GUI 63 will be described later.

[Annotation display image]
Annotation is generally adding information (metadata) related to certain data as an annotation. With the present technology, a user who is a pathologist places a specific location on a pathological image. To add a comment about.

Here, an example of a mark displayed on the pathological image in order to indicate the part to which the annotation is added will be described.

First, the mark shown in FIG. 6 is “Arrow”. A box for entering a comment is shown at the lower right of the arrow. The mark shown in FIG. 7 is “Ruler”. By using the ruler, the distance from one point to another can be measured. A comment box is also shown at the bottom right of the ruler.

The mark shown in FIG. 8 is “Rectangle”. By using this mark, it is possible to enclose the part to be commented with a rectangle. In addition, the rectangular area can be measured. The mark shown in FIG. 9 is “Freehand”. By using this mark, it is possible to indicate a part where a comment is to be added by surrounding it with a free curve. Moreover, the area of the range enclosed by the free curve can be measured.

Although not shown, there may be a configuration in which an annotation is performed by inputting a comment by voice. In that case, a mark indicating how a person speaks, a mark in the shape of a speaker, or the like may be displayed at the location where the comment is added.

[About annotation data]
FIG. 10 is a diagram illustrating details of data included in one annotation added to a pathological image. 14 types of data in total, “annotation type”, “image ID”, “owner”, “label name”, “center coordinate”, “magnification”, “color”, “coordinate 1”, “coordinate 2”, “coordinate 2” It consists of “Area (length)”, “Comment”, “Public setting”, “Display setting”, and “Creation time”. For example, “color” designates the color of the mark indicating the location where the annotation is added. This color can be changed for each user or according to the importance of the annotation.

[About the use of chapters]
A chapter is mainly a break provided at a position intended by the creator of a work in a DVD work such as a movie. When a chapter is provided at a place where the scene changes in the work, the viewer of this work can easily find the place he / she wants to see by jumping the playback position to the place where the chapter is set.

In pathological diagnosis, in the case of difficult cases, one virtual slide may take several hours. In the case of reproducing the operation history of the diagnosis, it has been difficult to search for a place to see. Therefore, the purpose of this technology is to easily find the place to see by introducing the concept of chapters.

There are two types of chapter setting timings. One is setting of chapters according to an explicit instruction from the user when a viewer operation is recorded. According to this method, chapters can be set at arbitrary locations desired by the user. However, it takes time to give instructions explicitly. In addition, although this technique can also take this method, it is abbreviate | omitted in the following description.

Another method is to automatically set chapters at the timing when a series of viewer operations is performed by the user. According to this method, there is no need to issue an instruction to explicitly set a chapter. However, it is important to select an appropriate timing as a timing for separating a series of viewer operations by the user.

The most appropriate timing for separating a series of viewer operations by the user is the timing at which the user adds an annotation to the pathological image. This is because image diagnosis using a pathological image is performed by first searching for a lesion, then determining the range of the lesion, and adding a comment to that portion. Because. Annotation is added at the end of this series of flows, and is particularly suitable as a timing for providing chapters.

Note that, in more detail, the timing when the annotation comment is completed and the comment is confirmed is preferable as the chapter setting timing. This timing is a timing when the “OK” button or the “Confirm” button is clicked after the comment is input.

[Operation record / playback GUI]
Next, the operation recording / reproducing GUI 63 will be described. FIG. 11 is a diagram illustrating an example of the operation recording / reproducing GUI.

In the operation recording / reproducing GUI 63 shown in this figure, the file name of the operation history is displayed on the upper left. In the upper center portion, a seek bar SB is shown in the horizontal direction, and a slider SL indicating the current playback position and circles AT1, AT2, and AT3 indicating the time when the annotation is added are shown above the seek bar SB. On the upper right side, the elapsed playback time is shown.

Also, on the lower side of the operation recording / reproducing GUI 63 shown in the figure, chapter feed (rewind direction), rewind, stop, playback, fast forward, chapter feed (reproduction direction), and recording buttons are shown. On the lower right side, a volume button and a microphone button are shown.

In this example, circles AT1, AT2, and AT3 indicating the time when the annotation is added are displayed on the seek bar SB. In this way, when the user drags the slider and changes the playback position, it is possible to easily search for a chapter at a desired location.

Further, the color of the circle indicating the time when the annotation is added shown on the seek bar SB may be indicated by a color corresponding to the “color” described in the details of the annotation data. Further, the shape of the mark indicating the time when the annotation is added may be indicated by a square or a triangle other than the circle. By doing so, it is possible to display an annotation by a specific user or an important annotation separately from other annotations. Then, it becomes possible to easily move the playback position to the annotation position.

FIG. 12 is a diagram showing an example in which the playback position is moved to the next chapter position using the chapter feed button. This figure shows an example in which the position of the slider SL is moved from the current position to the position of the next circle AT2 by clicking the chapter feed button CJ.

[Recording and playback flow with operation and annotation]
Next, a flow of recording / reproducing the operation history of the viewer operation and a flow of adding an annotation or sending a chapter at the time of adding an annotation will be described. FIG. 13 is a sequence diagram for explaining the flow of recording / reproducing the operation history of the viewer operation, and the flow of adding an annotation and sending a chapter at the time of adding an annotation.

First, the flow of recording the operation history will be described.
First, the user clicks the record button of the operation recording / reproducing GUI 63 to instruct the operation history control unit 52 to start recording of the viewer operation (S1).

After the operation history control unit 52 receives an instruction to start recording, the operation history control unit 52 changes the display position performed by the user on the viewer, changes the observation magnification, records the user's voice, and the like ( S2).

When the display position is changed or the observation magnification is changed by the user, the image acquisition unit 51 requests the image management server 400 for a corresponding tiled image and acquires it (S3).

The image acquired from the image management server 400 is displayed on the screen via the image acquisition unit 51 (S4).

When an operation for adding an annotation is performed, the operation history control unit 52 records the time when the addition is performed so that a chapter can be set (S5).

Similarly, the operation history control unit 52 continues the change of the display position performed by the user to the viewer, the change of the observation magnification, the recording of the user's voice, and the like (S6), and the image acquisition unit 51 corresponds. The image is displayed on the screen (S7).

The user clicks the stop button on the operation recording / reproducing GUI 63 to instruct the operation history control unit 52 to stop recording the viewer operation (S8). At this time, a name is assigned to the recorded operation history. When a stop instruction is given, the operation history control unit 52 transmits the operation history and sound temporarily stored locally to the image management server 400 (S9). The operation history management unit 44 stores the received operation history and voice in the operation history storage unit 43.
The above is the flow of recording the operation history. Next, the flow of reproducing the operation history will be described.

First, the user designates the name of the operation history to be reproduced and clicks the reproduction button of the operation recording / reproduction GUI 63 to instruct the operation history control unit 52 to reproduce the operation history (S10).

When reproduction of the operation history is instructed, the operation history control unit 52 requests the operation history management unit 44 of the image management server 400 for the operation history and sound designated by the user, and acquires them from the image management server 400. (S11).

Further, when an operation history reproduction instruction is given, the image acquisition unit 51 acquires an image to be displayed during reproduction from the image storage unit 41 of the image management server 400 (S12).

The viewer operation is played back using the acquired operation history, sound and image (S13).

When the viewer operation is being played back, if the user clicks on the chapter feed button CJ (forward feed direction) of the operation recording / playback GUI 63 (S14), the operation history control unit 52 causes the annotation to be recorded after the current playback time. The added time is searched (S15). When the time at which the annotation is added is found, the operation to be reproduced is fast forwarded until that time.

Also, the image displayed on the screen at the time when the annotation is added is acquired from the image management server 400 based on the center coordinates and display magnification when the screen is included in the operation history (S16).

Thus, after the playback of the operation is fast-forwarded until the time when the annotation is added, the acquired image is displayed and normal playback is resumed (S17).

Finally, when the user clicks the stop button of the operation record / playback GUI 63 to instruct the operation history control unit 52 to stop playback of the operation history (S18), the operation history control unit 52 stops the playback of the operation history. .
The above is the flow of reproducing the operation history.

[Play slideshow with annotations added]
In the above description, when the viewer operation is being played back, if the user clicks the chapter feed button CJ of the operation recording / playback GUI 63, the playback of the viewer operation is fast forwarded to the time when the annotation is added. explained.

In addition to the configuration, once the user gives an instruction to execute the slide show, the operation history control unit 52 continuously searches for the time when the annotation is added, and plays back only for a few seconds for each portion of the searched time. It is also possible to adopt a configuration in which fast-forwarding is performed until the next time point.

In this way, the user can efficiently browse only the part to which the annotation is added and the comment of the annotation in the pathological image to be observed without taking time and effort.

[Another configuration of this technology]
In addition, this technique can also take the following structures.
(1) An acquisition unit that acquires a pathological image, a display control unit that displays the acquired pathological image on a screen, and at least annotations are set by the user during browsing of the pathological image displayed on the screen by the user. A first input unit that receives a series of operations including an operation for generating an operation history by associating a browsing time with each of the operations received by the first input unit, and the annotation A screen that is being browsed at the time when is set as a browsing screen, a second input unit that receives an instruction to move to the browsing screen from the user, and the operation history is referred to based on the input movement instruction An information processing apparatus comprising a reproduction unit that reproduces the browsing screen of the destination.
(2) The information processing apparatus according to (1), wherein the operation history is displayed on the browsing screen, which is associated with a browsing time, and a central coordinate value and a browsing magnification of the pathological image The reproduction unit causes the acquisition unit to acquire the pathological image serving as the browsing screen by causing the display control unit to display the pathological image using the central coordinate value and the browsing magnification. An information processing device that reproduces the browsing screen.
(3) The information processing apparatus according to any one of (1) and (2), wherein the second input unit includes a seek bar in which a time at which the annotation is set is clearly indicated as a mark. An information processing apparatus that accepts the instruction from the user using a GUI having a slider that can be moved by the user on the seek bar.
(4) In the information processing apparatus according to (3), when the second input unit displays a mark indicating the time when the annotation is set on the seek bar, the color of the mark And an information processing apparatus that changes at least one of the shapes according to a difference in attributes of the annotation.
(5) The acquisition unit acquires a pathological image, the display control unit displays the acquired pathological image on the screen, and the first input unit is browsing the pathological image displayed on the screen by the user. The user receives a series of operations including at least an annotation setting operation from the user, and the generation unit generates an operation history by associating the browsing time with each of the operations received by the first input unit. Then, the second input unit accepts an instruction to move to the browsing screen as the browsing screen when the annotation is set, and the reproduction unit receives the input movement instruction. The information processing method which reproduces the said browsing screen of the movement destination with reference to the said operation history based on.
(6) An acquisition unit that acquires a pathological image, a display control unit that displays the acquired pathological image on a screen, and at least an annotation setting by the user during browsing of the pathological image displayed on the screen by the user. A first input unit that receives a series of operations including operations, a generation unit that generates an operation history by associating a viewing time with each operation received by the first input unit, and the annotation are set A second input unit that accepts an instruction to move to the browsing screen from the user, with the screen currently being browsed as the browsing screen, and the movement with reference to the operation history based on the input movement instruction An information processing program for causing a computer to function as a reproduction unit that reproduces the previous browsing screen.

In addition, the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the scope of the present invention.

10 ... Microscope 20 ... Computer for scanner 21 ... CPU
22 ... ROM
23 ... RAM
DESCRIPTION OF SYMBOLS 24 ... Operation input part 25 ... Interface part 26 ... Output part 27 ... Memory | storage part 28 ... Network interface part 29 ... Bus 41 ... Image storage part 42 ... Image provision part 43 ... Operation history storage part 44 ... Operation history management part 51 ... Image Acquisition unit 52 ... operation history control unit 60 ... viewer window 61 ... thumbnail map 62 ... observation area 63 ... operation recording / playback GUI
DESCRIPTION OF SYMBOLS 100 ... Scanner 300 ... Network 400 ... Image management server 500 ... Viewer computer

Claims (6)

An acquisition unit for acquiring a pathological image;
A display control unit for displaying the acquired pathological image on a screen;
A first input unit that receives a series of operations including at least an operation for setting an annotation from the user during browsing of the pathological image displayed on the screen by the user;
A generation unit that generates an operation history by associating a browsing time with each operation received by the first input unit;
A second input unit that accepts an instruction to move to the browsing screen as a browsing screen when the annotation is set;
An information processing apparatus comprising: a reproduction unit that reproduces the browse screen of the movement destination with reference to the operation history based on the input movement instruction. The information processing apparatus according to claim 1,
The operation history has a central coordinate value and a browsing magnification of the pathological image when displayed on the browsing screen, associated with a browsing time,
The reproduction unit is
An information processing apparatus that reproduces the browsing screen by causing the display control unit to display the pathological image to be the browsing screen acquired by the acquisition unit using the central coordinate value and the browsing magnification. An information processing apparatus according to claim 2,
The second input unit includes:
An information processing apparatus that receives the instruction from a user using a GUI having a seek bar in which the time when the annotation is set is clearly indicated as a mark and a slider that can be moved by the user on the seek bar. The information processing apparatus according to claim 3,
The second input unit includes:
When displaying a mark indicating the time when the annotation is set on the seek bar,
An information processing apparatus that changes at least one of the color and shape of the mark according to a difference in attributes of the annotation. The acquisition unit acquires a pathological image,
The display control unit displays the acquired pathological image on the screen,
The first input unit accepts a series of operations including at least an operation for setting an annotation from the user while the pathological image displayed on the screen is viewed by the user,
The generation unit generates an operation history by associating a browsing time with each operation received by the first input unit,
The second input unit accepts an instruction to move to the browsing screen from the user, with the screen being browsed when the annotation is set as the browsing screen,
An information processing method in which a reproduction unit reproduces the browsing screen of the movement destination with reference to the operation history based on the input movement instruction. An acquisition unit for acquiring a pathological image;
A display control unit for displaying the acquired pathological image on a screen;
A first input unit that receives a series of operations including at least an operation for setting an annotation from the user during browsing of the pathological image displayed on the screen by the user;
A generating unit that generates an operation history by associating a browsing time with each operation received by the first input unit;
A screen that is being browsed at the time when the annotation is set is used as a browsing screen, a second input unit that receives an instruction to move to the browsing screen from a user, and the operation history based on the input movement instruction An information processing program for causing a computer to function as a reproduction unit that reproduces the browsing screen of the movement destination with reference to FIG.

Images