JP6542334B2 - Medical image display - Google Patents

Description

  Embodiments of the present invention relate to a medical image display apparatus.

  The present invention relates to a medical image display apparatus, and in particular, is used when observing an image while moving a display range. First, when a radiographed image (original image) is read, the original image is displayed over the entire display range of the display. When a notable part is found out of them, the user designates an enlarged display range including the notable part. An enlarged image of the enlarged display range is created and displayed. Furthermore, the user moves (displaces) the enlarged display range as necessary, and observes while adjusting the display position of the enlarged image with respect to the original image. A series of operations from the movement operation of the enlarged display range by the user to the display of the enlarged image corresponding to the enlarged display range after the movement in response to the movement operation will be referred to as "pan movement".

  FIGS. 15 and 16 show the processing procedure on the apparatus side in the conventional panning operation. Data of an original image is usually stored in a hard disk drive (HDD) as a large-capacity non-volatile main storage unit. In the pan operation, the original image is enlarged over the entire area, and the enlarged image data is temporarily stored as an auxiliary storage unit in a semiconductor memory such as a high-speed read / write DRAM. By the read control of the memory, data of a partial enlarged image corresponding to the enlarged display range after movement is read and displayed on the display. Note that if the image is simply enlarged, the image becomes rough, so smoothing processing is essential along with the enlargement processing (interpolation processing). When the partial enlarged image is displayed, data other than the data of the partial enlarged image is erased to secure the remaining memory capacity. The same processing is repeated each time the user inputs a move operation instruction for the enlarged display range.

  Since the image smoothing process takes a processing time according to the performance of the CPU, a time lag occurs from the start of the pan operation by the user until the partial enlarged image is actually displayed on the screen. In order to reduce the time lag, it is conceivable to keep the enlarged image always on the memory, but usually the enlarged image is larger in size than the original image, so the client's resources may be excessively consumed. It is thought, and realization is difficult.

  In addition, when an examination in which an enlargement factor, an annotation, and the like are stored in an image storage communication device is displayed under a different monitor environment, the annotation displayed at the time of storage may not be displayed. In such a case, it is considered that the user performs a panning operation immediately after the image display because the range of the image display intended at the time of storage can not be properly reproduced, but the time lag causes stress on the operator and the reading time There was also a situation called an extension.

  The purpose is to shorten a lime lag from the user's pan operation to the actual display while reducing the load on the system during pan operation to move a portion of the medical image, for example. .

The medical image display apparatus according to the present embodiment includes an input unit that inputs a moving operation for moving the first display area on the medical image with respect to the first enlarged image related to the display area set in the medical image. An image processing unit that generates a second enlarged image corresponding to a region determined in advance with respect to the movement direction included in the movement operation in response to the input movement operation; A storage unit that stores a second enlarged image in association with space information in the medical image, and a control unit that reads a third enlarged image corresponding to the display area after movement from the storage unit and displays it on a display unit And.

FIG. 1 is a view showing a medical image display apparatus according to the present embodiment and an external apparatus. FIG. 2 is a view showing the configuration of a medical image display apparatus according to the present embodiment. FIG. 3 is a diagram showing changes in display screen according to the present embodiment. FIG. 4 is a view showing an outline of image enlargement display processing according to the present embodiment. FIG. 5 is a diagram showing an expanded enlargement processing range when panning is performed in the right direction. FIG. 6 is a diagram showing an expanded enlargement processing range when panning operation is performed in the left direction. FIG. 7 is a diagram showing the expanded enlargement processing range when the panning operation is performed in the upward direction. FIG. 8 is a diagram showing an expanded enlargement processing range when panning downward. FIG. 9 is a diagram showing an expanded enlargement processing range when panning operation is performed in the upper right direction. FIG. 10 is a diagram showing the expanded enlargement processing range when the panning operation is performed in the upper left direction. FIG. 11 is a diagram showing the expanded enlargement processing range when the panning operation is performed in the lower right direction. FIG. 12 is a diagram showing an expanded enlargement processing range when panning is performed in the lower left direction. FIG. 13 is a diagram showing in detail the procedure of the image enlargement display process according to the present embodiment. FIG. 14 is a diagram showing the procedure of the image enlargement display process when the panning operation is repeated according to the present embodiment. FIG. 15 is a diagram showing an outline of conventional image enlargement display processing. FIG. 16 is a diagram showing a procedure of image enlargement display processing when the panning operation is repeated in the related art.

  The medical image display apparatus according to the present embodiment stores data of a medical image (original image) in a first image storage unit. The image processing unit executes image processing such as enlargement processing on the original image. The second image storage unit has a higher speed operation than the first image storage unit, and stores data of a processed image subjected to image processing. The display unit displays the data read from the second image storage unit as an image in a predetermined display range in the screen. The control unit executes image processing on the original image while limiting to a partial range corresponding to the direction of the movement instruction (panning operation) by the operator. The partial range is substantially wider than the display range. The data of the partially processed image regarding the partial range is held in the second image storage unit. Data of a part of the partially processed image is read out and displayed on the display unit from the second image storage unit, limited to the display range corresponding to the movement instruction.

  That is, for example, a portion of the medical image is enlarged and displayed, and while reducing the load on the system at the time of pan operation for moving the range, the medical treatment is performed to shorten the lime lag from the pan operation by the user to actual display. The enlargement process is performed only on a part (the enlargement process range) of the image (original image). The enlargement processing range is relatively larger than the display range of the display screen. The partial enlarged image generated by this enlargement processing is stored in the memory. When the panning operation is continued beyond the range (enlargement processing range) of the partially enlarged image stored in the memory, whenever the range is exceeded, an enlarged image of the enlargement processing range according to the moving direction by the panning operation at that time Only generate and store in memory. The enlarged display range to be created is determined in advance for each client's performance. The image stored in the memory is erased at the end of panning.

  Further, when the display state (GSPS) is stored in the image to be displayed, if there is an annotation mark indicating a portion of interest in the GSPS, an enlarged image of the peripheral area is created and stored in the memory. The image stored in the memory is erased when the application of GSPS is canceled or the enlargement factor is changed. At this time, unless special operation is performed, a restriction may be provided so that panning can not be performed outside the range of the created enlarged image.

Hereinafter, the medical image display apparatus according to the present embodiment will be described in detail with reference to the drawings.
FIG. 1 shows the connection of an external device to the medical image display device according to the present embodiment. A medical image display apparatus 1 according to the present embodiment includes a medical image storage apparatus 4 having a communication function of medical image data via a network 2 such as a local area communication network (LAN) or a wide area communication network (WAN); It is connected to a medical image storage 5 having a function of storing a large amount of medical image data. The medical image display device 1 including the medical image storage device 4 and the medical image storage 5 or components equivalent thereto may be stand-alone.

  As shown in FIG. 2, the medical image display apparatus 1 is connected to the network 2 via the interface 2. The system control unit 12 functions as a control center of the medical image display apparatus 1. The operation unit 13 includes operation devices such as a keyboard, a mouse, and a touch pad. For example, information for specifying or searching a medical image to be interpreted is input via the operation unit 13, and a trigger for a request for transmission of medical image data (transmission request) is input together with the information. The main storage unit 14 is provided to store data of a medical image (original image) transmitted from the medical image storage device 4 and is typically composed of a hard disk drive (HDD) with a relatively large capacity. The auxiliary storage unit 15 is interposed between the main storage unit 14 and the display unit 16 and is provided to send display image data to the display unit 16 in accordance with a predetermined rule and speed. The auxiliary storage unit 15 has a storage capacity smaller than that of the main storage unit 14 but is typically made of a semiconductor memory such as a DRAM having a high speed of read / write operation. The storage control unit 17 controls reading and writing of image data to the main storage unit 14. The image processing unit 18 performs image processing such as enlargement processing, gradation processing, smoothing processing, and edge enhancement processing on the data of the medical image read from the main storage unit 14. The image data subjected to the image processing is stored in the auxiliary storage unit 15. The display control unit 19 controls reading and writing of the image data of the auxiliary storage unit 15. The image data (referred to as display image data) read from the auxiliary storage unit 15 under the control of the display control unit 19 is displayed on the display unit 16.

  FIG. 3 shows a screen change of the display unit 16 according to the present embodiment. First, image processing and display operations in the present embodiment will be schematically described with reference to FIG. When interpreting a medical image (referred to as an original image), first, the entire medical image (original image) is displayed, and a part thereof is displayed enlarged. Here, a partially enlarged image is referred to as a partially enlarged image. Note that “enlargement processing” is defined as image processing that matches the matrix size of an image with the matrix size of the image display area set in the screen of the display unit 16, and includes reduction processing.

  The operator appropriately interprets the important parts of the original image in detail while moving (panning or scrolling) the displayed part (partially enlarged image). Typically, the move operation (pan operation) is performed by drag and drop or scroll by mouse operation or touch pad operation on the displayed partial magnified image.

  As shown in FIG. 4, in the present embodiment, a smooth panning operation is performed by shortening the time lag from the panning operation to the display of a partially enlarged image after movement, which varies according to the processing capability of the image processing unit 18. In order to realize the above, part of the original image is subjected to enlargement processing by limiting the enlargement display range that defines the position and range of the displayed partial enlargement image to the extended range (extended enlargement processing range) In addition, the enlargement processing is performed as long as the partially enlarged image generated thereby (hereinafter referred to as an expanded partial enlarged image) is held in the auxiliary storage unit 15 and pan operation is performed within the expanded enlargement processing range. From the auxiliary storage unit 15 to the display unit 16 from the “data of the partially enlarged image expanded” stored in the auxiliary storage unit 15 from the auxiliary It is assumed that the corresponding by controlling look out.

  The “data of the partially enlarged image expanded” is held in the auxiliary storage unit 15 at least until the end of the movement is instructed by the operator. Alternatively, “the expanded partially enlarged image data” is held in the auxiliary storage unit 15 until the next partially processed image is displayed. The “data of the partially enlarged image expanded” is held in the auxiliary storage unit 15 until a predetermined time elapses from when it is stored in the auxiliary storage unit 15.

  Here, the extension width of the “expanded enlargement processing range” with respect to the enlargement display range is determined in advance in accordance with the processing capability of the image processing unit 18, the storage capacity of the auxiliary storage unit 15, and the like. The expansion direction of the “expanded expansion processing range” is expanded in the direction coincident with the moving direction by the panning operation. For example, when the movement direction instructed by the panning operation is either left, right, upper or lower, as shown in FIGS. 5 to 8, the moving direction is expanded by a predetermined expansion width based on the enlarged display range at the time of panning operation. . When the movement direction instructed by the panning operation is any one of upper right, upper left, upper right and lower right, left or right according to the moving direction with reference to the enlarged display range at the time of panning operation as shown in FIGS. Extended by a predetermined expansion width, and expanded upward or downward by a predetermined expansion width. In this case, the left and right extension widths may be the same as or different from each other. In addition, in order to eliminate the fluctuation of the time lag due to the movement direction, the movement direction is either upper right, upper left, upper right, lower right with respect to the area of the extension when the movement direction is either left, right, upper or lower When the movement direction is either upper right, upper left, upper right, lower right, the expansion width in the left or right direction and the expansion width in the upper or lower direction move so that the area of the expansion part at the time becomes the same. The width may be adjusted to be narrower than the expansion width when the direction is either left, right, upper, or lower.

  FIG. 13 and FIG. 14 show the procedure of the image enlargement display process according to the present embodiment. First, information for specifying or searching an image to be interpreted is input through the operation unit 13. The system control unit 12 sends an image request together with the information to the medical image storage device 3 via the interface 11. Data of a medical image to be read (referred to as an original image T1) is supplied from the medical image storage device 3 and stored in the main storage unit 14 (S11). Then, the original image is scaled up / down by the image processing unit 18 according to the matrix size of the image display area of the screen of the display unit 16 and the whole area is displayed on the display unit 16 (S12).

  When a partial enlarged display instruction is input through the operation unit 13, the enlarged display frame is superimposed on the original image displayed in the entire area under the control of the system control unit 12 and the display control unit 19. The operator adjusts the position and size of the enlarged display frame via the operation unit 13. As a result, the enlarged display range for the entire area of the original image is set (S13). Data of a part of the original image is read from the main storage unit 14 limited to the range (enlargement processing range R1) corresponding to the set enlarged display range, and enlargement processing is performed. The data of the partial enlarged image P1 generated thereby is displayed on the display unit 16 via the auxiliary storage unit 15 (S14).

  When movement (panning operation) to the right, for example, is input by the operator via the operation unit 13 from this state (S15), the system control unit 12 detects the instructed movement direction (S16), and It is determined whether the data of the partial enlarged image P2 corresponding to the enlarged display range after movement is held in the auxiliary storage unit 15 (S17). Here, it is determined as "No" (NO in S15). The system control unit 12 extends the immediately preceding enlargement processing range R1 in the right direction indicated by the panning operation by a predetermined expansion width (S18). The enlargement process is limited to the expanded enlargement process range ER1 (S19). The data of the expanded partial magnified image EP1 generated thereby is held in the auxiliary storage unit 15 (S20). The data of the partial enlarged image P2 corresponding to the enlarged display range after movement, which constitutes a part of the expanded partial enlarged image EP1 held in the auxiliary storage unit 15 under the readout control of the display control unit 19, is It is read from the auxiliary storage unit 15 to the display unit 16 (S21) and displayed (S22). When the image interpretation regarding the image is not completed, the process returns to S15 via step S23, and waits for input of a new pan operation.

  Subsequently, when, for example, a movement (panning operation) to the right is further input by the operator via the operation unit 13 (S15), the system control unit 12 detects the instructed movement direction (S16), Further, it is determined whether or not the data of the partial enlarged image P3 corresponding to the enlarged display range after movement is held in the auxiliary storage unit 15 (S17). Here, it is determined as "OK (held)" (YES in S15). At this time, enlargement processing is not performed. A part corresponding to the enlarged display range after further movement, which constitutes a part of the expanded partial enlarged image EP1 held in the auxiliary storage unit 15 by the readout control of the display control unit 19 by the system control unit 12 The data of the target enlarged image P3 is read from the auxiliary storage unit 15 to the display unit 16 (S21) and displayed (S22). When the image interpretation regarding the image is not completed, the process returns to S15 via step S23, and waits for input of a new pan operation.

  Furthermore, when, for example, downward movement (pan operation) is input by the operator via the operation unit 13 (S15), the system control unit 12 detects the instructed movement direction (S16), and It is determined whether the data of the partial enlarged image P4 corresponding to the enlarged display range after movement is held in the auxiliary storage unit 15 (S17). Here, it is determined as "No" (NO in S15). The system control unit 12 extends the previous enlargement processing range R1 downward in the downward direction instructed by the panning operation by a predetermined expansion width (S18). The enlargement process is limited to the expanded enlargement process range ER2 (S19). The data of the expanded partially enlarged image EP2 generated thereby is held in the auxiliary storage unit 15 (S20). Then, under the readout control of the display control unit 19, the data of the partial enlarged image P4 corresponding to the enlarged display range after movement, which is a part of the expanded partial enlarged image EP2 held in the auxiliary storage unit 15, is It is read from the auxiliary storage unit 15 to the display unit 16 (S21) and displayed (S22).

  The processes of steps S15 to S23 are repeated until the interpretation of the image is completed.

  As described above, the enlargement processing time is shortened and the partial enlargement image is displayed from the pan operation by performing the enlargement processing by narrowing the region to a narrower range instead of performing the enlargement processing for the entire original image. Lime lag can be shortened. In addition, a partial enlarged image is generated for a range (expanded enlargement processing range) wider than the enlargement processing range corresponding to the enlarged display range, and is stored in the auxiliary storage unit 15 faster than the main storage unit 14. By setting the partial enlarged image corresponding to the next pan operation can be generated by reading control from the auxiliary storage unit 15 to the display unit 16 without the need for enlargement processing, and the lime lag can be further shortened. . Then, by aligning the expansion direction of the “expanded expansion processing range” with the movement direction by the pan operation, the possibility that the partially enlarged image required by the next pan operation is held in the auxiliary storage unit 15 is enhanced. It can reduce the chance of lime rags becoming longer.

  In the above description, the enlargement processing has been described to be limited to the expanded enlargement processing range, but the original image is enlarged in the entire area, and the enlargement processing range of the holding range to the auxiliary storage unit 15 is expanded. It may be limited to data of a partially enlarged image.

  In the above description, immediately after displaying the entire area of the original image and prior to setting the enlarged display range, the local image is limited to the minimum range necessary for display, that is, the enlargement processing range equivalent to the enlarged display range. Although the enlargement processing is described to hold the data of the partial enlarged image in the auxiliary storage unit 15, in the previous step, the portion regarding the portion in the image to which the image interpretation doctor focused as supplementary information of the original image When information (annotation information) is present, an extended enlargement processing range may be set centering on the portion of interest, and the expanded partial enlarged image may be generated and held in the auxiliary storage unit 15 . The image data stored in the auxiliary storage unit 15 is erased when the display mode is canceled or the enlargement factor is changed. At this time, unless special operation is performed, a restriction may be provided so that panning can not be performed outside the range of the created enlarged image.

A medical image display apparatus according to an embodiment includes a first image storage unit that stores data of a medical image, an image processing unit that performs image processing on the medical image, and a processed image on which the image processing has been performed. A second image storage unit for storing data, which is faster than the first image storage unit, and an image of the processed image read from the second image storage unit within a predetermined display range in the screen And a control unit that controls the first image storage unit, the image processing unit, and the second image storage unit, and the control unit operates in the direction of the movement instruction by the operator. Accordingly, the first image processing is performed on the medical image limited to a portion range substantially wider than the display range to generate data of a partially processed image related to the portion range. Image storage unit and image processing And the control unit causes the second image storage unit to hold the data of the partially processed image, and limits the range according to the movement instruction from the second image storage unit to the display unit. Control the second image storage unit to read out data of a part of the partially processed image.
In the medical image display device according to another embodiment, the data of the partially processed image is held in the second image storage unit until the end of movement is instructed by the operator.
In the medical image display apparatus according to another embodiment, the data of the partially processed image is held in the second image storage unit until the next partially processed image is displayed.
In the medical image display device according to another embodiment, the data of the partially processed image is held in the second image storage unit until a predetermined time has elapsed from the time when it is stored in the second image storage unit. It is.
In the medical image display apparatus according to another embodiment, data of a part of the partially processed image held in the second image storage unit is a movement instruction by the operator from the second image storage unit to the display unit. It is read repeatedly according to.
The medical image display apparatus according to another embodiment, when movement is instructed by the operator in a direction different from the instructed direction, data of a new partially processed image regarding a partial range corresponding to the different direction. Are regenerated by the image processing unit.
In the medical image display apparatus according to another embodiment, the control unit can arbitrarily change the ratio of the matrix size of the partial range larger than the matrix size of the display range according to an operator instruction. The image storage unit and the image processing unit are controlled.
In the medical image display device according to the other embodiment, the medical image is accompanied by annotation information indicating a caution or interest position in the image, and the portion in the medical image includes the caution or interest position. The range of the range is set initially.
In the medical image display device according to another embodiment, the image processing includes at least one of enlargement processing, gradation processing, smoothing processing, and edge enhancement processing.
A medical image display apparatus according to another embodiment includes: a first image storage unit that stores data of a medical image; an image processing unit that performs image processing on the medical image; and a processed image on which the image processing has been performed. A second image storage unit storing data of the first image storage unit and data of the processed image read from the second image storage unit within a predetermined display range in the screen A display unit for displaying as an image, and a control unit for controlling the first image storage unit, the image processing unit, and the second image storage unit, the control unit including a direction of movement instruction by the operator And execute the image processing on the medical image limited to a partial range substantially wider than the display range, and hold the medical image in the second image storage unit, and according to the movement instruction by the operator From the second image storage unit One in which to read returns.
While certain embodiments of the present invention have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

  DESCRIPTION OF SYMBOLS 1 ... medical image display apparatus, 2 ... interface, 3 ... medical image storage, 4 ... medical image storage apparatus, 12 ... system control part, 13 ... operation part, 14 ... main memory part, 15 ... auxiliary memory part, 16 ... Display unit, 17: storage control unit, 18: image processing unit, 19: display control unit.

Claims (9)

With respect to the first enlarged image relating to the first display area set in the medical image, an input unit for inputting a moving operation of moving the front Symbol first display area,
An image processing unit configured to generate an enlarged enlarged image of an area obtained by expanding the first display area by a predetermined width in the moving direction included in the moving operation in response to the input moving operation;
A storage unit that stores the expansion enlarged picture image in correspondence with the spatial information in the medical image,
A control unit for displaying on a part readout display unit from the expansion enlarged image stored a second enlarged image corresponding to the second display area after the moving the storage unit,
Medical image display apparatus equipped with Wherein the image processing unit, if the third display area after the movement of the second display area is not included in the extended enlarged image, only predetermined width said second display region in the direction of the movement generating a second extended enlarged image expands,
The storage unit stores the previous SL second expansion enlarged image in association with the spatial information in the medical image,
The medical image according to claim 1, wherein the control unit causes the display unit to display a partial readout of a third enlarged image corresponding to the third display area from the second enlarged enlarged image stored in the storage unit. Display device. Wherein the image processing unit, said the area before Symbol extended enlarged image in the storage unit is stored, the medical image display device according to claim 2 which does not store the previous SL second expansion enlarged image. Annotation information is attached to the medical image,
The medical image display apparatus according to any one of claims 1 to 3, wherein the enlarged enlarged image is determined based on a position of the annotation information. The medical image display apparatus according to claim 4, wherein the control unit prohibits the movement of the first display area out of the enlarged enlarged image determined based on the annotation information. The expansion enlarged picture image is a medical image display device as claimed in any one of claims 1 to 5 times or magnification table示態like is changed is held in the storage unit until the time it is changed. The expansion enlarged picture image, the operator by the medical image display device as claimed in any one of claims 1 to 5 the end of the movement based on the movement operation is held in the storage unit until instructed. The expansion enlarged picture image, before Symbol third medical image display apparatus according to claim 2, wherein held in the storage unit until the enlarged image is displayed. The expansion enlarged picture image is a medical image display device as claimed in any one of claims 1 to 5 from the time stored in the storage unit until a predetermined time elapses is held in the storage unit.