[go: up one dir, main page]

WO2019049666A1 - Image processing device, image processing device operation method, and image processing device operation program - Google Patents

Image processing device, image processing device operation method, and image processing device operation program Download PDF

Info

Publication number
WO2019049666A1
WO2019049666A1 PCT/JP2018/030990 JP2018030990W WO2019049666A1 WO 2019049666 A1 WO2019049666 A1 WO 2019049666A1 JP 2018030990 W JP2018030990 W JP 2018030990W WO 2019049666 A1 WO2019049666 A1 WO 2019049666A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image processing
digestive tract
medical device
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/030990
Other languages
French (fr)
Japanese (ja)
Inventor
優輔 鈴木
千葉 淳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Publication of WO2019049666A1 publication Critical patent/WO2019049666A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045Control thereof

Definitions

  • the present invention relates to an image processing apparatus, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.
  • an image group including a plurality of images acquired in chronological order by a capsule endoscope is acquired, and a partial image is extracted from the image group and summarized into an image group having a smaller number than the original image group.
  • An image processing apparatus that performs image summarization processing is known (see, for example, Patent Document 1).
  • the efficiency of observation by a medical worker such as a doctor can be improved by excluding an image obtained by imaging the same feature area.
  • the capsule endoscope may move in the opposite direction to the anus because it moves by peristaltic movement of the digestive tract.
  • the image captured when the capsule endoscope returns is an image obtained by capturing an already captured region of the digestive tract.
  • Such an image is also included in the image summarized by the image processing apparatus of Patent Document 1, and therefore, a part of the digestive tract is overlapped and observed, and there is a problem that the observation efficiency is lowered.
  • the present invention has been made in view of the above, and an object of the present invention is to provide an image processing apparatus capable of improving observation efficiency, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.
  • the image processing apparatus is configured such that the medical device has already passed among images taken by a medical device introduced into the digestive tract
  • the image processing apparatus may further include a processing unit configured to select a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract.
  • the processing unit includes an extraction unit that extracts a candidate image that is a candidate for the representative image from the image group, and the medical device A determination unit that determines whether or not the image of the section in the digestive tract which has already passed is imaged, and a candidate image that is determined not to be an image of the section in the digestive tract which the medical device has already passed And a selection unit for selecting a representative image.
  • the processing unit is an image obtained by imaging a section in the digestive tract in which the medical device has already passed, with respect to each image included in the image group Characterized in that it has a determination unit that determines whether or not it is, and an extraction unit that extracts the representative image from among the images determined not to be images obtained by imaging the section in the digestive tract through which the medical device has already passed.
  • the image processing apparatus further includes a calculation unit that calculates the moving direction of the medical device when each image included in the image group is captured, and the processing unit is configured to calculate the moving direction. And processing for selecting a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract which the medical device has already passed.
  • the calculation unit may calculate the movement direction based on position information of the medical device when each image included in the image group is captured. It features.
  • an image processing apparatus includes a display control unit that causes the display device to display the representative image.
  • the medical device is a capsule endoscope.
  • the image processing apparatus is not an image obtained by imaging a section in the digestive tract through which the medical device has already passed, among images captured by the medical device introduced into the digestive tract.
  • the display control unit is configured to display a representative image selected from the determined images on the display device.
  • the processing unit is a section in the digestive tract in which the medical device has already passed among the image group captured by the medical device introduced into the digestive tract. It is characterized in that the image processing apparatus is caused to execute a processing step of selecting a representative image from among the images determined not to be captured images.
  • an image processing apparatus capable of improving observation efficiency, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.
  • FIG. 1 is a schematic view showing an endoscope system according to a first embodiment of the present invention.
  • FIG. 2 is a block diagram of the recording medium shown in FIG. 1 connected to the image processing apparatus.
  • FIG. 3 is a flowchart showing the operation of the image processing apparatus shown in FIG.
  • FIG. 4 is a view showing the movement of the capsule endoscope in the digestive tract.
  • FIG. 5 is a diagram illustrating an example of an in-vivo image.
  • FIG. 6 is a diagram illustrating an example of an in-vivo image.
  • FIG. 7 is a diagram illustrating an example of an in-vivo image.
  • FIG. 8 is a flowchart showing the operation of the image processing apparatus according to the second modification of the first embodiment.
  • FIG. 9 is a flowchart showing the operation of the image processing apparatus according to the second embodiment.
  • FIG. 10 is a view showing the movement of the capsule endoscope in the digestive tract.
  • FIG. 11 is a flowchart showing the operation of the image processing apparatus according to the third embodiment.
  • FIG. 12 is a view showing the movement of the capsule endoscope in the digestive tract.
  • FIG. 13 is a block diagram of a configuration that causes a processing device connected via the Internet to execute a part of processing.
  • FIG. 1 is a schematic view showing an endoscope system according to a first embodiment of the present invention.
  • the endoscope system 1 is a system that acquires an in-vivo image of the inside of the subject 100 using a capsule endoscope 2 as a swallow-type medical device and causes a doctor or the like to observe the in-vivo image.
  • the endoscope system 1 includes, in addition to the capsule endoscope 2, a receiving device 3, an image processing device 4, a portable recording medium 5, an input device 6, and a display device. And 7.
  • the recording medium 5 is a portable recording medium for transferring data between the receiving device 3 and the image processing device 4 and is configured to be removable from the receiving device 3 and the image processing device 4 respectively. There is.
  • the capsule endoscope 2 is a capsule endoscope device formed in a size that can be introduced into the organ of the subject 100, introduced into the organ of the subject 100 by oral intake or the like, The in-vivo images are sequentially taken while moving inside the organ by the like. Then, the capsule endoscope 2 sequentially transmits the image data generated by imaging.
  • the receiving device 3 includes a plurality of receiving antennas 3a to 3h, and receives image data from the capsule endoscope 2 in the subject 100 using at least one of the plurality of receiving antennas 3a to 3h. Then, the receiving device 3 accumulates the received image data in the recording medium 5 inserted into the receiving device 3.
  • the receiving antennas 3a to 3h may be disposed on the body surface of the subject 100 as shown in FIG. 1, or may be disposed on a jacket worn by the subject 100. Further, the number of receiving antennas provided in the receiving device 3 may be one or more, and is not particularly limited to eight.
  • FIG. 2 is a block diagram of the recording medium shown in FIG. 1 connected to the image processing apparatus.
  • the image processing apparatus 4 includes a reader / writer 41, a storage unit 42, and a control unit 43.
  • the reader / writer 41 has a function as an image acquisition unit that acquires image data to be processed from the outside. Specifically, when the recording medium 5 is inserted into the reader / writer 41, the reader / writer 41 controls the control unit 43 to store image data stored in the recording medium 5 (capsule type endoscope 2. In-vivo image group including a plurality of in-vivo images captured (acquired) in chronological order in accordance with step 2). Also, the reader / writer 41 transfers the captured in-vivo image group to the control unit 43. Then, the in-vivo image group transferred to the control unit 43 is stored in the storage unit 42.
  • the storage unit 42 stores the in-vivo image group transferred from the control unit 43.
  • the storage unit 42 also stores various programs (including an image processing program) executed by the control unit 43 and information necessary for processing of the control unit 43.
  • the storage unit 42 is realized by various IC memories such as a flash memory, a read only memory (ROM) and a random access memory (RAM), and a hard disk electrically connected by a built-in or data communication terminal.
  • the control unit 43 is configured using a general-purpose processor such as a central processing unit (CPU) or a dedicated processor such as various arithmetic circuits that execute a specific function such as an application specific integrated circuit (ASIC).
  • the control unit 43 reads a program (including an image processing program) stored in the storage unit 42, and controls the entire operation of the endoscope system 1 according to the program.
  • the control unit 43 has a processing unit 431 and a display control unit 432, as shown in FIG.
  • the processing unit 431 is a digest that the capsule endoscope 2 has already passed among the image group captured by the capsule endoscope 2 introduced into the digestive tract based on the moving direction of the capsule endoscope 2. A process of selecting a representative image from among the images determined not to be an image obtained by imaging a section in the duct is performed.
  • the processing unit 431 includes an extraction unit 4311, a calculation unit 4312, a determination unit 4313, and a selection unit 4314.
  • the extraction unit 4311 extracts a candidate image that is a candidate for a representative image from the image group.
  • the candidate image is an image captured when the capsule endoscope 2 moves largely in the digestive tract.
  • the extraction unit 4311 compares the images before and after the image group arranged in chronological order to calculate the similarity, and sets the image as a candidate image when the calculated similarity is smaller than a predetermined threshold.
  • a known technique such as scene change determination using a motion vector of an image may be used.
  • the calculating unit 4312 calculates the moving direction based on the position information of the capsule endoscope 2 when each image included in the image group is captured. Specifically, the calculation unit 4312 calculates position information of the capsule endoscope 2 for each image included in the image group from the signal strengths of the reception signals at the reception antennas 3a to 3h received from the reception device 3. Furthermore, the calculating unit 4312 compares position information of images before and after the image group arranged in chronological order, and calculates a direction (moving direction) in which each image moves from the previous image in chronological order.
  • the determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed.
  • the selection unit 4314 selects, as a representative image, a candidate image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed.
  • the display control unit 432 performs predetermined image processing on the image stored in the storage unit 42 and performs predetermined processing such as thinning of data according to the display range of the image on the display device 7 and gradation processing. After that, the representative image is displayed on the display device 7.
  • the input device 6 is configured using a keyboard, a mouse, and the like, and receives an operation by the user.
  • the display device 7 is configured using a liquid crystal display or the like, and displays an image including a representative image and the like under the control of the display control unit 432.
  • FIG. 3 is a flowchart showing the operation of the image processing apparatus shown in FIG. As shown in FIG. 3, first, the extraction unit 4311 extracts a candidate image from the image group stored in the storage unit 42 by the capsule endoscope 2 via the recording medium 5 (step S1). .
  • FIG. 4 is a view showing the movement of the capsule endoscope in the digestive tract.
  • the reference direction D is the direction in which the capsule endoscope 2 moves toward the anus. Therefore, in the portion where the digestive tract is bent, the reference direction D also changes along the extension direction of the digestive tract.
  • the reference direction D can be calculated, for example, by averaging the moving directions of several images before and after each image.
  • the calculation unit 4312 calculates the movement direction of the ith image (step S5).
  • the determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed. Specifically, the determination unit 4313 compares the movement direction Ai of the ith image with the reference direction D, and determines whether the movement direction Ai of the ith image is positive (step S6). The determining unit 4313 determines that the angle between the movement direction Ai of the i-th image and the reference direction D is less than 90 degrees, and determines that the angle is more than 90 degrees.
  • each arrow (A 1, A 2,%) Indicates the moving direction when each image is captured.
  • the moving directions A1, A2 and An + 2 of the 1, 2, and n + 2-th images are positive, and the moving directions An and An + 1 of the n and n + 1-th images are negative.
  • step S6 determines that the moving direction is positive (step S6: Yes)
  • the selecting unit 4314 selects the candidate image (i-th image) as a representative image (step S7).
  • step S6: No the process proceeds to step S8.
  • step S8 determines whether i> N is satisfied. If i> N is not satisfied (step S8: No), the process returns to step S4, and if i> N, the series of processing ends.
  • an image whose moving direction is positive is set as a representative image, whereas an image which is determined as a negative moving direction is Not selected as a representative image. That is, the capsule endoscope 2 returns in the digestive tract, and an image captured in the same range in an overlapping manner is excluded from the representative image. As a result, a medical worker such as a doctor does not observe an image captured by overlapping the same range, and the observation efficiency is improved.
  • the moving direction of the capsule endoscope 2 is calculated using the position information of the capsule endoscope 2, but the capsule endoscope using the image captured by the capsule endoscope 2 The moving direction of 2 may be calculated.
  • the calculating unit 4312 sets feature points B in the image.
  • the feature point B is, for example, an end of a fold or unevenness in the digestive tract.
  • the calculator 4312 calculates the moving direction of the capsule endoscope 2 as positive.
  • the calculating unit 4312 calculates the moving direction of the capsule endoscope 2 as negative.
  • the method of calculating the moving direction of the capsule endoscope 2 is not particularly limited.
  • the moving direction of the capsule endoscope 2 may be calculated based on the speed information and the acceleration information detected by the speed sensor and the acceleration sensor of the capsule endoscope 2.
  • the determination unit 4313 is an image obtained by imaging a section in the digestive tract in which the capsule endoscope 2 has already passed, with respect to each image included in the image group It is determined whether the In addition, the extraction unit 4311 extracts a representative image from the image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed.
  • FIG. 8 is a flowchart showing the operation of the image processing apparatus according to the second modification of the first embodiment.
  • the process of step S1 is not performed, and the process starts from the process of step S2. Then, the processing from step S2 to step S6 is performed as in the first embodiment.
  • the determination unit 4313 determines whether or not an image of a section in the digestive tract in which the capsule endoscope 2 has already passed is captured for all the images included in the image group.
  • the selecting unit 4314 selects an image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed as a display candidate image (step S11).
  • step 8 is performed as in the first embodiment, and the processes of steps S5 to S11 are performed on all the images.
  • the extraction unit 4311 extracts a representative image from the display candidate images (step S12).
  • the order of the process of the first embodiment may be switched.
  • an image processing apparatus capable of improving the observation efficiency can be realized.
  • the image processing apparatus 4 according to the second embodiment is different from that of the first embodiment in the processing in the processing unit 431, but the configuration of the image processing apparatus 4 may be the same as that of the first embodiment. Do.
  • FIG. 9 is a flowchart showing the operation of the image processing apparatus according to the second embodiment. As shown in FIG. 9, the same processing as in the first embodiment is performed from step S1 to step S4.
  • the calculation unit 4312 calculates the movement direction and the movement amount of the ith image (step S21).
  • the determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed (step S6).
  • step S6 determines that the moving direction is not positive (step S6: No)
  • the processing unit 431 stores the amount of movement in the reverse direction (step S22). Specifically, the processing unit 431 stores the movement amount calculated by the calculation unit 4312 in the storage unit 42. Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • step S6 determines that the movement direction is positive (step S6: Yes)
  • the processing unit 431 reads the storage of the storage unit 42 and determines whether or not there is storage of the movement amount in the reverse direction. Is determined (step S23).
  • step S23 If the determination unit 4313 determines that there is storage of the backward movement amount (step S23: Yes), the processing unit 431 determines that the forward movement amount is the reverse movement amount stored in the storage unit 42. It is determined whether it has exceeded (step S24).
  • FIG. 10 is a view showing the movement of the capsule endoscope in the digestive tract.
  • the direction of each arrow (C1, C2,%) Indicates the movement direction when each image is captured, and the length of each arrow indicates the movement amount when each image is captured.
  • the capsule endoscope 2 moves in the reverse direction by the movement amount E1.
  • the amount of movement in the positive direction does not exceed the amount of movement E1 (step S24: No)
  • the process proceeds to step S8.
  • step S24 Yes
  • the processing unit 431 resets the storage of the amount of movement in the reverse direction to the storage unit 42.
  • the selection unit 4314 selects the candidate image (the n + 3rd image) as a representative image (Step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • step S23 when the determination unit 4313 determines that there is no storage of the movement amount in the reverse direction (step S23: No), the processing unit 431 selects the candidate image (i-th image) as the selection unit 4314. A representative image is selected (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • the processing unit 431 selects the representative image based on the movement direction and the movement amount, so the capsule endoscope 2 has already been moved even if it has moved in the forward direction.
  • the image (the n + 2th image in FIG. 10) obtained by imaging the section in the digestive tract that has passed is also excluded from the representative image.
  • the observation efficiency is further improved compared to the first embodiment.
  • the image processing apparatus 4 according to the third embodiment is different from that of the first embodiment in the processing in the processing unit 431, but the configuration of the image processing apparatus 4 may be the same as that of the first embodiment. Do.
  • FIG. 11 is a flowchart showing the operation of the image processing apparatus according to the third embodiment. As shown in FIG. 11, the same processes as in the second embodiment are performed from step S1 to step S6.
  • step S6 determines that the moving direction is not positive (step S6: No)
  • the processing unit 431 stores the moving start position in the reverse direction (step S31). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • step S6 determines that the moving direction is positive
  • the processing unit 431 reads the storage of the storage unit 42 and determines whether or not there is a storage of the movement start position in the reverse direction. It is determined (step S32).
  • step S32 determines that there is storage of the movement start position in the reverse direction. If the determination unit 4313 determines that there is storage of the movement start position in the reverse direction (step S32: Yes), the processing unit 431 determines that the position of the capsule endoscope 2 is stored in the storage unit 42 in the reverse direction. It is determined whether it has exceeded the movement start position to (step S33).
  • FIG. 12 is a view showing the movement of the capsule endoscope in the digestive tract.
  • the direction of each arrow (F1, F2,%) Indicates the movement direction when each image is captured, and the length of each arrow indicates the movement amount when each image is captured.
  • the storage unit 42 stores the movement start position P0 in the reverse direction. It is assumed that the capsule endoscope 2 is moved in the opposite direction when the nth and n + 1th images are captured. In this case, in the (n + 2) -th image, the position P1 of the capsule endoscope 2 does not exceed the movement start position P0 (step S33: No), the process proceeds to step S8.
  • step S33 Yes
  • the processing unit 431 stores the movement start position storage unit 42 in the reverse direction.
  • the memory in the memory is reset (step S34), and the selecting unit 4314 selects the candidate image (the n + 3rd image) as a representative image (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • step S32 when the determination unit 4313 determines that there is no storage of the movement start position in the reverse direction (step S32: No), the processing unit 431 determines that the candidate image (i-th image) is the candidate image Is selected as a representative image (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.
  • the observation efficiency is further improved than the first embodiment.
  • the value detected by the speed sensor, and the acceleration sensor may be calculated.
  • FIG. 13 is a block diagram of a configuration that causes a processing device connected via the Internet to execute a part of processing. As shown in FIG. 13, at least a part of the processing performed by the processing unit may be executed by the processing device 8A connected via the Internet line. Further, at least a part of the processing performed by the processing unit may be performed on a cloud including a plurality of processing devices (server groups). In this case, the control unit 43A of the image processing apparatus 4A may not have a processing unit.
  • the display control unit 432A is not an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed, out of the image group imaged by the capsule endoscope 2 introduced into the digestive tract.
  • the representative image selected from the determined images is displayed on the display device 7.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

This image processing device, this image processing device operation method, and this image processing device operation program are each provided with: a processing unit that performs a process for selecting a representative image from among images that are in a group of images captured by a medical instrument introduced into the gastrointestinal tract and that have been determined not to be images capturing a section within the gastrointestinal tract through which the medical instrument has already passed. By this configuration, the present invention is able to provide an image processing device, an image processing device operation method, and an image processing device operation program, with which it is possible to improve observation efficiency.

Description

画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラムImage processing apparatus, operation method of image processing apparatus, and operation program of image processing apparatus

 本発明は、画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラムに関する。 The present invention relates to an image processing apparatus, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.

 従来、カプセル型内視鏡により時系列順に取得された複数の画像を含む画像群を取得し、当該画像群から一部の画像を抽出して元の画像群よりも枚数の少ない画像群に要約する画像要約処理を実行する画像処理装置が知られている(例えば、特許文献1参照)。 Conventionally, an image group including a plurality of images acquired in chronological order by a capsule endoscope is acquired, and a partial image is extracted from the image group and summarized into an image group having a smaller number than the original image group. An image processing apparatus that performs image summarization processing is known (see, for example, Patent Document 1).

 特許文献1の画像処理装置によれば、同一の特徴領域を撮像した画像を除外することにより、医師等の医療従事者による観察の効率を向上させることができる。 According to the image processing apparatus of Patent Document 1, the efficiency of observation by a medical worker such as a doctor can be improved by excluding an image obtained by imaging the same feature area.

特開2015-032127号公報JP, 2015-032127, A

 ところで、消化管内において、カプセル型内視鏡は、消化管の蠕動運動によって移動するため、肛門とは逆方向に戻る場合がある。カプセル型内視鏡が戻る際に撮像された画像は、消化管の既に撮像された領域を撮像した画像である。特許文献1の画像処理装置が要約した画像には、このような画像も含まれているため、消化管の一部を重複して観察することとなり、観察効率が低下するという課題があった。 By the way, in the digestive tract, the capsule endoscope may move in the opposite direction to the anus because it moves by peristaltic movement of the digestive tract. The image captured when the capsule endoscope returns is an image obtained by capturing an already captured region of the digestive tract. Such an image is also included in the image summarized by the image processing apparatus of Patent Document 1, and therefore, a part of the digestive tract is overlapped and observed, and there is a problem that the observation efficiency is lowered.

 本発明は、上記に鑑みてなされたものであって、観察効率を向上させることができる画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラムを提供することを目的とする。 The present invention has been made in view of the above, and an object of the present invention is to provide an image processing apparatus capable of improving observation efficiency, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.

 上述した課題を解決し、目的を達成するために、本発明の一態様に係る画像処理装置は、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理部を備えることを特徴とする。 In order to solve the problems described above and to achieve the object, the image processing apparatus according to an aspect of the present invention is configured such that the medical device has already passed among images taken by a medical device introduced into the digestive tract The image processing apparatus may further include a processing unit configured to select a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract.

 また、本発明の一態様に係る画像処理装置は、前記処理部は、前記画像群から前記代表画像の候補である候補画像を抽出する抽出部と、前記候補画像に対して、前記医療装置が既に通過した前記消化管内の区間を撮像した画像であるか否かを判定する判定部と、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定された候補画像を前記代表画像に選択する選択部と、を有することを特徴とする。 Further, in the image processing apparatus according to one aspect of the present invention, the processing unit includes an extraction unit that extracts a candidate image that is a candidate for the representative image from the image group, and the medical device A determination unit that determines whether or not the image of the section in the digestive tract which has already passed is imaged, and a candidate image that is determined not to be an image of the section in the digestive tract which the medical device has already passed And a selection unit for selecting a representative image.

 また、本発明の一態様に係る画像処理装置は、前記処理部は、前記画像群に含まれる各画像に対して、前記医療装置が既に通過した前記消化管内の区間を撮像した画像であるか否かを判定する判定部と、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定された画像の中から前記代表画像を抽出する抽出部と、を有することを特徴とする。 Further, in the image processing device according to one aspect of the present invention, whether the processing unit is an image obtained by imaging a section in the digestive tract in which the medical device has already passed, with respect to each image included in the image group Characterized in that it has a determination unit that determines whether or not it is, and an extraction unit that extracts the representative image from among the images determined not to be images obtained by imaging the section in the digestive tract through which the medical device has already passed. I assume.

 また、本発明の一態様に係る画像処理装置は、前記画像群に含まれる各画像が撮像された際の前記医療装置の移動方向を算出する算出部を備え、前記処理部は、前記移動方向に基づいて、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行うことを特徴とする。 The image processing apparatus according to an aspect of the present invention further includes a calculation unit that calculates the moving direction of the medical device when each image included in the image group is captured, and the processing unit is configured to calculate the moving direction. And processing for selecting a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract which the medical device has already passed.

 また、本発明の一態様に係る画像処理装置は、前記算出部は、前記画像群に含まれる各画像が撮像された際の前記医療装置の位置情報に基づいて前記移動方向を算出することを特徴とする。 Further, in the image processing device according to the aspect of the present invention, the calculation unit may calculate the movement direction based on position information of the medical device when each image included in the image group is captured. It features.

 また、本発明の一態様に係る画像処理装置は、前記代表画像を表示装置に表示させる表示制御部を備えることを特徴とする。 In addition, an image processing apparatus according to an aspect of the present invention includes a display control unit that causes the display device to display the representative image.

 また、本発明の一態様に係る画像処理装置は、前記医療装置は、カプセル型内視鏡であることを特徴とする。 In the image processing device according to one aspect of the present invention, the medical device is a capsule endoscope.

 また、本発明の一態様に係る画像処理装置は、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から選択された代表画像を表示装置に表示させる表示制御部を備えることを特徴とする。 Further, the image processing apparatus according to the aspect of the present invention is not an image obtained by imaging a section in the digestive tract through which the medical device has already passed, among images captured by the medical device introduced into the digestive tract. The display control unit is configured to display a representative image selected from the determined images on the display device.

 また、本発明の一態様に係る画像処理装置の作動方法は、処理部が、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理ステップを含むことを特徴とする。 Further, in the method of operating an image processing device according to one aspect of the present invention, a section in the digestive tract through which the medical device has already passed, out of a group of images captured by the medical device introduced into the digestive tract And a processing step of performing processing of selecting a representative image from among the images determined not to be captured images.

 また、本発明の一態様に係る画像処理装置の作動プログラムは、処理部が、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理ステップを画像処理装置に実行させることを特徴とする。 Further, in the operation program of the image processing device according to one aspect of the present invention, the processing unit is a section in the digestive tract in which the medical device has already passed among the image group captured by the medical device introduced into the digestive tract. It is characterized in that the image processing apparatus is caused to execute a processing step of selecting a representative image from among the images determined not to be captured images.

 本発明によれば、観察効率を向上させることができる画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラムを実現することができる。 According to the present invention, it is possible to realize an image processing apparatus capable of improving observation efficiency, an operation method of the image processing apparatus, and an operation program of the image processing apparatus.

図1は、本発明の実施の形態1に係る内視鏡システムを示す模式図である。FIG. 1 is a schematic view showing an endoscope system according to a first embodiment of the present invention. 図2は、図1に示す記録媒体が画像処理装置に接続された状態のブロック図である。FIG. 2 is a block diagram of the recording medium shown in FIG. 1 connected to the image processing apparatus. 図3は、図2に示した画像処理装置の動作を示すフローチャートである。FIG. 3 is a flowchart showing the operation of the image processing apparatus shown in FIG. 図4は、消化管内をカプセル型内視鏡が移動する様子を表す図である。FIG. 4 is a view showing the movement of the capsule endoscope in the digestive tract. 図5は、体内画像の一例を表す図である。FIG. 5 is a diagram illustrating an example of an in-vivo image. 図6は、体内画像の一例を表す図である。FIG. 6 is a diagram illustrating an example of an in-vivo image. 図7は、体内画像の一例を表す図である。FIG. 7 is a diagram illustrating an example of an in-vivo image. 図8は、実施の形態1の変形例2に係る画像処理装置の動作を示すフローチャートである。FIG. 8 is a flowchart showing the operation of the image processing apparatus according to the second modification of the first embodiment. 図9は、実施の形態2に係る画像処理装置の動作を示すフローチャートである。FIG. 9 is a flowchart showing the operation of the image processing apparatus according to the second embodiment. 図10は、消化管内をカプセル型内視鏡が移動する様子を表す図である。FIG. 10 is a view showing the movement of the capsule endoscope in the digestive tract. 図11は、実施の形態3に係る画像処理装置の動作を示すフローチャートである。FIG. 11 is a flowchart showing the operation of the image processing apparatus according to the third embodiment. 図12は、消化管内をカプセル型内視鏡が移動する様子を表す図である。FIG. 12 is a view showing the movement of the capsule endoscope in the digestive tract. 図13は、インターネット回線を経由して接続された処理装置に一部の処理を実行させる構成のブロック図である。FIG. 13 is a block diagram of a configuration that causes a processing device connected via the Internet to execute a part of processing.

 以下に、図面を参照して本発明に係る画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラムの実施の形態を説明する。なお、これらの実施の形態により本発明が限定されるものではない。本発明は、カプセル型内視鏡が撮像した画像に画像処理を施す画像処理装置、画像処理装置の作動方法、及び画像処理装置の作動プログラム一般に適用することができる。 Hereinafter, embodiments of an image processing apparatus, an operation method of the image processing apparatus, and an operation program of the image processing apparatus according to the present invention will be described with reference to the drawings. Note that the present invention is not limited by these embodiments. The present invention can be applied to an image processing apparatus that performs image processing on an image captured by a capsule endoscope, an operation method of the image processing apparatus, and an operation program of the image processing apparatus in general.

 また、図面の記載において、同一又は対応する要素には適宜同一の符号を付している。また、図面は模式的なものであり、各要素の寸法の関係、各要素の比率などは、現実と異なる場合があることに留意する必要がある。図面の相互間においても、互いの寸法の関係や比率が異なる部分が含まれている場合がある。 Further, in the description of the drawings, the same or corresponding elements are given the same reference numerals as appropriate. In addition, it should be noted that the drawings are schematic, and the relationship between dimensions of each element, the ratio of each element, and the like may differ from reality. Even between the drawings, there may be a case where the dimensional relationships and ratios differ from one another.

(実施の形態1)
 図1は、本発明の実施の形態1に係る内視鏡システムを示す模式図である。内視鏡システム1は、飲み込み型の医療装置としてのカプセル型内視鏡2を用いて、被検体100内部の体内画像を取得し、当該体内画像を医師等に観察させるシステムである。この内視鏡システム1は、図1に示すように、カプセル型内視鏡2の他、受信装置3と、画像処理装置4と、可搬型の記録媒体5と、入力装置6と、表示装置7と、を備える。
Embodiment 1
FIG. 1 is a schematic view showing an endoscope system according to a first embodiment of the present invention. The endoscope system 1 is a system that acquires an in-vivo image of the inside of the subject 100 using a capsule endoscope 2 as a swallow-type medical device and causes a doctor or the like to observe the in-vivo image. As shown in FIG. 1, the endoscope system 1 includes, in addition to the capsule endoscope 2, a receiving device 3, an image processing device 4, a portable recording medium 5, an input device 6, and a display device. And 7.

 記録媒体5は、受信装置3と画像処理装置4との間におけるデータの受け渡しを行うための可搬型の記録メディアであり、受信装置3及び画像処理装置4に対してそれぞれ着脱可能に構成されている。 The recording medium 5 is a portable recording medium for transferring data between the receiving device 3 and the image processing device 4 and is configured to be removable from the receiving device 3 and the image processing device 4 respectively. There is.

 カプセル型内視鏡2は、被検体100の臓器内部に導入可能な大きさに形成されたカプセル型の内視鏡装置であり、経口摂取等によって被検体100の臓器内部に導入され、蠕動運動等によって臓器内部を移動しつつ、体内画像を順次、撮像する。そして、カプセル型内視鏡2は、撮像することにより生成した画像データを順次、送信する。 The capsule endoscope 2 is a capsule endoscope device formed in a size that can be introduced into the organ of the subject 100, introduced into the organ of the subject 100 by oral intake or the like, The in-vivo images are sequentially taken while moving inside the organ by the like. Then, the capsule endoscope 2 sequentially transmits the image data generated by imaging.

 受信装置3は、複数の受信アンテナ3a~3hを備え、これら複数の受信アンテナ3a~3hのうち少なくとも一つを用いて被検体100内部のカプセル型内視鏡2からの画像データを受信する。そして、受信装置3は、当該受信装置3に挿着された記録媒体5内に、受信した画像データを蓄積する。なお、受信アンテナ3a~3hは、図1に示したように被検体100の体表上に配置されていてもよいし、被検体100に着用させるジャケットに配置されていてもよい。また、受信装置3が備える受信アンテナ数は、1つ以上であればよく、特に8つに限定されない。 The receiving device 3 includes a plurality of receiving antennas 3a to 3h, and receives image data from the capsule endoscope 2 in the subject 100 using at least one of the plurality of receiving antennas 3a to 3h. Then, the receiving device 3 accumulates the received image data in the recording medium 5 inserted into the receiving device 3. The receiving antennas 3a to 3h may be disposed on the body surface of the subject 100 as shown in FIG. 1, or may be disposed on a jacket worn by the subject 100. Further, the number of receiving antennas provided in the receiving device 3 may be one or more, and is not particularly limited to eight.

 図2は、図1に示す記録媒体が画像処理装置に接続された状態のブロック図である。図2に示すように、画像処理装置4は、リーダライタ41と、記憶部42と、制御部43と、を備える。 FIG. 2 is a block diagram of the recording medium shown in FIG. 1 connected to the image processing apparatus. As shown in FIG. 2, the image processing apparatus 4 includes a reader / writer 41, a storage unit 42, and a control unit 43.

 リーダライタ41は、外部から処理対象となる画像データを取得する画像取得部としての機能を有する。具体的には、リーダライタ41は、当該リーダライタ41に記録媒体5が挿着された際に、制御部43による制御のもと、記録媒体5に保存された画像データ(カプセル型内視鏡2により時系列順に撮像(取得)された複数の体内画像を含む体内画像群)を取り込む。また、リーダライタ41は、取り込んだ体内画像群を制御部43に転送する。そして、制御部43に転送された体内画像群は、記憶部42に記憶される。 The reader / writer 41 has a function as an image acquisition unit that acquires image data to be processed from the outside. Specifically, when the recording medium 5 is inserted into the reader / writer 41, the reader / writer 41 controls the control unit 43 to store image data stored in the recording medium 5 (capsule type endoscope 2. In-vivo image group including a plurality of in-vivo images captured (acquired) in chronological order in accordance with step 2). Also, the reader / writer 41 transfers the captured in-vivo image group to the control unit 43. Then, the in-vivo image group transferred to the control unit 43 is stored in the storage unit 42.

 記憶部42は、制御部43から転送された体内画像群を記憶する。また、記憶部42は、制御部43が実行する各種プログラム(画像処理プログラムを含む)や制御部43の処理に必要な情報等を記憶する。記憶部42は、フラッシュメモリ、ROM(Read Only Memory)及びRAM(Random Access Memory)といった各種ICメモリ、及び内蔵若しくはデータ通信端子により電気的に接続されたハードディスク等によって実現される。 The storage unit 42 stores the in-vivo image group transferred from the control unit 43. The storage unit 42 also stores various programs (including an image processing program) executed by the control unit 43 and information necessary for processing of the control unit 43. The storage unit 42 is realized by various IC memories such as a flash memory, a read only memory (ROM) and a random access memory (RAM), and a hard disk electrically connected by a built-in or data communication terminal.

 制御部43は、CPU(Central Processing Unit)等の汎用プロセッサやASIC(Application Specific Integrated Circuit)等の特定の機能を実行する各種演算回路等の専用プロセッサを用いて構成されている。制御部43は、記憶部42に記憶されたプログラム(画像処理プログラムを含む)を読み出し、当該プログラムに従って内視鏡システム1全体の動作を制御する。制御部43は、図2に示すように、処理部431と、表示制御部432と、を有する。 The control unit 43 is configured using a general-purpose processor such as a central processing unit (CPU) or a dedicated processor such as various arithmetic circuits that execute a specific function such as an application specific integrated circuit (ASIC). The control unit 43 reads a program (including an image processing program) stored in the storage unit 42, and controls the entire operation of the endoscope system 1 according to the program. The control unit 43 has a processing unit 431 and a display control unit 432, as shown in FIG.

 処理部431は、カプセル型内視鏡2の移動方向に基づいて、消化管内に導入されるカプセル型内視鏡2によって撮像された画像群のうち、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う。 The processing unit 431 is a digest that the capsule endoscope 2 has already passed among the image group captured by the capsule endoscope 2 introduced into the digestive tract based on the moving direction of the capsule endoscope 2. A process of selecting a representative image from among the images determined not to be an image obtained by imaging a section in the duct is performed.

 処理部431は、図2に示すように、抽出部4311と、算出部4312と、判定部4313と、選択部4314と、を有する。 As shown in FIG. 2, the processing unit 431 includes an extraction unit 4311, a calculation unit 4312, a determination unit 4313, and a selection unit 4314.

 抽出部4311は、画像群から代表画像の候補である候補画像を抽出する。候補画像は、カプセル型内視鏡2が消化管内において大きく動いた際に撮像された画像である。抽出部4311は、時系列順に並べられた画像群の前後の画像を比較して類似度を算出し、算出した類似度が所定の閾値より小さい場合にその画像を候補画像に設定する。なお、候補画像を設定するにあたり、画像の動きベクトルを用いたシーンチェンジ判定などの公知の技術を用いてもよい。 The extraction unit 4311 extracts a candidate image that is a candidate for a representative image from the image group. The candidate image is an image captured when the capsule endoscope 2 moves largely in the digestive tract. The extraction unit 4311 compares the images before and after the image group arranged in chronological order to calculate the similarity, and sets the image as a candidate image when the calculated similarity is smaller than a predetermined threshold. In setting a candidate image, a known technique such as scene change determination using a motion vector of an image may be used.

 算出部4312は、画像群に含まれる各画像が撮像された際のカプセル型内視鏡2の位置情報に基づいて移動方向を算出する。具体的には、算出部4312は、受信装置3から受信した受信アンテナ3a~3hにおける受信信号の信号強度からカプセル型内視鏡2の位置情報を画像群に含まれる画像ごとに算出する。さらに、算出部4312は、時系列順に並べられた画像群の前後の画像の位置情報を比較し、各画像が時系列順に1つ前の画像から移動した方向(移動方向)を算出する。 The calculating unit 4312 calculates the moving direction based on the position information of the capsule endoscope 2 when each image included in the image group is captured. Specifically, the calculation unit 4312 calculates position information of the capsule endoscope 2 for each image included in the image group from the signal strengths of the reception signals at the reception antennas 3a to 3h received from the reception device 3. Furthermore, the calculating unit 4312 compares position information of images before and after the image group arranged in chronological order, and calculates a direction (moving direction) in which each image moves from the previous image in chronological order.

 判定部4313は、候補画像に対して、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像であるか否かを判定する。 The determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed.

 選択部4314は、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像ではないと判定された候補画像を代表画像に選択する。 The selection unit 4314 selects, as a representative image, a candidate image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed.

 表示制御部432は、記憶部42に記憶されている画像に所定の画像処理を施し、表示装置7における画像の表示レンジに応じたデータの間引きや、階調処理などの所定の処理を施した後、代表画像を表示装置7に表示させる。 The display control unit 432 performs predetermined image processing on the image stored in the storage unit 42 and performs predetermined processing such as thinning of data according to the display range of the image on the display device 7 and gradation processing. After that, the representative image is displayed on the display device 7.

 入力装置6は、キーボード及びマウス等を用いて構成されており、ユーザによる操作を受け付ける。 The input device 6 is configured using a keyboard, a mouse, and the like, and receives an operation by the user.

 表示装置7は、液晶ディスプレイ等を用いて構成されており、表示制御部432による制御のもと、代表画像等を含む画像を表示する。 The display device 7 is configured using a liquid crystal display or the like, and displays an image including a representative image and the like under the control of the display control unit 432.

 次に、画像処理装置4が代表画像を選択する処理について説明する。図3は、図2に示した画像処理装置の動作を示すフローチャートである。図3に示すように、はじめに、抽出部4311は、カプセル型内視鏡2が撮像し、記録媒体5を経由して記憶部42に記憶された画像群から候補画像を抽出する(ステップS1)。 Next, processing in which the image processing device 4 selects a representative image will be described. FIG. 3 is a flowchart showing the operation of the image processing apparatus shown in FIG. As shown in FIG. 3, first, the extraction unit 4311 extracts a candidate image from the image group stored in the storage unit 42 by the capsule endoscope 2 via the recording medium 5 (step S1). .

 続いて、算出部4312は、基準方向を算出する(ステップS2)。図4は、消化管内をカプセル型内視鏡が移動する様子を表す図である。図4に示すようにカプセル型内視鏡2が消化管内を移動する場合に、カプセル型内視鏡2が肛門に向かって進む方向が基準方向Dである。従って、消化管が曲がっている部分では、基準方向Dも消化管が延在する方向に沿って変化する。基準方向Dは、例えば各画像の前後数枚の画像の移動方向を平均することにより算出することができる。 Subsequently, the calculating unit 4312 calculates a reference direction (step S2). FIG. 4 is a view showing the movement of the capsule endoscope in the digestive tract. When the capsule endoscope 2 moves in the digestive tract as shown in FIG. 4, the direction in which the capsule endoscope 2 moves toward the anus is the reference direction D. Therefore, in the portion where the digestive tract is bent, the reference direction D also changes along the extension direction of the digestive tract. The reference direction D can be calculated, for example, by averaging the moving directions of several images before and after each image.

 そして、処理部431は、i=0として初期値を設定する(ステップS3)。 Then, the processing unit 431 sets an initial value as i = 0 (step S3).

 さらに、処理部431は、iをインクリメント(i=i+1)する(ステップS4)。 Furthermore, the processing unit 431 increments i (i = i + 1) (step S4).

 続いて、算出部4312は、i番目の画像の移動方向を算出する(ステップS5)。 Subsequently, the calculation unit 4312 calculates the movement direction of the ith image (step S5).

 その後、判定部4313は、候補画像に対して、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像であるか否かを判定する。具体的には、判定部4313は、i番目の画像の移動方向Aiと基準方向Dとを比較し、i番目の画像の移動方向Aiが正であるか否かを判定する(ステップS6)。なお、判定部4313は、i番目の画像の移動方向Aiと基準方向Dとのなす角が90度未満であれば正と判定し、90度以上であれば負と判定する。 Thereafter, the determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed. Specifically, the determination unit 4313 compares the movement direction Ai of the ith image with the reference direction D, and determines whether the movement direction Ai of the ith image is positive (step S6). The determining unit 4313 determines that the angle between the movement direction Ai of the i-th image and the reference direction D is less than 90 degrees, and determines that the angle is more than 90 degrees.

 図4において、各矢印(A1、A2、・・・)は、各画像が撮像された際の移動方向を表す。図4では、1、2、n+2番目の画像の移動方向A1、A2、An+2は正であり、n、n+1番目の画像の移動方向An、An+1は負である。 In FIG. 4, each arrow (A 1, A 2,...) Indicates the moving direction when each image is captured. In FIG. 4, the moving directions A1, A2 and An + 2 of the 1, 2, and n + 2-th images are positive, and the moving directions An and An + 1 of the n and n + 1-th images are negative.

 判定部4313が、移動方向が正であると判定した場合(ステップS6:Yes)、選択部4314は、その候補画像(i番目の画像)を代表画像に選択する(ステップS7)。一方、判定部4313が、移動方向が正ではないと判定した場合(ステップS6:No)、ステップS8に進む。 When the determining unit 4313 determines that the moving direction is positive (step S6: Yes), the selecting unit 4314 selects the candidate image (i-th image) as a representative image (step S7). On the other hand, when the determining unit 4313 determines that the moving direction is not positive (step S6: No), the process proceeds to step S8.

 そして、処理部431は、i>Nであるか否かを判定する(ステップS8)。i>Nではない場合(ステップS8:No)、ステップS4に戻り、i>Nである場合、一連の処理が終了する。 Then, the processing unit 431 determines whether i> N is satisfied (step S8). If i> N is not satisfied (step S8: No), the process returns to step S4, and if i> N, the series of processing ends.

 以上説明したように、実施の形態1によれば、候補画像のうち、移動方向が正である画像は代表画像に設定されるのに対して、移動方向が負であると判定された画像は代表画像に選択されない。すなわち、消化管内においてカプセル型内視鏡2が戻り、同じ範囲を重複して撮像した画像は代表画像から除外される。その結果、医師等の医療従事者は、同じ範囲を重複して撮像した画像を観察することがなく、観察効率が向上する。 As described above, according to the first embodiment, among the candidate images, an image whose moving direction is positive is set as a representative image, whereas an image which is determined as a negative moving direction is Not selected as a representative image. That is, the capsule endoscope 2 returns in the digestive tract, and an image captured in the same range in an overlapping manner is excluded from the representative image. As a result, a medical worker such as a doctor does not observe an image captured by overlapping the same range, and the observation efficiency is improved.

(変形例1)
 実施の形態1では、カプセル型内視鏡2の位置情報を用いてカプセル型内視鏡2の移動方向を算出したが、カプセル型内視鏡2が撮像した画像を用いてカプセル型内視鏡2の移動方向を算出してもよい。
(Modification 1)
In the first embodiment, the moving direction of the capsule endoscope 2 is calculated using the position information of the capsule endoscope 2, but the capsule endoscope using the image captured by the capsule endoscope 2 The moving direction of 2 may be calculated.

 図5~図7は、体内画像の一例を表す図である。図5~図7に示すように、算出部4312は、画像内に特徴点Bを設定する。特徴点Bは、例えば消化管内のひだや凹凸の端部である。図5に示す状態から、図6に示すように、特徴点Bが画像の外側に移動した場合、算出部4312は、カプセル型内視鏡2の移動方向を正と算出する。一方、図5に示す状態から、図7に示すように、特徴点Bが画像の内側に移動した場合、算出部4312は、カプセル型内視鏡2の移動方向を負と算出する。 5 to 7 illustrate an example of an in-vivo image. As shown in FIGS. 5 to 7, the calculating unit 4312 sets feature points B in the image. The feature point B is, for example, an end of a fold or unevenness in the digestive tract. When the feature point B is moved to the outside of the image from the state shown in FIG. 5 as shown in FIG. 6, the calculator 4312 calculates the moving direction of the capsule endoscope 2 as positive. On the other hand, when the feature point B is moved to the inside of the image as shown in FIG. 7 from the state shown in FIG. 5, the calculating unit 4312 calculates the moving direction of the capsule endoscope 2 as negative.

 このように、カプセル型内視鏡2の移動方向の算出方法は特に限定されない。例えば、カプセル型内視鏡2が有する速度センサや加速度センサが検出した速度情報や加速度情報に基づいて、カプセル型内視鏡2の移動方向を算出してもよい。 Thus, the method of calculating the moving direction of the capsule endoscope 2 is not particularly limited. For example, the moving direction of the capsule endoscope 2 may be calculated based on the speed information and the acceleration information detected by the speed sensor and the acceleration sensor of the capsule endoscope 2.

(変形例2)
 実施の形態1の変形例2に係る画像処理装置4において、判定部4313は、画像群に含まれる各画像に対して、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像であるか否かを判定する。また、抽出部4311は、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像ではないと判定された画像の中から代表画像を抽出する。
(Modification 2)
In the image processing apparatus 4 according to the second modification of the first embodiment, the determination unit 4313 is an image obtained by imaging a section in the digestive tract in which the capsule endoscope 2 has already passed, with respect to each image included in the image group It is determined whether the In addition, the extraction unit 4311 extracts a representative image from the image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed.

 図8は、実施の形態1の変形例2に係る画像処理装置の動作を示すフローチャートである。図8に示すように、変形例2では、実施の形態1と異なり、ステップS1の処理を行わず、ステップS2の処理から開始する。そして、ステップS2からステップS6までの処理を実施の形態1と同様に行う。ただし、ステップS6において、判定部4313は、画像群に含まれる全ての画像に対して、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像であるか否かを判定する。 FIG. 8 is a flowchart showing the operation of the image processing apparatus according to the second modification of the first embodiment. As shown in FIG. 8, in the second modification, unlike the first embodiment, the process of step S1 is not performed, and the process starts from the process of step S2. Then, the processing from step S2 to step S6 is performed as in the first embodiment. However, in step S6, the determination unit 4313 determines whether or not an image of a section in the digestive tract in which the capsule endoscope 2 has already passed is captured for all the images included in the image group.

 続いて、選択部4314は、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像ではないと判定された画像を表示候補画像に選択する(ステップS11)。 Subsequently, the selecting unit 4314 selects an image determined not to be an image obtained by imaging the section in the digestive tract through which the capsule endoscope 2 has already passed as a display candidate image (step S11).

 その後、実施の形態1と同様にステップ8の処理が行われ、全ての画像に対してステップS5~ステップS11の処理が行われる。 After that, the process of step 8 is performed as in the first embodiment, and the processes of steps S5 to S11 are performed on all the images.

 そして、抽出部4311は、表示候補画像の中から代表画像を抽出する(ステップS12)。 Then, the extraction unit 4311 extracts a representative image from the display candidate images (step S12).

 以上説明したように、実施の形態1の処理と順番を入れ替えてもよい。変形例2によれば、実施の形態1と同様に、観察効率を向上させることができる画像処理装置を実現することができる。 As described above, the order of the process of the first embodiment may be switched. According to the second modification, as in the first embodiment, an image processing apparatus capable of improving the observation efficiency can be realized.

(実施の形態2)
 実施の形態2に係る画像処理装置4は、処理部431における処理が実施の形態1と異なるが、画像処理装置4の構成は、実施の形態1と同様であってよいので、適宜説明を省略する。
Second Embodiment
The image processing apparatus 4 according to the second embodiment is different from that of the first embodiment in the processing in the processing unit 431, but the configuration of the image processing apparatus 4 may be the same as that of the first embodiment. Do.

 図9は、実施の形態2に係る画像処理装置の動作を示すフローチャートである。図9に示すように、ステップS1~ステップS4まで実施の形態1と同様の処理を行う。 FIG. 9 is a flowchart showing the operation of the image processing apparatus according to the second embodiment. As shown in FIG. 9, the same processing as in the first embodiment is performed from step S1 to step S4.

 続いて、算出部4312は、i番目の画像の移動方向及び移動量を算出する(ステップS21)。 Subsequently, the calculation unit 4312 calculates the movement direction and the movement amount of the ith image (step S21).

 その後、判定部4313は、候補画像に対して、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像であるか否かを判定する(ステップS6)。 Thereafter, the determining unit 4313 determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed (step S6).

 判定部4313が、移動方向が正ではないと判定した場合(ステップS6:No)、処理部431は、逆方向への移動量を記憶する(ステップS22)。具体的には、処理部431は、算出部4312が算出した移動量を記憶部42に記憶する。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 When the determining unit 4313 determines that the moving direction is not positive (step S6: No), the processing unit 431 stores the amount of movement in the reverse direction (step S22). Specifically, the processing unit 431 stores the movement amount calculated by the calculation unit 4312 in the storage unit 42. Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 一方、判定部4313が、移動方向が正であると判定した場合(ステップS6:Yes)、処理部431は、記憶部42の記憶を読み出し、逆方向への移動量の記憶があるか否かを判定する(ステップS23)。 On the other hand, when the determination unit 4313 determines that the movement direction is positive (step S6: Yes), the processing unit 431 reads the storage of the storage unit 42 and determines whether or not there is storage of the movement amount in the reverse direction. Is determined (step S23).

 判定部4313が、逆方向への移動量の記憶があると判定した場合(ステップS23:Yes)、処理部431は、正方向の移動量が記憶部42に記憶された逆方向の移動量を超えたか否かを判定する(ステップS24)。 If the determination unit 4313 determines that there is storage of the backward movement amount (step S23: Yes), the processing unit 431 determines that the forward movement amount is the reverse movement amount stored in the storage unit 42. It is determined whether it has exceeded (step S24).

 図10は、消化管内をカプセル型内視鏡が移動する様子を表す図である。図10において、各矢印(C1、C2、・・・)の方向は、各画像が撮像された際の移動方向を表し、各矢印の長さは、各画像が撮像された際の移動量を表す。図10に示すように、n番目、n+1番目の画像が撮像された際に、カプセル型内視鏡2が逆方向に移動量E1だけ移動したとする。この場合、n+2番目の画像では、正方向の移動量が移動量E1を超えていないので(ステップS24:No)、ステップS8に進む。 FIG. 10 is a view showing the movement of the capsule endoscope in the digestive tract. In FIG. 10, the direction of each arrow (C1, C2,...) Indicates the movement direction when each image is captured, and the length of each arrow indicates the movement amount when each image is captured. Represent. As shown in FIG. 10, it is assumed that when the n-th and n + 1-th images are captured, the capsule endoscope 2 moves in the reverse direction by the movement amount E1. In this case, in the (n + 2) -th image, the amount of movement in the positive direction does not exceed the amount of movement E1 (step S24: No), the process proceeds to step S8.

 一方、n+3番目の画像では、正方向の移動量E2が移動量E1を超えているので(ステップS24:Yes)、処理部431が、逆方向への移動量の記憶部42への記憶をリセットし(ステップS25)、選択部4314が、その候補画像(n+3番目の画像)を代表画像に選択する(ステップS7)。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 On the other hand, in the (n + 3) th image, the amount of movement E2 in the forward direction exceeds the amount of movement E1 (step S24: Yes), the processing unit 431 resets the storage of the amount of movement in the reverse direction to the storage unit 42. (Step S25), and the selection unit 4314 selects the candidate image (the n + 3rd image) as a representative image (Step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 ステップS23において、判定部4313が、逆方向への移動量の記憶がないと判定した場合(ステップS23:No)、処理部431は、選択部4314が、その候補画像(i番目の画像)を代表画像に選択する(ステップS7)。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 In step S23, when the determination unit 4313 determines that there is no storage of the movement amount in the reverse direction (step S23: No), the processing unit 431 selects the candidate image (i-th image) as the selection unit 4314. A representative image is selected (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 以上説明したように、実施の形態2によれば、処理部431が移動方向及び移動量に基づいて、代表画像を選択するため、正方向に移動していてもカプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像(図10のn+2番目の画像)も代表画像から除外される。その結果、実施の形態2によれば、実施の形態1よりさらに観察効率が向上する。 As described above, according to the second embodiment, the processing unit 431 selects the representative image based on the movement direction and the movement amount, so the capsule endoscope 2 has already been moved even if it has moved in the forward direction. The image (the n + 2th image in FIG. 10) obtained by imaging the section in the digestive tract that has passed is also excluded from the representative image. As a result, according to the second embodiment, the observation efficiency is further improved compared to the first embodiment.

(実施の形態3)
 実施の形態3に係る画像処理装置4は、処理部431における処理が実施の形態1と異なるが、画像処理装置4の構成は、実施の形態1と同様であってよいので、適宜説明を省略する。
Third Embodiment
The image processing apparatus 4 according to the third embodiment is different from that of the first embodiment in the processing in the processing unit 431, but the configuration of the image processing apparatus 4 may be the same as that of the first embodiment. Do.

 図11は、実施の形態3に係る画像処理装置の動作を示すフローチャートである。図11に示すように、ステップS1~ステップS6まで実施の形態2と同様の処理を行う。 FIG. 11 is a flowchart showing the operation of the image processing apparatus according to the third embodiment. As shown in FIG. 11, the same processes as in the second embodiment are performed from step S1 to step S6.

 判定部4313が、移動方向が正ではない判定した場合(ステップS6:No)、処理部431は、逆方向への移動開始位置を記憶する(ステップS31)。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 When the determining unit 4313 determines that the moving direction is not positive (step S6: No), the processing unit 431 stores the moving start position in the reverse direction (step S31). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 一方、判定部4313が、移動方向が正であると判定した場合(ステップS6:Yes)、処理部431は、記憶部42の記憶を読み出し、逆方向への移動開始位置の記憶があるか否かを判定する(ステップS32)。 On the other hand, when the determination unit 4313 determines that the moving direction is positive (step S6: Yes), the processing unit 431 reads the storage of the storage unit 42 and determines whether or not there is a storage of the movement start position in the reverse direction. It is determined (step S32).

 判定部4313が、逆方向への移動開始位置の記憶があると判定した場合(ステップS32:Yes)、処理部431は、カプセル型内視鏡2の位置が記憶部42に記憶された逆方向への移動開始位置を超えたか否かを判定する(ステップS33)。 If the determination unit 4313 determines that there is storage of the movement start position in the reverse direction (step S32: Yes), the processing unit 431 determines that the position of the capsule endoscope 2 is stored in the storage unit 42 in the reverse direction. It is determined whether it has exceeded the movement start position to (step S33).

 図12は、消化管内をカプセル型内視鏡が移動する様子を表す図である。図12において、各矢印(F1、F2、・・・)の方向は、各画像が撮像された際の移動方向を表し、各矢印の長さは、各画像が撮像された際の移動量を表す。図12に示すように、記憶部42には、逆方向への移動開始位置P0が記憶されている。n番目、n+1番目の画像が撮像された際に、カプセル型内視鏡2が逆方向に移動したとする。この場合、n+2番目の画像では、カプセル型内視鏡2の位置P1が移動開始位置P0を超えていないので(ステップS33:No)、ステップS8に進む。 FIG. 12 is a view showing the movement of the capsule endoscope in the digestive tract. In FIG. 12, the direction of each arrow (F1, F2,...) Indicates the movement direction when each image is captured, and the length of each arrow indicates the movement amount when each image is captured. Represent. As shown in FIG. 12, the storage unit 42 stores the movement start position P0 in the reverse direction. It is assumed that the capsule endoscope 2 is moved in the opposite direction when the nth and n + 1th images are captured. In this case, in the (n + 2) -th image, the position P1 of the capsule endoscope 2 does not exceed the movement start position P0 (step S33: No), the process proceeds to step S8.

 一方、n+3番目の画像では、カプセル型内視鏡2の位置P2が移動開始位置P0を超えているので(ステップS33:Yes)、処理部431が、逆方向への移動開始位置の記憶部42への記憶をリセットし(ステップS34)、選択部4314が、その候補画像(n+3番目の画像)を代表画像に選択する(ステップS7)。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 On the other hand, in the (n + 3) th image, the position P2 of the capsule endoscope 2 exceeds the movement start position P0 (step S33: Yes), the processing unit 431 stores the movement start position storage unit 42 in the reverse direction. The memory in the memory is reset (step S34), and the selecting unit 4314 selects the candidate image (the n + 3rd image) as a representative image (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 ステップS32において、判定部4313が、逆方向への移動開始位置の記憶がないと判定した場合(ステップS32:No)、処理部431は、選択部4314が、その候補画像(i番目の画像)を代表画像に選択する(ステップS7)。その後、ステップS8に進み、実施の形態1と同様の処理が行われる。 In step S32, when the determination unit 4313 determines that there is no storage of the movement start position in the reverse direction (step S32: No), the processing unit 431 determines that the candidate image (i-th image) is the candidate image Is selected as a representative image (step S7). Thereafter, the process proceeds to step S8, and the same process as that of the first embodiment is performed.

 以上説明したように、実施の形態3によれば、実施の形態2度同様に、実施の形態1よりさらに観察効率が向上する。 As described above, according to the third embodiment, as in the second embodiment, the observation efficiency is further improved than the first embodiment.

 なお、実施の形態2及び実施の形態3においても、実施の形態1の変形例1と同様に、カプセル型内視鏡2が撮像した画像や、速度センサ、加速度センサが検出した値に基づいて移動方向及び移動量を算出してもよい。 Also in the second embodiment and the third embodiment, as in the first modification of the first embodiment, based on the image captured by the capsule endoscope 2, the value detected by the speed sensor, and the acceleration sensor. The movement direction and the movement amount may be calculated.

 また、上述した実施の形態において、画像処理装置が処理部を有する構成を説明したがこれに限られない。図13は、インターネット回線を経由して接続された処理装置に一部の処理を実行させる構成のブロック図である。図13に示すように、インターネット回線を経由して接続された処理装置8Aに処理部が行っていた処理の少なくとも一部を実行させてもよい。また、複数の処理装置(サーバ群)を含むクラウド上において処理部が行っていた処理の少なくとも一部を実行させてもよい。この場合、画像処理装置4Aの制御部43Aは、処理部を有しなくてもよい。また、表示制御部432Aは、消化管内に導入されるカプセル型内視鏡2によって撮像された画像群のうち、カプセル型内視鏡2が既に通過した消化管内の区間を撮像した画像ではないと判定した画像の中から選択された代表画像を表示装置7に表示させる。 In the above-described embodiment, the configuration in which the image processing apparatus has the processing unit has been described, but the present invention is not limited to this. FIG. 13 is a block diagram of a configuration that causes a processing device connected via the Internet to execute a part of processing. As shown in FIG. 13, at least a part of the processing performed by the processing unit may be executed by the processing device 8A connected via the Internet line. Further, at least a part of the processing performed by the processing unit may be performed on a cloud including a plurality of processing devices (server groups). In this case, the control unit 43A of the image processing apparatus 4A may not have a processing unit. In addition, the display control unit 432A is not an image obtained by imaging a section in the digestive tract through which the capsule endoscope 2 has already passed, out of the image group imaged by the capsule endoscope 2 introduced into the digestive tract. The representative image selected from the determined images is displayed on the display device 7.

 さらなる効果や変形例は、当業者によって容易に導き出すことができる。よって、本発明のより広範な態様は、以上のように表し、かつ記述した特定の詳細及び代表的な実施の形態に限定されるものではない。従って、添付のクレーム及びその均等物によって定義される総括的な発明の概念の精神又は範囲から逸脱することなく、様々な変更が可能である。 Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the invention are not limited to the specific details and representative embodiments presented and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

 1 内視鏡システム
 2 カプセル型内視鏡
 3 受信装置
 3a~3h 受信アンテナ
 4、4A 画像処理装置
 5 記録媒体
 6 入力装置
 7 表示装置
 8A 処理装置
 41 リーダライタ
 42 記憶部
 43、43A 制御部
 100 被検体
 431 処理部
 432、432A 表示制御部
 4311 抽出部
 4312 算出部
 4313 判定部
 4314 選択部
Reference Signs List 1 endoscope system 2 capsule endoscope 3 receiving device 3a to 3h receiving antenna 4 and 4A image processing device 5 recording medium 6 input device 7 display device 8A processing device 41 reader / writer 42 storage unit 43, 43A control unit 100 Sample 431 Processing unit 432, 432A Display control unit 4311 Extraction unit 4312 Calculation unit 4313 Determination unit 4314 Selection unit

Claims (10)

 消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理部を備えることを特徴とする画像処理装置。 A process of selecting a representative image from among images determined not to be images obtained by imaging a section in the digestive tract through which the medical device has already passed, among images captured by a medical device introduced into the digestive tract An image processing apparatus comprising a processing unit.  前記処理部は、
 前記画像群から前記代表画像の候補である候補画像を抽出する抽出部と、
 前記候補画像に対して、前記医療装置が既に通過した前記消化管内の区間を撮像した画像であるか否かを判定する判定部と、
 前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定された候補画像を前記代表画像に選択する選択部と、
 を有することを特徴とする請求項1に記載の画像処理装置。
The processing unit is
An extraction unit that extracts candidate images that are candidates for the representative image from the image group;
A determination unit that determines whether or not the candidate image is an image obtained by imaging a section in the digestive tract already passed by the medical device;
A selection unit that selects, as the representative image, a candidate image determined not to be an image obtained by imaging the section in the digestive tract through which the medical device has already passed;
The image processing apparatus according to claim 1, comprising:
 前記処理部は、
 前記画像群に含まれる各画像に対して、前記医療装置が既に通過した前記消化管内の区間を撮像した画像であるか否かを判定する判定部と、
 前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定された画像の中から前記代表画像を抽出する抽出部と、
 を有することを特徴とする請求項1に記載の画像処理装置。
The processing unit is
A determination unit that determines whether or not each image included in the image group is an image obtained by imaging a section in the digestive tract through which the medical device has already passed;
An extraction unit configured to extract the representative image from among images determined not to be images obtained by imaging the section in the digestive tract through which the medical device has already passed;
The image processing apparatus according to claim 1, comprising:
 前記画像群に含まれる各画像が撮像された際の前記医療装置の移動方向を算出する算出部を備え、
 前記処理部は、前記移動方向に基づいて、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行うことを特徴とする請求項1~3のいずれか1つに記載の画像処理装置。
A calculation unit that calculates the moving direction of the medical device when each image included in the image group is captured;
The processing unit is characterized by performing processing of selecting a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract which the medical device has already passed based on the moving direction. The image processing apparatus according to any one of claims 1 to 3.
 前記算出部は、前記画像群に含まれる各画像が撮像された際の前記医療装置の位置情報に基づいて前記移動方向を算出することを特徴とする請求項4に記載の画像処理装置。 The image processing apparatus according to claim 4, wherein the calculation unit calculates the movement direction based on position information of the medical device when each image included in the image group is captured.  前記代表画像を表示装置に表示させる表示制御部を備えることを特徴とする請求項1~5のいずれか1つに記載の画像処理装置。 The image processing apparatus according to any one of claims 1 to 5, further comprising a display control unit configured to display the representative image on a display device.  前記医療装置は、カプセル型内視鏡であることを特徴とする請求項1~6のいずれか1つに記載の画像処理装置。 The image processing apparatus according to any one of claims 1 to 6, wherein the medical device is a capsule endoscope.  消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から選択された代表画像を表示装置に表示させる表示制御部を備えることを特徴とする画像処理装置。 Display a representative image selected from among images determined not to be images obtained by imaging a section in the digestive tract through which the medical device has already passed, among images captured by a medical device introduced into the digestive tract An image processing apparatus comprising a display control unit for displaying  処理部が、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理ステップを含むことを特徴とする画像処理装置の作動方法。 The processing unit selects a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract through which the medical device has already passed, among the images captured by the medical device introduced into the digestive tract A method of operating an image processing apparatus comprising the steps of:  処理部が、消化管内に導入される医療装置によって撮像された画像群のうち、前記医療装置が既に通過した前記消化管内の区間を撮像した画像ではないと判定した画像の中から代表画像を選択する処理を行う処理ステップを画像処理装置に実行させることを特徴とする画像処理装置の作動プログラム。 The processing unit selects a representative image from among the images determined not to be images obtained by imaging the section in the digestive tract through which the medical device has already passed, among the images captured by the medical device introduced into the digestive tract An operation program of an image processing apparatus that causes an image processing apparatus to execute a processing step of performing processing.
PCT/JP2018/030990 2017-09-05 2018-08-22 Image processing device, image processing device operation method, and image processing device operation program Ceased WO2019049666A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017170533 2017-09-05
JP2017-170533 2017-09-05

Publications (1)

Publication Number Publication Date
WO2019049666A1 true WO2019049666A1 (en) 2019-03-14

Family

ID=65634025

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/030990 Ceased WO2019049666A1 (en) 2017-09-05 2018-08-22 Image processing device, image processing device operation method, and image processing device operation program

Country Status (1)

Country Link
WO (1) WO2019049666A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110004059A1 (en) * 2008-07-09 2011-01-06 Innurvation, Inc. Displaying Image Data From A Scanner Capsule
JP2013183912A (en) * 2012-03-08 2013-09-19 Olympus Corp Image summarization device and program
WO2016047190A1 (en) * 2014-09-22 2016-03-31 オリンパス株式会社 Image display device, image display method, and image display program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110004059A1 (en) * 2008-07-09 2011-01-06 Innurvation, Inc. Displaying Image Data From A Scanner Capsule
JP2013183912A (en) * 2012-03-08 2013-09-19 Olympus Corp Image summarization device and program
WO2016047190A1 (en) * 2014-09-22 2016-03-31 オリンパス株式会社 Image display device, image display method, and image display program

Similar Documents

Publication Publication Date Title
US8693785B2 (en) Image matching devices and image matching methods thereof
JP7614268B2 (en) Information processing device, information processing method, and program
US8830307B2 (en) Image display apparatus
JP6478654B2 (en) Imaging apparatus and control method thereof
JP4891636B2 (en) Image analysis device
US11055865B2 (en) Image acquisition device and method of operating image acquisition device
JP2018151748A (en) Image processing device, image processing method, template generation device, object recognition processing device, and program
US20210004961A1 (en) Image processing apparatus, capsule endoscope system, method of operating image processing apparatus, and computer-readable storage medium
WO2009104316A1 (en) Image processing device and image processing program
Gadermayr et al. Shape curvature histogram: A shape feature for celiac disease diagnosis
JP2012254221A (en) Image processing apparatus, method for controlling the same, and program
JP6530432B2 (en) Image processing apparatus, image processing method and program
CN114785948B (en) Endoscope focusing method and device, endoscope image processor and readable storage medium
WO2019049666A1 (en) Image processing device, image processing device operation method, and image processing device operation program
WO2019003597A1 (en) Image processing device, capsule endoscope system, method for operating image processing device, and program for operating image processing device
JP7100505B2 (en) Image processing device, operation method of image processing device, and operation program of image processing device
JP6576179B2 (en) Image processing apparatus, image processing method, and program
US20210290047A1 (en) Image processing apparatus, method of operating image processing apparatus, and non-transitory computer readable recording medium
WO2019159415A1 (en) Reading system
JP5408850B2 (en) Image analysis apparatus and image analysis program
JP2018092507A (en) Image processing apparatus, image processing method, and program
JP2007282906A (en) MEDICAL IMAGE PROCESSING METHOD, DEVICE THEREOF, AND PROGRAM
EP2375723A2 (en) Imaging apparatus and program
JP6684947B2 (en) Reading system, reading device, program, and storage medium
JP6716897B2 (en) Operation detection method, operation detection device, and operation detection program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18853666

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18853666

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP