[go: up one dir, main page]

WO2017115442A1 - Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image - Google Patents

Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image Download PDF

Info

Publication number
WO2017115442A1
WO2017115442A1 PCT/JP2015/086569 JP2015086569W WO2017115442A1 WO 2017115442 A1 WO2017115442 A1 WO 2017115442A1 JP 2015086569 W JP2015086569 W JP 2015086569W WO 2017115442 A1 WO2017115442 A1 WO 2017115442A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image data
display
processing apparatus
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2015/086569
Other languages
English (en)
Japanese (ja)
Inventor
岩城　秀和
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Priority to PCT/JP2015/086569 priority Critical patent/WO2017115442A1/fr
Priority to JP2017558835A priority patent/JPWO2017115442A1/ja
Publication of WO2017115442A1 publication Critical patent/WO2017115442A1/fr
Priority to US16/011,707 priority patent/US20180307933A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10068—Endoscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Definitions

  • the present invention relates to an image processing apparatus, an image processing method, and an image processing program for generating an image signal by performing signal processing on an imaging signal generated by an imaging element.
  • the medical endoscope apparatus is inserted into a subject such as a patient by inserting a flexible insertion portion having an elongated shape provided with an imaging element having a plurality of pixels at the tip, Since an in-vivo image (subject image) in a subject can be acquired without incising the subject, the burden on the subject is small, and the spread is increasing.
  • information indicating a region of interest such as a lesion detection result is displayed on the observation screen as a result of image analysis.
  • the information indicating the attention area is displayed by being superimposed on the attention area on the subject image at a predetermined position by a predetermined method (for example, see Patent Document 1).
  • a predetermined method for example, see Patent Document 1
  • the mark is superimposed on the subject image as the information indicating the region of interest, there is a problem that the region overlapping the mark cannot be observed in the subject image.
  • the display area is divided into two, the subject image is displayed in the first display area, and a mark indicating the attention area is attached to the second display area smaller than the first display area.
  • Means for displaying the captured subject image is disclosed (for example, see Patent Documents 2 and 3).
  • JP 2011-255006 A Japanese Patent Laid-Open No. 10-262923 Japanese Patent No. 4989036
  • the present invention has been made in view of the above, and is an image processing apparatus and an image processing method capable of ensuring the visibility of a subject image and improving the visibility of information indicating a region of interest in the subject image.
  • An object of the present invention is to provide an image processing program.
  • an image processing apparatus includes a subject image acquisition unit that acquires a subject image as first image data, and a feature amount of the subject image.
  • the image data includes an attention area detection unit that detects an attention area that is an attention area, and an instruction image that indicates information on the attention area in the subject image.
  • An image data generation unit that generates second image data having a small amount of information, and a display control unit that performs control to display an image corresponding to the second image data, the first image data An image corresponding to the second image data is displayed in the first display area, and an image corresponding to the second image data is displayed in the second display area.
  • an image processing method acquires a subject image as first image data, and in a region to be noted based on the feature amount of the subject image.
  • Image data including an instruction image that detects a certain region of interest and indicates information related to the region of interest in the subject image, the second image data having a smaller information amount than the information amount of the first image data.
  • an image processing program is based on a subject image acquisition procedure for acquiring a subject image as first image data, and a feature amount of the subject image.
  • Image data including a region of interest detection procedure for detecting a region of interest that is a region of interest, and an instruction image indicating information related to the region of interest in the subject image, compared to the amount of information in the first image data
  • An image data generation procedure for generating second image data with a small amount of information, a first display procedure for displaying an image corresponding to the first image data in the first display area, and the second image data And causing the computer to execute a second display procedure for displaying the corresponding image in the second display area.
  • the present invention it is possible to ensure the visibility of the subject image and improve the visibility of the information indicating the region of interest in the subject image.
  • FIG. 1 is a diagram showing a schematic configuration of an endoscope apparatus according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing a schematic configuration of the endoscope apparatus according to the embodiment of the present invention.
  • FIG. 3 is a flowchart for explaining processing performed by the endoscope apparatus according to the embodiment of the present invention.
  • FIG. 4 is a diagram for explaining a display screen displayed by the display unit of the endoscope apparatus according to the embodiment of the present invention.
  • FIG. 5 is a diagram illustrating a display screen displayed by the display unit of the endoscope apparatus according to the first modification of the embodiment of the present invention.
  • FIG. 6 is a diagram illustrating a display screen displayed by the display unit of the endoscope apparatus according to the second modification of the embodiment of the present invention.
  • FIG. 1 is a diagram showing a schematic configuration of an endoscope apparatus according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing a schematic configuration of the endoscope apparatus according to the embodiment
  • FIG. 7 is a diagram illustrating a display screen displayed by the display unit of the endoscope apparatus according to the third modification of the embodiment of the present invention.
  • FIG. 8 is a diagram illustrating a display screen displayed by the display unit of the endoscope apparatus according to the fourth modification of the embodiment of the present invention.
  • FIG. 9 is a diagram illustrating a schematic configuration of an endoscope apparatus according to Modification 5 of the embodiment of the present invention.
  • FIG. 1 is a diagram showing a schematic configuration of an endoscope apparatus 1 according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing a schematic configuration of the endoscope apparatus 1 according to the embodiment of the present invention.
  • An endoscope apparatus 1 shown in FIGS. 1 and 2 includes an endoscope 2 that captures an in-vivo image of an observation site by inserting an insertion portion 21 into a subject, and generates an electrical signal.
  • a light source section 3 that generates illumination light emitted from the distal end of the endoscope, and a processor section 4 that performs predetermined image processing on the electrical signal acquired by the endoscope 2 and controls the overall operation of the endoscope apparatus 1 in an integrated manner.
  • the endoscope apparatus 1 acquires an in-vivo image in a subject by inserting the insertion unit 21 into a subject such as a patient.
  • a surgeon such as a doctor examines the presence or absence of a bleeding site or a tumor site as a detection target site by observing the acquired in-vivo image.
  • the endoscope 2 includes an insertion portion 21 having an elongated shape having flexibility, an operation portion 22 that is connected to a proximal end side of the insertion portion 21 and receives input of various operation signals, and an insertion portion from the operation portion 22. And a universal cord 23 that extends in a direction different from the direction in which 21 extends and incorporates various cables connected to the light source unit 3 and the processor unit 4.
  • the insertion unit 21 includes pixels (photodiodes) that receive light arranged in a lattice (matrix), and includes an image sensor 202 that generates an image signal by performing photoelectric conversion on the light received by the pixels.
  • the operation unit 22 includes a bending knob 221 that bends the bending unit 25 in the vertical direction and the left-right direction, a treatment tool insertion unit 222 that inserts a treatment tool such as a biological forceps, an electric knife, and a test probe into the subject, and a light source unit. 3, an instruction signal for switching the illumination light, a treatment instrument, an operation instruction signal for an external device connected to the processor unit 4, a water supply instruction signal for water supply, and a suction instruction signal for suction Etc., and a plurality of switches 223 for inputting.
  • the treatment tool inserted from the treatment tool insertion portion 222 is exposed from an opening (not shown) via a treatment tool channel (not shown) provided at the distal end of the distal end portion 24.
  • the universal cord 23 includes at least a light guide 203 and an aggregate cable in which one or a plurality of signal lines are collected.
  • the collective cable is a signal line for transmitting and receiving signals between the endoscope 2 and the light source unit 3 and the processor unit 4, and is a signal line for transmitting and receiving setting data, a signal line for transmitting and receiving image signals, A signal line for transmitting and receiving a driving timing signal for driving the image sensor 202 is included.
  • the endoscope 2 includes an imaging optical system 201, an imaging element 202, a light guide 203, an illumination lens 204, an A / D conversion unit 205, and an imaging information storage unit 206.
  • the imaging optical system 201 is provided at the distal end portion 24 and collects at least light from the observation site.
  • the imaging optical system 201 is configured using one or a plurality of lenses. Note that the imaging optical system 201 may be provided with an optical zoom mechanism that changes the angle of view and a focus mechanism that changes the focus.
  • the imaging element 202 is provided perpendicular to the optical axis of the imaging optical system 201, and photoelectrically converts an image of light connected by the imaging optical system 201 to generate an electrical signal (imaging signal).
  • the image sensor 202 is realized using a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like.
  • the light guide 203 is configured using glass fiber or the like, and serves as a light guide path for light emitted from the light source unit 3.
  • the illumination lens 204 is provided at the tip of the light guide 203, diffuses the light guided by the light guide 203, and emits it to the outside of the tip 24.
  • the A / D conversion unit 205 performs A / D conversion on the electrical signal generated by the image sensor 202 and outputs the converted electrical signal to the processor unit 4.
  • the A / D conversion unit 205 converts the electrical signal generated by the image sensor 202 into, for example, 12-bit digital data (image signal).
  • the imaging information storage unit 206 stores various programs for operating the endoscope 2, various parameters necessary for the operation of the endoscope 2, identification information of the endoscope 2, and the like.
  • the imaging information storage unit 206 includes an identification information storage unit 261 that stores identification information.
  • the identification information includes unique information (ID) of the endoscope 2, year information, specification information, information on the transmission method, and the like.
  • the imaging information storage unit 206 is realized using a flash memory or the like.
  • the light source unit 3 includes an illumination unit 31 and an illumination control unit 32.
  • the illumination unit 31 switches and emits a plurality of illumination lights having different wavelength bands under the control of the illumination control unit 32.
  • the illumination unit 31 includes a light source 31a, a light source driver 31b, and a condenser lens 31c.
  • Light source 31a emits under the control of the illumination control unit 32, the red, green and blue wavelength band H R, the white illumination light including light of H G and H B.
  • the white illumination light generated by the light source 31a is emitted to the outside from the distal end portion 24 via the condenser lens 31c and the light guide 203.
  • the light source 31a is realized using a light source that emits white light, such as a white LED or a xenon lamp.
  • the light source driver 31b supplies white light to the light source 31a by supplying current to the light source 31a under the control of the illumination control unit 32.
  • the condensing lens 31c condenses the white illumination light emitted from the light source 31a and emits it to the outside of the light source unit 3 (light guide 203).
  • the illumination control unit 32 controls emission of illumination light by controlling the light source driver 31b to turn on and off the light source 31a.
  • the processor unit 4 includes an image processing unit 41, an input unit 42, a storage unit 43, and a control unit 44.
  • the image processing unit 41 executes predetermined image processing based on the imaging signal from the endoscope 2 (A / D conversion unit 205), and generates a display image signal to be displayed by the display unit 5.
  • the image processing unit 41 includes an image acquisition unit 411, an attention area detection unit 412, an image data generation unit 413, and a display control unit 414.
  • the image acquisition unit 411 receives an imaging signal from the endoscope 2 (A / D conversion unit 205).
  • the image acquisition unit 411 performs noise removal, A / D conversion, and synchronization processing (for example, performed when an image pickup signal for each color component is obtained using a color filter or the like) on the acquired image pickup signal. Apply processing.
  • the image acquisition unit 411 generates an image signal including a subject image to which RGB color components are added by the signal processing described above.
  • the image acquisition unit 411 inputs the generated image signal to the attention area detection unit 412 and the image data generation unit 413.
  • the image acquisition unit 411 may perform OB clamping processing, gain adjustment processing, and the like in addition to the above-described synchronization processing.
  • the attention area detection unit 412 detects whether there is a possibility of a lesion in the input image based on the input image generated by the image acquisition unit 411 and whether there is an attention area that is a region of interest.
  • the attention area detection unit 412 detects the attention area by detecting a lesion area based on the feature amount of the subject image. Examples of the feature amount include a luminance value and a signal value of each color component (RGB component).
  • RGB component color component
  • Various techniques for detecting lesions have been proposed. For example, "Towards Automatic Polyp Detection with a Polyp Appearance Model" Jorge Bernal, F. Javier Sanchez, & Fernando Vilarino, Pattern Recognition, 45 (9), 3166-3 Such a technique can be used.
  • the attention area detection unit 412 When detecting a lesioned part, the attention area detection unit 412 generates detection information regarding the coordinates and size of the center of gravity of the lesioned part in the input image, and inputs the detection information to the image data generation
  • the image data generation unit 413 performs a color conversion process on the image signal (subject image) generated by the image acquisition unit 411 in a color space of sRGB (XYZ color system), which is the color gamut of the display unit 5, for example. Then, gradation conversion based on predetermined gradation conversion characteristics, enlargement processing, or structure enhancement processing of structures such as capillaries and mucous membrane fine patterns on the surface of the mucosa are performed to generate first image data including the subject image. Further, the image data generation unit 413 receives the attention detected by the attention region detection unit 412 separately from the first image data subjected to the above-described processing when the detection information of the lesioned part is input from the attention region detection unit 412.
  • sRGB XYZ color system
  • Second image data including an instruction image indicating information regarding the region and smaller than the information amount of the first image data is generated. Note that the image data generation unit 413 generates only the first image data without generating the second image data when the lesion area detection information is not input from the attention area detection unit 412.
  • the display control unit 414 inputs image data (first image data or first and second image data) generated by the image data generation unit 413 to the display unit 5 under the control of the control unit 44. Control the display.
  • the input unit 42 is an interface for performing an input from the surgeon to the processor unit 4, a power switch for turning on / off the power, a mode switching button for switching a photographing mode and various other modes,
  • the light source unit 3 includes an illumination light switching button for switching on and off illumination light and the like.
  • the storage unit 43 records various programs for operating the endoscope apparatus 1, such as an image processing program and data including various parameters necessary for the operation of the endoscope apparatus 1.
  • the storage unit 43 is realized by using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory).
  • the storage unit 43 includes an instruction image information storage unit 431 that stores information indicating a region of interest in the display image, for example, an instruction image.
  • the control unit 44 is configured using a CPU or the like, and performs drive control of each component including the endoscope 2 and the light source unit 3, input / output control of information with respect to each component, and the like.
  • the control unit 44 transmits setting data (for example, a pixel to be read) recorded in the storage unit 43, a timing signal related to imaging timing, and the like via a predetermined signal line to the endoscope. 2 to send.
  • the display unit 5 receives the display image signal generated by the processor unit 4 via the video cable and displays an in-vivo image corresponding to the display image signal.
  • the display unit 5 is configured using liquid crystal or organic EL (Electro Luminescence).
  • FIG. 3 is a flowchart for explaining processing performed by the endoscope apparatus 1 according to the embodiment of the present invention.
  • FIG. 4 is a diagram illustrating the display screen W 1 displayed by the display unit 5 of the endoscope apparatus 1 according to the embodiment of the present invention. Hereinafter, description will be made assuming that each unit operates under the control of the control unit 44.
  • the image acquisition unit 411 acquires an imaging signal digitally converted from the endoscope 2 (step S101). As described above, the image acquisition unit 411 performs signal processing such as noise removal, A / D conversion, and synchronization processing on the acquired imaging signal, and includes an object image to which RGB color components are added. Generate a signal. The image acquisition unit 411 inputs the generated image signal to the attention area detection unit 412 and the image data generation unit 413.
  • the attention area detection unit 412 is based on the input image generated by the image acquisition unit 411, and whether or not there is a attention area (for example, attention area C shown in FIG. 4) that may be a lesion in the input image. Is detected (step S102).
  • the attention area detection unit 412 When detecting a lesioned part, the attention area detection unit 412 generates detection information regarding the coordinates and size of the center of gravity of the attention area C that may be the lesion part in the subject image, and inputs the detection information to the image data generation unit 413. To do.
  • the image data generation unit 413 generates image data.
  • the image data generation unit 413 determines whether detection information is input from the attention area detection unit 412 (step S103).
  • the image data generation unit 413 proceeds to step S104.
  • the image data generation unit 413 proceeds to step S105.
  • the image data generation unit 413 generates first image data based on the image signal generated by the image acquisition unit 411 and generates second image data including an instruction image based on the detection information.
  • the image data generation unit 413 includes the subject image, and relates to the first image data to be displayed in the first display region R 1 in the display unit 5 and the attention region in the subject image.
  • Second image data including an instruction image I 1 indicating information and smaller than the information amount of the first image data is generated.
  • the second image data has a relationship similar to the contour of the first display region R 1 and the instruction image I 1 indicating information on the attention region C, and the contour of the second display region R 2 A contour image I r formed, and a background image I b forming the background of the second display region R 2 .
  • the background image I b is generated using the same color as the first display region R 1 other than the background of the display screen W 1.
  • the instruction image I 1 is a rectangular figure that forms a rectangle, and is generated using an inverted color (complementary color) of the average color of the subject image displayed in the first display region R 1 .
  • Instruction image I 1 for example, the center position of the rectangular relative to the contour image I r is disposed so as to correspond to the position of the center of gravity of the region of interest C with respect to the first display region R 1 of the contour.
  • Outline image I r is no the first display region R 1 of the shape, similar to a ring shape along the contour, the inverted color of the background image I b (color of the first display region R 1 other than the display region) It is generated using a color (complementary color).
  • each image (the instruction image I 1 , the contour image I r, and the background image I b ) is composed of single color information, for example, from a plurality of color information such as an intraluminal image of the subject. The number of colors is small and the amount of information (data amount) is small compared to the subject image.
  • step S105 the image data generation unit 413 generates first image data based on the image signal generated by the image acquisition unit 411.
  • the first image data displayed in the first display region R 1 and the second display region R 2 displayed in the first display region R 1 in the display unit 5 according to the presence / absence of the detection information of the attention region.
  • Image data is generated.
  • the display control unit 414 performs control of inputting and displaying image data on the display unit 5 under the control of the control unit 44. Surgeon for instructing image I 1 is displayed when observing the subject images sequentially displayed on the display unit 5 (first image data), the region of interest is detected, check the instruction image I 1 By doing so, it is possible to easily grasp at which position of the subject image the attention area exists. Thereby, oversight of a lesioned part can be suppressed.
  • the attention area detection unit 412 detects an attention area that is an attention area based on the feature amount of the subject image
  • the image data generation section 413 detects the attention area detection information.
  • the display control unit 414 displays the first image corresponding to the first image data in the first display area of the display unit, and displays the second image corresponding to the second image data in the second part of the display unit. Control to display in the display area.
  • the background of the second display region R 2 is made a single color, for example, black, and the color of the instruction image I 1 is changed to the background color of the second display region R 2.
  • the contrast is white, the visibility of the instruction image I 1 in the second display region R 2 can be improved.
  • the color of the instruction image I 1 and the background color of the second display region R 2 are made a single color, thereby reducing the number of colors and reducing the amount of information.
  • the combination of colors is not limited to this.
  • the background color of the second display region R 2 may be white
  • the color of the instruction image I 1 may be black with the brightness of the background color of the second display region R 2 reversed
  • the second The background color of the display area R 2 may be black or white
  • the color of the instruction image I 1 may be a color other than black or white.
  • the color of the instruction image I 1 may be black, white, or a complementary color of the background color of the second display region R 2.
  • the color of the second display region R 2 of the background is the average color of the subject image displayed in the first display area R 1, displays the color of the instruction image I 1 in the display region R 1 of the first
  • the average color of the subject image may be a complementary color.
  • the background color of the second display region R 2 may be a single color such as black, and the color of the instruction image I 1 may be a complementary color of the average color of the subject image displayed in the first display region R 1 .
  • the background of the second display area R 2 corresponds to the subject image displayed in the first display area R 1 , and the background of the second display area R 2 is changed to the first display area R 1 .
  • the displayed subject image may be an image in which at least one of resolution, saturation, brightness, and contrast is reduced, and the information amount of the second image data may be reduced.
  • the background of the second display area R 2 is formed by reducing at least one of resolution, saturation, brightness, and contrast based on the subject image displayed in the first display area R 1 .
  • the amount of information can also be reduced by lowering the refresh rate of the display image in the second display region R 2 relative to the refresh rate of the subject image displayed in the first display region R 1 .
  • FIG. 5 is a diagram illustrating a display screen W 2 displayed on the display unit 5 of the endoscope apparatus 1 according to the first modification of the embodiment of the present invention.
  • the instruction image I 2 shown in FIG. 5 has a cross shape of an inverted color (complementary color) of the background image I b .
  • the crossed portion is arranged so as to correspond to the center of gravity position of the attention area C. Also in the first modification, the same effect as that of the above-described embodiment can be obtained.
  • FIG. 6 is a diagram illustrating a display screen W 3 displayed by the display unit 5 of the endoscope apparatus 1 according to the second modification of the embodiment of the present invention.
  • each line segment has a length corresponding to the length in each direction.
  • the crossed portion is arranged so as to correspond to the position of the center of gravity of the attention area C. Also in the second modification, it is possible to obtain the same effect as in the above-described embodiment and to grasp the size of the attention area C.
  • FIG. 7 is a diagram illustrating a display screen W 4 displayed on the display unit 5 of the endoscope apparatus 1 according to the third modification of the embodiment of the present invention.
  • the instruction image I 4 shown in FIG. 7 has an oval shape that is colored with the reverse color (complementary color) of the background image I b .
  • the instruction image I 4 is, for example, arranged so that the center of gravity of the ellipse (the intersection of the long axis and the short axis) corresponds to the position of the center of gravity of the attention area C, and the background transmittance decreases as it approaches the center of gravity.
  • the instruction image I 4 is arranged so that the direction of the major axis of the ellipse is parallel to the longitudinal direction of the region of interest C.
  • the length of the major axis of the ellipse corresponds to the length of the attention area C in the longitudinal direction
  • the length of the minor axis corresponds to the length in the direction orthogonal to the longitudinal direction of the attention area C. It is preferable to correspond.
  • the same effect as in the above-described embodiment can be obtained.
  • the visibility of the position of the center of gravity can be improved by reducing the background transmittance as it is closer to the center of gravity.
  • the instruction image extends in a direction corresponding to the longitudinal direction of the attention area C and a direction orthogonal to the longitudinal direction, and has a shape having a length corresponding to each direction.
  • the present invention is not limited to this, and may reflect at least one of the aspect ratio and inclination of the region of interest, or the color of the instruction image may be the reverse color of the subject image.
  • FIG. 8 is a diagram for explaining a display screen W 5 displayed by the display unit 5 of the endoscope apparatus 1 according to the modification 4 of the embodiment of the present invention.
  • the display screen W 5 in addition to the contour image I r, further comprising a cross-shaped guide wire made of two linear image (linear image I S1, I S2) orthogonal to each other.
  • the straight line image I S1 extends in the vertical direction from the center of the second display region R 2 in the horizontal direction (the horizontal direction in the rectangular display screen W 5 ).
  • the straight line image I S2 extends in the horizontal direction from the center in the vertical direction (vertical direction in the rectangular display screen W 5 ) of the second display region R 2 .
  • the straight line images I S1 and I S2 are superimposed on the instruction image I 4 in terms of improving the visibility of the guide lines, that is, arranged so that the guide lines are not hidden by the instruction image I 4 . It is preferable.
  • the present invention is not limited to this. *) It may be formed using at least one of one or a plurality of straight lines and one or a plurality of curves, such as a radial shape such as a shape, a concentric circle, and a concentric polygon. Further, the color of the instruction image and the color of the guide line may be the same or different.
  • the second display area R 2 is described as being displayed adjacent to the first display area R 1.
  • the display position is not limited to this. .
  • it may be arranged on the right side of the first display area R 1 on the display screen, or may be arranged on the upper left, lower left, upper right, lower right, upper, or lower. It is preferable to be closer to the center of the screen.
  • the size of the second display region R 2 has been described as smaller than the first display region R 1, it may be larger than the first display region R 1.
  • the outline (contour image I r ) of the second display region R 2 has been described as an octagon corresponding to the first display region R 1, it may be a rectangle, Is not limited.
  • FIG. 9 is a diagram illustrating a schematic configuration of an endoscope apparatus according to Modification 5 of the embodiment of the present invention.
  • An endoscope apparatus 1A according to Modification 5 includes a display unit 5A instead of the display unit 5 of the endoscope apparatus 1 according to the above-described embodiment.
  • Display unit 5A includes a first display unit 51 for displaying an image on the first display region R 1, and a second display unit 52 for displaying an image on the second display region R 2.
  • the display unit 5A is configured using liquid crystal or organic EL (Electro Luminescence).
  • the image acquisition unit 411 inputs the generated image signal to the first display unit 51 as the first image data including the first image, and the first image is displayed in the first display region R. 1 is displayed.
  • the image acquisition unit 411 performs image processing for display as necessary.
  • the image data generation unit 413 generates second image data including the instruction image and inputs the second image data to the display control unit 414.
  • the display control unit 414, the second image data by the image data generating unit 413 has generated is input to the second display unit 52, performs control to display the second image on the second display region R 2.
  • the first image is displayed in the first display region R 1 without using the display control unit 414.
  • the second image is input to the second display unit 52 via the display control unit 414, is displayed on the second display region R 2.
  • the same effect as in the above-described embodiment can be obtained.
  • the first display region R 1 and the second display region R 2 may be provided on the same monitor display screen, or provided on two different monitors. May be. That is, the first display unit 51 and the second display unit 52 may be configured by the same monitor or may be configured by a plurality of different monitors. Moreover, it is preferable that the first display region R 1 and the second display region R 2 are arranged side by side in order to ensure visibility.
  • the endoscope apparatus 1 has been described as the A / D conversion unit 205 being provided in the endoscope 2, it may be provided in the processor unit 4. . Further, the configuration relating to the image processing may be provided in the endoscope 2, the connector that connects the endoscope 2 and the processor unit 4, the operation unit 22, or the like. In the endoscope apparatus 1 described above, the endoscope unit 2 connected to the processor unit 4 is identified using the identification information stored in the identification information storage unit 261. However, the processor unit 4 An identification means may be provided at a connection portion (connector) between the endoscope 2 and the endoscope 2. For example, an identification pin (identification means) is provided on the endoscope 2 side to identify the endoscope 2 connected to the processor unit 4.
  • the display may be changed according to the skill level of the operator.
  • the display mode is set based on the information of the operator who is logged in to the apparatus.
  • the medical flexible endoscope has been described as an example.
  • the present invention is not limited to this, and is not limited to this.
  • the present invention can also be applied to an endoscope apparatus using a camera head connected to an eyepiece portion of an optical endoscope such as an endoscope, a capsule endoscope, a fiber scope, an optical endoscope, or the like.
  • the image processing apparatus according to the present invention can be applied to the inside or outside of the body, and performs processing on a video signal including an imaging signal and an image signal generated outside.
  • the present invention can include various embodiments and the like not described herein, and appropriate design changes and the like can be made without departing from the technical idea described in the claims. Is possible.
  • the image processing apparatus, the image processing method, and the image processing program according to the present invention are useful for ensuring the visibility of the subject image and improving the visibility of the information indicating the region of interest in the subject image. It is.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Endoscopes (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un appareil de traitement d'image comprenant : une unité d'acquisition d'image de sujet qui acquiert une image de sujet en tant que premières données d'image ; une unité de détection de région d'intérêt qui détecte, sur la base d'une quantité de caractéristiques de l'image de sujet, une région d'intérêt qui est une région dont il faut tenir compte ; une unité de génération de données d'image qui génère des secondes données d'image qui sont des données d'image comprenant une image d'instruction indiquant des informations concernant la région d'intérêt dans l'image de sujet, les secondes données d'image ayant une quantité d'informations moindre comparativement à la quantité d'informations des premières données d'image ; et une unité de commande d'affichage qui effectue une commande pour afficher une image correspondant aux secondes données d'image. Une image correspondant aux premières données d'image est affichée dans une première région d'affichage et l'image correspondant aux secondes données d'image est affichée dans une seconde région d'affichage.
PCT/JP2015/086569 2015-12-28 2015-12-28 Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image Ceased WO2017115442A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/JP2015/086569 WO2017115442A1 (fr) 2015-12-28 2015-12-28 Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image
JP2017558835A JPWO2017115442A1 (ja) 2015-12-28 2015-12-28 画像処理装置、画像処理方法および画像処理プログラム
US16/011,707 US20180307933A1 (en) 2015-12-28 2018-06-19 Image processing apparatus, image processing method, and computer readable recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/086569 WO2017115442A1 (fr) 2015-12-28 2015-12-28 Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/011,707 Continuation US20180307933A1 (en) 2015-12-28 2018-06-19 Image processing apparatus, image processing method, and computer readable recording medium

Publications (1)

Publication Number Publication Date
WO2017115442A1 true WO2017115442A1 (fr) 2017-07-06

Family

ID=59224942

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/086569 Ceased WO2017115442A1 (fr) 2015-12-28 2015-12-28 Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image

Country Status (3)

Country Link
US (1) US20180307933A1 (fr)
JP (1) JPWO2017115442A1 (fr)
WO (1) WO2017115442A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020059445A1 (fr) * 2018-09-21 2020-03-26 富士フイルム株式会社 Appareil de traitement d'image et procédé de traitement d'image
WO2020090731A1 (fr) 2018-11-01 2020-05-07 富士フイルム株式会社 Dispositif de traitement d'image médicale, procédé et programme de traitement d'image médicale, et dispositif d'aide au diagnostic
WO2021044900A1 (fr) * 2019-09-02 2021-03-11 ソニー株式会社 Système opératoire, dispositif de traitement d'image, procédé de traitement d'image et programme
CN114693593A (zh) * 2020-12-31 2022-07-01 杭州海康慧影科技有限公司 图像处理方法、装置、及计算机装置
CN117649335A (zh) * 2023-12-01 2024-03-05 书行科技(北京)有限公司 图像处理方法、装置和计算机可读存储介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018146546A (ja) 2017-03-09 2018-09-20 エアロセンス株式会社 情報処理システム、情報処理装置および情報処理方法
JPWO2018179610A1 (ja) * 2017-03-27 2020-02-06 ソニー・オリンパスメディカルソリューションズ株式会社 制御装置、内視鏡システム、処理方法およびプログラム
WO2019078237A1 (fr) * 2017-10-18 2019-04-25 富士フイルム株式会社 Dispositif de traitement d'image médicale, système d'endoscope, dispositif d'aide au diagnostic, et dispositif d'aide à l'industrie médicale
JP7368074B2 (ja) * 2018-03-28 2023-10-24 日本光電工業株式会社 挿管装置
CN112739250B (zh) * 2018-09-18 2024-10-15 富士胶片株式会社 医用图像处理装置、处理器装置及医用图像处理方法
JP7374224B2 (ja) * 2021-01-14 2023-11-06 コ，ジファン 内視鏡を用いた大腸検査ガイド装置
US12342064B1 (en) * 2023-12-21 2025-06-24 Shenzhen Andelian Technology Co., Ltd. Pipeline endoscope probe and pipeline endoscope assembly

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008061704A (ja) * 2006-09-05 2008-03-21 Olympus Medical Systems Corp 画像表示装置
JP2008295804A (ja) * 2007-05-31 2008-12-11 Topcon Corp 眼底検査装置及びプログラム
JP2008301968A (ja) * 2007-06-06 2008-12-18 Olympus Medical Systems Corp 内視鏡画像処理装置
JP2010172673A (ja) * 2009-02-02 2010-08-12 Fujifilm Corp 内視鏡システム、内視鏡用プロセッサ装置、並びに内視鏡検査支援方法
WO2012132790A1 (fr) * 2011-03-31 2012-10-04 オリンパス株式会社 Dispositif d'observation de fluorescence

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8900124B2 (en) * 2006-08-03 2014-12-02 Olympus Medical Systems Corp. Image display device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008061704A (ja) * 2006-09-05 2008-03-21 Olympus Medical Systems Corp 画像表示装置
JP2008295804A (ja) * 2007-05-31 2008-12-11 Topcon Corp 眼底検査装置及びプログラム
JP2008301968A (ja) * 2007-06-06 2008-12-18 Olympus Medical Systems Corp 内視鏡画像処理装置
JP2010172673A (ja) * 2009-02-02 2010-08-12 Fujifilm Corp 内視鏡システム、内視鏡用プロセッサ装置、並びに内視鏡検査支援方法
WO2012132790A1 (fr) * 2011-03-31 2012-10-04 オリンパス株式会社 Dispositif d'observation de fluorescence

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020059445A1 (fr) * 2018-09-21 2020-03-26 富士フイルム株式会社 Appareil de traitement d'image et procédé de traitement d'image
US12213641B2 (en) 2018-09-21 2025-02-04 Fujifilm Corporation Image processing apparatus and image processing method
WO2020090731A1 (fr) 2018-11-01 2020-05-07 富士フイルム株式会社 Dispositif de traitement d'image médicale, procédé et programme de traitement d'image médicale, et dispositif d'aide au diagnostic
JPWO2020090731A1 (ja) * 2018-11-01 2021-09-30 富士フイルム株式会社 医療画像処理装置、医療画像処理方法及びプログラム、診断支援装置
EP3875022A4 (fr) * 2018-11-01 2021-10-20 FUJIFILM Corporation Dispositif de traitement d'image médicale, procédé et programme de traitement d'image médicale, et dispositif d'aide au diagnostic
JP7143436B2 (ja) 2018-11-01 2022-09-28 富士フイルム株式会社 医療画像処理装置、医療画像処理装置の作動方法及びプログラム、診断支援装置
US11481944B2 (en) 2018-11-01 2022-10-25 Fujifilm Corporation Medical image processing apparatus, medical image processing method, program, and diagnosis support apparatus
WO2021044900A1 (fr) * 2019-09-02 2021-03-11 ソニー株式会社 Système opératoire, dispositif de traitement d'image, procédé de traitement d'image et programme
CN114693593A (zh) * 2020-12-31 2022-07-01 杭州海康慧影科技有限公司 图像处理方法、装置、及计算机装置
CN117649335A (zh) * 2023-12-01 2024-03-05 书行科技(北京)有限公司 图像处理方法、装置和计算机可读存储介质

Also Published As

Publication number Publication date
US20180307933A1 (en) 2018-10-25
JPWO2017115442A1 (ja) 2018-10-18

Similar Documents

Publication Publication Date Title
WO2017115442A1 (fr) Appareil de traitement d'image, procédé de traitement d'image et programme de traitement d'image
CN110325100B (zh) 内窥镜系统及其操作方法
US11045079B2 (en) Endoscope device, image processing apparatus, image processing method, and program
JP6196900B2 (ja) 内視鏡装置
CN105828693A (zh) 内窥镜装置
JP6401800B2 (ja) 画像処理装置、画像処理装置の作動方法、画像処理装置の作動プログラムおよび内視鏡装置
US20190082936A1 (en) Image processing apparatus
CN105828692B (zh) 内窥镜装置
WO2016079831A1 (fr) Dispositif de traitement d'image, procédé de traitement d'image, programme de traitement d'image et dispositif d'endoscope
JP7335399B2 (ja) 医用画像処理装置及び内視鏡システム並びに医用画像処理装置の作動方法
US11571111B2 (en) Endoscope scope, endoscope processor, and endoscope adaptor
WO2016110984A1 (fr) Dispositif de traitement d'image, procédé de fonctionnement de dispositif de traitement d'image, programme de fonctionnement de dispositif de traitement d'image, et dispositif d'endoscope
JP4554267B2 (ja) 内視鏡及び内視鏡システム
JP2004000505A (ja) 内視鏡装置
WO2020178962A1 (fr) Système d'endoscope et dispositif de traitement d'image
JP2022510261A (ja) 医療撮像システム及び方法
WO2016084257A1 (fr) Appareil d'endoscopie
JPWO2019069414A1 (ja) 内視鏡装置、画像処理方法およびプログラム
JP6937902B2 (ja) 内視鏡システム
JP4373726B2 (ja) 自家蛍光観察装置
JP6663692B2 (ja) 画像処理装置、内視鏡システム、及び画像処理装置の制御方法
CN111989026B (zh) 内窥镜装置、内窥镜装置的工作方法及记录介质
WO2022208629A1 (fr) Dispositif d'observation de fluorescence, système de photo-immunothérapie et endoscope à fluorescence

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15912108

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017558835

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15912108

Country of ref document: EP

Kind code of ref document: A1