WO2016072422A1 - Imaging system - Google Patents

Abstract

The present invention comprises: an image signal processing unit 33 which generates a moving image signal and a still image signal on the basis of an imaging signal; an index image generating unit 35 which generates an index image signal on the basis of the still image signal; a compositing unit 39 which superimposes the moving image signal and the index image signal such that an index image group is displayed superimposed on a screen on which the moving image is displayed; a superposed position setting unit 37 which sets the position at which the index image group is superposed by the compositing unit 39 relative to the moving image; an index image reduction rate setting unit 36 which sets a reduction rate for the index images according to the superposed position; and a screen size changing unit 38 which changes the screen size of a subject image according to the superposed position.

Description

Imaging system

The present invention relates to an imaging system, and more particularly to an imaging system that performs predetermined processing on an imaging signal to generate and output an imaging signal.

Conventionally, endoscopes equipped with an image sensor have been widely used in the medical field and the industrial field. There is also a known technique for constituting an endoscope system, which is detachably connected to an endoscope, and performs various signal processing related to the endoscope by a signal processing device called a processor.

In an endoscope system having the above-described signal processing device, a predetermined process is performed on an imaging signal obtained by imaging a subject to generate an imaging signal, which is displayed as a subject image on a display device such as a monitor. In addition, an endoscope system that superimposes and displays a reference image (index image) related to the subject image is known, for example, in Japanese Unexamined Patent Application Publication No. 2003-265407.

That is, in the technique described in the endoscope system, a release image at a predetermined timing related to the subject image is displayed as an index image on a monitor screen that displays the subject image.

By the way, in the endoscope system as described in JP-A-2003-265407, when displaying the index image as described above on the monitor screen, the image size of the subject image or the index image as the endoscope image is set. If it is displayed in a large size, the index image and the subject image are displayed in a superimposed manner, which may interfere with observation.

Conventionally, it has been difficult to display the index image as described above on an arbitrary position desired by the user on the monitor screen. As a result, the visibility of the index image is lowered depending on the relationship between the user's standing position and the monitor arrangement position, and the usability is poor.

The present invention has been made in view of the above points, and provides an imaging system capable of displaying a subject image and an index image at appropriate positions regardless of the screen size of the subject image displayed on the monitor. With the goal.

An imaging system according to an aspect of the present invention instructs an imaging unit that captures an image of a subject to generate an imaging signal, a moving image generation unit that generates a moving image signal based on the imaging signal, and recording a still image A release switch that generates an instruction signal; a still image generation unit that generates a still image signal from the moving image signal in response to input of the instruction signal; a recording unit that can record a plurality of the still image signals; An index image generating unit that reads the still image signal from the recording unit and generates an index image signal representing an index image obtained by reducing the still image based on the read still image signal, and the moving image is displayed. The moving image signal and the index image signal are superimposed so that an index image group including a plurality of the index images is superimposed on the screen. That includes a combining unit, and a superimposing position setting unit for setting the superimposing position of the index image group relative to the moving image by the combining unit.

FIG. 1 is an external perspective view showing the configuration of the endoscope system according to the first embodiment of the present invention. FIG. 2 is a block diagram illustrating an electrical configuration of the endoscope system according to the first embodiment. FIG. 3 is a diagram illustrating an example of a monitor display screen in the endoscope system according to the first embodiment. FIG. 4 is a diagram illustrating another example of the monitor display screen in the endoscope system according to the first embodiment. FIG. 5 is a block diagram showing an electrical configuration of an endoscope system according to the second embodiment of the present invention. FIG. 6 is a diagram illustrating an example of a monitor display screen in the endoscope system according to the second embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
The configuration of the endoscope system according to the first embodiment will be described with reference to FIGS. FIG. 1 is an external perspective view showing the configuration of the endoscope system of the first embodiment, and FIG. 2 is a diagram showing the electrical configuration of the endoscope system of the first embodiment. .

As shown in FIGS. 1 and 2, an endoscope system 1 according to a first embodiment of the present invention includes an endoscope 2 having an image sensor and an endoscope 2 that are detachably connected to each other to perform predetermined signal processing. A video processor 3, a light source device 4 for supplying illumination light to the endoscope 2, a monitor 5 as a display device for displaying an image signal generated by the video processor 3 as an endoscopic image, and a video A keyboard 8 connected to the processor 3 and performing a predetermined operation is mainly provided.

The endoscope 2 is provided at an elongated insertion portion 6 to be inserted into a body cavity, an operation portion 7 provided at the rear end of the insertion portion 6, and a distal end rigid portion of the insertion portion 6. A CCD image sensor 21 that picks up an image and outputs a predetermined image signal, and performs predetermined A / D conversion on the image signal related to the subject image output from the CCD image sensor 21 to the video processor 3. And an A / D converter 22 for sending out.

The operation unit 7 is provided with a release switch 9 for generating an instruction signal for instructing recording of a still image.

The video processor 3 includes a control unit 31 that controls various circuits in the video processor 3, a pre-processing unit 32 that performs known pre-processing on the imaging signal output from the CCD image sensor 21, and the pre-processing unit An image signal processing unit 33 that performs predetermined image processing on the signal processed in 32 to generate and output an endoscope image signal.

The pre-processing unit 32 inputs an imaging signal from the CCD image sensor 21 and performs predetermined pre-signal processing, and includes a known signal amplifying unit, preprocess circuit, A / D converter, white balance circuit, and the like. And is controlled by the control unit 31.

The image signal processing unit 33 performs predetermined image processing on the output signal from the preprocessing unit 32 under the control of the control unit 31 to generate a moving image signal based on the imaging signal, and the release switch. In response to the input operation 9, a still image signal is generated from the moving image signal.

In addition, the video processor 3, under the control of the control unit 31, stores a still image recording unit 34 that can record a plurality of still image signals generated in the image signal processing unit 33, and an index image obtained by reducing the still image. An index image generation unit 35 that generates an index image signal to be represented, an index image reduction rate setting unit 36 that sets a reduction rate when the index image generation unit 35 generates the index image from the still image, and image signal processing A superposition position setting unit 37 that sets a superposition position of the index image with respect to the moving image generated in the unit 33.

Further, under the control of the control unit 31, the video processor 3 has a screen size changing unit 38 that changes the display screen size of a moving image that is a subject image generated in the image signal processing unit 33, and the screen size changing unit 38. A synthesis processing unit 39 that superimposes and synthesizes a moving image that is an output signal and the index image, and an OSD generation unit 40 that generates predetermined additional information (character information) related to the subject.

Here, the still image recording unit 34 records the still image signal generated in the image signal processing unit 33 generated at the timing of the input operation of the release switch 9, but the keyboard 8 connected to the video processor 3 or the like. Deletion / change or the like is performed by the above operation or a predetermined operation from the operation unit 7 in the endoscope 2.

The index image generation unit 35 reads the still image signal recorded from the still image recording unit 34 under the control of the control unit 31, and represents an index image obtained by reducing the still image based on the read still image signal. An index image signal is generated.

The index image generated in the index image generating unit 35 is a still image recording unit by an operation of the keyboard 8 or the like connected to the video processor 3 or a predetermined operation from the operation unit 7 in the endoscope 2. It is possible to select the still image signal recorded in 34, that is, it is possible to change the number of index images.

The index image reduction rate setting unit 36 sets a reduction rate when the index image generated by the index image generation unit 35 is generated under the control of the control unit 31.

In addition, the index image reduction ratio setting unit 36 has an initial setting value for the index image reduction ratio. In addition, the operation of the keyboard 8 connected to the video processor 3 or the operation of the endoscope 2 is performed. The value can be changed to an arbitrary value by a predetermined operation from the unit 7.

In the present embodiment, the superposition position setting unit 37 sets the superposition position for the moving image of the index image group, that is, automatically according to the layout information of the subject image and the index image. It is also possible to set a reduction rate.

Under the control of the control unit 31, the superposition position setting unit 37 sets the superposition position of the index image with respect to the moving image that is the subject image processed in the synthesis processing unit 39, and in other words, the setting information, The layout information is transmitted to the composition processing unit 39, the index image reduction rate setting unit 36, and the like.

In this embodiment, under the control of the control unit 31, the operation of the keyboard 8 or the like connected to the video processor 3 is used to change the arrangement relationship between the moving image that is a subject image and the index image. 37 can be instructed.

The superimposition position setting unit 37 calculates the optimum layout of the subject image and the index image on the same display screen based on the instructed arrangement relationship, and transmits the layout information to each unit. ing.

When calculating the optimum layout, the superimposition position setting unit 37 sets the index image reduction rate value set by the index image reduction rate setting unit 36 and the index image generated by the index image generation unit 35. The number information is taken into consideration.

Note that when there are a plurality of index images, the superimposition position setting unit 37 calculates the layout of the index image group including the plurality of index images and the subject image.

The screen size changing unit 38 performs image processing under the control of the control unit 31 so as to change the display screen size of the moving image that is the subject image generated in the image signal processing unit 33 to a predetermined size.

Further, in the screen size changing unit 38, the initial setting value is determined in advance for the display screen size of the moving image that is the subject image, the operation of the keyboard 8 or the like connected to the video processor 3, or the endoscope 2 can be changed to an arbitrary value by a predetermined operation from the operation unit 7.

Furthermore, in the present embodiment, the screen size changing unit 38 automatically changes the display screen size of the moving image according to the layout information set by the superposition position setting unit 37 under the control of the control unit 31. It has become so.

The synthesis processing unit 39 receives layout information from the superimposition position setting unit 37 under the control of the control unit 31 and displays the index image or the index on the same display screen that displays the moving image that is a subject image. The moving image signal, which is a subject image signal, and the index image signal are superimposed so that an image group is displayed in a superimposed manner, and a composite image is generated and output to the monitor 5.

Under the control of the control unit 31, the OSD generation unit 40 displays predetermined additional information (character information) related to the subject on the same screen that displays the subject image, and an on-screen display (OSD). Is supposed to generate as

<Operation of First Embodiment>
Next, the operation of the first embodiment will be described.

Under the control of the control unit 31 in the video processor 3, the image signal processing unit 33 performs predetermined image processing on the output signal from the preprocessing unit 32, and generates a moving image signal based on the imaging signal. Further, the image signal processing unit 33 generates a predetermined still image signal based on the moving image signal in response to the input of the release switch 9.

Next, under the control of the control unit 31, the still image recording unit 34 records a plurality of still image signals generated in the image signal processing unit 33.

Further, the index image generation unit 35 reads the still image signal recorded from the still image recording unit 34 under the control of the control unit 31, and reduces the still image based on the read still image signal. An index image signal representing is generated.

Thereafter, under the control of the control unit 31, the index image reduction rate setting unit 36 sets a reduction rate for generating the index image generated by the index image generation unit 35.

At this time, the index image reduction rate setting unit 36 first determines the reduction rate of the index image to a predetermined initial setting value, and then operates the keyboard 8 or the like, or the operation unit 7 in the endoscope 2. The value is changed to an arbitrary value by the predetermined operation.

When the index image reduction ratio setting unit 36 receives the layout information from the superimposition position setting unit 37, the index image reduction ratio setting unit 36 sets the optimum value that is the layout obtained by the superposition position setting unit 37 under the control of the control unit 31. Set the reduction ratio automatically.

Then, under the control of the control unit 31, the superposition position setting unit 37 is set in the index image reduction rate setting unit 36 based on the arrangement relation instruction received from the user via the keyboard 8 or the like. In consideration of the value of the reduction ratio or the number of index images, the superimposition position of the index image or index image group on the moving image that is the subject image is set, and the setting information, in other words, the subject image and the index image or The layout information with the index image group is transmitted to the composition processing unit 39 and the index image reduction rate setting unit 36.

On the other hand, under the control of the control unit 31, the screen size changing unit 38 changes the display screen size of the moving image, which is the subject image generated by the image signal processing unit 33, from the predetermined initial setting value to the keyboard. The value is changed to an arbitrary value by an operation such as 8 or a predetermined operation from the operation unit 7 in the endoscope 2.

Furthermore, the screen size changing unit 38 controls the size of the subject image so that the layout obtained by the superimposition position setting unit 37 is obtained under the control of the control unit 31 according to the layout information set by the superposition position setting unit 37. Automatically change the value to the optimum value.

Further, the OSD generation unit 40 generates predetermined additional information (character information) related to the subject on the same screen on which the subject image is displayed under the control of the control unit 31, and transmits the generated information to the synthesis processing unit 39. .

Then, under the control of the control unit 31, the composition processing unit 39 displays the index image or the index image on the same display screen that displays the moving image that is the subject image based on the layout information from the superimposition position setting unit 37. The moving image signal, which is a subject image signal, and the index image signal are superimposed so that the index image group is displayed at a predetermined position, and further, the character information generated by the OSD generation unit 40 is superimposed and combined. An image is generated and output to the monitor 5.

3 and 4 are both examples of a monitor display screen in the endoscope system of the first embodiment, and a moving image 51, an index image group 52, and character information 55, which are subject images, are superimposed on each other. The example of a composite image display is shown.

In the present embodiment, the control unit 31 controls the superimposition position setting unit 37, the screen size changing unit 38, and the index image reduction rate setting unit 36, and the moving image 51 and the index image group 52, which are subject images, On the same display screen, the respective image sizes and display positions are adjusted so that they are not overlapped and superimposed.

For example, as shown in FIG. 3, the user arranges a moving image 51 as a subject image on the right side of the display screen, and an index image group 52 having three index images on the left side of the display screen. Is instructed to do so.

At this time, under the control of the control unit 31, the superimposition position setting unit 37 takes into account the size and number of index images in the index image group 52 and the size of the moving image 51, so that an optimum layout is displayed on the same display screen. Is calculated.

That is, in this case, the moving image 51 and the index are displayed so that the moving image 51 is displayed largely on the right side on the display screen and the index image group 52 can be displayed in the vertical direction next to the left of the moving image 51. The layout of the image group 52 is obtained, and this layout information is transmitted to the index image reduction rate setting unit 36 together with the composition processing unit 39.

Then, under the control of the control unit 31, the screen size changing unit 38 adjusts the size of the moving image 51 based on the layout information from the superimposition position setting unit 37, and the index image reduction rate setting unit 36. Receives the layout information from the superimposition position setting unit 37 and adjusts the reduction ratio of the index image in the index image group 52.

Thereafter, the composition processing unit 39 converts the image signals related to the moving image 51 and the index image group 52 whose sizes have been changed and set by the screen size changing unit 38 and the index image reduction rate setting unit 36, respectively, to the superimposition position setting unit. Superimpose on the basis of the layout information received from 37, further superimpose the character information 55 and synthesize it, and output it to the monitor 5.

On the other hand, as shown in FIG. 4, a moving image 51 that is a subject image from the user is arranged on the upper side of the display screen, and an index image group 53 having four index images is arranged on the lower side of the display screen. Is instructed to do so.

In this case, under the control of the control unit 31, the superimposition position setting unit 37 displays the moving image 51 large on the upper side of the display screen and arranges the index image group 53 next to the moving image 51 in the horizontal direction. The layout of the moving image 51 and the index image group 53 is obtained so that it can be displayed, and this layout information is transmitted to the index image reduction rate setting unit 36 together with the composition processing unit 39.

In response to this, the screen size changing unit 38 and the index image reduction rate setting unit 36 adjust to change the size of the moving image 51 and adjust the reduction rate of the index image in the index image group 53 as described above. .

Thereafter, similarly to the above, the composition processing unit 39 outputs the image signals related to the moving image 51 and the index image group 53 whose sizes have been changed and set by the screen size changing unit 38 and the index image reduction rate setting unit 36, respectively. Superimposition is performed based on the layout information received from the superimposition position setting unit 37, and the character information 55 is superimposed and combined and output to the monitor 5.

As described above, according to the first embodiment of the present invention, the user simply gives an instruction on the rough arrangement relationship between the moving image that is the subject image and the index image, and the superimposition position setting unit 37 then Depending on the size or number of index images that have been set, the optimal layout of the moving image that is the subject image and the index image is calculated, and on the basis of the calculation result, the screen size is set so that the optimal layout is obtained. The changing unit 38 changes the size of the moving image, and the index image reduction rate setting unit 36 sets the reduction rate of the index image at that time, so that the synthesis processing unit 39 generates an optimum synthesized image. There is an effect that can be.

(Second Embodiment)
Next, a second embodiment of the present invention will be described.

FIG. 5 is a block diagram showing an electrical configuration of the endoscope system according to the second embodiment of the present invention, and FIG. 6 shows an example of a monitor display screen in the endoscope system according to the second embodiment. FIG.

As shown in FIG. 5, the endoscope system 101 of the second embodiment has the same basic configuration as the imaging system 1 of the first embodiment, but combines the subject image and the index image. The video processor 103 that outputs the image information further includes a detection unit 31a that detects whether or not the display position of the character information generated by the OSD generation unit 40 and the index image overlap, and a superposition position setting unit It is characterized in that the layout calculation rules such as 37 are different from those of the first embodiment.

Since the other configuration and operation are the same as those in the first embodiment, only the difference from the first embodiment will be referred to here, and a detailed description of the same configuration and operation as in the first embodiment will be given here. Omitted.

In the second embodiment, as described above, the OSD generation unit 40, under the control of the control unit 31, displays predetermined additional information (character information) related to the subject on the same screen that displays the subject image. It is generated as an on-screen display (OSD).

Then, under the control of the control unit 31, the composition processing unit 39 can superimpose the index image on the same screen on which the subject image is displayed and can superimpose the character information at a predetermined position on the screen. ing.

Furthermore, the control unit 31 further includes a detection unit 31a that detects whether or not the display positions of the character information and the index image overlap, and the synthesis processing unit 39 performs the detection according to the detection result of the detection unit 31a. It is possible to set whether to superimpose the character information.

<Operation of Second Embodiment>
Next, the operation of the second embodiment will be described.

Also in the second embodiment, the moving image that is the subject image and the index image are superposed and synthesized with the optimum screen size under the optimum layout, and output to the monitor 5 is the first. The same operation as the embodiment is performed.

As shown in FIG. 5, in the second embodiment, in the detection unit 31a in the control unit 31, whether the display positions of the character information generated in the OSD generation unit 40 and the index image overlap each other. To detect.

Here, an instruction operation such as displaying the size of the moving image that is the subject image larger than usual or displaying the size of the index image larger is performed by the user's operation, and then the overlapping position setting unit Suppose that 37 calculates the layout of a moving image and an index image that are subject images.

Then, as a result of performing an operation for obtaining an optimum layout in the superimposition position setting unit 37, when these images are superimposed in the synthesis processing unit 39 in view of the arrangement relationship and size between the moving image and the index image, the index image It is assumed that the display position has to overlap with the display position of the character information.

In the second embodiment, when this state is detected by the detection unit 31a in the control unit 31, the control unit 31 controls the OSD generation unit 40 to temporarily erase character information as shown in FIG. Only the moving image 51 and the index image 54 are displayed.

As described above, according to the second embodiment of the present invention, the same effect as that of the first embodiment can be obtained, and the display position of the index image can be changed by changing the size of the subject image or the index image. If it overlaps with character information, it is possible to generate and display a composite image that is easier to view by temporarily erasing the display of the character information.

Furthermore, in the above-described embodiment, the video processor in the endoscope system is exemplified as an apparatus for synthesizing the subject image and the index image. However, the present invention is not limited to this, and the present invention is not limited to an endoscope image, for example. The present invention can also be applied to a video processing apparatus such as a video camera that processes a non-image.

In addition, the present invention is not limited to the above-described embodiment, and various changes and modifications can be made without departing from the scope of the present invention. Embodiments configured in this manner also belong to the present invention.

According to the present invention, it is possible to provide an imaging system capable of displaying a subject image and an index image at appropriate positions regardless of the screen size of the subject image displayed on the monitor.

This application is filed on the basis of the priority claim of Japanese Patent Application No. 2014-226207 filed in Japan on November 6, 2014. The above disclosure is included in the present specification and claims. Shall be quoted.

Claims (4)

An imaging unit for imaging an object and generating an imaging signal;
A moving image generation unit that generates a moving image signal based on the imaging signal;
A release switch for generating an instruction signal for instructing recording of a still image;
A still image generating unit that generates a still image signal from the moving image signal in response to an input of the instruction signal;
A recording unit capable of recording a plurality of still image signals;
An index image generating unit that reads the still image signal from the recording unit and generates an index image signal representing an index image obtained by reducing the still image based on the read still image signal;
A synthesis unit that superimposes the moving image signal and the index image signal so that an index image group including a plurality of index images is superimposed and displayed on a screen on which the moving image is displayed;
A superposition position setting unit that sets a superposition position of the index image group on the moving image by the synthesis unit;
An imaging system comprising: A setting unit for setting a reduction ratio when generating the index image from the still image by the index image generating unit;
The imaging system according to claim 1, further comprising: The imaging system according to claim 2, wherein the setting unit sets the reduction ratio according to a superimposition position of the index image group with respect to the moving image set by the superimposition position setting unit. The synthesis unit can further superimpose character information at a predetermined position on the screen,
A detection unit for detecting whether or not display positions of the character information and the index image overlap;
The imaging system according to claim 2, wherein it is possible to set whether or not to superimpose the character information by the synthesis unit according to a detection result of the detection unit.

Images