[go: up one dir, main page]

WO2025000595A1 - Endoscope system - Google Patents

Endoscope system Download PDF

Info

Publication number
WO2025000595A1
WO2025000595A1 PCT/CN2023/107155 CN2023107155W WO2025000595A1 WO 2025000595 A1 WO2025000595 A1 WO 2025000595A1 CN 2023107155 W CN2023107155 W CN 2023107155W WO 2025000595 A1 WO2025000595 A1 WO 2025000595A1
Authority
WO
WIPO (PCT)
Prior art keywords
endoscope
connecting line
image
module
image processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2023/107155
Other languages
French (fr)
Chinese (zh)
Inventor
陈兴旺
王翔
申晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Himaging Technology Shanghai Co Ltd
Original Assignee
Himaging Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Himaging Technology Shanghai Co Ltd filed Critical Himaging Technology Shanghai Co Ltd
Publication of WO2025000595A1 publication Critical patent/WO2025000595A1/en
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00066Proximal part of endoscope body, e.g. handles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00071Insertion part of the endoscope body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005Flexible endoscopes
    • A61B1/0051Flexible endoscopes with controlled bending of insertion part
    • A61B1/0052Constructional details of control elements, e.g. handles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005Flexible endoscopes
    • A61B1/0051Flexible endoscopes with controlled bending of insertion part
    • A61B1/0055Constructional details of insertion parts, e.g. vertebral elements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005Flexible endoscopes
    • A61B1/0051Flexible endoscopes with controlled bending of insertion part
    • A61B1/0057Constructional details of force transmission elements, e.g. control wires
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/012Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor
    • A61B1/018Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor for receiving instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661Endoscope light sources
    • A61B1/0676Endoscope light sources at distal tip of an endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661Endoscope light sources
    • A61B1/0684Endoscope light sources using light emitting diodes [LED]

Definitions

  • the present application relates to the technical field of disposable endoscopes, and in particular to an endoscope system.
  • the endoscope system combines traditional optics, ergonomics, precision machinery, modern electronics, mathematics, software and other technologies, providing an important means for doctors to inspect, diagnose and operate on the patient's internal cavity. It is widely used in respiratory, digestive, urological, otolaryngology, gynecology and other professional fields. Since the invention of the endoscope, it has undergone multiple rounds of technological iterations, such as soft mirrors replacing hard mirrors, electronic mirrors replacing traditional optical mirrors, and CMOS replacing CCD. At the same time, its application scope has also expanded to multiple professional fields such as urology, digestion, respiration, and minimally invasive surgery. Traditional endoscopes have always appeared in the form of reusable products.
  • disposable endoscopes At present, many companies in the market have successively launched disposable endoscope products for the digestive system and respiratory system. However, compared with traditional reusable endoscopes, disposable endoscopes still have a certain gap in user experience and imaging performance. Because of this, disposable endoscopes are only a beneficial supplement in the entire endoscope market and cannot occupy a dominant position in the market.
  • the current disposable endoscopes have the following problems: First, the performance index gap is obvious. At present, most manufacturers of disposable endoscope products are not traditional reusable endoscope manufacturers. Limited by the experience and ability of professional endoscopic image processing and the limited experience of meeting clinical needs, their products have a large gap with traditional reusable endoscope products in terms of professionalism of endoscopic image processing and clinical control experience.
  • the present specification is proposed to provide an endoscope system that overcomes the above problems or at least partially solves the above problems.
  • an embodiment of the present application provides an endoscope system, comprising an endoscope, a connecting line and an image processor, wherein the endoscope is connected to the image processor via a connecting line; the connecting line and the image processor are aseptically processed in a sterile barrier manner; the endoscope comprises an endoscope head end, wherein the endoscope head end is integrated with a camera lens module, wherein the camera lens module is used to image an imaging scene according to a control signal sent by the image processor, and to stably transmit the collected video signal using a differential data phase dynamic adjustment technology, and to send the acquired video signal to the image processor via a connecting line; the connecting line is used to send the video signal collected by the camera lens module to the image processor for post-processing, and to configure the camera lens module, control the camera lens module to collect images in accordance with a global rolling shutter automatic exposure control method, and forward user button requests on the connecting line for the image processor to respond; the image processor is used to control the endoscope handle; receive user operation signals sent
  • the connecting line is provided with a connecting line FPGA module;
  • the image processor includes an AC/DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip
  • the core main board includes an FPGA image processing module, an isolated power supply and a video output module
  • the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module
  • the FPGA image processing module is connected to the connecting line FPGA module to transmit video signals
  • the video output module includes several video output interfaces
  • the isolated power supply is used to power the connecting line and the endoscope handle
  • the controller is connected to the connecting line FPGA module to transmit control signals.
  • the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.
  • the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.
  • the endoscope also includes an endoscope handle, which includes an instrument Luer connector, an infusion and suction Luer connector, and a multi-lumen tube.
  • an endoscope handle which includes an instrument Luer connector, an infusion and suction Luer connector, and a multi-lumen tube.
  • a clamp channel tube is provided in the multi-lumen tube, and a clamp channel hole corresponding to the size of the clamp channel tube is provided at one end of the multi-lumen tube; the other end of the multi-lumen tube is respectively connected to the instrument Luer connector and the infusion and suction Luer connector through the clamp channel tube.
  • the multi-lumen tube is connected to a serpentine structure, the multi-lumen tube is provided with a wire rope hole, a wire rope is passed through the wire rope hole, the wire rope is fixed at the end of the endoscope head, and the serpentine structure is pulled by the wire rope to drive the end of the endoscope head to bend and swing.
  • the snake-bone structure is in the insertion portion, the end of the endoscope head is located at the head end of the insertion portion, and the insertion portion is composed of a multi-lumen tube integrally formed by an extrusion weaving process.
  • the camera lens module includes a lens, an image sensor, and a number of illumination LEDs.
  • the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method
  • the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, converting digital to analog, and outputting data for each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor through the connecting wire FPGA module in the connecting wire.
  • the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.
  • the present invention uses an FPGA-based endoscope system for image processing algorithms, and combines white light illumination-based early cancer screening and global rolling shutter automatic exposure technology to effectively improve the video image processing performance of endoscope products.
  • the present invention uses a polymer material extrusion weaving process to replace the complex structure of the traditional endoscope insertion part, uses a sterile barrier method to allow the host connection cable to be reused, and uses differential The data phase dynamic adjustment technology ensures the stable transmission of high-speed video signals on low-cost transmission lines.
  • FIG1 is a schematic diagram of the product structure of an endoscope system provided in an embodiment of the present application.
  • FIG2 is a schematic diagram of a top view of the structure of an endoscope provided in an embodiment of the present application.
  • FIG3 is a schematic diagram of the side structure of an endoscope provided in an embodiment of the present application.
  • FIG4 is a schematic structural diagram of a snake bone structure provided in an embodiment of the present application.
  • FIG5 is a schematic diagram of the structure of an image processor provided in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the module structure of the endoscope system provided in an embodiment of the present application.
  • endoscope 100. endoscope; 101. endoscope handle; 101a. instrument Luer connector; 101b. perfusion and suction Luer connector; 101c. multi-lumen tube; 101d. clamp channel hole; 101e. snake-bone structure; 101e-1. wire rope hole; 101e-2. clamp channel position; 101e-3. wire position; 110. connecting wire; 120. image processor.
  • An embodiment of the present application provides an endoscope system.
  • the endoscope system includes an endoscope 100, a connecting line 110 and an image processor 120.
  • the endoscope 100 is connected to the image processor 120 via the connecting line 110.
  • the connecting line 110 and the image processor 120 are aseptically processed in a sterile barrier manner.
  • the endoscope 100 includes an endoscope head end, and the endoscope head end is integrated with a camera lens module.
  • the camera lens module is used The imaging scene is imaged according to the control signal sent by the image processor, and the differential data phase dynamic adjustment technology is used to stably transmit the collected video signal and send it to the image processor through a connecting line.
  • the endoscope 100 also includes an endoscope handle 101, which includes an instrument Luer connector 101a, an infusion and suction Luer connector 101b, and a multi-lumen tube 101c.
  • a clamp channel tube is provided in the multi-lumen tube 101c, and a clamp channel hole 101d adapted to the size of the clamp channel tube is provided at one end of the multi-lumen tube 101c; the other end of the multi-lumen tube 101c is respectively connected to the instrument Luer connector 101a and the infusion and suction Luer connector 101b through the clamp channel tube.
  • the instrument Luer connector 101a and the perfusion and suction Luer connector 101b cross and converge to dock with the clamp channel tube in the multi-lumen tube 101c, and finally lead out from the clamp channel hole at the end of the multi-lumen tube 101c.
  • the embodiment of the present application utilizes this structure to insert instruments such as biopsy forceps, lithotripsy optical fibers, and stone removal baskets from the instrument Luer connector 101a, and then complete functions such as biopsy sampling, radiofrequency ablation, and laser ablation through the clamp channel tube and the clamp channel hole in the multi-lumen tube 101c.
  • the embodiment of the present application can also connect a suction machine or a carbon dioxide gas delivery machine through the perfusion and suction Luer connector 101b, and perform perfusion and suction, carbon dioxide gas injection, and other operations on the end of the endoscope head through the clamp channel tube and the clamp channel hole in the multi-lumen tube.
  • the endoscope of the present application can form various channels through the multi-lumen tube, such as working channels, water vapor channels, etc.
  • the multi-lumen tube 101c is connected to a serpentine structure 101e, the serpentine structure 101e is included in the insertion part, the end of the endoscope head is located at the head end of the insertion part, and the insertion part is composed of a multi-lumen tube integrally formed by an extrusion braiding process.
  • the serpentine structure 101e is provided with a wire rope hole 101e-1, and a wire rope is passed through the wire rope hole 101e-1. The wire rope is fixed at the end of the endoscope head, and the serpentine structure 101e is pulled by the wire rope to drive the end of the endoscope head to bend and swing.
  • wire rope holes 101e-1 are respectively provided on both sides of the snake-bone structure 101e, and two wire ropes can be passed through the wire rope holes 101e-1 on both sides, and then fixed at the end of the endoscope head.
  • the snake-bone structure 101e By pulling the wire rope left and right, the snake-bone structure 101e can drive the end of the endoscope head to bend and swing.
  • the snake structure 101e also reserves a clamp channel position 101e-2 and a wire position 101e-3 for the clamp channel tube and the wire. Since the clamp channel tube and the wire are made of flexible materials, the snake structure 101e can drive the end of the endoscope head to bend as a whole through the drive of the wire rope, and can make the lower half of the endoscope handle 101 swing in multiple directions, thereby realizing image acquisition, perfusion suction, Functions such as biopsy sampling, radiofrequency ablation and laser ablation.
  • the multi-lumen tube of the insertion portion is made by an integrally formed extrusion weaving process.
  • the embodiment of the present application adopts a polymer material extrusion and weaving process to replace the complex structure of the traditional endoscope insertion part.
  • the polymer material extrusion and weaving process forms the outer tube and the inner cavity of the insertion part in one step, providing a working platform for the endoscope working channel, suction channel, signal line, traction wire and other functions.
  • the embodiment of the present application greatly reduces the material cost and production manufacturing cost.
  • the camera lens module includes a camera, an image sensor, and a number of illumination LEDs.
  • the present application implements an integrated camera lens module at the end of the endoscope lens, which can image the scene in front of the endoscope lens.
  • the endoscope lens can integrate two lighting LEDs, which are used to illuminate the scene in front of the endoscope lens.
  • the image processor will power the connecting wire and the endoscope handle.
  • the FPGA image processing module in the image processor and the connecting wire FPGA module in the connecting wire can configure the camera through the IIC bus. After configuration, the camera can perform normal image acquisition functions according to the control method of the global rolling shutter.
  • the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method
  • the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, converting digital to analog, and outputting data for each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor through the connecting wire FPGA module in the connecting wire.
  • the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.
  • a global rolling shutter automatic exposure control method is used for image acquisition.
  • the exposure time of the rolling shutter sensor is set to the maximum.
  • Each row of pixels is exposed, converted to analog, and output in a fixed time sequence to form an image.
  • the image The FPGA image processing module on the processor will analyze the overall brightness of the previously captured image. This brightness value will be further converted into the lighting time of the endoscope lens end.
  • the FPGA module in the connecting line will control the LED light source on the endoscope lens end to illuminate the imaging scene during the time interval from the start of exposure of the last row of the sensor to the end of exposure of the first row.
  • the rolling shutter automatic exposure control method adopted in the embodiment of the present application is consistent with the global shutter exposure effect. Therefore, the embodiment of the present application implements the global shutter function on the rolling shutter image sensor, avoiding the jello effect and other problems that are not conducive to real-time imaging in the rolling shutter image sensor.
  • the present application analyzes the overall brightness of the previously collected image and further converts it into the lighting time of the illumination LED at the end of the endoscope. Since the LED is not continuously lit during the lighting process, the present application reduces the lighting heat at the head end, which is beneficial to improve the signal-to-noise ratio of the head end image sensor.
  • the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.
  • the connecting line is used to send the video signal captured by the camera lens module to the image processor for post-processing, and to configure the camera lens module, control the camera lens module to capture images according to the global rolling shutter automatic exposure control method, and forward the user button request on the connecting line for the image processor to respond.
  • the connecting line converts the signal collected by the image sensor at the end of the endoscope lens into a format suitable for long-distance transmission and sends it to the image processor for post-processing.
  • the camera lens module can also be configured to control the lighting LED and the imaging sensor to complete the automatic exposure function and forward the user button request on the connecting line for the image processor to respond.
  • the image processor is used to control the endoscope handle; receive user operation signals sent by a connecting line; respond to user operations according to the user operation signals, and send control signals to the endoscope handle through the connecting line; receive video signals sent by the endoscope head end through the connecting line, and perform image processing on the video signals.
  • connection line is provided with a connection line FPGA module; an image processor It includes an AC/DC high and low voltage conversion board, a power management board, a core mainboard, a key expansion board, a controller, and an external signal interface chip.
  • the AC/DC high and low voltage conversion board is connected to an AC220V input power supply.
  • the core mainboard includes an FPGA image processing module, an isolated power supply, and a video output module.
  • the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module.
  • the FPGA image processing module is connected to the connecting line FPGA module to transmit video signals.
  • the video output module includes several video output interfaces.
  • the isolated power supply is used to power the connecting line and the endoscope handle.
  • the controller can be an IIC controller, and the controller is connected to the connecting line FPGA module to transmit control signals.
  • the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.
  • connection line and the front panel of the image processor of the embodiment of the present application include multiple buttons.
  • the connection line includes four buttons, and the functions of buttons 1, 2, and 3 can be customized by the user, and can be set to one of multiple functions such as taking pictures, special spectrum imaging, magnification, metering mode adjustment, structure enhancement, hemoglobin enhancement, light source switch, and image rotation 90°.
  • Button 4 can call out a prompt bar to display information such as the current function, timing, endoscope type, and custom buttons.
  • the front panel of the image processor may include 11 buttons. Among them, two function buttons are respectively used to adjust the structure enhancement level and the method of image brightness evaluation in the automatic exposure function. In addition, there are 9 buttons in a 3*3 array, from top to bottom, respectively, user-defined button 1, white balance/up button, return button, electronic zoom/left button, menu button, photo browsing/right button, user-defined button 2, photo/down button and confirmation button.
  • User-defined buttons 1 and 2 can be defined by the user as light source switch, special spectrum imaging, hemoglobin enhancement and image rotation 90°.
  • the white balance/up, electronic zoom/left, photo browsing/right, and photo/down buttons can complete the functions of white balance, electronic zoom, photo browsing, and photo.
  • these buttons can respectively realize the functions of up, left, right, and down in the menu operation.
  • the menu button can complete the function of menu call out.
  • the confirmation and return buttons can respectively complete the functions of menu selection and menu return.
  • the FPGA module in the connection line when a button on the connection line is clicked, the FPGA module in the connection line will first receive the button request. Then, it will send this request to the image processor via the IIC bus in the connection line. The IIC controller in the processor is finally sent to the FPGA image processing module for corresponding function response.
  • the key expansion board When the front panel button is clicked, the key expansion board will generate a corresponding key request, which will be further passed to the IIC controller and finally sent to the FPGA image processing module to respond to the function selection.
  • the embodiment of the present application designs a USB interface on the front and back panels of the image processor respectively.
  • the USB interface is connected to the USB PHY chip (corresponding to the external signal interface chip), and then finally connected to the FPGA image processing module.
  • the user can insert a storage device such as a USB flash drive into the USB interface, or insert an input device such as a keyboard.
  • the user can also choose to store the captured pictures in a USB flash drive, or use the keyboard to operate the interface and input characters.
  • a video signal sent by an endoscope head end is received through a connecting line, and image processing is performed on the video signal, including characteristic spectral color conversion processing under white light illumination and hemoglobin enhancement processing under white light illumination on the collected image.
  • V540 and V415 represent the flux-to-power conversion ratio of 540nm and 415nm light
  • GVg and GVb represent the green and blue pixel grayscale values recovered from the CMOS sensor (corresponding to the image sensor) after FPGA processing (i.e., the blue-green grayscale values of the image obtained after interpolation of the original image data)
  • ⁇ l and ⁇ h are the highest and lowest wavelengths of the light source
  • Qe is the relative quantum efficiency of the current pixel for light of a specific wavelength
  • ⁇ s is the relative luminous flux of light of a specific wavelength in the light source
  • V ⁇ is the flux-to-power conversion coefficient of light of a specific wavelength.
  • the endoscope is connected to the image processor via a connecting line.
  • the endoscope can complete functions such as lighting and control, high-definition video image acquisition, perfusion and suction, and provide channels for other endoscopic surgical instruments to realize functions such as biopsy sampling, radiofrequency ablation, laser ablation, etc.
  • the end of the endoscope can be controlled to bend to traverse various angles of the human body cavity in clinical practice; the connecting line converts the signal collected by the head-end imaging sensor into a format suitable for long-distance transmission and sends it to the image processor for post-processing, and can configure the head-end sensor, control the head-end LED and imaging sensor to complete the automatic exposure function and forward the user button request on the connecting line for the image processor to respond.
  • the image processor controls each module of the endoscope, receives the video signal and user operation signal transmitted by the connecting line, performs image processing on the video signal respectively, responds to the user operation and sends a control signal to the endoscope handle. After the video signal is processed, it is finally output to the screen in a specific format by the output module.
  • the image processor can also provide stable power supply for each part of the endoscope so that each part meets the safety standards related to medical devices.
  • the image signal is collected by the head-end image sensor and transmitted to the image processor via the connecting line.
  • the FPGA image processing module receives the collected image signal and performs image processing to complete functions such as denoising, enhancement, and sharpening, and finally forms a video image signal that meets the requirements of endoscopic detection.
  • the endoscope head integrates a camera lens module to image the scene in front of the head.
  • the head can integrate two lighting LEDs, which can illuminate the scene in front of the head.
  • the host will power the connecting cable and the handle. After that, the FPGA module in the host and the connecting cable will configure the camera through the IIC bus. After configuration, the camera can perform normal image acquisition functions according to the control method of the global rolling shutter.
  • the signal collected by the camera is first transmitted to the FPGA module in the connecting line through the connecting line or FPC (flexible circuit board) in the multi-lumen tube.
  • the module will convert the signal to a level more suitable for long-distance transmission through the signal line in the connecting line and transmit it to the image processor. Due to the long distance of the transmission line, the stable transmission of high-speed video signals needs to rely on high-quality and high-cost signal transmission lines, especially the impedance accuracy of differential signal lines. This is inconsistent with the original intention of low cost of disposable endoscopes.
  • the present application targets possible receiving end error sampling caused by high-speed signal distortion.
  • the image processor dynamically adjusts the phase difference between the signal clock and the data, and receives and evaluates the receiving bit error rate under the phase difference in real time, thereby obtaining stable signal reception and ensuring the quality of image signal transmission.
  • This application is based on materials engineering, production process, electronics, software, optical engineering, image processing, etc.
  • the design of the domain realizes global rolling shutter automatic exposure control, perfusion suction, biopsy sampling, radio frequency and laser ablation, image acquisition and image signal transmission, image processing, video output, button and interface response and other functions.
  • the endoscope system provided by this application adopts FPGA-based endoscope image processing algorithms, early cancer screening based on white light illumination, global rolling shutter automatic exposure and other technologies, which effectively improves the video image processing performance of endoscope products.
  • a polymer material extrusion weaving process is used to replace the complex structure of the traditional endoscope insertion part, a sterile barrier method is used to enable the host connection cable to be reused, and differential data phase dynamic adjustment technology is used to ensure the stable transmission of high-speed video signals on low-cost transmission lines.
  • the present application adopts a polymer material extrusion weaving process to replace the complex structure of the traditional endoscope insertion part, adopts a sterile barrier method to allow the host connection cable to be reused, and adopts differential data phase dynamic adjustment technology to ensure the stable transmission of high-speed video signals on low-cost transmission lines. Under the premise of ensuring performance indicators, the material and production costs of the product are further reduced.
  • this application uses FPGA-based endoscope image processing algorithms, white light illumination-based early cancer screening, global rolling shutter automatic exposure and other technologies to effectively improve the video image processing performance of endoscope products, avoid problems such as the jelly effect, reduce the impact of lighting on the head end temperature, and improve the imaging signal-to-noise ratio.
  • the above measures have raised the core performance of endoscope products—video image processing—to the level of mainstream multiplexed endoscopes in the market, laying a solid foundation for disposable endoscope products to replace multiplexed products and completely eliminate the threat of cross-infection.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Signal Processing (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)

Abstract

An endoscope system, comprising an endoscope (100), a connecting line (110) and an image processor (120), wherein the endoscope (100) is connected to the image processor (120) by means of the connecting line (110); the endoscope (100) comprises an endoscope head end; the connecting line (110) is used for sending a video signal, which is collected by a camera lens module, to the image processor (120) for post-processing; and the image processor (120) is used for receiving, by means of the connecting line (110), a video signal which is sent by the endoscope head end, and performing image processing on the video signal. The video image processing performance of an endoscope product is effectively improved; moreover, a polymer material extrusion and braiding process is used to replace the complex structure of a traditional endoscope insertion portion, and a sterile barrier method is used, such that a host connecting cable is reused, and thus, the stable transmission of a high-speed video signal on a low-cost transmission line is ensured and, on the basis of an improvement in cost control, a disposable endoscope has a product performance index that is comparable to that of a reusable endoscope.

Description

一种内窥镜系统Endoscope system 技术领域Technical Field

本申请涉及一次性内窥镜技术领域,具体涉及一种内窥镜系统。The present application relates to the technical field of disposable endoscopes, and in particular to an endoscope system.

背景技术Background Art

内窥镜系统结合了传统光学、人体工程学、精密机械、现代电子、数学、软件等技术,为医生对患者内腔道的检查、诊断、手术提供了重要的手段,广泛应用于呼吸、消化、泌尿、耳鼻咽喉科、妇科等专业方向。自内窥镜被发明以来,经历了软镜替代硬镜、电子镜替代传统光学镜、CMOS替代CCD等多轮技术迭代,同时其应用范围也扩展到泌尿、消化、呼吸、微创手术等多个专业方向。传统内窥镜一直以复用型产品的形态出现。使用后的内窥镜经过高水平消毒或灭菌后重复使用。然而,近年来内窥镜交叉感染风险因为一系列事故而被大家广泛认知,作为彻底消除交叉感染风险的解决方案,内窥镜耗材化成为内窥镜行业的重要发展方向。The endoscope system combines traditional optics, ergonomics, precision machinery, modern electronics, mathematics, software and other technologies, providing an important means for doctors to inspect, diagnose and operate on the patient's internal cavity. It is widely used in respiratory, digestive, urological, otolaryngology, gynecology and other professional fields. Since the invention of the endoscope, it has undergone multiple rounds of technological iterations, such as soft mirrors replacing hard mirrors, electronic mirrors replacing traditional optical mirrors, and CMOS replacing CCD. At the same time, its application scope has also expanded to multiple professional fields such as urology, digestion, respiration, and minimally invasive surgery. Traditional endoscopes have always appeared in the form of reusable products. Used endoscopes are reused after high-level disinfection or sterilization. However, in recent years, the risk of cross-infection of endoscopes has been widely recognized by everyone due to a series of accidents. As a solution to completely eliminate the risk of cross-infection, endoscope consumables have become an important development direction of the endoscope industry.

目前市场上许多公司陆续推出了消化系统和呼吸系统的一次性内窥镜产品。但与传统复用性内窥镜相比,一次性内窥镜在使用体验、成像性能方面仍存在着一定的差距。正因为如此,一次性内窥镜在整个内窥镜市场中仅仅作为有益的补充,还无法占据市场的主导地位。当前的一次性内窥镜存在以下问题:第一,性能指标差距明显。目前一次性内窥镜产品制造商大都不是传统复用型内窥镜制造商,受限于专业内窥镜图像处理经验和能力以及临床需求满足的有限经验,他们的产品在内窥镜图像处理的专业性和临床操控体验上和传统复用型内窥镜产品存在较大差距。第二,成本控制水平和市场预期差距明显,内窥镜从复用性变为一次性,在每次检查或诊断中,增加了耗材的成本,这些成本的增加使市场对该产品的接受程度受到支付能力的严重影响,从而影响了内窥镜耗材化替代的进展。这些问题限制了一次性内窥镜产品对复用型产品的替代进度,使得该类产品仍然仅仅作为内窥镜市场的有益补充,在大多数场景中,患者仍然不得不承受交叉感染的威胁。 At present, many companies in the market have successively launched disposable endoscope products for the digestive system and respiratory system. However, compared with traditional reusable endoscopes, disposable endoscopes still have a certain gap in user experience and imaging performance. Because of this, disposable endoscopes are only a beneficial supplement in the entire endoscope market and cannot occupy a dominant position in the market. The current disposable endoscopes have the following problems: First, the performance index gap is obvious. At present, most manufacturers of disposable endoscope products are not traditional reusable endoscope manufacturers. Limited by the experience and ability of professional endoscopic image processing and the limited experience of meeting clinical needs, their products have a large gap with traditional reusable endoscope products in terms of professionalism of endoscopic image processing and clinical control experience. Second, there is a significant gap between the cost control level and market expectations. The endoscope has changed from reusable to disposable, and the cost of consumables has increased in each examination or diagnosis. The increase in these costs has seriously affected the market's acceptance of the product by the ability to pay, thereby affecting the progress of endoscope consumable substitution. These problems limit the progress of disposable endoscope products replacing reusable products, making such products still only a beneficial supplement to the endoscope market. In most scenarios, patients still have to bear the threat of cross-infection.

发明内容Summary of the invention

鉴于上述问题,提出了本说明书以便提供一种克服上述问题或者至少部分地解决上述问题的一种内窥镜系统。In view of the above problems, the present specification is proposed to provide an endoscope system that overcomes the above problems or at least partially solves the above problems.

本发明公开的其他特性和优点将通过下面的详细描述变得显然,或部分地通过本公开的实践而习得。Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

第一方面,本申请实施例提供了一种内窥镜系统,包括内窥镜、连接线以及图像处理器,内窥镜通过连接线与图像处理器进行连接;连接线以及图像处理器采用无菌屏障方式进行无菌处理;内窥镜包括内窥镜头端,内窥镜头端集成有摄像头镜头模块,摄像头镜头模块用于根据图像处理器发送的控制信号对成像场景进行成像,并采用差分数据相位动态调整技术将采集的视频信号进行稳定传输、并通过连接线发送至图像处理器;连接线,用于将摄像头镜头模块采集的视频信号发送至图像处理器进行后处理,并对摄像头镜头模块进行配置,控制摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,并转发连接线上面的用户按键请求供图像处理器响应;图像处理器,用于对内窥镜手柄进行控制;接收连接线发送的用户操作信号;根据用户操作信号响应用户操作、并通过连接线向内窥镜手柄发送控制信号;通过连接线接收内窥镜头端发送的视频信号、并对视频信号进行图像处理。In a first aspect, an embodiment of the present application provides an endoscope system, comprising an endoscope, a connecting line and an image processor, wherein the endoscope is connected to the image processor via a connecting line; the connecting line and the image processor are aseptically processed in a sterile barrier manner; the endoscope comprises an endoscope head end, wherein the endoscope head end is integrated with a camera lens module, wherein the camera lens module is used to image an imaging scene according to a control signal sent by the image processor, and to stably transmit the collected video signal using a differential data phase dynamic adjustment technology, and to send the acquired video signal to the image processor via a connecting line; the connecting line is used to send the video signal collected by the camera lens module to the image processor for post-processing, and to configure the camera lens module, control the camera lens module to collect images in accordance with a global rolling shutter automatic exposure control method, and forward user button requests on the connecting line for the image processor to respond; the image processor is used to control the endoscope handle; receive user operation signals sent by the connecting line; respond to user operations according to the user operation signals, and send control signals to the endoscope handle via the connecting line; receive the video signal sent by the endoscope head end via the connecting line, and perform image processing on the video signal.

在一些实施例中,连接线设有连接线FPGA模块;图像处理器包括AC/DC高低压转换板、电源管理板、核心主板、按键扩展板、控制器、外部信号接口芯片,核心主板包括FPGA图像处理模块、隔离电源和视频输出模块;FPGA图像处理模块分别与电源管理板、外部信号接口芯片、控制器、连接线FPGA模块连接,FPGA图像处理模块与连接线FPGA模块连接以传输视频信号;视频输出模块包括若干个视频输出接口;隔离电源用于为连接线以及内窥镜手柄进行供电;控制器通过与连接线FPGA模块连接以传输控制信号。In some embodiments, the connecting line is provided with a connecting line FPGA module; the image processor includes an AC/DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip, and the core main board includes an FPGA image processing module, an isolated power supply and a video output module; the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module, and the FPGA image processing module is connected to the connecting line FPGA module to transmit video signals; the video output module includes several video output interfaces; the isolated power supply is used to power the connecting line and the endoscope handle; the controller is connected to the connecting line FPGA module to transmit control signals.

在一些实施例中,按键扩展板连接有前面板按键,按键扩展板与控制器连接,外部信号接口芯片连接有前面板USB接口以及后面板USB接口,若干个视频输出接口包括但不限于CVBS接口、S-Video接口、VGA接口、DVI接口。 In some embodiments, the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.

在一些实施例中,FPGA图像处理模块和连接线FPGA模块通过IIC总线对摄像头镜头模块进行配置;摄像头镜头模块配置完成后按照全局卷帘快门自动曝光控制方式进行图像采集。In some embodiments, the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.

在一些实施例中,内窥镜还包括内窥镜手柄,内窥镜手柄包括器械鲁尔接头、灌注吸引鲁尔接头以及多腔管,多腔管中设置有钳道管,多腔管的一端设置有与钳道管尺寸相适应的钳道孔;多腔管的另一端通过钳道管分别与器械鲁尔接头和灌注吸引鲁尔接头对接。In some embodiments, the endoscope also includes an endoscope handle, which includes an instrument Luer connector, an infusion and suction Luer connector, and a multi-lumen tube. A clamp channel tube is provided in the multi-lumen tube, and a clamp channel hole corresponding to the size of the clamp channel tube is provided at one end of the multi-lumen tube; the other end of the multi-lumen tube is respectively connected to the instrument Luer connector and the infusion and suction Luer connector through the clamp channel tube.

在一些实施例中,多腔管连接有蛇骨结构,多腔管设置有钢丝绳孔,钢丝绳孔穿有钢丝绳,钢丝绳在内窥镜头端进行固定,蛇骨结构通过钢丝绳进行牵引、以带动内窥镜头端进行弯曲摆动。In some embodiments, the multi-lumen tube is connected to a serpentine structure, the multi-lumen tube is provided with a wire rope hole, a wire rope is passed through the wire rope hole, the wire rope is fixed at the end of the endoscope head, and the serpentine structure is pulled by the wire rope to drive the end of the endoscope head to bend and swing.

在一些实施例中,蛇骨结构处于插入部,内窥镜头端位于插入部头端,并且插入部由挤出编织工艺一体成型的多腔管组成。In some embodiments, the snake-bone structure is in the insertion portion, the end of the endoscope head is located at the head end of the insertion portion, and the insertion portion is composed of a multi-lumen tube integrally formed by an extrusion weaving process.

在一些实施例中,摄像头镜头模块包括镜头、图像传感器以及若干个照明LED。In some embodiments, the camera lens module includes a lens, an image sensor, and a number of illumination LEDs.

在一些实施例中,摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,摄像头镜头模块中的图像传感器为卷帘快门传感器,包括:设置卷帘快门传感器的曝光时间;基于曝光时间,将卷帘快门传感器采集到的每行像素以固定预设时间差顺序进行曝光、数模转化和数据输出;通过连接线内的连接线FPGA模块控制内窥镜头端上的照明LED在卷帘快门传感器从最后一行曝光开始至第一行曝光结束的时间间隔内照亮成像场景。In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, converting digital to analog, and outputting data for each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor through the connecting wire FPGA module in the connecting wire.

在一些实施例中,摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,还包括:在对卷帘快门传感器采集到的每行像素进行曝光过程中,图像处理器的FPGA图像处理模块获取历史采集图像的整体亮度,并将历史采集图像的整体亮度转化为内窥镜头端照明LED的点亮时间。In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.

本发明采用基于FPGA的内窥镜系统进行图像处理算法,同时结合基于白光照明的早癌筛查、全局卷帘快门自动曝光技术,有效提升了内窥镜产品的视频图像处理性能。同时,本发明采用了高分子材料挤出编织工艺替代传统内窥镜插入部的复杂结构,采用无菌屏障方式使得主机连接线缆得以复用,采用差 分数据相位动态调整技术确保了高速视频信号在低成本传输线上的稳定传输。通过以上创新设计,本发明实现了一次性内窥镜在成本控制改善的基础上产品性能指标和复用型内窥镜可比。The present invention uses an FPGA-based endoscope system for image processing algorithms, and combines white light illumination-based early cancer screening and global rolling shutter automatic exposure technology to effectively improve the video image processing performance of endoscope products. At the same time, the present invention uses a polymer material extrusion weaving process to replace the complex structure of the traditional endoscope insertion part, uses a sterile barrier method to allow the host connection cable to be reused, and uses differential The data phase dynamic adjustment technology ensures the stable transmission of high-speed video signals on low-cost transmission lines. Through the above innovative design, the present invention realizes that the product performance indicators of disposable endoscopes are comparable to those of multiplexed endoscopes on the basis of cost control improvement.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

图1是本申请实施例提供的内窥镜系统的产品结构示意图;FIG1 is a schematic diagram of the product structure of an endoscope system provided in an embodiment of the present application;

图2是本申请实施例提供的内窥镜的俯视结构示意图;FIG2 is a schematic diagram of a top view of the structure of an endoscope provided in an embodiment of the present application;

图3是本申请实施例提供的内窥镜的侧视结构示意图;FIG3 is a schematic diagram of the side structure of an endoscope provided in an embodiment of the present application;

图4是本申请实施例提供的蛇骨结构的结构示意图;FIG4 is a schematic structural diagram of a snake bone structure provided in an embodiment of the present application;

图5是本申请实施例提供的图像处理器的结构示意图;FIG5 is a schematic diagram of the structure of an image processor provided in an embodiment of the present application;

图6是本申请实施例提供的内窥镜系统的模块结构示意图。FIG. 6 is a schematic diagram of the module structure of the endoscope system provided in an embodiment of the present application.

100、内窥镜,101、内窥镜手柄,101a、器械鲁尔接头,101b、灌注吸引鲁尔接头,101c、多腔管,101d、钳道孔,101e、蛇骨结构,101e-1、钢丝绳孔,101e-2、钳道位,101e-3、线材位,110、连接线,120、图像处理器。100. endoscope; 101. endoscope handle; 101a. instrument Luer connector; 101b. perfusion and suction Luer connector; 101c. multi-lumen tube; 101d. clamp channel hole; 101e. snake-bone structure; 101e-1. wire rope hole; 101e-2. clamp channel position; 101e-3. wire position; 110. connecting wire; 120. image processor.

具体实施方式DETAILED DESCRIPTION

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

本申请实施例提供了一种内窥镜系统。An embodiment of the present application provides an endoscope system.

在本申请实施例中,如图1及图6所示,该内窥镜系统包括内窥镜100、连接线110以及图像处理器120,内窥镜100通过连接线110与图像处理器120进行连接;连接线110以及图像处理器120采用无菌屏障方式进行无菌处理;内窥镜100包括内窥镜头端,内窥镜头端集成有摄像头镜头模块,摄像头镜头模块用 于根据图像处理器发送的控制信号对成像场景进行成像,并采用差分数据相位动态调整技术将采集的视频信号进行稳定传输、并通过连接线发送至图像处理器。In the embodiment of the present application, as shown in FIG. 1 and FIG. 6 , the endoscope system includes an endoscope 100, a connecting line 110 and an image processor 120. The endoscope 100 is connected to the image processor 120 via the connecting line 110. The connecting line 110 and the image processor 120 are aseptically processed in a sterile barrier manner. The endoscope 100 includes an endoscope head end, and the endoscope head end is integrated with a camera lens module. The camera lens module is used The imaging scene is imaged according to the control signal sent by the image processor, and the differential data phase dynamic adjustment technology is used to stably transmit the collected video signal and send it to the image processor through a connecting line.

在一些实施例中,如图2以及图3所示,内窥镜100还包括内窥镜手柄101,内窥镜手柄101包括器械鲁尔接头101a、灌注吸引鲁尔接头101b以及多腔管101c,多腔管101c中设置有钳道管,多腔管101c的一端设置有与钳道管尺寸相适应的钳道孔101d;多腔管101c的另一端通过钳道管分别与器械鲁尔接头101a和灌注吸引鲁尔接头101b对接。In some embodiments, as shown in Figures 2 and 3, the endoscope 100 also includes an endoscope handle 101, which includes an instrument Luer connector 101a, an infusion and suction Luer connector 101b, and a multi-lumen tube 101c. A clamp channel tube is provided in the multi-lumen tube 101c, and a clamp channel hole 101d adapted to the size of the clamp channel tube is provided at one end of the multi-lumen tube 101c; the other end of the multi-lumen tube 101c is respectively connected to the instrument Luer connector 101a and the infusion and suction Luer connector 101b through the clamp channel tube.

在本申请实施例中,器械鲁尔接头101a、灌注吸引鲁尔接头101b交叉汇聚与多腔管101c中钳道管对接,最终由多腔管101c末端的钳道孔导出。本申请实施例利用这一结构可以从器械鲁尔接头101a插入活检钳、碎石光纤、取石网篮等器械,进而通过多腔管101c中钳道管以及钳道孔完成活检取样、射频消融和激光消融等功能。本申请实施例也可以通过灌注吸引鲁尔接头101b连接抽吸机或二氧化碳送气机,通过多腔管内钳道管以及钳道孔对内窥镜头端处进行灌注吸引、二氧化碳注气等操作。本申请内窥镜通过多腔管可形成各种通道,比如工作通道、水汽通道等。In the embodiment of the present application, the instrument Luer connector 101a and the perfusion and suction Luer connector 101b cross and converge to dock with the clamp channel tube in the multi-lumen tube 101c, and finally lead out from the clamp channel hole at the end of the multi-lumen tube 101c. The embodiment of the present application utilizes this structure to insert instruments such as biopsy forceps, lithotripsy optical fibers, and stone removal baskets from the instrument Luer connector 101a, and then complete functions such as biopsy sampling, radiofrequency ablation, and laser ablation through the clamp channel tube and the clamp channel hole in the multi-lumen tube 101c. The embodiment of the present application can also connect a suction machine or a carbon dioxide gas delivery machine through the perfusion and suction Luer connector 101b, and perform perfusion and suction, carbon dioxide gas injection, and other operations on the end of the endoscope head through the clamp channel tube and the clamp channel hole in the multi-lumen tube. The endoscope of the present application can form various channels through the multi-lumen tube, such as working channels, water vapor channels, etc.

在一些实施例中,如图4所示,多腔管101c连接有蛇骨结构101e,蛇骨结构101e包含于插入部中,内窥镜头端位于插入部的头端,并且插入部由挤出编织工艺一体成型的多腔管组成。蛇骨结构101e设置有钢丝绳孔101e-1,钢丝绳孔101e-1穿有钢丝绳,钢丝绳在内窥镜头端进行固定,蛇骨结构101e通过钢丝绳进行牵引、以带动内窥镜头端进行弯曲摆动。In some embodiments, as shown in FIG. 4 , the multi-lumen tube 101c is connected to a serpentine structure 101e, the serpentine structure 101e is included in the insertion part, the end of the endoscope head is located at the head end of the insertion part, and the insertion part is composed of a multi-lumen tube integrally formed by an extrusion braiding process. The serpentine structure 101e is provided with a wire rope hole 101e-1, and a wire rope is passed through the wire rope hole 101e-1. The wire rope is fixed at the end of the endoscope head, and the serpentine structure 101e is pulled by the wire rope to drive the end of the endoscope head to bend and swing.

具体地,本申请实施例中在蛇骨结构101e两侧分别开设钢丝绳孔101e-1,两侧的钢丝绳孔101e-1可以穿过两条钢丝绳,然后在内窥镜头端进行固定。通过钢丝绳左右牵引,蛇骨结构101e可以带动内窥镜头端进行弯曲摆动。Specifically, in the embodiment of the present application, wire rope holes 101e-1 are respectively provided on both sides of the snake-bone structure 101e, and two wire ropes can be passed through the wire rope holes 101e-1 on both sides, and then fixed at the end of the endoscope head. By pulling the wire rope left and right, the snake-bone structure 101e can drive the end of the endoscope head to bend and swing.

在本申请实施例中,蛇骨结构101e还为钳道管与线材预留了钳道位101e-2以及线材位101e-3,由于钳道管和线材采用柔性材料,经过钢丝绳的带动,蛇骨结构101e可以带动内窥镜头端进行整体弯曲,并且可以使得内窥镜手柄101的下半部进行多方向的摆动,从而在多方向上实现图像采集、灌注吸引、 活检取样、射频消融和激光消融等功能。In the embodiment of the present application, the snake structure 101e also reserves a clamp channel position 101e-2 and a wire position 101e-3 for the clamp channel tube and the wire. Since the clamp channel tube and the wire are made of flexible materials, the snake structure 101e can drive the end of the endoscope head to bend as a whole through the drive of the wire rope, and can make the lower half of the endoscope handle 101 swing in multiple directions, thereby realizing image acquisition, perfusion suction, Functions such as biopsy sampling, radiofrequency ablation and laser ablation.

在本申请实施例中,插入部多腔管采用一体成型的挤出编织工艺制成。In the embodiment of the present application, the multi-lumen tube of the insertion portion is made by an integrally formed extrusion weaving process.

本申请实施例采用了高分子材料挤出编织工艺替代传统内窥镜插入部的复杂结构,高分子材料挤出编织工艺将插入部的外管和内腔一次成型,为内窥镜工作通道、吸引通道、信号线、牵引钢丝等功能提供工作平台,相比传统内窥镜插入部多个腔管嵌套的工艺,本申请实施例大大降低了材料成本和生产制造成本。The embodiment of the present application adopts a polymer material extrusion and weaving process to replace the complex structure of the traditional endoscope insertion part. The polymer material extrusion and weaving process forms the outer tube and the inner cavity of the insertion part in one step, providing a working platform for the endoscope working channel, suction channel, signal line, traction wire and other functions. Compared with the traditional process of nesting multiple lumens of the endoscope insertion part, the embodiment of the present application greatly reduces the material cost and production manufacturing cost.

在一些实施例中,摄像头镜头模块包括摄像头、图像传感器以及若干个照明LED。In some embodiments, the camera lens module includes a camera, an image sensor, and a number of illumination LEDs.

本申请实施内窥镜头端集成摄像头镜头模块,可以对内窥镜头端前方的场景进行成像。内窥镜头端可以集成两个照明LED,照明LED用于照明内窥镜头端前方场景。在图像处理器开机过程中,图像处理器会为连接线和内窥镜手柄供电。之后,图像处理器内的FPGA图像处理模块和连接线内的连接线FPGA模块可以通过IIC总线对摄像头进行配置。配置后摄像头就能按照全局卷帘快门的控制方式执行正常的图像采集功能。The present application implements an integrated camera lens module at the end of the endoscope lens, which can image the scene in front of the endoscope lens. The endoscope lens can integrate two lighting LEDs, which are used to illuminate the scene in front of the endoscope lens. During the startup of the image processor, the image processor will power the connecting wire and the endoscope handle. Afterwards, the FPGA image processing module in the image processor and the connecting wire FPGA module in the connecting wire can configure the camera through the IIC bus. After configuration, the camera can perform normal image acquisition functions according to the control method of the global rolling shutter.

在一些实施例中,摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,摄像头镜头模块中的图像传感器为卷帘快门传感器,包括:设置卷帘快门传感器的曝光时间;基于曝光时间,将卷帘快门传感器采集到的每行像素以固定预设时间差顺序进行曝光、数模转化和数据输出;通过连接线内的连接线FPGA模块控制内窥镜头端上的照明LED在卷帘快门传感器从最后一行曝光开始至第一行曝光结束的时间间隔内照亮成像场景。In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, including: setting the exposure time of the rolling shutter sensor; based on the exposure time, exposing, converting digital to analog, and outputting data for each row of pixels acquired by the rolling shutter sensor in a fixed preset time difference sequence; controlling the lighting LED on the end of the endoscope lens to illuminate the imaging scene during the time interval from the start of exposure of the last row to the end of exposure of the first row of the rolling shutter sensor through the connecting wire FPGA module in the connecting wire.

在一些实施例中,摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,还包括:在对卷帘快门传感器采集到的每行像素进行曝光过程中,图像处理器的FPGA图像处理模块获取历史采集图像的整体亮度,并将历史采集图像的整体亮度转化为内窥镜头端照明LED的点亮时间。In some embodiments, the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and also includes: during the exposure process of each row of pixels acquired by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical acquired image, and converts the overall brightness of the historical acquired image into the lighting time of the lighting LED at the end of the endoscope lens.

在本申请实施例中,采用了全局卷帘快门自动曝光控制方式进行图像采集。卷帘快门传感器的曝光时间被设置为最大。其每行像素以一固定时间差顺序进行曝光、数模转化和数据输出后形成图像。在传感器进行曝光的过程中,图像 处理器上的FPGA图像处理模块会分析之前采集图像的整体亮度,该亮度值会进一步转化为内窥镜头端点亮时间,最终由连接线内的FPGA模块控制内窥镜头端上的LED光源在传感器最后一行曝光开始至第一行曝光结束时间间隔内照亮成像场景。In the embodiment of the present application, a global rolling shutter automatic exposure control method is used for image acquisition. The exposure time of the rolling shutter sensor is set to the maximum. Each row of pixels is exposed, converted to analog, and output in a fixed time sequence to form an image. During the exposure process of the sensor, the image The FPGA image processing module on the processor will analyze the overall brightness of the previously captured image. This brightness value will be further converted into the lighting time of the endoscope lens end. Finally, the FPGA module in the connecting line will control the LED light source on the endoscope lens end to illuminate the imaging scene during the time interval from the start of exposure of the last row of the sensor to the end of exposure of the first row.

由于内镜检查过程中,体内环境由内镜手柄头端的LED光源唯一照明,且在此时间内,传感器的所有像素单元同时接收外界光线曝光,所以本申请实施例采用的卷帘快门自动曝光控制方式与全局快门曝光效果一致。因此,本申请实施例在卷帘快门图像传感器上实现了全局快门功能,避免了卷帘快门图像传感器存在的果冻效应等不利于实时成像的问题。另外,本申请分析之前采集图像的整体亮度从而进一步转化为内窥镜头端照明LED的点亮时间,由于LED没有在照明过程中连续点亮,本申请降低了头端的照明发热,从而有利于提高头端图像传感器的信噪比。Since during the endoscopic examination, the internal environment is only illuminated by the LED light source at the head end of the endoscope handle, and during this time, all pixel units of the sensor receive external light exposure at the same time, the rolling shutter automatic exposure control method adopted in the embodiment of the present application is consistent with the global shutter exposure effect. Therefore, the embodiment of the present application implements the global shutter function on the rolling shutter image sensor, avoiding the jello effect and other problems that are not conducive to real-time imaging in the rolling shutter image sensor. In addition, the present application analyzes the overall brightness of the previously collected image and further converts it into the lighting time of the illumination LED at the end of the endoscope. Since the LED is not continuously lit during the lighting process, the present application reduces the lighting heat at the head end, which is beneficial to improve the signal-to-noise ratio of the head end image sensor.

在一些实施例中,FPGA图像处理模块和连接线FPGA模块通过IIC总线对摄像头镜头模块进行配置;摄像头镜头模块配置完成后按照全局卷帘快门自动曝光控制方式进行图像采集。In some embodiments, the FPGA image processing module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method.

在一些实施例中,连接线用于将摄像头镜头模块采集的视频信号发送至图像处理器进行后处理,并对摄像头镜头模块进行配置,控制摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,并转发连接线上面的用户按键请求供图像处理器响应。In some embodiments, the connecting line is used to send the video signal captured by the camera lens module to the image processor for post-processing, and to configure the camera lens module, control the camera lens module to capture images according to the global rolling shutter automatic exposure control method, and forward the user button request on the connecting line for the image processor to respond.

在本申请实施例中,连接线将内窥镜头端的图像传感器采集到的信号转换为适合远距离传输的格式发送给图像处理器进行后处理,并可以对摄像头镜头模块进行配置,控制照明LED和成像传感器完成自动曝光功能并转发连接线上面的用户按键请求供图像处理器响应。In an embodiment of the present application, the connecting line converts the signal collected by the image sensor at the end of the endoscope lens into a format suitable for long-distance transmission and sends it to the image processor for post-processing. The camera lens module can also be configured to control the lighting LED and the imaging sensor to complete the automatic exposure function and forward the user button request on the connecting line for the image processor to respond.

在一些实施例中,如图5所示,图像处理器,用于对内窥镜手柄进行控制;接收连接线发送的用户操作信号;根据用户操作信号响应用户操作、并通过连接线向内窥镜手柄发送控制信号;通过连接线接收内窥镜头端发送的视频信号、并对视频信号进行图像处理。In some embodiments, as shown in FIG. 5 , the image processor is used to control the endoscope handle; receive user operation signals sent by a connecting line; respond to user operations according to the user operation signals, and send control signals to the endoscope handle through the connecting line; receive video signals sent by the endoscope head end through the connecting line, and perform image processing on the video signals.

在一些实施例中,如图6所示,连接线设有连接线FPGA模块;图像处理器 包括AC/DC高低压转换板、电源管理板、核心主板、按键扩展板、控制器、外部信号接口芯片,AC/DC高低压转换板接入AC220V输入电源,核心主板包括FPGA图像处理模块、隔离电源和视频输出模块;FPGA图像处理模块分别与电源管理板、外部信号接口芯片、控制器、连接线FPGA模块连接,FPGA图像处理模块与连接线FPGA模块连接以传输视频信号;视频输出模块包括若干个视频输出接口;隔离电源用于为连接线以及内窥镜手柄进行供电;控制器可以为IIC控制器,控制器通过与连接线FPGA模块连接以传输控制信号。In some embodiments, as shown in FIG6 , the connection line is provided with a connection line FPGA module; an image processor It includes an AC/DC high and low voltage conversion board, a power management board, a core mainboard, a key expansion board, a controller, and an external signal interface chip. The AC/DC high and low voltage conversion board is connected to an AC220V input power supply. The core mainboard includes an FPGA image processing module, an isolated power supply, and a video output module. The FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module. The FPGA image processing module is connected to the connecting line FPGA module to transmit video signals. The video output module includes several video output interfaces. The isolated power supply is used to power the connecting line and the endoscope handle. The controller can be an IIC controller, and the controller is connected to the connecting line FPGA module to transmit control signals.

在一些实施例中,按键扩展板连接有前面板按键,按键扩展板与控制器连接,外部信号接口芯片连接有前面板USB接口以及后面板USB接口,若干个视频输出接口包括但不限于CVBS接口、S-Video接口、VGA接口、DVI接口。In some embodiments, the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface.

具体地,本申请实施例连接线与图像处理器前面板包含多个按键。其中,连接线上包含四个按键,按键1、2、3的功能可被用户自定义,可以设置为拍照、特殊光谱成像、放大、测光模式调节、结构增强、血红蛋白增强、光源开关和图像旋转90°等多个功能中的一个。按键4可以呼出提示栏显示当前功能、计时、内窥镜类型和自定义按键等信息。Specifically, the connection line and the front panel of the image processor of the embodiment of the present application include multiple buttons. Among them, the connection line includes four buttons, and the functions of buttons 1, 2, and 3 can be customized by the user, and can be set to one of multiple functions such as taking pictures, special spectrum imaging, magnification, metering mode adjustment, structure enhancement, hemoglobin enhancement, light source switch, and image rotation 90°. Button 4 can call out a prompt bar to display information such as the current function, timing, endoscope type, and custom buttons.

图像处理器前面板可以包含11个按键。其中,包含两个功能按键分别用于调节结构增强等级和自动曝光功能中图像亮度评估的方法。另外,9个呈3*3阵列的按键,从上向下分别为用户自定义按键1、白平衡/向上按键、返回按键、电子放大/向左按键、菜单按键、拍照浏览/向右按键、用户自定义按键2、拍照/向下按键和确认按键。用户自定义按键1、2可以被用户定义为光源开关、特殊光谱成像、血红蛋白增强和图像旋转90°等功能。在未进入菜单情况下,白平衡/向上、电子放大/向左、拍照浏览/向右、拍照/向下按键可以完成白平衡、电子放大、拍照浏览、拍照的功能。在已进入菜单情况下,这些按键可以分别实现菜单操作中向上、向左、向右、向下的功能。菜单按键可以完成菜单呼出的功能。确认和返回按键可以分别完成菜单选取,菜单返回的功能。The front panel of the image processor may include 11 buttons. Among them, two function buttons are respectively used to adjust the structure enhancement level and the method of image brightness evaluation in the automatic exposure function. In addition, there are 9 buttons in a 3*3 array, from top to bottom, respectively, user-defined button 1, white balance/up button, return button, electronic zoom/left button, menu button, photo browsing/right button, user-defined button 2, photo/down button and confirmation button. User-defined buttons 1 and 2 can be defined by the user as light source switch, special spectrum imaging, hemoglobin enhancement and image rotation 90°. When the menu is not entered, the white balance/up, electronic zoom/left, photo browsing/right, and photo/down buttons can complete the functions of white balance, electronic zoom, photo browsing, and photo. When the menu has been entered, these buttons can respectively realize the functions of up, left, right, and down in the menu operation. The menu button can complete the function of menu call out. The confirmation and return buttons can respectively complete the functions of menu selection and menu return.

在本申请实施例中,在点击连接线按键情况下,连接线内的FPGA模块会首先接收按键请求。其后,它会通过连接线内的IIC总线将此请求发送至图像 处理器内的IIC控制器,并最终发送至FPGA图像处理模块进行相应功能的响应。点击前面板按键时,按键扩展板会生成相应的按键请求,此按键请求会进一步传递至IIC控制器中,并最终发送至FPGA图像处理模块从而对功能选择进行响应。In the embodiment of the present application, when a button on the connection line is clicked, the FPGA module in the connection line will first receive the button request. Then, it will send this request to the image processor via the IIC bus in the connection line. The IIC controller in the processor is finally sent to the FPGA image processing module for corresponding function response. When the front panel button is clicked, the key expansion board will generate a corresponding key request, which will be further passed to the IIC controller and finally sent to the FPGA image processing module to respond to the function selection.

本申请实施例在图像处理器的前后面板上分别设计了一个USB接口。USB接口与USB PHY芯片(对应外部信号接口芯片)连接,进而与FPGA图像处理模块最终连接。用户可以在USB接口上插入U盘等存储设备,也可以插入键盘这样的输入设备。用户还可以通过选择将拍摄的图片存储在U盘中,也可以使用键盘对界面进行操作,输入字符。The embodiment of the present application designs a USB interface on the front and back panels of the image processor respectively. The USB interface is connected to the USB PHY chip (corresponding to the external signal interface chip), and then finally connected to the FPGA image processing module. The user can insert a storage device such as a USB flash drive into the USB interface, or insert an input device such as a keyboard. The user can also choose to store the captured pictures in a USB flash drive, or use the keyboard to operate the interface and input characters.

在本申请实施例中,通过连接线接收内窥镜头端发送的视频信号、并对视频信号进行图像处理,包括对采集到的图像进行白光照明下的特征光谱色彩变换处理以及进行白光照明下的血红蛋白增强处理。In an embodiment of the present application, a video signal sent by an endoscope head end is received through a connecting line, and image processing is performed on the video signal, including characteristic spectral color conversion processing under white light illumination and hemoglobin enhancement processing under white light illumination on the collected image.

其中,在对采集到的图像进行白光照明下的特征光谱色彩变换处理过程中,通过计算得到色彩转换后的b通道像素值,计算得到色彩转换后的g通道像素值,计算 得到色彩转换后的r通道像素值。其中,分别表示绿色、蓝色、红色色彩变换后的灰度值,分别表示传感器对540nm和415nm光的量子转换效率,分别表示光源在540nm和415nm的相对光通量,V540和V415表示540nm和415nm光的通量功率转换比,GVg和GVb表示经FPGA处理从CMOS传感器(对应图像传感器)中恢复的绿色与蓝色像素点灰度值(即由图像原始数据经过插值之后得到的图像的蓝绿灰度值),λlλh分别为光源的最高与最低波长,Qe为当前像素对于特定波长光的相对量子效率,φs为特定波长光在光源中的相对光通量,Vλ为特定波长光的通量功率转换系数。Among them, in the process of transforming the characteristic spectrum color of the collected image under white light illumination, by calculating Get the pixel value of the b channel after color conversion and calculate Get the pixel value of the g channel after color conversion and calculate Get the r channel pixel value after color conversion. Among them, Respectively represent the grayscale values of green, blue, and red after color conversion, and They represent the quantum conversion efficiency of the sensor for 540nm and 415nm light, respectively. and represents the relative luminous flux of the light source at 540nm and 415nm, V540 and V415 represent the flux-to-power conversion ratio of 540nm and 415nm light, GVg and GVb represent the green and blue pixel grayscale values recovered from the CMOS sensor (corresponding to the image sensor) after FPGA processing (i.e., the blue-green grayscale values of the image obtained after interpolation of the original image data), λl and λh are the highest and lowest wavelengths of the light source, Qe is the relative quantum efficiency of the current pixel for light of a specific wavelength, φs is the relative luminous flux of light of a specific wavelength in the light source, and is the flux-to-power conversion coefficient of light of a specific wavelength.

在本申请实施例中,内窥镜通过连接线与图像处理器进行连接。其中,内 窥镜可以完成照明及控制、高清视频图像采集、灌注吸引等功能,并为其它镜下手术器械提供通道实现活检取样、射频消融、激光消融等功能,内窥镜头端可控弯曲从而遍历临床中人体内腔道的多种角度;连接线将头端成像传感器采集到的信号转换为适合远距离传输的格式发送给图像处理器进行后处理,并可以对头端传感器进行配置,控制头端LED和成像传感器完成自动曝光功能并转发连接线上面的用户按键请求供图像处理器响应。图像处理器控制内窥镜的各个模块,接收由连接线传递过来的视频信号与用户操作信号,分别对视频信号进行图像处理,响应用户操作并向内窥镜手柄发送控制信号。视频信号经处理后,最终由输出模块以特定格式输出至屏幕上。图像处理器还可以为内窥镜各部分提供稳定的供电,使各部分满足医疗器械相关的安全标准。图像信号由头端图像传感器采集经连接线传递至图像处理器,FPGA图像处理模块接收采集来的图像信号,对其进行图像处理完成去噪、增强、锐化等功能,最终形成符合内镜检测要求的视频图像信号。In the embodiment of the present application, the endoscope is connected to the image processor via a connecting line. The endoscope can complete functions such as lighting and control, high-definition video image acquisition, perfusion and suction, and provide channels for other endoscopic surgical instruments to realize functions such as biopsy sampling, radiofrequency ablation, laser ablation, etc. The end of the endoscope can be controlled to bend to traverse various angles of the human body cavity in clinical practice; the connecting line converts the signal collected by the head-end imaging sensor into a format suitable for long-distance transmission and sends it to the image processor for post-processing, and can configure the head-end sensor, control the head-end LED and imaging sensor to complete the automatic exposure function and forward the user button request on the connecting line for the image processor to respond. The image processor controls each module of the endoscope, receives the video signal and user operation signal transmitted by the connecting line, performs image processing on the video signal respectively, responds to the user operation and sends a control signal to the endoscope handle. After the video signal is processed, it is finally output to the screen in a specific format by the output module. The image processor can also provide stable power supply for each part of the endoscope so that each part meets the safety standards related to medical devices. The image signal is collected by the head-end image sensor and transmitted to the image processor via the connecting line. The FPGA image processing module receives the collected image signal and performs image processing to complete functions such as denoising, enhancement, and sharpening, and finally forms a video image signal that meets the requirements of endoscopic detection.

内窥镜头端集成摄像头镜头模块,可以对头端前方的场景进行成像。头端可以集成两个照明LED,照明LED可以照明头端前方场景。在图像处理器开机过程中,主机会为连接线和手柄供电。之后,主机和连接线内的FPGA模块会通过IIC总线对摄像头进行配置。配置后,摄像头就能按照全局卷帘快门的控制方式执行正常的图像采集功能。The endoscope head integrates a camera lens module to image the scene in front of the head. The head can integrate two lighting LEDs, which can illuminate the scene in front of the head. During the image processor startup process, the host will power the connecting cable and the handle. After that, the FPGA module in the host and the connecting cable will configure the camera through the IIC bus. After configuration, the camera can perform normal image acquisition functions according to the control method of the global rolling shutter.

在本申请实施例中,摄像头采集的信号首先通过多腔管内的连接线或者FPC(柔性电路板)将信号传递到连接线内的FPGA模块。模块会对信号进行转换以更适合远距离传输的电平通过连接线内的信号线传递到图像处理器中。由于传输线的距离较长,高速视频信号的稳定传输需要依赖于高质量高成本的信号传输线,特别对差分信号线的阻抗精度有较高的要求。这和一次性内窥镜低成本的初衷矛盾。为解决这一问题,本申请针对高速信号畸变导致的可能的接收端误码采样,图像处理器动态地调整信号时钟与数据之间的相位差,并实时接收和评估该相位差下接收误码率,从而获得稳定的信号接收,确保了图像信号传输的质量。In an embodiment of the present application, the signal collected by the camera is first transmitted to the FPGA module in the connecting line through the connecting line or FPC (flexible circuit board) in the multi-lumen tube. The module will convert the signal to a level more suitable for long-distance transmission through the signal line in the connecting line and transmit it to the image processor. Due to the long distance of the transmission line, the stable transmission of high-speed video signals needs to rely on high-quality and high-cost signal transmission lines, especially the impedance accuracy of differential signal lines. This is inconsistent with the original intention of low cost of disposable endoscopes. To solve this problem, the present application targets possible receiving end error sampling caused by high-speed signal distortion. The image processor dynamically adjusts the phase difference between the signal clock and the data, and receives and evaluates the receiving bit error rate under the phase difference in real time, thereby obtaining stable signal reception and ensuring the quality of image signal transmission.

本申请通过材料工程、生产制程、电子、软件、光学工程、图像处理等领 域的设计实现了全局卷帘快门自动曝光控制,灌注吸引、活检取样、射频及激光消融、图像采集与图像信号传输、图像处理、视频输出、按键与接口响应等功能。相较于当前市场上一次性内窥镜产品,本申请提供的内窥镜系统采用基于FPGA的内窥镜图像处理算法、基于白光照明的早癌筛查、全局卷帘快门自动曝光等技术,有效提升了内窥镜产品的视频图像处理性能。同时,采用了高分子材料挤出编织工艺替代传统内窥镜插入部的复杂结构,采用无菌屏障方式使得和主机连接线缆得以复用,采用差分数据相位动态调整技术确保了高速视频信号在低成本传输线上的稳定传输。This application is based on materials engineering, production process, electronics, software, optical engineering, image processing, etc. The design of the domain realizes global rolling shutter automatic exposure control, perfusion suction, biopsy sampling, radio frequency and laser ablation, image acquisition and image signal transmission, image processing, video output, button and interface response and other functions. Compared with the disposable endoscope products on the current market, the endoscope system provided by this application adopts FPGA-based endoscope image processing algorithms, early cancer screening based on white light illumination, global rolling shutter automatic exposure and other technologies, which effectively improves the video image processing performance of endoscope products. At the same time, a polymer material extrusion weaving process is used to replace the complex structure of the traditional endoscope insertion part, a sterile barrier method is used to enable the host connection cable to be reused, and differential data phase dynamic adjustment technology is used to ensure the stable transmission of high-speed video signals on low-cost transmission lines.

另外,本申请采用了高分子材料挤出编织工艺替代传统内窥镜插入部的复杂结构,采用无菌屏障方式使得和主机连接线缆得以复用,采用差分数据相位动态调整技术确保了高速视频信号在低成本传输线上的稳定传输。在确保性能指标的前提下进一步降低了产品的物料和生产成本。In addition, the present application adopts a polymer material extrusion weaving process to replace the complex structure of the traditional endoscope insertion part, adopts a sterile barrier method to allow the host connection cable to be reused, and adopts differential data phase dynamic adjustment technology to ensure the stable transmission of high-speed video signals on low-cost transmission lines. Under the premise of ensuring performance indicators, the material and production costs of the product are further reduced.

而且,本申请采用基于FPGA的内窥镜图像处理算法、基于白光照明的早癌筛查、全局卷帘快门自动曝光等技术,有效提升了内窥镜产品的视频图像处理性能,避免了果冻效应等问题,降低了照明对于头端温度的影响,提高了成像信噪比。以上措施将内窥镜产品的核心性能—视频图像处理提升到了市场主流复用型内窥镜的水平,为一次性内窥镜产品替代复用型产品,彻底消除交叉感染威胁奠定了坚实的基础。Moreover, this application uses FPGA-based endoscope image processing algorithms, white light illumination-based early cancer screening, global rolling shutter automatic exposure and other technologies to effectively improve the video image processing performance of endoscope products, avoid problems such as the jelly effect, reduce the impact of lighting on the head end temperature, and improve the imaging signal-to-noise ratio. The above measures have raised the core performance of endoscope products—video image processing—to the level of mainstream multiplexed endoscopes in the market, laying a solid foundation for disposable endoscope products to replace multiplexed products and completely eliminate the threat of cross-infection.

以上对本申请实施例所提供的一种内窥镜系统进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上,本说明书内容不应理解为对本申请的限制。 The above is a detailed introduction to an endoscope system provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims (10)

一种内窥镜系统,其特征在于,包括内窥镜、连接线以及图像处理器,所述内窥镜通过所述连接线与所述图像处理器进行连接;An endoscope system, characterized in that it comprises an endoscope, a connecting line and an image processor, wherein the endoscope is connected to the image processor via the connecting line; 所述内窥镜包括内窥镜头端,所述内窥镜头端集成有摄像头镜头模块,所述摄像头镜头模块用于根据所述图像处理器发送的控制信号对成像场景进行成像,并采用差分数据相位动态调整技术将采集的视频信号进行稳定传输、并通过所述连接线发送至所述图像处理器;The endoscope comprises an endoscope head end, the endoscope head end is integrated with a camera lens module, the camera lens module is used to image an imaging scene according to a control signal sent by the image processor, and adopts a differential data phase dynamic adjustment technology to stably transmit the collected video signal and send it to the image processor through the connecting line; 所述连接线,用于将所述摄像头镜头模块采集的视频信号发送至所述图像处理器进行后处理,并对所述摄像头镜头模块进行配置,控制所述摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,并转发所述连接线上面的用户按键请求供所述图像处理器响应;The connecting line is used to send the video signal collected by the camera lens module to the image processor for post-processing, configure the camera lens module, control the camera lens module to collect images according to the global rolling shutter automatic exposure control method, and forward the user key request on the connecting line for the image processor to respond; 所述图像处理器,用于对所述内窥镜手柄进行控制;接收所述连接线发送的用户操作信号;根据所述用户操作信号响应用户操作、并通过所述连接线向所述内窥镜手柄发送控制信号;通过所述连接线接收所述内窥镜头端发送的所述视频信号、并对所述视频信号进行图像处理。The image processor is used to control the endoscope handle; receive the user operation signal sent by the connecting line; respond to the user operation according to the user operation signal and send the control signal to the endoscope handle through the connecting line; receive the video signal sent by the endoscope head end through the connecting line and perform image processing on the video signal. 如权利要求1所述的内窥镜系统,其特征在于,所述连接线设有连接线FPGA模块;所述图像处理器包括AC/DC高低压转换板、电源管理板、核心主板、按键扩展板、控制器、外部信号接口芯片,所述核心主板包括FPGA图像处理模块、隔离电源和视频输出模块;所述FPGA图像处理模块分别与所述电源管理板、所述外部信号接口芯片、所述控制器、所述连接线FPGA模块连接,所述FPGA图像处理模块与所述连接线FPGA模块连接以传输所述视频信号;所述视频输出模块包括若干个视频输出接口;所述隔离电源用于为所述连接线以及所述内窥镜手柄进行供电;所述控制器通过与所述连接线FPGA模块连接以传输所述控制信号。The endoscope system as described in claim 1 is characterized in that the connecting line is provided with a connecting line FPGA module; the image processor includes an AC/DC high and low voltage conversion board, a power management board, a core main board, a key expansion board, a controller, and an external signal interface chip, and the core main board includes an FPGA image processing module, an isolated power supply and a video output module; the FPGA image processing module is respectively connected to the power management board, the external signal interface chip, the controller, and the connecting line FPGA module, and the FPGA image processing module is connected to the connecting line FPGA module to transmit the video signal; the video output module includes a plurality of video output interfaces; the isolated power supply is used to power the connecting line and the endoscope handle; the controller is connected to the connecting line FPGA module to transmit the control signal. 如权利要求2所述的内窥镜系统,其特征在于,所述按键扩展板连接有前面板按键,所述按键扩展板与所述控制器连接,所述外部信号接口芯片连接有前面板USB接口以及后面板USB接口,所述若干个视频输出接口包括但不限于CVBS接口、S-Video接口、VGA接口、DVI接口。The endoscope system as described in claim 2 is characterized in that the key expansion board is connected to the front panel keys, the key expansion board is connected to the controller, the external signal interface chip is connected to the front panel USB interface and the rear panel USB interface, and the several video output interfaces include but are not limited to CVBS interface, S-Video interface, VGA interface, and DVI interface. 如权利要求3所述的内窥镜系统,其特征在于,所述FPGA图像处理 模块和所述连接线FPGA模块通过IIC总线对所述摄像头镜头模块进行配置;所述摄像头镜头模块配置完成后按照全局卷帘快门自动曝光控制方式进行图像采集。The endoscope system according to claim 3, characterized in that the FPGA image processing The module and the connecting line FPGA module configure the camera lens module through the IIC bus; after the camera lens module is configured, image acquisition is performed according to the global rolling shutter automatic exposure control method. 如权利要求1或4所述的内窥镜系统,其特征在于,所述内窥镜还包括内窥镜手柄,所述内窥镜手柄包括器械鲁尔接头、灌注吸引鲁尔接头以及多腔管,所述多腔管中设置有钳道管,所述多腔管的一端设置有与所述钳道管尺寸相适应的钳道孔;所述多腔管的另一端通过所述钳道管分别与所述器械鲁尔接头和所述灌注吸引鲁尔接头对接。The endoscope system as described in claim 1 or 4 is characterized in that the endoscope also includes an endoscope handle, which includes an instrument Luer connector, an infusion and suction Luer connector and a multi-lumen tube, a clamp channel tube is provided in the multi-lumen tube, and a clamp channel hole corresponding to the size of the clamp channel tube is provided at one end of the multi-lumen tube; the other end of the multi-lumen tube is respectively connected to the instrument Luer connector and the infusion and suction Luer connector through the clamp channel tube. 如权利要求5所述的内窥镜系统,其特征在于,所述多腔管连接有蛇骨结构,所述蛇骨结构设置有钢丝绳孔,所述钢丝绳孔穿有钢丝绳,所述钢丝绳在所述内窥镜头端进行固定,所述蛇骨结构通过所述钢丝绳进行牵引、以带动所述内窥镜头端进行弯曲摆动。The endoscope system as described in claim 5 is characterized in that the multi-lumen tube is connected to a serpentine structure, the serpentine structure is provided with a wire rope hole, a wire rope is passed through the wire rope hole, the wire rope is fixed to the end of the endoscope head, and the serpentine structure is pulled by the wire rope to drive the end of the endoscope head to bend and swing. 如权利要求6所述的内窥镜系统,其特征在于,所述蛇骨结构处于插入部,所述内窥镜头端位于所述插入部头端,并且所述插入部由挤出编织工艺一体成型的多腔管组成。The endoscope system as described in claim 6 is characterized in that the snake-bone structure is in the insertion part, the endoscope head end is located at the head end of the insertion part, and the insertion part is composed of a multi-lumen tube integrally formed by an extrusion weaving process. 如权利要求1所述的内窥镜系统,其特征在于,所述摄像头镜头模块包括镜头、图像传感器以及若干个照明LED。The endoscope system as described in claim 1 is characterized in that the camera lens module includes a lens, an image sensor and a plurality of lighting LEDs. 如权利要求8所述的内窥镜系统,其特征在于,所述摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,所述摄像头镜头模块中的图像传感器为卷帘快门传感器,包括:The endoscope system according to claim 8, characterized in that the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and the image sensor in the camera lens module is a rolling shutter sensor, comprising: 设置所述卷帘快门传感器的曝光时间;Setting the exposure time of the rolling shutter sensor; 基于所述曝光时间,将所述卷帘快门传感器采集到的每行像素以固定预设时间差顺序进行曝光、数模转化和数据输出;Based on the exposure time, each row of pixels collected by the rolling shutter sensor is exposed, converted into digital-to-analog, and output as data in a fixed preset time difference sequence; 通过所述连接线内的连接线FPGA模块控制所述内窥镜头端上的照明LED在所述卷帘快门传感器从最后一行曝光开始至第一行曝光结束的时间间隔内照亮成像场景。The FPGA module in the connecting wire controls the illumination LED on the end of the endoscope head through the connecting wire to illuminate the imaging scene during the time interval from the start of the last row of exposure to the end of the first row of exposure of the rolling shutter sensor. 如权利要求9所述的内窥镜系统,其特征在于,所述摄像头镜头模块按照全局卷帘快门自动曝光控制方式进行图像采集,还包括: The endoscope system according to claim 9, characterized in that the camera lens module performs image acquisition according to a global rolling shutter automatic exposure control method, and further comprises: 在对所述卷帘快门传感器采集到的每行像素进行曝光过程中,所述图像处理器的FPGA图像处理模块获取历史采集图像的整体亮度,并将所述历史采集图像的整体亮度转化为所述内窥镜头端照明LED的点亮时间。 During the exposure process of each row of pixels collected by the rolling shutter sensor, the FPGA image processing module of the image processor obtains the overall brightness of the historical collected image, and converts the overall brightness of the historical collected image into the lighting time of the illumination LED at the end of the endoscope head.
PCT/CN2023/107155 2023-06-25 2023-07-13 Endoscope system Pending WO2025000595A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310753194.1 2023-06-25
CN202310753194.1A CN116649872A (en) 2023-06-25 2023-06-25 An endoscope system

Publications (1)

Publication Number Publication Date
WO2025000595A1 true WO2025000595A1 (en) 2025-01-02

Family

ID=87727952

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/107155 Pending WO2025000595A1 (en) 2023-06-25 2023-07-13 Endoscope system

Country Status (2)

Country Link
CN (1) CN116649872A (en)
WO (1) WO2025000595A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204377054U (en) * 2014-12-24 2015-06-03 中国科学院深圳先进技术研究院 Binocular Stereoscopic Endoscope System Based on FPGA
US20190320886A1 (en) * 2018-04-20 2019-10-24 Fujifilm Corporation Endoscope apparatus
CN211187504U (en) * 2019-05-31 2020-08-07 武汉大学 A kind of FPGA-based electrosurgical assistant system
CN113079361A (en) * 2021-03-29 2021-07-06 鹰利视医疗科技有限公司 Ultra-high-definition image enhancement system and method for medical endoscope
WO2022243553A2 (en) * 2021-05-21 2022-11-24 Ambu A/S Endoscope with an insertion cord including an interstitial lumen
CN115916026A (en) * 2020-07-21 2023-04-04 雪力光纤有限公司 endoscope components
CN116055889A (en) * 2023-02-16 2023-05-02 瀚湄信息科技(上海)有限公司 Endoscope device and method for automatically adjusting exposure and realizing global rolling shutter

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7610343B2 (en) * 2019-02-27 2025-01-08 Hoya株式会社 Electronic Endoscope System
CN110367910A (en) * 2019-08-23 2019-10-25 重庆金山科技(集团)有限公司 Endoscopy joints, endoscope mirror body, cold light source for endoscope and endoscopic system
CN218830298U (en) * 2022-11-17 2023-04-07 杭州维斯博医疗科技有限公司 Electronic endoscope image processor

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204377054U (en) * 2014-12-24 2015-06-03 中国科学院深圳先进技术研究院 Binocular Stereoscopic Endoscope System Based on FPGA
US20190320886A1 (en) * 2018-04-20 2019-10-24 Fujifilm Corporation Endoscope apparatus
CN211187504U (en) * 2019-05-31 2020-08-07 武汉大学 A kind of FPGA-based electrosurgical assistant system
CN115916026A (en) * 2020-07-21 2023-04-04 雪力光纤有限公司 endoscope components
CN113079361A (en) * 2021-03-29 2021-07-06 鹰利视医疗科技有限公司 Ultra-high-definition image enhancement system and method for medical endoscope
WO2022243553A2 (en) * 2021-05-21 2022-11-24 Ambu A/S Endoscope with an insertion cord including an interstitial lumen
CN116055889A (en) * 2023-02-16 2023-05-02 瀚湄信息科技(上海)有限公司 Endoscope device and method for automatically adjusting exposure and realizing global rolling shutter

Also Published As

Publication number Publication date
CN116649872A (en) 2023-08-29

Similar Documents

Publication Publication Date Title
CN103079454B (en) camera device
JP7383105B2 (en) Medical image processing equipment and endoscope systems
US11950760B2 (en) Endoscope apparatus, endoscope operation method, and program
US8197399B2 (en) System and method for producing and improving images
CN105792727B (en) endoscopic device
US20090213211A1 (en) Method and Device for Reducing the Fixed Pattern Noise of a Digital Image
CN105828692B (en) Endoscope apparatus
CN107113405B (en) Image processing apparatus, operating method of image processing apparatus, recording medium, and endoscope apparatus
US20220313067A1 (en) Medical image processing apparatus, endoscope system, diagnosis assistance method, and program
JP2023014288A (en) Medical image processing device, processor device, endoscope system, operation method of medical image processing device, and program
WO2018142658A1 (en) Image processing device, operating method for image processing device, and operating program for image processing device
CN102846301B (en) Intelligent adjusting device of endoscope illumination
JP2023007331A (en) Endoscope system, medical image processing device, and operation method therefor
JP7179837B2 (en) Endoscope device, endoscope image display method, and operation method of endoscope device
WO2025000595A1 (en) Endoscope system
US20250040787A1 (en) Electronic flexible and rigid endoscope system and method applicable to general practice
JP7454417B2 (en) Medical control device and medical observation system
US11363943B2 (en) Endoscope system and operating method thereof
US9832411B2 (en) Transmission system and processing device
JP2000271081A (en) Method for controlling visual field of endoscope camera
US20250095197A1 (en) Medical image processing apparatus, medical image processing method, and storage medium
JP2015047440A (en) Processor
JP7411515B2 (en) Endoscope system and its operating method
JP6681971B2 (en) Processor and endoscope system
EP4091532B1 (en) Medical image processing device, endoscope system, diagnosis assistance method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23943083

Country of ref document: EP

Kind code of ref document: A1