WO2018157868A1 - Ultrasonic imaging system and imaging method thereof - Google Patents

Abstract

An ultrasonic imaging system (2), comprising: an ultrasonic probe (21) used for acquiring an ultrasonic image comprising nerves and surrounding tissues; an ultrasonic device (22) connected to the ultrasonic probe (21) and used for collecting the ultrasonic image; an image capturing device (23) connected to the ultrasonic device (22) and used for converting the ultrasonic image; a calculating device (24) connected to the image capturing device (23), and used for scanning the ultrasonic image and marking a particular feature of the ultrasonic image with a color; and an imaging device (25) connected to the calculating device (24) and used for displaying in real time the color of the particular feature and the scanned image of the ultrasonic image. Further provided is an imaging method of the ultrasonic imaging system.

Description

Ultrasonic imaging system and imaging method thereof Technical field

BACKGROUND OF THE INVENTION 1. Field of the Invention This invention relates to an ultrasound imaging system, and more particularly to an ultrasound imaging system for automatically distinguishing peripheral nerve images and/or anesthetic drugs in real time and a method of imaging the same.

Background technique

The distribution of body nerves can be divided into two categories, the central nervous system and the peripheral nerve (Peripheral nerve). Peripheral nerve block is a local anesthetic injection around the target nerve to temporarily block the sensory and motor nerve conduction in a specific area, reduce pain during surgery, and strengthen postoperative recovery.

Traditional peripheral nerve blockade is a blind injection of local anesthetics and the movement of the nerve stimulator to confirm the position of the nerve. Therefore, the implementation of traditional peripheral nerve blockade requires the use of a large number of local Anesthetic, in addition to the unstable effect, is accompanied by more adverse reactions. In recent years, another common ultrasound-guided peripheral nerve block system has been developed. With the guidance of ultrasound imaging, the success rate of nerve blockade is higher, the adverse reactions are less, the effect is faster, and the effect is equivalent. The amount of anesthesia is minimal. Some patients obtain satisfactory peripheral ultrasound imaging through the technique of sliding, tilting, and rotating the ultrasound probe of an experienced operator.

However, for newcomers who do not have experience in peripheral nerve blockade surgery, some patients have ultrasound images that include echogenic echogenicity, which is difficult to identify true nerve locations, so nerves still need to be used. The stimulator is used to assist in the judgment to avoid putting the drug into the wrong position and adversely affecting the human body. Therefore, in order to solve the above disadvantages, it is necessary to provide a real-time ultrasonic analysis system to assist the operating physician in diagnosis, treatment and education.

In the prior art, the Haar feature based cascade classifiers are an effective target detection method proposed by Paul Viola and Michael Jones in 2001 (P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, 2001, pp. I-511-I-518 vol. 1.). The machine learning method proposed by Paul and Michael for target detection can quickly process images and achieve high detection rates. Target detection has three key contributions: integral imagery, AdaBoost-based learning calculations, and the ability to combine complex classifiers into a "cascading" approach. AdaBoost learning calculation method requires a large number of positive images (only images of target and surrounding tissues) and negative images (with no target images) to train the classifier. From the training images, extract as shown in Fig. 1(a)-Fig.1(c) A schematic diagram of the Hal character shown. Each feature is a single value that is calculated by subtracting the pixels under the black rectangle from the sum of the pixels under the white rectangle. Most of the calculated features are irrelevant. Therefore, the variant of AdaBoost is to perform the selection of a small feature set and training classifier (Y.Freund and RESchapire, "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," Journal of Computer and System Sciences , vol. 55, pp. 119-139, 1997/08/01 1997.), in its original form, used to improve the classification performance of weak learning calculations. In order to find a small number of features and form an effective classifier, a weak learning calculation method was designed to select a single rectangular feature that can best separate the positive and negative images. For each feature, the weak learner determines the optimal threshold classification function. However, in order to improve the performance of neural detection, a "cascade" classifier structure is used. The structure of the cascaded classifier not only achieves detection performance but also reduces computation time. The key reason is that it is smaller and more efficient, so the upgraded classifier can reject many negative subwindows (cascades) when positive instances are detected. 2 is a schematic structural view of a cascade classifier.

In the prior art, there is no Hal document and learning related literature or application based on the level of online learning. The present invention utilizes the Hal feature of level-based learner learning to detect nerves, and can help an anesthesiologist to automatically address a neural region immediately prior to surgery.

Summary of the invention

The present invention provides an ultrasonic imaging system, comprising: an ultrasonic probe for acquiring an ultrasonic image including a nerve and surrounding tissue; and an ultrasonic device coupled to the ultrasonic probe for collecting the ultrasonic image; An image capturing device is connected to the ultrasonic device for converting the ultrasonic image; and an arithmetic device is connected to the image capturing device for scanning the ultrasonic image to obtain an ultrasonic scanned image, and the ultrasonic wave A specific feature in the scanned image is indicated by a color; and a developing device is coupled to the computing device for displaying the ultrasonic scanned image in real time and the color for indicating the particular feature.

According to the above concept, the computing device may further mark a plurality of the specific features in the ultrasonic scanned image in a plurality of the colors.

According to the above concept, the developing device can display a plurality of the ultrasonic scanned images in real time, and mark a plurality of the colors of the plurality of the specific features.

According to the above concept, a plurality of said specific features may be nerve regions or local anesthetic regions.

According to the above concept, the ultrasonic source device and the image capturing device further have an image source line.

According to the above concept, the image taking device and the calculating device further have a connecting line.

In another aspect, the present invention also provides a method for developing an ultrasonic imaging system, which can be used for detecting a nerve region, and is characterized by the following steps: Step 1, based on the characteristics of Haar, analyzing the ultrasonic image, detecting Detect possible neural candidate regions to achieve real-time imaging effects; Step 2, depth-based neural network identification method, complete neural region localization in real time; and step 3, according to image pixel intensity distribution in the neural region, by The image with high pixel value is discolored, the nerve tissue is separated from the background, and the nerve tissue is presented in real time with a color.

According to the above concept, the imaging method can be used for detecting an anesthetic drug region, and the method comprises the following steps: Step 1, based on the Haar feature, analyzing the ultrasound image to detect possible nerve candidate regions, The effect of real-time imaging is achieved; in step 2, the depth-based neural network identification method is used to complete the localization of the neural region in real time; and in step 3, according to the image pixel intensity distribution in the neural region, by changing the image with high pixel value, The nerve tissue is separated from the background, and the nerve tissue is presented in real time in one color; and in step 4, the nerve tissue is mainly used, the detection range is increased, the pixel intensity around the nerve tissue is analyzed, and the range of the anesthetic drug is confirmed, and The range is presented in real time in another color.

DRAWINGS

Figure 1 (a) is a schematic diagram of the Haar feature of a rectangular feature (edge feature).

Fig. 1(b) is a schematic diagram of Haar characteristics of a 3 rectangular feature (line feature).

Fig. 1(c) is a schematic diagram of the Haar feature of a 4-rectangular feature.

2 is a schematic structural view of a cascade classifier.

Figure 3 is a schematic diagram of a common ultrasound guided peripheral nerve block system.

4 is a schematic view of an embodiment of an ultrasonic imaging system of the present invention.

Fig. 5 is a flow chart showing a method of developing a nerve region of the ultrasonic imaging system of the present invention.

Figure 6 is a schematic view of a detection area in a neuroimaging image.

Figure 7 is a schematic diagram of the coloration of the nerve region.

Figure 8 is a schematic diagram of a traceable development mode.

Fig. 9(a) is a schematic view of an ultrasound image including nerves and surrounding tissues.

Fig. 9(b) is a schematic view of an ultrasonic image excluding nerves.

Fig. 10 is a flow chart showing an anesthetic drug region developing method of the ultrasonic imaging system of the present invention.

Figure 11 is a schematic view showing the coloration of the nerve region and the anesthetic drug region.

detailed description

Unless otherwise defined, all technical and scientific terms used herein have the same meaning meaning

The present invention will be described by the following examples, so that those skilled in the art can understand the spirit of their creation and can accomplish it.

The implementation of the present invention is not limited by the following embodiments.

3 is a schematic diagram of a conventional ultrasonic guided peripheral nerve blocking system 1 including an ultrasonic probe 11, an ultrasonic device 12, and an ultrasonic image playback device 13.

The ultrasonic guided peripheral nerve blocking system 1 of FIG. 3 obtains an ultrasonic image including the nerve and the surrounding tissue using the ultrasonic probe 11, and then transmits the ultrasonic image to the ultrasonic image playing device 13 via the ultrasonic device 12, and then the operator The ultrasonic image on the ultrasonic image playback device 13 is visually observed, the nerve position in the ultrasonic image is judged, or the nerve stimulator is used to strike the human body, and the nerve is moved to identify the true nerve position to inject the anesthetic. Therefore, the shortcoming of the ultrasound-guided peripheral nerve block system 1 is that it depends on the experience of the operating physician to correctly determine the peripheral nerve position, and cannot perform real-time analysis to assist diagnosis and treatment; in addition, knocking on the human body may also cause other human body Part of the damage.

4 is a schematic view showing an embodiment of an ultrasonic imaging system 2 of the present invention. The ultrasonic imaging system 2 includes an ultrasonic probe 21, an ultrasonic device 22, an image capturing device 23, a calculating device 24, and a developing device 25. There is an image source line 221 between the ultrasonic device 22 and the image taking device 23. There is a connection line 231 between the image taking device 23 and the calculation device 24. In some embodiments, the image source line can be DVI, HDMI, or DSUB. In other embodiments, the image capture device 23 includes, but is not limited to, a capture cartridge. In some embodiments, computing device 24 includes, but is not limited to, a notebook computer. In other embodiments, imaging device 25 includes, but is not limited to, a computer screen.

The ultrasonic imaging system 2 provided by the present invention acquires an ultrasonic image including a nerve and a surrounding tissue using the ultrasonic probe 21, and transmits the ultrasonic image to the image capturing device 23 via the ultrasonic device 22 and the image source line 221, and then transmits the image capturing device. 23. The ultrasonic image is converted to the calculation device 24 via the connection line 231. The calculating device 24 scans the ultrasonic image by using a neural detection algorithm, and then displays the nerve tissue in the ultrasonic scanned image in real time with a significant color, and displays the result on the developing device 25.

Since the ultrasonic imaging system 2 provided by the present invention can correctly mark the nerve position in real time, the ultrasonic imaging system 2 provided by the present invention can be used without the nerve stimulation as compared with the ultrasonic guided peripheral nerve blocking system 1 of FIG. In the case of an auxiliary tool such as a device, it is possible to identify a true nerve position from a soft tissue including a nerve, to put the drug into the correct area, to help an operator with and/or experience, and to more easily identify and evaluate the local anesthetic. The injection position avoids the misuse of drugs and has an adverse effect on the human body.

5 is a flow chart of a developing method of the ultrasonic imaging system 2 of the present invention, FIG. 6 is a schematic view of a detecting area in a neuroimaging image, and FIG. 7 is a schematic view showing a coloring of a nerve region.

Referring to FIG. 4 to FIG. 7, the imaging method of the ultrasonic imaging system 2 provided by the present invention, in some embodiments, has the following steps:

Step S241, the first stage of the neural candidate region detecting step, scanning and analyzing the ultrasonic image based on the Haar feature, and detecting a possible neural candidate region (as shown in FIG. 6), in order to achieve real-time imaging effect. The area selected in step S241 is not completely correct or unique;

Step S242, the second stage of the neural region identification step, using the depth-like neural network to complete the positioning of the neural region in real time for the ultrasound scan image;

Step S243, a step of identifying the nerve tissue in the nerve region, and identifying the nerve tissue according to the image pixel intensity distribution in the neural region, and dissociating the nerve tissue from the background by discoloring the image with high pixel value, and highlighting The color presents the neural tissue in real time.

The developing method of step S241 to step S243 is performed by the calculating device 24 of the ultrasonic developing system 2, and the developing result is displayed on the developing device 25 in real time by the developing device 25 (as shown in FIG. 7). Show) to assist the operator in real-time analysis of the correct nerve location.

Figure 8 is a schematic diagram of a traceable development mode. As shown in FIG. 8, the imaging method of the ultrasonic imaging system 2 provided by the present invention can continuously mark the nerve tissue scanned in the ultrasonic image on the developing device 25 in real time with different significant colors. In some embodiments, the neural tissue of the first ultrasonic scanned image is presented in the first color on the developing device 25, and the second ultrasonic scanned image is obtained from the plurality of ultrasonic scanned images confirmed in steps S241 to S243. The neural tissue will be presented in a second color on the imaging device 25... and so on, providing the operator with a traceable imaging mode.

Fig. 9(a) is a schematic view of an ultrasonic image including nerves and surrounding tissues, and Fig. 9(b) is a schematic view of an ultrasonic image not including nerves. In some embodiments, the present invention utilizes a Hal feature and a cascading learning calculation extracted from training images (including but not limited to the ultrasound images of Figures 9(a) and 9(b) to find regions of the nerve to The development method of steps S241 to S243 is implemented.

Fig. 10 is a flow chart showing another development method of the ultrasonic imaging system 2 of the present invention, and Fig. 11 is a schematic view showing the coloration of the nerve region and the anesthetic drug region.

The method of the present invention for finding a nerve region can be used to find an area of anesthetic drug that is applied around a nerve region. 10 and FIG. 11, the imaging method of the ultrasonic imaging system 2 provided by the present invention, in some embodiments, has the following steps:

Step S241, the first stage of the neural candidate region detecting step, scanning and analyzing the ultrasonic image based on the Haar feature, and detecting a possible neural candidate region (as shown in FIG. 6), in order to achieve real-time imaging effect. The area selected in step S241 is not completely correct or unique;

Step S242, the second stage of the neural region identification step, using the depth-like neural network to complete the positioning of the neural region in real time for the ultrasound scan image;

Step S2431: a step of identifying the nerve tissue in the nerve region, identifying the nerve tissue according to the image pixel intensity distribution in the neural region, and dissociating the nerve tissue from the background by discoloring the image with high pixel value, and highlighting The color presents the neural tissue in real time;

Step S2432, a step of identifying the anesthetic drug around the nerve tissue, focusing on the nerve tissue, increasing the detection range, analyzing the pixel intensity around the nerve tissue, confirming the range of the anesthetic drug, and presenting the effect in real time in another significant color. range.

The developing method of step S241 to step S2432 is performed by the calculating device 24 of the ultrasonic developing system 2, and the developing result is displayed on the developing device 25 in real time by the developing device 25 (as shown in FIG. 11). To assist the operator in confirming the scope of the anesthetic that has been applied to determine whether the anesthetic is completely covered with nerve tissue.

In one embodiment, the identified pixel value of the anesthetic is differentiated by 60 pixels, and if the pixel value is below 60 pixels, it is not rendered in a significant color.

In some embodiments, the imaging device 25 can display not only the original ultrasound image, but also an ultrasound scan image that colors the nerve region and/or the anesthetic drug region for the operator to confirm the original ultrasound image and the colored ultrasound scan. Whether the image positions match each other.

The present invention assists an unexperienced peripheral nerve block operation by automatically addressing the neural region immediately and marking the position of the nerve region and/or the location of the anesthetic drug region in a significant color by using the Hal feature of the cascade learning calculation method. The physician identifies the true nerve position in the soft tissue including the nerve; the invention can determine the correct nerve position without using the nerve stimulator to strike the human body, and avoids the need for the traditional peripheral nerve block surgery to hit the human body with the auxiliary tool The problem of damage to the ligament or soft tissue, etc.; the invention also avoids the adverse effects of the anesthetic drug on the human body, and confirms the scope of the anesthetic drug, thereby determining that the drug can completely cover the nerve tissue, further Improve the success rate and effectiveness of nerve blockade. Therefore, the present invention not only contributes to the technical education of peripheral nerve blockade, but also is beneficial to clinical diagnosis and treatment, solves the existing technical problems, and achieves better effects.

Symbol Description

Steps S241, S242, S243, S2431, and S2432

1 catheter device

1 Ultrasound guided peripheral nerve block system

11 ultrasonic probe

12 Ultrasonic equipment

13 Ultrasonic video playback device

2 Ultrasonic imaging system

21 ultrasonic probe

22 Ultrasonic equipment

23 image capture device

24 calculation device

25 imaging device

221 image source line

231 cable

Claims (9)

An ultrasonic imaging system characterized by comprising: An ultrasonic probe for obtaining an ultrasound image comprising the nerve and surrounding tissue; An ultrasonic device connected to the ultrasonic probe for collecting the ultrasonic image; An image capturing device is connected to the ultrasonic device for converting the ultrasonic image; An calculus device is connected to the image capturing device for scanning the ultrasonic image to obtain an ultrasonic scanned image, and marking a specific feature in the ultrasonic scanned image with a color; A developing device is coupled to the calculating device for displaying the ultrasonic scanned image in real time and the color for indicating the specific feature. The ultrasonic imaging system according to claim 1, wherein said calculating means further marks said plurality of said specific features in said ultrasonic scanned image in a plurality of said colors. The ultrasonic imaging system according to claim 1, wherein said developing means displays a plurality of said ultrasonic scanned images in real time and a plurality of said colors of said plurality of said specific features. The ultrasonic imaging system according to claim 1, wherein said developing means further displays said ultrasonic image and said ultrasonic scanned image in real time, and a plurality of said colors indicative of said plurality of said specific features. The ultrasonic imaging system according to any one of claims 1 to 4, characterized in that the plurality of said specific features may be a nerve region or a local anesthetic region. The ultrasonic imaging system according to claim 1, wherein said ultrasonic device and said image capturing device further have an image source line. The ultrasonic imaging system according to claim 1, wherein said image capturing means and said calculating means further have a connecting line. A developing method of an ultrasonic imaging system according to any one of claims 1 to 7, which can be used for detecting a nerve region, characterized by comprising the steps of: Step 1. Based on the characteristics of Hal, the ultrasound image is analyzed to detect possible candidate regions for real-time imaging. Step 2: The depth-based neural network identification method completes the localization of the neural region in real time; Step 3: According to the image pixel intensity distribution in the neural region, the neural tissue is separated from the background by discoloring the image with high pixel value, and the neural tissue is presented in real time with a color. A method of developing according to claim 8 for detecting an anesthetic drug region, comprising the steps of: Step 1. Based on the characteristics of Hal, the ultrasound image is analyzed to detect possible candidate regions for real-time imaging. Step 2: The depth domain-like neural network identification method completes the localization of the neural region in real time; Step 3, according to the image pixel intensity distribution in the neural region, by discoloring the image with high pixel value, separating the nerve tissue from the background, and presenting the neural tissue in real time in one color; In step 4, the nerve tissue is mainly used, the detection range is increased, the pixel intensity around the nerve tissue is analyzed, the range of the anesthetic drug is confirmed, and the range is presented in real time in another color.

Images