WO2019041411A1 - Guan pulse recognition system based on thermal imaging - Google Patents

Abstract

A Guan pulse recognition system based on thermal imaging, comprising: a non-contact wrist imaging platform based on infrared thermal imaging and a Guan pulse extraction algorithm unit, wherein a fixing frame structure of the non-contact wrist imaging platform based on infrared thermal imaging can ensure that the wrist of a measured person enters an imaging area in a fixed posture every time; a straight-line laser mark of the platform provides an alignment reference position of rasceta of the wrist; and the non-contact wrist imaging platform based on infrared thermal imaging transmits a wrist thermal imaging image carrying radial artery image information to the Guan pulse extraction algorithm unit so as to extract a Guan pulse position. The system proposes, for the first time, an algorithm where a Guan pulse position can be automatically recognized by means of thermal imaging image processing, where same objectifies and digitizes Guan pulse recognition, so that data has good repeatability and reproducibility, and is more feasible than an ultrasonic array and other types of sensor arrays in the implementation of a contact-type determination method for a Guan pulse.

Description

Thermal imaging based pulse recognition system Technical field

The present disclosure relates to the field of pulse detection technology, and in particular to a thermal imaging based pulse recognition system.

Background technique

In the process of diagnosis of TCM pulse diagnosis, the positioning of the Guanmai is extremely important. The ability to find the right pulse is the premise of accurately determining the patient's disease. The classic characteristics of the traditional Chinese medicine pulse diagnosis are the sacral stalk (Chinese medicine called the posterior high bone) and the wrist transverse stripes. In the classic ancient books, the radial artery on the sacral stalk is considered to be the Guanmai. Another part of the ancient books describes the distance between the veins and the wrist stripes. Despite having two distinct features, for thousands of years, the diagnosis of Chinese medicine doctors relied only on the touch of the hand to judge the position of the pulse. Due to the differences in the perceptions of different people, the subjectivity of the pulse was too strong, and the reproducibility of the pulse was discriminated. Poor, the same person has poor repeatability of the Guanmai positioning, and the accuracy of the discrimination cannot be guaranteed. The existing TCM automatic diagnostic equipment, the positioning procedure of the veins are also completed by the human judgment, and then the pulse wave probe is placed in the corresponding position of the inch, and the objectivity of the pulse positioning cannot be guaranteed.

Summary of the invention

In view of this, the main object of the present disclosure is to provide a pulse recognition system to at least partially solve the above technical problems.

In order to achieve the above object, the present disclosure provides a pulse recognition system including:

An imaging system for acquiring an infrared image of the tester's arm and wrist;

a pulse extraction algorithm unit for obtaining an outline of the tester's arm and wrist based on the infrared image acquired by the imaging system, and preprocessing the contour to extract an x coordinate of a feature point of the sacral stem; Based on the infrared image acquired by the imaging system, a thermographic image of the tester's arm and wrist is obtained, and the radial artery image in the thermographic image is fitted into a linear function, and the x coordinate of the characteristic point of the sacral stem The corresponding y coordinate of the x coordinate on the straight line function is the final position of the pulse.

Wherein, the pulse recognition system further comprises a support structure for placing the tester's wrist, which ensures that the tester enters the imaging area of the imaging system in a fixed posture every time the wrist.

Wherein, the pulse recognition system further comprises a word laser transmitter for providing a word laser mark as a reference position for the tester's wrist wrist horizontal alignment.

Wherein, the pulse recognition system further includes a three-dimensional mobile station and a point laser emitter; wherein the point laser emitter is disposed on the three-dimensional mobile station, so that the three-dimensional mobile station can be based on the The calculation result of the extraction algorithm unit moves the point laser emitted by the spot laser emitter to indicate the position of the pulse of the tester's wrist.

Wherein the pulse recognition system further comprises a pulse wave sensor disposed on the three-dimensional mobile station, the three-dimensional mobile station being capable of moving the pulse wave sensor to the tester's wrist based on a calculation result of the pulse-off extraction algorithm unit The position of the pulse to properly collect the pulse wave.

among them:

The step of obtaining the outline of the tester's arm and the wrist based on the infrared image acquired by the imaging system based on the infrared pulse acquisition algorithm unit includes:

A thermographic image of the subject's arm and wrist is obtained, and the contours of the arm and wrist in the thermographic image are extracted by an edge detection algorithm.

The step of preprocessing the obtained contour line by the pulse extraction algorithm unit specifically includes:

Step S21, performing a connected domain identification on the contour line obtained in step S1, and determining whether the largest connected domain in the contour line runs through the boundary of the left and right sides of the infrared image, that is, whether there is a breakpoint in the connected domain, if there is no breakpoint The maximum connected domain is the outline of the arm and the wrist to be extracted, and the process proceeds to step S23;

Step S22: searching for the edge segment in the range of 2 pixels in the upper, upper left, left, lower left, and lower directions with the left breakpoint of the maximum connected domain as the origin, and if there are other connected domains in the search range, then two The connected domains are connected, and the intermediate breakpoint pixels complement the pixels between the two segments by interpolation, and finally form a new connected domain, and further search for other edge segments with the new connected domain left breakpoint as the origin until the image is reached. Left border

Find the edge segment in the range of 2 pixels from the top, top right, right, bottom right, and bottom directions of the maximum connected domain as the origin. If there is a range within the search range, In other connected domains, the two connected domains are connected, and the intermediate breakpoint pixels complement each other by interpolating between the two segments, eventually forming a new connected domain, and further searching for the new connected domain right breakpoint as the origin. Other edge segments until the right edge of the image is reached;

Among them, the above-mentioned steps of searching left and right and following the breakpoints are in no particular order;

Step S23, converting the edge contour of the two-dimensional image obtained based on the maximum connected domain into a one-dimensional curve, eliminating the step point generated during the conversion process, and making the converted one-dimensional curve smoother, highlighting the arm and the wrist. Edge features.

The step of extracting the characteristic points of the sacral stalk stem by the smear extraction algorithm unit specifically includes:

Step S24, performing feature extraction on the one-dimensional curve of the converted arm and wrist edge contours, and searching for the lowest depression between the hand and the sacral stem;

Step S25, searching for the first peak in the curvature waveform corresponding to the contour line in the range of 0 to 4 cm on the left side of the reference with the lowest depression as a reference, and if present, the peak is identified as the x of the pulse. The coordinates, if not present, are identified as the x-coordinate of the Guan pulse.

Among them, the step of finding the lowest depression between the hand and the sacral stem is based on the fact that the humeral stem has a maximum boundary bending amplitude on the edge contour of the wrist to the arm.

The step of the Guanmai extraction algorithm unit fitting the radial artery image in the thermographic image into a straight line function specifically includes:

Step S31, constructing a radial artery region for the thermographic image, and setting a threshold for providing a threshold reference for binarizing the radial artery region;

Step S32, binarizing the radial artery region, separating the image of the radial artery from other portions in the thermographic image;

In step S33, the radial artery image obtained in step S32 is fitted to a straight line function.

Wherein, the step of constructing the radial artery region for the thermographic image in step S31, the step of setting the threshold value specifically includes:

Constructing an area for each origin using each pixel on the contour line generated after preprocessing;

According to the statistical rule of the mean and variance of the area of the radial artery boundary position, set the average The threshold for values and variances.

The step of binarizing the radial artery region in step S32 specifically includes:

Calculating the mean and variance of the pixels in each edge pixel region;

The mean and variance of the pixels in each of the generated edge pixel regions are successively compared with a threshold, and the region meeting the threshold condition is binarized.

The step of fitting the radial artery image into a straight line function in step S33 specifically includes:

Obtaining the ordinate of the pixel of the binarized radial artery image to obtain a curve describing the radial artery image;

Straight line fitting of the curve yields a linear function that includes the trend of the radial artery.

DRAWINGS

Figure 1 is an infrared thermographic image of an arm wrist carrying brachial artery information;

2 is a schematic diagram of a broken connection of an arm edge;

Figure 3 is an image of the arm and wrist edges;

Figure 4 is an arm wrist curve transformed into an edge of a one-dimensional curve and a filtered or high-order polynomial fit;

Figure 5 is a curve diagram of the edge of the arm wrist and the corresponding curvature;

Figure 6 is an image of the arm wrist edge with radial artery information;

Figure 7 is a segmented radial artery image;

Figure 8 is a ordinate ordinate averaging and straight line fitting curve of the radial artery;

Figure 9 is a coordinate display diagram of the radial artery;

10 is a schematic structural view of a non-contact wrist imaging platform of infrared thermal imaging of the present disclosure;

Figure 11 is a schematic diagram showing the relationship between the wrist transverse stripes and the off-axis x coordinates;

Figure 12 is a schematic diagram of a compact connection of adjacent pixels of an image;

Figure 13 is a schematic view showing loose connections of adjacent pixels of an image;

Figure 14 is a schematic diagram of the image edge detection arbitrary angle composition form;

Fig. 15 is a schematic diagram showing the image of the image beyond the boundary of the image.

Detailed ways

The purpose of the present disclosure is to provide an automatic pulse recognition system capable of removing subjective differences in humans. The system performs non-contact recognition of human wrist veins by image edge recognition technology combined with brachial artery thermal imaging characteristics. When thermal imaging of the arm wrist, the infrared thermography spectral range is farther than the visible spectrum range, and the images in the visible spectrum range are not displayed, and the generated image effectively simplifies the complexity of the image background. Because the brachial artery temperature is higher than other skin temperatures, thermal imaging spectroscopy can highlight the radial artery, providing an image basis for radial artery image segmentation and straight line fitting, as shown in Figure 1.

To achieve the above object, the present disclosure discloses a method for identifying a pulse, comprising the following steps:

1. The edge detection algorithm extracts the wrist contour;

2. Pre-treatment of the wrist edge of the opponent to extract the x-coordinate of the characteristic point of the sacral stem;

3. Perform image segmentation on the radial artery and fit the radial artery thermography image into a straight line function. The x coordinate and the corresponding y coordinate of the characteristic point of the sacral stalk in the straight line function are the final position of the pulse.

More specifically, the pulse recognition method of the present disclosure includes the following steps:

1. Identify the edges of the arms and wrists to be tested to create the edge lines of the arms and wrists. The algorithm for recognizing the edges of the arms and wrists may be any angular edge detection algorithm of the present application as described hereinafter, or may be other types of edge detection algorithms of the prior art. For the convenience of description, the left hand is taken as an example for shooting, and the wrist is placed on the right side of the photo, and the arm connecting the elbow is located on the left side of the photo, thereby establishing the plane orientation coordinates of the top, bottom, left, and right. It should be noted that this is for convenience of description only and is not intended to limit the disclosure.

2. Pre-treatment of the edges of the arms and wrists to further optimize the edges of the arms and wrists to provide protection for subsequent wrist veins. This step specifically includes identifying the maximum connected domain of the arm edge, the arm edge breakpoint connection, and the arm wrist curve fitting as follows:

(1) Identify the maximum connected domain at the edge of the arm:

Connected domain recognition is performed on the generated edge image to find the largest connected domain on the right side of the image. If the maximum connected domain runs through the left and right borders of the image, that is, there is no breakpoint in the connected domain, the maximum connected domain can be considered as the edge of the arm wrist.

(2) Arm edge breakpoint connection:

The arm edge segments are joined to form an integral edge of the arm wrist that runs through the left and right borders of the image. In the case of a breakpoint at the edge, the maximum connected domain is only a part of the edge of the arm's wrist, so the other arm wrist edge segments need to be connected. The edge segment is found in the range of 2 pixels in the upper, upper left, left, lower left, and lower directions from the left breakpoint of the largest connected domain. If there are other connected domains in the search range, the two connected domains are connected, and the intermediate breakpoint pixels complement the pixels between the two segments by interpolation or other fitting, eventually forming a new connected domain and The breakpoint on the left side of the connected domain is the origin to further find other edge segments until reaching the left edge of the image; in addition, the right breakpoint of the largest connected domain is taken as the origin, the top, top right, right, bottom right, bottom 5 Find the edge segment within 2 pixels of the direction. If there are other connected domains in the search range, connect the two connected domains. The intermediate breakpoint pixel fills the pixel between the two segments by interpolation, and finally forms a new one. Connect the domain and further search for other edge segments with the new connected domain right breakpoint as the origin until the right edge of the image is reached; the above left and right search and subsequent breakpoint steps are in no particular order.

(3) Curve fitting of arm wrist:

Eliminate the step points generated in the process of turning the 2D image edge into a one-dimensional curve, so that the converted one-dimensional arm edge curve is smoother and highlights the edge feature of the arm wrist.

3. Identify the sacral stalk algorithm to identify the sacral stalk feature points:

First, feature extraction is performed on the extracted arm wrist edge, and the depression between the hand and the sacral stem is identified to find the lowest point of the depression. The curvature of the sacral stalk at the top of the epidermis is characterized by the distance between the wrist and the two fingers on the left side (approximately 0 to 3 cm or 0 to 4 cm). There are several local peak points of curvature, that is, the boundary varies greatly. point. Secondly, look for the local peak point of curvature that is furthest from the depression at that distance (that is, the first peak point in the local peak point of several curvatures). Finally, the local peak point of the curvature is identified as the Guan x coordinate; if there is no peak, the depression is identified as the Guan x coordinate.

4. Radial artery image segmentation and vein recognition are used to segment the radial artery image and fit into a linear function that reflects the trend of the radial artery. The specific steps include:

(1) Regional construction and threshold settings for providing a threshold reference for the binarized brachial artery;

(2) Binaryized radial artery region for separating the radial artery image from other images;

(3) Straight line fitting of the radial artery is used to obtain a linear function that reflects the trend of the radial artery and finally The coordinates of the pulse.

In a specific embodiment, the pulse recognition method of the present disclosure includes the following steps:

The entire image is first edge-identified to create the edge of the arm wrist.

The arm edge is then pre-treated to further optimize the edge of the arm wrist to provide protection for subsequent wrist pulse recognition. The pre-processing process includes identifying the largest connected domain at the edge of the arm, the breakpoint connection at the arm edge, and the curve fitting of the arm wrist.

(1) Identify the maximum connected domain of the arm edge: identify the connected domain of the generated edge image, and find the largest connected domain of the right edge of the image. If the maximum connected domain runs through the left and right borders of the image, that is, there is no breakpoint in the connected domain, the maximum connected domain can be considered as the edge of the arm wrist.

(2) As shown in Fig. 2, the arm edge breakpoint connection includes the following steps: connecting the arm edge segments to form an entire edge of the arm wrist that runs through the left and right boundaries of the image. In the case of a breakpoint at the edge, the maximum connected domain is only a part of the edge of the arm's wrist, so the other arm wrist edge segments need to be connected. The edge segment is found in the range of 2 pixels in the upper, upper left, left, lower left, and lower directions from the left breakpoint of the largest connected domain. If there are other connected domains in the search range, the two connected domains are connected, and the intermediate breakpoint pixels complement the pixels between the two segments by interpolation or other fitting, eventually forming a new connected domain and The breakpoint on the left side of the connected domain is the origin and further search for other edge segments until reaching the left edge of the image.

(3) As shown in Fig. 3 and Fig. 4, the curve fitting of the arm wrist includes the following steps: using a low-pass filter or a polynomial curve fitting to eliminate the step point generated in the process of converting the edge of the two-dimensional image into a one-dimensional curve, Makes the transition of the one-dimensional arm edge curve smoother, highlighting the edge features of the arm wrist.

The sacral stem algorithm is used to identify the characteristic points of the sacral stem. As shown in Fig. 5, the extracted arm edge is extracted first, and the depression between the hand and the sacral stem is identified to find the lowest point of the depression. The curvature of the sacral stalk at the top of the epidermis is characterized by the fact that there are several local peak points of curvature in the distance between the two sides of the wrist and the two fingers on the left side of the sac, that is, the point where the boundary changes greatly. Secondly, look for the local peak point of curvature that is furthest from the depression at that distance (that is, the first peak point in the local peak point of several curvatures). Finally, the local peak point of the curvature is identified as the Guan x coordinate.

Next, the radial artery image segmentation and the pulse recognition are performed. Construct an area with the origin of each of the previously generated edge images (Figure 6). The threshold of the mean and the variance is set according to the statistical rule of the mean and variance of the region of the radial artery boundary position. Calculate the mean and variance of the pixels in each edge pixel area. The mean and variance of the pixels in each of the generated edge pixel regions are successively compared with the threshold, and the region meeting the threshold condition is binarized (Fig. 7). The binar coordinates of the binarized radial artery image are averaged to obtain a curve describing the radial artery image. A quadratic polynomial straight line fitting is performed on the curve to obtain a linear function including the trend of the radial artery (Fig. 8), and the x-coordinate of the pulse is substituted into the linear function to obtain the ordinate of the pulse. The position of the pulse in the image can be determined, as shown in Figure 9.

The present disclosure also discloses a non-contact automatic pulse recognition system based on infrared thermal imaging, comprising a non-contact wrist imaging platform and a pulse extraction algorithm unit based on infrared thermal imaging; wherein the infrared thermal imaging based non-contact The fixing structure of the wrist imaging platform can ensure that the measuring person enters the imaging area in a fixed posture every time the wrist is fixed. The one-line laser marking of the platform provides the wrist wrist horizontal alignment alignment reference position; the infrared thermal imaging-based non-contact wrist imaging The platform transmits the wrist thermal imaging image carrying the brachial artery image information to the Guanmai extraction unit, and the Guanmai extraction unit extracts the Guanmai by using the above-described Guanmai recognition method step.

Specifically, the infrared thermal imaging-based non-contact wrist imaging platform includes a three-dimensional mobile station, an infrared thermal imager, a spot laser, a word line laser, a hand and wrist mount, an instrument stand, and a display. The instrument holder is connected to the three-dimensional mobile station, the infrared thermal imager, the spot laser, the word line laser, and the side of the hand and wrist holders to support the entire system.

The other side of the three-dimensional mobile station is connected to the side of the point laser for carrying a point laser to indicate the position of the wrist pulse. The three-dimensional mobile station control part can communicate with the computer to obtain the pulse coordinates, and move the point laser to the coordinates of the pulse. . The three-dimensional mobile station can also be connected to a pulse wave sensor for sending the pulse wave sensor to the pulse position to acquire the pulse wave. One side of the infrared thermal imager is connected to the instrument stand for taking images of the wrist carrying the brachial artery information. A laser line on one side of the line is connected to the instrument holder to provide an alignment position for the wrist stripes. The side of the hand and wrist holders is connected to the instrument holder to ensure that the test subject's hand and arm position are basically unchanged. The computer is used to calculate and display the final pulse position and transmit coordinate signals to the 3D mobile platform.

In one embodiment, the infrared thermal imaging based non-contact automatic pulse recognition of the present disclosure The system is shown in Figure 10. The subject's wrist is placed on the hand and wrist mounts and the wrist stripes are aligned with the line of laser. The hand and wrist mounts contain a handle or finger grip device, and the subject needs to hold the handle-like device in each test, which allows the subject's hand and wrist to remain the same during each test. Position and keep the same position in the image. The position of the laser line of the word line is the right edge of the thermal imaging image. The coordinates of the thermal imaging image are the leftmost point as the origin, and the horizontal line of the wrist corresponds to the maximum coordinate of the right side of the image. The wrist of the subject is transversely lined with a line of laser. Alignment, the wrist wrist stripes basically correspond to the right edge of the image, as shown in Figure 11. The pulse recognition program is activated, and the thermal imager collects the wrist image and the radial artery image. Since the infrared thermography spectral range is farther than the visible spectral range, images in the visible spectral range are not displayed, effectively simplifying the complexity of the image background. In addition, because the temperature of the brachial artery is higher than other skin temperatures, the thermographic spectroscopy can image the radial artery, providing an image basis for radial artery image segmentation and straight line fitting, as shown in Figure 10. The thermal imager then transmits a wrist image of the brachial artery thermographic information to the computer. The computer's pulse extraction unit identifies the position of the pulse in the image, and transmits the generated coordinates of the pulse to the control part of the three-dimensional mobile station. The control part then controls the actual movement of the three-dimensional mobile platform to carry the point laser to the image. In position, the position indicated by the spot laser is the calculated actual position of the pulse. Using this method, the difference between the x coordinate of the pulse in the image and the boundary of the right edge of the image is calculated as the distance from the origin of the wrist to the origin. In addition, the platform effectively ensures the repeatability of test results in the system.

Based on the above technical solutions, the pulse recognition system of the present disclosure has the following beneficial effects as compared with the prior art:

1. Based on the physiological characteristics of the two recognized Chinese medicine practitioners, it provides a new method for the identification of pulse veins for TCM pulse diagnosis;

2. For the first time, a system capable of automatically identifying the position of the pulse by thermal imaging image processing is proposed;

3. An algorithm for automatically identifying the position of the pulse through thermal imaging image processing is proposed for the first time;

4. For the first time, the identification of the Guanmai is objective and digitized, and the data has good repeatability and reproducibility;

5. Eliminate the subjective interference factors of people in the judgment of Guanmai;

6. Non-contact method for distinguishing pulse veins is more feasible than ultrasonic arrays and other types of sensor arrays.

7. The edge detection algorithm can realize edge detection at any angle;

8. The method for discriminating the sacral stalk was first proposed.

For an algorithm for recognizing the edge of the arm and the wrist, the present disclosure also discloses an edge detection method of any angle, which includes the following steps:

(1) Construct an edge detection angle interval boundary

The adjacent pixel relationship of the image is divided into a compact connection and a loose connection. Taking two pixels per line as an example, the compact connection is as shown in FIG. 12: starting from the pixel in the leftmost column of the image, and the pixel of the adjacent row. The first and last pixels are vertically connected, and each two lines form a compact connection unit. In this way, several compact connecting units are connected in a line up to the image boundary, and the angle between this line and its y-axis projection is the edge detection angle. Its matrix Q _{θ2L is} expressed as:

Edge detection angle

The loose connection is shown in Figure 13: starting from the top left corner of the image, starting with the pixels of the leftmost column and the top row, the pixels of the adjacent rows are connected diagonally to the first and last pixels, and each of the two rows constitutes a loose connection unit. According to this method, a plurality of loose connecting units are connected in a line up to the image boundary, and the angle between the line and its y-axis projection is the edge detecting direction. Its matrix Q _{θ2R is} expressed as:

Edge detection angle

为该段角度区间的左边界。两像素的宽松连接单元组成的边缘检测角度

为该段角度区间的右边界。所以该角度区间为(θ_2L，θ_2R)。Therefore, the edge detection angle composed of a two-pixel compact connection unit

Is the left boundary of the angular interval of the segment. Edge detection angle composed of two-pixel loose connection unit

Is the right border of the angular interval of the segment. Therefore, the angle interval is (θ _2L , θ _2R ).

When the number of pixels is k pixels, the matrix Q _{θkL is} expressed as:

The left boundary of the edge detection angle interval consisting of a compact connecting unit of k pixels

Its matrix Q _{θkR is} expressed as:

The right edge of the edge detection angle interval consisting of a compact connecting unit of k pixels

Therefore, the boundary angles of the detected angular intervals are θ _2L , θ _2R , θ _3L , θ _3R , ... θ _nL , θ _nR , and the angular interval formed by the angular boundary is a union of several sub-intervals (θ _2L , θ _2R ) ∪ ( θ _3L , θ _3R ) ∪ ... ∪ (θ _nL , θ _nR ). The union is in the range of (45°, 90°).

(2) Construct any angle in the edge detection angle interval

Taking a unit connected by two pixels as an example, the arbitrary angles in the interval are composed as follows:

As shown in Figure 14, it is clear that the angle of edge detection is required to construct a unit. The unit consists of i compact connections and j loose connections, where the number of i and j corresponds to the detected angle. The unit repeats r times until it exceeds the image boundary. The relationship between the number of rows m and the number of columns n and i, j and r is:

r(i+j)+1=m (1)

Ri(k-1)+krj+k=n (2)

Therefore the edge detection angle in each angular interval

In addition, each boundary condition also conforms to the above formula.

Therefore, by the above method, the pixels in the image can be combined according to the required angle, and the image is complement-zero amplified for the part of the algorithm that realizes the boundary beyond the image, as shown in FIG.

(3) Convolution operation of a plurality of pixel lines constructed according to the above method with a first derivative fσ(t) of a Gaussian function, and taking an absolute value of the convolution operation result, and taking a local maximum value for the absolute value; The edge detection upper boundary angle generated by the compact connection is used as an example to explain a number of pixel lines, and the left side boundary is used as a starting point to generate a plurality of pixel lines X ₁ , X ₂ ... X _m , and the upper side boundary is a starting point for generating a number of pixel lines Y ₁ ... Y _m-1 . Where m is the row and k is the number of connected pixels.

Taking the edge detection lower boundary angle generated by the loose connection as an example to explain a number of pixel lines, the left side boundary is used as the starting point to generate a number of pixel lines X' ₁ , X′ ₂ ... X′ _m , and the upper side boundary is the starting point. Y'1...Y' _m-1 where m is a row and k is the number of connected pixels.

Each pixel line is convoluted with the first derivative f _σ (t) of the Gaussian function, and the absolute value of the convolution operation is obtained: |f _σ (t)*X ₁ |, |f _σ (t )*X ₂ |,...|f _σ (t)*X _m ||f _σ (t)*X′ ₁ |,|f _σ (t)*X′ ₂ |,...|f _σ (t)*X ' _m | and |f _σ (t)*Y ₁ |,...|f _σ (t)*Y _m-1 ||f _σ (t)*Y′ ₁ |,...|f _σ (t)*Y′ _M-1 |. The edge detection angle is reduced from [0°, 360°] to [0°, 180°] by convolving and constructing absolute values of the constructed pixel lines. Therefore, it is only necessary to process the image in the interval of the edge detection angle [0°, 180°].

(4) For the obtained |f _σ (t)*X ₁ |, |f _σ (t)*X ₂ |,...|f _σ (t)*X _m | and |f _σ (t)*Y ₁ | ,...|f _σ (t)*Y _m-1 | Perform local maxima operation to assign gray value, other non-local maxima pixel grayscale is set to 0, and its gray value is (255/edge detection angle number). Substituting image pixels having gray values according to pixel subscripts to the same pixel subscript position in the original image;

(5) grading the gradations of several images obtained by different edge detection angle directions, setting a binarization threshold for the gradation of the image after multiple superimposition according to the actual required edge image requirement, and performing two images according to the binarization threshold Value processing. (The threshold here is also not fixed) and finally the desired edge.

The edge detection angle range is (45°, 90°), and the 45° edge detection angle is a pixel line in which one pixel is sequentially connected, that is, when k=1. The 90° direction is a vertically segmented image, and each column of pixels constitutes a pixel line. Therefore, the detection angle range [45°, 90°] can be achieved.

The angle range [45°, 90°] can be mapped to [0°, 45°], [90°, 135°] and [135°, 180°] by transposing and flipping the image matrix. The specific method is as follows:

The image matrix is flipped horizontally, and the edge detection angle interval is mapped from [45°, 90°] to [90°, 135°]. After the image matrix is transposed, the edge detection angle interval is mapped from [45°, 90°] to [135°, 180°]. After the image matrix is horizontally flipped and transposed, the edge detection angle interval is mapped from [45°, 90°] to [0°, 45°]. Based on the above method, the edge detection of the [0°, 360°] angle interval can be realized only by applying the [45°, 90°] edge detection angle.

The specific embodiments of the present invention have been described in detail with reference to the preferred embodiments of the present disclosure. Any modifications, equivalent substitutions, restatements, etc., made within the spirit and scope of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (9)

A thermal imaging based pulse recognition system, comprising: An imaging system for acquiring an infrared image of the tester's arm and wrist; a pulse extraction algorithm unit for obtaining an outline of the tester's arm and wrist based on the infrared image acquired by the imaging system, and preprocessing the contour to extract an x coordinate of a feature point of the sacral stem; Based on the infrared image acquired by the imaging system, a thermographic image of the tester's arm and wrist is obtained, and the radial artery image in the thermographic image is fitted into a linear function, and the x coordinate of the characteristic point of the sacral stem The corresponding y coordinate of the x coordinate on the straight line function is the final position of the pulse. The pulse recognition system according to claim 1, wherein said pulse recognition system further comprises a support structure for placing the tester's wrist, which ensures that the tester enters the imaging system in a fixed posture each time the wrist is in a fixed posture. Imaging area. The pulse recognition system of claim 1 wherein said pulse recognition system further comprises a word laser emitter for providing a laser pointer for reference as a tester's wrist wrist alignment. position. The pulse recognition system according to claim 1, wherein the pulse recognition system further comprises a three-dimensional mobile station and a point laser emitter; wherein the point laser emitter is disposed on the three-dimensional mobile station So that the three-dimensional mobile station can move the point laser emitted by the point laser emitter to indicate the pulse position of the tester's wrist based on the calculation result of the pulse extraction algorithm unit. The pulse recognition system according to claim 1, wherein said pulse recognition system further comprises a pulse wave sensor disposed on said three-dimensional mobile station, said three-dimensional mobile station being capable of being based on said pulse extraction algorithm The calculation result of the unit moves the pulse wave sensor to the position of the pulse of the tester's wrist to correctly acquire the pulse wave. The pulse recognition system according to claim 1, wherein: The step of obtaining the outline of the tester's arm and the wrist based on the infrared image acquired by the imaging system based on the infrared pulse acquisition algorithm unit includes: Obtain thermal imaging images of the subject's arm and wrist, and extract the image by edge detection algorithm The outline of the arms and wrists in the thermographic image. The step of preprocessing the obtained contour line by the pulse extraction algorithm unit specifically includes: Step S21, performing a connected domain identification on the contour line obtained in step S1, and determining whether the largest connected domain in the contour line runs through the boundary of the left and right sides of the infrared image, that is, whether there is a breakpoint in the connected domain, if there is no breakpoint The maximum connected domain is the outline of the arm and the wrist to be extracted, and the process proceeds to step S23; Step S22: searching for the edge segment in the range of 2 pixels in the upper, upper left, left, lower left, and lower directions with the left breakpoint of the maximum connected domain as the origin, and if there are other connected domains in the search range, then two The connected domains are connected, and the intermediate breakpoint pixels complement the pixels between the two segments by interpolation, and finally form a new connected domain, and further search for other edge segments with the new connected domain left breakpoint as the origin until the image is reached. Left border Find the edge segment in the range of 2 pixels in the upper, upper right, right, lower right, and lower directions with the right breakpoint of the largest connected domain as the origin. If there are other connected domains in the search range, then the two connected. The domains are connected, and the intermediate breakpoint pixels complement each other by interpolating between the two segments, eventually forming a new connected domain, and further searching for other edge segments with the new connected domain right breakpoint as the origin until reaching the right side of the image. boundary; Among them, the above-mentioned steps of searching left and right and following the breakpoints are in no particular order; Step S23, converting the edge contour of the two-dimensional image obtained based on the maximum connected domain into a one-dimensional curve, eliminating the step point generated during the conversion process, and making the converted one-dimensional curve smoother, highlighting the arm and the wrist. Edge features. The step of extracting the characteristic points of the sacral stalk stem by the smear extraction algorithm unit specifically includes: Step S24, performing feature extraction on the one-dimensional curve of the converted arm and wrist edge contours, and searching for the lowest depression between the hand and the sacral stem; Step S25, searching for the first peak in the curvature waveform corresponding to the contour line in the range of 0 to 4 cm on the left side of the reference with the lowest depression as a reference, and if present, the peak is identified as the x of the pulse. The coordinates, if not present, are identified as the x-coordinate of the Guan pulse. Wherein, the step of finding the lowest depression between the hand and the sacral stalk is based on the fact that the sacral stalk has a maximum boundary bending amplitude on the edge contour of the wrist depression to the arm; The step of the Guanmai extraction algorithm unit fitting the radial artery image in the thermographic image into a straight line function specifically includes: Step S31, constructing a radial artery region for the thermographic image, and setting a threshold for providing a threshold reference for binarizing the radial artery region; Step S32, binarizing the radial artery region, separating the image of the radial artery from other portions in the thermographic image; In step S33, the radial artery image obtained in step S32 is fitted to a straight line function. The pulse-recognition system according to claim 6, wherein the step of constructing the radial artery region for the thermographic image in step S31, the step of setting the threshold value comprises: Constructing an area for each origin using each pixel on the contour line generated after preprocessing; The threshold of the mean and the variance is set according to the statistical rule of the mean and variance of the region of the radial artery boundary position. The pulse-recognition system according to claim 7, wherein the step of binarizing the radial artery region in step S32 comprises: Calculating the mean and variance of the pixels in each edge pixel region; The mean and variance of the pixels in each of the generated edge pixel regions are successively compared with a threshold, and the region meeting the threshold condition is binarized. The pulse recognition system according to claim 7, wherein the step of fitting the radial artery image into a straight line function in step S33 comprises: Obtaining the ordinate of the pixel of the binarized radial artery image to obtain a curve describing the radial artery image; Straight line fitting of the curve yields a linear function that includes the trend of the radial artery.

Images