TWI837039B - Image superposition method, image display method and clinical examination method of augmented reality for human acupuncture points - Google Patents

Abstract

An augmented reality clinical examination method includes: placing a blank prosthetic model on a model identification map; setting a acupoint marker corresponding to a test acupoint name on the blank prosthetic model; attaching a tip of a marker pen including a marker identification figure to the corresponding acupoint marker; performing image recognition to obtain a marker recognition map position of the marker identification figure, a marking position of the acupoint marker, and a model identification map position of the model identification map by a computer device; using an image superposition method and an image display method to determining whether a test-specified acupoint position in a virtual three-dimensional blank model overlapped three-dimensional acupoint model object matches the marking position by the computer device.

Description

Image superposition method and image display for augmented reality of human acupuncture points Indicative methods and clinical testing methods

The present invention relates to an image superposition method, an image display method and a clinical test method, and in particular to an augmented reality image superposition method, image display method and clinical test method for human acupuncture points.

Currently, in traditional acupuncture learning, it is usually taught by doctors themselves, or by some more experienced seniors guiding younger students. However, this model has limited manpower after all. If the class system is to be expanded, there must be better learning and assessment methods. The existing objective structured clinical skills test (OSCE) is presented to intern medical students with standardized patients simulating real clinical situations. Candidates need to go through 12 pre-scripted TCM clinical test stations, encounter standardized patients presenting TCM clinical medical problems, conduct TCM medical history interviews, four diagnoses and physical examinations, acupuncture point calibration, orthopedic muscle massage, clinical treatment and TCM health education, disease explanation and doctor-patient communication, and even the treatment of TCM complications related to Western medicine. The standard test process for acupuncture point calibration is still under development and has become a problem to be solved.

Therefore, the purpose of the present invention is to provide an augmented reality image superposition method, image display method and clinical testing method that effectively reduces the location error of acupuncture points and an objective scoring mechanism.

Therefore, one aspect of the present invention provides an augmented reality image superposition method for human acupuncture points, which is suitable for and implemented by a computer device and includes steps (A) to (G).

In step (A), a virtual three-dimensional acupoint model object corresponding to an acupoint prosthesis model is obtained.

In step (B), a virtual three-dimensional blank model object corresponding to a blank prosthesis model is obtained.

In step (C), the virtual three-dimensional acupoint model object is scanned to obtain a virtual acupoint model rectangular object, and a virtual acupoint model rectangular object center point position of the virtual acupoint model rectangular object is calculated as a virtual acupoint model object center point position.

In step (D), the virtual three-dimensional blank model object is scanned to obtain a virtual blank model cuboid object, and a virtual blank model cuboid object center point position of the virtual blank model cuboid object is calculated as a virtual blank model object center point position.

In step (E), a cuboid mapping proportion vector of the virtual acupuncture point model cuboid object relative to the virtual blank model cuboid object is calculated.

In step (F), adjust the size of the virtual three-dimensional acupuncture point model object according to the cuboid mapping proportion vector to obtain an adjusted virtual three-dimensional acupoint model object. An adjusted virtual acupoint model object of the adjusted virtual three-dimensional acupoint model object. The center point position is equal to the center point position of the virtual acupuncture point model object.

In step (G), align the center point position of the adjusted virtual acupoint model object with the center point position of the virtual blank model object to generate the adjusted virtual three-dimensional acupoint model object and the virtual A virtual three-dimensional blank model overlapping the three-dimensional acupuncture point model object overlaps the three-dimensional blank model object.

In some implementations, in step (A), the computer device downloads the virtual three-dimensional acupuncture point model object from a database, or the computer device scans the acupuncture point prosthesis model through a three-dimensional scanner. To generate the virtual three-dimensional acupuncture point model object. In step (B), the computer device downloads the virtual three-dimensional blank model object from the database, or the computer device scans the blank prosthesis model with the three-dimensional scanner to generate the virtual three-dimensional blank model object.

In other embodiments, in step (C), the computer device faces forward with a virtual three-dimensional acupoint model object, and scans the virtual three-dimensional acupoint model object in the up-down direction to obtain an upper plane and a lower plane of the virtual three-dimensional acupoint model object, and scans the virtual three-dimensional acupoint model object in the left-right direction to obtain a left plane and a right plane of the virtual three-dimensional acupoint model object, and scans the virtual three-dimensional acupoint model object in the forward-backward direction to obtain a front plane and a rear plane of the virtual three-dimensional acupoint model object. The computer device performs a union of the upper plane, the lower plane, the left plane, the right plane, the front plane, and the rear plane to obtain the virtual acupoint model rectangular parallelepiped object.

The computer device calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the line connecting the center point of the left plane and the center point of the right plane, or the center point of the line connecting the center point of the front plane and the center point of the back plane as the center point position of the virtual acupuncture point model cuboid object.

In step (D), the computer device faces a front side of a virtual three-dimensional blank model object of the virtual three-dimensional blank model object forward, and scans the virtual three-dimensional blank model object in the up and down directions to obtain an upper plane and a lower plane of the virtual three-dimensional blank model object. , and scan in the left and right directions respectively to obtain a left plane and a right plane of the virtual three-dimensional blank model object, and scan in the front and back directions respectively to obtain a front plane and a rear plane of the virtual three-dimensional blank model object. The computer device combines the upper plane, the lower plane, the left plane, the right plane, the front plane, and the rear plane to obtain the virtual blank model cuboid object.

The computer device calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the line connecting the center point of the left plane and the center point of the right plane, or the center point of the line connecting the center point of the front plane and the center point of the back plane as the center point position of the virtual blank model cuboid object.

In some implementations, in step (E), the cuboid mapping proportion vector includes an upper and lower length mapping proportion vector, a left and right width mapping proportion vector, and a front and rear depth mapping proportion vector. The computer device calculates the ratio of the distance between the upper plane and the lower plane of the virtual acupuncture point model cuboid object to the distance between the upper plane and the lower plane of the virtual blank model cuboid object, and obtains the upper and lower length mapping proportion vector, And calculate the ratio of the distance between the left plane and the right plane of the virtual acupuncture point model cuboid object to the distance between the left plane and the right plane of the virtual blank model cuboid object, and obtain the left and right width mapping proportion vector, and calculate the The front-to-back depth mapping proportion vector is obtained by the ratio of the distance between the front plane and the back plane of the virtual acupuncture point model cuboid object to the distance between the front plane and the back plane of the virtual blank model cuboid object.

In some implementations, in step (F), the computer device generates the virtual three-dimensional acupuncture point model object according to the up and down length mapping proportion vector, the left and right width mapping proportion vector, and the front and rear depth mapping proportion vector. Adjust the corresponding three directions and proportions respectively.

Therefore, another aspect of the present invention is to provide an augmented reality image display method for human body acupuncture points, which is applicable to a computer device including an image capture unit, a computer equipment, a blank prosthesis model, and a model recognition diagram including a marking frame, and includes steps (A) to (D).

In step (A), the computer device pre-stores a virtual three-dimensional model identification map object corresponding to the model identification map and any one of the implementation aspects of the aforementioned augmented reality image superposition method for human acupuncture points. The virtual three-dimensional blank model overlaps the three-dimensional acupoint model object.

In step (B), the computer device is used to set the virtual three-dimensional blank model overlaid with the three-dimensional acupuncture point model object on the mark frame in the virtual three-dimensional model identification map object.

In step (C), the blank prosthesis model is placed on the marked box of the model identification diagram.

In step (D), the image capture unit photographs the blank prosthesis model and the model recognition image, and the computer device performs image recognition on the model recognition image and, based on the setting relationship between the virtual three-dimensional blank model overlapping three-dimensional acupoint model object and the virtual three-dimensional model recognition image object stored in the computer device, the virtual three-dimensional blank model overlapping three-dimensional acupoint model object is displayed together with the blank prosthesis model in an augmented reality manner.

In some implementations, the mark box indicates a preset direction, and in step (B), an object front side of the virtual three-dimensional blank model overlapping the three-dimensional acupuncture point model object faces the preset direction of the mark box, The front surface of the object is the same as the front surface of the virtual three-dimensional blank model object. In step (C), a model front of the blank prosthetic model faces the preset direction of the mark frame, and the model is facing Facing the front of the virtual three-dimensional blank model object.

In some implementations, the computer device is a smartphone, a tablet, a head-mounted smart glasses, a laptop, or a computer host, and the image capture unit is a photography module or A webcam.

Therefore, another aspect of the present invention provides a clinical testing method for augmented reality of human acupuncture points, which is applicable to a subject, a computer device including an image acquisition unit, a blank prosthesis model, and a model recognition diagram including a marking frame, and includes steps (A) to (E).

In step (A), the blank prosthesis model is placed on the marked frame of the model identification image.

In step (B), after the subject obtains a test acupoint name, a response acupoint marking point corresponding to the test acupoint name is set on the blank prosthesis model.

In step (C), a tip of the marker pen is attached to the responding acupuncture point.

In step (D), the image capture unit captures a real marker recognition image of the marker recognition image and a real model recognition image of the model recognition image, and the computer device performs image recognition on the real marker recognition image and the real model recognition image to obtain a marker recognition image position of the marker recognition image, a marking position of the corresponding acupuncture point marking point, and a model recognition image position of the model recognition image.

In step (E), the computer device determines whether a test designated acupoint position corresponding to the test acupoint name in the virtual three-dimensional blank model overlapping three-dimensional acupoint model object of any implementation of the aforementioned augmented reality image display method for human acupoints is consistent with the marked position of the response acupoint marking point.

In some embodiments, the augmented reality clinical testing method for human body acupuncture points further includes (F) between steps (A) and (B), wherein an examiner uses the computer device to select the test designated acupuncture point position corresponding to the test acupuncture point name in the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object, and then notifies the test subject of the test acupuncture point name through the computer device.

In some implementations, in step (E), the computer device also displays a virtual marker object corresponding to the marker in an augmented reality manner, overlapping the marker according to the position of the marker identification map.

The effect of the present invention is that: the image superposition method of augmented reality for human body acupuncture points can generate the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object in which the adjusted virtual three-dimensional acupuncture point model object overlaps with the virtual three-dimensional blank model object, and the image display method of augmented reality for human body acupuncture points can overlap and display the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object and the blank prosthesis model in an augmented reality manner, thereby being able to effectively reduce the position error of acupuncture points and an objective scoring mechanism through the clinical test method of augmented reality for human body acupuncture points.

1: Computer equipment

11: Processing unit

12:Storage unit

13: Communication unit

2:Computer device

21: Processing unit

22: Image capture unit

23: Display unit

24:Storage unit

40: Three-dimensional objects

41, 43, 45: plane

51: Model identification diagram

52: Marking box

53:Area

S11~S17, S21~S24, S31~S36: Steps

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: FIG. 1 is a block diagram illustrating a computer device and a computer apparatus applicable to the image superposition method, image display method and clinical test method for augmented reality of human body acupuncture points of the present invention; FIG. 2 is a flow chart illustrating an embodiment of the image superposition method for augmented reality of human body acupuncture points of the present invention; FIG. 3 is a flowchart illustrating an embodiment of the image superposition method for augmented reality of human body acupuncture points of the present invention; A three-dimensional diagram exemplarily illustrates a virtual three-dimensional acupoint model object and a virtual acupoint model rectangular object; FIG. 4 is a flow chart illustrating an embodiment of the image display method of the present invention for augmented reality of human acupoints; FIG. 5 is a three-dimensional diagram exemplarily illustrating a model recognition diagram; and FIG. 6 is a flow chart illustrating an embodiment of the clinical test method of the present invention for augmented reality of human acupoints.

Before the present invention is described in detail, it should be noted that similar components are represented by the same numbers in the following description.

Referring to Figure 1, embodiments of the present invention's augmented reality image superposition method, image display method, and clinical testing method for human acupuncture points are applicable to a computer equipment 1 and a computer device 2. The computer device 1 is, for example, a computer host and includes a processing unit 11 , a storage unit 12 , and a communication unit 13 . The processing unit 11 is, for example, one or more processors. The storage unit 12 is, for example, a memory and a disk device. The communication unit 13 is, for example, a USB connection device, an Ethernet network card, or a wireless device. Communication module. The computer device 2 includes a processing unit 21, an image capture unit 22, a display unit 23, and a storage unit 24, and is, for example, a smart phone, a tablet computer, a head-mounted smart glasses, a notebook computer, or another computer host. The processing unit 21 is, for example, a processor, the image capture unit 22 is, for example, a photography module or a webcam, the display unit 23 is, for example, a display, and the storage unit 24 is, for example, a memory. A disk device.

Referring to Figures 1 and 2, the embodiment of the image superposition method for augmented reality of human body acupuncture points of the present invention includes steps S11 to S17.

In step S11, a virtual three-dimensional acupoint model object corresponding to an acupoint prosthesis model is obtained through the computer device 1. For example, the acupuncture point prosthesis model is a standard acupuncture point model purchased at a traditional Chinese medicine professional acupuncture equipment store, and includes a square base. In this embodiment, the acupuncture point prosthesis model is the human head and includes Baihui, Yintang, Zanzhu, Shenting, Yingxiang, Dicang, Jieche, Shugu, Fengchi, Touwei, Yangbai, There are 15 acupoints such as Sibai, Fengfu, Wangu, and Yifeng, but in other embodiments, It is not limited to this. The computer device 1 downloads the virtual three-dimensional acupuncture point model object from a database, such as another computer device. Alternatively, the computer device 1 scans the acupuncture point prosthesis model with a three-dimensional scanner (such as Artec 3D Scanner) to generate the virtual three-dimensional acupoint model object.

In step S12, a virtual three-dimensional blank model object corresponding to a blank prosthesis model is obtained by the computer device 1. The blank prosthesis model and the acupoint prosthesis model correspond to the same human body part, such as the head, and both include a square base and do not include any acupoints. For example, the blank prosthesis model and the acupoint prosthesis model are the same in size and shape, or the shapes of the two are the same but the sizes are different. Similarly, the computer device 1 downloads the virtual three-dimensional blank model object from the database. Alternatively, the computer device 1 scans the blank prosthesis model by the three-dimensional scanner to generate the virtual three-dimensional blank model object.

In step S13, the computer device 1 executes a software (such as Unity) to scan the virtual three-dimensional acupoint model object, thereby obtaining a virtual acupoint model rectangular object, and calculating a virtual acupoint model rectangular object center point position of the virtual acupoint model rectangular object as a virtual acupoint model object center point position.

In more detail, the computer device 1 faces the front of the virtual three-dimensional acupoint model object forward, that is, the computer device 1 determines the front of the virtual three-dimensional acupoint model object according to the part of the human body to which the virtual three-dimensional acupoint model object corresponds, such as the face of the head, according to the preset settings.

Referring again to Figure 3, the computer device 1 also scans in the up and down directions (ie, from top to bottom and from bottom to top) in the software to pass the corresponding virtual three-dimensional acupuncture point model objects (such as the three-dimensional objects 40). The upper and lower vertex coordinates are used to obtain an upper plane (such as plane 41) and a lower plane of the virtual three-dimensional acupuncture point model object, and similarly, the left and right directions are scanned respectively to pass the corresponding virtual three-dimensional acupuncture point model object (such as The left and right vertex coordinates of the three-dimensional object 40) are used to obtain a left plane (such as plane 43) and a right plane of the virtual three-dimensional acupuncture point model object, and the same is also scanned in the front and back directions respectively to pass the corresponding virtual The coordinates of the front and back vertices of the three-dimensional acupuncture point model object (such as the three-dimensional object 40) are used to obtain a front plane (such as the plane 45) and a back plane of the virtual three-dimensional acupoint model object. The computer device 1 combines the upper plane, the lower plane, the left plane, the right plane, the front plane, and the back plane to obtain the virtual acupuncture point model cuboid object.

The computer device 1 then calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the line connecting the center point of the left plane and the center point of the right plane, or the center point of the line connecting the center point of the front plane and the center point of the back plane as the center point position of the virtual acupuncture point model cuboid object.

In step S14, the computer device 1 scans the virtual three-dimensional blank model object in the software to obtain a virtual blank model cuboid object, and calculates a center point position of the virtual blank model cuboid object of the virtual blank model cuboid object. Take it as the center point position of a virtual blank model object.

To be more specific, the computer device 1 faces the front of a virtual three-dimensional blank model object of the virtual three-dimensional blank model object toward the front. Similarly, the front of the virtual three-dimensional blank model object is also the face of the head.

The computer device 1 similarly scans in the up and down directions in the software to obtain a virtual three-dimensional blank model object by corresponding to the upper and lower vertex coordinates of the virtual three-dimensional blank model object (such as the three-dimensional object 40). The upper plane (such as plane 41) and the lower plane are also scanned in the left and right directions respectively to obtain the virtual three-dimensional model object by corresponding to the left and right vertex coordinates of the virtual three-dimensional blank model object (such as the three-dimensional object 40). A left plane (such as plane 43) and a right plane of the blank model object are also scanned in the front and rear directions respectively to pass the front and back vertex coordinates corresponding to the virtual three-dimensional blank model object (such as three-dimensional object 40). , and obtain a front plane (such as plane 45) and a back plane of the virtual three-dimensional blank model object. The computer device 1 combines the upper plane, the lower plane, the left plane, the right plane, the front plane, and the rear plane to obtain the virtual blank model cuboid object.

The computer device 1 calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the line connecting the center point of the left plane and the center point of the right plane, or the center point of the line connecting the center point of the front plane and the center point of the back plane as the center point position of the virtual blank model cuboid object.

In addition, it is particularly noted that: before the software scans the virtual three-dimensional acupuncture point model object or the virtual three-dimensional blank model object, the computer device 1 can automatically adjust the software or manually adjust the user to make the connection line of the two ears (such as the predetermined points of the ears) of the head in the image appear horizontal, and the nose (such as the nose tip point) in the image is relatively located at the center of the two ears, so as to avoid the virtual three-dimensional acupuncture point model object and the virtual three-dimensional blank model object from rotating relative to each other. Furthermore, FIG. 3 uses the three-dimensional object 40 as the virtual three-dimensional acupuncture point model object or the virtual three-dimensional blank model object to display the relationship with each plane, so the acupuncture points are not specifically marked.

In step S15, the computer device 1 calculates the ratio of the distance between the upper plane and the lower plane of the virtual acupoint model rectangular object to the distance between the upper plane and the lower plane of the virtual blank model rectangular object, thereby obtaining a set of upper and lower length mapping ratio vectors included in a set of rectangular mapping ratio vectors, and calculates the ratio of the distance between the left plane and the right plane of the virtual acupoint model rectangular object to the distance between the left plane and the right plane of the virtual blank model rectangular object. The ratio of the distance between the left plane and the right plane of the cuboid object is calculated to obtain a left-right width mapping ratio vector included in the cuboid mapping ratio vector, and the ratio of the distance between the front plane and the back plane of the virtual acupoint model cuboid object and the distance between the front plane and the back plane of the virtual blank model cuboid object is calculated to obtain a front-back depth mapping ratio vector included in the cuboid mapping ratio vector

In step S16, the computer device 1 adjusts the size of the virtual three-dimensional acupoint model object according to the rectangular parallelepiped mapping scale vector, that is, the virtual three-dimensional acupoint model object is adjusted according to the three directions and scales corresponding to the upper and lower length mapping scale vector, the left and right width mapping scale vector, and the front and back depth mapping scale vector, to obtain an adjusted virtual three-dimensional acupoint model object. The adjusted virtual three-dimensional acupoint model object has a center point position equal to the center point position of the virtual acupoint model object.

In step S17, the computer device 1 aligns the center point position of the adjusted virtual three-dimensional acupoint model object with the center point position of the virtual blank model object to generate a virtual three-dimensional blank model overlapping three-dimensional acupoint model object in which the adjusted virtual three-dimensional acupoint model object and the virtual three-dimensional blank model object overlap.

Referring to FIG. 1 and FIG. 4 , the embodiment of the image display method for augmented reality of human body acupuncture points of the present invention is applicable to the computer device 2, the computer device 1, the blank prosthesis model, and a model recognition diagram including a marking frame, and includes steps S21 to S24. Referring to FIG. 5 , an exemplary embodiment of the model recognition diagram 51 is illustrated. The model recognition diagram 51 is an image including asymmetric features, but it should be particularly noted that FIG. 5 does not depict images of these asymmetric features. In this embodiment, the image of the model recognition diagram 51 is verified by a Vuforia platform and has a recognition rate of four or five stars, but it is not limited to this software.

In step S21, the computer device 1 pre-stores a virtual three-dimensional model recognition image object corresponding to the model recognition image 51 and the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object of the augmented reality image overlay method for human body acupuncture points of the present invention.

In step S22, the computer device 1 sets the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object on the mark frame in the virtual three-dimensional model identification map object, and the mark frame indicates a preset direction, and the The front surface of an object of the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object faces the preset direction of the mark frame, and the front surface of the object is the same as the front surface of the virtual three-dimensional blank model object. In this embodiment, the size of the mark frame is the same as the bottom size of the blank prosthesis model. Therefore, the software (such as Unity) executed by the computer device 1 obtains the virtual three-dimensional blank model overlapping the three-dimensional acupuncture point model object and The virtual three-dimensional model identifies the arrangement relationship between the objects in the drawing, that is, the relationship between the relative positions.

In step S23, the blank prosthesis model is set on the marking frame 52 of the model identification image 51. For example, the model identification image 51 of FIG5 is attached to an object with thickness, such as a 3 mm thin plate, by setting latches (such as two protrusions) (not shown) on the four sides of the marking frame 52, and one side of the marking frame 52 is marked with the preset direction, such as by color (such as located in area 53) or arrows (not shown), so that the blank prosthesis model is stably set on the marking frame 52, and a model front of the blank prosthesis model faces the preset direction of the marking frame 52. The front of the model corresponds to the front of the virtual three-dimensional blank model object, that is, the face of the head.

In step S24, the blank prosthetic model and the model identification image are captured by the image capture unit 22, and the computer device 2 performs image recognition on the model identification image. To obtain the position of the model identification map in space, the computer device 2 also sets the relationship between the overlapping three-dimensional acupuncture point model object and the virtual three-dimensional model identification map object according to the virtual three-dimensional blank model stored in the computer device 1 , the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object is overlapped with the blank prosthesis model in an augmented reality manner, and the model identification diagram and the virtual three-dimensional model identification diagram object are not displayed.

Referring to FIG. 1 and FIG. 6 , an embodiment of the present invention for the augmented reality clinical testing method of human body acupuncture points is applicable to a subject, an experimenter, and a marking pen including a marking identification diagram, and includes steps S31 to S36.

In step S31, the blank prosthetic model is set on the marked frame of the model identification diagram.

In step S32, the examiner uses the computer device 2 to select a test designated acupuncture point position corresponding to a test acupoint name in the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object, and then uses the computer device 2 to notify the The name of the test acupuncture point of the subject.

In step S33, the subject sets a response acupoint mark point on the blank prosthesis model at a position corresponding to the name of the test acupoint (that is, the location answered by the subject in the clinical test). The response acupoint marking point is, for example, a small dot sticker, or a mark made by a pencil.

In step S34, the tip of the marking pen is attached to the response acupoint marking point. The mark identifier is provided at the other end of the marker pen or at a position far away from the pen tip. Recognize pictures. The marker recognition map is used to provide the computer device 2 with image recognition of the captured image, so as to determine the orientation of the marker recognition map in space.

In step S35, the image capturing unit 22 captures a real mark identification image of the mark identification map and a real model identification image of the model identification map, and the computer device 2 captures the real mark The identification map image and the real model identification map image are used for image recognition to obtain a marker identification map position of the marker identification map, a mark position of the response acupoint marker point, and a model identification map position of the model identification map. Since the size and shape of the marker pen are known in advance, the computer device 1 or the computer device 2 stores in advance the positional correspondence between the two ends of the marker pen in space, so that the marker can be The position of the mark is determined by identifying the position of the image.

In step S36, the computer device 2 overlaps the virtual three-dimensional blank model of the image display method and the image superposition method of the present invention with the three-dimensional acupuncture point model object and the blank prosthesis model, and displays them together in an augmented reality manner. . In addition, the computer device 2 also overlays a virtual marker pen object corresponding to the marker pen with the marker pen in an augmented reality manner based on the position of the marker recognition image. The computer device 2 determines whether a test designated acupoint position corresponding to the test acupoint name in the overlapping three-dimensional acupoint model object of the virtual three-dimensional blank model is consistent with the response acupoint mark point, so as to determine the subject's response to the test acupoint name. Is the location answered correctly? For example, the computer device 2 determines that the test designation is based on a predetermined distance threshold. When the distance between the acupuncture point position and the responding acupoint marking point is less than or equal to the distance threshold, it is determined that the test designated acupuncture point position is consistent with the responding acupoint marking point, that is, the subject's answer is correct. On the contrary, when it is determined that the distance between the position of the designated acupoint in the test and the marker point of the responding acupoint is greater than the distance threshold, it is determined that the position of the designated acupoint in the test does not match the marker point of the responding acupoint, that is, the subject's answer is wrong.

In summary, the augmented reality image superposition method for human body acupuncture points can generate the virtual three-dimensional blank model overlapping three-dimensional acupuncture points in which the adjusted virtual three-dimensional acupoint model object overlaps the virtual three-dimensional blank model object. A model object, and through the augmented reality image display method for human acupoints, the virtual three-dimensional blank model can be overlaid and displayed in an augmented reality manner. The three-dimensional acupuncture point model object and the blank prosthesis model can be overlapped and displayed together, Furthermore, the augmented reality clinical testing method for human acupuncture points can be used to effectively reduce the position error of the acupoints and achieve an objective scoring mechanism, so the purpose of the present invention can indeed be achieved.

However, the above is only an example of the implementation of the present invention, and it cannot be used to limit the scope of the implementation of the present invention. All simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the patent specification are still within the scope of the patent of the present invention.

S31~S36: Steps

Claims (11)

An augmented reality image superposition method for human acupuncture points, which is suitable for and implemented by a computer device, and includes: step (A) obtaining a virtual three-dimensional acupoint model object corresponding to an acupuncture point prosthesis model ; Step (B) obtains a virtual three-dimensional blank model object corresponding to a blank prosthesis model; Step (C) scans the virtual three-dimensional acupoint model object to obtain a virtual acupoint model cuboid object, and calculates the virtual acupoint model cuboid object The center point position of a virtual acupuncture point model cuboid object is used as the center point position of a virtual acupuncture point model object; step (D) scans the virtual three-dimensional blank model object to obtain a virtual blank model cuboid object, and calculates the virtual blank model cuboid object The center point position of a virtual blank model cuboid object of the object is used as the center point position of a virtual blank model object; step (E) calculates a cuboid mapping proportion vector of the virtual acupuncture point model cuboid object relative to the virtual blank model cuboid object; step (E) F) Adjust the size of the virtual three-dimensional acupuncture point model object according to the cuboid mapping proportion vector to obtain an adjusted virtual three-dimensional acupoint model object. The center point position of the adjusted virtual acupoint model object of the adjusted virtual three-dimensional acupoint model object is equal to The center point position of the virtual acupoint model object; and step (G) comparing the adjusted center point position of the virtual three-dimensional acupoint model object with the virtual blank model object The center point positions are aligned to generate a virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object in which the adjusted virtual three-dimensional acupuncture point model object overlaps the virtual three-dimensional blank model object. The augmented reality image superposition method for human acupuncture points as described in claim 1, wherein in step (A), the computer device downloads the virtual three-dimensional acupoint model object from a database, or the The computer device scans the acupuncture point prosthesis model with a three-dimensional scanner to generate the virtual three-dimensional acupoint model object. In step (B), the computer device downloads the virtual three-dimensional blank model object from the database, or the The computer equipment scans the blank prosthetic model through the three-dimensional scanner to generate the virtual three-dimensional blank model object. The augmented reality image superposition method for human body acupuncture points as described in claim 1, wherein in step (C), the computer device is a front side of a virtual three-dimensional acupoint model object of the virtual three-dimensional acupoint model object. Facing forward, scan in the up and down directions to obtain an upper plane and a lower plane of the virtual three-dimensional acupuncture point model object, and scan in the left and right directions to obtain a left plane and a right plane of the virtual three-dimensional acupuncture point model object, and then The computer equipment scans the upper plane, the lower plane, the left plane, the right plane, the front plane, and the back plane respectively to obtain a front plane and a back plane of the virtual three-dimensional acupuncture point model object. The virtual acupuncture point model cuboid object is obtained by union, and the computer device calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the left plane and the center point of the right plane. The center point of the connecting line, or the center point of the front plane and the back plane The center point of the line connecting the center points is used as the center point position of the virtual acupuncture point model cuboid object. In step (D), the computer device faces the front of a virtual three-dimensional blank model object of the virtual three-dimensional blank model object forward, and Scan in the up and down directions to obtain an upper plane and a lower plane of the virtual three-dimensional blank model object, and scan in the left and right directions to obtain a left plane and a right plane of the virtual three-dimensional blank model object, and scan in the front and back directions respectively. To obtain a front plane and a back plane of the virtual three-dimensional blank model object, the computer device is obtained by combining the upper plane, the lower plane, the left plane, the right plane, the front plane, and the back plane. For the virtual blank model cuboid object, the computer device calculates the center point of the line connecting the center point of the upper plane and the center point of the lower plane, or the center point of the line connecting the center point of the left plane and the center point of the right plane. point, or the center point of the line connecting the center point of the front plane and the center point of the rear plane as the center point position of the virtual blank model cuboid object. As described in claim 3, the image overlay method for augmented reality of human acupuncture points, wherein in step (E), the rectangular parallelepiped mapping ratio vector includes a top-bottom length mapping ratio vector, a left-right width mapping ratio vector, and a front-back depth mapping ratio vector, and the computer device calculates the ratio of the distance between the upper plane and the lower plane of the virtual acupuncture point model rectangular parallelepiped object to the distance between the upper plane and the lower plane of the virtual blank model rectangular parallelepiped object, and obtains the top-bottom and bottom-bottom distances. The length mapping ratio vector is obtained by calculating the ratio of the distance between the left plane and the right plane of the virtual acupoint model rectangular object to the distance between the left plane and the right plane of the virtual blank model rectangular object, thereby obtaining the left-right width mapping ratio vector, and the ratio of the distance between the front plane and the back plane of the virtual acupoint model rectangular object to the distance between the front plane and the back plane of the virtual blank model rectangular object is calculated to obtain the front-back depth mapping ratio vector. The augmented reality image superposition method for human acupuncture points as described in claim 4, wherein in step (F), the computer device maps the virtual three-dimensional acupuncture point model object according to the upper and lower length mapping proportion vector, The three directions and proportions corresponding to the left and right width mapping proportion vectors and the front and rear depth mapping proportion vectors are adjusted. An augmented reality image display method for human body acupuncture points, applicable to a computer device including an image capture unit, a computer equipment, a blank prosthetic model, and a model identification diagram including a mark frame, and Comprising: step (A) using the computer device to pre-store a virtual three-dimensional model identification map object corresponding to the model identification map and the virtual three-dimensional blank model overlapping three-dimensional acupuncture point model object of any one of the requirements 1 to 5; Step (B) uses the computer equipment to set the virtual three-dimensional blank model overlaid with the three-dimensional acupuncture point model object on the marked frame in the virtual three-dimensional model identification diagram object; step (C) sets the blank prosthesis model on the on the marked frame of the model identification diagram; step (D) uses the image capture unit to capture the blank prosthetic model and the model identification diagram, and uses the computer device to perform image recognition on the model identification diagram and perform image recognition based on the computer The virtual three-dimensional blank model stored in the device is The setting relationship between the overlapping three-dimensional acupuncture point model object and the virtual three-dimensional model identification chart object is such that the overlapping three-dimensional acupuncture point model object of the virtual three-dimensional blank model is overlapped and displayed with the blank prosthesis model in an augmented reality manner. The augmented reality image display method for human acupuncture points as described in claim 6, wherein the mark box indicates a preset direction, and in step (B), the virtual three-dimensional blank model overlaps the three-dimensional acupoint model object The front side of an object faces the preset direction of the mark frame, and the front side of the object is the same as the front side of the virtual three-dimensional blank model object. In step (C), a front side of a model of the blank prosthetic model Towards the preset direction of the mark box, the front face of the model faces the front face of the virtual three-dimensional blank model object. The augmented reality image display method for human acupuncture points as described in claim 7, wherein the computer device is a smart phone, a tablet computer, a wearable smart glasses, a notebook computer, or a Computer host, the image capture unit is a photography module or a network camera (Webcam). An augmented reality clinical testing method for human acupuncture points, which is applicable to a subject, a computer device including an image capture unit, a blank prosthetic model, a model identification diagram including a marking frame, and A marking pen including a mark identification diagram, and includes: step (A) setting the blank prosthesis model on the mark frame of the model identification diagram; step (B) obtaining a test acupoint name through the subject Finally, set a response acupoint mark point corresponding to the name of the test acupoint on the blank prosthesis model; Step (C) uses the tip of the marking pen to attach to the response acupoint marking point; step (D) uses the image capture unit to capture a real mark recognition map image of the mark recognition map, and the model recognition A real model recognition map image of the mark, and the computer device performs image recognition on the real mark recognition map image and the real model recognition map image to obtain a marker recognition map position and the response acupoint of the mark recognition map a mark position of the mark point, and a model identification map position of the model identification map; and step (E) using the computer device to determine the overlapping three-dimensional acupuncture points of the virtual three-dimensional blank model of any one of claims 6 to 8 Test whether a designated acupoint position corresponding to the test acupoint name in the model object matches the mark position of the response acupoint mark point. The augmented reality clinical testing method for human acupoints as described in claim 9 also includes step (F) between step (A) and step (B), in which an experimenter uses the computer The device selects the test designated acupoint position corresponding to the test acupoint name in the virtual three-dimensional blank model overlapping three-dimensional acupoint model object, and then notifies the subject of the test acupoint name through the computer device. As claimed in claim 10, the augmented reality clinical testing method for human acupuncture points, wherein in step (E), the computer device also displays a virtual marker object corresponding to the marker in an augmented reality manner and superimposed on the marker according to the position of the marker identification map.

Images