[go: up one dir, main page]

TWI884731B - Ai recognition and recovery device for acupuncture needles - Google Patents

Ai recognition and recovery device for acupuncture needles Download PDF

Info

Publication number
TWI884731B
TWI884731B TW113109975A TW113109975A TWI884731B TW I884731 B TWI884731 B TW I884731B TW 113109975 A TW113109975 A TW 113109975A TW 113109975 A TW113109975 A TW 113109975A TW I884731 B TWI884731 B TW I884731B
Authority
TW
Taiwan
Prior art keywords
acupuncture
needle
needles
identification
acupuncture needles
Prior art date
Application number
TW113109975A
Other languages
Chinese (zh)
Other versions
TW202537613A (en
Inventor
劉中賢
周俊男
張榮貴
林奕勳
沈建安
Original Assignee
戴德森醫療財團法人嘉義基督教醫院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 戴德森醫療財團法人嘉義基督教醫院 filed Critical 戴德森醫療財團法人嘉義基督教醫院
Priority to TW113109975A priority Critical patent/TWI884731B/en
Application granted granted Critical
Publication of TWI884731B publication Critical patent/TWI884731B/en
Publication of TW202537613A publication Critical patent/TW202537613A/en

Links

Landscapes

  • Finger-Pressure Massage (AREA)

Abstract

The present invention relates to an AI recognition and recovery device for acupuncture needles, which includes: a frame; a needle placement platform for placing a plurality of acupuncture needles; a driving unit provided on the frame; a photography unit provided with a lens pointing toward the needle placement platform for photographing the acupuncture needles and thereby obtaining an acupuncture needle image; a computing unit for receiving the acupuncture needle image and generating a binary image through calculation; an AI module for recognizing the number of acupuncture needles from the binary image and outputting a recognized value, wherein the AI module is created by deep learning based on a training dataset established through employing a YOLO object detection model and a recursive gated convolution network to perform two rounds of high-level and low-level feature fusion; and an accommodation space provided on the frame. When the recognized value meets the total number of the acupuncture needles used during acupuncture, the driving unit collects the acupuncture needles into the accommodation space.

Description

針灸針的AI辨識回收裝置AI Identification and Recycling Device for Acupuncture Needles

本發明係有關於一種可以提高回收針灸針的準確率及速度之AI辨識系統。 The present invention relates to an AI recognition system that can improve the accuracy and speed of recovering acupuncture needles.

目前在一般的中醫門診時,醫師通常會幫患者使用針灸治療,而每一次施針時的針灸針之數量通常在數十支之間,而且同一時段的門診人數相當的多,因此每一位患者於針灸治療完畢後,醫師拔針時偶而會有遺漏的狀況發生,通常會造成患者因針灸針未拔除而受到傷害,嚴重者甚至於會危害到生命安全。因此會規定要求醫師在施針同時,也要記錄施針的針數及人體區域,當拔針之後要再核對針灸針的數目與記錄是否相符,但由於需要一支一支的計算針灸針並進行加總,因此相當的耗費人力及時間,因而會延誤到後面患者的看診時間。另外雖然有利用金屬電磁感應的方式,以感應是否仍有遺留在患者身上未被拔除的針灸針,但此種方式可避免有遺漏的針灸針未被拔除,但同樣是需要耗費人力及時間來計算並加總針灸針的數量。 At present, in general TCM clinics, doctors usually use acupuncture to treat patients. The number of acupuncture needles used each time is usually between dozens, and the number of outpatients at the same time period is quite large. Therefore, after each patient's acupuncture treatment, doctors occasionally miss a needle when removing it, which usually causes the patient to be injured due to the failure to remove the needle. In severe cases, it may even endanger the patient's life. Therefore, it is required that doctors record the number of needles and the area of the body when performing acupuncture. After removing the needles, they need to check whether the number of acupuncture needles is consistent with the record. However, since the acupuncture needles need to be counted one by one and added up, it is quite labor-intensive and time-consuming, and thus delays the consultation time of the next patient. In addition, although there is a method of using metal electromagnetic induction to sense whether there are still acupuncture needles left in the patient, this method can avoid missing acupuncture needles that have not been removed, but it also requires manpower and time to calculate and add up the number of acupuncture needles.

因此有中華民國109年1月1日所公告的發明第I680779號「具計數裝置之針體回收盒」專利案。其係揭露:配合複數針體使用,其包含有一容置件、以及一可拆卸地連接於該容置件之計數模組。該容置件包含有一底板,一環繞立設於該底板周圍之環牆,以及一由該底板及該環牆共同界定之容置空間。該計數模組包含有一連通該容置空間之投放口,一對應該投放口設置之針體感測裝置,一背向該容置空間設置之計數顯示器,以及一電性連接該針體感測裝置與該計數顯示器之控制器。其中該針體感測裝置係於每一該針體進入該容置空間時傳送一檢測訊號予該控制器,且該控制器依據該檢測訊號控制該計數顯示器顯示相應之數目。Therefore, there is a patent case of invention No. I680779 "Needle Recovery Box with Counting Device" announced on January 1, 2020 in the Republic of China. It discloses: for use with multiple needles, it includes a container and a counting module detachably connected to the container. The container includes a bottom plate, a surrounding wall erected around the bottom plate, and a storage space defined by the bottom plate and the surrounding wall. The counting module includes a delivery port connected to the storage space, a needle sensing device arranged corresponding to the delivery port, a counting display arranged facing away from the storage space, and a controller electrically connecting the needle sensing device and the counting display. The needle sensing device transmits a detection signal to the controller each time the needle enters the accommodating space, and the controller controls the counting display to display the corresponding number according to the detection signal.

該等專利前案於丟針時,如果針灸針有重疊時,容易會被漏算數量,或造成誤判,因此於使用上不盡理想。When discarding needles, if the acupuncture needles overlap, the number of needles may be missed or misjudged, so the use of these prior patents is not ideal.

又有中華民國111年12月1日所公告的新型第M635081號「醫療用自動回收裝置」專利案。其係揭露:係用以提供醫療用廢棄物進行分類回收之自動化裝置,其包含一箱體,包含一上部空間以及一下部空間,上部空間係具有一開口部,且上部空間以及下部空間係相互連通;複數置物桶,其主要係設置於箱體之該下部空間中;一廢棄物辨識裝置,其設於箱體中,其包含一傾倒板、一影像辨識器以及一控制器,傾倒板具有一立桿,立桿設置於該下部空間近中央處,而傾倒板設置於立桿之端部,使其傾倒裝置之高度略高於些置物桶並以該立桿為軸進行360度之樞轉運動,影像辨識器設置於上部空間,並將其影像辨識裝置朝傾倒板方向設置,控制器係分別與影像辨識器、傾倒裝置電性連接,使其可對傾倒板上的醫療廢棄物進行影像辨識,並透過控制器交傾倒板旋轉至對應置物桶上放後進行傾倒作業以及分類之功效。There is also a new patent case No. M635081 "Medical Automatic Recycling Device" announced on December 1, 2012. It discloses: It is an automated device for providing medical waste for classification and recycling, which includes a box body, including an upper space and a lower space, the upper space has an opening, and the upper space and the lower space are interconnected; a plurality of storage bins, which are mainly set in the lower space of the box body; a waste identification device, which is set in the box body, and includes a tilting plate, an image identifier and a controller, the tilting plate has a vertical rod, and the vertical rod is set near the lower space. The tilting plate is arranged at the end of the vertical pole, so that the height of the tilting device is slightly higher than the storage buckets and the vertical pole is used as the axis to perform 360-degree pivoting motion. The image recognition device is arranged in the upper space and is arranged toward the tilting plate. The controller is electrically connected to the image recognition device and the tilting device respectively, so that the image recognition of the medical waste on the tilting plate can be performed, and the tilting plate can be rotated to the corresponding storage bucket through the controller to perform the tilting operation and classification.

該專利前案並無法用以辨識非常細小的針灸針等物件,因此無法用以辨識針灸針之用。The patent application cannot be used to identify very small objects such as acupuncture needles, and therefore cannot be used to identify acupuncture needles.

爰此,有鑑於目前針灸針的回收裝置具有上述的缺點。故本發明提供一種針灸針的AI辨識回收裝置,包含有:一架體;一置針平台,設置於該架體,供置放複數針灸針;一驅動單元,設置於該架體;一攝影單元,具有指向該置針平台的一鏡頭,該攝影單元拍攝該等針灸針,獲得一針灸針影像;一運算單元,連接該攝影單元,接收該針灸針影像,經運算而獲得一二值影像:一AI模組,訊號連接該運算單元,該AI模組使用YOLO物件偵測模型,利用遞歸門控卷積網路進行二次高低階融合,以訓練數據集進行深度學習而建立;該AI模組從該二值影像中辨識該等針灸針的數目,並據以輸出一辨識數值;一容納空間,設置於該架體;當該辨識數值符合一施針總數時,該驅動單元將該等針灸針彙集至該容納空間中。Therefore, in view of the above-mentioned shortcomings of the current acupuncture needle recovery device, the present invention provides an AI recognition and recovery device for acupuncture needles, comprising: a frame; a needle placement platform, which is arranged on the frame and is used to place a plurality of acupuncture needles; a driving unit, which is arranged on the frame; a camera unit, which has a lens pointing to the needle placement platform, and the camera unit takes pictures of the acupuncture needles to obtain an acupuncture needle image; a calculation unit, which is connected to the camera unit, receives the acupuncture needle image, and obtains a binary image through calculation; an AI module, The signal is connected to the computing unit, the AI module uses the YOLO object detection model, utilizes the recursive gated convolutional network to perform secondary high-low order fusion, and is established by deep learning with a training data set; the AI module recognizes the number of the acupuncture needles from the binary image and outputs an identification value accordingly; a storage space is set in the frame; when the identification value meets the total number of needles, the driving unit gathers the acupuncture needles into the storage space.

上述進一步包含一電子操作單元,該電子操作單元係訊號連接該運算單元,該電子操作單元執行一針灸針管理程式,該針灸針管理程式包含有一輸入介面,該輸入介面設有至少一人像施針圖,該人像施針圖具有複數施針區域,每一該施針區域設有一分區數值區,供輸入一施針數目,所有該等施針區域的該施針數目由該電子操作單元匯總為該施針總數,並顯示於該輸入介面的一加總顯示區。The above further includes an electronic operation unit, which is signal-connected to the computing unit. The electronic operation unit executes an acupuncture needle management program. The acupuncture needle management program includes an input interface. The input interface is provided with at least one portrait acupuncture diagram. The portrait acupuncture diagram has a plurality of acupuncture areas. Each of the acupuncture areas is provided with a partitioned numerical area for inputting a number of acupuncture needles. The numbers of acupuncture needles in all the acupuncture areas are aggregated by the electronic operation unit into the total number of acupuncture needles and displayed in a total display area of the input interface.

上述進一步包含一電子操作單元,該電子操作單元係訊號連接該運算單元,該電子操作單元執行一針灸針管理程式,該針灸針管理程式包含有一計時模組,該電子操作單元供輸入一針灸時間,該計時模組執行一時間記錄,當該時間記錄符合該針灸時間,該電子操作單元輸出一提示訊息。The above further includes an electronic operation unit, which is signal-connected to the computing unit. The electronic operation unit executes an acupuncture needle management program. The acupuncture needle management program includes a timing module. The electronic operation unit is used to input an acupuncture time. The timing module executes a time record. When the time record matches the acupuncture time, the electronic operation unit outputs a prompt message.

上述二值影像中包含複數線型集合像素,該運算單元將該二值影像界定為一直角坐標平面,以該二值影像的像素為座標單位,進一步對該等線型集合像素執行一斜率驗證,計算每一該線型集合像素中的一像素斜率,當該像素斜率均在一誤差範圍值之內,該運算單元判定該針灸針為單一支。The binary image contains a plurality of linear set pixels. The operation unit defines the binary image as a rectangular coordinate plane, takes the pixels of the binary image as coordinate units, and further performs a slope verification on the linear set pixels to calculate a pixel slope in each linear set pixel. When the pixel slopes are all within an error range, the operation unit determines that the acupuncture needle is a single one.

上述置針平台係可相對旋動於該架體,該驅動單元驅動該置針平台旋動,使該置針平台上的該等針灸針利用重力落入該容納空間中。The needle placement platform can rotate relative to the frame, and the driving unit drives the needle placement platform to rotate, so that the acupuncture needles on the needle placement platform fall into the accommodating space by gravity.

上述架體設有一辨識空間,該容納空間係位於該辨識空間的下方處,該架體朝向該辨識空間凸設有一支架,該攝影單元係固定於該支架。The frame is provided with an identification space, the accommodating space is located below the identification space, the frame is provided with a bracket protruding toward the identification space, and the photographic unit is fixed to the bracket.

上述置針平台係設為一平面板體,以供樞接於該架體,藉以分隔該辨識空間及該容納空間。The needle placement platform is configured as a flat plate to be pivotally connected to the frame to separate the identification space and the accommodating space.

上述容納空間設有可活動開啟或關閉的一門板,該容納空間內可供置入有一盛接桶,該盛接桶係位於該辨識空間的下方處。The storage space is provided with a door panel that can be opened or closed movably. A receiving bucket can be placed in the storage space. The receiving bucket is located below the identification space.

上述置針平台藉由一樞軸而樞接於該架體,該驅動單元係透過一變速傳動組連動該樞軸,以驅動該置針平台朝向該容納空間旋動一傾斜角度。The needle placement platform is pivotally connected to the frame via a pivot shaft, and the driving unit is linked to the pivot shaft via a variable speed transmission assembly to drive the needle placement platform to rotate toward the accommodating space at a tilting angle.

上述驅動單元係為一步進馬達,該變速傳動組係為一齒輪傳動組或一皮帶傳動組。The driving unit is a stepper motor, and the speed transmission set is a gear transmission set or a belt transmission set.

根據上述技術特徵係具有下列之優點:According to the above technical features, it has the following advantages:

1.當施針者於患者身上拔取全部的針灸針後,係可將其置放於置針平台上,同時開始執行辨識,如數目符合時,將會控制置針平台上的該等針灸針利用重力,可以落入於容納空間中的盛接桶內被收集,如此,則可快速的盤點該針灸針數量及清除收集該等針灸針,以提高回收該針灸針的準確率及速度。1. After the acupuncturist has removed all the acupuncture needles from the patient, they can be placed on the needle placement platform and identification can be started at the same time. If the number matches, the acupuncture needles on the needle placement platform will be controlled to use gravity to fall into the receiving bucket in the storage space and be collected. In this way, the number of acupuncture needles can be quickly counted and cleared to improve the accuracy and speed of recovering the acupuncture needles.

2.同時運算單元並會將上述辨識結果反饋到該電子操作單元,以告知施針者瞭解拔針數目是否與施針總數相符。若是發現數目不符,也可立即進行後續拔針或尋針的處置,藉以可減少遺漏針灸針未拔的情形發生。2. At the same time, the calculation unit will feed back the above recognition results to the electronic operation unit to inform the acupuncturist whether the number of needles removed is consistent with the total number of needles. If the number is found to be inconsistent, the subsequent needle removal or needle search can be carried out immediately to reduce the occurrence of missed acupuncture needles.

3.藉由操作電子操作單元執行針灸針管理程式,可顯示人像施針圖,以方便施針者根據於患者身上相對應的部分施針後,並將施針的部位及施針的數目,透過該人像施針圖於相對應的施針區域進行點選,以及輸入相對應的針數,藉以能快速匯總施針總數,以利於後續的辨識比對。3. By operating the electronic operation unit to execute the acupuncture needle management program, a portrait needle diagram can be displayed to facilitate the acupuncturist to perform acupuncture according to the corresponding part of the patient's body. The acupuncture site and the number of needles can be selected through the portrait needle diagram in the corresponding acupuncture area, and the corresponding number of needles can be input, so that the total number of needles can be quickly summarized to facilitate subsequent identification and comparison.

4.藉由操作計時模組執行計時,並於留針等待時間達到後,該電子操作單元即會發出警示燈號或警示聲音,以提醒施針者準備拔針,可避免留針時間過長,對於患者造成傷害。4. The timing module is operated to execute timing, and when the waiting time for the needle to be left in is reached, the electronic operation unit will emit a warning light or a warning sound to remind the acupuncturist to prepare to remove the needle, so as to avoid the needle being left in for too long and causing harm to the patient.

5.針對於AI模組的改善,主要採用YOLO物件偵測模型(HPS-YOLOv7),專門適用於高精度小物體檢測的算法,可適合用來辨識針灸針此種細小的物件,以達到辨識準確的功效。5. For the improvement of AI modules, the YOLO object detection model (HPS-YOLOv7) is mainly used. It is an algorithm specially suitable for high-precision small object detection. It can be used to identify small objects such as acupuncture needles to achieve accurate identification.

6.提出了一種改進的高效層聚合網絡(CLAN)用於特徵提取,不僅保留了網路深度,還減少參數量,使得辨識的模型更加輕量級,有助於辨識速度的提昇。6. An improved efficient layer aggregation network (CLAN) is proposed for feature extraction, which not only retains the network depth but also reduces the number of parameters, making the recognition model more lightweight and helping to improve the recognition speed.

7.改進了遞歸門控卷積(C-g nConv),並被用來替換原來的Neck的CBS結構,使得模型更有彈性,並且避免偏差,避免了高階卷積帶來的不對稱性,不僅能保留較小的客觀訊息,也不會帶來額外的參數量,使得在辨別小物件上能更有幫助。 7. The recursive gated convolution (Cg n Conv) was improved and used to replace the original Neck's CBS structure, making the model more flexible and avoiding deviations. It avoids the asymmetry caused by high-order convolutions, not only retains smaller objective information, but also does not bring additional parameters, making it more helpful in identifying small objects.

8.提出了淺層特徵融合網絡(SFN),將深度卷積與淺層語義信息相結合,彌補了深度卷積網絡中小物體丟失的信息,20*20的檢測頭改為160*160,進而提高小物體的檢測精度,並且提昇訓練速度。8. A shallow feature fusion network (SFN) is proposed to combine deep convolution with shallow semantic information, making up for the lost information of small objects in the deep convolution network. The 20*20 detection head is changed to 160*160, thereby improving the detection accuracy of small objects and increasing the training speed.

9.增加訓練數據集所擁有的數據量,可更好的模擬在不同情境下都能做到良好的辨識率,需要不斷的收集針灸針的資料量,並且也會從簡單的單針到複數針,再到重疊針,把各種可能的情況都考慮進去,以利於訓練模型的深度學習。9. Increasing the amount of data in the training dataset can better simulate good recognition rates in different situations. It is necessary to continuously collect data on acupuncture needles, and also consider various possible situations from simple single needles to multiple needles and then to overlapping needles, so as to facilitate the deep learning of the training model.

10.利用斜率進行輔助辨識,幫助判斷被覆蓋的針灸針的頭與尾是否屬於單一支針,或是不同支針,並根據針灸針的長度,寬度以及擺放的方向等種種數據面,將這些參數放入所設定的斜率中,讓AI模組進行分辨,並使用點斜式計算針灸針像素點間的斜率,就能區分兩支重疊不同之針灸針,藉以能大幅增加整體辨識的精準度。10. Use the slope to assist in identification and help determine whether the head and tail of the covered acupuncture needle belong to a single needle or different needles. Based on various data surfaces such as the length, width, and placement direction of the acupuncture needle, these parameters are put into the set slope for the AI module to distinguish and use the point-slope method to calculate the slope between the pixels of the acupuncture needle. This can distinguish between two overlapping and different acupuncture needles, thereby greatly increasing the overall recognition accuracy.

11.影像處理利用自適應二值化方法,根據指定大小的區域平均值設定,減少光線與陰影因素影響,使得模型接收到的數據更為乾淨,有利於後續進行辨識時的精準度,接著再將各種針型混合並重疊方式,重複這個前處理的動作,循序的將每一種情境下的針都可以被乾淨的辨識出來,進而大幅增進辨識精度。11. Image processing uses an adaptive binarization method, which is set according to the average value of the area of a specified size to reduce the influence of light and shadow factors, making the data received by the model cleaner, which is conducive to the accuracy of subsequent recognition. Then, various needle types are mixed and overlapped, and this pre-processing action is repeated. The needles in each situation can be identified cleanly in sequence, thereby greatly improving the recognition accuracy.

請參閱第一圖、第二圖及第三圖所示,本發明實施例係包含有:一架體1、一容納空間2、一置針平台3、一驅動單元4、一攝影單元5、一運算單元6、一AI模組7及一電子操作單元8,其中:Please refer to the first, second and third figures, the embodiment of the present invention includes: a frame 1, a receiving space 2, a needle placement platform 3, a driving unit 4, a camera unit 5, a computing unit 6, an AI module 7 and an electronic operation unit 8, wherein:

架體1;其係設有一辨識空間11。該架體1朝向該辨識空間11凸設有一支架12。The frame 1 is provided with an identification space 11. The frame 1 is provided with a bracket 12 protruding toward the identification space 11.

容納空間2,設置於該架體1。該容納空間2係位於該辨識空間11的下方處。該容納空間2設有可活動開啟或關閉的一門板21,該容納空間2內可供置入有一盛接桶22,該盛接桶22係位於該辨識空間11的下方處。The storage space 2 is disposed in the frame 1. The storage space 2 is located below the identification space 11. The storage space 2 is provided with a door panel 21 that can be opened or closed movably. A receiving bucket 22 can be placed in the storage space 2. The receiving bucket 22 is located below the identification space 11.

置針平台3,設置於該架體1,以供置放複數針灸針A〔如第四圖所示〕。該置針平台3係設為一平面板體,並藉由一樞軸31而樞接於該架體1,係可相對旋動於該架體1,藉以分隔該辨識空間11及該容納空間2。The needle placement platform 3 is disposed on the frame 1 for placing a plurality of acupuncture needles A (as shown in the fourth figure). The needle placement platform 3 is configured as a flat plate and is pivoted to the frame 1 via a pivot 31, and can rotate relative to the frame 1 to separate the identification space 11 and the accommodation space 2.

驅動單元4,設置於該架體1。該驅動單元4係為一步進馬達,該驅動單元4可以進一步透過一變速傳動組41連動該置針平台3之該樞軸31,該變速傳動組41係為一齒輪傳動組或一皮帶傳動組。藉以於辨識該等針灸針A後,該驅動單元4係能透過該變速傳動組41連動該樞軸31,以驅動該置針平台3朝向該容納空間2旋動一傾斜角度,使該置針平台3上的該等複數針灸針A利用重力,可以落入該容納空間2中的該盛接桶22內被收集。The driving unit 4 is disposed on the frame 1. The driving unit 4 is a stepping motor, and the driving unit 4 can further drive the pivot 31 of the needle placement platform 3 through a speed change transmission set 41, and the speed change transmission set 41 is a gear transmission set or a belt transmission set. After the acupuncture needles A are identified, the driving unit 4 can drive the pivot 31 through the speed change transmission set 41 to drive the needle placement platform 3 to rotate toward the receiving space 2 at an inclined angle, so that the plurality of acupuncture needles A on the needle placement platform 3 can fall into the receiving bucket 22 in the receiving space 2 by gravity and be collected.

攝影單元5,該攝影單元5係固定於該支架12上,具有指向該置針平台3的一鏡頭51。該攝影單元5的該鏡頭51拍攝該等針灸針A,以獲得一針灸針影像〔如第五圖所示〕。The camera unit 5 is fixed on the support 12 and has a lens 51 pointing to the needle placement platform 3. The lens 51 of the camera unit 5 photographs the acupuncture needles A to obtain an acupuncture needle image (as shown in the fifth figure).

運算單元6,係分別訊號連接該攝影單元5及該驅動單元4。該運算單元6接收上述針灸針影像,經運算而獲得一二值影像〔如第六圖所示〕。該二值影像是指由像素值只有兩種取值的影像,通常是黑和白。其係將灰度影像經過二值化處理得到的。在二值影像中,每個像素只能是兩種值中的一種,通常用0表示一種狀態(例如黑色),用1表示另一種狀態(例如白色)。二值影像常用於圖像處理和計算機視覺的應用中,因為僅包含兩種像素值的影像更容易進行處理和分析。今本發明實施例之該針灸針A係為黑色,而背景色則為白色。這樣的表示方式有助於簡化圖像,強調特定的信息,以方便進行後續辨識時的分析和處理。又該二值影像中包含複數線型集合像素,該運算單元6將該二值影像界定為一直角坐標平面,以該二值影像的像素為座標單位,進一步對所述線型集合像素執行一斜率驗證,計算每一所述線型集合像素中的一像素斜率,當所述像素斜率均在一誤差範圍值之內,該運算單元6判定該針灸針A為單一支。The operation unit 6 is signal-connected to the camera unit 5 and the drive unit 4, respectively. The operation unit 6 receives the acupuncture needle image and obtains a binary image after calculation (as shown in Figure 6). The binary image refers to an image with only two pixel values, usually black and white. It is obtained by binarizing the grayscale image. In a binary image, each pixel can only be one of the two values, usually 0 represents one state (such as black) and 1 represents the other state (such as white). Binary images are often used in image processing and computer vision applications because images containing only two pixel values are easier to process and analyze. The acupuncture needle A in the present invention embodiment is black, and the background color is white. Such a representation helps to simplify the image and emphasize specific information to facilitate subsequent analysis and processing during identification. The binary image contains a plurality of linear set pixels. The operation unit 6 defines the binary image as a rectangular coordinate plane, and uses the pixels of the binary image as coordinate units. A slope verification is further performed on the linear set pixels to calculate a pixel slope in each linear set pixel. When the pixel slopes are within an error range, the operation unit 6 determines that the acupuncture needle A is a single one.

AI模組7,訊號連接該運算單元6,該AI模組7使用YOLO物件偵測模型,係屬於類神經網路演算法,並利用遞歸門控卷積網路進行二次高低階融合,以訓練數據集進行深度學習而建立;該AI模組從該二值影像中辨識所述針灸針A的數目,並據以輸出一辨識數值。當前述辨識數值符合一施針總數時,該驅動單元4將所述針灸針A彙集至該容納空間2中。The AI module 7 is signal-connected to the operation unit 6. The AI module 7 uses the YOLO object detection model, which is a neural network-like algorithm, and uses a recursive gated convolutional network to perform secondary high- and low-level fusion, and is established by deep learning with a training data set; the AI module identifies the number of acupuncture needles A from the binary image and outputs an identification value accordingly. When the aforementioned identification value meets the total number of needles, the driving unit 4 gathers the acupuncture needles A into the accommodation space 2.

電子操作單元8,訊號連接該運算單元6。該電子操作單元8係為一智慧型手機或一平板電腦。該電子操作單元8執行一針灸針管理程式(APP),該針灸針管理程式包含有一輸入介面81,該輸入介面81係為一觸控螢幕。該輸入介面81設有至少一人像施針圖82,該人像施針圖82具有複數施針區域83,每一所述施針區域設有一分區數值區84,以供輸入一施針數目,所有前述施針區域83的該施針數目由該電子操作單元8匯總為該施針總數,並於該輸入介面81的一加總顯示區85顯示出該施針總數。進一步該針灸針管理程式包含有一計時模組86,該電子操作單元8供輸入一針灸時間,該計時模組86執行一時間記錄,當該時間記錄符合該針灸時間,該電子操作單元8輸出一提示訊息,該提示訊息係可為一警示燈號或一警示聲音。The electronic operation unit 8 is signal-connected to the operation unit 6. The electronic operation unit 8 is a smart phone or a tablet computer. The electronic operation unit 8 executes an acupuncture needle management program (APP), and the acupuncture needle management program includes an input interface 81, and the input interface 81 is a touch screen. The input interface 81 is provided with at least one portrait acupuncture diagram 82, and the portrait acupuncture diagram 82 has a plurality of acupuncture areas 83, and each of the acupuncture areas is provided with a partitioned numerical area 84 for inputting a number of acupuncture needles. The numbers of acupuncture needles in all the aforementioned acupuncture areas 83 are summarized by the electronic operation unit 8 as the total number of acupuncture needles, and the total number of acupuncture needles is displayed in a total display area 85 of the input interface 81. Furthermore, the acupuncture needle management program includes a timing module 86. The electronic operating unit 8 is used to input an acupuncture time. The timing module 86 executes a time record. When the time record matches the acupuncture time, the electronic operating unit 8 outputs a prompt message. The prompt message can be a warning light or a warning sound.

使用時,如第一圖、第二圖及第三圖所示,一施針者(醫師)於一患者身上施針後,施針者並同時於該電子操作單元8執行該針灸針管理程式,並透過該輸入介面81顯示一正面身體人像及一背面身體人像之該人像施針圖82,根據於該患者身上相對應的部分施針後,並將該患者身上施針的部位及施針的數目,一一透過該人像施針圖82於相對應的該等施針區域83進行點選,以及輸入相對應的針數。並同時經由該電子操作單元8輸入該針灸時間,例如施針後需留針20至50分鐘的該針灸時間。然後該電子操作單元8啟動該計時模組86執行該時間記錄,同時針灸針管理程式係會將該人像施針圖82及該等施針區域83所輸入的該針數予以匯總,使其成為該施針總數,並顯示於該加總顯示區85,同時並將該施針總數傳輸至該運算單元6,以供該運算單元6根據該施針的總數進行辨識比對。當該時間記錄符合該針灸時間時,該電子操作單元8則會輸出一提示訊息,係可為一警示燈號或一警示聲音,以提醒施針者準備拔針,可避免留針時間過長,對於該患者造成傷害。When in use, as shown in the first, second and third figures, after an acupuncturist (doctor) performs acupuncture on a patient, the acupuncturist also executes the acupuncture needle management program on the electronic operation unit 8, and displays the acupuncture image 82 of a front body portrait and a back body portrait through the input interface 81. According to the acupuncture on the corresponding part of the patient, the acupuncture parts and the number of acupuncture on the patient are selected one by one through the acupuncture image 82 in the corresponding acupuncture areas 83, and the corresponding number of needles is input. At the same time, the acupuncture time is input through the electronic operation unit 8, for example, the acupuncture time of 20 to 50 minutes after acupuncture. Then the electronic operation unit 8 activates the timing module 86 to execute the time record. At the same time, the acupuncture needle management program will summarize the needle numbers inputted in the acupuncture portrait 82 and the acupuncture areas 83 to form the total number of acupunctures, and display it in the total display area 85. At the same time, the total number of acupunctures will be transmitted to the calculation unit 6 for the calculation unit 6 to identify and compare according to the total number of acupunctures. When the time record matches the acupuncture time, the electronic operation unit 8 will output a prompt message, which can be a warning light or a warning sound, to remind the acupuncturist to prepare to remove the needles, so as to avoid leaving the needles for too long and causing harm to the patient.

如第一圖及第四圖所示,當該施針者於該患者身上拔取該針灸針A後,係可將其一一置放於該置針平台3上。當該患者身上的該針灸針A全部都被拔除,且全部都置放於該置針平台上3後,則可控制開始執行辨識。首先該攝影單元5係會拍攝該置針平台3上的該等針灸針A,藉以獲得一針灸針影像〔如第五圖所示〕。該運算單元6係接收該針灸針影像,並經運算而獲得該二值影像〔如第六圖所示〕。該二值影像係利用二值法,使得模型(model)接收到的數據更為乾淨,並且更能凸顯針灸針A這個物件,有利於後續進行辨識時的精準度。同時需要預先將各種針型混合並重疊方式,重複這個前處理的動作,循序的將每一種情境下的針都可以被乾淨的辨識出來,進而大幅增進辨識精度。如第五圖所示,係為所拍攝針灸針影像的原始影像,如第六圖所示,則為自適應二值化後影像。由於採用自適應二值化方法,所需的灰度和閾值,根據指定大小的區域平均值設定,減少光線與陰影因素影響。As shown in the first and fourth figures, after the acupuncturist removes the acupuncture needles A from the patient, they can be placed one by one on the needle placement platform 3. When all the acupuncture needles A on the patient are removed and placed on the needle placement platform 3, the recognition can be controlled to start. First, the camera unit 5 will photograph the acupuncture needles A on the needle placement platform 3 to obtain an acupuncture needle image [as shown in the fifth figure]. The calculation unit 6 receives the acupuncture needle image and obtains the binary image through calculation [as shown in the sixth figure]. The binary image uses the binary method, so that the data received by the model is cleaner and the acupuncture needle A can be more prominent, which is beneficial to the accuracy of subsequent recognition. At the same time, it is necessary to mix and overlap various needle types in advance, repeat this pre-processing action, and sequentially identify the needles in each situation, thereby greatly improving the recognition accuracy. As shown in the fifth figure, it is the original image of the acupuncture needle image taken, and as shown in the sixth figure, it is the image after adaptive binarization. Due to the use of the adaptive binarization method, the required grayscale and threshold are set according to the average value of the area of the specified size, reducing the influence of light and shadow factors.

又該AI模組7係使用YOLO物件偵測模型,利用遞歸門控卷積網路進行二次高低階融合,以訓練數據集進行深度學習而建立。由於本發明實施例採用YOLO物件偵測模型第7版(HPS-YOLOv7),專門用於高精度小物體檢測的算法,非常適合用來辨別針灸針A這種細小的物件。並提出了一種改進的高效層聚合網絡(CLAN)用於特徵提取,改進的高效層聚合網絡內容在於它的網路結構上,如第七圖所示是一般的殘差網路,如第八圖所示是瓶頸結構(Bottleneck structure),兩者都採用了殘差結構,但差異在於通道數,因為原本的高效層聚合網絡確實是增加了網路層數,幫助提高模型的訓練精度與泛化能力,但是多個非線性層增加了網路深度,導致帶來巨大的運算量,可能導致網路效能下降。並以第七圖為例,一般的殘差結構直接使用兩個3*3的卷積核,瓶頸是117萬左右,而瓶頸結構只有用1*1的卷積核降維後才會出現瓶頸,然後經過3*3卷積核,最後用1*1卷積核升維,參數總數約7萬個,相差了16.7倍,可看出瓶頸結構不僅保留了網路深度,還減少參數量,使得模型更加輕量級。因此本發明實施例提出了上述改進高效層聚合網絡,以瓶頸結構取代殘差網路,有助於縮短辨識運算的時間。The AI module 7 uses the YOLO object detection model, uses a recursive gated convolutional network to perform secondary high- and low-level fusion, and is established by deep learning with a training data set. Since the embodiment of the present invention adopts the YOLO object detection model version 7 (HPS-YOLOv7), an algorithm specifically used for high-precision small object detection, it is very suitable for identifying small objects such as acupuncture needles A. An improved efficient layer aggregation network (CLAN) is proposed for feature extraction. The content of the improved efficient layer aggregation network lies in its network structure. As shown in Figure 7, it is a general residual network, and as shown in Figure 8, it is a bottleneck structure. Both use residual structures, but the difference lies in the number of channels. The original efficient layer aggregation network does increase the number of network layers, which helps improve the training accuracy and generalization ability of the model. However, multiple nonlinear layers increase the network depth, resulting in a huge amount of computation, which may lead to a decrease in network performance. Taking the seventh figure as an example, the general residual structure directly uses two 3*3 convolution kernels, and the bottleneck is about 1.17 million, while the bottleneck structure will only appear after the dimensionality is reduced by a 1*1 convolution kernel, and then after a 3*3 convolution kernel, and finally a 1*1 convolution kernel is used to increase the dimension, the total number of parameters is about 70,000, a difference of 16.7 times. It can be seen that the bottleneck structure not only retains the network depth, but also reduces the number of parameters, making the model more lightweight. Therefore, the embodiment of the present invention proposes the above-mentioned improved efficient layer aggregation network, and replaces the residual network with a bottleneck structure, which helps to shorten the time of recognition operation.

又本發明實施例改進了遞歸門控卷積(C-g nConv),被用來替換原來的Neck的CBS結構。係與原先的遞歸門控卷積(Recursively gated Convolution)在數學理論上差別在於,原先的公式是: The embodiment of the present invention improves the recursive gated convolution (Cg n Conv) and is used to replace the original Neck's CBS structure. The difference between the original recursive gated convolution and the original recursive gated convolution in mathematical theory is that the original formula is:

P k +1k(q k)⊙ ɡ k(pk)/α, k=0,1,…,n-1; P k +1k (q k )⊙ ɡ k (pk)/α, k =0, 1,…, n-1;

而在這基礎上進行二次高低階融合,變成下列公式:On this basis, a secondary high- and low-level fusion is performed, which becomes the following formula:

P k +1={[fk(qk)*gk(pk)]⊙[fn(qn)*pn]}/a, k=0,1,…,n-1; P k +1 ={[fk(qk)*gk(pk)]⊙[fn(qn)*pn]}/a, k =0, 1, ..., n-1;

多進行了一遍,為了多擴展性,將簡單的兩階段互動擴展到更多階段,使模型更有彈性,並且避免偏差,遞歸門控卷積(C-Recursively gated Convolution)避免了高階卷積帶來的不對稱性,不僅能保留較小的客觀訊息,也不會帶來額外的參數量,使得在辨別小物件上能更有幫助。We repeated this process several times. For the sake of scalability, we expanded the simple two-stage interaction to more stages to make the model more flexible and avoid bias. The recursive gated convolution (C-Recursively gated Convolution) avoids the asymmetry brought by high-order convolution. It not only retains smaller objective information, but also does not bring additional parameters, making it more helpful in identifying small objects.

又本發明實施例提出了淺層特徵融合網絡(SFN),將深度卷積與淺層語義信息相結合,彌補了深度卷積網絡中小物體丟失的信息,20*20的檢測頭改為160*160,進而提高小物體的檢測精度。因為原先的YOLO物件偵測模型第5版(YOLOv5)是使用個人區域網路(PAN)對高階特徵圖進行重新取樣並融合先前的特徵圖,進一步提高偵測精度,但是對於深層特徵和淺層特徵的融合仍然會導致部分語義資訊丟失的問題,而此使用的淺層特徵融合網絡是為了避免過度採樣,導致失去小物件本身就不明顯的特徵,因為針灸針A過於細長,以及容易密集的問題,過度深層的採樣訓練會導致容易丟失原先該有的特徵,所以使用該網路結構的原因是想要使其在淺層捲積層中去保留中小物件的訊息,提高小物體的精度,並且提升訓練速度。The embodiment of the present invention proposes a shallow feature fusion network (SFN), which combines deep convolution with shallow semantic information to make up for the lost information of small objects in the deep convolution network. The 20*20 detection head is changed to 160*160, thereby improving the detection accuracy of small objects. Because the original YOLO object detection model version 5 (YOLOv5) uses a personal area network (PAN) to resample high-level feature maps and fuse previous feature maps to further improve detection accuracy, but the fusion of deep and shallow features will still lead to the loss of some semantic information. The shallow feature fusion network used here is to avoid over-sampling, which leads to the loss of small objects that are not obvious in themselves. Because acupuncture needle A is too thin and long, and is prone to dense problems, excessive deep sampling training will easily lead to the loss of the original features. Therefore, the reason for using this network structure is to retain the information of small and medium objects in the shallow convolution layer, improve the accuracy of small objects, and increase the training speed.

由於建立模型需要增加訓練數據集所擁有的數據量,為了更好的模擬在不同情境下都能做到良好的辨識率,就會需要不斷的收集針灸針A的資料量,而資料的部分也會從簡單的單針到複數針,再到重疊針,把各種可能的情況都考慮進去,以利於訓練該模型的彈性。Since building a model requires increasing the amount of data in the training dataset, in order to better simulate and achieve good recognition rates in different scenarios, it is necessary to continuously collect data on acupuncture needle A. The data will also range from simple single needles to multiple needles, and then to overlapping needles, taking into account various possible situations to facilitate training the flexibility of the model.

又該二值影像中包含複數線型集合像素,該運算單元6將該二值影像界定為一直角坐標平面,以該二值影像的像素為座標單位,進一步對所述線型集合像素執行一斜率驗證,以計算每一所述線型集合像素中的一像素斜率,當所述像素斜率均在一誤差範圍值之內,該運算單元判定為該針灸針A為單一。The binary image contains a plurality of linear set pixels. The operation unit 6 defines the binary image as a rectangular coordinate plane, takes the pixels of the binary image as coordinate units, and further performs a slope verification on the linear set pixels to calculate a pixel slope in each linear set pixel. When the pixel slopes are all within an error range, the operation unit determines that the acupuncture needle A is single.

上述利用到斜率的部分,據以輔助判斷被覆蓋的針灸針A的頭與尾是否屬於單一支針,或是不同支針。由於針灸針A本身是細長圓柱體,只會有部分重疊的特性,因此每隻針灸針A的斜率都不同,根據做完影像處理後圖片的像素,使用點斜式計算針中像素點間的斜率,就能區分兩隻重疊不同之針。根據該針灸針A的長度,寬度以及擺放的方向等種種數據面,將這些參數加入所設定的斜率中,讓該AI模組7進行分辨,如此就能更有效的避免針頭與針尾就算是同一支針,而被模型視為不同支針的狀態,故能大幅增加整體辨識的精準度。The above-mentioned part using the slope is used to assist in determining whether the head and tail of the covered acupuncture needle A belong to a single needle or different needles. Since the acupuncture needle A itself is a thin long cylinder, it will only have a partially overlapping characteristic, so the slope of each acupuncture needle A is different. According to the pixels of the image after image processing, the slope between the pixels in the needle is calculated using the point slope method, and two overlapping different needles can be distinguished. According to various data surfaces such as the length, width and placement direction of the acupuncture needle A, these parameters are added to the set slope, allowing the AI module 7 to distinguish, so that it can more effectively avoid the state where the needle head and needle tail are considered to be the same needle but are regarded as different needles by the model, thereby greatly increasing the accuracy of overall recognition.

該AI模組7從該二值影像中辨識所述針灸針A的數目,並據以輸出該辨識數值至該運算單元6。然後該運算單元6並將該辨識數值,與該施針者輸入於該患者身上不同部位的施針數目,經由該針灸針管理程式予以匯總後的該施針總數進行比對。如第九圖所示,當前述辨識數值符合該施針總數時,該運算單元6將會控制該驅動單元4啟動,並透過該變速傳動組41連動該樞軸31驅動該置針平台3朝向該容納空間2旋動該傾斜角度,使得該置針平台3上的該等針灸針A利用重力,可以落入於該容納空間2中的該盛接桶22內被收集。同時,該運算單元6並會將上述辨識結果傳輸到該電子操作單元8,以告知該施針者瞭解拔針數目是否與施針總數相符。若是發現數目不符,也可立即進行後續拔針或進行尋針的處置,藉以可減少遺漏針灸針A未拔的情形發生。如此,藉由本發明的AI辨識回收裝置,則可快速的盤點該針灸針A數量及清除收集該等針灸針A,以提高回收該針灸針A的準確率及速度。The AI module 7 identifies the number of acupuncture needles A from the binary image and outputs the identification value to the calculation unit 6 accordingly. Then the calculation unit 6 compares the identification value with the number of needles inserted in different parts of the patient input by the acupuncturist and the total number of needles inserted after being summarized by the acupuncture needle management program. As shown in Figure 9, when the aforementioned identification value matches the total number of needles inserted, the calculation unit 6 will control the drive unit 4 to start, and drive the needle placement platform 3 to rotate the tilt angle toward the receiving space 2 through the speed change transmission group 41 to make the acupuncture needles A on the needle placement platform 3 fall into the receiving bucket 22 in the receiving space 2 by gravity and be collected. At the same time, the calculation unit 6 will transmit the above identification results to the electronic operation unit 8 to inform the acupuncturist whether the number of needles removed is consistent with the total number of needles. If the number is found to be inconsistent, the subsequent needle removal or needle search can be carried out immediately to reduce the occurrence of missing acupuncture needles A. In this way, through the AI identification and recovery device of the present invention, the number of acupuncture needles A can be quickly counted and the acupuncture needles A can be cleared and collected to improve the accuracy and speed of recovering the acupuncture needles A.

又本發明經由實際測試,進行測試一至測試六〔辨識影像截圖分別如第十圖至第十五圖所示〕,其測試結果如下列表一所示。The present invention has been subjected to actual testing, and tests 1 to 6 have been conducted (the recognition image screenshots are shown in FIG. 10 to FIG. 15 respectively), and the test results are shown in Table 1 below.

表一: 測試一 測試二 測試三 測試四 測試五 測試六 施針總數 44 44 44 44 44 44 辨識數值 44 44 43 43 42 41 辨識率 100% 100% 97.7% 97.7% 95.4% 93.1% Table 1: Test 1 Test 2 Test 3 Test 4 Test 5 Test 6 Total number of needles 44 44 44 44 44 44 Identify value 44 44 43 43 42 41 Recognition rate 100% 100% 97.7% 97.7% 95.4% 93.1%

經由上述實際的測試一至測試六之結果得知,本發明之辨識率最少可達到93.1%,平均的辨識率更是高達97.3%,因此係足以證明本發明確實可以達到辨識準確及快速之功效。From the results of the above-mentioned actual tests 1 to 6, it is known that the recognition rate of the present invention can reach at least 93.1%, and the average recognition rate is as high as 97.3%, which is sufficient to prove that the present invention can indeed achieve the effect of accurate and rapid recognition.

綜合上述實施例之說明,當可充分瞭解本發明之操作、使用及本發明產生之功效,惟以上所述實施例僅係為本發明之較佳實施例,當不能以此限定本發明實施之範圍,即依本發明申請專利範圍及發明說明內容所作簡單的等效變化與修飾,皆屬本發明涵蓋之範圍內。Combined with the description of the above embodiments, the operation, use and effects of the present invention can be fully understood. However, the above embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of the implementation of the present invention. In other words, simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the invention description are all within the scope of the present invention.

1:架體 11:辨識空間 12:支架 2:容納空間 21:門板 22:盛接桶 3:置針平台 31:樞軸 4:驅動單元 41:變速傳動組 5:攝影單元 51:鏡頭 6:運算單元 7:AI模組 8:電子操作單元 81:輸入介面 82:人像施針圖 83:施針區域 84:分區數值區 85:加總顯示區 86:計時模組 A:針灸針 1: Frame 11: Identification space 12: Bracket 2: Accommodation space 21: Door panel 22: Receiver 3: Needle placement platform 31: Pivot 4: Drive unit 41: Variable speed transmission group 5: Camera unit 51: Lens 6: Calculation unit 7: AI module 8: Electronic operation unit 81: Input interface 82: Portrait acupuncture diagram 83: Acupuncture area 84: Partition value area 85: Total display area 86: Timing module A: Acupuncture needles

[第一圖]係為本發明實施例之立體外觀圖。[Figure 1] is a three-dimensional appearance diagram of an embodiment of the present invention.

[第二圖]係為本發明實施例之組合剖視圖。[Figure 2] is a combined cross-sectional view of an embodiment of the present invention.

[第三圖]係為本發明實施例電子操作單元及其輸入界面之示意圖。[Figure 3] is a schematic diagram of the electronic operation unit and its input interface according to an embodiment of the present invention.

[第四圖]係為本發明實施例針灸針置放於置針平台上之示意圖。[Figure 4] is a schematic diagram of an acupuncture needle placed on a needle placement platform according to an embodiment of the present invention.

[第五圖]係為本發明實施例攝影單元拍攝針灸針所獲得的針灸針影像之示意圖。[FIG. 5] is a schematic diagram of an acupuncture needle image obtained by photographing an acupuncture needle by the camera unit of the embodiment of the present invention.

[第六圖]係為本發明實施例針灸針影像經由自適應二值化後之影像示意圖。[Figure 6] is a schematic diagram of the image of the acupuncture needle after adaptive binarization according to the embodiment of the present invention.

[第七圖]係為本發明實施例高效層聚合網絡之一般殘差網路的示意圖。[FIG. 7] is a schematic diagram of a general residual network of an efficient layer aggregation network according to an embodiment of the present invention.

[第八圖]係為本發明實施例高效層聚合網絡之瓶頸結構的示意圖。[Figure 8] is a schematic diagram of the bottleneck structure of the high-efficiency layered polymerization network according to an embodiment of the present invention.

[第九圖]係為本發明實施例開啟置針平台使針灸針落入於盛接桶收集之示意圖。[Figure 9] is a schematic diagram of opening the needle placement platform to allow acupuncture needles to fall into the receiving bucket for collection according to an embodiment of the present invention.

[第十圖]係為本發明實經由實際測試的測試一之辨識截圖。[Figure 10] is a screenshot of the identification of Test 1 of the actual test of the present invention.

[第十一圖]係為本發明經由實際測試的測試二之辨識截圖。[Figure 11] is a screenshot of the identification of the second test of the present invention after actual testing.

[第十二圖]係為本發明經由實際測試的測試三之辨識截圖。[Figure 12] is a screenshot of the identification of the present invention in Test 3 after actual testing.

[第十三圖]係為本發明經由實際測試的測試四之辨識截圖。[Figure 13] is a screenshot of the identification of Test 4 of the actual test of the present invention.

[第十四圖]係為本發明經由實際測試的測試五之辨識截圖。[Figure 14] is a screenshot of the identification of Test 5 of the actual test of the present invention.

[第十五圖]係為本發明經由實際測試的測試六之辨識示意圖。[Figure 15] is a schematic diagram showing the identification of Test 6 of the present invention after actual testing.

1:架體 1:Frame

11:辨識空間 11: Identify space

12:支架 12: Bracket

2:容納空間 2: Accommodation space

21:門板 21: Door panel

22:盛接桶 22: Receive bucket

3:置針平台 3: Needle placement platform

31:樞軸 31: Pivot

4:驅動單元 4: Drive unit

41:變速傳動組 41: Speed transmission group

5:攝影單元 5: Photography unit

51:鏡頭 51: Lens

6:運算單元 6: Arithmetic unit

7:AI模組 7: AI module

8:電子操作單元 8: Electronic operation unit

81:輸入介面 81: Input interface

82:人像施針圖 82: Acupuncture portrait

Claims (10)

一種針灸針的AI辨識回收裝置,包含有: 一架體; 一置針平台,設置於該架體,供置放複數針灸針; 一驅動單元,設置於該架體; 一攝影單元,具有指向該置針平台的一鏡頭,該攝影單元拍攝該等針灸針,獲得一針灸針影像; 一運算單元,連接該攝影單元,接收該針灸針影像,經運算而獲得一二值影像: 一AI模組,訊號連接該運算單元,該AI模組使用YOLO物件偵測模型,利用遞歸門控卷積網路進行二次高低階融合,以訓練數據集進行深度學習而建立;該AI模組從該二值影像中辨識該等針灸針的數目,並據以輸出一辨識數值; 一容納空間,設置於該架體; 當該辨識數值符合一施針總數時,該驅動單元將該等針灸針彙集至該容納空間中。 An AI identification and recovery device for acupuncture needles comprises: A frame; A needle placement platform, arranged on the frame, for placing a plurality of acupuncture needles; A driving unit, arranged on the frame; A camera unit, having a lens pointing to the needle placement platform, the camera unit photographs the acupuncture needles to obtain an acupuncture needle image; An operation unit, connected to the camera unit, receives the acupuncture needle image, and obtains a binary image through operation: An AI module, signal-connected to the computing unit, the AI module uses the YOLO object detection model, utilizes the recursive gated convolutional network to perform secondary high-low order fusion, and is established by deep learning with a training data set; the AI module identifies the number of the acupuncture needles from the binary image, and outputs an identification value accordingly; A storage space, set in the frame; When the identification value matches the total number of needles, the driving unit gathers the acupuncture needles into the storage space. 如請求項1之針灸針的AI辨識回收裝置,進一步包含一電子操作單元,該電子操作單元係訊號連接該運算單元,該電子操作單元執行一針灸針管理程式,該針灸針管理程式包含有一輸入介面,該輸入介面設有至少一人像施針圖,該人像施針圖具有複數施針區域,每一該施針區域設有一分區數值區,供輸入一施針數目,所有該等施針區域的該施針數目由該電子操作單元匯總為該施針總數,並顯示於該輸入介面的一加總顯示區。The AI identification and recovery device for acupuncture needles as claimed in claim 1 further comprises an electronic operating unit, which is signal-connected to the computing unit, and which executes an acupuncture needle management program. The acupuncture needle management program comprises an input interface, and the input interface is provided with at least one portrait acupuncture needle diagram, and the portrait acupuncture needle diagram has a plurality of acupuncture needle areas, and each of the acupuncture needle areas is provided with a partitioned numerical area for inputting a number of acupuncture needles, and the numbers of acupuncture needles of all the acupuncture needle areas are aggregated by the electronic operating unit into the total number of acupuncture needles, and displayed in a total display area of the input interface. 如請求項1之針灸針的AI辨識回收裝置,進一步包含一電子操作單元,該電子操作單元係訊號連接該運算單元,該電子操作單元執行一針灸針管理程式,該針灸針管理程式包含有一計時模組,該電子操作單元供輸入一針灸時間,該計時模組執行一時間記錄,當該時間記錄符合該針灸時間,該電子操作單元輸出一提示訊息。The AI identification and recovery device for acupuncture needles as claimed in claim 1 further comprises an electronic operating unit, which is signal-connected to the computing unit. The electronic operating unit executes an acupuncture needle management program. The acupuncture needle management program includes a timing module. The electronic operating unit is used to input an acupuncture time. The timing module executes a time record. When the time record matches the acupuncture time, the electronic operating unit outputs a prompt message. 如請求項1之針灸針的AI辨識回收裝置,其中,該二值影像中包含複數線型集合像素,該運算單元將該二值影像界定為一直角坐標平面,以該二值影像的像素為座標單位,進一步對該等線型集合像素執行一斜率驗證,計算每一該線型集合像素中的一像素斜率,當該像素斜率均在一誤差範圍值之內,該運算單元判定該針灸針為單一支。As in claim 1, the AI identification and recovery device for acupuncture needles, wherein the binary image contains a plurality of linear set pixels, the operation unit defines the binary image as a rectangular coordinate plane, takes the pixels of the binary image as coordinate units, further performs a slope verification on the linear set pixels, calculates a pixel slope in each of the linear set pixels, and when the pixel slopes are within an error range, the operation unit determines that the acupuncture needle is a single one. 如請求項1之針灸針的AI辨識回收裝置,其中,該置針平台係可相對旋動於該架體,該驅動單元驅動該置針平台旋動,使該置針平台上的該等針灸針利用重力落入該容納空間中。As in claim 1, the AI identification and recovery device for acupuncture needles, wherein the needle placement platform is rotatable relative to the frame, and the driving unit drives the needle placement platform to rotate, so that the acupuncture needles on the needle placement platform fall into the accommodating space by gravity. 如請求項1之針灸針的AI辨識回收裝置,其中,該架體設有一辨識空間,該容納空間係位於該辨識空間的下方處,該架體朝向該辨識空間凸設有一支架,該攝影單元係固定於該支架。As in claim 1, the AI identification and recovery device for acupuncture needles, wherein the frame is provided with an identification space, the accommodating space is located below the identification space, the frame is provided with a bracket protruding toward the identification space, and the photographic unit is fixed to the bracket. 如請求項6之針灸針的AI辨識回收裝置,其中,該置針平台係設為一平面板體,以供樞接於該架體,藉以分隔該辨識空間及該容納空間。As in claim 6, the AI identification and recovery device for acupuncture needles, wherein the needle placement platform is configured as a flat plate to be pivotally connected to the frame to separate the identification space and the accommodating space. 如請求項6之針灸針的AI辨識回收裝置,其中,該容納空間設有可活動開啟或關閉的一門板,該容納空間內可供置入有一盛接桶,該盛接桶係位於該辨識空間的下方處。As in claim 6, the AI identification and recovery device for acupuncture needles, wherein the storage space is provided with a door panel that can be movably opened or closed, and a receiving bucket can be placed in the storage space, and the receiving bucket is located below the identification space. 如請求項1之針灸針的AI辨識回收裝置,其中,該置針平台藉由一樞軸而樞接於該架體,該驅動單元係透過一變速傳動組連動該樞軸,以驅動該置針平台朝向該容納空間旋動一傾斜角度。As in claim 1, the AI identification and recovery device for acupuncture needles, wherein the needle placement platform is pivotally connected to the frame via a pivot, and the driving unit is connected to the pivot via a variable speed transmission assembly to drive the needle placement platform to rotate at an inclination angle toward the accommodating space. 如請求項9之針灸針的AI辨識回收裝置,其中,該驅動單元係為一步進馬達,該變速傳動組係為一齒輪傳動組或一皮帶傳動組。As in claim 9, the AI identification and recovery device for acupuncture needles, wherein the driving unit is a stepper motor, and the speed transmission set is a gear transmission set or a belt transmission set.
TW113109975A 2024-03-18 2024-03-18 Ai recognition and recovery device for acupuncture needles TWI884731B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW113109975A TWI884731B (en) 2024-03-18 2024-03-18 Ai recognition and recovery device for acupuncture needles

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW113109975A TWI884731B (en) 2024-03-18 2024-03-18 Ai recognition and recovery device for acupuncture needles

Publications (2)

Publication Number Publication Date
TWI884731B true TWI884731B (en) 2025-05-21
TW202537613A TW202537613A (en) 2025-10-01

Family

ID=96582186

Family Applications (1)

Application Number Title Priority Date Filing Date
TW113109975A TWI884731B (en) 2024-03-18 2024-03-18 Ai recognition and recovery device for acupuncture needles

Country Status (1)

Country Link
TW (1) TWI884731B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201905851A (en) * 2017-06-20 2019-02-01 國立成功大學 Method for visualizing acupuncture points by AR technology capable of assisting different users in finding positions of acupuncture points easily and quickly
US20210060330A1 (en) * 2018-01-30 2021-03-04 Apex Neuro Holdings, Inc. Devices and methods for delivering mechanical stimulation to nerve, mechanoreceptor, and cell targets

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201905851A (en) * 2017-06-20 2019-02-01 國立成功大學 Method for visualizing acupuncture points by AR technology capable of assisting different users in finding positions of acupuncture points easily and quickly
US20210060330A1 (en) * 2018-01-30 2021-03-04 Apex Neuro Holdings, Inc. Devices and methods for delivering mechanical stimulation to nerve, mechanoreceptor, and cell targets
US11504521B2 (en) * 2018-01-30 2022-11-22 Apex Neuro Holdings, Inc. Devices and methods for delivering mechanical stimulation to nerve, mechanoreceptor, and cell targets

Similar Documents

Publication Publication Date Title
EP3989119A1 (en) Detection model training method and apparatus, computer device, and storage medium
WO2021017998A1 (en) Method and system for positioning text position, and method and system for training model
CN113222064A (en) Image target object real-time detection method, system, terminal and storage medium
CN111178197A (en) Mass R-CNN and Soft-NMS fusion based group-fed adherent pig example segmentation method
CN111402217B (en) Image grading method, device, equipment and storage medium
CN114581432B (en) Tongue image segmentation method of tongue image instrument based on deep learning
WO2011028023A2 (en) Apparatus and method for detecting eye state
CN111860078B (en) Method, device, readable storage medium and equipment for silent face liveness detection
CN113485555B (en) Medical image reading method, electronic device and storage medium
CN113936280A (en) Embedded instrument code disc character automatic identification system and method
CN114816055A (en) Eyeball motion track capturing and analyzing method, device and medium based on VR equipment
CN111160261A (en) Sample image labeling method and device for automatic sales counter and storage medium
WO2022095359A1 (en) Anti-screen-capturing-based information security protection method and apparatus, electronic device and medium
CN110619332A (en) Data processing method, device and equipment based on visual field inspection report
TWI884731B (en) Ai recognition and recovery device for acupuncture needles
CN116758539A (en) Embryo image blastomere identification method based on data enhancement
CN113435229B (en) Multi-modal human face iris recognition method and device, readable storage medium and equipment
CN113268623A (en) Artificial intelligence gastroscope image recognition processing system
CN112906610A (en) Method for living body detection, electronic circuit, electronic apparatus, and medium
TW202537613A (en) Ai recognition and recovery device for acupuncture needles
CN114972462B (en) Method for optimizing working distance alignment effect of eye bottom camera and related products thereof
CN114445658B (en) Pet X-ray posture classification method, device and equipment based on deep learning
CN118134887A (en) Real-time enteroscopy polyp detection method, system and model training method
CN117094972B (en) A lightweight PCB defect detection method and system based on high-order spatial interaction
CN116188397A (en) A fundus image screening method, device, equipment and medium