WO2025112057A1 - Sample recognition system and method, controller, and storage medium - Google Patents
Sample recognition system and method, controller, and storage medium Download PDFInfo
- Publication number
- WO2025112057A1 WO2025112057A1 PCT/CN2023/135957 CN2023135957W WO2025112057A1 WO 2025112057 A1 WO2025112057 A1 WO 2025112057A1 CN 2023135957 W CN2023135957 W CN 2023135957W WO 2025112057 A1 WO2025112057 A1 WO 2025112057A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- barcode
- sample container
- image
- sample
- outside
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
Definitions
- the present application relates to the field of medical detection technology, and in particular to a sample identification system and a sample identification method, a controller and a storage medium.
- the automated biochemical immunoassay assembly line can connect different biochemical instruments with pre-analysis and post-analysis laboratory analysis systems through automated transmission tracks, and realize the combination of assembly line operations under the dominant control of the information system; since the barcode pasted on the surface of the sample container records the information or test items of the blood sample in the sample container, the barcode recognition of the sample container is one of the important links in the biochemical immunoassay assembly line of the hospital laboratory and the most critical step in information flow. However, the barcode on the sample container is manually pasted. If the barcode is not fully displayed during the barcode scanning process, the barcode recognition result cannot be obtained. Therefore, before scanning the sample container, it is necessary to manually adjust the angle and position of the sample container to successfully recognize the barcode, resulting in reduced barcode recognition efficiency.
- embodiments of the present application provide a sample identification system and a sample identification method, a controller and a storage medium.
- An embodiment of the present application provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
- the rotating device is used to drive the sample container to rotate around the vertical direction
- the image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
- the controller is used to determine the sample information of the sample container according to a first recognition result of the barcode, when the barcode can be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device; and is used to recognize the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, when the barcode cannot be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container according to a second recognition result of the serial code.
- the embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
- the rotating device is used to drive the sample container to rotate around the vertical direction
- the image acquisition device is used to acquire an image of the sample container when the rotating device drives the sample container to rotate;
- the controller is used to control the rotation device to operate, and when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, control the rotation device to stop operating;
- the controller is further used to determine the sample information of the sample container according to a first recognition result of the barcode, when the barcode can be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device; and to recognize the serial code based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container according to a second recognition result of the serial code, when the barcode cannot be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device.
- the embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
- the rotating device is used to drive the sample container to rotate around the vertical direction
- the image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
- the controller is used to identify the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device, identify the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container based on a first recognition result of the barcode and a second recognition result of the serial code.
- the embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
- the rotating device is used to drive the sample container to rotate around the vertical direction
- the image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
- the controller is used to control the operation of the rotating device, and control the rotating device to stop operating when the image acquisition device acquires an image containing the barcode and the serial code on the outside of the sample container; and is also used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container; and is used to control the operation of the rotating device to recognize the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device when the barcode cannot be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container, and to determine the sample information of the sample container according to the first recognition result of the barcode when the barcode can be successfully recognized based on the at least one image containing the barcode on the outside of the sample container; and to recognize the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device when the
- the present application also provides a sample identification method, which is applied to a controller in a sample identification system; the sample identification system further includes a rotating device and an image acquisition device coupled to the controller; the method includes:
- the barcode on the outside of the sample container can be successfully identified according to at least one image including the barcode, determining the sample information of the sample container according to a first identification result of the barcode;
- the serial code is identified based on at least one image containing the serial code on the outside of the sample container, and the sample information of the sample container is determined based on the second identification result of the serial code;
- At least one image including the barcode and/or the serial code on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
- the present application also provides a controller, comprising: a processor and a memory for storing a computer program that can be run on the processor.
- the processor is configured to execute the steps of any of the above-mentioned controller-side methods when running the computer program.
- An embodiment of the present application further provides a storage medium on which a computer program is stored.
- the computer program is executed by a processor, the steps of any of the above-mentioned controller-side methods are implemented.
- the image acquisition device rotates and photographs the sample container to obtain at least one image containing the barcode and/or serial code on the outside of the same sample container. If the barcode can be successfully identified based on the image containing at least the barcode on the outside of the same sample container, the controller can determine the sample information of the sample container based on the first recognition result of the barcode; and if the barcode cannot be successfully identified based on the image containing at least the barcode on the outside of the same sample container, the controller can determine the sample information of the sample container based on the first recognition result of the barcode.
- the controller identifies a second recognition result of the sequence code based on an image at least including the sequence code on the outside of the same sample container, and determines the sample information of the sample container according to the second recognition result of the sequence code; or the controller identifies the barcode based on an image at least including the barcode on the outside of the sample container, identifies the sequence code according to at least the sequence code on the outside of the sample container, and determines the sample information of the sample container based on the first recognition result of the barcode of the same sample container and the second recognition result of the sequence code.
- the above solution can improve the barcode recognition efficiency, and even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the sequence code, which can improve the success rate of identifying the sample information.
- FIG1 is a schematic diagram of a sample identification system architecture according to an embodiment of the present application.
- FIG2 is an example diagram of a sequence code based on image feature recognition according to an embodiment of the present application.
- FIG3 is an example diagram of recognizing a sequence code through a first setting neural network according to an embodiment of the present application
- FIG4 is an example of an image obtained by rotating and photographing a sample container according to an embodiment of the present application.
- FIG5 is an example of an image obtained by rotating and photographing a sample container according to an embodiment of the present application.
- FIG6 is an example diagram of an image captured when the sample container is stationary according to an embodiment of the present application.
- FIG7 is an exemplary diagram of rotating and photographing a sample container according to an embodiment of the present application.
- FIG8 is a schematic diagram of a sample identification method implementation flow in an embodiment of the present application.
- FIG. 9 is a schematic diagram of the controller structure of an embodiment of the present application.
- the sample identification system includes: a controller 101, a rotating device 102, and an image acquisition device 103 coupled to the controller 101.
- the image acquisition device 103 may be a camera, such as an industrial camera.
- the image acquisition device 103 may be directly coupled, for example, the image acquisition device 103 is connected to the controller 101 through a universal serial bus (USB), a high definition multimedia interface (HDMI), etc., or the controller 101 and the image acquisition device 103 may be indirectly coupled, for example, the controller 101 is connected to the image acquisition device 103 through an intermediate device or other device.
- USB universal serial bus
- HDMI high definition multimedia interface
- An image acquisition device 103 configured to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
- the rotating device 102 can drive the sample container to rotate in a vertical direction, for example, to rotate 360 degrees in a vertical direction.
- the image acquisition device 103 can take a picture of the sample container during the process of the sample container rotating in the vertical direction to obtain an image containing the barcode and/or serial code on the outside of the sample container, that is, to perform rotational scanning or rotational photography on the same sample container; different images taken by the image acquisition device 103 for the same sample container have images with different shooting perspectives or different shooting angles.
- the image acquisition device 103 can directly transmit all images of the sample container to the controller 101, or transmit all images of the sample container to other devices for storage, and the controller 101 can obtain the image of the sample container from other devices.
- the image acquisition device 103 saves the captured image of the sample container to a set storage path of the image acquisition device 103 or other electronic device, and the controller 101 obtains and saves the image of the sample container from the set storage path.
- a corresponding folder can be created for each sample container, and the images of the sample containers can be stored in the corresponding folders respectively, so as to realize the distinction between the images of different sample containers.
- the image acquisition device 103 stores all the images of a sample container captured into the set storage path each time. After the controller 101 acquires all the images of the sample container from the set storage path, the controller 101 can clear all the images under the set storage path. Thereafter, the image acquisition device 103 stores all the images of another sample container captured into the set storage path, so as to realize the image reading of the sample container one by one.
- the sample container can be understood as a transparent or translucent container for loading samples, which can be a blood collection tube, a test tube, a sample tube, a sampling tube, a test tube, a bottle, a sample cup, etc.
- the sample loaded in the sample container includes a blood sample, and the blood sample can be a serum sample or a plasma sample, and a reagent for detection can be added to the blood sample.
- a label is pasted or attached to the surface of the sample container, which is used to mark or record relevant information of the sample in the sample container.
- the label may include identification information of the sample in the sample container, such as a barcode, or a serial code composed of letters and/or numbers.
- the serial code can also be understood as a serial number, and the barcode can also be called a barcode, which is composed of a group of black and white bars of different thicknesses.
- different rotation speeds of the rotating device 102 correspond to different exposure durations, and/or different rotation speeds of the rotating device 102 correspond to different shooting frequencies.
- the rotation speed of the rotating device 102 can be determined based on the recognition speed of the label on the sample container; of course, the rotation speed of the rotating device 102 can be determined based on the recognition speed of the label on the sample container;
- the rotation speed of 102 may also be a set rotation speed.
- the exposure duration may also be understood as the exposure time. In order to ensure that the image acquisition device 103 can capture a clear image, the exposure duration of the image acquisition device 103 is less than or equal to the quotient of the precision of the image acquisition device 103 and the rotation speed of the rotating device 102.
- the precision of the image acquisition device 103 may also be referred to as pixel precision, which is equal to the quotient of the one-way field of view of the camera and the one-way resolution.
- the shooting frequency may be replaced by the frame rate; the frame rate may be understood as the number of frames of the image captured per second, for example, the frame rate is 20 frames per second.
- the image acquisition device 103 may or may not have a barcode recognition function.
- the image acquisition device 103 may recognize a barcode, and the image acquisition device 103 is also used to recognize the barcode based on at least one barcode containing the outside of the same sample container, and when the barcode is successfully recognized, send the barcode recognition result, or the first recognition result of the barcode to the controller 101; when receiving the barcode recognition result sent by the image acquisition device 103, the controller 101 determines the first recognition result of the barcode on the outside of the sample container from the received barcode recognition result.
- the controller 101 determines the only received barcode recognition result as the first recognition result of the barcode of the sample container.
- at least one image including a barcode on the outside of the sample container includes multiple images; when the image acquisition device 103 acquires at least two different barcode recognition results based on the multiple images of the same sample container: the controller 101 is further used to determine a first recognition result of the barcode of the sample container from the at least two different barcode recognition results of the same sample container sent by the image acquisition device 103 based on the number of occurrences of the barcode recognition results corresponding to the same sample container; or, the image acquisition device 103 is further used to determine a first recognition result from the at least two different barcode recognition results of the same sample container based on the number of occurrences of the corresponding barcode recognition results, and send the first recognition result to the controller 101.
- the controller 101 or the image acquisition device 103 determines the at least two identical barcode recognition results corresponding to the same sample container as the first recognition result.
- the first recognition result of the barcode of the sample container For another example, the controller 101 or the image acquisition device 103 determines the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container.
- the controller 101 is used to recognize the barcode based on the image features of all or part of the at least one image containing the barcode on the outside of the sample container; or, the controller 101 is used to process all or part of the at least one image containing the barcode on the outside of the sample container through a second set neural network to recognize the barcode; wherein the second set neural network is used to recognize the barcode in the input image.
- the controller 101 can extract at least one type of image features from all or part of the images of at least one image of the same sample container containing the barcode outside the sample container through a set barcode recognition algorithm or a second set neural network; identify the barcode area according to the extracted image features and identify the barcode in the barcode area to obtain at least one barcode recognition result; and determine the first recognition result of the barcode in the determined barcode recognition results.
- the same barcode recognition results corresponding to at least two consecutive images of the same sample container are determined as the first recognition result of the barcode of the sample container; for another example, the barcode recognition result with the most occurrences corresponding to the same sample container is determined as the first recognition result of the barcode of the sample container.
- the second set neural network is trained based on the image samples of the sample container, and at least part of the image samples contain the barcode outside the sample container.
- the at least one type of image features includes at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features, and spatial relationship features.
- Edge features are used to characterize the presence of step changes (slope-type edges) or roof-like changes (roof-type edges) in the grayscale, brightness or color of pixels in an image; grayscale distribution features characterize the distribution of grayscale values in an image.
- Color features and texture features are global features that describe the surface properties of the barcode area outside the sample container.
- Shape features include contour features, which mainly describe the contour or boundary of the label and/or sample container.
- Spatial relationship features refer to the spatial position or relative direction relationship between multiple targets segmented from an image. These relationships can be divided into connection relationships or adjacency relationships, overlapping relationships or overlapping relationships, inclusion relationships or independent relationships, etc.
- the controller 101 only obtains one barcode recognition result based on at least one image containing the barcode on the outside of the same sample container, then only this barcode recognition result will be determined as the first recognition result of the barcode of the sample container; if at least one image containing the barcode on the outside of the same sample container includes multiple images, and the controller 101 obtains at least two barcode recognition results based on the multiple images of the same sample container, then the same barcode recognition results corresponding to at least two consecutive images of the same sample container will be determined as the first recognition result of the barcode of the sample container, or the barcode recognition result with the largest number of occurrences corresponding to the same sample container will be determined as the first recognition result of the barcode of the sample container.
- the controller 101 can determine a first recognition result of the barcode on the outside of the sample container, and determine the sample information of the sample container based on the first recognition result of the barcode.
- the first recognition result can be parsed or decoded according to the encoding rules or coding rules of the barcode to obtain the sample information of the sample container, and the sample detection items bound to the sample information (such as identification information) can also be obtained.
- the controller 101 identifies the serial code based on at least one image containing the serial code on the outside of the same sample container, and determines the sample information of the sample container according to the second recognition result of the serial code; for example, according to the encoding of the serial code
- the rule parses or decodes the first recognition result of the sequence code to obtain the sample information of the sample container, and can also obtain the sample detection item bound to the sample information (such as identification information).
- the sequence code does not involve the coding rule, the second recognition result of the sequence code can be used as the sample information of the sample container.
- the controller 101 obtains only one sequence code recognition result based on at least one sequence code containing the outside of the same sample container, then the only sequence code recognition result is determined as the second recognition result of the sequence code of the sample container; if at least one image containing the sequence code of the outside of the same sample container includes multiple images, and the controller 101 obtains at least two sequence code recognition results based on multiple images of the same sample container, then the controller 101 can determine the same sequence code recognition result corresponding to at least two consecutive images of the same sample container as the second recognition result of the sequence code of the sample container, or, the sequence code recognition result corresponding to the same sample container with the most occurrences is determined as the second recognition result of the sequence code of the sample container.
- the controller 101 can obtain the second identification result of the sequence code in the following manner:
- the first set neural network is used to process all or part of at least one image containing the serial code on the outside of the sample container to obtain a second recognition result of the serial code; wherein the first set neural network is used to recognize the serial code in the input image.
- the controller 101 may use a set serial code recognition algorithm or a serial number recognition algorithm, such as an optical character recognition (OCR) algorithm, to extract image features of all or part of at least one image containing the serial code on the outside of the same sample container, and recognize the serial code on the outside of the sample container based on the extracted image features to obtain a second recognition result of the serial code.
- the serial code region may be first recognized based on the extracted image features. domain, and then identify the sequence code in the sequence code area; the extracted image features include at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features and spatial relationship features.
- the controller 101 issues an alarm prompt so that relevant personnel can review or make further processing.
- the first setting neural network is trained based on image samples of the sample container, and at least part of the image samples contain the serial code outside the sample container.
- the first setting neural network at least extracts the feature information of the numbers and/or characters used to constitute the serial code in the input image, and determines the serial code in the input image based on the extracted feature information.
- the controller 101 may also select at least one image containing the barcode and/or serial code on the outside of the sample container from multiple images of the same sample container for determining the sample information before identifying the barcode and/or serial code on the outside of the sample container. Based on this, in one embodiment, the controller 101 is further configured to:
- a first parameter value of the at least one image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
- the controller 101 can determine the first parameter value of each image in the multiple images of the same sample container, where the first parameter value represents the ratio of the first area to the second area; among the multiple images of the sample container, determine the image whose first parameter value is greater than the set threshold, and obtain at least one image containing the serial code and/or the serial code on the outside of the sample container.
- the first area represents the area occupied by the barcode in the image to obtain at least one image including the serial code on the outside of the sample container; when the serial code needs to be identified, the first area represents the area occupied by the serial code in the image to obtain at least one image including the serial code on the outside of the sample container.
- the first area represents the area occupied by the barcode and the serial code in the image to obtain at least one image including the barcode and the serial code on the outside of the sample container.
- Figures 4 and 5 respectively give examples of images obtained by rotational photography.
- the image determined to contain the barcode on the outside of the sample container may be Figure (a) in Figure 4, or Figure (c) and/or Figure (d) in Figure 5; before recognizing the serial code, the image determined to contain the serial code on the outside of the sample container may be Figure (d) in Figure 5.
- the sample identification system further includes: a human-computer interaction device; the controller 101 is also used to: control the human-computer interaction device to output an alarm prompt message on its display interface when the serial code is not successfully identified; the alarm prompt message indicates that the sample information identification of the sample container has failed.
- the controller 101 may not be able to successfully identify the serial code because the serial code in the captured image may be incomplete or unclear.
- the controller 101 controls the human-computer interaction device to output an alarm prompt message on the display interface of the human-computer interaction device to prompt relevant personnel to perform further processing, for example, manually enter the serial number and/or sample information.
- the barcode outside the sample container can be identified when the sample container is in a stationary state, that is, a conventional scan is performed first. If the barcode cannot be identified when the sample container is in a stationary state, the sample container is then rotated to shoot or rotated to scan. Based on this, in one embodiment, before rotating and shooting the sample container, the image acquisition device 103 is also used to:
- An image is taken when the sample container is stationary, and the barcode is calibrated based on the image.
- the sample container is identified by the rotating device 102. If the barcode cannot be identified successfully, at least the image of the barcode and/or the serial code on the outside of the sample container is acquired when the rotating device 102 drives the sample container to rotate.
- the image acquisition device 103 recognizes the barcode based on an image taken when the same sample container is stationary; the image acquisition device 103 recognizes the barcode on the outside of the sample container based on the image, and when the barcode on the outside of the sample container is not successfully recognized, the controller 101 can be notified to control the operation of the rotating device 102 to drive the sample container to rotate in a vertical direction; the image acquisition device 103 at least acquires an image containing the barcode and/or serial code on the outside of the sample container when the rotating device 102 drives the sample container to rotate, so that the image acquisition device 103 and/or the controller 101 recognize the barcode on the outside of the sample container based on the image containing the barcode and/or serial code on the outside of the sample container.
- FIG6 shows an example of an image taken when the sample container is stationary. Since FIG6 (a) can show the complete barcode, and FIG6 (b) does not show the barcode, the barcode outside the sample container can be successfully recognized based on FIG6 (a), and the barcode outside the sample container cannot be successfully recognized based on FIG6 (b).
- FIG7 shows an example of rotating and photographing a sample container. Since the barcode cannot be successfully recognized when the barcode is not fully displayed in the image, the barcode outside the sample container cannot be successfully recognized based on images (a) and (b) in FIG7 , but the barcode outside the sample container can be successfully recognized based on images (c) and/or (d) in FIG7 .
- the rotating device 102 includes: a base for vertically placing the sample container, and a rotating mechanism for driving the base to rotate around the vertical direction.
- the rotating mechanism is connected to a base for vertically placing a sample container, the base also being called a sample holder, and the rotating mechanism drives the base to rotate, so as to drive the sample container vertically placed on the base to rotate around the vertical direction, for example, to rotate 360 degrees around the vertical direction.
- Image acquisition device 103 An image may be taken when the sample container is stationary, and/or at least an image including a barcode and/or a serial code on the outside of the sample container may be acquired while the rotating device 102 drives the sample container to rotate.
- the base used to vertically place the sample container can clamp the bottom of the sample container, and the part that clamps the sample container does not block the barcode and/or serial code;
- the base can be a single-tube base or a multi-tube base;
- a multi-tube base can hold multiple sample containers, for example, 5 or 10 sample containers.
- the rotating device 102 includes: a manipulator for grasping the sample container, and a rotating mechanism for driving the manipulator to rotate around a vertical direction.
- the rotating mechanism is connected to the manipulator; the manipulator can be used to clamp the top or other parts of the sample container, and the part of the sample container clamped does not block the barcode and/or serial code.
- the rotating mechanism can drive the manipulator to rotate around the vertical direction to drive the sample container clamped by the manipulator to rotate around the vertical direction.
- the image acquisition device 103 can take an image when the sample container is stationary, and/or, at least acquire an image containing the barcode and/or serial code on the outside of the sample container during the process of the rotating device 102 driving the sample container to rotate.
- the rotating device 102 can clamp the top of the sample container through a manipulator, lift the sample container to a certain height, and drive the manipulator to rotate in a vertical direction through a rotating mechanism, so as to drive the sample container clamped by the manipulator to rotate in a vertical direction, so that the image acquisition device 103 can rotate and photograph the sample container.
- the rotating device 102 includes: a sample container carrying mechanism, and a rotating mechanism for driving the sample container to rotate around a vertical direction in the sample container carrying mechanism.
- sample container can be rotated in the sample container carrying mechanism around the vertical direction of the sample container, and the sample container carrying mechanism is used to carry or fix the sample container, and the barcode and/or serial code outside the sample container is not blocked.
- sample container carrying mechanism is used to carry or fix the sample container, and the barcode and/or serial code outside the sample container is not blocked.
- the rotating device 102 may also include a rotating head, and the rotating mechanism may drive the rotating head to rotate; when the rotating mechanism drives the rotating head to rotate, the rotating head is used to apply pressure to the end of the sample container to drive the sample container to rotate in the sample container carrying mechanism.
- the rotating mechanism is connected to the rotating head.
- the image acquisition device 103 further includes:
- a light source is used to provide a shooting light source for the camera.
- the light source can improve the brightness of the shooting environment, thereby improving the brightness of the image captured by the image acquisition device 103 to obtain a clear image.
- the image acquisition device 103 captures an image containing a barcode and/or a serial code on the outside of the same sample container in a rotation scanning or selective shooting scenario, and the image acquisition device 103 and/or the controller 101 recognizes the barcode based on at least one image containing a barcode on the outside of the same sample container. If the barcode is not successfully recognized, the controller 101 recognizes the serial code based on at least one image containing a serial code on the outside of the same sample container, obtains a second recognition result of the serial code, and determines the sample information of the sample container based on the second recognition result. In this way, even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the serial code. Compared with the solution in the related art that obtains the sample information only by scanning the barcode, the above solution can improve the success rate of identifying the sample information.
- the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
- the controller 101 is used to identify the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device 103, identify the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device 103, and determine the sample information of the sample container based on a first recognition result of the barcode and a second recognition result of the serial code.
- the image acquisition device 103 acquires an image containing a barcode and/or a serial code on the outside of the sample container when the rotating device 102 drives the sample container to rotate;
- the controller 101 acquires an image containing a barcode and/or a serial code on the outside of the same sample container acquired by the image acquisition device 103, and obtains a first recognition result of the barcode based on at least one image containing a barcode on the outside of the sample container;
- the serial code is recognized based on at least one image containing a serial code on the outside of the sample container to obtain a second recognition result of the serial code;
- the sample information of the sample container is determined based on the first recognition result of the barcode and the second recognition result of the serial code.
- the controller 101 can also recognize the barcode and the serial code based on at least one image containing a barcode and a serial code on the outside of the same sample container to obtain a first recognition result of the barcode and a second recognition result of the serial code.
- the controller 101 recognizing the barcode and the serial code on the outside of the sample container to obtain the first recognition result and the second recognition result, please refer to the relevant description above, which will not be repeated here.
- the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code, including:
- the sample information of the sample container is determined based on the first recognition result or the second recognition result.
- the server can obtain the sample information determined by the controller based on the first recognition result or the second recognition result, and establish a correspondence between the barcode and the sample information and the sample test result.
- One barcode is bound to one sample information and one sample test result.
- the controller 101 recognizes the barcode based on at least one image containing the barcode on the outside of the same sample container, recognizes the serial code based on at least one image containing the serial code on the outside of the same sample container, and determines the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code; thereby, even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the serial code, thereby improving the success rate of identifying the sample information; in addition, the image acquisition device 103 does not need to recognize the barcode, which can save data processing resources of the image acquisition device 103 and reduce the requirements for the data processing capability of the image acquisition device.
- the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
- the controller 101 is used to control the rotation device to operate, and when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, control the rotation device to stop operating;
- the controller 101 is further configured to determine the sample information of the sample container according to the first recognition result of the barcode when the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device 103 can successfully recognize the barcode; and to determine the sample information of the sample container according to the first recognition result of the barcode when the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device 103 cannot successfully recognize the barcode.
- the image containing the barcode and the serial code on the outside of the sample container recognizes the serial code, and determines the sample information of the sample container according to the second recognition result of the serial code.
- the controller 101 controls the rotation device 102 to operate so that the rotation device 102 drives the sample container to rotate around the vertical direction, and the image acquisition device 103 acquires the image of the sample container when the rotation device 102 drives the sample container to rotate.
- the controller 101 acquires the image of the same sample container taken by the image acquisition device 103, and determines whether the acquired image contains the image of the barcode and the serial code on the outside of the sample container, that is, determines whether the front image of the barcode and the serial code on the outside of the sample container is acquired; when the image acquisition device 103 acquires the image containing the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotation device 102 to stop operating; the image acquisition device 103 and/or the controller 101 can recognize the barcode according to the image containing the barcode and the serial code on the outside of the sample container to obtain a barcode recognition result; in the case that the barcode cannot be successfully recognized according to the image containing the barcode and the serial code on the outside of the sample container acquired by the
- the controller 101 can control the rotating device 102 to rotate at a set angle, that is, each time the rotating device 102 rotates at a set angle, for example, 20 degrees.
- the rotating angle of the rotating device 102 can be determined according to the rotation speed of the rotating device 102.
- the controller 101 is further used to identify the barcode based on the image features of all or part of the image containing the barcode and the serial code on the outside of the sample container; or,
- the controller 101 is also used to process all or part of the image containing the barcode and serial code on the outside of the sample container through a second set neural network to identify the barcode; wherein the second set neural network is used to identify the barcode in the input image.
- the method of identifying a barcode based on an image containing a barcode and a serial code on the outside of a sample container is similar to the above method of identifying a barcode based on at least one barcode on the outside of a sample container, and is not described in detail here.
- the controller 101 may identify the serial code based on the image features of all or part of the image including the barcode and the serial code on the outside of the sample container to obtain the second identification result; or,
- the controller 101 can process all or part of the image including the barcode and serial code on the outside of the sample container through a first set neural network to identify the serial code and obtain the second recognition result; wherein the first set neural network is used to identify the serial code in the input image.
- the method of identifying the serial code based on an image containing the barcode and serial code on the outside of the sample container is similar to the above method of identifying the serial code based on at least one image containing the serial code on the outside of the sample container, and will not be repeated here.
- the controller 101 identifies the image based on the image features of the image acquired by the image acquisition device 103 to obtain a third recognition result; or, the controller 101 processes the image acquired by the image acquisition device 103 through a third set neural network to obtain a third recognition result; when the third recognition result indicates that the image acquisition device 103 acquires an image containing the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotating device 102 to stop running.
- the controller 101 can call a barcode area recognition algorithm to recognize the image features of the image acquired by the image acquisition device 103 to obtain a third recognition result;
- the barcode area recognition algorithm is used to detect the barcode area;
- the image features include at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features and spatial relationship features.
- the third setting neural network is used to process the input image to obtain a barcode area recognition result, and the barcode area recognition result indicates whether the barcode and serial code outside the sample container are included.
- the third setting neural network takes the image of the sample container as input and the barcode area recognition result as output.
- the controller 101 can also select images with larger image areas of barcodes and serial codes from multiple images of the same sample container before identifying the barcodes and serial codes on the outside of the sample container to identify the sample information. Based on this, in one embodiment, the image containing the barcode and serial code on the outside of the sample container used to determine the sample information of the sample container is determined from the multiple images acquired by the image acquisition device; wherein,
- the first parameter value of the at least one image is greater than a set threshold; the first parameter value represents the ratio of the first area to the second area; the first area represents the area occupied by the barcode and the serial code in the at least one image; the second area represents the area occupied by the sample container in the at least one image.
- the controller 101 is also used to determine the first recognition result of the barcode from the at least two different barcode recognition results based on the number of occurrences of the barcode recognition results corresponding to the same sample container; or, the image acquisition device 103 is also used to determine the first recognition result from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results, and send the first recognition result to the controller.
- Some or all of the multiple images of the same sample container acquired by the image acquisition device 103 contain at least the barcode on the outside of the sample container, that is, one image may contain only the barcode on the outside of the sample container, or one image may contain the barcode and the serial code on the outside of the sample container.
- the controller 101 or the image acquisition device 103 may identify at least two different barcode recognition results based on the multiple images containing at least the barcode on the outside of the same sample container; the controller 101 or the image acquisition device 103 may identify at least two identical barcodes corresponding to the same sample container.
- the controller 101 or the image acquisition device 103 may also determine the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container.
- the controller 101 or the image acquisition device 103 determines the first recognition result from at least two different barcode recognition results based on the number of occurrences of the barcode recognition results corresponding to the same sample container, including:
- the controller 101 or the image acquisition device 103 votes on the corresponding barcode recognition result when the barcode in the image is recognized; when the number of votes corresponding to any barcode recognition result is greater than a set threshold, the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
- the controller 101 or the image acquisition device 103 votes for each barcode recognition result corresponding to a sample container; when the number of votes corresponding to any barcode recognition result of the same sample container is greater than a set threshold, the barcode recognition result with a number of votes greater than the set threshold is determined as the first recognition result of the barcode outside the sample container. For example, when a barcode recognition result A corresponding to any sample container is obtained, A is voted, and when any barcode recognition result of the sample container reaches N votes, A is determined as the first recognition result of the barcode outside the sample container.
- the barcode recognition results of the same sample container obtained twice in a row can be the same or different.
- the barcode recognition results corresponding to the same sample container obtained multiple times in a row are ABA, ABB, AAA, ABAA or ABBAA.
- the controller 101 can also determine the sample information of the sample container according to the first recognition result of the barcode of the sample container; in the case where the image acquisition device 103 and/or the controller 101 fail to successfully recognize the barcode on the outside of the sample container, the controller 101 can also recognize the serial code based on an image at least containing the serial code on the outside of the same sample container, and determine the sample information of the sample container according to the first recognition result of the barcode of the sample container.
- the second identification result determines the sample information of the sample container. The implementation process of the controller 101 determining the sample information according to the second identification result is described above and will not be repeated here.
- the barcode outside the sample container can be identified when the sample container is in a stationary state, that is, a conventional scan is performed first. If the barcode cannot be identified when the sample container is in a stationary state, the sample container is rotated and photographed. Based on this, in one embodiment, the image acquisition device 103 is also used to obtain an image of the sample container when the sample container is stationary; if the controller 101 fails to successfully identify the barcode based on the image, the rotation device 102 is controlled to operate.
- the image acquisition device 103 acquires an image of the sample container when the sample container is stationary; the image acquisition device 103 and/or the controller 101 recognize the barcode based on the image; if the barcode can be successfully recognized based on the image, the controller 101 can control the rotating device 102 to stop running; if the barcode cannot be successfully recognized based on the image, the controller 101 controls the rotating device 102 to run, thereby driving the sample container to rotate in the vertical direction, so as to recognize the barcode in the scene of rotation scanning or rotation photography. In this way, the success rate of identifying sample information can be guaranteed, resources can be saved, and the efficiency of sample information recognition can be improved.
- the controller 101 is also used to control the rotating device 102 to stop running if no barcode is identified after the rotating device 102 drives the sample container to rotate a set number of times.
- the controller 101 controls the rotating device 102 to stop running, so that the sample container stops.
- the set number of revolutions may be 2; at this time, the controller 101 may also mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
- any barcode recognition result corresponding to the sample container is obtained within the first set number of revolutions driven by the rotating device 102, the controller 101 or the image acquisition device 103 needs to determine the first recognition result of the barcode within the second set number of revolutions driven by the rotating device 102; if the controller 101 still fails to determine the first recognition result of the barcode when the rotating device 102 drives the sample container to rotate the second set number of revolutions, or fails to receive the first recognition result of the barcode sent by the image acquisition device 103, then the controller 101 can mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
- the second set number of revolutions is greater than the first set number of revolutions, for example, the first set number of revolutions can be 2, and the second set number of revolutions can be 3 or 4.
- the image acquisition device 103 acquires an image of the sample container while the rotating device 102 drives the sample container to rotate.
- the controller 101 recognizes the barcode according to the image containing the barcode and the serial code on the outside of the sample container; if the barcode can be successfully recognized, the controller 101 determines the sample information of the sample container according to the first recognition result of the barcode; if the barcode cannot be successfully recognized, the controller 101 recognizes the serial code according to the image containing the serial code on the outside of the sample container and the serial code, obtains a second recognition result of the serial code, and determines the sample information of the sample container according to the second recognition result.
- the above solution can improve the success rate and efficiency of identifying sample information.
- the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
- the image acquisition device 103 is used for, when the rotating device drives the sample container to rotate, acquiring at least an image including a barcode on the exterior of the sample container;
- the controller 101 is used to control the rotation device 102 to operate, and when the image acquisition device 103 acquires an image containing the barcode and/or the serial code on the outside of the sample container, control the rotation device 102 to stop operating; and is also used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully identified according to the image containing the barcode on the outside of the sample container, and is used to control the rotation device 102 to operate, according to at least one image containing the barcode acquired by the image acquisition device 103, when the barcode cannot be successfully identified according to the image containing the barcode on the outside of the sample container.
- the barcode is identified based on the image of the barcode on the outside of the sample container.
- the sample information of the sample container is determined based on the first recognition result of the barcode.
- the serial code is identified based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device 103, and the sample information of the sample container is determined based on the second recognition result of the serial code.
- the controller 101 controls the rotation device 102 to operate so that the rotation device 102 drives the sample container to rotate around the vertical direction, and the image acquisition device 103 acquires an image of the sample container when the rotation device 102 drives the sample container to rotate.
- the controller 101 can control the rotation device 102 to rotate at a set angle, that is, each time the rotation is set by an angle, such as 20 degrees.
- the rotation angle of the rotation device 102 can be determined according to the rotation speed of the rotation device 102.
- the controller 101 acquires the image of the same sample container taken by the image acquisition device 103, and determines whether the acquired image contains the image of the barcode and the serial code on the outside of the sample container, that is, determines whether the front image of the barcode and the serial code on the outside of the sample container is acquired; when the acquired image contains the image of the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotating device 102 to stop running.
- the controller 101 or the image acquisition device 103 determines whether the image contains the image of the barcode and the serial code on the outside of the sample container.
- the controller 101 identifies the image of the barcode on the outside of the sample container.
- the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode on the outside of the sample container.
- the controller 101 controls the rotation device 103 to operate.
- the rotation device 102 drives the sample container to rotate
- the image acquisition device 103 at least acquires the image including the barcode and/or the serial code on the outside of the sample container.
- the controller 101 recognizes the barcode based on at least one image containing the barcode on the outside of the same sample container acquired by the image acquisition device 103.
- the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode.
- the controller 101 recognizes the serial code based on at least one image containing the serial code on the outside of the same sample container acquired by the image acquisition device 103, and determines the sample information of the sample container based on the second recognition result of the serial code.
- the embodiment of the present application also provides a sample identification method, which is applied to the controller in the above sample identification system; the sample identification system also includes a rotating device and an image acquisition device coupled to the controller, and the controller can communicate with the image acquisition device to receive or acquire images taken by the image acquisition device, and/or receive barcode recognition results sent by the image acquisition device.
- the method includes:
- Step 801 when a barcode on the outside of a sample container can be successfully identified based on at least one image at least including the barcode on the outside of the sample container, determine sample information of the sample container based on a first recognition result of the barcode.
- the image acquisition device or the controller may recognize the barcode based on at least one image that at least includes the barcode on the outside of the same sample container to obtain a barcode recognition result, and determine a first barcode recognition result based on the barcode recognition result of the same sample container, and the controller determines the sample information of the sample container based on the first barcode recognition result.
- the image acquisition device may recognize the barcode based on at least one image that at least includes the barcode on the outside of the same sample container to obtain a barcode recognition result, and the controller may determine a first barcode recognition result based on the barcode recognition result of the same sample container; and the controller determines the sample information of the sample container based on the first barcode recognition result.
- the implementation process of determining the first barcode recognition result and determining the sample information based on the first recognition result is described above, and will not be repeated here.
- the image that at least includes the barcode on the outside of the same sample container may include at least the barcode of the sample container and may also include the serial code of the sample container. That is, the image acquisition device or controller recognizes the barcode based on at least one image that at least includes the barcode on the outside of the same sample container, including: performing barcode recognition based on the image that includes the barcode on the outside of the same sample container, or performing barcode recognition based on the image that includes the barcode and the serial code on the outside of the same sample container.
- determining the sample information of the sample container according to the first recognition result of the barcode includes:
- the image acquisition device Receive the first recognition result sent by the image acquisition device, and determine the sample information of the sample container according to the first recognition result; the first recognition result is obtained by the image acquisition device recognizing the barcode based on an image captured by at least the barcode on the outside of the sample container.
- the image acquisition device is based on at least one image containing at least one sample container
- the barcode is recognized by using the image of the barcode on the sample container, and only one barcode recognition result is obtained, then the barcode recognition result is the first recognition result of the barcode of the sample container;
- the image acquisition device sends the first recognition result of the barcode of the sample container to the controller;
- the controller receives the first recognition result sent by the image acquisition device, and determines the sample information of the sample container according to the first recognition result.
- the image at least including the barcode on the outside of the sample container may be an image acquired when the sample container is stationary before the controller controls the rotating device to operate, or may be an image captured by the image acquisition device when the rotating device drives the sample container to rotate.
- the barcode can be recognized by the image acquisition device to reduce the amount of data processing of the controller.
- the at least one image containing at least the barcode on the outside of the sample container includes multiple images; the receiving the first recognition result sent by the image acquisition device includes:
- the first recognition result is determined from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results.
- the image acquisition device can obtain at least two different barcode recognition results based on multiple images containing at least the barcode on the outside of the same sample container, and send all barcode recognition results corresponding to the same sample container to the controller; the controller determines the first recognition result from all barcode recognition results corresponding to the sample container based on the number of occurrences of each barcode recognition result corresponding to the sample container; for example, the controller can determine the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container. In this way, the accuracy and credibility of the first recognition result can be improved.
- the barcode recognition result is selected from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results. Determining the first recognition result from the results includes:
- the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
- the first recognition result of the barcode of the sample container is A; if the different barcode recognition results corresponding to the same sample container are ABB, then the first recognition result of the barcode of the sample container is B.
- the barcode recognition can be controlled to reduce the data processing amount of the image acquisition device or reduce the data processing capability requirements of the image acquisition device. Based on this, in one embodiment, the method further includes:
- the barcode is identified based on image features of all or part of the at least one image that at least includes the barcode on the outside of the sample container; or, the barcode is identified by processing all or part of the at least one image that at least includes the barcode on the outside of the sample container through a second set neural network; the second set neural network is used to identify the barcode in the input image.
- the at least one image containing at least the barcode on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
- the implementation process of the controller recognizing the barcode based on at least one image containing at least the barcode on the outside of the same sample container is described above and will not be repeated here.
- Step 802 If the barcode cannot be successfully identified based on at least one image that at least includes the barcode on the outside of the sample container, identify the serial code based on at least one image that at least includes the serial code on the outside of the sample container, and identify the serial code based on the serial code.
- the sample information of the sample container is determined based on the second recognition result.
- At least one image including at least the barcode and/or the serial code on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
- the controller or the image acquisition device fails to successfully identify the barcode based on at least one image that at least includes the barcode on the outside of the same sample container
- the controller identifies the serial code on the outside of the sample container based on at least one image that at least includes the serial code on the outside of the sample container, obtains a second identification result of the barcode, and determines the sample information of the sample container based on the second identification result of the serial code.
- the image at least including the serial code on the outside of the sample container may also include the serial code on the outside of the sample container. That is, the controller recognizes the serial code based on at least one image at least including the serial code on the outside of the same sample container, including: performing barcode recognition based on the image including the serial code on the outside of the same sample container, or performing barcode recognition based on the image including the barcode and the serial code on the outside of the same sample container.
- the identifying the serial code based on at least one image at least including the serial code on the outside of the sample container includes:
- the first set neural network is used to process all or part of the at least one image containing at least the serial code on the outside of the sample container to identify the serial code to obtain the second recognition result; the first set neural network is used to identify the serial code in the input image. Serial number.
- the rotating device can be stopped when the front image of the barcode and/or the serial code is obtained. Based on this, in one embodiment, the rotating device is controlled to operate, and when the image acquisition device acquires an image containing the barcode and the serial code on the outside of the sample container, the rotating device is controlled to stop operating.
- the controller can control the rotating device to continue to operate to drive the sample container to continue to rotate in the vertical direction, and the image acquisition device captures the next frame of image.
- the image acquired by the image acquisition device is identified based on the image features to obtain a third recognition result; or, the image acquired by the image acquisition device is processed by a third set neural network to obtain a third recognition result;
- the controller controls the rotating device to stop running.
- the rotating device drives the sample container to rotate a set number of times, the rotating device is controlled to stop running.
- the controller controls the rotating device to stop running, so that the sample container stops rotating; the set number of revolutions can be 2.
- the controller can also mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
- the controller or the image acquisition device needs to determine the first recognition result of the barcode of the sample container within the second set number of revolutions driven by the rotating device; if, when the rotating device drives the sample container to rotate the second set number of revolutions, the controller or the image acquisition device still has not determined the first recognition result of the barcode of the sample container, then the controller can mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
- the second set number of revolutions is greater than the first set number of revolutions, for example, the first set number of revolutions can be 2, and the second set number of revolutions can be 3 or 4.
- the first parameter value of the image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
- the controller can also identify the barcode based on at least one image containing the barcode on the outside of the same sample container, identify the serial code based on at least one image containing the serial code on the outside of the same sample container, and determine the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code; wherein, at least one image containing the barcode and/or serial code on the outside of the same sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
- the sample information of the sample container is determined based on the first recognition result or the second recognition result; when the first recognition result and the second recognition result corresponding to the same sample container are different, it indicates that the code scanning is abnormal, and the controller can transfer the sample container to the code scanning abnormality area, and can also control the human-computer interaction device in the sample identification system to output an alarm prompt message or a prompt message indicating the code scanning abnormality on its display interface to prompt relevant personnel to make further processing.
- the controller can also control the rotation device to operate so that the image acquisition device at least acquires an image containing the barcode and/or the serial code on the outside of the sample container when the rotation device drives the sample container to rotate.
- the controller controls the rotation device to stop operating; when the image acquisition device can successfully identify the barcode and the serial code on the outside of the sample container based on the image containing the barcode and the serial code on the outside of the sample container, the controller controls the rotation device to stop operating.
- the sample information of the sample container is determined according to a first recognition result of the barcode, and in the case that the barcode cannot be successfully recognized according to the image containing the barcode and the serial code on the outside of the sample container, the rotating device is controlled to operate; the barcode is recognized according to at least one image containing the barcode on the outside of the sample container acquired by an image acquisition device, and in the case that the barcode can be successfully recognized according to the at least one image containing the barcode on the outside of the sample container, the sample information of the sample container is determined according to the first recognition result of the barcode; in the case that the barcode cannot be successfully recognized according to the at least one image containing the barcode on the outside of the sample container, the serial code is recognized according to at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, and the sample information of the sample container is determined according to a second recognition result of the serial code.
- the embodiment of the present application further provides a controller, which is deployed in the above sample identification system, and the sample identification system also includes a rotating device and an image acquisition device coupled to the controller.
- the controller 900 includes:
- Communication interface 901 capable of exchanging information with other nodes
- the processor 902 is connected to the communication interface 901 to implement information exchange with other nodes, and is used to execute the method provided by one or more technical solutions of the controller side when running the computer program.
- the computer program is stored in the memory 903.
- the processor 902 is used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully recognized based on at least one image that at least includes the barcode on the outside of the sample container; and to recognize the sequence code based on at least one image that at least includes the sequence code on the outside of the sample container, and determine the sample information of the sample container according to a second recognition result of the sequence code when the barcode cannot be successfully recognized based on at least one image that at least includes the barcode on the outside of the sample container; wherein at least one image that at least includes the barcode and/or the sequence code on the outside of the sample container is
- the image acquisition device takes pictures when the rotating device drives the sample container to rotate.
- the processor 902 is further configured to control the operation of the rotating device, and control the rotating device to stop operating when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container.
- the processor 902 is further configured to, when the rotating device is running, perform recognition based on image features of the image acquired by the image acquisition device to obtain a third recognition result; or, process the image acquired by the image acquisition device through a third set neural network to obtain a third recognition result;
- the controller controls the rotating device to stop running.
- the processor 902 is specifically configured to identify the serial code based on image features of all or part of the at least one image at least including the serial code on the outside of the sample container to obtain the second identification result; or
- the first set neural network is used to process all or part of the at least one image containing at least the serial code on the outside of the sample container to identify the serial code and obtain the second recognition result; the first set neural network is used to identify the serial code in the input image.
- the communication interface 901 is used to receive the first recognition result sent by the image acquisition device, and determine the sample information of the sample container according to the first recognition result; the first recognition result is obtained by the image acquisition device recognizing the barcode based on the image captured by at least the barcode on the outside of the sample container;
- the processor 902 is specifically configured to determine the sample information of the sample container according to the first recognition result.
- the at least one image at least including the barcode on the outside of the sample container includes a plurality of images; the communication interface 901 is specifically used to receive the image acquisition device based on At least two different barcode recognition results obtained from the multiple images;
- the processor 902 is specifically configured to determine the first recognition result from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results.
- the processor 902 is specifically configured to vote on the corresponding barcode recognition results; when the number of votes corresponding to any barcode recognition result is greater than a set threshold, the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
- the communication interface 901 is further used to receive the at least one image including at least the barcode on the outside of the sample container sent by the image acquisition device;
- the processor 902 is further used to identify the barcode based on image features of all or part of the at least one image that at least includes the barcode on the outside of the sample container; or, to process all or part of the at least one image that at least includes the barcode on the outside of the sample container through a second set neural network to identify the barcode; the second set neural network is used to identify the barcode in the input image.
- the processor 902 is further configured to determine, from the multiple images acquired by the image acquisition device, at least one image including at least a barcode on the outside of the sample container and/or at least one image including at least a serial code on the outside of the sample container for determining the sample information of the sample container; wherein,
- the first parameter value of the image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
- the processor 902 is further configured to control the rotating device to stop running if no barcode is recognized after the rotating device drives the sample container to rotate a set number of times.
- bus system 904. the various components in the controller 900 are coupled together through the bus system 904. It can be understood that the bus system 904 is used to realize the connection and communication between these components.
- the bus system 904 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, various buses are marked as the bus system 904 in FIG. 9.
- the memory 903 in the embodiment of the present application is used to store various types of data to support the operation of the controller 900. Examples of such data include: any computer program used to operate on the controller 900.
- the method disclosed in the above embodiment of the present application can be applied to the processor 902, or implemented by the processor 902.
- the processor 902 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 902 or the instruction in the form of software.
- the above-mentioned processor 902 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
- DSP Digital Signal Processor
- the processor 902 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.
- a general-purpose processor may be a microprocessor or any conventional processor, etc.
- the decoding processor 902 In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor.
- the software module can be located in a storage medium, which is located in the memory 903.
- the processor 902 reads the information in the memory 903 and completes the steps of the above method in combination with its hardware.
- the controller 900 may be implemented by one or more application specific integrated circuits.
- the method can be implemented by an ASIC (Application Specific Integrated Circuit), a DSP, a programmable logic device (PLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), a general-purpose processor, a controller, a microcontroller (MCU), a microprocessor, or other electronic components to execute the aforementioned method.
- ASIC Application Specific Integrated Circuit
- DSP digital signal processor
- PLD programmable logic device
- CPLD complex programmable logic device
- FPGA field programmable gate array
- MCU microcontroller
- microprocessor or other electronic components to execute the aforementioned method.
- the memory (memory 903) of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories.
- the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a ferromagnetic random access memory, a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM);
- the magnetic surface memory can be a disk memory or a tape memory.
- the volatile memory can be a random access memory (RAM), which is used as an external cache.
- RAM random access memory
- RAM random access memory
- SRAM static random access memory
- SSRAM synchronous static random access memory
- DRAM dynamic random access memory
- SDRAM synchronous dynamic random access memory
- DDRSDRAM double data rate synchronous dynamic random access memory
- ESDRAM enhanced synchronous dynamic random access memory
- SLDRAM synchronous link dynamic random access memory
- DMA direct memory access memory
- DMA direct memory access memory
- DRRAM Direct Rambus Random Access Memory
- the memory described in the embodiments of the present application is intended to include but is not limited to these and any other suitable types of memory.
- the embodiment of the present application further provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, a memory 903 storing a computer program, and the computer program can be executed by a processor 902 of a controller 900 to complete the steps described in the aforementioned electronic device side method.
- the computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.
- a and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone.
- at least one herein represents any combination of at least two of any one or more of a plurality of.
- including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Automatic Analysis And Handling Materials Therefor (AREA)
Abstract
Description
本申请涉及医学检测技术领域,尤其涉及一种样本识别系统及样本识别方法、控制器及存储介质。The present application relates to the field of medical detection technology, and in particular to a sample identification system and a sample identification method, a controller and a storage medium.
自动化生化免疫流水线,可以将不同的生化仪器与分析前、分析后的实验室分析系统通过自动化传输轨道串联起来,在信息化系统的主导控制下,实现流水线作业的组合;由于样本容器的表面粘贴的条形码记录了样本容器内的血液样本的信息或检测项目,因此,样本容器的条形码识别是医院检验科生化免疫流水线的重要环节之一,是信息流通的最关键步骤。然而,样本容器上的条形码是人工粘贴的,在扫描条形码的过程中如果条形码显示不全将无法得到条形码识别结果因此,在对样本容器扫码前需要人工调整样本容器的角度和位置,才能成功识别条形码,导致条码识别效率降低。The automated biochemical immunoassay assembly line can connect different biochemical instruments with pre-analysis and post-analysis laboratory analysis systems through automated transmission tracks, and realize the combination of assembly line operations under the dominant control of the information system; since the barcode pasted on the surface of the sample container records the information or test items of the blood sample in the sample container, the barcode recognition of the sample container is one of the important links in the biochemical immunoassay assembly line of the hospital laboratory and the most critical step in information flow. However, the barcode on the sample container is manually pasted. If the barcode is not fully displayed during the barcode scanning process, the barcode recognition result cannot be obtained. Therefore, before scanning the sample container, it is necessary to manually adjust the angle and position of the sample container to successfully recognize the barcode, resulting in reduced barcode recognition efficiency.
发明内容Summary of the invention
为解决相关技术问题,本申请实施例提供了一种样本识别系统及样本识别方法、控制器及存储介质。To solve related technical problems, embodiments of the present application provide a sample identification system and a sample identification method, a controller and a storage medium.
本申请实施例提供了一种样本识别系统,包括控制器、旋转装置以及耦合至所述控制器的图像获取装置;An embodiment of the present application provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
所述旋转装置,用于驱动样本容器绕竖直方向旋转;The rotating device is used to drive the sample container to rotate around the vertical direction;
所述图像获取装置,用于在所述旋转装置驱动所述样本容器旋转时至少获取包含所述样本容器外部的条形码和/或序列码的图像; The image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
所述控制器,用于在根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;以及用于在根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,基于所述图像获取装置获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。The controller is used to determine the sample information of the sample container according to a first recognition result of the barcode, when the barcode can be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device; and is used to recognize the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, when the barcode cannot be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container according to a second recognition result of the serial code.
本申请实施例还提供了一种样本识别系统,包括控制器、旋转装置以及耦合至所述控制器的图像获取装置;The embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
所述旋转装置,用于驱动样本容器绕竖直方向旋转;The rotating device is used to drive the sample container to rotate around the vertical direction;
所述图像获取装置,用于在所述旋转装置驱动所述样本容器旋转时,获取所述样本容器的图像;The image acquisition device is used to acquire an image of the sample container when the rotating device drives the sample container to rotate;
所述控制器,用于控制所述旋转装置运行,并在所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,控制所述旋转装置停止运行;The controller is used to control the rotation device to operate, and when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, control the rotation device to stop operating;
所述控制器,还用于在根据所述图像获取装置获取的包含所述样本容器外部的条形码和序列码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;以及用于在根据所述图像获取装置获取的包含所述样本容器外部的条形码和序列码的图像未能成功识别出所述条形码的情况下,基于所述图像获取装置获取的包含所述样本容器外部的条形码和序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。The controller is further used to determine the sample information of the sample container according to a first recognition result of the barcode, when the barcode can be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device; and to recognize the serial code based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container according to a second recognition result of the serial code, when the barcode cannot be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device.
本申请实施例还提供了一种样本识别系统,包括控制器、旋转装置以及耦合至所述控制器的图像获取装置;The embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
所述旋转装置,用于驱动样本容器绕竖直方向旋转; The rotating device is used to drive the sample container to rotate around the vertical direction;
所述图像获取装置,用于在所述旋转装置驱动所述样本容器旋转时至少获取包含所述样本容器外部的条形码和/或序列码的图像;The image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
所述控制器,用于根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像对所述条形码进行识别,根据所述图像获取装置获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,以及根据所述条形码的第一识别结果和所述序列码的第二识别结果确定所述样本容器的样本信息。The controller is used to identify the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device, identify the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container based on a first recognition result of the barcode and a second recognition result of the serial code.
本申请实施例还提供了一种样本识别系统,包括控制器、旋转装置以及耦合至所述控制器的图像获取装置;The embodiment of the present application also provides a sample identification system, including a controller, a rotating device, and an image acquisition device coupled to the controller;
所述旋转装置,用于驱动样本容器绕竖直方向旋转;The rotating device is used to drive the sample container to rotate around the vertical direction;
所述图像获取装置,用于在所述旋转装置驱动所述样本容器旋转时,至少获取包含所述样本容器外部的条形码和/或序列码的图像;The image acquisition device is used to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
所述控制器,用于控制所述旋转装置运行,并在所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,控制所述旋转装置停止运行;还用于在根据包含所述样本容器外部的条形码和序列码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息,以及用于在根据包含所述样本容器外部的条形码和序列码的图像未能成功识别出所述条形码的情况下,控制所述旋转装置运行,根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像对所述条形码进行识别,在根据所述至少一张包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;在根据所述至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,根据所述图像获取装置获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结 果确定所述样本容器的样本信息。The controller is used to control the operation of the rotating device, and control the rotating device to stop operating when the image acquisition device acquires an image containing the barcode and the serial code on the outside of the sample container; and is also used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container; and is used to control the operation of the rotating device to recognize the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device when the barcode cannot be successfully recognized based on the image containing the barcode and the serial code on the outside of the sample container, and to determine the sample information of the sample container according to the first recognition result of the barcode when the barcode can be successfully recognized based on the at least one image containing the barcode on the outside of the sample container; and to recognize the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device when the barcode cannot be successfully recognized based on the at least one image containing the barcode on the outside of the sample container, and to determine the sample information of the sample container according to the second recognition result of the serial code. The result is to determine the sample information of the sample container.
本申请实施例还提供了一种样本识别方法,应用于样本识别系统中的控制器;所述样本识别系统还包括旋转装置及耦合至所述控制器的图像获取装置;所述方法包括:The present application also provides a sample identification method, which is applied to a controller in a sample identification system; the sample identification system further includes a rotating device and an image acquisition device coupled to the controller; the method includes:
在根据至少一张包含样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;In a case where the barcode on the outside of the sample container can be successfully identified according to at least one image including the barcode, determining the sample information of the sample container according to a first identification result of the barcode;
在根据至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,基于至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息;其中,In the case that the barcode on the outside of the sample container cannot be successfully identified based on at least one image containing the barcode on the outside of the sample container, the serial code is identified based on at least one image containing the serial code on the outside of the sample container, and the sample information of the sample container is determined based on the second identification result of the serial code; wherein,
至少一张包含所述样本容器外部的条形码和/或序列码的图像由所述图像获取装置在所述旋转装置驱动所述样本容器旋转时拍摄得到。At least one image including the barcode and/or the serial code on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
本申请实施例还提供了一种控制器,包括:处理器和用于存储能够在处理器上运行的计算机程序的存储器,The present application also provides a controller, comprising: a processor and a memory for storing a computer program that can be run on the processor.
其中,所述处理器配置为运行所述计算机程序时,执行上述控制器侧任一方法的步骤。Wherein, the processor is configured to execute the steps of any of the above-mentioned controller-side methods when running the computer program.
本申请实施例还提供了一种存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述控制器侧任一方法的步骤。An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned controller-side methods are implemented.
在本申请实施例提供的样本识别系统及样本识别方法、控制器及存储介质中,由图像获取装置对样本容器进行旋转拍摄,得到至少一张包含同一样本容器外部的条形码和/或序列码的图像,可以在根据至少包含同一样本容器外部的条形码的图像能够成功识别出条形码的情况下,由控制器根据条形码的第一识别结果确定样本容器的样本信息;以及在根据至少包含同一样本容器外部的条形码的图像未能成功识别出条形码的情况下,由控 制器基于至少包含同一样本容器外部的序列码的图像识别出序列码的第二识别结果,并根据序列码的第二识别结果确定样本容器的样本信息;或者控制器基于至少包含样本容器外部的条形码的图像对条形码进行识别,根据至少包含样本容器外部的序列码对序列码进行识别,基于同一样本容器的条形码的第一识别结果和序列码的第二识别结果确定样本容器的样本信息。相比于相关技术中通过人工调整样本容器的位置和方向来提升扫码成功率的方案,上述方案能够提升条码识别效率,并且即使未成功识别条形码,也可以通过识别序列码来获得样本信息,能够提高识别样本信息的成功率。In the sample identification system and sample identification method, controller and storage medium provided in the embodiments of the present application, the image acquisition device rotates and photographs the sample container to obtain at least one image containing the barcode and/or serial code on the outside of the same sample container. If the barcode can be successfully identified based on the image containing at least the barcode on the outside of the same sample container, the controller can determine the sample information of the sample container based on the first recognition result of the barcode; and if the barcode cannot be successfully identified based on the image containing at least the barcode on the outside of the same sample container, the controller can determine the sample information of the sample container based on the first recognition result of the barcode. The controller identifies a second recognition result of the sequence code based on an image at least including the sequence code on the outside of the same sample container, and determines the sample information of the sample container according to the second recognition result of the sequence code; or the controller identifies the barcode based on an image at least including the barcode on the outside of the sample container, identifies the sequence code according to at least the sequence code on the outside of the sample container, and determines the sample information of the sample container based on the first recognition result of the barcode of the same sample container and the second recognition result of the sequence code. Compared with the solution in the related art that improves the scanning success rate by manually adjusting the position and direction of the sample container, the above solution can improve the barcode recognition efficiency, and even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the sequence code, which can improve the success rate of identifying the sample information.
图1为本申请实施例一种样本识别系统架构示意图;FIG1 is a schematic diagram of a sample identification system architecture according to an embodiment of the present application;
图2为本申请实施例基于图像特征识别序列码的示例图;FIG2 is an example diagram of a sequence code based on image feature recognition according to an embodiment of the present application;
图3为本申请实施例通过第一设定神经网络识别序列码的示例图;FIG3 is an example diagram of recognizing a sequence code through a first setting neural network according to an embodiment of the present application;
图4为本申请实施例对样本容器进行旋转拍摄获得的图像示例;FIG4 is an example of an image obtained by rotating and photographing a sample container according to an embodiment of the present application;
图5为本申请实施例对样本容器进行旋转拍摄获得的图像示例;FIG5 is an example of an image obtained by rotating and photographing a sample container according to an embodiment of the present application;
图6为本申请实施例在样本容器静止时拍摄图像的示例图;FIG6 is an example diagram of an image captured when the sample container is stationary according to an embodiment of the present application;
图7为本申请实施例对样本容器进行旋转拍摄的示例图;FIG7 is an exemplary diagram of rotating and photographing a sample container according to an embodiment of the present application;
图8为本申请实施例样本识别方法实现流程示意图;FIG8 is a schematic diagram of a sample identification method implementation flow in an embodiment of the present application;
图9为本申请实施例控制器结构示意图。FIG. 9 is a schematic diagram of the controller structure of an embodiment of the present application.
下面结合附图及实施例对本申请再作进一步详细的描述。The present application is further described in detail below in conjunction with the accompanying drawings and embodiments.
本申请实施例提供了一种样本识别系统,参照图1,样本识别系统包括:控制器101、旋转装置102以及耦合至控制器101的图像获取装置103,图像获取装置103可以是照相机,例如工业相机;控制器101与图像获取装 置103之间可以直接耦合,例如图像获取装置103通过通用串行总线(USB,Universal Serial Bus)、高清多媒体接口(HDMI,High Definition Multimedia Interface)等与控制器101进行通信连接,控制器101与图像获取装置103之间也可以间接耦合,例如控制器101通过中间设备或其他设备,与图像获取装置103进行通信连接。其中,The present application embodiment provides a sample identification system. Referring to FIG. 1 , the sample identification system includes: a controller 101, a rotating device 102, and an image acquisition device 103 coupled to the controller 101. The image acquisition device 103 may be a camera, such as an industrial camera. The image acquisition device 103 may be directly coupled, for example, the image acquisition device 103 is connected to the controller 101 through a universal serial bus (USB), a high definition multimedia interface (HDMI), etc., or the controller 101 and the image acquisition device 103 may be indirectly coupled, for example, the controller 101 is connected to the image acquisition device 103 through an intermediate device or other device.
旋转装置102,用于驱动样本容器绕竖直方向旋转;The rotating device 102 is used to drive the sample container to rotate in a vertical direction;
图像获取装置103,用于在所述旋转装置驱动所述样本容器旋转时至少获取包含所述样本容器外部的条形码和/或序列码的图像;An image acquisition device 103, configured to acquire at least an image including a barcode and/or a serial code on the outside of the sample container when the rotating device drives the sample container to rotate;
控制器101,用于在根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;以及用于在根据所述图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,基于所述图像获取装置获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。The controller 101 is configured to determine the sample information of the sample container according to a first recognition result of the barcode, if the barcode can be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device; and to recognize the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, if the barcode cannot be successfully recognized based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device, and determine the sample information of the sample container according to a second recognition result of the serial code.
这里,旋转装置102可以驱动样本容器绕竖直方向旋转,例如绕竖直方向旋转360度。图像获取装置103可以在样本容器绕竖直方向旋转的过程中,对样本容器进行拍照,以获取包含该样本容器外部的条形码和/或序列码的图像,即,对同一样本容器进行旋转扫描或旋转拍照;图像获取装置103为同一样本容器拍摄的不同图像中存在不同拍摄视角或不同拍摄角度的图像。图像获取装置103可以直接将样本容器的所有图像传输至控制器101,也可以将样本容器的所有图像传输至其他设备进行保存,控制器101可从其他设备获取该样本容器的图像。进一步地,图像获取装置103将拍摄的样本容器的图像保存至图像获取装置103或其他电子设备的设定存储路径中,控制器101从设定存储路径获取样本容器的图像并保存。实际 应用时,可通过为每个样本容器创建对应的文件夹,将样本容器的图像分别存储至对应的文件夹中,以实现不同样本容器的图像的区分。此外,图像获取装置103每次将拍摄到的一个样本容器的所有图像存入设定存储路径,在控制器101从设定存储路径获取到该样本容器的所有图像之后,控制器101可以清空设定存储路径下的所有图像,此后,图像获取装置103再将拍摄到的另一样本容器的所有图像存入设定存储路径,从而实现样本容器的逐一图像读取。Here, the rotating device 102 can drive the sample container to rotate in a vertical direction, for example, to rotate 360 degrees in a vertical direction. The image acquisition device 103 can take a picture of the sample container during the process of the sample container rotating in the vertical direction to obtain an image containing the barcode and/or serial code on the outside of the sample container, that is, to perform rotational scanning or rotational photography on the same sample container; different images taken by the image acquisition device 103 for the same sample container have images with different shooting perspectives or different shooting angles. The image acquisition device 103 can directly transmit all images of the sample container to the controller 101, or transmit all images of the sample container to other devices for storage, and the controller 101 can obtain the image of the sample container from other devices. Furthermore, the image acquisition device 103 saves the captured image of the sample container to a set storage path of the image acquisition device 103 or other electronic device, and the controller 101 obtains and saves the image of the sample container from the set storage path. Actual When applied, a corresponding folder can be created for each sample container, and the images of the sample containers can be stored in the corresponding folders respectively, so as to realize the distinction between the images of different sample containers. In addition, the image acquisition device 103 stores all the images of a sample container captured into the set storage path each time. After the controller 101 acquires all the images of the sample container from the set storage path, the controller 101 can clear all the images under the set storage path. Thereafter, the image acquisition device 103 stores all the images of another sample container captured into the set storage path, so as to realize the image reading of the sample container one by one.
实际应用时,样本容器可以理解为用于装载样本的透明或半透明的容器,可以是血液收集管、测试管、样本管、采样管、试管、瓶子、样本杯等。样本容器内装载的样本包括血液样本,血液样本可以是血清样本或血浆样本,血液样本中可以添加有用于检测的试剂。样本容器的表面粘贴或附着有标签,用于标记或记录样本容器内的样本的相关信息,标签上可以包括样本容器内样本的标识信息,例如条形码,或者由字母和/或数字组合成的序列码。序列码也可以理解为序列号,条形码也可称为条码,由一组黑白相间、粗细不同的条状符合组成。In practical applications, the sample container can be understood as a transparent or translucent container for loading samples, which can be a blood collection tube, a test tube, a sample tube, a sampling tube, a test tube, a bottle, a sample cup, etc. The sample loaded in the sample container includes a blood sample, and the blood sample can be a serum sample or a plasma sample, and a reagent for detection can be added to the blood sample. A label is pasted or attached to the surface of the sample container, which is used to mark or record relevant information of the sample in the sample container. The label may include identification information of the sample in the sample container, such as a barcode, or a serial code composed of letters and/or numbers. The serial code can also be understood as a serial number, and the barcode can also be called a barcode, which is composed of a group of black and white bars of different thicknesses.
实际应用时,图像获取装置103对样本容器进行拍照的时长,需要大于或等于样本容器旋转一周或360度所需要的时长,以保证在样本容器旋转一周的过程中,图像获取装置103能够从不同拍摄角度或拍摄视角获取样本容器的图像。考虑到图像获取装置103拍摄运动的物体时容易产生运动伪影,因此,在旋转拍照的场景下,为了保证图像获取装置103能够在样本容器旋转一周的过程中,获得该样本容器的不同拍摄角度的清晰的图像,进一步地,照相机的曝光时长和/或拍摄频率,与旋转机构的转速存在设定对应关系或映射关系。这里,旋转装置102的不同转速对应的曝光时长不同,和/或,旋转装置102的不同转速对应的拍摄频率不同。旋转装置102的转速可以根据样本容器上的标签的识别速度来确定;当然,旋转装置 102的转速也可以是设定转速。曝光时长也可以理解为曝光时间。为了保证图像获取装置103能够拍摄到清晰的图像,图像获取装置103的曝光时长小于或等于图像获取装置103的精度与旋转装置102的转速之商。图像获取装置103的精度也可以称为像素精度,像素精度等于照相机的单向视野范围与单向分辨率之商。实际应用时,拍摄频率可以用帧率替代;帧率可以理解为每秒拍摄的图像的帧数,例如,帧率为每秒20帧。In actual application, the duration of the image acquisition device 103 taking pictures of the sample container needs to be greater than or equal to the duration required for the sample container to rotate one circle or 360 degrees, so as to ensure that the image acquisition device 103 can acquire images of the sample container from different shooting angles or shooting perspectives during the sample container's rotation. Considering that the image acquisition device 103 is prone to motion artifacts when photographing a moving object, in the scenario of rotational photography, in order to ensure that the image acquisition device 103 can obtain clear images of the sample container at different shooting angles during the sample container's rotation, further, the exposure duration and/or shooting frequency of the camera have a set corresponding relationship or mapping relationship with the rotation speed of the rotating mechanism. Here, different rotation speeds of the rotating device 102 correspond to different exposure durations, and/or different rotation speeds of the rotating device 102 correspond to different shooting frequencies. The rotation speed of the rotating device 102 can be determined based on the recognition speed of the label on the sample container; of course, the rotation speed of the rotating device 102 can be determined based on the recognition speed of the label on the sample container; The rotation speed of 102 may also be a set rotation speed. The exposure duration may also be understood as the exposure time. In order to ensure that the image acquisition device 103 can capture a clear image, the exposure duration of the image acquisition device 103 is less than or equal to the quotient of the precision of the image acquisition device 103 and the rotation speed of the rotating device 102. The precision of the image acquisition device 103 may also be referred to as pixel precision, which is equal to the quotient of the one-way field of view of the camera and the one-way resolution. In practical applications, the shooting frequency may be replaced by the frame rate; the frame rate may be understood as the number of frames of the image captured per second, for example, the frame rate is 20 frames per second.
图像获取装置103可以具备条形码识别功能,也可以不具备条形码识别功能。在一实施例中,当图像获取装置103具备条形码识别功能时,可以由图像获取装置103识别条形码,图像获取装置103还用于基于至少一张包含同一样本容器外部的条形码对条形码进行识别,并在成功识别出条形码的情况下,向控制器101发送条形码识别结果,或者条形码的第一识别结果;控制器101在接收图像获取装置103发送的条形码识别结果的情况下,在接收到的条形码识别结果中确定出该样本容器外部的条形码的第一识别结果。例如,如果图像获取装置103基于至少一张包含同一样本容器外部的条形码仅获取到一个条码识别结果,那么控制器101将仅接收到的一个条码识别结果确定为该样本容器的条形码的第一识别结果。在一实施例中,至少一张包含样本容器外部的条形码的图像包括多张图像;在图像获取装置103基于同一样本容器的多张图像获取到至少两个不同的条形码识别结果的情况下:控制器101还用于基于同一样本容器对应的条形码识别结果的出现次数,从图像获取装置103发送的同一样本容器的至少两个不同的条形码识别结果中,确定出该样本容器的条形码的第一识别结果;或者,图像获取装置103还用于基于对应的条形码识别结果的出现次数,从同一样本容器的至少两个不同的条形码识别结果中确定出第一识别结果,并将第一识别结果发送至控制器101。例如,控制器101或图像获取装置103将同一样本容器对应的至少两个相同的条形码识别结果,确定为该 样本容器的条形码的第一识别结果。再例如,控制器101或图像获取装置103将同一样本容器对应的出现次数最多的条形码识别结果,确定为该样本容器的条形码的第一识别结果。The image acquisition device 103 may or may not have a barcode recognition function. In one embodiment, when the image acquisition device 103 has a barcode recognition function, the image acquisition device 103 may recognize a barcode, and the image acquisition device 103 is also used to recognize the barcode based on at least one barcode containing the outside of the same sample container, and when the barcode is successfully recognized, send the barcode recognition result, or the first recognition result of the barcode to the controller 101; when receiving the barcode recognition result sent by the image acquisition device 103, the controller 101 determines the first recognition result of the barcode on the outside of the sample container from the received barcode recognition result. For example, if the image acquisition device 103 only obtains one barcode recognition result based on at least one barcode containing the outside of the same sample container, the controller 101 determines the only received barcode recognition result as the first recognition result of the barcode of the sample container. In one embodiment, at least one image including a barcode on the outside of the sample container includes multiple images; when the image acquisition device 103 acquires at least two different barcode recognition results based on the multiple images of the same sample container: the controller 101 is further used to determine a first recognition result of the barcode of the sample container from the at least two different barcode recognition results of the same sample container sent by the image acquisition device 103 based on the number of occurrences of the barcode recognition results corresponding to the same sample container; or, the image acquisition device 103 is further used to determine a first recognition result from the at least two different barcode recognition results of the same sample container based on the number of occurrences of the corresponding barcode recognition results, and send the first recognition result to the controller 101. For example, the controller 101 or the image acquisition device 103 determines the at least two identical barcode recognition results corresponding to the same sample container as the first recognition result. The first recognition result of the barcode of the sample container. For another example, the controller 101 or the image acquisition device 103 determines the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container.
当图像获取装置103不具备条形码识别功能,或者控制器101未接收到图像获取装置103发送的样本容器对应的条形码识别结果和第一识别结果时,可以由控制器101识别条形码。具体地,控制器101在获取到同一样本容器的至少一张包含样本容器外部的条形码的图像的情况下,基于该样本容器的至少一张包含样本容器外部的条形码的图像对条形码进行识别,得到至少一个条形码识别结果,并在至少一个条形码识别结果中确定出条形码的第一识别结果。在一实施例中,控制器101用于基于所述至少一张包含样本容器外部的条形码的图像中全部或部分图像的图像特征对条形码进行识别;或,控制器101用于通过第二设定神经网络对所述至少一张包含样本容器外部的条形码的图像中全部或部分图像进行处理,以对条形码进行识别;其中,第二设定神经网络用于识别输入图像中的条形码。这里,控制器101可以通过设定的条码识别算法或第二设定神经网络,在同一样本容器的至少一张包含样本容器外部的条形码的图像中全部或部分图像中提取至少一类图像特征;根据提取的图像特征识别出条码区域并对条码区域中的条形码进行识别,得到至少一个条形码识别结果;并在确定出的条形码识别结果中确定出条形码的第一识别结果。例如,将同一个样本容器的至少两张连续的图像对应的相同的条形码识别结果,确定为该样本容器的条形码的第一识别结果;再例如,将同一样本容器对应的出现次数最多的条形码识别结果,确定为该样本容器的条形码的第一识别结果。第二设定神经网络基于样本容器的图像样本训练得到,至少部分图像样本中包含样本容器外部的条形码。至少一类图像特征包括以下至少之一:边缘特征、灰度分布特征、颜色特征、纹理特征、形状特征和空间关系特征。 边缘特征用于表征图像的像素灰度、像素亮度或像素颜色存在阶跃变化(斜坡型边缘)或屋顶状变化(屋顶型边缘);灰度分布特征表征图像的灰度值的分布情况。颜色特征和纹理特征均是全局特征,描述了样本容器外部的条码区域的表面性质。形状特征包括轮廓特征,主要描述标签和/或样本容器的轮廓或边界。空间关系特征,是指图像中分割出来的多个目标之间的相互的空间位置或相对方向关系,这些关系可以分为连接关系或邻接关系、交叠关系或重叠关系、包含关系或独立关系等。When the image acquisition device 103 does not have a barcode recognition function, or the controller 101 does not receive the barcode recognition result and the first recognition result corresponding to the sample container sent by the image acquisition device 103, the controller 101 can recognize the barcode. Specifically, when the controller 101 acquires at least one image of the same sample container containing the barcode on the outside of the sample container, the controller 101 recognizes the barcode based on at least one image of the sample container containing the barcode on the outside of the sample container, obtains at least one barcode recognition result, and determines the first recognition result of the barcode in the at least one barcode recognition result. In one embodiment, the controller 101 is used to recognize the barcode based on the image features of all or part of the at least one image containing the barcode on the outside of the sample container; or, the controller 101 is used to process all or part of the at least one image containing the barcode on the outside of the sample container through a second set neural network to recognize the barcode; wherein the second set neural network is used to recognize the barcode in the input image. Here, the controller 101 can extract at least one type of image features from all or part of the images of at least one image of the same sample container containing the barcode outside the sample container through a set barcode recognition algorithm or a second set neural network; identify the barcode area according to the extracted image features and identify the barcode in the barcode area to obtain at least one barcode recognition result; and determine the first recognition result of the barcode in the determined barcode recognition results. For example, the same barcode recognition results corresponding to at least two consecutive images of the same sample container are determined as the first recognition result of the barcode of the sample container; for another example, the barcode recognition result with the most occurrences corresponding to the same sample container is determined as the first recognition result of the barcode of the sample container. The second set neural network is trained based on the image samples of the sample container, and at least part of the image samples contain the barcode outside the sample container. The at least one type of image features includes at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features, and spatial relationship features. Edge features are used to characterize the presence of step changes (slope-type edges) or roof-like changes (roof-type edges) in the grayscale, brightness or color of pixels in an image; grayscale distribution features characterize the distribution of grayscale values in an image. Color features and texture features are global features that describe the surface properties of the barcode area outside the sample container. Shape features include contour features, which mainly describe the contour or boundary of the label and/or sample container. Spatial relationship features refer to the spatial position or relative direction relationship between multiple targets segmented from an image. These relationships can be divided into connection relationships or adjacency relationships, overlapping relationships or overlapping relationships, inclusion relationships or independent relationships, etc.
实际应用时,如果控制器101基于至少一张包含同一样本容器外部的条形码的图像仅获取到一个条形码识别结果,那么将仅有这个条形码识别结果,确定为该样本容器的条形码的第一识别结果;如果至少一张包含同一样本容器外部的条形码的图像包括多张图像,且控制器101基于同一个样本容器的多张图像获取到至少两个条形码识别结果,那么将同一个样本容器的至少两张连续的图像对应的相同的条形码识别结果,确定为该样本容器的条形码的第一识别结果,或者,将同一样本容器对应的出现次数最多的条形码识别结果,确定为该样本容器的条形码的第一识别结果。In actual application, if the controller 101 only obtains one barcode recognition result based on at least one image containing the barcode on the outside of the same sample container, then only this barcode recognition result will be determined as the first recognition result of the barcode of the sample container; if at least one image containing the barcode on the outside of the same sample container includes multiple images, and the controller 101 obtains at least two barcode recognition results based on the multiple images of the same sample container, then the same barcode recognition results corresponding to at least two consecutive images of the same sample container will be determined as the first recognition result of the barcode of the sample container, or the barcode recognition result with the largest number of occurrences corresponding to the same sample container will be determined as the first recognition result of the barcode of the sample container.
需要说明的是,在图像获取装置103成功识别出样本容器外部的条形码,和/或,控制器101成功识别出样本容器外部的条形码的情况下,控制器101可以确定出样本容器外部的条形码的第一识别结果,根据条形码的第一识别结果确定该样本容器的样本信息,例如,根据条形码的编码规则或赋码规则对第一识别结果进行解析或解码,得到样本容器的样本信息,还可以获取与样本信息(比如标识信息)绑定的样本检测项目。It should be noted that, when the image acquisition device 103 successfully identifies the barcode on the outside of the sample container, and/or the controller 101 successfully identifies the barcode on the outside of the sample container, the controller 101 can determine a first recognition result of the barcode on the outside of the sample container, and determine the sample information of the sample container based on the first recognition result of the barcode. For example, the first recognition result can be parsed or decoded according to the encoding rules or coding rules of the barcode to obtain the sample information of the sample container, and the sample detection items bound to the sample information (such as identification information) can also be obtained.
在图像获取装置103未成功识别出样本容器外部的条形码,且控制器101也未成功识别出样本容器外部的条形码的情况下,控制器101基于至少一张包含同一样本容器外部的序列码的图像对序列码进行识别,并根据序列码的第二识别结果确定该样本容器的样本信息;例如根据序列码的编码 规则对序列码的第一识别结果进行解析或解码,得到样本容器的样本信息,还可以获取与样本信息(比如标识信息)绑定的样本检测项目。当然,当序列码不涉及编码规则时,可以将序列码的第二识别结果作为样本容器的样本信息。实际应用时,如果控制器101基于至少一张包含同一样本容器外部的序列码的仅获取到一个序列码识别结果,那么将仅有的这个序列码识别结果,确定为该样本容器的序列码的第二识别结果;如果至少一张包含同一样本容器外部的序列码的图像包括多张图像,且控制器101基于同一个样本容器的多张图像获取到至少两个序列码识别结果,那么控制器101可以将同一个样本容器的至少两张连续的图像对应的相同的序列码识别结果,确定为该样本容器的序列码的第二识别结果,或者,将同一样本容器对应的出现次数最多的序列码识别结果,确定为该样本容器的序列码的第二识别结果。In the case that the image acquisition device 103 fails to successfully identify the barcode on the outside of the sample container, and the controller 101 also fails to successfully identify the barcode on the outside of the sample container, the controller 101 identifies the serial code based on at least one image containing the serial code on the outside of the same sample container, and determines the sample information of the sample container according to the second recognition result of the serial code; for example, according to the encoding of the serial code The rule parses or decodes the first recognition result of the sequence code to obtain the sample information of the sample container, and can also obtain the sample detection item bound to the sample information (such as identification information). Of course, when the sequence code does not involve the coding rule, the second recognition result of the sequence code can be used as the sample information of the sample container. In actual application, if the controller 101 obtains only one sequence code recognition result based on at least one sequence code containing the outside of the same sample container, then the only sequence code recognition result is determined as the second recognition result of the sequence code of the sample container; if at least one image containing the sequence code of the outside of the same sample container includes multiple images, and the controller 101 obtains at least two sequence code recognition results based on multiple images of the same sample container, then the controller 101 can determine the same sequence code recognition result corresponding to at least two consecutive images of the same sample container as the second recognition result of the sequence code of the sample container, or, the sequence code recognition result corresponding to the same sample container with the most occurrences is determined as the second recognition result of the sequence code of the sample container.
为了提高识别样本信息的成功率,在一实施例中,控制器101可通过以下方式获得序列码的第二识别结果:In order to improve the success rate of identifying sample information, in one embodiment, the controller 101 can obtain the second identification result of the sequence code in the following manner:
基于至少一张包含所述样本容器外部的序列码的图像中全部或部分图像的图像特征对样本容器外部的序列码进行识别,得到序列码的第二识别结果;或,Recognize the serial code on the outside of the sample container based on the image features of all or part of at least one image containing the serial code on the outside of the sample container to obtain a second recognition result of the serial code; or,
通过第一设定神经网络对至少一张包含所述样本容器外部的序列码的图像中全部或部分图像进行处理,得到序列码第二识别结果;其中,第一设定神经网络用于识别输入图像中的序列码。The first set neural network is used to process all or part of at least one image containing the serial code on the outside of the sample container to obtain a second recognition result of the serial code; wherein the first set neural network is used to recognize the serial code in the input image.
这里,控制器101可以使用设定的序列码识别算法或序列号识别算法,例如光学字符识别(OCR,Optical Character Recognition)算法,提取至少一张包含同一样本容器外部的序列码的图像中全部或部分图像的图像特征,并根据提取的图像特征对样本容器外部的序列码进行识别,得到序列码的第二识别结果。具体地,可以根据提取的图像特征先识别出序列码区 域,再识别出序列码区域中的序列码;提取的图像特征包括以下至少一种:边缘特征、灰度分布特征、颜色特征、纹理特征、形状特征和空间关系特征。Here, the controller 101 may use a set serial code recognition algorithm or a serial number recognition algorithm, such as an optical character recognition (OCR) algorithm, to extract image features of all or part of at least one image containing the serial code on the outside of the same sample container, and recognize the serial code on the outside of the sample container based on the extracted image features to obtain a second recognition result of the serial code. Specifically, the serial code region may be first recognized based on the extracted image features. domain, and then identify the sequence code in the sequence code area; the extracted image features include at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features and spatial relationship features.
当使用算法得到的第二识别结果与第一设定神经网络输出的第二识别结果相同时,表征第二识别结果正确,例如图2和图3中通过不同方式识别出的序列码相同;当使用算法得到的第二识别结果与第一设定神经网络输出的第二识别结果不同时,控制器101发出报警提示,以便相关人员复核或做进一步处理。第一设定神经网络基于样本容器的图像样本训练得到,至少部分图像样本中包含样本容器外部的序列码。第一设定神经网络至少提取输入的图像中用于构成序列码的数字和/或字符的特征信息,基于提取的特征信息,确定出输入的图像中的序列码。When the second recognition result obtained using the algorithm is the same as the second recognition result output by the first setting neural network, it indicates that the second recognition result is correct, for example, the serial codes identified by different methods in Figures 2 and 3 are the same; when the second recognition result obtained using the algorithm is different from the second recognition result output by the first setting neural network, the controller 101 issues an alarm prompt so that relevant personnel can review or make further processing. The first setting neural network is trained based on image samples of the sample container, and at least part of the image samples contain the serial code outside the sample container. The first setting neural network at least extracts the feature information of the numbers and/or characters used to constitute the serial code in the input image, and determines the serial code in the input image based on the extracted feature information.
为了进一步提高识别样本信息的成功率和准确度,控制器101在识别样本容器外的条形码和/或序列码之前,还可以在同一样本容器的多张图像中,筛选出用于确定样本信息的至少一张包含样本容器外部的条形码和/或序列码的图像。基于此,在一实施例中,控制器101还用于:In order to further improve the success rate and accuracy of identifying sample information, the controller 101 may also select at least one image containing the barcode and/or serial code on the outside of the sample container from multiple images of the same sample container for determining the sample information before identifying the barcode and/or serial code on the outside of the sample container. Based on this, in one embodiment, the controller 101 is further configured to:
从图像获取装置103获取的多张图像中确定出用于确定所述样本容器的样本信息的所述至少一张包含样本容器外部的条形码的图像,和/或,所述至少一张包含样本容器外部的序列码的图像;其中,所述至少一张图像的第一参数值大于设定阈值;所述第一参数值表征第一面积与第二面积的比值;所述第一面积表征条形码和/或序列码在所述至少一张图像中占据的面积;所述第二面积表征所述样本容器在所述至少一张图像中占据的面积。Determine from the multiple images acquired by the image acquisition device 103, at least one image containing a barcode on the outside of the sample container, and/or at least one image containing a serial code on the outside of the sample container, which are used to determine the sample information of the sample container; wherein a first parameter value of the at least one image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
这里,控制器101可以确定出同一样本容器的多张图像中的每张图像的第一参数值,第一参数值表征第一面积与第二面积的比值;在该样本容器的多张图像中,确定出第一参数值大于设定阈值的图像,得到至少一张包含该样本容器外部的序列码和/或序列码的图像。其中,在需要识别条形 码时,第一面积表征条形码在图像中占据的面积,以获得至少一张包含样本容器外部的序列码的图像;在需要识别序列码时,第一面积表征序列码在图像中占据的面积,以获得至少一张包含样本容器外部的序列码的图像。在需要识别条形码和序列码时,第一面积表征条形码和序列码在图像中占据的面积,以获得至少一张包含样本容器外部的条形码和序列码的图像。Here, the controller 101 can determine the first parameter value of each image in the multiple images of the same sample container, where the first parameter value represents the ratio of the first area to the second area; among the multiple images of the sample container, determine the image whose first parameter value is greater than the set threshold, and obtain at least one image containing the serial code and/or the serial code on the outside of the sample container. When the barcode is to be identified, the first area represents the area occupied by the barcode in the image to obtain at least one image including the serial code on the outside of the sample container; when the serial code needs to be identified, the first area represents the area occupied by the serial code in the image to obtain at least one image including the serial code on the outside of the sample container. When the barcode and the serial code need to be identified, the first area represents the area occupied by the barcode and the serial code in the image to obtain at least one image including the barcode and the serial code on the outside of the sample container.
例如,图4和图5分别给出了旋转拍摄获得的图像示例,识别条形码前,确定出的包含样本容器外部的条形码的图像可以是图4中的图(a),也可以是图5中的图(c)和/或图(d);识别序列码前,确定出的包含样本容器外部的序列码的图像可以是图5中的图(d)。For example, Figures 4 and 5 respectively give examples of images obtained by rotational photography. Before recognizing the barcode, the image determined to contain the barcode on the outside of the sample container may be Figure (a) in Figure 4, or Figure (c) and/or Figure (d) in Figure 5; before recognizing the serial code, the image determined to contain the serial code on the outside of the sample container may be Figure (d) in Figure 5.
在一实施例中,样本识别系统还包括:人机交互装置;控制器101还用于:在未成功识别出所述序列码的情况下,控制所述人机交互装置在其显示界面上输出报警提示信息;所述报警提示信息表征所述样本容器的样本信息识别失败。In one embodiment, the sample identification system further includes: a human-computer interaction device; the controller 101 is also used to: control the human-computer interaction device to output an alarm prompt message on its display interface when the serial code is not successfully identified; the alarm prompt message indicates that the sample information identification of the sample container has failed.
这里,可能因拍摄的图像中的序列码可能不全或不清晰,控制器101无法成功识出别序列码,此时,控制器101控制人机交互装置在人机交互装置的显示界面上输出报警提示信息,以提示相关人员做进一步处理,例如,人工录入序列号和/或样本信息。Here, the controller 101 may not be able to successfully identify the serial code because the serial code in the captured image may be incomplete or unclear. At this time, the controller 101 controls the human-computer interaction device to output an alarm prompt message on the display interface of the human-computer interaction device to prompt relevant personnel to perform further processing, for example, manually enter the serial number and/or sample information.
考虑到有的条形码贴得比较规整或者条形码面向图像获取装置103的摄像头,可能不需要对样本容器进行旋转扫码也能成功识别条形码,因此,为了尽可能缩短识别条形码所消耗的总时长以及节省数据处理资源,可以先在样本容器处于静止状态时识别样本容器外的条形码,即先进行常规扫码,如果在样本容器处于静止状态时无法识别条形码,再对样本容器进行旋转拍摄或旋转扫码。基于此,在一实施例中,图像获取装置103在对样本容器进行旋转拍摄之前,还用于:Considering that some barcodes are posted in a relatively regular manner or face the camera of the image acquisition device 103, it may not be necessary to rotate the sample container to scan the barcode in order to successfully identify the barcode. Therefore, in order to shorten the total time consumed for identifying the barcode and save data processing resources, the barcode outside the sample container can be identified when the sample container is in a stationary state, that is, a conventional scan is performed first. If the barcode cannot be identified when the sample container is in a stationary state, the sample container is then rotated to shoot or rotated to scan. Based on this, in one embodiment, before rotating and shooting the sample container, the image acquisition device 103 is also used to:
在样本容器静止时拍摄一张图像,并基于所述一张图像对所述条形码 进行识别,在未能成功识别出所述条形码的情况下,在旋转装置102驱动所述样本容器旋转时至少获取所述包含所述样本容器外部的条形码和/或序列码的图像。An image is taken when the sample container is stationary, and the barcode is calibrated based on the image. The sample container is identified by the rotating device 102. If the barcode cannot be identified successfully, at least the image of the barcode and/or the serial code on the outside of the sample container is acquired when the rotating device 102 drives the sample container to rotate.
这里,图像获取装置103基于同一个样本容器静止时拍摄的一张图像识别条形码;图像获取装置103基于该图像对样本容器外部的条形码进行识别,在未成功识别出样本容器外的条形码的情况下,可以通知控制器101控制旋转装置102运行,以驱动样本容器绕竖直方向旋转;图像获取装置103在旋转装置102驱动样本容器旋转时至少获取包含该样本容器外部的条形码和/或序列码的图像,以使图像获取装置103和/或控制器101基于包含该样本容器的外部的条形码和/或序列码的图像识别该样本容器外部的条形码。Here, the image acquisition device 103 recognizes the barcode based on an image taken when the same sample container is stationary; the image acquisition device 103 recognizes the barcode on the outside of the sample container based on the image, and when the barcode on the outside of the sample container is not successfully recognized, the controller 101 can be notified to control the operation of the rotating device 102 to drive the sample container to rotate in a vertical direction; the image acquisition device 103 at least acquires an image containing the barcode and/or serial code on the outside of the sample container when the rotating device 102 drives the sample container to rotate, so that the image acquisition device 103 and/or the controller 101 recognize the barcode on the outside of the sample container based on the image containing the barcode and/or serial code on the outside of the sample container.
图6给出了在样本容器静止时拍摄的一张图像的示例。由于图6中的图(a)可展示出完整的条形码,而图6中的图(b)未展示出条形码,因此,可基于图6中的图(a)成功识别出样本容器外的条形码,基于图6中的图(b)无法成功识别出样本容器外的条形码。FIG6 shows an example of an image taken when the sample container is stationary. Since FIG6 (a) can show the complete barcode, and FIG6 (b) does not show the barcode, the barcode outside the sample container can be successfully recognized based on FIG6 (a), and the barcode outside the sample container cannot be successfully recognized based on FIG6 (b).
图7给出了对样本容器进行旋转拍摄的示例。由于图像中条码显示不全时无法成功识别出条形码,因此,基于图7中的图(a)和(b)均无法成功识别出样本容器外的条形码,基于图7中的图(c)和/或图(d)可成功识别出样本容器外的条形码。FIG7 shows an example of rotating and photographing a sample container. Since the barcode cannot be successfully recognized when the barcode is not fully displayed in the image, the barcode outside the sample container cannot be successfully recognized based on images (a) and (b) in FIG7 , but the barcode outside the sample container can be successfully recognized based on images (c) and/or (d) in FIG7 .
在对底座承载的样本容器进行旋转拍摄或旋转扫描的场景下,在一实施例中,旋转装置102包括:用于竖直放置样本容器的底座,以及驱动所述底座绕竖直方向旋转的旋转机构。In the scenario of performing rotational photography or rotational scanning on the sample container carried by the base, in one embodiment, the rotating device 102 includes: a base for vertically placing the sample container, and a rotating mechanism for driving the base to rotate around the vertical direction.
这里,如图4所示,旋转机构与用于竖直放置样本容器的底座连接,底座也称样本座,旋转机构驱动底座旋转,以驱动竖直放置在底座上的样本容器绕竖直方向旋转,例如绕竖直方向旋转360度。图像获取装置103 可以在样本容器静止时拍摄一张图像,和/或,在旋转装置102驱动样本容器旋转过程中至少获取包含样本容器外部的条形码和/或序列码的图像。Here, as shown in FIG. 4 , the rotating mechanism is connected to a base for vertically placing a sample container, the base also being called a sample holder, and the rotating mechanism drives the base to rotate, so as to drive the sample container vertically placed on the base to rotate around the vertical direction, for example, to rotate 360 degrees around the vertical direction. Image acquisition device 103 An image may be taken when the sample container is stationary, and/or at least an image including a barcode and/or a serial code on the outside of the sample container may be acquired while the rotating device 102 drives the sample container to rotate.
其中,用于竖直放置样本容器的底座,可以夹持样本容器的底部,且夹持样本容器的部位未遮挡条形码和/或序列码;该底座可以是单管底座,也可以是多管底座;一个多管底座可以放置多个样本容器,例如放置5个或10个样本容器。Among them, the base used to vertically place the sample container can clamp the bottom of the sample container, and the part that clamps the sample container does not block the barcode and/or serial code; the base can be a single-tube base or a multi-tube base; a multi-tube base can hold multiple sample containers, for example, 5 or 10 sample containers.
在对机械手抓取的样本容器进行旋转拍摄或旋转扫描的场景下,在一实施例中,旋转装置102包括:用于夹取样本容器的机械手,以及驱动所述机械手绕竖直方向旋转的旋转机构。In the scenario of performing rotational photography or rotational scanning on a sample container grasped by a manipulator, in one embodiment, the rotating device 102 includes: a manipulator for grasping the sample container, and a rotating mechanism for driving the manipulator to rotate around a vertical direction.
这里,旋转机构与机械手连接;机械手可以用于夹持样本容器的顶部或其他部位,且夹持样本容器的部位未遮挡条形码和/或序列码。旋转机构可以驱动机械手绕竖直方向旋转,以带动机械手夹取的样本容器绕竖直方向旋转。图像获取装置103可以在样本容器静止时拍摄一张图像,和/或,在旋转装置102驱动样本容器旋转过程中至少获取包含样本容器外部的条形码和/或序列码的图像。Here, the rotating mechanism is connected to the manipulator; the manipulator can be used to clamp the top or other parts of the sample container, and the part of the sample container clamped does not block the barcode and/or serial code. The rotating mechanism can drive the manipulator to rotate around the vertical direction to drive the sample container clamped by the manipulator to rotate around the vertical direction. The image acquisition device 103 can take an image when the sample container is stationary, and/or, at least acquire an image containing the barcode and/or serial code on the outside of the sample container during the process of the rotating device 102 driving the sample container to rotate.
实际应用时,如图5所示,旋转装置102可以通过机械手夹持样本容器顶部,将样本容器提起一定高度,并通过旋转机构驱动机械手绕竖直方向旋转,以带动机械手夹持的样本容器绕竖直方向旋转,以使图像获取装置103能够对样本容器进行旋转拍摄。In actual application, as shown in FIG5 , the rotating device 102 can clamp the top of the sample container through a manipulator, lift the sample container to a certain height, and drive the manipulator to rotate in a vertical direction through a rotating mechanism, so as to drive the sample container clamped by the manipulator to rotate in a vertical direction, so that the image acquisition device 103 can rotate and photograph the sample container.
在对样本管中放置的样本架进行旋转拍摄或旋转扫描的场景下,在一实施例中,旋转装置102包括:样本容器承载机构,以及驱动样本容器在所述样本容器承载机构中绕竖直方向旋转的旋转机构。In the scenario of performing rotational photography or rotational scanning on a sample rack placed in a sample tube, in one embodiment, the rotating device 102 includes: a sample container carrying mechanism, and a rotating mechanism for driving the sample container to rotate around a vertical direction in the sample container carrying mechanism.
这里,样本容器可以在样本容器承载机构中,绕样本容器的竖直方向旋转,且样本容器承载机构用于承载或固定样本容器的部位,未遮挡样本容器外的条形码和/或序列码。样本容器承载机构包括样本架,一个样本架 可承载多个样本容器,例如5个或10个。Here, the sample container can be rotated in the sample container carrying mechanism around the vertical direction of the sample container, and the sample container carrying mechanism is used to carry or fix the sample container, and the barcode and/or serial code outside the sample container is not blocked. Can hold multiple sample containers, for example 5 or 10.
需要说明的是,旋转装置102还可以包括旋转压头,旋转机构可驱动旋转压头旋转;在旋转机构驱动旋转压头旋转时,旋转压头用于向样本容器的端部施压,以驱动样本容器在样本容器承载机构中旋转。其中,旋转机构与旋转压头连接。It should be noted that the rotating device 102 may also include a rotating head, and the rotating mechanism may drive the rotating head to rotate; when the rotating mechanism drives the rotating head to rotate, the rotating head is used to apply pressure to the end of the sample container to drive the sample container to rotate in the sample container carrying mechanism. The rotating mechanism is connected to the rotating head.
在一实施例中,图像获取装置103还包括:In one embodiment, the image acquisition device 103 further includes:
光源,用于为所述照相机提供拍摄光源。A light source is used to provide a shooting light source for the camera.
这里,光源可以提升拍摄环境的亮度,从而提升图像获取装置103拍摄的图像的亮度,以获得清晰的图像。Here, the light source can improve the brightness of the shooting environment, thereby improving the brightness of the image captured by the image acquisition device 103 to obtain a clear image.
基于上文实施例,图像获取装置103在旋转扫描或选择拍摄的场景下,拍摄包含同一样本容器外部的条形码和/或序列码的图像,图像获取装置103和/或控制器101根据至少一张包含同一样本容器外部的条形码的图像对条形码进行识别,如果未成功识别出条形码,那么控制器101根据至少一张包含同一样本容器外部的序列码的图像对序列码进行识别,获得序列码的第二识别结果,并根据第二识别结果确定样本容器的样本信息。这样,即使未成功识别条形码,也可以通过识别序列码来获得样本信息,相比于相关技术中仅通过扫描条形码来获得样本信息的方案,上述方案可以提高识别样本信息的成功率。Based on the above embodiment, the image acquisition device 103 captures an image containing a barcode and/or a serial code on the outside of the same sample container in a rotation scanning or selective shooting scenario, and the image acquisition device 103 and/or the controller 101 recognizes the barcode based on at least one image containing a barcode on the outside of the same sample container. If the barcode is not successfully recognized, the controller 101 recognizes the serial code based on at least one image containing a serial code on the outside of the same sample container, obtains a second recognition result of the serial code, and determines the sample information of the sample container based on the second recognition result. In this way, even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the serial code. Compared with the solution in the related art that obtains the sample information only by scanning the barcode, the above solution can improve the success rate of identifying the sample information.
请继续参照图1,本申请实施例还提供了另一种样本识别系统,与上文实施例提供的样本识别系统的不同之处在于:Continuing to refer to FIG. 1 , the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
控制器101,用于根据图像获取装置103获取的至少一张包含样本容器外部的条形码的图像对所述条形码进行识别,根据图像获取装置103获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,以及根据所述条形码的第一识别结果和所述序列码的第二识别结果确定所述样本容器的样本信息。 The controller 101 is used to identify the barcode based on at least one image containing the barcode on the outside of the sample container acquired by the image acquisition device 103, identify the serial code based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device 103, and determine the sample information of the sample container based on a first recognition result of the barcode and a second recognition result of the serial code.
这里,图像获取装置103在旋转装置102驱动样本容器旋转时获取包含该样本容器外部的条形码和/或序列码的图像;控制器101获取图像获取装置103获取的包含同一样本容器外部的条形码和/或序列码的图像,基于至少一张包含该样本容器外部的条形码的图像对条形码,获得条形码的第一识别结果;根据至少一张包含该样本容器外部的序列码的图像对序列码进行识别,得到序列码的第二识别结果;基于条形码的第一识别结果和序列码的第二识别结果确定该样本容器的样本信息。当然,控制器101也可以根据至少一张包含同一样本容器的外部的条形码和序列码的图像对条形码和序列码进行识别,得到条形码的第一识别结果和序列码的第二识别结果。控制器101对样本容器外部的条形码和序列码进行识别,获得第一识别结果和第二识别结果的实现方式,请参照上文的相关描述,此处不赘述。Here, the image acquisition device 103 acquires an image containing a barcode and/or a serial code on the outside of the sample container when the rotating device 102 drives the sample container to rotate; the controller 101 acquires an image containing a barcode and/or a serial code on the outside of the same sample container acquired by the image acquisition device 103, and obtains a first recognition result of the barcode based on at least one image containing a barcode on the outside of the sample container; the serial code is recognized based on at least one image containing a serial code on the outside of the sample container to obtain a second recognition result of the serial code; the sample information of the sample container is determined based on the first recognition result of the barcode and the second recognition result of the serial code. Of course, the controller 101 can also recognize the barcode and the serial code based on at least one image containing a barcode and a serial code on the outside of the same sample container to obtain a first recognition result of the barcode and a second recognition result of the serial code. For the implementation method of the controller 101 recognizing the barcode and the serial code on the outside of the sample container to obtain the first recognition result and the second recognition result, please refer to the relevant description above, which will not be repeated here.
在一实施例中,控制器101基于所述条形码的第一识别结果和所述序列码的第二识别结果确定所述样本容器的样本信息,包括:In one embodiment, the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code, including:
在所述第一识别结果和所述第二识别结果相同的情况下,基于所述第一识别结果或所述第二识别结果确定出所述样本容器的样本信息。When the first recognition result and the second recognition result are the same, the sample information of the sample container is determined based on the first recognition result or the second recognition result.
这里,控制器101在获得条形码的第一识别结果和序列码的第二识别结果的情况下,判断第一识别结果与第二识别结果是否相同,以对第一识别结果和第二识别结果进行验证;在第一识别结果与第二识别结果相同的情况下,表征扫码成功,控制器101根据第一识别结果或第二识别结果确定出样本容器的样本信息。Here, when the controller 101 obtains the first recognition result of the barcode and the second recognition result of the serial code, it determines whether the first recognition result is the same as the second recognition result to verify the first recognition result and the second recognition result; when the first recognition result is the same as the second recognition result, it indicates that the code scanning is successful, and the controller 101 determines the sample information of the sample container based on the first recognition result or the second recognition result.
需要说明的是,在第一识别结果和第二识别结果不同的情况下,表征扫码异常,控制器101可以将样本容器转移至扫码异常区,还可以控制样本识别系统中的人机交互装置在人机交互装置显示界面上输出报警提示信息或输出表征扫码异常的提示信息,以提示相关人员做进一步处理,例如,人工录入序列号和/或样本信息;报警提示信息表征样本容器的样本信息识 别失败。It should be noted that, when the first recognition result and the second recognition result are different, indicating that the code scanning is abnormal, the controller 101 can transfer the sample container to the code scanning abnormality area, and can also control the human-computer interaction device in the sample identification system to output an alarm prompt message on the display interface of the human-computer interaction device or output a prompt message indicating the code scanning abnormality, so as to prompt relevant personnel to make further processing, for example, manually enter the serial number and/or sample information; the alarm prompt message indicates that the sample information recognition of the sample container is abnormal. Don't fail.
实际应用时,相关人员在上样之前会在电脑上下单,输入要测试的样本的条形码,服务器可以获取到控制器根据第一识别结果或第二识别结果确定的样本信息,并建立条形码与样本信息、样本检测结果之间的对应关系。一个条形码对应绑定一个样本信息和样本检测结果。In actual application, relevant personnel will place an order on the computer before loading the sample and enter the barcode of the sample to be tested. The server can obtain the sample information determined by the controller based on the first recognition result or the second recognition result, and establish a correspondence between the barcode and the sample information and the sample test result. One barcode is bound to one sample information and one sample test result.
基于上文实施例,在旋转扫描或选择拍摄的场景下,控制器101根据至少一张包含同一样本容器外部的条形码的图像识别条形码,根据至少一张包含同一样本容器外部的序列码的图像识别序列码,并根据条形码的第一识别结果和序列码的第二识别结果确定样本容器的样本信息;由此,即使未成功识别条形码,也可以通过识别序列码来获得样本信息,提高了识别样本信息的成功率;另外,图像获取装置103不需要识别条形码,可以节省图像获取装置103的数据处理资源,降低了图像获取装置的数据处理能力的要求。Based on the above embodiments, in the scenario of rotational scanning or selective shooting, the controller 101 recognizes the barcode based on at least one image containing the barcode on the outside of the same sample container, recognizes the serial code based on at least one image containing the serial code on the outside of the same sample container, and determines the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code; thereby, even if the barcode is not successfully recognized, the sample information can be obtained by recognizing the serial code, thereby improving the success rate of identifying the sample information; in addition, the image acquisition device 103 does not need to recognize the barcode, which can save data processing resources of the image acquisition device 103 and reduce the requirements for the data processing capability of the image acquisition device.
请继续参照图1,本申请实施例还提供了另一种样本识别系统,与上文实施例提供的样本识别系统的不同之处在于:Continuing to refer to FIG. 1 , the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
图像获取装置103,用于在旋转装置102驱动所述样本容器旋转时,获取所述样本容器的图像;An image acquisition device 103, used to acquire an image of the sample container when the rotating device 102 drives the sample container to rotate;
控制器101,用于控制所述旋转装置运行,并在所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,控制所述旋转装置停止运行;The controller 101 is used to control the rotation device to operate, and when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, control the rotation device to stop operating;
控制器101,还用于在根据图像获取装置103获取的包含所述样本容器外部的条形码和序列码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;以及用于在根据图像获取装置103获取的包含所述样本容器外部的条形码和序列码的图像未能成功识别出所述条形码的情况下,基于所述图像获取装置获取的包 含所述样本容器外部的条形码和序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。The controller 101 is further configured to determine the sample information of the sample container according to the first recognition result of the barcode when the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device 103 can successfully recognize the barcode; and to determine the sample information of the sample container according to the first recognition result of the barcode when the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device 103 cannot successfully recognize the barcode. The image containing the barcode and the serial code on the outside of the sample container recognizes the serial code, and determines the sample information of the sample container according to the second recognition result of the serial code.
这里,控制器101控制旋转装置102运行,以使旋转装置102驱动样本容器绕竖直方向旋转,图像获取装置103在旋转装置102驱动样本容器旋转时获取样本容器的图像。控制器101获取图像获取装置103拍摄的同一样本容器的图像,并确定获取到的图像中是否包含样本容器外部的条形码和序列码的图像,即确定是否获取到样本容器外部的条形码和序列码的正面图像;在图像获取装置103获取到包含样本容器外部的条形码和序列码的图像时,控制器101控制旋转装置102停止运行;图像获取装置103和/或控制器101可以根据包含样本容器外部的条形码和序列码的图像对条形码进行识别,获得条形码识别结果;在根据图像获取装置103获取的包含样本容器外部的条形码和序列码的图像未能成功识别出条形码的情况下,控制器101还可以根据包含样本容器外部的条形码和序列码的图像对序列码进行识别,获得序列码识别结果。实际应用时,控制器101可以控制旋转装置102按设定角度旋转,即每次旋转设定角度,例如20度。旋转装置102旋转的角度可以根据旋转装置102的转速确定。Here, the controller 101 controls the rotation device 102 to operate so that the rotation device 102 drives the sample container to rotate around the vertical direction, and the image acquisition device 103 acquires the image of the sample container when the rotation device 102 drives the sample container to rotate. The controller 101 acquires the image of the same sample container taken by the image acquisition device 103, and determines whether the acquired image contains the image of the barcode and the serial code on the outside of the sample container, that is, determines whether the front image of the barcode and the serial code on the outside of the sample container is acquired; when the image acquisition device 103 acquires the image containing the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotation device 102 to stop operating; the image acquisition device 103 and/or the controller 101 can recognize the barcode according to the image containing the barcode and the serial code on the outside of the sample container to obtain a barcode recognition result; in the case that the barcode cannot be successfully recognized according to the image containing the barcode and the serial code on the outside of the sample container acquired by the image acquisition device 103, the controller 101 can also recognize the serial code according to the image containing the barcode and the serial code on the outside of the sample container to obtain a serial code recognition result. In actual application, the controller 101 can control the rotating device 102 to rotate at a set angle, that is, each time the rotating device 102 rotates at a set angle, for example, 20 degrees. The rotating angle of the rotating device 102 can be determined according to the rotation speed of the rotating device 102.
为了提高识别样本信息的成功率,在一实施例中,控制器101还用于基于所述包含所述样本容器外部的条形码和序列码的图像中全部或部分图像的图像特征对所述条形码进行识别;或,In order to improve the success rate of identifying sample information, in one embodiment, the controller 101 is further used to identify the barcode based on the image features of all or part of the image containing the barcode and the serial code on the outside of the sample container; or,
控制器101还用于通过第二设定神经网络对所述包含所述样本容器外部的条形码和序列码的图像中全部或部分图像进行处理以对所述条形码进行识别;其中,所述第二设定神经网络用于识别输入图像中的条形码。The controller 101 is also used to process all or part of the image containing the barcode and serial code on the outside of the sample container through a second set neural network to identify the barcode; wherein the second set neural network is used to identify the barcode in the input image.
需要说明的是,根据包含样本容器外部的条形码和序列码的图像识别条形码的方法,与上文根据至少一张包含样本容器外部的条形码识别条形码的方法类似,此处不赘述。 It should be noted that the method of identifying a barcode based on an image containing a barcode and a serial code on the outside of a sample container is similar to the above method of identifying a barcode based on at least one barcode on the outside of a sample container, and is not described in detail here.
为了提高识别样本信息的成功率,在一实施例中,控制器101可以基于所述包含所述样本容器外部的条形码和序列码的图像中全部或部分图像的图像特征对所述序列码进行识别,得到所述第二识别结果;或,In order to improve the success rate of identifying sample information, in one embodiment, the controller 101 may identify the serial code based on the image features of all or part of the image including the barcode and the serial code on the outside of the sample container to obtain the second identification result; or,
控制器101可以通过第一设定神经网络对所述包含所述样本容器外部的条形码和序列码的图像中全部或部分图像进行处理以对所述序列码进行识别,得到所述第二识别结果;其中,所述第一设定神经网络用于识别输入图像中的序列码。The controller 101 can process all or part of the image including the barcode and serial code on the outside of the sample container through a first set neural network to identify the serial code and obtain the second recognition result; wherein the first set neural network is used to identify the serial code in the input image.
需要说明的是,根据包含样本容器外部的条形码和序列码的图像识别序列码的方法,与上文根据至少一张包含样本容器外部的序列码识别序列码的方法类似,此处不赘述。It should be noted that the method of identifying the serial code based on an image containing the barcode and serial code on the outside of the sample container is similar to the above method of identifying the serial code based on at least one image containing the serial code on the outside of the sample container, and will not be repeated here.
为了准确地识别出条形码和序列码的正面图像,在一实施例中,在旋转装置102运行时,控制器101基于图像获取装置103获取到的图像的图像特征进行识别,得到第三识别结果;或者,控制器101通过第三设定神经网络对图像获取装置103获取到的图像进行处理,得到第三识别结果;在第三识别结果表征图像获取装置103获取到包含样本容器外部的条形码和序列码的图像时,控制器101控制旋转装置102停止运行。In order to accurately identify the front image of the barcode and the serial code, in one embodiment, when the rotating device 102 is running, the controller 101 identifies the image based on the image features of the image acquired by the image acquisition device 103 to obtain a third recognition result; or, the controller 101 processes the image acquired by the image acquisition device 103 through a third set neural network to obtain a third recognition result; when the third recognition result indicates that the image acquisition device 103 acquires an image containing the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotating device 102 to stop running.
这里,控制器101可以调用条码区域识别算法,对图像获取装置103获取到的图像的图像特征进行识别,得到第三识别结果;条码区域识别算法用于检测条码区域;图像特征包括以下至少之一:边缘特征、灰度分布特征、颜色特征、纹理特征、形状特征和空间关系特征。第三设定神经网络用于对输入的图像进行处理,得到条码区域识别结果,条码区域识别结果表征是否包含样本容器外部的条形码和序列码。第三设定神经网络以样本容器的图像为输入,以条码区域识别结果为输出。需要说明的是,在第三识别结果表征图像获取装置103未获取到包含样本容器外部的条形码和序列码的图像时,控制器101可以控制旋转装置102继续运行,直到第三 识别结果表征图像获取装置103获取到包含样本容器外部的条形码和序列码的图像为止。其中,获取到包含样本容器外部的条形码和序列码的图像,可以理解为获取到条形码和序列码的正面图像。Here, the controller 101 can call a barcode area recognition algorithm to recognize the image features of the image acquired by the image acquisition device 103 to obtain a third recognition result; the barcode area recognition algorithm is used to detect the barcode area; the image features include at least one of the following: edge features, grayscale distribution features, color features, texture features, shape features and spatial relationship features. The third setting neural network is used to process the input image to obtain a barcode area recognition result, and the barcode area recognition result indicates whether the barcode and serial code outside the sample container are included. The third setting neural network takes the image of the sample container as input and the barcode area recognition result as output. It should be noted that when the third recognition result indicates that the image acquisition device 103 has not acquired an image containing the barcode and serial code outside the sample container, the controller 101 can control the rotating device 102 to continue running until the third The recognition result indicates that the image acquisition device 103 acquires an image including the barcode and the serial code on the outside of the sample container. The acquisition of the image including the barcode and the serial code on the outside of the sample container can be understood as the acquisition of the front image of the barcode and the serial code.
为了进一步提高识别样本信息的成功率和准确度,控制器101在识别样本容器外的条形码和序列码之前,还可以在同一样本容器的多张图像中,筛选出条形码和序列码的图像面积较大的图像,用来识别样本信息。基于此,在一实施例中,从所述图像获取装置获取的多张图像中确定出用于确定所述样本容器的样本信息的所述包含所述样本容器外部的条形码和序列码的图像;其中,In order to further improve the success rate and accuracy of identifying sample information, the controller 101 can also select images with larger image areas of barcodes and serial codes from multiple images of the same sample container before identifying the barcodes and serial codes on the outside of the sample container to identify the sample information. Based on this, in one embodiment, the image containing the barcode and serial code on the outside of the sample container used to determine the sample information of the sample container is determined from the multiple images acquired by the image acquisition device; wherein,
所述至少一张图像的第一参数值大于设定阈值;所述第一参数值表征第一面积与第二面积的比值;所述第一面积表征条形码和序列码在所述至少一张图像中占据的面积;所述第二面积表征所述样本容器在所述至少一张图像中占据的面积。为了提高第一识别结果的准确度,在一实施例中,在基于图像获取装置103获取的同一个样本容器的多张图像获取到至少两个不同的条形码识别结果的情况下:控制器101还用于基于同一样本容器对应的条形码识别结果的出现次数,从至少两个不同的条形码识别结果中确定出条形码的第一识别结果;或者,图像获取装置103还用于基于对应的条形码识别结果的出现次数,从所述至少两个不同的条形码识别结果中确定出所述第一识别结果,并将所述第一识别结果发送至所述控制器。The first parameter value of the at least one image is greater than a set threshold; the first parameter value represents the ratio of the first area to the second area; the first area represents the area occupied by the barcode and the serial code in the at least one image; the second area represents the area occupied by the sample container in the at least one image. In order to improve the accuracy of the first recognition result, in one embodiment, when at least two different barcode recognition results are obtained based on multiple images of the same sample container obtained by the image acquisition device 103: the controller 101 is also used to determine the first recognition result of the barcode from the at least two different barcode recognition results based on the number of occurrences of the barcode recognition results corresponding to the same sample container; or, the image acquisition device 103 is also used to determine the first recognition result from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results, and send the first recognition result to the controller.
图像获取装置103获取的同一个样本容器的多张图像中的部分或全部图像中至少包含样本容器外部的条形码,也就是说,一张图像中可以仅包含样本容器外部的条形码,一张图像中也可以包含样本容器外部的条形码和序列码。控制器101或图像获取装置103可以根据至少包含同一样本容器外部的条形码的多张图像识别出至少两个不同的条形码识别结果;控制器101或图像获取装置103可以将同一样本容器对应的至少两个相同的条 形码识别结果,确定为该样本容器的条形码的第一识别结果。控制器101或图像获取装置103也可以将同一样本容器对应的出现次数最多的条形码识别结果,确定为该样本容器的条形码的第一识别结果。Some or all of the multiple images of the same sample container acquired by the image acquisition device 103 contain at least the barcode on the outside of the sample container, that is, one image may contain only the barcode on the outside of the sample container, or one image may contain the barcode and the serial code on the outside of the sample container. The controller 101 or the image acquisition device 103 may identify at least two different barcode recognition results based on the multiple images containing at least the barcode on the outside of the same sample container; the controller 101 or the image acquisition device 103 may identify at least two identical barcodes corresponding to the same sample container. The controller 101 or the image acquisition device 103 may also determine the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container.
为了提高第一识别结果的准确度,在一实施例中,控制器101或图像获取装置103基于同一样本容器对应的条形码识别结果的出现次数,从至少两个不同的条形码识别结果中确定出所述第一识别结果,包括:In order to improve the accuracy of the first recognition result, in one embodiment, the controller 101 or the image acquisition device 103 determines the first recognition result from at least two different barcode recognition results based on the number of occurrences of the barcode recognition results corresponding to the same sample container, including:
对于图像获取装置103获取到的每张图像,控制器101或图像获取装置103在识别出图像中的条形码的情况下,对对应的条形码识别结果进行投票;在任一条形码识别结果对应的投票数大于设定阈值的情况下,将投票数大于所述设定阈值的条形码识别结果确定为所述第一识别结果。For each image acquired by the image acquisition device 103, the controller 101 or the image acquisition device 103 votes on the corresponding barcode recognition result when the barcode in the image is recognized; when the number of votes corresponding to any barcode recognition result is greater than a set threshold, the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
这里,控制器101或图像获取装置103每获取到一个样本容器对应的条形码识别结果,对该样本容器对应的条形码识别结果进行投票;在同一个样本容器的任一条形码识别结果对应的投票数大于设定阈值的情况下,将投票数大于设定阈值的条形码识别结果确定为该样本容器外部的条形码的第一识别结果。例如,在获取到任一样本容器对应的一个条形码识别结果为A时,对A进行投票,当该样本容器的任一条形码识别结果达到N票时,将A确定为该样本容器外部的条形码的第一识别结果。需要说明的是,相邻两次获取到的同一个样本容器的条形码识别结果可以相同,也可以不同。例如连续多次获得的同一样本容器对应的条形码识别结果为ABA、ABB、AAA、ABAA或者ABBAA。Here, the controller 101 or the image acquisition device 103 votes for each barcode recognition result corresponding to a sample container; when the number of votes corresponding to any barcode recognition result of the same sample container is greater than a set threshold, the barcode recognition result with a number of votes greater than the set threshold is determined as the first recognition result of the barcode outside the sample container. For example, when a barcode recognition result A corresponding to any sample container is obtained, A is voted, and when any barcode recognition result of the sample container reaches N votes, A is determined as the first recognition result of the barcode outside the sample container. It should be noted that the barcode recognition results of the same sample container obtained twice in a row can be the same or different. For example, the barcode recognition results corresponding to the same sample container obtained multiple times in a row are ABA, ABB, AAA, ABAA or ABBAA.
在图像获取装置103和/或控制器101成功识别出样本容器外部的条形码的情况下,控制器101还可以根据该样本容器的条形码的第一识别结果确定该样本容器的样本信息;在图像获取装置103和/或控制器101未成功识别出样本容器外部的条形码的情况下,控制器101还可以基于至少包含同一样本容器外部的序列码的图像对序列码进行识别,并根据序列码的第 二识别结果确定样本容器的样本信息。其中,控制器101根据第二识别结果确定样本信息的实现过程,请参照上文的相关描述,此处不赘述。In the case where the image acquisition device 103 and/or the controller 101 successfully recognizes the barcode on the outside of the sample container, the controller 101 can also determine the sample information of the sample container according to the first recognition result of the barcode of the sample container; in the case where the image acquisition device 103 and/or the controller 101 fail to successfully recognize the barcode on the outside of the sample container, the controller 101 can also recognize the serial code based on an image at least containing the serial code on the outside of the same sample container, and determine the sample information of the sample container according to the first recognition result of the barcode of the sample container. The second identification result determines the sample information of the sample container. The implementation process of the controller 101 determining the sample information according to the second identification result is described above and will not be repeated here.
考虑到有的条形码贴得比较规整或者条形码面向图像获取装置103的摄像头,可能不需要对样本容器进行旋转扫码也能成功识别条形码,因此,为了尽可能缩短识别条形码所消耗的总时长以及节省数据处理资源,可以先在样本容器处于静止状态时识别样本容器外的条形码,即先进行常规扫码,如果在样本容器处于静止状态时无法识别条形码,再对样本容器进行旋转拍摄。基于此,在一实施例中,图像获取装置103还用于在所述样本容器静止时获取所述样本容器的一张图像;控制器101在基于所述一张图像未能成功识别出所述条形码的情况下,控制旋转装置102运行。Considering that some barcodes are posted more neatly or face the camera of the image acquisition device 103, it may not be necessary to rotate the sample container to scan the barcode in order to successfully identify the barcode. Therefore, in order to shorten the total time consumed for identifying the barcode and save data processing resources, the barcode outside the sample container can be identified when the sample container is in a stationary state, that is, a conventional scan is performed first. If the barcode cannot be identified when the sample container is in a stationary state, the sample container is rotated and photographed. Based on this, in one embodiment, the image acquisition device 103 is also used to obtain an image of the sample container when the sample container is stationary; if the controller 101 fails to successfully identify the barcode based on the image, the rotation device 102 is controlled to operate.
这里,在旋转装置102驱动样本容器绕竖直方向旋转之前,图像获取装置103在样本容器静止时获取样本容器的一张图像;图像获取装置103和/或控制器101基于该图像对条形码进行识别;如果基于该图像能够成功识别出条形码,控制器101可以控制旋转装置102停止运行;如果基于该图像未能成功识别出条形码,控制器101控制旋转装置102运行,从而驱动样本容器绕竖直方向旋转,以在旋转扫描或旋转拍照的场景下识别条形码。这样,既可以保证识别样本信息的成功率,又能节省资源,提高样本信息识别效率。Here, before the rotating device 102 drives the sample container to rotate in the vertical direction, the image acquisition device 103 acquires an image of the sample container when the sample container is stationary; the image acquisition device 103 and/or the controller 101 recognize the barcode based on the image; if the barcode can be successfully recognized based on the image, the controller 101 can control the rotating device 102 to stop running; if the barcode cannot be successfully recognized based on the image, the controller 101 controls the rotating device 102 to run, thereby driving the sample container to rotate in the vertical direction, so as to recognize the barcode in the scene of rotation scanning or rotation photography. In this way, the success rate of identifying sample information can be guaranteed, resources can be saved, and the efficiency of sample information recognition can be improved.
为了不在无条码样本上浪费过多时间,提高样本信息识别效率,在一实施例中,控制器101还用于:在旋转装置102驱动所述样本容器旋转设定圈数之后还未识别出任意条形码的情况下,控制旋转装置102停止运行。In order to avoid wasting too much time on samples without barcodes and improve the efficiency of sample information identification, in one embodiment, the controller 101 is also used to control the rotating device 102 to stop running if no barcode is identified after the rotating device 102 drives the sample container to rotate a set number of times.
这里,在旋转装置102驱动样本容器旋转设定圈数之后,如果仍未接收到图像获取装置103发送的该样本容器对应的条形码识别结果,或者控制器101仍未识别出该样本容器对应的任意条形码,表明样本容器外部没有条形码,那么控制器101控制旋转装置102停止运行,以使样本容器停 止旋转;设定圈数可以为2;此时,控制器101还可以将该样本容器的条码识别结果标记为NOREAD或识别失败或无条形码。Here, after the rotating device 102 drives the sample container to rotate a set number of times, if the barcode recognition result corresponding to the sample container sent by the image acquisition device 103 is still not received, or the controller 101 still cannot recognize any barcode corresponding to the sample container, indicating that there is no barcode on the outside of the sample container, then the controller 101 controls the rotating device 102 to stop running, so that the sample container stops. The set number of revolutions may be 2; at this time, the controller 101 may also mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
需要说明的是,在旋转装置102驱动样本容器旋转第一设定圈数之内,如果获得样本容器对应的任一条形码识别结果,控制器101或图像获取装置103需要在旋转装置102驱动样本容器旋转第二设定圈数之内,确定出条形码的第一识别结果;如果控制器101在旋转装置102驱动样本容器旋转第二设定圈数时,仍未确定出条形码的第一识别结果,或者未接收到图像获取装置103发送的条形码的第一识别结果,那么控制器101可以将该样本容器的条码识别结果标记为NOREAD或识别失败或无条形码。第二设定圈数大于第一设定圈数,例如第一设定圈数可以为2,第二设定圈数可以为3或4。It should be noted that if any barcode recognition result corresponding to the sample container is obtained within the first set number of revolutions driven by the rotating device 102, the controller 101 or the image acquisition device 103 needs to determine the first recognition result of the barcode within the second set number of revolutions driven by the rotating device 102; if the controller 101 still fails to determine the first recognition result of the barcode when the rotating device 102 drives the sample container to rotate the second set number of revolutions, or fails to receive the first recognition result of the barcode sent by the image acquisition device 103, then the controller 101 can mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode. The second set number of revolutions is greater than the first set number of revolutions, for example, the first set number of revolutions can be 2, and the second set number of revolutions can be 3 or 4.
基于上文实施例,在旋转扫描或选择拍摄的场景下,图像获取装置103在旋转装置102驱动样本容器旋转过程中获取样本容器的图像,控制器101在图像获取装置103获取到包含样本容器外部的条形码和序列码的图像时,根据包含样本容器外部的条形码和序列码的图像对条形码进行识别;如果能够成功识别出条形码,那么控制器101根据条形码的第一识别结果确定样本容器的样本信息;如果未能成功识别出条形码,那么控制器101根据包含该样本容器外部的序列码和序列码的图像对序列码进行识别,获得序列码的第二识别结果,并根据第二识别结果确定样本容器的样本信息。这样,不仅可以提高识别样本信息的效率,即使未成功识别条形码,也可以通过识别序列码来获得样本信息,相比于相关技术中仅通过扫描条形码来获得样本信息的方案,上述方案可以提高识别样本信息的成功率和效率。Based on the above embodiments, in the scenario of rotational scanning or selective shooting, the image acquisition device 103 acquires an image of the sample container while the rotating device 102 drives the sample container to rotate. When the image acquisition device 103 acquires an image containing the barcode and the serial code on the outside of the sample container, the controller 101 recognizes the barcode according to the image containing the barcode and the serial code on the outside of the sample container; if the barcode can be successfully recognized, the controller 101 determines the sample information of the sample container according to the first recognition result of the barcode; if the barcode cannot be successfully recognized, the controller 101 recognizes the serial code according to the image containing the serial code on the outside of the sample container and the serial code, obtains a second recognition result of the serial code, and determines the sample information of the sample container according to the second recognition result. In this way, not only the efficiency of identifying sample information can be improved, but also the sample information can be obtained by identifying the serial code even if the barcode is not successfully recognized. Compared with the solution of obtaining sample information by only scanning the barcode in the related art, the above solution can improve the success rate and efficiency of identifying sample information.
请继续参照图1,本申请实施例还提供了另一种样本识别系统,与上文实施例提供的样本识别系统的不同之处在于:Continuing to refer to FIG. 1 , the present embodiment also provides another sample identification system, which is different from the sample identification system provided in the above embodiment in that:
图像获取装置103,用于在所述旋转装置驱动所述样本容器旋转时, 至少获取包含所述样本容器外部的条形码的图像;The image acquisition device 103 is used for, when the rotating device drives the sample container to rotate, acquiring at least an image including a barcode on the exterior of the sample container;
控制器101,用于控制旋转装置102运行,并在图像获取装置103获取到包含所述样本容器外部的条形码和/或序列码的图像时,控制旋转装置102停止运行;还用于在根据包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息,以及用于在根据包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,控制旋转装置102运行,根据图像获取装置103获取的至少一张包含所述样本容器外部的条形码的图像对所述条形码进行识别,在根据所述至少一张包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;在根据所述至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,根据图像获取装置103获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。The controller 101 is used to control the rotation device 102 to operate, and when the image acquisition device 103 acquires an image containing the barcode and/or the serial code on the outside of the sample container, control the rotation device 102 to stop operating; and is also used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully identified according to the image containing the barcode on the outside of the sample container, and is used to control the rotation device 102 to operate, according to at least one image containing the barcode acquired by the image acquisition device 103, when the barcode cannot be successfully identified according to the image containing the barcode on the outside of the sample container. The barcode is identified based on the image of the barcode on the outside of the sample container. When the barcode can be successfully identified based on the at least one image containing the barcode on the outside of the sample container, the sample information of the sample container is determined based on the first recognition result of the barcode. When the barcode cannot be successfully identified based on the at least one image containing the barcode on the outside of the sample container, the serial code is identified based on at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device 103, and the sample information of the sample container is determined based on the second recognition result of the serial code.
这里,控制器101控制旋转装置102运行,以使旋转装置102驱动样本容器绕竖直方向旋转,图像获取装置103在旋转装置102驱动样本容器旋转时获取样本容器的图像。实际应用时,控制器101可以控制旋转装置102按设定角度旋转,即每次旋转设定角度,例如20度。旋转装置102旋转的角度可以根据旋转装置102的转速确定。Here, the controller 101 controls the rotation device 102 to operate so that the rotation device 102 drives the sample container to rotate around the vertical direction, and the image acquisition device 103 acquires an image of the sample container when the rotation device 102 drives the sample container to rotate. In actual application, the controller 101 can control the rotation device 102 to rotate at a set angle, that is, each time the rotation is set by an angle, such as 20 degrees. The rotation angle of the rotation device 102 can be determined according to the rotation speed of the rotation device 102.
控制器101获取图像获取装置103拍摄的同一样本容器的图像,并确定获取到的图像中是否包含样本容器外部的条形码和序列码的图像,即确定是否获取到样本容器外部的条形码和序列码的正面图像;在获取到的图像中包含样本容器外部的条形码和序列码的图像时,控制器101控制旋转装置102停止运行。控制器101或图像获取装置103根据包含样本容器外 部的条形码的图像进行识别,在根据包含样本容器外部的条形码和序列码的图像能够成功识别出条形码的情况下,控制器101根据该样本容器外部的条形码的第一识别结果确定该样本容器的样本信息;在根据包含样本容器外部的条形码的图像未能成功识别出条形码的情况下,控制器101控制旋转装置103运行;图像获取装置103在旋转装置102驱动样本容器旋转时,至少获取包含样本容器外部的条形码和/或序列码的图像。控制器101根据图像获取装置103获取的至少一张包含同一样本容器外部的条形码的图像对条形码进行识别,在根据至少一张包含同一样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,控制器101根据条形码的第一识别结果确定该样本容器的样本信息;在根据至少一张包含同一样本容器外部的条形码的图像未能成功识别出条形码的情况下,控制器101根据图像获取装置103获取的至少一张包含同一样本容器外部的序列码的图像对序列码进行识别,并根据序列码的第二识别结果确定该样本容器的样本信息。The controller 101 acquires the image of the same sample container taken by the image acquisition device 103, and determines whether the acquired image contains the image of the barcode and the serial code on the outside of the sample container, that is, determines whether the front image of the barcode and the serial code on the outside of the sample container is acquired; when the acquired image contains the image of the barcode and the serial code on the outside of the sample container, the controller 101 controls the rotating device 102 to stop running. The controller 101 or the image acquisition device 103 determines whether the image contains the image of the barcode and the serial code on the outside of the sample container. The controller 101 identifies the image of the barcode on the outside of the sample container. When the barcode can be successfully identified based on the image including the barcode and the serial code on the outside of the sample container, the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode on the outside of the sample container. When the barcode cannot be successfully identified based on the image including the barcode on the outside of the sample container, the controller 101 controls the rotation device 103 to operate. When the rotation device 102 drives the sample container to rotate, the image acquisition device 103 at least acquires the image including the barcode and/or the serial code on the outside of the sample container. The controller 101 recognizes the barcode based on at least one image containing the barcode on the outside of the same sample container acquired by the image acquisition device 103. When the barcode can be successfully recognized based on at least one image containing the barcode on the outside of the same sample container, the controller 101 determines the sample information of the sample container based on the first recognition result of the barcode. When the barcode cannot be successfully recognized based on at least one image containing the barcode on the outside of the same sample container, the controller 101 recognizes the serial code based on at least one image containing the serial code on the outside of the same sample container acquired by the image acquisition device 103, and determines the sample information of the sample container based on the second recognition result of the serial code.
识别条形码和序列码的实现方式、以及确定样本信息的实现方式请参照上文的相关描述,此处不赘述。For the implementation method of identifying the barcode and serial code, and the implementation method of determining the sample information, please refer to the relevant description above and will not be repeated here.
基于上文实施例的相关描述,对应地,本申请实施例还提供了一种样本识别方法,应用于上述样本识别系统中的控制器;样本识别系统还包括旋转装置及耦合至控制器的图像获取装置,控制器可与图像获取装置进行通信连接,接收或获取图像获取装置拍摄的图像,和/或,接收图像获取装置发送的条形码识别结果。参照图8,所述方法包括:Based on the relevant description of the above embodiment, correspondingly, the embodiment of the present application also provides a sample identification method, which is applied to the controller in the above sample identification system; the sample identification system also includes a rotating device and an image acquisition device coupled to the controller, and the controller can communicate with the image acquisition device to receive or acquire images taken by the image acquisition device, and/or receive barcode recognition results sent by the image acquisition device. Referring to Figure 8, the method includes:
步骤801:在根据至少一张至少包含样本容器外部的条形码的图像能够成功识别出样本容器外部的条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息。Step 801: when a barcode on the outside of a sample container can be successfully identified based on at least one image at least including the barcode on the outside of the sample container, determine sample information of the sample container based on a first recognition result of the barcode.
其中,至少一张至少包含样本容器外部的条形码的图像由图像获取 装置在旋转装置驱动样本容器旋转时拍摄得到。wherein at least one image including at least a barcode on the outside of the sample container is acquired by an image The device is photographed when the rotating device drives the sample container to rotate.
这里,可以由图像获取装置或控制器根据至少一张至少包含同一样本容器外部的条形码的图像对条形码进行识别,获得条形码识别结果,以及根据同一个样本容器的条形码识别结果,确定出条形码的第一识别结果,由控制器根据条形码的第一识别结果确定该样本容器的样本信息。或者,由图像获取装置根据至少一张至少包含同一样本容器外部的条形码的图像对条形码进行识别,获得条形码识别结果,以及由控制器根据同一个样本容器的条形码识别结果,确定出条形码的第一识别结果;由控制器根据条形码的第一识别结果确定该样本容器的样本信息。其中,确定条形码的第一识别结果以及根据第一识别结果确定样本信息的实现过程请参照上文的相关描述,此处不赘述。Here, the image acquisition device or the controller may recognize the barcode based on at least one image that at least includes the barcode on the outside of the same sample container to obtain a barcode recognition result, and determine a first barcode recognition result based on the barcode recognition result of the same sample container, and the controller determines the sample information of the sample container based on the first barcode recognition result. Alternatively, the image acquisition device may recognize the barcode based on at least one image that at least includes the barcode on the outside of the same sample container to obtain a barcode recognition result, and the controller may determine a first barcode recognition result based on the barcode recognition result of the same sample container; and the controller determines the sample information of the sample container based on the first barcode recognition result. The implementation process of determining the first barcode recognition result and determining the sample information based on the first recognition result is described above, and will not be repeated here.
需要说明的是,至少包含同一样本容器外部的条形码的图像中,至少包含该样本容器的条形码,还可以包含该样本容器的序列码。也就是说,图像获取装置或控制器根据至少一张至少包含同一样本容器外部的条形码的图像对条形码进行识别,包括:根据包含同一样本容器外部的条形码的图像进行条形码识别,或者,根据包含同一样本容器外部的条形码和序列码的图像进行条形码识别。It should be noted that the image that at least includes the barcode on the outside of the same sample container may include at least the barcode of the sample container and may also include the serial code of the sample container. That is, the image acquisition device or controller recognizes the barcode based on at least one image that at least includes the barcode on the outside of the same sample container, including: performing barcode recognition based on the image that includes the barcode on the outside of the same sample container, or performing barcode recognition based on the image that includes the barcode and the serial code on the outside of the same sample container.
为了减少控制器的数据处理量,条形码可以由图像获取装置进行识别,基于此,在一实施例中,所述根据所述条形码的第一识别结果确定所述样本容器的样本信息,包括:In order to reduce the amount of data processing of the controller, the barcode can be recognized by an image acquisition device. Based on this, in one embodiment, determining the sample information of the sample container according to the first recognition result of the barcode includes:
接收所述图像获取装置发送的所述第一识别结果,并根据所述第一识别结果确定所述样本容器的样本信息;所述第一识别结果由所述图像获取装置基于拍摄的至少包含所述样本容器外部的条形码的图像对所述条形码进行识别得到。Receive the first recognition result sent by the image acquisition device, and determine the sample information of the sample container according to the first recognition result; the first recognition result is obtained by the image acquisition device recognizing the barcode based on an image captured by at least the barcode on the outside of the sample container.
这里,如果图像获取装置基于至少一张至少包含同一个样本容器外 部的条形码的图像对条形码进行识别,仅得到一个条形码识别结果,那么该条形码识别结果为该样本容器的条形码的第一识别结果;图像获取装置向控制器发送该样本容器的条形码的第一识别结果;控制器接收图像获取装置发送的第一识别结果,并根据第一识别结果确定该样本容器的样本信息。Here, if the image acquisition device is based on at least one image containing at least one sample container The barcode is recognized by using the image of the barcode on the sample container, and only one barcode recognition result is obtained, then the barcode recognition result is the first recognition result of the barcode of the sample container; the image acquisition device sends the first recognition result of the barcode of the sample container to the controller; the controller receives the first recognition result sent by the image acquisition device, and determines the sample information of the sample container according to the first recognition result.
至少包含样本容器外部的条形码的图像可以是控制器控制旋转装置运行之前,在样本容器静止时获取的一张图像,也可以是由图像获取装置在旋转装置驱动样本容器旋转时拍摄得到的图像。The image at least including the barcode on the outside of the sample container may be an image acquired when the sample container is stationary before the controller controls the rotating device to operate, or may be an image captured by the image acquisition device when the rotating device drives the sample container to rotate.
在旋转扫描或旋转拍照的场景下,可以由图像获取装置识别条形码,以减少控制器的数据处理量。基于此,在一实施例中,所述至少一张至少包含所述样本容器外部的条形码的图像包括多张图像;所述接收所述图像获取装置发送的所述第一识别结果,包括:In the scenario of rotational scanning or rotational photography, the barcode can be recognized by the image acquisition device to reduce the amount of data processing of the controller. Based on this, in one embodiment, the at least one image containing at least the barcode on the outside of the sample container includes multiple images; the receiving the first recognition result sent by the image acquisition device includes:
接收所述图像获取装置基于所述多张图像获取到的至少两个不同的条形码识别结果;receiving at least two different barcode recognition results acquired by the image acquisition device based on the multiple images;
基于对应的条形码识别结果的出现次数,从所述至少两个不同的条形码识别结果中确定出所述第一识别结果。The first recognition result is determined from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results.
这里,图像获取装置可以基于多张至少包含同一个样本容器外部的条形码的图像,获取到至少两个不同的条形码识别结果,并向控制器发送同一个样本容器对应的所有条形码识别结果;控制器基于该样本容器对应的每个条形码识别结果的出现次数,从该样本容器对应的所有条形码识别结果中确定出第一识别结果;例如,控制器可以将同一样本容器对应的出现次数最多的条形码识别结果,确定为该样本容器的条形码的第一识别结果。由此,可以提高第一识别结果的准确度和可信度。Here, the image acquisition device can obtain at least two different barcode recognition results based on multiple images containing at least the barcode on the outside of the same sample container, and send all barcode recognition results corresponding to the same sample container to the controller; the controller determines the first recognition result from all barcode recognition results corresponding to the sample container based on the number of occurrences of each barcode recognition result corresponding to the sample container; for example, the controller can determine the barcode recognition result with the largest number of occurrences corresponding to the same sample container as the first recognition result of the barcode of the sample container. In this way, the accuracy and credibility of the first recognition result can be improved.
为了提高第一识别结果的准确度和可信度,在一实施例中,所述基于对应的条形码识别结果的出现次数,从所述至少两个不同的条形码识别结 果中确定出所述第一识别结果,包括:In order to improve the accuracy and credibility of the first recognition result, in one embodiment, the barcode recognition result is selected from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results. Determining the first recognition result from the results includes:
对对应的条形码识别结果进行投票;Vote for the corresponding barcode recognition results;
在任一条形码识别结果对应的投票数大于设定阈值的情况下,将投票数大于所述设定阈值的条形码识别结果确定为所述第一识别结果。In the case that the number of votes corresponding to any barcode recognition result is greater than a set threshold, the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
例如,如果同一个样本容器对应的不同条形码识别结果为ABA、AAA、ABAA或ABBAAA,那么该样本容器的条形码的第一识别结果为A;如果同一个样本容器对应的不同条形码识别结果为ABB,那么该样本容器的条形码的第一识别结果为B。For example, if the different barcode recognition results corresponding to the same sample container are ABA, AAA, ABAA or ABBAAA, then the first recognition result of the barcode of the sample container is A; if the different barcode recognition results corresponding to the same sample container are ABB, then the first recognition result of the barcode of the sample container is B.
在旋转扫描或旋转拍照的场景下,可以由控制识别条形码,以减少图像获取装置的数据处理量或者降低图像获取装置的数据处理能力的要求。基于此,在一实施例中,所述方法还包括:In the case of rotation scanning or rotation photography, the barcode recognition can be controlled to reduce the data processing amount of the image acquisition device or reduce the data processing capability requirements of the image acquisition device. Based on this, in one embodiment, the method further includes:
接收所述图像获取装置发送的所述至少一张至少包含所述样本容器外部的条形码的图像;receiving the at least one image including at least the barcode on the outside of the sample container sent by the image acquisition device;
基于所述至少一张至少包含所述样本容器外部的条形码的图像中全部或部分图像的图像特征对所述条形码进行识别;或,通过第二设定神经网络对所述至少一张至少包含所述样本容器外部的条形码的图像中全部或部分图像进行处理以对所述条形码进行识别;所述第二设定神经网络用于识别输入图像中的条形码。The barcode is identified based on image features of all or part of the at least one image that at least includes the barcode on the outside of the sample container; or, the barcode is identified by processing all or part of the at least one image that at least includes the barcode on the outside of the sample container through a second set neural network; the second set neural network is used to identify the barcode in the input image.
这里,上述至少一张至少包含样本容器外部的条形码的图像,由图像获取装置在旋转装置驱动样本容器旋转时拍摄得到。控制器基于至少一张至少包含同一样本容器外部的条形码的图像识别条形码的实现过程,请参照上文的相关描述,此处不赘述。Here, the at least one image containing at least the barcode on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate. The implementation process of the controller recognizing the barcode based on at least one image containing at least the barcode on the outside of the same sample container is described above and will not be repeated here.
步骤802:在根据至少一张至少包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,基于至少一张至少包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码 的第二识别结果确定所述样本容器的样本信息。Step 802: If the barcode cannot be successfully identified based on at least one image that at least includes the barcode on the outside of the sample container, identify the serial code based on at least one image that at least includes the serial code on the outside of the sample container, and identify the serial code based on the serial code. The sample information of the sample container is determined based on the second recognition result.
其中,至少一张至少包含所述样本容器外部的条形码和/或序列码的图像由所述图像获取装置在所述旋转装置驱动所述样本容器旋转时拍摄得到。Wherein, at least one image including at least the barcode and/or the serial code on the outside of the sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate.
这里,在控制器或图像获取装置根据至少一张至少包含同一样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,控制器基于至少一张至少包含该样本容器外部的序列码的图像对样本容器外部的序列码进行识别,获得条形码的第二识别结果,并根据序列码的第二识别结果确定样本容器的样本信息,具体实现细节请参照上文的相关描述,此处不赘述。Here, when the controller or the image acquisition device fails to successfully identify the barcode based on at least one image that at least includes the barcode on the outside of the same sample container, the controller identifies the serial code on the outside of the sample container based on at least one image that at least includes the serial code on the outside of the sample container, obtains a second identification result of the barcode, and determines the sample information of the sample container based on the second identification result of the serial code. For specific implementation details, please refer to the relevant description above, which will not be repeated here.
需要说明的是,至少包含样本容器外部的序列码的图像中,至少包含样本容器外部的序列码的图像,还可以包含样本容器外部的序列码。也就是说,控制器根据至少一张至少包含同一样本容器外部的序列码的图像对序列码进行识别,包括:根据包含同一样本容器外部的序列码的图像进行条形码识别,或者,根据包含同一样本容器外部的条形码和序列码的图像进行条形码识别。It should be noted that, among the images at least including the serial code on the outside of the sample container, the image at least including the serial code on the outside of the sample container may also include the serial code on the outside of the sample container. That is, the controller recognizes the serial code based on at least one image at least including the serial code on the outside of the same sample container, including: performing barcode recognition based on the image including the serial code on the outside of the same sample container, or performing barcode recognition based on the image including the barcode and the serial code on the outside of the same sample container.
为了提高识别样本信息的成功率,在一实施例中,所述,所述基于至少一张至少包含所述样本容器外部的序列码的图像对所述序列码进行识别,包括:In order to improve the success rate of identifying sample information, in one embodiment, the identifying the serial code based on at least one image at least including the serial code on the outside of the sample container includes:
基于所述至少一张至少包含所述样本容器外部的序列码的图像中全部或部分图像的图像特征对所述序列码进行识别,得到所述第二识别结果;或,Recognize the serial code based on the image features of all or part of the at least one image that at least includes the serial code on the outside of the sample container to obtain the second recognition result; or,
通过第一设定神经网络对所述至少一张至少包含所述样本容器外部的序列码的图像中全部或部分图像进行处理以对所述序列码进行识别,得到所述第二识别结果;所述第一设定神经网络用于识别输入图像中的 序列码。The first set neural network is used to process all or part of the at least one image containing at least the serial code on the outside of the sample container to identify the serial code to obtain the second recognition result; the first set neural network is used to identify the serial code in the input image. Serial number.
这里,控制器基于包含样本容器外部的序列码的图像识别序列码的实现过程,请参照上文的相关描述,此处不赘述。Here, for the implementation process of the controller recognizing the serial code based on the image containing the serial code on the outside of the sample container, please refer to the relevant description above and will not be repeated here.
由于基于条形码和序列码的正面图像可成功识别出条形码和/或序列码,为了提高识别条形码和/或序列码的效率,可以在获取到条形码和/或序列码的正面图像,旋转装置停止运行。基于此,在一实施例中,控制所述旋转装置运行,并在所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,控制所述旋转装置停止运行。Since the barcode and/or the serial code can be successfully identified based on the front image of the barcode and the serial code, in order to improve the efficiency of identifying the barcode and/or the serial code, the rotating device can be stopped when the front image of the barcode and/or the serial code is obtained. Based on this, in one embodiment, the rotating device is controlled to operate, and when the image acquisition device acquires an image containing the barcode and the serial code on the outside of the sample container, the rotating device is controlled to stop operating.
这里,在图像获取装置未获取到包含样本容器外部的条形码和序列码的图像的情况下,控制器可以控制旋转装置继续运行,以驱动样本容器继续绕竖直方向旋转,图像获取装置拍摄下一帧图像。Here, when the image acquisition device fails to acquire an image containing the barcode and serial code on the outside of the sample container, the controller can control the rotating device to continue to operate to drive the sample container to continue to rotate in the vertical direction, and the image acquisition device captures the next frame of image.
为了准确地识别出条形码和序列码的正面图像,在一实施例中,在所述旋转装置运行时,基于所述图像获取装置获取到的图像的图像特征进行识别,得到第三识别结果;或者,通过第三设定神经网络对所述图像获取装置获取到的图像进行处理,得到第三识别结果;In order to accurately identify the front image of the barcode and the serial code, in one embodiment, when the rotating device is running, the image acquired by the image acquisition device is identified based on the image features to obtain a third recognition result; or, the image acquired by the image acquisition device is processed by a third set neural network to obtain a third recognition result;
在所述第三识别结果表征所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,所述控制器控制所述旋转装置停止运行。When the third recognition result indicates that the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, the controller controls the rotating device to stop running.
为了不在无条码样本上浪费过多时间,提高样本信息识别效率,在一实施例中,所述方法还包括:In order to avoid wasting too much time on samples without barcodes and improve the efficiency of sample information identification, in one embodiment, the method further includes:
在所述旋转装置驱动所述样本容器旋转设定圈数之后还未识别出任意条形码的情况下,控制所述旋转装置停止运行。In the case that any barcode has not been identified after the rotating device drives the sample container to rotate a set number of times, the rotating device is controlled to stop running.
这里,在旋转装置驱动样本容器旋转设定圈数之后,如果控制器仍未接收到图像获取装置发送的该样本容器对应的条形码识别结果,或者控制器仍未识别出该样本容器对应的任意条形码,表明样本容器外部没有条形 码,那么控制器控制旋转装置停止运行,以使样本容器停止旋转;设定圈数可以为2。控制器还可以将该样本容器的条码识别结果标记为NOREAD或识别失败或无条形码。Here, after the rotating device drives the sample container to rotate a set number of times, if the controller still does not receive the barcode recognition result corresponding to the sample container sent by the image acquisition device, or the controller still does not recognize any barcode corresponding to the sample container, it indicates that there is no barcode on the outside of the sample container. If the barcode is found, the controller controls the rotating device to stop running, so that the sample container stops rotating; the set number of revolutions can be 2. The controller can also mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode.
需要说明的是,在旋转装置驱动样本容器旋转第一设定圈数之内,如果获得样本容器对应的任一条形码识别结果,控制器或图像获取装置需要在旋转装置驱动该样本容器旋转第二设定圈数之内,确定出该样本容器的条形码的第一识别结果;如果,在旋转装置驱动样本容器旋转第二设定圈数时,控制器或图像获取装置仍未确定出该样本容器的条形码的第一识别结果,那么控制器可以将该样本容器的条码识别结果标记为NOREAD或识别失败或无条形码。第二设定圈数大于第一设定圈数,例如第一设定圈数可以为2,第二设定圈数可以为3或4。It should be noted that if any barcode recognition result corresponding to the sample container is obtained within the first set number of revolutions driven by the rotating device, the controller or the image acquisition device needs to determine the first recognition result of the barcode of the sample container within the second set number of revolutions driven by the rotating device; if, when the rotating device drives the sample container to rotate the second set number of revolutions, the controller or the image acquisition device still has not determined the first recognition result of the barcode of the sample container, then the controller can mark the barcode recognition result of the sample container as NOREAD or recognition failure or no barcode. The second set number of revolutions is greater than the first set number of revolutions, for example, the first set number of revolutions can be 2, and the second set number of revolutions can be 3 or 4.
为了进一步提高识别样本信息的成功率和准确度,控制器在识别样本容器外的条形码和/或序列码之前,还可以在同一样本容器的多图像中,筛选出用于确定样本信息的包含样本容器外部的条形码和/或序列码的图像。基于此,在一实施例中,所述方法还包括:In order to further improve the success rate and accuracy of identifying sample information, before identifying the barcode and/or serial code on the outside of the sample container, the controller may also filter out the image containing the barcode and/or serial code on the outside of the sample container from multiple images of the same sample container for determining the sample information. Based on this, in one embodiment, the method further includes:
从所述图像获取装置获取的多张图像中确定出用于确定所述样本容器的样本信息的所述至少一张至少包含所述样本容器外部的条形码的图像,和/或,所述至少一张至少包含所述样本容器外部的序列码的图像;其中,Determine from the multiple images acquired by the image acquisition device the at least one image containing at least the barcode on the outside of the sample container and/or the at least one image containing at least the serial code on the outside of the sample container for determining the sample information of the sample container; wherein,
所述一张图像的第一参数值大于设定阈值;所述第一参数值表征第一面积与第二面积的比值;所述第一面积表征条形码和/或序列码在所述至少一张图像中占据的面积;所述第二面积表征所述样本容器在所述至少一张图像中占据的面积。The first parameter value of the image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
这里,控制器可以从图像获取装置获取的多张图像中确定出用于确定样本容器的样本信息的包含样本容器外部的条形码的图像,和/或,包含样本容器外部的序列码的图像;也可以从图像获取装置获取的多张图 像中确定出用于确定样本容器的样本信息的包含样本容器外部的条形码和序列码的图像。Here, the controller can determine, from the multiple images acquired by the image acquisition device, an image containing a barcode on the outside of the sample container and/or an image containing a serial code on the outside of the sample container for determining the sample information of the sample container; or An image including a barcode and a serial code on the outside of the sample container for determining sample information of the sample container is determined in the image.
实际应用时,可能因拍摄的图像中的序列码可能不全或不清晰,控制器无法成功识出别序列码。基于此,为了提醒相关人员及时处理无法识别序列码的样本,在一实施例中,所述方法还包括:In actual application, the controller may not be able to successfully identify the sequence code because the sequence code in the captured image may be incomplete or unclear. Based on this, in order to remind relevant personnel to deal with samples with unrecognizable sequence codes in a timely manner, in one embodiment, the method further includes:
在未成功识别出所述序列码的情况下,控制所述样本识别系统的人机交互装置在其显示界面上输出报警提示信息;所述报警提示信息表征所述样本容器的样本信息识别失败。In the case where the serial code is not successfully identified, the human-computer interaction device controlling the sample identification system outputs an alarm prompt message on its display interface; the alarm prompt message indicates that the sample information identification of the sample container has failed.
需要说明的是,在一实施例中,控制器还可以基于至少一张包含同一样本容器外部的条形码的图像对条形码进行识别,基于至少一张包含同一样本容器外部的序列码的图像对序列码进行识别,基于所述条形码的第一识别结果和所述序列码的第二识别结果确定所述样本容器的样本信息;其中,至少一张包含同一样本容器外部的条形码和/或序列码的图像由所述图像获取装置在所述旋转装置驱动所述样本容器旋转时拍摄得到。实际应用时,在同一样本容器对应的第一识别结果和第二识别结果相同的情况下,基于第一识别结果或所述第二识别结果确定出该样本容器的样本信息;在同一样本容器对应的第一识别结果和第二识别结果不同的情况下,表征扫码异常,控制器可以将样本容器转移至扫码异常区,还可以控制样本识别系统中的人机交互装置在其显示界面上输出报警提示信息或输出表征扫码异常的提示信息,以提示相关人员做进一步处理。It should be noted that, in one embodiment, the controller can also identify the barcode based on at least one image containing the barcode on the outside of the same sample container, identify the serial code based on at least one image containing the serial code on the outside of the same sample container, and determine the sample information of the sample container based on the first recognition result of the barcode and the second recognition result of the serial code; wherein, at least one image containing the barcode and/or serial code on the outside of the same sample container is captured by the image acquisition device when the rotating device drives the sample container to rotate. In actual application, when the first recognition result and the second recognition result corresponding to the same sample container are the same, the sample information of the sample container is determined based on the first recognition result or the second recognition result; when the first recognition result and the second recognition result corresponding to the same sample container are different, it indicates that the code scanning is abnormal, and the controller can transfer the sample container to the code scanning abnormality area, and can also control the human-computer interaction device in the sample identification system to output an alarm prompt message or a prompt message indicating the code scanning abnormality on its display interface to prompt relevant personnel to make further processing.
需要说明的是,在一实施例中,控制器还可以控制旋转装置运行,以使图像获取装置在旋转装置驱动样本容器旋转时至少获取包含所述样本容器外部的条形码和/或序列码的图像,控制器在图像获取装置获取到包含样本容器外部的条形码和序列码的图像时,控制旋转装置停止运行;在根据包含样本容器外部的条形码和序列码的图像能够成功识别出所述 条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息,以及在根据包含所述样本容器外部的条形码和序列码的图像未能成功识别出所述条形码的情况下,控制旋转装置运行;根据图像获取装置获取的至少一张包含所述样本容器外部的条形码的图像对所述条形码进行识别,在根据所述至少一张包含所述样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;在根据所述至少一张包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,根据所述图像获取装置获取的至少一张包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息。It should be noted that, in one embodiment, the controller can also control the rotation device to operate so that the image acquisition device at least acquires an image containing the barcode and/or the serial code on the outside of the sample container when the rotation device drives the sample container to rotate. When the image acquisition device acquires an image containing the barcode and the serial code on the outside of the sample container, the controller controls the rotation device to stop operating; when the image acquisition device can successfully identify the barcode and the serial code on the outside of the sample container based on the image containing the barcode and the serial code on the outside of the sample container, the controller controls the rotation device to stop operating. In the case of a barcode, the sample information of the sample container is determined according to a first recognition result of the barcode, and in the case that the barcode cannot be successfully recognized according to the image containing the barcode and the serial code on the outside of the sample container, the rotating device is controlled to operate; the barcode is recognized according to at least one image containing the barcode on the outside of the sample container acquired by an image acquisition device, and in the case that the barcode can be successfully recognized according to the at least one image containing the barcode on the outside of the sample container, the sample information of the sample container is determined according to the first recognition result of the barcode; in the case that the barcode cannot be successfully recognized according to the at least one image containing the barcode on the outside of the sample container, the serial code is recognized according to at least one image containing the serial code on the outside of the sample container acquired by the image acquisition device, and the sample information of the sample container is determined according to a second recognition result of the serial code.
本申请实施例还提供了一种控制器,控制器部署于上述样本识别系统中,样本识别系统还包括旋转装置及耦合至控制器的图像获取装置。如图9所示,控制器900包括:The embodiment of the present application further provides a controller, which is deployed in the above sample identification system, and the sample identification system also includes a rotating device and an image acquisition device coupled to the controller. As shown in FIG9 , the controller 900 includes:
通信接口901,能够与其他节点进行信息交互;Communication interface 901, capable of exchanging information with other nodes;
处理器902,与所述通信接口901连接,以实现与其他节点进行信息交互,用于运行计算机程序时,执行上述控制器侧一个或多个技术方案提供的方法。而所述计算机程序存储在存储器903上。The processor 902 is connected to the communication interface 901 to implement information exchange with other nodes, and is used to execute the method provided by one or more technical solutions of the controller side when running the computer program. The computer program is stored in the memory 903.
具体地,所述处理器902,用于在根据至少一张至少包含样本容器外部的条形码的图像能够成功识别出所述条形码的情况下,根据所述条形码的第一识别结果确定所述样本容器的样本信息;在根据至少一张至少包含所述样本容器外部的条形码的图像未能成功识别出所述条形码的情况下,基于至少一张至少包含所述样本容器外部的序列码的图像对所述序列码进行识别,并根据所述序列码的第二识别结果确定所述样本容器的样本信息;其中,至少一张至少包含所述样本容器外部的条形码和/或序列码的图像由 所述图像获取装置在所述旋转装置驱动所述样本容器旋转时拍摄得到。Specifically, the processor 902 is used to determine the sample information of the sample container according to a first recognition result of the barcode when the barcode can be successfully recognized based on at least one image that at least includes the barcode on the outside of the sample container; and to recognize the sequence code based on at least one image that at least includes the sequence code on the outside of the sample container, and determine the sample information of the sample container according to a second recognition result of the sequence code when the barcode cannot be successfully recognized based on at least one image that at least includes the barcode on the outside of the sample container; wherein at least one image that at least includes the barcode and/or the sequence code on the outside of the sample container is The image acquisition device takes pictures when the rotating device drives the sample container to rotate.
在一实施例中,所述处理器902,还用于控制所述旋转装置运行,并在所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,控制所述旋转装置停止运行。In one embodiment, the processor 902 is further configured to control the operation of the rotating device, and control the rotating device to stop operating when the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container.
在一实施例中,所述处理器902,还用于在所述旋转装置运行时,基于所述图像获取装置获取到的图像的图像特征进行识别,得到第三识别结果;或者,通过第三设定神经网络对所述图像获取装置获取到的图像进行处理,得到第三识别结果;In one embodiment, the processor 902 is further configured to, when the rotating device is running, perform recognition based on image features of the image acquired by the image acquisition device to obtain a third recognition result; or, process the image acquired by the image acquisition device through a third set neural network to obtain a third recognition result;
在所述第三识别结果表征所述图像获取装置获取到包含所述样本容器外部的条形码和序列码的图像时,所述控制器控制所述旋转装置停止运行。When the third recognition result indicates that the image acquisition device acquires an image including the barcode and the serial code on the outside of the sample container, the controller controls the rotating device to stop running.
在一实施例中,所述处理器902,具体用于基于所述至少一张至少包含所述样本容器外部的序列码的图像中全部或部分图像的图像特征对所述序列码进行识别,得到所述第二识别结果;或,In one embodiment, the processor 902 is specifically configured to identify the serial code based on image features of all or part of the at least one image at least including the serial code on the outside of the sample container to obtain the second identification result; or
通过第一设定神经网络对所述至少一张至少包含所述样本容器外部的序列码的图像中全部或部分图像进行处理以对所述序列码进行识别,得到所述第二识别结果;所述第一设定神经网络用于识别输入图像中的序列码。The first set neural network is used to process all or part of the at least one image containing at least the serial code on the outside of the sample container to identify the serial code and obtain the second recognition result; the first set neural network is used to identify the serial code in the input image.
在一实施例中,所述通信接口901,用于接收所述图像获取装置发送的所述第一识别结果,并根据所述第一识别结果确定所述样本容器的样本信息;所述第一识别结果由所述图像获取装置基于拍摄的至少包含所述样本容器外部的条形码的图像对所述条形码进行识别得到;In one embodiment, the communication interface 901 is used to receive the first recognition result sent by the image acquisition device, and determine the sample information of the sample container according to the first recognition result; the first recognition result is obtained by the image acquisition device recognizing the barcode based on the image captured by at least the barcode on the outside of the sample container;
所述处理器902,具体用于根据所述第一识别结果确定所述样本容器的样本信息。The processor 902 is specifically configured to determine the sample information of the sample container according to the first recognition result.
在一实施例中,所述至少一张至少包含所述样本容器外部的条形码的图像包括多张图像;所述通信接口901,具体用于接收所述图像获取装置基 于多张图像获取到的至少两个不同的条形码识别结果;In one embodiment, the at least one image at least including the barcode on the outside of the sample container includes a plurality of images; the communication interface 901 is specifically used to receive the image acquisition device based on At least two different barcode recognition results obtained from the multiple images;
所述处理器902,具体用于基于对应的条形码识别结果的出现次数,从所述至少两个不同的条形码识别结果中确定出所述第一识别结果。The processor 902 is specifically configured to determine the first recognition result from the at least two different barcode recognition results based on the number of occurrences of the corresponding barcode recognition results.
在一实施例中,所述处理器902,具体用于对对应的条形码识别结果进行投票;在任一条形码识别结果对应的投票数大于设定阈值的情况下,将投票数大于所述设定阈值的条形码识别结果确定为所述第一识别结果。In one embodiment, the processor 902 is specifically configured to vote on the corresponding barcode recognition results; when the number of votes corresponding to any barcode recognition result is greater than a set threshold, the barcode recognition result with the number of votes greater than the set threshold is determined as the first recognition result.
在一实施例中,所述通信接口901,还用于接收所述图像获取装置发送的所述至少一张至少包含所述样本容器外部的条形码的图像;In one embodiment, the communication interface 901 is further used to receive the at least one image including at least the barcode on the outside of the sample container sent by the image acquisition device;
所述处理器902,还用于基于所述至少一张至少包含所述样本容器外部的条形码的图像中全部或部分图像的图像特征对所述条形码进行识别;或,通过第二设定神经网络对所述至少一张至少包含所述样本容器外部的条形码的图像中全部或部分图像进行处理以对所述条形码进行识别;所述第二设定神经网络用于识别输入图像中的条形码。The processor 902 is further used to identify the barcode based on image features of all or part of the at least one image that at least includes the barcode on the outside of the sample container; or, to process all or part of the at least one image that at least includes the barcode on the outside of the sample container through a second set neural network to identify the barcode; the second set neural network is used to identify the barcode in the input image.
在一实施例中,所述处理器902,还用于从所述图像获取装置获取的多张图像中确定出用于确定所述样本容器的样本信息的所述至少一张至少包含所述样本容器外部的条形码的图像,和/或,所述至少一张至少包含所述样本容器外部的序列码的图像;其中,In one embodiment, the processor 902 is further configured to determine, from the multiple images acquired by the image acquisition device, at least one image including at least a barcode on the outside of the sample container and/or at least one image including at least a serial code on the outside of the sample container for determining the sample information of the sample container; wherein,
所述一张图像的第一参数值大于设定阈值;所述第一参数值表征第一面积与第二面积的比值;所述第一面积表征条形码和/或序列码在所述至少一张图像中占据的面积;所述第二面积表征所述样本容器在所述至少一张图像中占据的面积。The first parameter value of the image is greater than a set threshold; the first parameter value represents a ratio of a first area to a second area; the first area represents an area occupied by a barcode and/or a serial code in the at least one image; and the second area represents an area occupied by the sample container in the at least one image.
在一实施例中,所述处理器902,还用于在未成功识别出所述序列码的情况下,控制所述样本识别系统的人机交互装置在其显示界面上输出报警提示信息;所述报警提示信息表征所述样本容器的样本信息识别失败。 In one embodiment, the processor 902 is further used to control the human-computer interaction device of the sample identification system to output an alarm prompt message on its display interface when the serial code is not successfully identified; the alarm prompt message indicates that the sample information of the sample container has failed to be identified.
在一实施例中,所述处理器902,还用于在所述旋转装置驱动所述样本容器旋转设定圈数之后还未识别出任意条形码的情况下,控制所述旋转装置停止运行。In one embodiment, the processor 902 is further configured to control the rotating device to stop running if no barcode is recognized after the rotating device drives the sample container to rotate a set number of times.
需要说明的是:处理器902和通信接口901的具体处理过程可参照上述方法理解。It should be noted that the specific processing process of the processor 902 and the communication interface 901 can be understood by referring to the above method.
当然,实际应用时,控制器900中的各个组件通过总线系统904耦合在一起。可理解,总线系统904用于实现这些组件之间的连接通信。总线系统904除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图9中将各种总线都标为总线系统904。Of course, in actual application, the various components in the controller 900 are coupled together through the bus system 904. It can be understood that the bus system 904 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 904 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, various buses are marked as the bus system 904 in FIG. 9.
本申请实施例中的存储器903用于存储各种类型的数据以支持控制器900的操作。这些数据的示例包括:用于在控制器900上操作的任何计算机程序。The memory 903 in the embodiment of the present application is used to store various types of data to support the operation of the controller 900. Examples of such data include: any computer program used to operate on the controller 900.
上述本申请实施例揭示的方法可以应用于所述处理器902中,或者由所述处理器902实现。所述处理器902可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过所述处理器902中的硬件的集成逻辑电路或者软件形式的指令完成。上述的所述处理器902可以是通用处理器、数字信号处理器(DSP,Digital Signal Processor),或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。所述处理器902可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的步骤,可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于存储介质中,该存储介质位于存储器903,所述处理器902读取存储器903中的信息,结合其硬件完成前述方法的步骤。The method disclosed in the above embodiment of the present application can be applied to the processor 902, or implemented by the processor 902. The processor 902 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 902 or the instruction in the form of software. The above-mentioned processor 902 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 902 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in the memory 903. The processor 902 reads the information in the memory 903 and completes the steps of the above method in combination with its hardware.
在示例性实施例中,控制器900可以被一个或多个应用专用集成电路 (ASIC,Application Specific Integrated Circuit)、DSP、可编程逻辑器件(PLD,Programmable Logic Device)、复杂可编程逻辑器件(CPLD,Complex Programmable Logic Device)、现场可编程门阵列(FPGA,Field-Programmable Gate Array)、通用处理器、控制器、微控制器(MCU,Micro Controller Unit)、微处理器(Microprocessor)、或者其他电子元件实现,用于执行前述方法。In an exemplary embodiment, the controller 900 may be implemented by one or more application specific integrated circuits. The method can be implemented by an ASIC (Application Specific Integrated Circuit), a DSP, a programmable logic device (PLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), a general-purpose processor, a controller, a microcontroller (MCU), a microprocessor, or other electronic components to execute the aforementioned method.
可以理解,本申请实施例的存储器(存储器903)可以是易失性存储器或者非易失性存储器,也可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(ROM,Read Only Memory)、可编程只读存储器(PROM,Programmable Read-Only Memory)、可擦除可编程只读存储器(EPROM,Erasable Programmable Read-Only Memory)、电可擦除可编程只读存储器(EEPROM,Electrically Erasable Programmable Read-Only Memory)、磁性随机存取存储器(FRAM,ferromagnetic random access memory)、快闪存储器(Flash Memory)、磁表面存储器、光盘、或只读光盘(CD-ROM,Compact Disc Read-Only Memory);磁表面存储器可以是磁盘存储器或磁带存储器。易失性存储器可以是随机存取存储器(RAM,Random Access Memory),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(SRAM,Static Random Access Memory)、同步静态随机存取存储器(SSRAM,Synchronous Static Random Access Memory)、动态随机存取存储器(DRAM,Dynamic Random Access Memory)、同步动态随机存取存储器(SDRAM,Synchronous Dynamic Random Access Memory)、双倍数据速率同步动态随机存取存储器(DDRSDRAM,Double Data Rate Synchronous Dynamic Random Access Memory)、增强型同步动态随机存取存储器(ESDRAM,Enhanced Synchronous Dynamic Random Access Memory)、同步连接动态随机存取存储器(SLDRAM,SyncLink Dynamic Random Access Memory)、直接内存总 线随机存取存储器(DRRAM,Direct Rambus Random Access Memory)。本申请实施例描述的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the memory (memory 903) of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a ferromagnetic random access memory, a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), direct memory access memory (DMA), and the like. Direct Rambus Random Access Memory (DRRAM). The memory described in the embodiments of the present application is intended to include but is not limited to these and any other suitable types of memory.
在示例性实施例中,本申请实施例还提供了一种存储介质,即计算机存储介质,具体为计算机可读存储介质,例如包括存储计算机程序的存储器903,上述计算机程序可由控制器900的处理器902执行,以完成前述电子设备侧方法所述步骤。计算机可读存储介质可以是FRAM、ROM、PROM、EPROM、EEPROM、Flash Memory、磁表面存储器、光盘、或CD-ROM等存储器。In an exemplary embodiment, the embodiment of the present application further provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, a memory 903 storing a computer program, and the computer program can be executed by a processor 902 of a controller 900 to complete the steps described in the aforementioned electronic device side method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.
需要说明的是:“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中术语“至少一种”表示多个中的任意一种或多种中的至少两种的任意组合,例如,包括A、B、C中的至少一种,可以表示包括从A、B和C构成的集合中选择的任意一个或多个元素。The term "and/or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.
另外,本申请实施例所记载的技术方案之间,在不冲突的情况下,可以任意组合。In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.
以上所述,仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。 The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.
Claims (40)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2023/135957 WO2025112057A1 (en) | 2023-12-01 | 2023-12-01 | Sample recognition system and method, controller, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2023/135957 WO2025112057A1 (en) | 2023-12-01 | 2023-12-01 | Sample recognition system and method, controller, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025112057A1 true WO2025112057A1 (en) | 2025-06-05 |
Family
ID=95896081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/135957 Pending WO2025112057A1 (en) | 2023-12-01 | 2023-12-01 | Sample recognition system and method, controller, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2025112057A1 (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140374480A1 (en) * | 2012-02-03 | 2014-12-25 | Siemens Healthcare Diagnostics Inc. | Barcode reading test tube holder |
| US20150241457A1 (en) * | 2012-08-20 | 2015-08-27 | Siemens Healthcare Diagnostics Inc. | Methods and apparatus for ascertaining specimen and/or sample container characteristics while in transit |
| CN110573883A (en) * | 2017-04-13 | 2019-12-13 | 美国西门子医学诊断股份有限公司 | Method and apparatus for determining tag count during sample characterization |
| CN111368574A (en) * | 2020-03-06 | 2020-07-03 | 联想(北京)有限公司 | Bar code identification method and device |
| US20210374382A1 (en) * | 2018-03-16 | 2021-12-02 | Inveox Gmbh | Automated identification, orientation and sample detection of a sample container |
| CN113869077A (en) * | 2021-09-29 | 2021-12-31 | 杭州海康威视数字技术股份有限公司 | A barcode identification method, device and electronic device |
| CN114339046A (en) * | 2021-12-30 | 2022-04-12 | 中元汇吉生物技术股份有限公司 | Image acquisition method, device, equipment and medium based on automatic rotation test tube |
| CN114858793A (en) * | 2021-02-04 | 2022-08-05 | 深圳迈瑞生物医疗电子股份有限公司 | Sample image photographing system, method, and computer-readable storage medium |
| CN115578464A (en) * | 2022-12-07 | 2023-01-06 | 深圳思谋信息科技有限公司 | Bar code identification method and device, computer equipment and readable storage medium |
| CN116773834A (en) * | 2022-03-17 | 2023-09-19 | 深圳迈瑞生物医疗电子股份有限公司 | Sample analysis system and sample analysis method |
-
2023
- 2023-12-01 WO PCT/CN2023/135957 patent/WO2025112057A1/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140374480A1 (en) * | 2012-02-03 | 2014-12-25 | Siemens Healthcare Diagnostics Inc. | Barcode reading test tube holder |
| US20150241457A1 (en) * | 2012-08-20 | 2015-08-27 | Siemens Healthcare Diagnostics Inc. | Methods and apparatus for ascertaining specimen and/or sample container characteristics while in transit |
| CN110573883A (en) * | 2017-04-13 | 2019-12-13 | 美国西门子医学诊断股份有限公司 | Method and apparatus for determining tag count during sample characterization |
| US20210374382A1 (en) * | 2018-03-16 | 2021-12-02 | Inveox Gmbh | Automated identification, orientation and sample detection of a sample container |
| CN111368574A (en) * | 2020-03-06 | 2020-07-03 | 联想(北京)有限公司 | Bar code identification method and device |
| CN114858793A (en) * | 2021-02-04 | 2022-08-05 | 深圳迈瑞生物医疗电子股份有限公司 | Sample image photographing system, method, and computer-readable storage medium |
| CN113869077A (en) * | 2021-09-29 | 2021-12-31 | 杭州海康威视数字技术股份有限公司 | A barcode identification method, device and electronic device |
| CN114339046A (en) * | 2021-12-30 | 2022-04-12 | 中元汇吉生物技术股份有限公司 | Image acquisition method, device, equipment and medium based on automatic rotation test tube |
| CN116773834A (en) * | 2022-03-17 | 2023-09-19 | 深圳迈瑞生物医疗电子股份有限公司 | Sample analysis system and sample analysis method |
| CN115578464A (en) * | 2022-12-07 | 2023-01-06 | 深圳思谋信息科技有限公司 | Bar code identification method and device, computer equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3259068B1 (en) | Detection of barcode tag conditions on sample tubes | |
| US8319823B2 (en) | System and method for panoramic image stitching | |
| US11250943B2 (en) | Sample traceability device and method for medical research and/or diagnosis | |
| US10937152B2 (en) | Inspection support method and inspection support device | |
| CN110737785B (en) | Picture labeling method and device | |
| CN118365699B (en) | Label position deviation detection method, device and detection equipment | |
| CN113870168B (en) | Material counting method, system, computer device and storage medium | |
| WO2014044747A1 (en) | Method and system for detecting 2d barcode in a circular label | |
| Suksawatchon et al. | Shape recognition using unconstrained pill images based on deep convolution network | |
| CN113743434A (en) | Training method of target detection network, image augmentation method and device | |
| CN113536868B (en) | Circuit board fault identification method and related equipment | |
| WO2025112057A1 (en) | Sample recognition system and method, controller, and storage medium | |
| JP2005025417A (en) | Optical information reading device | |
| CN114399623A (en) | General answer recognition method, system, storage medium and computing equipment | |
| US12079683B2 (en) | Methods and systems of harvesting data for training machine learning (ML) model | |
| CN118671078A (en) | New energy battery cell packaging detection method and device, electronic equipment and storage medium | |
| EP4579680A1 (en) | Sample analysis system and sample information display method | |
| CN110765991B (en) | High-speed rotating electrical machine fuse real-time detection system based on vision | |
| Tian et al. | Fast batch reading densely deployed QR codes | |
| CN111243014B (en) | Face detection processing method, device and equipment | |
| CN112987276A (en) | Smear posture adjusting device and method, cell image analyzer and storage medium | |
| TWI764473B (en) | Method, terminal device, electronic device and storage medium for object detection | |
| US20230306630A1 (en) | Image analysis server, object counting method using image analysis server, and object counting syste | |
| US20230252802A1 (en) | Technique for identifying a container and verifying human-readable information | |
| CN120852522A (en) | Sample tube preservation method and device based on image recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23959963 Country of ref document: EP Kind code of ref document: A1 |