WO2022065275A1 - Drug identification system and drug identification method - Google Patents

Abstract

Provided are a drug identification system and drug identification method that improve readability of a drug display and make it possible to acquire ample information pertaining to identification of a drug based on display information. The present invention is provided with: a first lighting device (80) that is disposed on a first surface side of a drug (12) and illuminates the drug from the first surface side; a first imaging device (72) that is disposed on a second surface side opposite from the first surface of the drug, and images the drug from the second surface side; and at least one processor. The processor acquires, from the first imaging device, a first transmitted light image of the drug from when the drug was irradiated with illumination light from the first lighting device, acquires second display information of the drug, said information being displayed on the second surface of the drug, from the first transmitted light image, and identifies the drug on the basis of the acquired display information.

Description

Drug identification system and drug identification method

The present invention relates to a drug identification system and a drug identification method.

A drug identification device that identifies the type of drug is used when conducting dispensing audits at pharmacies and discrimination of brought-in drugs at hospitals, etc. For example, a drug identification device that provides information on a candidate drug to be identified based on a collation result between a photographed image of a drug and a master image is known.

Patent Document 1 describes a tablet inspection device that inspects the number of tablets enclosed in a medicine package, the type of tablet, and the state of the tablet. The device described in the same document irradiates light from the lower surface of the transport path of the drug continuum, photographs the drug enclosed in the drug package from the upper surface of the transport path, and captures the number of tablets of the drug based on the photographed image of the drug. Inspect.

Patent Document 2 describes a drug recognition device that collates a photographed image of a drug with a master image and recognizes which drug the photographed image indicates. The apparatus described in the same document irradiates the illumination light from the upper side of the drug and irradiates the illumination light from the lower side of the first camera and the drug to acquire a photographed image of the upper surface of the drug, and under the drug. A second camera for acquiring a captured image of the side surface is provided.

Japanese Patent No. 6093655 International Publication No. 2018/173649

However, when collating the photographed image of the drug with the master image, it is necessary that sufficient information for identifying the drug is acquired from the photographed image of the drug. However, in the case of a drug with a shallow marking, the drug identification device that irradiates the drug with illumination light and acquires a photographed image of the drug based on the reflected light of the illumination light has the marking and the marking on the photographed image of the drug. It is difficult to secure the contrast with the non-engraved area, and there is a possibility that sufficient information for identifying the drug cannot be obtained from the photographed image of the drug.

The device described in Patent Document 1 can recognize the number of drugs and the form of the drug such as whether the drug to be inspected is a tablet or a capsule, but it is difficult to recognize the display itself such as engraving and printing of the drug. be. That is, Patent Document 1 does not describe or suggest a technique for recognizing a drug stamp based on a photographed image of the drug.

The device described in Patent Document 2 irradiates the drug to be imaged with illumination light from the same side as the light receiving surface of the camera, and the camera receives the reflected light of the drug to generate a photographed image of the drug. As described above, the drug identification device based on the reflected light for photographing the drug may have a problem that it is difficult to obtain sufficient information for identifying the drug from the photographed image of the drug.

The present invention has been made in view of such circumstances, and provides a drug identification system and a drug identification method that improve the readability of drug display information and enable acquisition of sufficient information regarding drug identification based on the display information. The purpose is to provide.

In order to achieve the above object, the following aspects of the invention are provided.

The drug identification system according to the present disclosure is a first lighting device that is arranged on the front surface side of the drug and illuminates the drug from the first surface side, and a second surface opposite to the first surface of the drug. It is provided with a first imaging device, which is arranged on the side and images the drug from the side of the second surface, and one or more processors, in which the processor is the first of the drugs when the first lighting device irradiates the drug with illumination light. One transmitted light image is acquired from the first photographing device, the second display information displayed on the second surface of the drug is acquired from the first transmitted light image, and the drug is identified based on the acquired second display information. It is a system.

According to the drug identification system according to the present disclosure, a first transmitted light image in which the second display information displayed on the second surface of the drug is emphasized is acquired. Thereby, when the second display information on the second surface of the drug is stamped, the readability of the stamp can be improved.

The drug to be photographed may include a form in which one or more drugs are packaged using a packing paper or the like.

The packaging member for packaging the drug may be an opaque material such as a transparent material or a translucent material that transmits at least a part of the illumination light. The packaging member for packaging the drug may be in the form of a sheet. As the material of the packaging member, paper, film and the like can be applied.

Drug identification includes dispensing audits conducted at pharmacies, etc. The identification of the drug includes the discrimination performed for the drug brought at the time of admission in a hospital or the like.

In the drug identification system according to another aspect, a second lighting device that illuminates the drug from the side of the second surface is provided, and the processor is the first reflected light of the drug when the lighting light is applied to the drug from the second lighting device. The image is acquired from the first photographing device, the second display information is acquired from the first reflected light image, and the drug is identified based on the acquired second display information.

According to this aspect, the first reflected light image of the second surface of the drug is acquired. As a result, the second display information represented by the printing on the second side of the drug can be obtained.

In the drug identification system according to another aspect, a reversing device for reversing the positions of the first photographing device and the second lighting device and the first lighting device is provided on the side of the first surface and the side of the second surface.

According to such an embodiment, it is possible to obtain display information on both sides of the drug without inverting the drug on the first and second surfaces.

In the drug identification system according to another aspect, the processor is a second display information in the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied. And identify the drug based on the acquired second display information.

According to such an embodiment, it is possible to identify the drug packaged in at least one of the opaque packaging member and the transparent packaging member.

In the drug identification system according to another aspect, the processor acquires the second display format information indicating the display format of the second display information as the second display information of the drug to be identified, and packages the drug to be identified. When the packaging member information, which is the information of the packaging member, is acquired, the second display format information is engraved, and the packaging member information is an opaque member, the illumination light is emitted from the first lighting device to the drug to be identified. Irradiate and acquire the first transmitted light image.

According to such an embodiment, when the second display information is a stamp and the packaging member is opaque, the first transmitted light image in which the stamp is emphasized can be obtained.

In the drug identification system according to another aspect, the processor acquires the second display format information indicating the display format of the second display information as the second display information of the drug to be identified, and packages the drug to be identified. The packaging member information, which is the information of the packaging member, is acquired, and the medicine to be identified is irradiated with the illumination light from the first lighting device according to the combination of the second display format information and the packaging member information, and the first transmission is performed. It is selectively switched between acquiring an optical image or irradiating the agent to be identified with illumination light from the second lighting device to acquire the first reflected light image.

According to such an embodiment, the first transmitted light image and the first reflected light image can be selectively acquired according to the combination of the display format of the drug and the type of the packaging member.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the first lighting device when the second display format information is stamped and the packaging member information is an opaque member. And acquire the first transmitted light image.

According to such an embodiment, when the second display information is a stamp and the packaging member is opaque, the first transmitted light image in which the stamp is emphasized can be obtained.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the second lighting device when the second display format information is printing and the packaging member information is an opaque member. And acquire the first reflected light image.

According to this aspect, the first reflected light image is acquired when the second display information is printing and the packaging member is opaque.

In the drug identification system according to another aspect, the processor second-illuminates the drug to be identified when the second display format information is non-display of the second display information and the packaging member information is a transparent member. The first reflected light image is acquired by irradiating the illumination light from the device.

According to this aspect, the first reflected light image is acquired when the second display information is hidden and the packaging member is transparent.

In the drug identification system according to the other aspect, the processor first refers to the drug to be identified when the second display format information is stamped and the packaging member information is the transparent member or the packaging member is not used. The first transmitted light image is acquired by irradiating the illumination light from the illumination device.

According to such an embodiment, the first transmitted light image is acquired when the second display information is engraved and the packaging member is transparent or not used.

In the drug identification system according to another aspect, a third lighting device which is arranged on the second side of the drug and illuminates the drug from the side of the second surface and a third lighting device which is arranged on the side of the first surface of the drug. A second photographing device for photographing the drug from the side of the first surface is provided, and the processor acquires a second transmitted light image of the drug when the illumination light is applied to the drug from the third lighting device from the second photographing device. Then, the first display information displayed on the first surface of the drug is acquired from the second transmitted light image, and the drug is identified based on the acquired first display information.

According to such an embodiment, the first display information displayed on the first surface of the drug is acquired from the second transmitted light image without inverting the drug on the first surface and the second surface, and is based on the first display information. Drug identification can be performed.

In the drug identification system according to another aspect, a fourth lighting device that illuminates the drug from the side of the first surface is provided, and the processor is a second reflected light of the drug when the illumination light is applied to the drug from the fourth lighting device. The image is acquired from the second photographing device, the first display information is acquired from the second reflected light image, and the drug is identified based on the acquired first display information.

According to such an embodiment, the first display information displayed on the first surface of the drug is acquired from the second reflected light image without inverting the drug on the first surface and the second surface, and is based on the first display information. Drug identification can be performed.

In the drug identification system according to another aspect, the processor is the first display information in the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied. And identify the drug based on the acquired first display information.

According to such an embodiment, it is possible to identify the drug packaged in at least one of the opaque packaging member and the transparent packaging member.

In the drug identification system according to another aspect, a second lighting device that illuminates the drug from the side of the second surface is provided, and the processor is the first reflected light of the drug when the lighting light is applied to the drug from the second lighting device. The image is acquired from the first photographing device, the second display information is acquired from the first reflected light image, and the drug is identified based on the acquired second display information.

According to this aspect, the first reflected light image of the second surface of the drug is acquired. As a result, the second display information represented by the printing on the second side of the drug can be obtained.

In the drug identification system according to another aspect, the processor is a second display information in the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied. And identify the drug based on the acquired second display information.

According to such an embodiment, it is possible to identify the drug packaged in at least one of the opaque packaging member and the transparent packaging member.

In the drug identification system according to another aspect, the processor acquires the first display format information indicating the display format of the first display information as the first display information of the drug to be identified, and packages the drug to be identified. The packaging member information, which is the information of the packaging member, is acquired, and the drug to be identified is irradiated with the illumination light from the third lighting device according to the combination of the first display format information and the packaging member information, and the second transmission is performed. It selectively switches between acquiring an optical image or irradiating the agent to be identified with illumination light from the fourth lighting device to acquire a second reflected light image.

According to such an embodiment, the second transmitted light image and the second reflected light image can be selectively acquired according to the combination of the first display format information and the type of the packing paper.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the third lighting device when the first display format information is stamped and the packaging member information is an opaque member. And acquire the second transmitted light image.

According to such an embodiment, when the first display information is a stamp and the packaging member is an opaque member, a second transmitted light image in which the stamp is emphasized can be obtained.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the fourth lighting device when the first display format information is printing and the packaging member information is an opaque member. And acquire the second reflected light image.

According to this aspect, the second reflected light image is acquired when the first display information is printing and the packing paper information is opaque.

In the drug identification system according to the other aspect, the processor displays the first display format information in the non-display of the first display information and the fourth illumination to the drug to be identified when the packaging member information is a transparent member. The second reflected light image is acquired by irradiating the illumination light from the device.

According to this aspect, the second reflected light image is acquired when the first display information is hidden and the packaging member is transparent.

In the drug identification system according to the other aspect, the processor sends the drug to be identified to the drug to be identified when the first display format information is stamped and the packaging member information is the transparent member or the packaging member is not used. The second transmitted light image is acquired by irradiating the illumination light from the lighting device.

According to this aspect, the second transmitted light image is acquired when the first display information is engraved and the packaging member is transparent or not used.

In the drug identification system according to another aspect, a second lighting device that illuminates the drug from the side of the second surface is provided, and the processor is the first reflected light of the drug when the lighting light is applied to the drug from the second lighting device. The image is acquired from the first photographing device, the second display information is acquired from the first reflected light image, and the drug is identified based on the acquired second display information.

According to this aspect, the first reflected light image of the second surface of the drug is acquired. As a result, the second display information represented by the printing on the second side of the drug can be obtained.

In the drug identification system according to another aspect, the processor acquires the second display format information indicating the display format of the second display information as the second display information of the drug to be identified, and separates the second display format information from the second display format information. Depending on the combination with the member information, the drug to be identified is irradiated with the illumination light from the first lighting device to acquire the first transmitted light image, or the drug to be identified is irradiated with the illumination light from the second lighting device. Selectively switch whether to acquire the first reflected light image.

According to such an embodiment, the first transmitted light image and the first reflected light image can be selectively acquired according to the combination of the display format of the drug and the type of the packaging member.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the first lighting device when the second display format information is stamped and the packaging member information is an opaque member. And acquire the first transmitted light image.

According to such an embodiment, when the second display information is a stamp and the packaging member is opaque, the first transmitted light image in which the stamp is emphasized can be obtained.

In the drug identification system according to another aspect, the processor irradiates the drug to be identified with illumination light from the second lighting device when the second display format information is printing and the packaging member information is an opaque member. And acquire the first reflected light image.

According to this aspect, the first reflected light image is acquired when the second display information is printing and the packaging member is opaque.

In the drug identification system according to another aspect, the processor second-illuminates the drug to be identified when the second display format information is non-display of the second display information and the packaging member information is a transparent member. The first reflected light image is acquired by irradiating the illumination light from the device.

According to this aspect, the first reflected light image is acquired when the second display information is hidden and the packaging member is transparent.

In the drug identification system according to the other aspect, the processor first refers to the drug to be identified when the second display format information is stamped and the packaging member information is the transparent member or the packaging member is not used. The first transmitted light image is acquired by irradiating the illumination light from the illumination device.

According to such an embodiment, the first transmitted light image is acquired when the second display information is engraved and the packaging member is transparent or not used.

In the drug identification system according to another aspect, a contact adjusting device for adjusting the degree of contact between the packaging member for packaging the drug and the drug is provided.

According to this aspect, the packaging member can be brought into close contact with the drug, and a transmitted light image with improved readability of display information such as engraving can be obtained.

In the drug identification system according to another aspect, the contact adjusting device includes a pressing member that presses the packaging member around the drug on the side where the drug is imaged.

According to such an embodiment, the packaging member can be pressed against the drug to bring the drug and the packaging member into close contact with each other.

In the drug identification system according to another aspect, the contact adjusting device is a gas between a sheet-like member that covers the packaging member on the side where the drug is imaged, and a mounting member and the sheet-like member on which the drug is placed. It is equipped with a degassing device for degassing.

According to such an embodiment, the packaging member can be pressed against the drug to bring the drug and the packaging member into close contact with each other.

In the drug identification system according to another aspect, a support member for supporting the drug is provided on the side opposite to the side on which the drug is imaged.

According to such an embodiment, the position of the drug to be identified can be fixed.

In the drug identification method according to the present disclosure, a first lighting device arranged on the front surface side of the drug is applied to illuminate the drug from the first surface side, which is opposite to the first surface of the drug. The first transmitted light image of the drug when the drug is photographed from the side of the second surface and the illumination light is applied to the drug from the first lighting device by applying the first imaging device arranged on the side of the second surface. Is acquired from the first imaging device, the second display information of the drug displayed on the second surface of the drug is acquired from the first transmitted light image, and the drug is identified based on the acquired second display information by the drug identification method. be.

According to the drug identification method according to the present disclosure, the same action and effect as the drug identification system according to the present disclosure can be obtained.

The components in the drug identification system according to other aspects can be grasped as the components corresponding to the drug identification method according to the present disclosure.

According to the present invention, a first transmitted light image in which the second display information displayed on the second surface of the drug is emphasized is acquired. Thereby, when the second display information on the second surface of the drug is stamped, the readability of the stamp can be improved.

FIG. 1 is an overall configuration diagram of a drug identification system according to the first embodiment. FIG. 2 is a perspective view showing a configuration example of the photographing unit shown in FIG. FIG. 3 is a schematic view of the first lighting device and the second lighting device shown in FIG. 1 as viewed from the front. FIG. 4 is a schematic view of the first lighting device and the second lighting device shown in FIG. 1 as viewed from above. FIG. 5 is an operation explanatory view of the pressing mechanism shown in FIG. FIG. 6 is a perspective view showing a configuration example of the pressing mechanism shown in FIG. FIG. 7 is a mechanical block diagram of the drug identification system shown in FIG. FIG. 8 is a schematic diagram showing photography of a drug to be packaged using transparent packaging paper. FIG. 9 is a schematic diagram showing photography of an engraved type drug to be packaged using opaque packaging paper. FIG. 10 is an explanatory diagram of transmitted light and forward scattered light. FIG. 11 is a schematic diagram showing photography of a print-type drug to be packaged using opaque packaging paper. FIG. 12 is a schematic view of the holding mechanism according to the first modification and the mounting table according to the modification. FIG. 13 is a perspective view and a cross-sectional view of the pedestal member according to the modified example. FIG. 14 is a schematic view of the pressing mechanism according to the second modification. FIG. 15 is a schematic view of the pressing mechanism according to the third modification. 16 is a side view of FIG. 15. FIG. 17 is a top view of the medicine wrapping paper shown in FIG. FIG. 18 is a schematic view of the pressing mechanism according to the fourth modification. FIG. 19 is a schematic view of the pressing mechanism according to the fifth modification. FIG. 20 is an operation explanatory diagram of the pressing mechanism shown in FIG. FIG. 21 is a flowchart showing the procedure of the drug identification method according to the first embodiment. FIG. 22 is a schematic diagram of a drug identification system according to an application example. FIG. 23 is a perspective view showing a configuration example of the drug identification system according to the second embodiment. FIG. 24 is an explanatory diagram of a usage state of the photographing unit shown in FIG. 23. FIG. 25 is a perspective view showing a configuration example of a pressing mechanism applied to the drug identification system according to the third embodiment. FIG. 26 is a perspective view showing a state in which a drug is set in the pressing mechanism shown in FIG. 25. FIG. 27 is a perspective view showing a state in which a drug is sandwiched in the pressing mechanism shown in FIG. 25. FIG. 28 is a perspective view showing a configuration example of a photographing device and a lighting device applied to the drug identification system according to the third embodiment. FIG. 29 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view showing a state in which the drug is set. FIG. 30 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view view showing a state when surface imaging of the drug is performed. FIG. 31 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view view showing a state when backside photographing of the drug is performed. FIG. 32 is a perspective view showing a modified example of the drug identification system according to the third embodiment. FIG. 33 is a perspective view showing a configuration example of the drug identification system according to the fourth embodiment. FIG. 34 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a state when surface imaging of the drug is performed. FIG. 35 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a switching state between front surface imaging and back surface imaging. FIG. 36 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a state when backside photographing of the drug is performed. FIG. 37 is an explanatory diagram of a display format of the drug. FIG. 38 is an explanatory diagram showing a first display example of the identification result displayed on the display device shown in FIG. FIG. 39 is an explanatory diagram showing a second display example of the identification result displayed on the display device shown in FIG. 1, and is an explanatory diagram when a collation error does not occur. FIG. 40 is an explanatory diagram showing a second display example of the identification result displayed on the display device shown in FIG. 1, and is an explanatory diagram when a collation error has occurred. FIG. 41 is a schematic diagram when the drug to be identified is not packaged. FIG. 42 is a schematic diagram showing an example of application of a drug identification system to a network system.

Hereinafter, embodiments of the present invention will be described in detail according to the accompanying drawings. In the present specification, the same components are designated by the same reference numerals, and duplicate description will be omitted as appropriate.

[Issues of drug identification]
The issues of drug identification will be described. Drug identification includes drug dispensing audits based on prescription information conducted at pharmacies, hospitals, etc. In addition, drug identification includes identification of drugs brought at the time of admission, which is carried out at hospitals and the like.

In general, the character size of chemicals for engraving and printing is small, and especially for engraved type chemicals, the contrast between the engraved part and the non-engraved part is low. Is low. In addition, the readability of the stamp is generally low even in the case of non-packaging in which the drug is exposed.

Opaque glassine paper is sold as a packing paper used for packaging. When the engraving type chemical is packaged using glassine paper, the readability of the engraving is further reduced due to the diffusion and scattering of light on the surface of the glassine paper and the like.

The readability of the engraving tends to decrease due to the relatively large distance between the packaging paper such as glassine paper and the drug. Then, it is difficult to identify the drug to be packaged using an opaque packaging paper such as glassine paper based on the information represented by the display such as engraving and printing.

On the other hand, drug identification is preferably carried out in a packaged state as much as possible. The inexpensive glassine paper is one of the main packaging papers in one packaging, and it is preferable that the identification of the drug packaged using the glassine paper can be supported by applying an image processing technique or the like.

On the other hand, the identification of the drug to be packaged using an opaque packaging paper such as glassine paper is performed by acquiring a signal indicating engraving and printing while the drug is packaged and having high accuracy based on the acquired signal. Matching needs to be achieved. In the embodiments described below, the identification of the drug in the packaged state using the packaging paper will be described in detail. The drug identification is synonymous with the drug identification. The same applies to the following description.

[First Embodiment]
[Overall configuration example of drug identification system]
FIG. 1 is an overall configuration diagram of a drug identification system according to the first embodiment. The drug identification system 10 shown in the figure includes an imaging unit 20, a processing device 30, a display device 40, and an input device. Note that FIG. 1 shows a keyboard 52 and a mouse 54 as components of the input device. The input device is illustrated in FIG. 7 using reference numeral 50.

The photographing unit 20 includes a photographing device 22, a lighting device 24, a mounting table 26, and a holding mechanism 28. The photographing device 22 includes a camera and a frame 70. In FIG. 1, the illustration of the camera is omitted. The camera is illustrated in FIG. 2 using reference numeral 72.

The lighting device 24 includes a first lighting device and a second lighting device 82. The first lighting device is located on the side opposite to the photographing device 22 of the mounting table 26, and is arranged inside the mounting table 26. In FIG. 1, the illustration of the first lighting device is omitted. The first illuminating device is illustrated with reference numeral 80 in FIG.

The second lighting device 82 is arranged at a position on the mounting table 26 on the side of the photographing device 22. The second illuminating device 82 includes an LED array supported by the internal measuring surface of the frame 84. LED is an abbreviation for Light Emitting Diode. The LED array is illustrated in FIG. 2 using reference numeral 86.

The mounting table 26 supports the drug 12 to be identified. The agent 12 to be identified shown in FIG. 1 shows a state of being packaged using the packaging paper 14. One medicine 12 or a plurality of medicines 12 are enclosed in the packing paper 14 shown in FIG. Further, FIG. 1 shows a sachet continuum in which a plurality of sachets are continuous. As the packing paper, translucent glassine paper may be applied. A transparent packing paper may be applied.

The pressing mechanism 28 includes a pressing plate, a pressing plate bracket 91, a pressing plate drive mechanism 92, and an elevating motor 93. The pressing mechanism 28 presses the drug 12 from the side opposite to the mounting table 26 when photographing the drug 12 to be identified, and adjusts the degree of contact between the drug 12 and the packing paper 14.

Adjusting the degree of contact between the medicine 12 and the packing paper 14 means that the medicine 12 and the packing paper 14 are in close contact with each other, the medicine 12 and the packing paper 14 are in close contact with each other, and the close contact state is between the close contact state and the packing paper 14. It means adjusting the positional relationship between the medicine 12 and the packing paper 14 to the state.

An example of the state of close contact between the drug 12 and the packing paper 14 is a state in which 70% or more of the total area of the surface of the drug 12 to be identified is in contact with the packing paper 14. As an example of the proximity state between the drug 12 and the packing paper 14, the surface of the drug 12 to be identified and the packing paper 14 are not in contact with each other, and the distance between the surface of the drug 12 to be identified and the packing paper 14 is large. The state of 1 mm or less can be mentioned. As the distance between the surface of the agent 12 to be identified and the packing paper 14, representative values such as a maximum value, a minimum value, and an average value can be applied.

In FIG. 1, the holding plate is not shown. The holding plate is illustrated with reference numeral 90 in FIG. The pressing mechanism 28 described in the embodiment is an example of a contact adjusting device. The holding plate 90 described in the embodiment is an example of a pressing member.

The photographing unit 20 irradiates the agent 12 to be identified with illumination light from the first lighting device 80 or the second lighting device 82, and photographs the front surface of the agent 12 to be identified using the photographing device 22. Then, the captured image of the agent 12 to be identified is transmitted to the processing device 30. Here, the term image may include the meaning of image data, which is an electrical signal representing an image.

The processing device 30 acquires a photographed image of the drug 12 to be identified, collates the photographed image of the drug 12 to be identified with the master image, and identifies the drug 12 to be identified. The processing device 30 transmits a display signal indicating the identification result of the drug 12 to be identified to the display device 40. The processing device 30 may apply a computer.

The display device 40 acquires the display signal transmitted from the processing device 30 and displays the identification result of the drug 12 to be identified. The input device including the keyboard 52 and the mouse 54 transmits an input signal based on the operation of the operator to the processing device 30. The display device 40 may be configured integrally with the input device by applying a touch panel.

[Configuration example of shooting unit]
FIG. 2 is a perspective view showing a configuration example of the photographing unit shown in FIG. The photographing apparatus 22 shown in FIG. 2 cut a part of the frame 70 to visualize the internal structure of the frame 70. Similarly, the lighting device 24 cut a part of the frame 84 to visualize the internal structure of the frame 84, and cut a part of the mounting table 26 to visualize the inside of the mounting table 26. In FIG. 2, a two-dot chain line is used to simplify and illustrate the sachet continuum shown in FIG.

In the photographing device 22, the camera 72 is arranged inside the frame 70. The camera 72 is arranged so that the photographing surface faces the mounting table 26, and is supported by the support member. The support member that supports the camera 72 is not shown.

The camera 72 includes an optical system including a zoom lens and the like. The camera 72 includes a photographing element such as a CCD image sensor. CCD is an abbreviation for Charge Coupled Device.

The camera 72 includes a signal processing circuit that processes an electric signal output from the image sensor. The camera 72 generates a photographed image of the drug 12 to be identified. The camera 72 transmits an electric signal representing a photographed image of the drug 12 to be identified to the processing device 30 shown in FIG. USB (Universal Serial Bus) can be mentioned as an example of the communication interface of the camera 72. The optical system, the image sensor, and the signal processing circuit are not shown.

The camera 72 described in the embodiment is an example of a first imaging device that is arranged on the side of the second surface opposite to the first surface of the drug and photographs the drug from the side of the second surface. The front surface of the drug 12 according to the embodiment is an example of the second surface of the drug.

FIG. 3 is a schematic view of the first lighting device and the second lighting device shown in FIG. 1 as viewed from the front. FIG. 4 is a schematic view of the first lighting device and the second lighting device shown in FIG. 1 as viewed from above. In FIG. 4, the illustration of the first lighting device 80 is omitted.

Reference numeral x in FIGS. 3 and 4 indicates the arrangement direction of the packing paper in the continuous packing paper in the state where the drug 12 is placed on the mounting table 26, and represents the longitudinal direction of the continuous packing paper. The symbol z shown in FIG. 3 represents a vertical upward direction. The symbol y shown in FIG. 4 represents the lateral direction of the continuous packing paper. Hereinafter, the configuration of the lighting device 24 will be described with reference to FIGS. 2 to 4 as appropriate.

An LED light source arranged inside the mounting table 26 shown in FIG. 2 is applied to the first lighting device 80. The first lighting device 80 is arranged at a position corresponding to the position of the through hole 26A formed in the mounting table 26. The first lighting device 80 illuminates the back surface of the agent 12 mounted on the upper surface 26B of the mounting table 26 from the lower side of the mounting table 26 on the side opposite to the photographing device 22 of the mounting table 26. Functions as transmitted light illumination to illuminate.

The first lighting device 80 described in the embodiment is an example of a first lighting device that is arranged on the side of the first surface of the drug and illuminates the drug from the side of the first surface. The back surface of the drug 12 described in the embodiment is an example of the first surface of the drug.

The second lighting device 82 includes four LED arrays 86. 2 and 3 show two LED arrays 86 out of the four LED arrays 86. Each of the inner surfaces of the four sides constituting the frame 84 supports the LED array 86.

As shown in FIG. 4, of the four LED arrays 86, two LED arrays 86 are arranged at positions facing each other across the optical axis 74 of the camera 72. Further, the four LED arrays 86 are arranged so as to be displaced by 90 degrees on the plane orthogonal to the optical axis 74 of the camera 72. Further, among the four LED arrays 86, the positions of the two LED arrays 86 facing each other are equidistant from the optical axis 74 of the camera 72.

The second lighting device 82 is used as reflected light illumination that irradiates the agent 12 mounted on the upper surface 26B of the mounting table 26 from the upper side of the mounting table 26, which is the side of the photographing device 22 of the mounting table 26. Function.

The second lighting device 82 described in the embodiment is an example of the second lighting device that illuminates the drug from the side of the second surface.

FIG. 5 is an operation explanatory diagram of the pressing mechanism shown in FIG. Hereinafter, the configuration and operation of the pressing mechanism 28 will be described with reference to FIG. 2 as appropriate. The holding plate 90 is fixed to the tip of the holding plate bracket 91. The presser plate bracket 91 is connected to the presser plate drive mechanism 92. The holding plate drive mechanism 92 is connected to the rotating shaft of the elevating motor 93.

When the elevating motor 93 is rotated, the holding plate drive mechanism 92 moves up and down. The holding plate bracket 91 and the holding plate 90 move up and down according to the raising and lowering of the holding plate drive mechanism 92.

That is, the rotation amount of the elevating motor 93 is controlled to control the vertical position of the holding plate 90, and the degree of pressing of the holding plate 90 against the packing paper 14 is adjusted. A rotation amount control type motor such as a stepping motor is applied to the elevating motor 93.

FIG. 6 is a perspective view showing a configuration example of the pressing mechanism shown in FIG. The holding plate drive mechanism 92 includes a first linear guide 100, a second linear guide 102, a spring 104, and a guide rail 106. The holding plate bracket 91 is connected to the second linear guide 102. The second linear guide 102 is connected to the first linear guide 100 via a spring 104.

The first linear guide 100 and the second linear guide 102 are supported so as to be able to move up and down by using the guide rail 106. The first linear guide 100 and the second linear guide 102 are regulated by using the shaft 108, and the urging force of the spring 104 is applied between them.

The first linear guide 100 is connected to the timing belt 110. The timing belt 110 has an endless shape and is wound around the drive pulley 112 and the driven pulley 114. The drive pulley 112 is connected to the rotating shaft of the elevating motor 93.

The timing belt 110 travels in response to the rotational drive in the specified rotational direction of the elevating motor 93. The first linear guide 100 and the second linear guide 102 are lowered according to the traveling of the timing belt 110. The pressing plate 90 comes into contact with the packing paper 14 shown in FIG. 1 and the like, and when the pressing plate 90 further lowers, the spring 104 is compressed according to the stress received from the agent 12. As a result, a certain urging force is given to the drug 12 regardless of the size of the drug 12.

[Functional block of drug identification system]
FIG. 7 is a mechanical block diagram of the drug identification system shown in FIG. In FIG. 7, the keyboard 52 and the mouse 54 shown in FIG. 1 are shown as an input device 50. The processing device 30 includes a processor 200, a memory 202, a master image storage unit 204, an input interface 206, and an input / output port 208.

The processor 200 executes various programs to realize various functions in the drug identification system 10. The various processing units of the processor 200 shown in FIG. 7 correspond to various functions realized by the processor 200.

The memory 202 can store various data generated during various processes. The memory 202 can store programs corresponding to various functions. The memory 202 may store various parameters used when executing the program.

The memory 202 may be configured to include a computer-readable medium or the like which is a tangible object such as a semiconductor memory. The memory 202 may include a magnetic storage device such as a hard disk. The memory 202 may be configured by using a plurality of storage devices and the like. The plurality of storage devices and the like may include a plurality of different types of storage devices and the like. The storage device or the like constituting the memory 202 may be divided into a plurality of storage areas. The memory 202 may include a temporary storage area for various data.

The master image storage unit 204 stores a master image to be collated with the drug to be identified. The master image storage unit 204 may apply a storage device arranged outside the processing device 30. The master image storage unit 204 can store the captured image of the drug 12 acquired from the imaging device 22 as a master image.

For example, when identifying the drug 12 to be packaged using a continuous package, the photographed image of the drug 12 in the first package is stored as a master image, and the drugs 12 in the second and subsequent packages are collated. You may. When the photographed image of the drug 12 in the second and subsequent packages is different from the photographed image of the drug 12 in the first package, the master image for storing the photographed image of the drug 12 in the second and subsequent packages as a master image is updated. May be good.

The master image storage unit 204 may be linked with an external master image database of the processing device 30 to acquire a master image from the master image database.

The input interface 206 acquires an input signal transmitted from the input device 50. Either wired communication or wireless communication may be applied to the input interface 206.

The input / output port 208 functions as an interface for performing data communication with the external device of the processing device 30. The input / output port 208 may include a plurality of ports corresponding to each of the plurality of communication standards. The input / output port 208 may include a plurality of ports corresponding to the same communication standard.

The processor 200 includes a system control unit 220. The system control unit 220 functions as an overall control unit that collectively controls the drug identification system 10. The system control unit 220 transmits command signals to various processing units. Further, the system control unit 220 functions as a memory controller that controls storage of data and the like in the memory 202 and reading of data and the like from the memory 202.

The processor 200 includes a lighting control unit 222. The lighting control unit 222 controls the operation of the lighting device 24 based on the command signal transmitted from the system control unit 220. For example, the lighting control unit 222 selectively switches between using the first lighting device 80 and the second lighting device 82 shown in FIG. 1 based on the specified lighting conditions.

The lighting control unit 222 controls the amount of light of the first lighting device 80 and the second lighting device 82. Further, the lighting control unit 222 performs switching control of the four LED arrays 86 provided in the first lighting device 80.

The processor 200 includes a shooting control unit 224. The shooting control unit 224 sets the shooting conditions of the shooting device 22 based on the command signal transmitted from the system control unit 220, and controls the operation of the shooting device 22.

The processor 200 includes an image processing unit 226. The image processing unit 226 acquires a photographed image of the agent 12 to be identified transmitted from the photographing apparatus 22. The image processing unit 226 performs various image processing such as trimming processing and enhancement processing on the captured image of the agent 12 to be identified.

The processor 200 includes a drive control unit 228. The drive control unit 228 controls the operation of the pressing mechanism 28. Specifically, the drive control unit 228 functions as a motor driver that controls the operation of the elevating motor 93 shown in FIG. 1 and the like. The drive control unit 228 acquires sensor signals transmitted from various sensors provided in the pressing mechanism 28, and controls the operation of the elevating motor 93 according to the sensor signals.

The drive control unit 228 adjusts the position of the holding plate 90 in the vertical direction according to the type of the medicine 12 and the type of the packing paper 14, and adjusts the pushing pressure applied to the medicine 12 and the packing paper 14. Thereby, the degree of contact between the medicine 12 and the packing paper 14 is adjusted.

The processor 200 includes a drug information acquisition unit 230. The drug information acquisition unit 230 acquires various information applied to the identification of the drug 12 to be identified, such as the information described in the prescription information and the information described in the drug notebook. The name, code number, appearance characteristics, etc. of the drug 12 may be applied to various information regarding the drug 12 to be identified.

The appearance of the drug may include color, shape and display format. The shape of the drug may include the overall shape of the drug, the position of the marking, the shape of the marking, and the like. The display format indicates whether the display is engraved, printed, or hidden.

Various information regarding the drug 12 to be identified includes information on the type of packing paper 14. The information on the type of the packing paper 14 includes information on whether the packing paper 14 is transparent or opaque. As the identification information of the drug 12, a plurality of information may be used in combination.

An example of the opaque packing paper 14 is a packing paper having a haze value of 80% or more measured by applying a measuring method based on the method for determining the haze value of a plastic-transparent member specified in ISO 14782. Be done. An example of the transparent packing paper 14 is a packing paper 14 having a haze value of less than 80% measured by applying a measuring method conforming to ISO 14782.

An example of a measurement method based on the method for obtaining the haze value of a plastic-transparent member specified in ISO 14782 is turbidity measurement using a turbidity meter manufactured by Nippon Denshoku Kogyo Co., Ltd., NDH2000. ISO is an abbreviation for International Organization for Standardization, which is the English notation of the International Organization for Standardization.

The packing paper 14 having a haze value of one side and a haze value of the other side different from each other is an opaque packing paper 14 when the haze value of at least one of the one side and the other side is 80% or more. Can be specified as.

The information on the type of the packaging paper 14 described in the embodiment is an example of the packaging member information which is the information on the packaging member that packages the drug to be identified. Further, the transparent packing paper 14 described in the embodiment is an example of a transparent member. The opaque packing paper 14 described in the embodiment is an example of an opaque member.

The drug information acquisition unit 230 can acquire the identification information of the drug 12 based on the barcode reading data by the operator reading the barcode described in the prescription and the medication notebook using the barcode reader.

The drug information acquisition unit 230 can acquire an input signal representing the name, code number, etc. of the drug 12 input by the operator using the input device 50, and can acquire the identification information of the drug 12 based on the input signal.

The processor 200 includes a drug recognition processing unit 232. The drug recognition processing unit 232 collates the photographed image of the drug 12 to be identified with the master image, and performs the identification process of the drug 12 to be identified. The matching process may apply template matching. The collation process may apply a trained learner.

The drug recognition processing unit 232 may perform a stamp emphasizing process for emphasizing the engraving of the drug 12. In the engraving enhancement process, the four LED arrays 86 shown in FIG. 4 and the like are operated one by one to acquire images of the four types of drugs 12 in which the drugs 12 are photographed, and the captured images of the four types of drugs 12 are combined. Then, an engraved-enhanced image can be generated.

The processor 200 is equipped with a display driver 234. The display driver 234 transmits a display signal indicating the identification result of the agent 12 to be identified to the display device 40. The display device 40 displays the identification result of the drug 12 to be identified based on the display signal transmitted from the display driver 234. The processor 200 described in the embodiment is an example of one or more processors.

[Hardware configuration of each processing unit and control unit]
Various processors can be applied to the hardware of the processing unit that performs various processes shown in FIG. 7. The processing unit may be called a processing unit. Various processors include a CPU (Central Processing Unit), a PLD (Programmable Logic Device), an ASIC (Application Specific Integrated Circuit), and the like.

The CPU is a general-purpose processor that executes programs and functions as various processing units. The PLD is a processor whose circuit configuration can be changed after manufacturing. An example of PLD is FPGA (Field Programmable Gate Array). An ASIC is a dedicated electrical circuit having a circuit configuration specifically designed to perform a particular process.

One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same type or different types. For example, one processing unit may be configured by using a plurality of FPGAs and the like. One processing unit may be configured by combining one or more FPGAs and one or more CPUs.

Further, a plurality of processing units may be configured by using one processor. As an example of configuring a plurality of processing units using one processor, there is a form in which one processor is configured by combining one or more CPUs and software, and one processor functions as a plurality of processing units. Such a form is represented by a computer such as a client terminal device and a server device.

As another configuration example. An example is a mode in which a processor that realizes the functions of the entire system including a plurality of processing units by using one IC chip is used. Such a form is typified by a system-on-chip (SystemOnChip) and the like. IC is an abbreviation for Integrated Circuit. Further, the system-on-chip may be described as SoC by using the abbreviation of System On Chip.

As described above, various processing units are configured by using one or more of the above-mentioned various processors as a hardware structure. Further, the hardware-like structure of various processors is, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined.

[Detailed explanation of acquisition of photographed images of drugs]
In the drug identification according to the prior art, a camera is used to receive the reflected light of the illumination light applied to the drug 12, generate a reflected light image of the drug 12, extract a stamp or the like from the reflected light image, and stamp or the like. Gets the information that represents. In particular, when acquiring a reflected light image of the drug 12 to be packaged using an opaque packaging paper such as glassine paper, it is difficult to obtain sufficient contrast between the engraved portion and the non-engraved portion in the reflected light image. Is. Then, it is difficult to obtain sufficient information for identifying the drug 12.

Therefore, the drug identification system 10 described with reference to FIGS. 1 to 7 selectively switches between the first lighting device 80 and the second lighting device 82 according to the drug information. Further, the drug identification system 10 selectively switches whether or not to use the pressing mechanism 28 according to the drug information. The drug information includes display format information indicating the display format of the drug 12 and packing paper information indicating the type of the packing paper 14. The display format information includes a first display format information indicating the display format of the back surface of the drug 12 and a second display format information representing the display format of the front surface of the drug 12. Table 1 shows the relationship between the display format of the drug 12, the type of the packing paper 14, and the presence / absence of the pressing mechanism 28.

The reflected light described in the lighting device column in Table 1 represents the use of the second lighting device 82, and the transmitted light described in the same column represents the use of the first lighting device 80. The marking and printing described in the embodiment is an example of the display information of the drug displayed on the drug. The display information on the back surface of the drug 12 described in the embodiment is an example of the first display information, and the display information on the front surface of the drug 12 is an example of the second display information. The absence of the type of packing paper described in the embodiment is an example of non-use of the packing member.

FIG. 8 is a schematic diagram showing an image of a drug to be packaged using transparent packaging paper. FIG. 8 corresponds to pattern A in Table 1. Note that, in FIG. 8, of the four LED arrays 86, the illustration of the two LED arrays 86 arranged in the direction penetrating the paper surface of FIG. 8 is omitted. Further, in FIG. 8, for convenience of illustration, the packing paper 14 is not in contact with the mounting table 26, but the packing paper 14 is in contact with the mounting table 26. The same applies to FIGS. 9, 11, 12, 14, 15, 15 and 22.

When the type of the packaging paper 14 is a transparent packaging paper, reflected light photography is performed by applying the second lighting device 82 regardless of the display format of the drug 12. Further, when the type of the packing paper 14 is the transparent packing paper, the pressing mechanism 28 is not used. When the type of the packing paper 14 is a transparent packing paper and a plurality of medicines 12 are contained in one packing paper, the plurality of medicines 12 may be photographed at once.

FIG. 9 is a schematic diagram showing photography of an engraved type drug that is packaged using opaque packaging paper. FIG. 9 corresponds to pattern B and pattern D in Table 1. Table 1 exemplifies glassine paper and a white belt as examples of opaque packing paper. The white band indicates a white band-shaped area formed on the outer surface of the packing paper 14. The transparent packing paper on which the white belt is formed is treated as an opaque packing paper.

When the type of the packing paper 14 is opaque packing paper and the display format of the medicine 12 is engraved, transmitted light imaging using the first lighting device 80 is performed, and the pressing mechanism 28 is used. To. When a plurality of drugs 12 are contained in one package, imaging is performed for each drug 12. Even when the packing paper 14 is not used or the type of the packing paper 14 is the transparent packing paper and the display format of the medicine 12 is engraved, the transmitted light photographing by applying the first lighting device 80 is carried out. Moreover, the pressing mechanism 28 is used. In the identification of the agent 12 when the marking is relatively shallow or the marking is relatively thin, the transmitted light illumination is used when the signal of the intensity corresponding to sufficient information cannot be obtained by using the reflected light illumination. Therefore, it is possible that a signal with a strength corresponding to sufficient information can be obtained.

FIG. 10 is an explanatory diagram of transmitted light and forward scattered light. Reference numeral 60 shown in FIG. 10 indicates a schematic diagram of transmitted light imaging. Further, reference numeral 62 indicates an example of a transmitted light transparent image. In the transmitted light imaging shown in FIG. 10, manual operation was applied to bring the packing paper 14 into close contact with the drug 12. Further, in the transmitted light imaging shown in the figure, any engraved type tablet was used as the agent 12 to be identified.

When the engraved type drug 12 to be packaged using the opaque packaging paper 14 is photographed, a strong illumination light LA having a light amount transmitted through the drug 12 is emitted from the back surface of the drug 12 to the drug 12. The camera 72 receives light LB containing at least one of the transmitted light transmitted to the front surface of the agent 12 and the forward scattered light of the packaging paper 14, and the transmitted light is generated by the camera 72. From the optical image, it is possible to read the marking on the front surface of the drug 12.

In the transmitted light image 62, the contrast between the engraved portion and the non-engraved portion becomes clear, and the readability of characters and symbols represented as engraved parts is improved as compared with the reflected light image generated from the reflected light. In FIG. 10, the transmitted light transmitted through the drug 12 and the forward scattered light of the packing paper 14 are not distinguished and are shown as light LB.

The through hole 26A of the mounting table 26 shown in FIG. 9 may be a combination of a plurality of through holes having a radius smaller than that of the through hole 26A, and strong illumination light may be applied to the drug 12 from each through hole. In such an embodiment, a plurality of captured images corresponding to the illumination light emitted from each of the plurality of through holes to the drug 12 can be combined to generate a transmitted light image of the drug 12.

Further, the pressing mechanism 28 is used to bring the medicine 12 into contact with the packing paper 14, and keep the distance between the two short. As a result, it is possible to acquire a photographed image of the drug 12 including a clear engraving before the diffusion and scattering of the light LB on the surface of the packing paper 14 become large, and the information represented by the sufficient engraving based on the photographed image of the drug 12. Can be obtained.

In this way, the drug 12 to be packaged using the opaque packaging paper 14 can be photographed in a packaged state, and the information represented by sufficient engraving can be obtained, and the template matching or the trained machine learning model can be obtained. By applying inference or the like to collate the master image with the drug 12, highly accurate identification of the drug 12 is realized.

Further, the transmitted light imaging shown in FIGS. 9 and 10 can also be applied to the imaging of the drug 12 in the unpackaged state. Similar to the drug 12 packaged using the opaque packing paper 14, the information represented by the new stamp when collated with the master image based on the information represented by the stamp on the drug 12 in the unpackaged state. Can be applied to the acquisition of.

FIG. 11 is a schematic diagram showing photography of a print-type drug that is packaged using opaque packaging paper. FIG. 11 corresponds to pattern C in Table 1. When the type of the packing paper 14 is opaque packing paper and the display format of the medicine 12 is printing, the reflected light photographing by applying the second lighting device 82 is performed. Further, when the type of the packing paper 14 is opaque packing paper and the display format of the medicine 12 is printing, the pressing mechanism 28 is used.

That is, when the type of the packing paper 14 is opaque packing paper, the pressing mechanism 28 is used regardless of the display format of the medicine 12. As a result, the packing paper 14 can be brought into close contact with the medicine 12, and the readability of engraving and the like can be improved.

If a plurality of drugs 12 are contained in one package, photography is performed for each drug 12. When photographing a plurality of agents 12 one by one, the imaging magnification may be increased as compared with the case where a plurality of agents 12 are photographed at once. As a result, the engraving or the like can be photographed relatively large, and the readability of the engraving or the like can be improved.

The photographed image of the drug 12 obtained by performing transmitted light imaging to which the first lighting device 80 described in the embodiment is applied is an example of the first transmitted light image. Further, the photographed image of the agent 12 obtained by performing the reflected light imaging to which the second lighting device 82 described in the embodiment is applied is an example of the first reflected light image.

[First modification of the holding mechanism and modification of the mounting table]
FIG. 12 is a schematic view of the holding mechanism according to the first modification and the mounting table according to the modification. In the pressing plate 90A provided in the pressing mechanism 28A shown in the figure, the radius of the through hole 29A of the ring 29 surrounding the drug 12 is the same as the through hole in the pressing plate 90 shown in FIG. The radius of is smaller than the radius of the holding plate 90.

As a result, when a plurality of drugs 12 are contained in one package, the ring 29 is inserted between the drug 12 to be imaged and the drug 12 adjacent to the drug 12 to be imaged, and the drug 12 to be imaged is subjected to the ring 29. The packing paper 14 can be brought into close contact with the paper.

Further, a pedestal member 27 arranged on the upper surface 26B of the mounting table 26 shown in FIG. 12 is provided. The pedestal member 27 holds the drug 12 to be imaged and supports the back surface of the drug 12, which is the opposite side of the pressing mechanism 28A. The pedestal member 27 has a cylindrical shape, and a through hole 27A corresponding to the through hole 26A of the mounting table 26 is formed. The through hole 27A shown in FIG. 12 is the same over the entire length of the pedestal member 27.

The mounting table 26 provided with the pedestal member 27 can suppress the movement of the medicine 12 when the packing paper 14 is brought into close contact with the medicine 12 by using the pressing mechanism 28A, and the packing paper 14 with respect to the medicine 12 can be suppressed. The degree of adhesion can be improved. Further, the illumination light of the first illumination device 80 can efficiently irradiate the agent 12.

FIG. 13 is a perspective view and a cross-sectional view of the pedestal member according to the modified example. Reference numeral 27B indicates a perspective view of the pedestal member 27D. Reference numeral 27C is a cross section along the AA cross-sectional line shown in the perspective view 27B of the pedestal member 27D. The through hole 27E of the pedestal member 27D shown in FIG. 13 has a different radius of opening at one end and a radius of opening at the other end.

In the pedestal member 27D according to the modified example, when the packing paper 14 is brought into close contact with the medicine 12 by using the pressing mechanism 28A shown in FIG. 12, the deformation of the pedestal member 27D itself is suppressed, and the movement of the medicine 12 is suppressed. Be strengthened.

[Second modification of the holding mechanism]
FIG. 14 is a schematic view of the pressing mechanism according to the second modification. A ring-shaped sponge 97 on the side surface of the packing paper 14 of the holding plate 90B is attached to the holding mechanism 28B shown in the figure. As a result, the packing paper 14 can be deformed according to the shape of the medicine 12, and the degree of adhesion of the packing paper 14 to the medicine 12 can be improved.

[Third modification of the holding mechanism]
FIG. 15 is a schematic view of the pressing mechanism according to the third modification. 16 is a side view of FIG. 15. FIG. 17 is a top view of the medicine wrapping paper shown in FIG. 16 is a side view when FIG. 15 is a front view, and FIG. 17 is a top view when FIG. 15 is a front view. In addition, in FIGS. 16 and 17, some of the components shown in FIG. 15 are not shown as appropriate.

A transparent film 90C is applied to the pressing mechanism 28C shown in FIGS. 15 and 16. The space between the film 90C and the mounting table 26 is degassed, and the degree of contact between the agent 12 and the packing paper 14 can be adjusted according to the adjustment of the degree of degassing.

The mounting table 26 shown in FIG. 16 is formed with a through hole 26C serving as a suction flow path. The through hole 26C is connected to the pump via a flow path. The suction pressure generated in the through hole 26C according to the operation of the pump acts on the film 90C. As a result, the film 90C pushes down the packing paper 14, and the packing paper 14 can adhere to the medicine 12. The flow path and pump are not shown. As shown in FIG. 17, the film 90C has a width D2 larger than the width D1 of the packing paper 14. Thereby, the suction pressure generated in the through hole 26C can be directly applied to the film 90C.

The pressing mechanism 28C according to the third modification may photograph the plurality of agents 12 at the same time when performing transmitted light imaging on the plurality of agents 12.

The film 90C described in the embodiment is an example of a sheet-shaped member. The pump for degassing the space between the film 90C and the mounting table 26 according to the embodiment is an example of a degassing device for degassing the gas between the mounting member on which the drug is placed and the sheet-shaped member. be.

[Fourth modification of the holding mechanism]
FIG. 18 is a schematic view of the pressing mechanism according to the fourth modification. The pressing mechanism 28D shown in the figure is swingably supported with respect to the mounting table 26. The arrow line shown in the figure indicates the swing direction of the pressing mechanism 28D. A camera 72 is attached to the holding mechanism 28D. The pressing mechanism 28D is applied to the pattern B shown in Table 1.

The pressing mechanism 28D according to the fourth modification is smaller than the photographing unit 20 shown in FIG. 1 and the like, and can be carried.

[Fifth modification of the holding mechanism]
FIG. 19 is a schematic view of the pressing mechanism according to the fifth modification. FIG. 19 shows a photographing unit 20E provided with a pressing mechanism 28E. In FIG. 19, some of the components shown in FIG. 1 and the like of the first lighting device 80 and the like are not shown.

The holding mechanism 28E provided in the photographing unit 20E includes a swinging mechanism 94 that swings the holding plate 90 on a surface parallel to the upper surface 26B of the mounting table 26. In the pressing mechanism 28E, the rotation shaft of the swing motor 96 is connected to the base end of the pressing plate arm 95 to which the pressing plate 90 is attached to the tip end. The swing motor 96 is attached to the second linear guide 102 shown in FIG.

FIG. 20 is an operation explanatory diagram of the pressing mechanism shown in FIG. When the swing motor 96 is operated, the holding plate 90 swings. The holding plate 90 moves from the retracted position shown in FIG. 19 to the holding position shown in FIG. 20 in response to the swing of the holding plate 90. The arrow line attached to the holding plate arm 95 indicates the swing direction of the holding plate 90.

The elevating motor 93 is operated in a state where the holding plate 90 is located at the holding position, and the packing paper 14 is brought into close contact with the medicine 12 using the holding plate 90. The arrow line attached to the swing mechanism 94 indicates the downward direction of the swing mechanism 94. On the other hand, when taking a picture of reflected light using the second lighting device 82, the holding plate 90 is retracted to a retracted position outside the angle of view of the camera 72. Thereby, the reflection of the holding plate 90 can be suppressed at the time of the reflected light photographing.

[Procedure of drug identification method according to the first embodiment]
FIG. 21 is a flowchart showing the procedure of the drug identification method according to the first embodiment. In the drug information acquisition step S10, the drug information acquisition unit 230 shown in FIG. 7 acquires drug information of the drug 12 to be identified and stores the acquired drug information. The drug information includes various information applied to the subsequent steps. After the drug information acquisition step S10, the process proceeds to the lighting condition setting step S12.

In the lighting condition setting step S12, the lighting control unit 222 sets the lighting conditions according to the display format of the medicine 12 and the type of the packing paper 14. That is, the lighting control unit 222 sets whether to apply the first lighting device 80 or the second lighting device 82 according to the display format of the medicine 12 and the type of the packing paper 14. After the lighting condition setting step S12, the process proceeds to the shooting condition setting step S14.

In the shooting condition setting step S14, the shooting control unit 224 sets the shooting conditions of the shooting device 22 according to the drug information and the lighting conditions. Examples of shooting conditions include shooting magnification and the like. After the shooting condition setting step S14, the process proceeds to the shooting step S16.

In the photographing step S16, the drug 12 to be photographed is photographed. In the imaging step S16, the alignment of the drug 12 to be identified is performed. The alignment of the drug 12 to be identified may be automatically adjusted using a position adjusting device, or may be manually adjusted by the operator.

In the photographing step S16, the drive control unit 228 operates the pressing mechanism 28 according to the display type of the medicine 12 and the type of the packing paper 14, and adjusts the degree of contact of the packing paper 14 with the front surface of the medicine 12. Will be done.

In the photographing step S16, the photographing apparatus 22 photographs the drug 12 to be identified and generates a photographed image of the drug 12 to be identified. The photographing device 22 transmits the photographed image of the agent 12 to be identified to the image processing unit 226. After the photographing step S16, the process proceeds to the photographed image acquisition step S18.

In the captured image acquisition step S18, the image processing unit 226 acquires a captured image of the agent 12 to be identified transmitted from the imaging device 22. The image processing unit 226 performs image processing such as trimming and enhancement processing such as engraving on the captured image of the agent 12 to be identified. After the captured image acquisition step S18, the process proceeds to the collation step S20.

In the collation step S20, the drug recognition processing unit 232 reads the master image from the master image storage unit 204. The drug recognition processing unit 232 acquires a photographed image of the drug 12 to be identified from the image processing unit 226. The drug recognition processing unit 232 collates the master image with the captured image of the drug 12 to be identified, and identifies the drug 12 to be identified. After the collation step S20, the process proceeds to the identification result display step S22.

In the identification result display step S22, the display driver 234 transmits a display signal indicating the identification result of the drug 12 to be identified to the display device 40. The display device 40 displays the identification result of the drug 12 to be identified. After the identification result display step S22, the process proceeds to the end determination step S24.

In the end determination step S24, the system control unit 220 determines whether or not the identification results have been obtained for all the agents 12. In the end determination step S24, when the system control unit 220 determines that the identification results have not been obtained for all the agents 12, the determination is No. In the case of No determination, the process proceeds to the drug information acquisition step S10, and each step from the drug information acquisition step S10 to the end determination step S24 is repeatedly carried out until a Yes determination is made in the end determination step S24.

On the other hand, in the end determination step S24, when the system control unit 220 determines that the identification results have been obtained for all the drugs 12, the determination is Yes. In the case of Yes determination, the drug identification method is terminated.

After the end determination step S24, a posture change determination step of determining whether or not to acquire the drug information by changing the posture of the packing paper 14 in which the drug 12 is packaged may be included. Examples of changing the posture of the packing paper 14 include a mode in which the front surface and the back surface of the packing paper 14 are inverted, and a mode in which the packing paper 14 is rotated in the surface on which the packing paper 14 is placed. The posture of the packing paper 14 may be changed manually or automatically.

The surface of the packing paper 14 referred to here is a surface facing the camera 72 when the packing paper 14 is placed on the mounting table 26. The back surface of the packing paper 14 is a surface that comes into contact with the mounting table 26 when the packing paper 14 is placed on the mounting table 26.

[Application example]
FIG. 22 is a schematic diagram of a drug identification system according to an application example. The photographing unit 20A provided in the drug identification system 10A shown in the figure includes only the first lighting device 80 shown in FIG. 1 and the like, and does not include the second lighting device 82. That is, the photographing unit 20A is a dedicated system for transmitted light photography.

The photographing unit 20A may apply an embodiment of irradiating illumination light from the side of the front surface of the drug 12 to capture a transmitted light image of the back surface of the drug 12. The photographing unit 20A may include a camera on the side of the mounting table 26 opposite to the side of the camera 72, and may provide a lighting device on the side of the mounting table 26 opposite to the side of the first lighting device 80. It should be noted that illustration of an embodiment including a camera and a lighting device applied to capture a transmitted light image of the back surface of the drug 12 is omitted.

[Action and effect of the first embodiment]
The drug identification system and the drug identification method according to the first embodiment can obtain the following effects.

[1]
When photographing the drug 12 to be identified, the first lighting device 80 arranged on the opposite side of the photographing device 22 of the mounting table 26 on which the drug 12 is placed is applied to the back surface of the drug 12. The illumination light is irradiated and the photographing device 22 is applied to acquire a transmitted light image of the agent 12 to be identified. As a result, when the medicine 12 is packaged using the opaque packing paper 14 and the display format of the medicine 12 is engraved, it is possible to acquire a photographed image of the agent 12 in which the engraving on the front surface is emphasized.

[2]
When photographing the drug 12 to be identified, the second lighting device 82 arranged on the side of the photographing device 22 of the mounting table 26 on which the drug 12 is placed is applied to illuminate the front surface of the drug 12. 22 is applied, and the reflected light image of the agent 12 to be identified is acquired. As a result, when the medicine 12 is packaged using the transparent packing paper 14 and when the display format of the medicine 12 is printing, a photographed image of the medicine 12 with improved readability such as printing on the front side is acquired. Can be.

[3]
As the drug information, the type of the packing paper and the display format of the medicine 12 are acquired, and the first lighting device 80 is used or the second lighting device is used according to the type of the acquired packing paper and the display format of the medicine 12. Selectively switch whether to use 82. Thereby, it is possible to switch between the transmitted light photographing and the reflected light photographing based on the type of the packing paper and the display format of the medicine 12.

[Second Embodiment]
[Overall configuration of drug identification system]
FIG. 23 is a perspective view showing a configuration example of the drug identification system according to the second embodiment. The drug identification system according to the second embodiment includes an imaging unit 300. The photographing unit 300 includes a case 302. The case 302 includes a lid portion 304 and a holding plate member 306. The lid portion 304 is operably attached to a position corresponding to the window portion 308 formed on the upper surface 302A of the case 302 so as to be openable and closable.

FIG. 23 illustrates the photographing unit 300 in a state where the lid portion 304 and the holding plate member 306 are opened and the window portion 308 is exposed. The arrow line attached to the lid portion 304 indicates the moving direction of the lid portion 304 when the lid portion 304 is closed.

The inside of the case 302 includes a photographing device 310 and a second lighting device 312. The photographing device 310 is arranged on the bottom surface 314 of the case 302. The second lighting device 312 is arranged on each of the inner surfaces of the four walls surrounding the optical axis of the photographing device 310. An LED array is applied to the second lighting device 312. FIG. 23 shows two second illuminating devices 312 out of the four second illuminating devices 312.

The first lighting device 318 is arranged on the back surface 304A of the lid 304 facing the window 308 with the lid 304 closed. The first lighting device 318 is arranged at a position facing the light receiving surface of the photographing device 310 with the lid portion 304 closed.

A cushion material 322 is arranged around the first lighting device 318 on the back surface 304A of the lid portion 304. The cushion material 322 has a thickness that covers the LED light source applied to the first lighting device 318, and the LED light source applied to the first lighting device 318 is attached to the window portion 308 with the lid portion 304 closed. It has a thickness that makes it non-contact with the plate.

A holding plate 330 is attached to the tip of the holding plate member 306. A hinge 332 that supports the presser plate member 306 so as to be openable and closable is attached to the base end of the presser plate member 306 with respect to the case 302.

A through hole 334 is formed in the holding plate 330. The through hole 334 is arranged at a position corresponding to the first lighting device 318 in a state where the holding plate member 306 is closed. The radius of the through hole 334 is defined according to the size of the drug to be identified.

[How to use the drug identification system]
FIG. 24 is an explanatory diagram of a usage state of the photographing unit shown in FIG. 23. In FIG. 24, the reference numerals shown in FIG. 23 are not shown as appropriate. When performing transmitted light photography using the first lighting device 318, the holding plate member 306 is closed and the holding plate 330 is arranged on the window portion 308. The arrow line attached to the holding plate 330 indicates the moving direction of the holding plate 330.

Next, the medicine 12 to be identified as it is packaged in the packing paper 14 is aligned with the through hole 334 of the holding plate 330 and placed on the holding plate 330. The arrow line illustrated between the pressing plate 330 and the packing paper 14 indicates the moving direction of the medicine 12 packaged in the packing paper 14.

Next, close the lid 304. The arrow line attached to the lid portion 304 indicates the moving direction of the lid portion 304 when the lid portion 304 is closed. With the drug 12 to be identified set and the lid 304 closed, transmission light imaging of the drug 12 to be identified is performed. As a result, a transmitted light image of the drug 12 to be identified is acquired.

When the reflected light image of the agent 12 to be identified is taken by using the second lighting device 312, the agent 12 to be identified is set with the holding plate member 306 shown in FIG. 23 open, and the lid 304 is closed. .. It detects whether the holding plate member 306 is open or closed, and based on the detection result, selectively applies either the first lighting device 318 or the second lighting device 312, and performs transmitted light imaging or reflected light. Shooting may be carried out selectively.

[Action and effect of the second embodiment]
The drug identification system according to the second embodiment is smaller and simplified as compared with the drug identification system according to the first embodiment. This makes it easy to carry and can function as a handy type drug identification system.

[Third Embodiment]
[Configuration example of pressing mechanism]
FIG. 25 is a perspective view showing a configuration example of a pressing mechanism applied to the drug identification system according to the third embodiment. The pressing mechanism 400 shown in the figure is integrally configured with the mounting table 402. That is, the frame 406 that supports the holding plate drive mechanism 404 supports the mounting table 402.

The upper surface 402A of the mounting table 402 includes a pedestal 403. The pedestal 403 is formed with a through hole 403A through which illumination light passes. The pedestal 403 is a position corresponding to the holding plate 430, and is arranged at a position corresponding to the through hole of the mounting pedestal 402. In FIG. 25, the through hole of the mounting table 402 is not shown.

A lifting mechanism for raising and lowering the mounting table 402 shown in FIG. 25 is provided, the distance between the first lighting device described later and the drug 12 mounted on the mounting table 402 can be changed, and stronger illumination light is emitted to the drug 12. Irradiation may be possible.

The presser plate drive mechanism 404 includes a first linear guide 410, a second linear guide 412, a spring 414, a guide rail 416, a timing belt 420, a drive pulley 422, and a driven pulley 424. The presser plate drive mechanism 404 includes an origin sensor (not shown).

Each of the components of the presser plate drive mechanism 404 is the same as the component of the presser plate drive mechanism 92 shown in FIG. Here, the description of each component of the holding plate drive mechanism 404 will be omitted.

Further, the pressing plate 430 shown in FIG. 25 corresponds to the pressing plate 90 shown in FIG. The holding plate bracket 432 shown in FIG. 25 corresponds to the holding plate bracket 91 shown in FIG. The elevating motor 408 corresponds to the elevating motor 93. Detailed explanations of these will be omitted.

[Operation example of pressing mechanism]
An operation example of the pressing mechanism 400 shown in FIG. 25 will be described with reference to FIGS. 26 and 27. FIG. 26 is a perspective view showing a state in which a drug is set in the pressing mechanism shown in FIG. 25. FIG. 27 is a perspective view showing a state in which a drug is sandwiched in the pressing mechanism shown in FIG. 25. In FIGS. 26 and 27, the reference numerals shown in FIG. 25 are not shown as appropriate.

As shown in FIG. 26, the medicine 12 to be identified and the pedestal 403 shown in FIG. 25 are aligned with each other, and the packing paper 14 into which the medicine 12 to be identified is packaged is set on the upper surface 402A of the mounting table 402. .. Next, as shown in FIG. 27, the pressing plate bracket 432 is lowered to bring the pressing plate 430 into contact with the packing paper 14, and the agent 12 to be identified is sandwiched between the pressing plate 430 and the pedestal 403.

The packing paper 14 is brought into close contact with the medicine 12, the first lighting device 80 irradiates the medicine 12 with illumination light, and the medicine 12 is photographed.

[Configuration example of imaging device and lighting device]
FIG. 28 is a perspective view showing a configuration example of a photographing device and a lighting device applied to the drug identification system according to the third embodiment. The drug identification system according to the third embodiment includes a first photographing device 440, a first lighting device 450, and a second lighting device 460. The first photographing device 440, the first lighting device 450, and the second lighting device 460 are applied to photograph the surface which is the upper surface of the agent 12 to be identified.

Further, the drug identification system according to the third embodiment includes a second photographing device 470, a third lighting device 480, and a fourth lighting device 490. The second photographing device 470, the third lighting device 480, and the fourth lighting device 490 are applied to photograph the back surface of the agent 12 to be identified.

The second imaging device 470 described in the embodiment is an example of a second imaging device that is arranged on the side of the first surface of the drug and photographs the drug from the side of the first surface. The third lighting device 480 according to the embodiment is an example of a third lighting device which is arranged on the side of the second side of the medicine and illuminates the medicine from the side of the second side. The fourth lighting device 490 described in the embodiment is an example of a fourth lighting device that illuminates a drug from the side of the first surface.

The surface of the drug 12 shows a surface opposite to the mounting table 402 of the drug 12 when the drug 12 is placed on the mounting table 402 shown in FIG. 25 or the like. The back surface of the drug 12 is a surface that becomes the side of the mounting table 402 of the drug 12 when the drug 12 is placed on the mounting table 402 shown in FIG. 25 or the like, and shows the surface of the side opposite to the front surface of the drug 12. ..

The first photographing device 440, the first lighting device 45, the second lighting device 460, the second photographing device 470, the third lighting device 480, and the fourth lighting device 490 are supported by using the frame 500. The frame 500 includes a superstructure 502. The superstructure 502 supports a first photographing device 440, a second lighting device 460, and a third lighting device 480.

The first photographing device 440 can be applied with the same configuration as the photographing device 22 shown in FIG. 2 and the like. Ring lighting is applied to the second lighting device 460. Ring illumination has a structure in which a plurality of LED elements are arranged on the circumference. FIG. 28 illustrates a ring illumination that has a shape that surrounds the periphery of the first imaging device 440 and is arranged at a position that surrounds the periphery of the first imaging device 440.

An LED light source is applied to the third lighting device 480 as in the first lighting device 80 shown in FIG. 2 and the like. The third lighting device 480 is arranged at a position facing the light receiving surface of the second photographing device 470.

The frame 500 includes a lower structure 504. The substructure 504 supports a second photographing device 470, a fourth lighting device 490, and a first lighting device 450. The second photographing apparatus 470 can be applied with the same configuration as the photographing apparatus 22 shown in FIG. 2 and the like. The fourth illuminating device 490 can be applied with the same configuration and arrangement as the second illuminating device 460. The first illuminating device 450 can be applied with the same configuration and arrangement as the third illuminating device 480.

The frame 500 is movably supported by using the frame moving mechanism 510. The frame moving mechanism 510 includes a linear guide 512, a guide rail 514, a belt 516, a drive pulley 518, a driven pulley 520, a frame moving motor 522, and a support plate 524. The frame moving mechanism 510 includes a photographing device origin position sensor and a positioning sensor. The illustration of the sensor described above is omitted.

The frame 500 is connected to the linear guide 512. The linear guide 512 is supported by the guide rail 514. The linear guide 512 is connected to the belt 516. The belt 516 is endless and is wound around the drive pulley 518 and the driven pulley 520. The drive pulley 518 is connected to the rotating shaft of the frame moving motor 522. The guide rail 514 and the frame moving motor 522 are supported by the support plate 524.

The belt 516 travels according to the rotation of the frame movement motor 522. The linear guide 512 moves along the guide rail 514 according to the traveling of the belt 516. The frame 500 moves in response to the movement of the linear guide 512.

[Operation example of photographing device and lighting device]
FIG. 29 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view showing a state in which the drug is set. Reference numeral 530 shown in the figure shows a perspective view, and reference numeral 532 shows a side view.

In FIG. 29, the reference numerals shown in FIGS. 25 to 28 are not shown as appropriate. Further, in the side view view 532, the illustration of the medicine 12 and the packing paper 14 in which the medicine 12 is packaged is omitted.

As shown in FIG. 29, the drug 12 to be identified is positioned at the position of the pedestal 403 of the mounting table 402 and placed on the mounting table 402. For the drug 12 to be identified, the packing paper 14 is brought into close contact with the pressing plate 430. The perspective view 530 of FIG. 29 illustrates a state in which the drug 12 and the packing paper 14 are in close contact with each other.

FIG. 30 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view view showing a state when surface imaging of the drug is performed. Reference numeral 534 shown in the figure shows a perspective view, and reference numeral 536 shows a side view. In the side view 536, the medicine 12 and the packing paper 14 in which the medicine 12 is packaged are not shown.

The frame moving mechanism 510 is operated, and the first imaging device 440 is positioned with respect to the surface of the drug 12 to be identified. Depending on the display format of the medicine 12 and the type of the packing paper 14, the first lighting device 450 or the second lighting device 460 is applied, and the medicine 12 to be identified is photographed by using the first photographing device 440. ..

The transmitted light image obtained by performing transmitted light imaging using the first imaging device 440 described in the embodiment is an example of the first transmitted light image. The reflected light image obtained by performing the reflected light photographing using the first photographing apparatus 440 according to the embodiment is an example of the first reflected light image.

FIG. 31 is an operation explanatory view of the drug identification system according to the third embodiment, and is a perspective view and a side view view showing a state when backside photographing of the drug is performed. Reference numeral 538 shown in the figure shows a perspective view, and reference numeral 540 shows a side view. In the side view 540, the medicine 12 and the packing paper 14 in which the medicine 12 is packaged are omitted.

The frame moving mechanism 510 is operated, and the second imaging device 470 is positioned with respect to the back surface of the drug 12 to be identified. Depending on the display format of the medicine 12 and the type of the packing paper 14, the third lighting device 480 or the fourth lighting device 490 is applied, and the medicine 12 to be identified is photographed by using the second photographing device 470. ..

The transmitted light image obtained by performing transmitted light imaging using the second imaging device 470 described in the embodiment is an example of the second transmitted light image. The reflected light image obtained by performing the reflected light photographing using the second photographing apparatus 470 according to the embodiment is an example of the second reflected light image.

[Modification example]
FIG. 32 is a perspective view showing a modified example of the drug identification system according to the third embodiment. In FIG. 32, the frame moving mechanism 510 shown in FIG. 28 and the like is not shown. Further, in FIG. 32, the reference numerals shown in FIG. 28 are not shown as appropriate.

In FIG. 32, the first lighting device 450 and the third lighting device 480 shown in FIG. 28 are deleted, and the positions of the first photographing device 440 and the second photographing device 470 are aligned. In the embodiment shown in FIG. 32, the front surface and the back surface of the drug 12 to be identified can be photographed without moving the first imaging device 440 and the second imaging device 470, and the front surface and the back surface of the drug 12 to be identified can be photographed. Simultaneous shooting is also possible.

Although ring lighting is illustrated as the second lighting device 460 in FIGS. 28 to 32, a configuration for illuminating the agent 12 from the four directions shown in FIG. 2 and the like may be applied. According to such an embodiment, it is possible to emphasize the engraving on the medicine 12 to be packaged using the transparent packaging paper 14.

[Action and effect of the third embodiment]
According to the drug identification system according to the third embodiment, automatic imaging of the front surface and the back surface of the drug 12 to be identified can be performed without reversing the front surface and the back surface of the drug 12 to be identified. Thereby, the photographed image of the front surface of the drug 12 to be identified and the photographed image of the back surface of the drug 12 to be identified can be efficiently acquired.

[Fourth Embodiment]
[Configuration example]
FIG. 33 is a perspective view showing a configuration example of the drug identification system according to the fourth embodiment. The pressing mechanism 400 shown in FIG. 25 is applied to the drug identification system according to the fourth embodiment. In FIG. 33, the reference numerals shown in FIG. 25 are not shown as appropriate.

In the drug identification system according to the fourth embodiment, the photographing device 600, the first lighting device 602, and the second lighting device 604 are integrally configured. The photographing device 600, the first lighting device 602, and the second lighting device 604 are supported by using the frame 610. A structure similar to that of the frame 500 shown in FIG. 28 is applied to the frame 610.

The imaging device 600 shown in FIG. 33 has the same configuration and arrangement as the first imaging device 440 shown in FIG. 28. The first lighting device 602 and the second lighting device 604 shown in FIG. 33 have the same configurations and arrangements as those of the first lighting device 450 and the second lighting device 460 shown in FIG. 28, respectively.

The frame 610 is supported so that the arrangement relationship between the photographing device 600 and the second lighting device 604 and the first lighting device 602 can be reversed by using the reversing mechanism 620. The reversing mechanism 620 includes a frame rotation shaft 622, a drive pulley 624, a belt 626, a reversing motor 628, and a support plate 630. Further, the reversing mechanism 620 includes an origin detection sensor, a position detection sensor, and a rotation position detection sensor. The illustration of the sensor described above will be omitted.

The frame rotation shaft 622 is connected to the frame 610. An endless belt 626 is wound between the frame rotation shaft 622 and the drive pulley 624. The drive pulley 624 is connected to the rotating shaft of the reversing motor 628, and the frame rotating shaft 622 and the reversing motor 628 are supported by the support plate 630.

The belt 626 travels according to the rotation of the reversing motor 628. The frame rotation shaft 622 rotates according to the running of the belt 626. In response to the rotation of the frame rotation axis 622, the frame 610 rotates around the rotation axis. That is, the arrangement relationship between the photographing device 600 and the second lighting device 604 and the first lighting device 602 is reversed according to the rotation of the reversing motor 628.

The frame 610 and the reversing mechanism 620 are movably supported by using the moving mechanism 640. The moving mechanism 640 moves the photographing device 600 or the like between the photographing position where the drug 12 to be identified is photographed and the inverted position where the photographing device 600 or the like is inverted. As for the configuration of the moving mechanism 640, the same configuration as that of the frame moving mechanism 510 shown in FIG. 28 is applied. The reversing mechanism 620 described in the embodiment is an example of a reversing device.

[Operation example]
FIG. 34 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a state when surface imaging of the drug is performed. In FIG. 34, the reference numerals shown in FIG. 33 are not shown as appropriate.

First, set the drug 12 to be identified. The set of the drug 12 to be identified is the same as that in the third embodiment, and the description thereof will be omitted. The moving mechanism 640 is operated, the imaging device 600 is positioned with respect to the drug 12 to be identified placed on the mounting table 402, and the surface of the drug 12 is photographed. The arrow line shown in FIG. 34 indicates the moving direction of the photographing apparatus 600 or the like.

FIG. 35 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a switching state between front surface imaging and back surface imaging. After photographing the surface of the agent 12 to be identified, the moving mechanism 640 is operated to move the photographing device 600 or the like to the inverted position. The arrow line attached to the moving mechanism 640 indicates the moving direction of the photographing device 600 or the like.

At the reversing position, the reversing mechanism 620 is operated to reverse the arrangement relationship between the photographing device 600 and the second lighting device 604 and the first lighting device 602. The arrow line attached to the reversing mechanism 620 indicates the moving direction of the photographing device 600 or the like. FIG. 35 shows an arrangement state of an imaging device 600 or the like capable of performing backside imaging of the drug 12 to be identified.

FIG. 36 is an operation explanatory view of the drug identification system according to the fourth embodiment, and is a perspective view showing a state when backside photography of the drug is performed. The moving mechanism 640 is operated, the imaging device 600 is positioned with respect to the drug 12 to be identified, and the back surface of the drug 12 is photographed. The arrow line shown in FIG. 36 indicates the moving direction of the photographing apparatus 600 or the like.

[Action and effect of the fourth embodiment]
According to the drug identification system according to the fourth embodiment, the following effects can be obtained.

[1]
Automatic imaging of the front surface and the back surface of the drug 12 to be identified can be performed without inverting the front surface and the back surface of the drug 12 to be identified. Thereby, the photographed image of the front surface of the drug 12 to be identified and the photographed image of the back surface of the drug 12 to be identified can be efficiently acquired.

[2]
The arrangement relationship between the photographing device 600 and the second lighting device 604 and the first lighting device 602 is reversed. Thereby, the front surface photographing of the agent 12 to be identified and the back surface photographing of the agent 12 to be identified can be performed without a plurality of photographing devices 600, the first lighting device 602 and the second lighting device 604.

[Drug distinction based on drug labeling format]
FIG. 37 is an explanatory diagram of a display format of the drug. The agent 12 to be identified shown in FIG. 1 and the like is roughly classified into a stamp type and a print type. The tablet 700 shown in FIG. 37 is an engraved type in which marking is used on both the front surface 702 and the back surface 704. The tablet 710 is a print type that is printed on the surface 712 by printing. The back surface 714 of the tablet 710 is plain.

The tablet 720 is displayed on the front surface 722 and the back surface 724 by printing, and a score line is formed on the front surface 722. Tablets 720 are usually classified as print type. The tablet 730 is a plain non-display type on both the front surface 732 and the back surface 734. Hidden types are usually treated as print types.

The drug 12 to be identified may not be packaged. The non-packed drug 12 can be classified into an engraved type and a printed type, similarly to the packaged drug 12. The engraved type of the non-separated package 12 may be classified into a print type, and reflected light photography may be performed.

The front surface and the back surface of the drug 12 are defined for convenience, and represent a relative relationship such as one surface and the other surface of the drug 12.

[Drug identifiability]
Identifiability is taken into account when performing identification based on captured images of the agent 12. Identifiability is a complex concept of the amount of identification information that a stamp or print has and the number of drugs that have information such as stamps with the same content.

For example, in the tablet 740 shown in FIG. 37, the marking on the front surface 742 and the marking on the back surface 744 are different. The front surface 742 of the tablet 740 is more identifiable than the back surface 744. On the other hand, in the tablet 750, the marking on the front surface 752 and the marking on the back surface 754 are different, but the identifiability of the front surface 752 and the back surface 754 is about the same.

The surface 762 of the tablet 760 is the same as the surface 742 of the tablet 740, and the color and size of the tablet 760 are also the same as the tablet 740. On the other hand, the back surface 764 of the tablet 760 is different from the back surface 744 of the tablet 740. Then, the tablet 760 has low identifiability only on the back surface 764. In such a case, the information on both the front surface 762 and the back surface 764 of the tablet 760 is acquired, and the information on the front surface 762 and the information on the back surface 764 are used in combination for identification. This can improve the identifiability of tablets 760.

As an example with low identifiability, there is a case where there are many drugs having similar display contents and a case where the amount of information is small. Examples of cases where the amount of information is small include cases where only numbers are displayed, cases where the number of characters such as one character is small, cases where only the mark of a pharmaceutical company is used, cases where only a score line is used, and cases where the information is plain.

[Aspects used as input information for single drug identification]
When acquiring the information on the front surface and the information on the back surface of the drug 12 to be identified, it is necessary for the system side to be able to handle the acquisition of the information on the front surface of the drug 12 and the information acquisition on the back surface of the drug 12 in no particular order.

When collating the photographed image of the agent 12 to be identified with the master image, the photographed image on the surface of the agent 12 to be identified is collated with the front surface of the master image and the back surface of the master image. Similarly, the captured image on the back surface of the drug 12 to be identified is collated with the front surface of the master image and the back surface of the master image. When there are a plurality of master images, the front surface and the back surface of the plurality of master images are collated in a round-robin manner. As a collation result, a score can be calculated for each case. That is, the identification of the drug 12 to be identified and the determination of the front surface and the back surface of the drug 12 to be identified can be collectively performed.

[Display example of identification result]
FIG. 38 is an explanatory diagram showing a configuration example of a screen displayed on the display device shown in FIG. 1. The figure shows a display example of the identification result to which the list format is applied. In the area L1A of the list L1, the photographed image of the drug A is displayed as the master image. Further, in the area L1B, the attribute information of the drug A displayed as the master image is displayed.

Area L1C displays captured images of all the drugs 12 identified as the drug A. In FIG. 38, an embodiment in which captured images of the front surface of all the drugs 12 identified as the drug A are displayed is illustrated, but the region L1C may be displayed including the captured images of the back surface of the drug 12.

In the area L1C, the drug 12 to be identified is displayed for each package and for each dosing timing. Region L1C displays support information related to the identification elephant drug 12. Support information includes information used for efficient implementation of drug identification. FIG. 38 illustrates a package number and a dosing date as an example of support information.

In the area L1D, the back button B1, the forward button B2, and the menu transition button B3 are displayed. The various buttons shown in FIG. 38 are examples, and other operation buttons may be added.

FIG. 39 is an explanatory diagram showing a second display example of the identification result displayed on the display device shown in FIG. 1, and is an explanatory diagram when a collation error does not occur. Further, FIG. 40 is an explanatory diagram showing a second display example of the identification result displayed on the display device shown in FIG. 1, and is an explanatory diagram when a collation error has occurred.

39 and 40 show the identification results for the designated drug B and the drug D similar to the designated drug B. The list L8 shown in FIGS. 39 and 40 includes a list L8A showing the identification result of the drug B and a list L8B showing the identification result of the drug D.

The list L8A shown in FIG. 40 represents the occurrence of an error in which the drug D is identified as the drug B. The list L8B shown in the figure shows the occurrence of an error in which the drug B is identified as the drug D. In this way, even when the drug B and the drug D that are similar to each other are exchanged, the list L8A showing the identification result of the drug B and the list L8B showing the identification result of the drug D are displayed. The operator can be aware of the occurrence of a collation error.

[Example when the drug to be identified is not packaged]
FIG. 41 is a schematic diagram when the drug to be identified is not packaged. When the drug 12 to be identified is not packaged, the drug 12 to be identified is stored in a container 800 such as a petri dish. A material that transmits illumination light and reflected light of the illumination light is applied to the bottom surface 802 of the container 800.

[Application example to network system]
FIG. 42 is a schematic diagram showing an example of application of a drug identification system to a network system. The drug identification system 900 shown in the figure includes an imaging unit 920, a processing device 930, a display device 940, a server device 950, and a storage device 960. The processing device 930 is communicably connected to the server device 950 and the storage device 960 via the network 970.

The server device 950 may have the function of the processing device 930. When the server device 950 has the function of the processing device 930, the photographing unit 920 is communicably connected to the server device 950 via the network 970.

The server device 950 may have the function of the drug information acquisition unit 230 shown in FIG. 7. The server device 950 may apply cloud computing.

As the network 970, a small-scale network applied to the inside of a medical institution may be applied, or a large-scale network such as the Internet may be applied. The network 970 may be configured to include a plurality of networks.

[Example of application to programs]
Various functions realized by the processor 200 shown in FIG. 7 and a program for realizing each process shown in FIG. 21 in a computer can be configured.

The embodiments of the present invention described above can appropriately change, add, or delete constituent requirements without departing from the spirit of the present invention. The present invention is not limited to the embodiments described above, and many modifications can be made by a person having ordinary knowledge in the art within the technical idea of the present invention. Further, the embodiments, modifications and applications may be combined as appropriate.

10 Drug identification system 10A Drug identification system 12 Drug 14 wrapping paper 20 Photo unit 20A Photo unit 20E Photo unit 22 Photo unit 24 Lighting device 26 Mounting stand 26A Through hole 26B Top surface 27 Pedestal member 27A Through hole 27B Perspective view of pedestal member 27C Cross-sectional view of pedestal member 27D Pedestal member 27E Through hole 28 Pressing mechanism 28A Pressing mechanism 28B Pressing mechanism 28C Pressing mechanism 28D Pressing mechanism 28E Pressing mechanism 29 Ring 29A Through hole 30 Processing device 40 Display device 50 Input device 52 Keyboard 54 Mouse 60 Transmission light Schematic diagram 62 Transmitted light image 70 Frame 72 Camera 74 Optical axis 80 First lighting device 82 Second lighting device 84 Frame 86 LED array 90 Pressing plate 90A Pressing plate 90C Film 91 Pressing plate bracket 92 Pressing plate drive mechanism 93 Elevating motor 94 Swing mechanism 95 Hold plate arm 96 Swing motor 97 Sponge 100 First linear guide 102 Second linear guide 104 Spring 106 Guide rail 108 Axis 110 Timing belt 112 Drive pulley 114 Driven pulley 200 Processor 202 Memory 204 Master image storage unit 206 Input interface 208 Input / output port 220 System control unit 222 Lighting control unit 224 Imaging control unit 226 Image processing unit 228 Drive control unit 230 Drug information acquisition unit 232 Drug recognition processing unit 234 Display driver 300 Imaging unit 302 Case 302A Top 304 Lid 304A Back side 306 Holding plate member 308 Window part 310 Imaging device 312 Second lighting device 314 Bottom surface 318 First lighting device 322 Cushioning material 330 Holding plate 332 Hinge 334 Through hole 400 Holding mechanism 402 Mounting base 402A Top surface 403 Base 403A Through hole 404 Holding plate Drive mechanism 406 Frame 408 Elevating motor 410 1st linear guide 412 2nd linear guide 414 Spring 416 Guide rail 420 Timing belt 422 Drive pulley 424 Driven pulley 430 Pressing plate 432 Pressing plate bracket 440 1st lighting device 450 1st lighting device 460th (Ii) Lighting device 470 Second imager 480 Third lighting device 490 Fourth lighting device 500 Frame 502 Upper structure 504 Lower structure 510 Frame mover Structure 512 Linear guide 514 Guide rail 516 Belt 518 Drive pulley 520 Driven pulley 524 Support plate 530 Side view 532 Side view 534 Side view 536 Side view 538 Side view 540 Side view 600 Imaging device 602 First lighting device 604 Second Lighting device 610 Frame 620 Reversing mechanism 622 Frame rotating shaft 624 Drive pulley 626 Belt 628 Reversing motor 630 Support plate 640 Moving mechanism 700 Tablets 702 Front side 704 Back side 710 Tablets 712 Front side 714 Back side 720 Tablets 722 Front side 724 Back side 730 Tablets 732 Front side 734 Tablet 742 Front 744 Back 750 Tablet 752 Front 754 Back 800 Container 802 Bottom 900 Drug identification system 920 Imaging unit 930 Processing device 940 Display device 950 Server device 960 Storage device 970 Network B1 Button B2 Button B3 Menu transition button LA Illumination light LB Light L1 List L1A Area L1B Area L1C Area L1D Area L8 List L8A List L8B List S10 to S24 Each step of the drug identification processing method

Claims (31)

A first lighting device that is arranged on the side of the first surface of the drug and illuminates the drug from the side of the first surface.
A first imaging device arranged on the side of the second surface opposite to the first surface of the drug and photographing the drug from the side of the second surface.
With one or more processors
Equipped with
The processor
The first transmitted light image of the drug when the drug is irradiated with the illumination light from the first lighting device is acquired from the first photographing device.
The second display information displayed on the second surface of the drug is acquired from the first transmitted light image, and the second display information is acquired.
A drug identification system that identifies the drug based on the acquired second display information. A second lighting device for illuminating the drug from the side of the second surface is provided.
The processor
The first reflected light image of the drug when the drug is irradiated with the illumination light from the second lighting device is acquired from the first photographing device.
The second display information is acquired from the first reflected light image, and the second display information is acquired.
The drug identification system according to claim 1, wherein the drug is identified based on the acquired second display information. The agent according to claim 2, further comprising a first photographing device and a reversing device for reversing the positions of the second lighting device and the first lighting device on the side of the first surface and the side of the second surface. Identification system. The processor
Acquire the second display information of the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied.
The drug identification system according to any one of claims 1 to 3, which identifies the drug based on the acquired second display information. The processor
As the second display information of the drug to be identified, the second display format information indicating the display format of the second display information is acquired.
Acquires the packaging member information, which is the information of the packaging member that packages the drug to be identified,
When the second display format information is engraved and the packaging member information is an opaque member, the drug to be identified is irradiated with illumination light from the first lighting device to acquire a first transmitted light image. The drug identification system according to claim 4. The processor
As the second display information of the drug to be identified, the second display format information indicating the display format of the second display information is acquired.
Acquires the packaging member information, which is the information of the packaging member that packages the drug to be identified,
Depending on the combination of the second display format information and the packaging member information, the drug to be identified is irradiated with illumination light from the first lighting device to acquire a first transmitted light image, or the identification target is identified. The drug identification system according to claim 2 or 3, wherein the drug is selectively switched between irradiating the drug with illumination light from the second lighting device and acquiring a first reflected light image. When the second display format information is engraved and the packaging member information is an opaque member, the processor irradiates the agent to be identified with illumination light from the first lighting device to transmit the first transmission. The drug identification system according to claim 6, which acquires an optical image. When the second display format information is printing and the packaging member information is an opaque member, the processor irradiates the agent to be identified with illumination light from the second lighting device and first reflects it. The drug identification system according to claim 6, which acquires an optical image. When the second display format information is non-display of the second display information and the packaging member information is a transparent member, the processor illuminates the drug to be identified from the second lighting device. The drug identification system according to claim 6, wherein the first reflected light image is acquired by irradiating the light. When the second display format information is engraved and the packaging member information is a transparent member or the packaging member is not used, the processor illuminates the drug to be identified from the first lighting device. The drug identification system according to claim 6, wherein the first transmitted light image is acquired by irradiating with light. A third lighting device arranged on the side of the second surface of the drug and illuminating the drug from the side of the second surface.
A second imaging device arranged on the side of the first surface of the drug and photographing the drug from the side of the first surface.
Equipped with
The processor
A second transmitted light image of the drug when the drug is irradiated with illumination light from the third lighting device is acquired from the second photographing device.
The first display information displayed on the first surface of the drug is acquired from the second transmitted light image, and the first display information is obtained.
The drug identification system according to claim 1, wherein the drug is identified based on the acquired first display information. A fourth lighting device for illuminating the drug from the side of the first surface is provided.
The processor
A second reflected light image of the drug when the drug is irradiated with the illumination light from the fourth lighting device is acquired from the second photographing device.
The first display information is acquired from the second reflected light image, and the first display information is acquired.
The drug identification system according to claim 11, wherein the drug is identified based on the acquired first display information. The processor
Acquire the first display information of the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied.
The drug identification system according to claim 11 or 12, which identifies the drug based on the acquired first display information. A second lighting device for illuminating the drug from the side of the second surface is provided.
The processor
The first reflected light image of the drug when the drug is irradiated with the illumination light from the second lighting device is acquired from the first photographing device.
The second display information is acquired from the first reflected light image, and the second display information is acquired.
The drug identification system according to any one of claims 11 to 13, which identifies the drug based on the acquired second display information. The processor
Acquire the second display information of the drug to be identified packaged in at least one of the packaging member to which the opaque member is applied and the packaging member to which the transparent member is applied.
The drug identification system according to any one of claims 11 to 14, which identifies the drug based on the acquired second display information. The processor
As the first display information of the drug to be identified, the first display format information indicating the display format of the first display information is acquired.
Acquires the packaging member information, which is the information of the packaging member that packages the drug to be identified,
Depending on the combination of the first display format information and the packaging member information, the drug to be identified is irradiated with illumination light from the third lighting device to acquire a second transmitted light image, or the identification target is identified. The drug identification system according to claim 12, wherein the drug is selectively switched between irradiating the drug with illumination light from the fourth lighting device and acquiring a second reflected light image. When the first display format information is engraved and the packaging member information is an opaque member, the processor irradiates the drug to be identified with illumination light from the third lighting device to transmit the second transmission. The drug identification system according to claim 16, wherein an optical image is acquired. When the first display format information is printing and the packaging member information is an opaque member, the processor irradiates the agent to be identified with illumination light from the fourth lighting device to reflect the second. The drug identification system according to claim 16, wherein an optical image is acquired. When the first display format information is non-display of the first display information and the packaging member information is a transparent member, the processor illuminates the drug to be identified from the fourth lighting device. The drug identification system according to claim 16, wherein the second reflected light image is acquired by irradiating the light. When the first display format information is engraved and the packaging member information is a transparent member or the packaging member is not used, the processor illuminates the drug to be identified from the third lighting device. The drug identification system according to claim 16, wherein a second transmitted light image is acquired by irradiating light. A second lighting device for illuminating the drug from the side of the second surface is provided.
The processor
The first reflected light image of the drug when the drug is irradiated with the illumination light from the second lighting device is acquired from the first photographing device.
The second display information is acquired from the first reflected light image, and the second display information is acquired.
The drug identification system according to any one of claims 16 to 20, which identifies the drug based on the acquired second display information. The processor
As the second display information of the drug to be identified, the second display format information indicating the display format of the second display information is acquired.
Depending on the combination of the second display format information and the packaging member information, the drug to be identified is irradiated with illumination light from the first lighting device to acquire a first transmitted light image, or the identification target is identified. 21. The drug identification system according to claim 21, wherein the drug is selectively switched between irradiating the drug with illumination light from the second lighting device and acquiring a first reflected light image. When the second display format information is engraved and the packaging member information is an opaque member, the processor irradiates the agent to be identified with illumination light from the first lighting device to transmit the first transmission. The drug identification system according to claim 22, which acquires an optical image. When the second display format information is printing and the packaging member information is an opaque member, the processor irradiates the agent to be identified with illumination light from the second lighting device and first reflects it. The drug identification system according to claim 22, which acquires an optical image. When the second display format information is non-display of the second display information and the packaging member information is a transparent member, the processor illuminates the drug to be identified from the second lighting device. 24. The drug identification system according to claim 24, which obtains a first reflected light image by irradiating with a light beam. When the second display format information is engraved and the packaging member information is a transparent member or the packaging member is not used, the processor illuminates the drug to be identified from the first lighting device. The drug identification system according to claim 24, which irradiates light to acquire a first transmitted light image. The drug identification system according to any one of claims 1 to 26, comprising a contact adjusting device for adjusting the degree of contact between the packaging member for packaging the drug and the drug. The drug identification system according to claim 27, wherein the contact adjusting device includes a pressing member that presses the packaging member around the drug on the side where the drug is imaged. The contact adjusting device is
A sheet-like member that covers the packaging member on the side where the drug is imaged,
An degassing device that degass the gas between the mounting member on which the drug is placed and the sheet-shaped member,
27. The drug identification system according to claim 27. The drug identification system according to any one of claims 1 to 27, comprising a support member for supporting the drug on the side opposite to the side on which the drug is imaged. A first lighting device arranged on the side of the first surface of the drug is applied to illuminate the drug from the side of the first surface.
By applying the first imaging device arranged on the side of the second surface opposite to the first surface of the drug, the drug is imaged from the side of the second surface.
The first transmitted light image of the drug when the drug is irradiated with the illumination light from the first lighting device is acquired from the first photographing device.
The second display information of the drug displayed on the second surface of the drug is acquired from the first transmitted light image, and the second display information of the drug is acquired.
A drug identification method for identifying the drug based on the acquired second display information.

Images