CN119399872A - Method and device for monitoring food for sale in vending machine - Google Patents
Method and device for monitoring food for sale in vending machine Download PDFInfo
- Publication number
- CN119399872A CN119399872A CN202411753015.5A CN202411753015A CN119399872A CN 119399872 A CN119399872 A CN 119399872A CN 202411753015 A CN202411753015 A CN 202411753015A CN 119399872 A CN119399872 A CN 119399872A
- Authority
- CN
- China
- Prior art keywords
- food
- sale
- sold
- vending machine
- spoiled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F9/00—Details other than those peculiar to special kinds or types of apparatus
- G07F9/02—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus
- G07F9/026—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus for alarm, monitoring and auditing in vending machines or means for indication, e.g. when empty
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)
Abstract
The application relates to a method and a device for monitoring food to be sold in a vending machine, wherein the method comprises the steps of taking image information of the food to be sold in the vending machine and spectrum information of the food to be sold, determining packaging conditions of the food to be sold based on the image information of a plurality of directions, determining spectrum characteristics of the food to be sold based on the spectrum information of the plurality of directions, and moving the food to be sold to a target area of the vending machine under the condition that the package of the food to be sold is determined to be damaged according to the packaging conditions and/or the food to be sold is determined to be bad according to the spectrum characteristics. According to the food state inspection device and method, the problems that food in the food vending machine is inspected manually in the related art, inspection efficiency is low, and food safety and quality cannot be achieved are solved.
Description
Technical Field
The application relates to the field of food monitoring in vending machines, in particular to a method and a device for monitoring food to be sold in a vending machine.
Background
Along with the development of science and technology, people live more conveniently. Food merchandisers are also currently available in various public locations for purchase by consumers at any time. The existing food vending machine usually relies on manual inspection of the food state, but the manual inspection is low in efficiency, and the lack of real-time detection of the food state can not guarantee the stability of the food quality, so that damaged or unqualified food can be sold, and the experience of consumers and the food safety are affected.
Disclosure of Invention
The application provides a method and a device for monitoring food to be sold in a vending machine, which are used for solving the problems that food in the food vending machine is inspected in a food state manually in the related art, the inspection efficiency is low, and the food safety quality cannot be ensured.
According to the first aspect, the application provides a monitoring method for food to be sold in a vending machine, which comprises the steps of obtaining image information of the food to be sold in the vending machine and spectrum information of the food to be sold, wherein the image information comprises image information of shooting the food to be sold from a plurality of directions, the spectrum information comprises spectrum information obtained by monitoring the food to be sold from the plurality of directions, determining package conditions of the food to be sold based on the image information of the plurality of directions, determining spectrum characteristics of the food to be sold based on the spectrum information of the plurality of directions, and moving the food to be sold to a target area of the vending machine when the package of the food to be sold is damaged according to the package conditions, and/or determining deterioration of the food to be sold according to the spectrum characteristics, wherein the target area is a forbidden selling area.
Optionally, moving the food item to be sold to a target area of the vending machine in the case that the food item to be sold is determined to be deteriorated according to the spectral characteristics comprises determining at least one of the absorption characteristic, the reflection characteristic and the scattering characteristic of target wavelength light based on the spectral characteristics, determining the food item to be sold to be deteriorated in the case that the characteristics of the target wavelength light in at least two directions are inconsistent with the target characteristics, wherein the target characteristics are characteristics of the target wavelength light when the food item to be sold is not deteriorated, and moving the deteriorated food item to be sold to the target area of the vending machine.
Optionally, determining that the food item for sale is spoiled in the event that the characteristics of the target wavelength light in at least two orientations are inconsistent with target characteristics comprises determining that the food item for sale is spoiled in the event that an absorption peak of the target wavelength light in at least two orientations is shifted compared to an absorption peak of the target wavelength light when the food item for sale is not spoiled, and/or determining that the food item for sale is spoiled in the event that a new absorption peak of the target wavelength light in at least two orientations appears in the event that the target wavelength light in at least two orientations is not spoiled compared to the target wavelength light when the food item for sale is not spoiled, and/or determining that the food item for sale is spoiled in the event that an absorption peak intensity of the target wavelength light in at least two orientations is reduced compared to an intensity of the absorption peak of the target wavelength light in the event that the food item for sale is not spoiled.
Optionally, determining that the food product for sale is spoiled if the characteristic of the target wavelength light in at least two orientations is inconsistent with a target characteristic includes determining that the food product for sale is spoiled if the intensity of the reflectivity of the target wavelength light in at least two orientations is reduced compared to the intensity of the reflectivity of the target wavelength light when the food product for sale is not spoiled.
Optionally, determining that the food product for sale is spoiled in the event that the characteristic of the target wavelength light in at least two orientations is inconsistent with a target characteristic comprises determining that the food product for sale is spoiled in the event that a scattering peak of the target wavelength light in at least two orientations is shifted compared to a scattering peak of the target wavelength light when the food product for sale is not spoiled, and/or determining that the food product for sale is spoiled in the event that an intensity of a scattering peak of the target wavelength light in at least two orientations is reduced compared to an intensity of a scattering peak of the target wavelength light when the food product for sale is not spoiled.
Optionally, moving the food product to the target area of the vending machine in the case that the package of the food product to be vended is determined to be damaged according to the package condition, wherein the method comprises moving the food product to the target area of the vending machine in the case that at least two azimuth image information indicates that the package of the food product to be vended is damaged or two adjacent azimuth image information indicates that the package of the food product to be vended is damaged.
Optionally, acquiring image information of food to be sold in the vending machine and spectrum information of the food to be sold comprise determining remaining time of quality guarantee period of each food to be sold in the vending machine, determining food to be sold with the remaining time being lower than preset time, moving a plurality of cameras in the vending machine to an area where the food to be sold is located to acquire image information of a plurality of directions of the food to be sold, and moving a plurality of spectrum sensors in the vending machine to the area where the food to be sold is located to acquire spectrum information of the plurality of directions of the food to be sold.
In a second aspect, the application provides a monitoring device for food to be sold in a vending machine, which comprises an acquisition module, a determining module and a processing module, wherein the acquisition module is used for acquiring image information of the food to be sold in the vending machine and spectrum information of the food to be sold, the image information comprises image information for shooting the food to be sold from a plurality of directions, the spectrum information comprises spectrum information obtained by monitoring the food to be sold from the plurality of directions, the determining module is used for determining package conditions of the food to be sold based on the image information of the plurality of directions and determining spectral characteristics of the food to be sold based on the spectrum information of the plurality of directions, and the processing module is used for moving the food to be sold to a target area of the vending machine when the package of the food to be sold is determined to be damaged according to the package conditions and/or the spectrum characteristics are determined to be bad according to the spectrum characteristics.
In a third aspect, the application provides an electronic device comprising at least one communication interface, at least one bus connected to the at least one communication interface, at least one processor connected to the at least one bus, and at least one memory connected to the at least one bus, wherein the processor is configured to execute the method for monitoring food to be sold in the vending machine according to the first aspect of the application.
In a fourth aspect, the present application also provides a computer storage medium storing computer executable instructions for performing the method for monitoring food products for sale in the vending machine according to the first aspect of the present application.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the advantages that in the embodiment of the application, the image information of a plurality of directions and the spectrum information of a plurality of directions of food to be sold in the vending machine can be obtained in real time, so that whether the food package is damaged or not is determined through the image information of the plurality of directions, and whether the food to be sold is deteriorated or not is determined through the spectrum information of the plurality of directions, and if any one of the conditions occurs, the food to be sold is judged to be a non-qualified product, the food needs to be moved to a target area, and the food in the area is forbidden to be sold. Therefore, according to the embodiment of the application, food to be sold in the vending machine can be checked in real time, unqualified products can be moved to the target area to be forbidden to be sold, so that not only is the real-time monitoring of the food to be sold realized, but also the false selling of the unqualified food to a user is avoided, the food safety quality is ensured, and the problems that the food safety quality cannot be ensured due to the fact that food state checking is performed on the food in the food vending machine manually in the related art are solved, and the checking efficiency is low.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which the figures of the drawings are not to be taken in a limiting sense, unless otherwise indicated.
Fig. 1 is a flowchart of a method for monitoring food products for sale in a vending machine according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a vending machine according to an embodiment of the present application;
FIG. 3 is a flow chart of an intelligent monitoring and reject method for a food vending machine according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a monitoring device for food to be sold in a vending machine according to an embodiment of the present application;
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The following disclosure provides many different embodiments, or examples, for implementing different structures of the invention. In order to simplify the present disclosure, components and arrangements of specific examples are described below. They are, of course, merely examples and are not intended to limit the invention. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed.
In order to solve the problems of low inspection efficiency and incapacity of food safety quality in food state inspection of food in a food vending machine by manpower in the related art, the application provides a method for monitoring food to be sold in a vending machine, as shown in fig. 1, the method comprises the following steps:
Step 101, acquiring image information of food to be sold in a vending machine and spectrum information of the food to be sold, wherein the image information comprises image information for shooting the food to be sold from a plurality of directions, and the spectrum information comprises spectrum information obtained by monitoring the food to be sold from the plurality of directions;
In a specific example, the image information and the spectrum information can be obtained through a camera and a spectrum sensor arranged in the vending machine respectively, and further, the image information and the spectrum information are processed by sending the corresponding information to a cloud or a background server for corresponding analysis processing after the camera and the spectrum sensor obtain the corresponding information. Specifically, the high-definition image fed back by the camera is subjected to visual processing, and defects of food packaging are automatically identified by machine learning. The method comprises the steps of firstly, collecting images of food packages by using a high-resolution camera, then, preprocessing the images to extract key features, secondly, training a machine learning model by using a large amount of labeling data to improve the accuracy and the robustness of the model, and finally, applying the trained model to real-time detection, automatically identifying and classifying the package defects and outputting results (damaged or undamaged). For spectral information, the spectral sensor may measure spectral information of reflection or transmission of the food, and different types of substances may have different spectral characteristics. By analyzing these spectral data, changes in food ingredients such as moisture content, sugar content, fat content, etc. can be identified to evaluate the quality and safety of food
The food vending machine shown in fig. 2, wherein 1 is a food vending shelf (seven layers in total), 2 is a defective goods shelf (two layers in total), 3 is a transport trolley, 4 is a meal outlet (two layers in total), 5 is a multispectral sensor, and 6 is a camera. The vending machine shown in fig. 2 is only an example, different numbers of cameras and different numbers of spectrum sensors can be set according to different vending machines in different application scenes, and the positions of the cameras and the spectrum sensors can be adjusted accordingly according to requirements.
Step 102, determining the package condition of the food to be sold based on the image information of the plurality of directions, and determining the spectral characteristics of the food to be sold based on the spectral information of the plurality of directions;
and 103, moving the food to be sold to a target area of the vending machine, wherein the target area is a vending forbidden area under the condition that the package of the food to be sold is damaged according to the package condition and/or the deterioration of the food to be sold is determined according to the spectral characteristics.
In this regard, any food to be sold in the vending machine needs to be monitored in all directions whether the food to be sold is qualified or not, so that all-direction detection needs to be performed on the package of the food to be sold and whether the whole food to be sold is spoiled or not according to the application, namely, the package condition of the food to be sold needs to be acquired from a plurality of directions, namely, the package condition of the whole package needs to be acquired, and any angle of the package is normally damaged to be a non-qualified product, but for misjudgment of image information of one direction, the image information of at least two directions in the application indicates that the package of the food is damaged, so that the package of the food is really damaged. However, if only one orientation of the image information indicates that the package is damaged, but in fact, no damage may occur, the package may be prompted to be damaged when purchased by the customer, and the customer may be further confirmed to determine whether to pay for the purchase, so that the sale of damaged food to the customer can be avoided. The judgment of the spectral information is also similar to the processing mode, if the spectral characteristics of any one azimuth are different from those of normal foods, the foods are unqualified products, but in order to avoid misjudgment of the spectral information of one azimuth, in the application, the spectral information of at least two azimuth is different from those of the normal foods, the foods are characterized as being degenerated, namely, the foods are unqualified products, but if the spectral characteristics of only one azimuth are consistent with those of the normal foods, the foods are characterized as possibly being degenerated, the foods to be sold can be firstly transferred to a forbidden selling area, and prompt is carried out when the staff clear, so as to confirm whether the foods to be sold are degenerated.
In a specific example, a package having been damaged means that the food package has been deformed or that the food package has been opened. The food deterioration may be caused by food expiration, damage to food packaging, and severe weather in the environment of the vending machine, such as long-term high temperature or long-term rainy days. In addition, the target area is used for storing unqualified food for sale, and the unqualified food for sale is uniformly placed in one place so that subsequent staff can uniformly clean the food. In particular, the target area may be a reject bin in fig. 2.
Through steps 101 to 103, in the embodiment of the present application, image information of multiple orientations and spectrum information of multiple orientations of food to be sold in the vending machine may be obtained in real time, and further, whether the food package is damaged or not is determined according to the image information of multiple orientations, and whether the food to be sold is deteriorated or not is determined according to the spectrum information of multiple orientations, and if any one of the conditions occurs, it is determined that the food to be sold is a defective product, and it is required to move the product to a target area, where the food in the area is prohibited from being sold. Therefore, according to the embodiment of the application, food to be sold in the vending machine can be checked in real time, unqualified products can be moved to the target area to be forbidden to be sold, so that not only is the real-time monitoring of the food to be sold realized, but also the false selling of the unqualified food to a user is avoided, the food safety quality is ensured, and the problems that the food safety quality cannot be ensured due to the fact that food state checking is performed on the food in the food vending machine manually in the related art are solved, and the checking efficiency is low.
In the embodiment of the application, the freshness of the food can be evaluated by a spectrum analysis technology with specific wavelength. Because when the food starts to deteriorate, its internal components (such as moisture, fat, protein, etc.) change, resulting in a change in absorption, reflection or scattering properties of light of a specific wavelength. For example, near Infrared (NIR) spectra are commonly used to detect moisture content in food products, while the visible and ultraviolet spectra are used to detect changes in microbial activity. By comparing the spectral data of the food with a standard database of known freshness (spectral data of non-spoiled food), it can be judged whether the food starts spoiling. In particular, if the detected spectral characteristics match the characteristics of a spoiled food product, it is indicated that the food product may have been stale. Based on this, the manner of moving the food to be sold to the target area of the vending machine in the case that the food to be sold is deteriorated according to the spectral characteristics, which is referred to in the above step 103, may further include:
A step 11 of determining at least one of the absorption characteristic, the reflection characteristic, and the scattering characteristic of the light of the target wavelength based on the spectral characteristic;
step 12, determining deterioration of the food to be sold under the condition that the characteristics of the target wavelength light in at least two directions are inconsistent with the target characteristics, wherein the target characteristics are the characteristics of the target wavelength light when the food to be sold is not deteriorated;
and 13, moving the spoiled food to be sold to a target area of the vending machine.
It can be seen that in the embodiment of the present application, after the obtained spectral characteristics of the food for sale, that is, the target wavelength light absorption characteristic, the reflection characteristic and the scattering characteristic, the obtained spectral characteristics of the food for sale may be compared with those of the food which is not modified, and if there is a difference between the obtained spectral characteristics of at least two directions, it is indicated that the food for sale is modified, and it is required to move the food for sale to the target area of the vending machine, so as to prohibit vending the food.
When the light of the target wavelength is characterized by the absorption characteristic, it is necessary to compare whether the absorption peak is shifted or whether the intensity of the absorption peak is lowered or whether a new absorption peak appears, and in any of these cases, the occurrence of the new absorption peak may be caused by the change of chemical components in the food, and the change of chemical components in the food may occur after the food is deteriorated. Based on this, in the case where the characteristics of the target wavelength light in at least two directions and the target characteristics related to the above step 12 do not coincide, determining the manner in which the food to be sold is spoiled may further include:
mode 1) determining that the food to be sold is spoiled in the case where the absorption peaks of the target wavelength light in at least two directions are shifted from the absorption peaks of the target wavelength light when the food to be sold is not spoiled;
Mode 2), determining that the food to be sold is spoiled by the new absorption peak of the target wavelength light in at least two directions compared with the target wavelength light when the food to be sold is not spoiled;
specifically, as the food product deteriorates, its internal chemical composition changes, resulting in shifting or weakening of the absorption peak position at certain specific wavelengths (near infrared light). For example, proteolytic degradation can result in a decrease in the intensity of its absorption peak in the near infrared region.
Mode 3), determining that the food for sale is spoiled when the intensity of the absorption peak of the target wavelength light in at least two directions is reduced compared to the intensity of the absorption peak of the target wavelength light when the food for sale is not spoiled.
In particular, new compounds are generated during the deterioration of food, which may exhibit new absorption peaks in the spectrum. For example, microbial metabolites such as ammonia, sulfides, etc., can produce new absorption peaks at specific wavelengths (near infrared light). In order to avoid misjudgment of the spectral information of one azimuth, the spectral characteristics of at least two azimuth in the embodiment of the application are different from those of normal foods, and the food is characterized as being deteriorated, namely the food is an unqualified product, so that the accuracy of whether the food is deteriorated is improved. However, if the spectral characteristics of only one direction are consistent with those of normal foods, the food deterioration is possibly caused, the food to be sold can be firstly moved to a non-selling area, and a prompt is given when a worker cleans the food to confirm whether the food to be sold is determined to be deteriorated or not.
For the emission characteristic of light of the spectral characteristic being the target wavelength, if deterioration occurs in the food, the physical properties such as loss of moisture or growth of microorganisms may be changed, resulting in a change in reflectance. For example, drying of the surface of a food product may result in increased reflectivity, while formation of a microbial film may result in decreased reflectivity. Based on this, in the case where the characteristics of the target wavelength light in at least two directions and the target characteristics related to the above step 12 do not coincide, determining the manner in which the food to be sold is spoiled may further include:
Mode 1), the deterioration of the food product for sale is determined in the case where the reflectance intensity of the target wavelength light in at least two directions is reduced compared to the intensity of the reflectance of the target wavelength light when the food product for sale is not deteriorated.
It follows that comparing the reflectance intensity of light at the target wavelength in the spectral characteristics of the food product to that of light at the target wavelength when the same food product is not spoiled indicates that spoilage of the currently sold food product may occur if the reflectance is reduced. In the embodiment of the application, in order to further determine whether food is spoiled, whether the food is spoiled is determined by the change of the reflectivity intensity of at least two directions, and if the reflectivity intensity of only one direction is reduced, the food can be transferred to a sales prohibiting area, and a worker further determines whether the food is spoiled.
For scattering properties of light whose spectral properties are the target wavelength, changes in the internal structure of the food product, such as cell wall rupture or fat oxidation, can lead to changes in the scattering properties. These changes are manifested in the spectrum as changes in the position and intensity of the scattering peaks, i.e. if the scattering peaks shift or the scattering peak intensity decreases, this indicates that deterioration of the current food product may occur. Based on this, in the case that the characteristics of the target wavelength light in at least two directions and the target characteristics are inconsistent, the method for determining the deterioration of the food for sale in the step 12 may further include:
Mode 1) determining that the food to be sold is spoiled in the case where the scattering peaks of the target wavelength light in at least two directions are shifted from the scattering peaks of the target wavelength light when the food to be sold is not spoiled;
Mode 2) determining that the food item for sale is spoiled in the case where the intensity of the scattering peak of the light of the target wavelength in at least two directions is reduced compared to the intensity of the scattering peak of the light of the target wavelength when the food item for sale is not spoiled.
In the above manner, after the scattering peak of the light with the target wavelength shifts or the intensity thereof decreases, it is indicated that the current food may deteriorate, and it is necessary to move the food to the target area to prohibit selling the food. In the embodiment of the application, in order to further determine whether food is spoiled, whether the food is spoiled is determined through the change of the back scattering peaks of at least two directions, if the scattering peak of only one direction shifts or the intensity is reduced, the food can be transferred to a forbidden selling area, and the staff can further determine whether the food is spoiled.
In the embodiment of the present application, if the camera and the spectrum sensor cannot acquire the image information and the spectrum information of all the foods to be sold at one time, the image information and the spectrum information of the foods with a shorter shelf life may be acquired first, that is, the corresponding image information and the spectrum information may be sequentially acquired according to the remaining duration of the shelf life, and based on this, the method for acquiring the image information of the foods to be sold in the vending machine and the spectrum information of the foods to be sold in the step 101 may further include:
step 21, determining the remaining duration of the quality guarantee period of each food to be sold in the vending machine;
Step 22, determining food to be sold with the residual time period being less than the preset time period;
step 23, moving the plurality of cameras in the vending machine to the area where the food to be sold is located to obtain image information of a plurality of directions of the food to be sold, and moving the plurality of spectrum sensors in the vending machine to the area where the food to be sold is located to obtain spectrum information of a plurality of directions of the food to be sold.
For the above steps 21 to 23, in a specific example, taking the remaining time period as ten days as an example, the image information and the spectrum information of the food with the shelf life of less than ten days in the vending machine are preferentially obtained, and because the closer the shelf life is, the greater the possibility of deterioration of the food, it can be preferentially determined whether the food with the shelf life of less than ten days is an unqualified food, and further the safety quality of the food can be effectively improved. Taking fig. 2 as an example, the foods in the current area 1 have various foods, firstly acquiring the quality guarantee period of the foods, further determining the residual duration of the quality guarantee period of each food, then sequencing the residual durations of each food, and then acquiring the image information and the spectrum information of the foods from the food with the shortest residual duration to determine whether the foods are unqualified foods.
In addition, in the embodiment of the application, whether to preferentially acquire the image information and the spectrum information of the food can be determined according to the updating frequency of the food. A lower frequency indicates that the current food product is sold slower, and the time of storage in the vending machine may be longer, and therefore the likelihood of deterioration of the food product is higher in comparison. Based on this, the method for acquiring the image information of the food to be sold in the vending machine and the spectrum information of the food to be sold in the vending machine in the step 101 may further include:
Step 31, determining food for sale with update frequency exceeding a preset threshold;
And step 32, moving a plurality of cameras in the vending machine to the area where the food to be sold is located to acquire image information of a plurality of directions of the food to be sold, and moving a plurality of spectrum sensors in the vending machine to the area where the food to be sold is located to acquire spectrum information of a plurality of directions of the food to be sold.
In this regard, in a particular example, the update frequency refers to the replacement of a food item in a vending machine that is typically replenished or adjusted after the food item is vended, such as a food item replenished every three days, while another food item may be replenished every fifteen days. Further, the preset threshold may be set to 8 days, i.e., the update frequency is more than 8 days, which indicates that the food is not sold for a long period of time, and thus it is required to preferentially determine whether it is a defective food.
In an embodiment of the present application, for the case that the package of the food for sale is damaged according to the package condition, moving the food for sale to the target area of the vending machine, which is referred to in the step 103, includes moving the food for sale to the target area of the vending machine when the image information of at least two directions indicates that the package of the food for sale is damaged, or the image information of two adjacent directions indicates that the package of the food for sale is damaged.
In the embodiment of the application, the package condition of the food to be sold is acquired from a plurality of directions, namely, the condition that the whole package is required to be acquired, and any angle of the package is damaged normally to be a disqualified product, but for misjudgment of the image information of one direction, the image information of at least two directions in the application indicates that the food package is damaged indeed, so that the accuracy of determining whether the package is damaged can be improved. However, if only one orientation of the image information indicates that the package is damaged, but in fact, no damage may occur, the package may be prompted to be damaged when purchased by the customer, and the customer may be further confirmed to determine whether to pay for the purchase, so that the sale of damaged food to the customer can be avoided.
The following further explains the embodiment of the application with reference to fig. 2, and the application also provides an intelligent monitoring and rejecting method for the food vending machine. As shown in fig. 2, 1 is a food selling rack for storing food to be sold, 2 is a disqualified product rack for storing detected damaged or deteriorated food, and ensures that the food cannot be sold, 3 is a transport trolley which can move to any layer of rack for food to be sold and disqualified products to be transferred, 4 is a food outlet, the transport trolley sends the food to be sold to a place where a user can take the food, 5 is a multispectral sensor for detecting light rays with different wavelengths, analyzing the color and material changes of the food, judging the freshness of the food, and 6 is a camera for monitoring the food state in real time.
Based on the above, the intelligent monitoring and rejecting method for the food vending machine, as shown in fig. 3, comprises the following steps:
Step 301, food supplementation;
Step 302, monitoring in real time;
Step 303, analyzing the acquired image and spectrum data;
Step 304, determining whether the food is a good;
step 305, in the case that the food is not failed, the transportation trolley sends the failed product to a failed shelf and notifies the staff;
step 306, in the case that the food is not qualified, the transportation trolley sends qualified sold food to the meal outlet, and the user finishes taking the meal.
As can be seen from the steps 301 to 306, the vending layer shelf can be periodically replenished with fresh food, so as to ensure that the food in the vending machine is sufficient. And camera and multispectral sensor in selling the machine real-time supervision goods shelves are last to wait to go out the food state of meal, and high definition image and the spectral data of catching food promptly monitor the food that will sell. Analyzing the collected data to identify the damage and deterioration of the food. Further, defects such as breakage, stains, uneven color and the like of food packages are detected through an image processing algorithm, and the freshness of the food is judged by analyzing light rays with different wavelengths through a multispectral sensor. If the detection is failed, the transportation trolley is controlled to pick up the failed product and transport the failed product to the failed product shelf, and the staff is informed to follow-up treatment, so that the failed product is prevented from being sold. If the food is detected to be qualified, the transportation trolley is controlled to deliver qualified sold food to a meal outlet, and the user takes the meal.
Therefore, in the embodiment of the application, the quality and safety of the food in the vending machine can be ensured by monitoring the state of the food in real time and automatically identifying and removing damaged and deteriorated food. In addition, the automatic monitoring and removing system reduces the dependence on manual inspection, removes damaged foods in time, improves the operation efficiency of the vending machine, reduces the labor cost and improves the user satisfaction. Further, the monitoring and rejecting results can be fed back in real time, so that operators can know the food state in the vending machine in time, and necessary maintenance and replenishment operation can be performed.
Corresponding to fig. 1, the embodiment of the application also provides a device for monitoring food to be sold in the vending machine, as shown in fig. 4, the device comprises:
The acquisition module 402 is configured to acquire image information of food to be sold in the vending machine and spectrum information of the food to be sold, where the image information includes image information of shooting the food to be sold from a plurality of directions, and the spectrum information includes spectrum information obtained by monitoring the food to be sold from the plurality of directions;
A determining module 404, configured to determine a packaging situation of the food to be sold based on the image information of the plurality of orientations, and determine a spectral characteristic of the food to be sold based on the spectral information of the plurality of orientations;
the processing module 406 is configured to move the food to be sold to a target area of the vending machine when it is determined that the package of the food to be sold is damaged according to the package condition and/or when it is determined that the food to be sold is spoiled according to the spectral characteristic, wherein the target area is a vending forbidden area.
By the device provided by the embodiment of the application, the image information of the food to be sold in the vending machine and the spectrum information of the food in the plurality of directions can be obtained in real time, so that whether the food package is damaged or not is determined by the image information of the plurality of directions, and whether the food to be sold is deteriorated or not is determined by the spectrum information of the plurality of directions, and if any one of the conditions occurs, the food to be sold is judged to be an unqualified product, the food needs to be moved to a target area, and the food in the area is forbidden to be sold. Therefore, according to the embodiment of the application, food to be sold in the vending machine can be checked in real time, unqualified products can be moved to the target area to be forbidden to be sold, so that not only is the real-time monitoring of the food to be sold realized, but also the false selling of the unqualified food to a user is avoided, the food safety quality is ensured, and the problems that the food safety quality cannot be ensured due to the fact that food state checking is performed on the food in the food vending machine manually in the related art are solved, and the checking efficiency is low.
In an alternative implementation manner of the embodiment of the application, the processing module in the embodiment of the application further comprises a first determining unit, a second determining unit and a first moving unit, wherein the first determining unit is used for determining the characteristics of at least one of absorption characteristics, reflection characteristics and scattering characteristics of the target wavelength light based on the spectral characteristics, the second determining unit is used for determining the deterioration of the food to be sold when the characteristics of the target wavelength light in at least two directions are inconsistent with the characteristics of the target, the characteristics of the target wavelength light are the characteristics of the food to be sold when the characteristics of the target wavelength light are not deteriorated, and the first moving unit is used for moving the deteriorated food to a target area of the vending machine.
In an alternative implementation manner of the embodiment of the present application, the second determining unit in the embodiment of the present application may further include a first determining subunit for determining that the food for sale is spoiled in a case where the absorption peak of the target wavelength light in at least two directions is shifted compared to the absorption peak of the target wavelength light when the food for sale is not spoiled, and/or a second determining subunit for determining that the food for sale is spoiled in a case where the target wavelength light in at least two directions has a new absorption peak compared to the target wavelength light when the food for sale is not spoiled, and/or a third determining subunit for determining that the food for sale is spoiled in a case where the absorption peak intensity of the target wavelength light in at least two directions is reduced compared to the intensity of the absorption peak of the target wavelength light when the food for sale is not spoiled.
In an alternative implementation manner of the embodiment of the present application, the second determining unit in the embodiment of the present application may further include a fourth determining subunit for determining that the food for sale is spoiled in a case that the intensity of the reflectivity of the target wavelength light in at least two directions is reduced compared to the intensity of the reflectivity of the target wavelength light when the food for sale is not spoiled.
In an alternative implementation manner of the embodiment of the present application, the second determining unit in the embodiment of the present application may further include a fifth determining subunit for determining that the food for sale is spoiled in a case where the scattering peak of the target wavelength light in at least two directions is shifted compared to the scattering peak of the target wavelength light when the food for sale is not spoiled, and/or a sixth determining subunit for determining that the food for sale is spoiled in a case where the scattering peak of the target wavelength light in at least two directions is reduced in intensity compared to the scattering peak of the target wavelength light when the food for sale is not spoiled.
In an optional implementation manner of the embodiment of the application, the acquisition module in the embodiment of the application further comprises a third determination unit, a fourth determination unit, a first acquisition unit and a second acquisition unit, wherein the third determination unit is used for determining the remaining time of the quality guarantee period of each food to be sold in the vending machine, the fourth determination unit is used for determining the food to be sold with the remaining time being lower than the preset time, the first acquisition unit is used for moving a plurality of cameras in the vending machine to an area where the food to be sold is located to acquire image information of a plurality of directions of the food to be sold, and a plurality of spectrum sensors in the vending machine are moved to the area where the food to be sold is located to acquire spectrum information of a plurality of directions of the food to be sold.
In an optional implementation manner of the embodiment of the present application, the acquisition module in the embodiment of the present application may further include a fifth determining unit, configured to determine food to be sold with an update frequency exceeding a preset threshold, a second acquiring unit, configured to move a plurality of cameras in the vending machine to an area where the food to be sold is located to acquire image information of a plurality of directions of the food to be sold, and move a plurality of spectrum sensors in the vending machine to the area where the food to be sold is located to acquire spectrum information of a plurality of directions of the food to be sold.
In an alternative implementation manner of the embodiment of the present application, the processing module in the embodiment of the present application may further include a second moving unit, configured to move the food product to the target area of the vending machine, where the image information of at least two orientations indicates that the package of the food product for sale is damaged, or the image information of two adjacent orientations indicates that the package of the food product for sale is damaged.
As shown in fig. 5, an embodiment of the present application provides an electronic device including a processor 511, a communication interface 512, a memory 513, and a communication bus 514, wherein the processor 511, the communication interface 512, and the memory 513 communicate with each other via the communication bus 514,
A memory 513 for storing a computer program;
In an embodiment of the present application, the processor 511 is configured to implement the method for monitoring food to be sold in the vending machine provided in any one of the foregoing method embodiments when executing the program stored in the memory 513, and the function of the method is similar and will not be described herein.
The embodiment of the application also provides a computer readable storage medium, on which a computer program is stored, the computer program, when executed by a processor, implementing the steps of the method for monitoring food products for sale in a vending machine according to any one of the method embodiments.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
From the above description of embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus a general purpose hardware platform, or may be implemented by hardware. Based on such understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the related art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the method described in the respective embodiments or some parts of the embodiments.
It is to be understood that the terminology used herein is for the purpose of describing particular example embodiments only, and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises," "comprising," "includes," "including," and "having" are inclusive and therefore specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order described or illustrated, unless an order of performance is explicitly stated. It should also be appreciated that additional or alternative steps may be used.
The foregoing is only a specific embodiment of the invention to enable those skilled in the art to understand or practice the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method of monitoring food products for sale in a vending machine, comprising:
acquiring image information of food to be sold in the vending machine and spectrum information of the food to be sold, wherein the image information comprises image information for shooting the food to be sold from a plurality of directions, and the spectrum information comprises spectrum information obtained by monitoring the food to be sold from the plurality of directions;
determining a packaging condition of the food for sale based on the image information of the plurality of directions, and determining a spectral characteristic of the food for sale based on the spectral information of the plurality of directions;
And moving the food to be sold to a target area of the vending machine under the condition that the package of the food to be sold is damaged according to the package condition and/or the deterioration of the food to be sold is determined according to the spectral characteristics, wherein the target area is a vending forbidden area.
2. The method of claim 1, wherein moving the food product for sale to the target area of the vending machine if the deterioration of the food product for sale is determined based on the spectral characteristics comprises:
determining a characteristic of at least one of absorption, reflection and scattering characteristics of the light of the target wavelength based on the spectral characteristic;
determining that the food for sale is spoiled if the characteristics of the light with the target wavelength in at least two directions are inconsistent with target characteristics, wherein the target characteristics are characteristics of the light with the target wavelength when the food for sale is not spoiled;
and moving the spoiled food product for sale to a target area of the vending machine.
3. The method of claim 2, wherein determining that the food product for sale is spoiled if the characteristics of the target wavelength light in at least two orientations are inconsistent with target characteristics comprises:
Determining that the food product for sale is spoiled if the absorption peak of the target wavelength light in at least two orientations is shifted compared to the absorption peak of the target wavelength light when the food product for sale is not spoiled;
and/or the number of the groups of groups,
Determining that the food item for sale is spoiled by the presence of a new absorption peak of the target wavelength light in at least two orientations when the target wavelength light is not spoiled compared to the food item for sale;
and/or the number of the groups of groups,
Determining that the food product for sale is spoiled if the intensity of the absorption peak of the light of the target wavelength in at least two orientations is reduced compared to the intensity of the absorption peak of the light of the target wavelength when the food product for sale is not spoiled.
4. The method of claim 2, wherein determining that the food product for sale is spoiled if the characteristics of the target wavelength light in at least two orientations are inconsistent with target characteristics comprises:
determining that the food product for sale is spoiled if the reflectance intensity of the target wavelength light in at least two orientations is reduced compared to the intensity of the reflectance of the target wavelength light when the food product for sale is not spoiled.
5. The method of claim 2, wherein determining that the food product for sale is spoiled if the characteristic of the target wavelength light does not correspond to a target characteristic comprises:
Determining that the food product for sale is spoiled if the scattering peaks of the target wavelength light in at least two orientations are shifted compared to the scattering peaks of the target wavelength light when the food product for sale is not spoiled;
and/or the number of the groups of groups,
Determining that the food product for sale is spoiled if the intensity of the scattered peak of the light of the target wavelength in at least two orientations is reduced compared to the intensity of the scattered peak of the light of the target wavelength when the food product for sale is not spoiled.
6. The method of claim 1, wherein moving the food product for sale to the target area of the vending machine if it is determined from the packaging conditions that the package of the food product for sale has been damaged, comprises:
Moving the food product for sale to a target area of the vending machine in the event that at least two of the image information characterizing the package of the food product for sale has been damaged, or that two adjacent of the image information characterizing the package of the food product for sale have been damaged.
7. The method of claim 1, wherein acquiring image information of the food product for sale in the vending machine, and spectral information of the food product for sale, comprises:
determining the remaining duration of the shelf life of each food product for sale in the vending machine;
determining food to be sold with the residual time period being less than a preset time period;
And moving a plurality of cameras in the vending machine to the area where the food to be sold is located to acquire image information of a plurality of directions of the food to be sold, and moving a plurality of spectrum sensors in the vending machine to the area where the food to be sold is located to acquire spectrum information of the plurality of directions of the food to be sold.
8. A monitoring device for food products offered for sale in a vending machine, comprising:
the acquisition module is used for acquiring image information of food to be sold in the vending machine and spectrum information of the food to be sold, wherein the image information comprises image information for shooting the food to be sold from a plurality of directions, and the spectrum information comprises spectrum information obtained by monitoring the food to be sold from the plurality of directions;
A determining module, configured to determine a packaging condition of the food for sale based on the image information of the plurality of directions, and determine a spectral characteristic of the food for sale based on the spectral information of the plurality of directions;
and the processing module is used for moving the food to be sold to a target area of the vending machine under the condition that the package of the food to be sold is damaged according to the package condition and/or the deterioration of the food to be sold is determined according to the spectral characteristics, wherein the target area is a vending forbidden area.
9. An electronic device comprising at least one communication interface, at least one bus connected to the at least one communication interface, at least one processor connected to the at least one bus, at least one memory connected to the at least one bus, wherein the processor is configured to perform the method of monitoring food products for sale in a vending machine as claimed in any one of the preceding claims 1 to 7.
10. A computer storage medium storing computer executable instructions for performing the method of monitoring food products for sale in a vending machine as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411753015.5A CN119399872A (en) | 2024-12-02 | 2024-12-02 | Method and device for monitoring food for sale in vending machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411753015.5A CN119399872A (en) | 2024-12-02 | 2024-12-02 | Method and device for monitoring food for sale in vending machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN119399872A true CN119399872A (en) | 2025-02-07 |
Family
ID=94429640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411753015.5A Withdrawn CN119399872A (en) | 2024-12-02 | 2024-12-02 | Method and device for monitoring food for sale in vending machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN119399872A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107835938A (en) * | 2015-07-08 | 2018-03-23 | 皮道练 | Food state measuring device, food state measuring module, smart device including same |
| CN108805123A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | A kind of device, method and system that the time limit reminds |
| CN109668852A (en) * | 2018-12-25 | 2019-04-23 | Oppo广东移动通信有限公司 | Electronic equipment, information-pushing method and Related product |
| CN208985289U (en) * | 2018-08-31 | 2019-06-14 | 杭州吧啦熊自动化科技有限公司 | A kind of monitoring processing system of automatic vending machine |
| CN110136129A (en) * | 2019-05-22 | 2019-08-16 | 广东工业大学 | A kind of commodity quality detection method, device and storage medium |
| CN113447084A (en) * | 2021-08-31 | 2021-09-28 | 季华实验室 | Detection device, system, method and storage medium for estimating shelf life of food |
| CN117824284A (en) * | 2023-12-22 | 2024-04-05 | 北京声智科技有限公司 | Food expiration reminding method and device, refrigerator and storage medium |
-
2024
- 2024-12-02 CN CN202411753015.5A patent/CN119399872A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107835938A (en) * | 2015-07-08 | 2018-03-23 | 皮道练 | Food state measuring device, food state measuring module, smart device including same |
| CN108805123A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | A kind of device, method and system that the time limit reminds |
| CN208985289U (en) * | 2018-08-31 | 2019-06-14 | 杭州吧啦熊自动化科技有限公司 | A kind of monitoring processing system of automatic vending machine |
| CN109668852A (en) * | 2018-12-25 | 2019-04-23 | Oppo广东移动通信有限公司 | Electronic equipment, information-pushing method and Related product |
| CN110136129A (en) * | 2019-05-22 | 2019-08-16 | 广东工业大学 | A kind of commodity quality detection method, device and storage medium |
| CN113447084A (en) * | 2021-08-31 | 2021-09-28 | 季华实验室 | Detection device, system, method and storage medium for estimating shelf life of food |
| CN117824284A (en) * | 2023-12-22 | 2024-04-05 | 北京声智科技有限公司 | Food expiration reminding method and device, refrigerator and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230214982A1 (en) | Machine learning-based assessment of food item quality | |
| Keresztes et al. | Real-time pixel based early apple bruise detection using short wave infrared hyperspectral imaging in combination with calibration and glare correction techniques | |
| Blasco et al. | Computer vision detection of peel defects in citrus by means of a region oriented segmentation algorithm | |
| US20220174912A1 (en) | Egg Sorting Device, Egg Sorting Method and Recording Medium | |
| Hu et al. | The potential of double K‐means clustering for banana image segmentation | |
| JP6790160B2 (en) | Intelligent machine network | |
| US10918016B2 (en) | System and method for grading agricultural commodity | |
| Shanthini et al. | Early bruise detection, classification and prediction in strawberry using Vis-NIR hyperspectral imaging | |
| CN118279808B (en) | Spot check evidence obtaining method, system, electronic equipment and medium based on video analysis | |
| CN117726278B (en) | Agricultural product flow management method and system | |
| CN118469310B (en) | Grain inventory management method and system in granary | |
| Castillo-Gironés et al. | Detection of subsurface bruises in plums using spectral imaging and deep learning with wavelength selection | |
| CN119234249A (en) | Uv light and machine learning based assessment of food item quality | |
| JP7597089B2 (en) | Metal strip manufacturing method | |
| Eyarkai Nambi et al. | Comparison of various RGB image features for nondestructive prediction of ripening quality of “Alphonso” mangoes for easy adoptability in machine vision applications: a multivariate approach | |
| US11745224B2 (en) | Method and apparatus for sorting | |
| Donis-González et al. | Color vision system to assess English walnut (Juglans Regia) kernel pellicle color | |
| JP2022098763A (en) | Freshness management system, freshness management method, and freshness management program | |
| JP7097642B1 (en) | Food inspection system, food inspection learning device and food inspection method | |
| CN109711337A (en) | A method of realizing object using Background matching, whether there is or not detections | |
| CN119399872A (en) | Method and device for monitoring food for sale in vending machine | |
| US20230206186A1 (en) | Fried food disposal time management device, fried food disposal time management system, and fried food disposal time management method | |
| Ogidi et al. | Enhancing Food Safety and Quality Control With Computer Vision Systems | |
| Puchalski et al. | Image analysis for apple defect detection | |
| FR2809642A1 (en) | METHOD OF SORTING OBJECTS BY VIDEOMETRY AND INSTALLATION FOR ITS IMPLEMENTATION |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20250207 |