[go: up one dir, main page]

WO2022041992A1 - Réfrigérateur, dispositif d'affichage, serveur, procédé de recommandation et procédé de rappel de message - Google Patents

Réfrigérateur, dispositif d'affichage, serveur, procédé de recommandation et procédé de rappel de message Download PDF

Info

Publication number
WO2022041992A1
WO2022041992A1 PCT/CN2021/102312 CN2021102312W WO2022041992A1 WO 2022041992 A1 WO2022041992 A1 WO 2022041992A1 CN 2021102312 W CN2021102312 W CN 2021102312W WO 2022041992 A1 WO2022041992 A1 WO 2022041992A1
Authority
WO
WIPO (PCT)
Prior art keywords
ingredient
recipe
ingredients
existing
refrigerator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/102312
Other languages
English (en)
Chinese (zh)
Inventor
卢可敬
穆聪聪
张振宝
王光强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Juhaokan Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202010855107.XA external-priority patent/CN111984838A/zh
Priority claimed from CN202110606093.2A external-priority patent/CN113251727A/zh
Priority claimed from CN202110617466.6A external-priority patent/CN114294884B/zh
Application filed by Hisense Visual Technology Co Ltd, Juhaokan Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Publication of WO2022041992A1 publication Critical patent/WO2022041992A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation

Definitions

  • the smart refrigerator usually first recognizes all the ingredients it stores, then generates various popular recipes containing the identified ingredients, and finally displays the popular recipes on the display screen of the refrigerator, or recommends the recipes in other related recipes. on an associated display device, such as a smart TV.
  • a box door located at the opening of the storage room
  • a display screen arranged on the box door, for displaying a user interface
  • a part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
  • the present application further provides a method for pushing information, which is applied to a refrigerator, where the refrigerator includes a display screen, and the method includes:
  • a part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
  • the application provides a refrigerator, comprising:
  • the box body has a storage room inside for storing ingredients
  • a box door located at the opening of the storage room
  • a display arranged on the box door, for displaying a user interface
  • the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room;
  • the reminder message including the ingredient name of the target ingredient
  • the target ingredients at least include ingredients whose freshness satisfies the preset reminder condition determined according to the time-related information corresponding to the existing ingredients in the refrigerator;
  • the reminder message including the ingredient name of the target ingredient
  • a server comprising: a media repository for storing recipe data corresponding to ingredients; a second controller configured to: receive a recommendation request sent from a display device, and store in the media repository according to the The recommended recipe data that can be provided by querying the main ingredients of the ingredients stored in the user's refrigerator, the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; and the recommended recipe data is sent to the display device.
  • a method for recommending recipes comprising: receiving a recommendation request sent from a display device, and querying available recommended recipe data according to main ingredients in the ingredients stored in the user's refrigerator, and the user's refrigerator stores ingredients Recognized by the server as a main ingredient or an auxiliary ingredient; and sending the recommended recipe data to the display device.
  • FIG. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
  • FIG. 2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application
  • FIG. 8 is another food material management interface shown in the present application according to an exemplary embodiment
  • FIG. 9 is a recipe detail interface shown in the present application according to an exemplary embodiment.
  • FIG. 11 is another recipe display interface shown in this application according to an exemplary embodiment
  • FIG. 12 is a flowchart of a method for pushing information according to an exemplary embodiment of the present application.
  • Fig. 13 is a flowchart showing the steps of configuring a refrigerator controller according to an exemplary embodiment of the present application
  • FIG. 14 is an application scenario shown in the present application according to an exemplary embodiment
  • FIG. 15 is a user interface of a display device shown in the present application according to an exemplary embodiment
  • FIG. 16 is a user interface of a refrigerator display according to an exemplary embodiment of the present application.
  • FIG. 17B shows a UI schematic diagram of displaying device recommended recipe data according to an embodiment of the present application
  • FIG. 17C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application.
  • 17D shows a schematic diagram of an operation interface of recommended recipe data according to an embodiment of the present application.
  • FIG. 19 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application.
  • FIG. 20B shows a schematic front view of a refrigerator according to an embodiment of the present application.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.
  • Fig. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
  • the shape of the refrigerator provided by the embodiment of the present invention is approximately a rectangular parallelepiped.
  • the appearance of the refrigerator is defined by the storage compartment 101 providing a limited storage space and a plurality of box doors 200 provided at the opening of the storage compartment 101 .
  • the storage compartment 101 is a box body 100 with an opening.
  • the storage compartment 101 includes a freezing compartment 101A located below and a refrigerating compartment 101B located above, and the freezing compartment 101A and the refrigerating compartment 101B respectively have one or more an independent storage space.
  • freezer compartment 101A may be selectively covered by freezer drawer door 200A.
  • the refrigerator compartment 101B is partitioned into left and right sides.
  • the refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotally mounted on the refrigerating compartment 101B.
  • Fig. 1b is a schematic view of the appearance of a refrigerator according to an exemplary embodiment of the present application.
  • a display screen is provided on the refrigerator compartment door 200B, and the display screen is embedded in the door body.
  • a tag reading area is provided at a position below the display screen on the refrigerator compartment door 200B, and the tag reading area has a built-in antenna for reading RFID tags, so as to identify RFID tags at a short distance.
  • the plane on which the screen of the display screen is located is flush with the outer surface of the box door.
  • the refrigerator 200 may include a display screen 210, a controller 220, a detector 240, a memory 250, a communicator 260, and several user input interfaces.
  • the display screen 210, the antenna 230, the detector 240, and the memory 250 are coupled with the controller 220 through a communication interface.
  • the display 210 is used for receiving the image signal output by the controller 220 , performing components for displaying video content and images and a menu manipulation interface, and displaying a user manipulation UI interface for controlling the refrigerator 200 .
  • the controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • SoC system on a chip
  • CPU central processing unit
  • MCU microcontroller
  • memory controller and the like.
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the refrigerator further includes a plurality of antennas 230 for detecting RFID tags, and the controller 220 communicates with the antennas 230 through a serial port.
  • the controller 220 includes an RFID module, the RFID module, the antenna 230 and the RFID tag constitute an RFID reading and writing system, the antenna 230 is used to transmit radio frequency signals between the RFID module and the RFID tag, and the RFID module completes the pairing process through the antenna 230. Read and write operations of RFID tags.
  • the RFID module communicates with the antenna through a serial port.
  • the memory 250 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; can also include non-volatile memory (non-volatile memory, NVM), such as: read-only memory (read-only memory, ROM), flash memory (flash memory), etc.
  • volatile memory dynamic random access memory
  • SRAM static random access memory
  • NVM non-volatile memory
  • different storage units may be independent devices, or may be integrated or packaged in one or more processors or communication interfaces, and become part of the processors or communication interfaces.
  • Program instructions and applications are stored in the memory 250 .
  • the controller 220 can call program instructions in the memory 250 or run an application program, so that the refrigerator executes a related method, such as the method for scanning food labels provided in the embodiments of the present application.
  • the detector 240 including at least a sound collector, such as a microphone, may be used to receive the user's voice.
  • the voice signal includes a control instruction of the user to control the refrigerator 200 .
  • the detector 240 may also include a box door switch state sensor, such as a magnetic sensitive switch, a mechanical switch, for detecting the switch signal of each box door, and when the switch state of the box door is recorded according to the detected switch signal, the switch is sent. Status information to the controller 220 .
  • the detector detects an opening signal or a closing signal of any box door, it sends the latest switch state information to the controller 220 .
  • the detector may further include an image collector, such as a camera, and the camera is used to record the putting-in/out-out time and storage location of the food ingredients.
  • the user input interface includes at least one of other input interfaces such as a microphone, a touch panel, a sensor, and a button.
  • the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc.
  • the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the controller 220.
  • the communicator 260 is used to communicate with the server or the terminal device in the local area network.
  • the antenna 230 may include an antenna disposed in each storage chamber and an antenna disposed in a tag reading area, wherein the antenna disposed in each storage chamber is mainly used for scanning RFID tags in each storage chamber to read the RFID tags
  • the antenna set inside the tag reading area is mainly used to scan the RFID tag on the tag reading area to read the tag information of the RFID tag.
  • the power of the antennas disposed in different storage compartments may be different.
  • the power of the antenna of each storage room can ensure that the antenna can recognize the ingredients included in its own compartment, so as to avoid that the false recognition rate will increase when the power is too high, and the ingredients in its own compartment will not be recognized when the power is too small.
  • the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the refrigerator. The larger the space, the higher the power.
  • RFID tags can be used to identify the ingredients in the storage room.
  • the virtual association between the RFID tag and the ingredient information is realized.
  • the same RFID tag is associated with different food information successively, and the flexibility of using the RFID tag is improved.
  • the ingredients with the RFID tags are stored in the refrigerator, the RFID tags in the storage room are detected by the second antenna to obtain the tag information, and the ingredients identified by the tags are determined according to the association relationship between the tag information and the ingredient information.
  • the ingredient library interface includes a tab switch bar and a content area
  • the tab switch bar includes multiple tab controls
  • the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area.
  • the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
  • the ingredient management application may also draw a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient.
  • the dominant freshness indicator is a display representation of the freshness of the ingredients
  • the freshness of the ingredients is the freshness of the ingredients.
  • this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
  • the ingredients in the refrigerator can be recorded by taking pictures of the ingredients in the refrigerator, and the corresponding ingredients in the collected images can be parsed and identified by the controller, or sent to the The server does the parsing and identification.
  • the camera when the refrigerator door is closed, the camera is not enabled to detect images; when the refrigerator door is opened, the camera is triggered to turn on and take pictures of the inside of the refrigerator.
  • the controller sends the data collected by the camera to the server, and the server analyzes and recognizes the captured pictures, and feeds back the specific ingredients in the refrigerator.
  • the controller is also used to record when the ingredients are first put in, and the shelf life of the stored ingredients.
  • both the RFID module and the camera are used to record food data, one can be applied to the refrigerator.
  • FIG. 3 is a user interface shown in the present application according to an exemplary embodiment, which is specifically an exemplary ingredient management interface.
  • the ingredient management interface includes an RFID tag editing control 301, a recommended recipe control 302, an ingredient adding control 306, and also includes an ingredient display area corresponding to each storage room, such as an ingredient display area 303 corresponding to a refrigerator room, and a corresponding change room.
  • the food material display area 304 and the food material display area 305 corresponding to the cold greenhouse.
  • Each ingredient display area displays an ingredient icon corresponding to each ingredient in the storage room, such as ingredient 1, ingredient 2, and ingredient 3 in ingredient display area 303, ingredient 4 and ingredient 5 in ingredient display area 304, and ingredient display area.
  • Each ingredient icon includes an ingredient image and ingredient name.
  • the ingredient management application determines the freshness of the existing ingredients at preset time intervals according to the current time, the shelf life and the starting time of the existing ingredients. After determining the freshness of the existing ingredients, use the corresponding freshness identifier to mark the corresponding ingredient information in the local ingredient information set, or update the previously marked freshness identifier.
  • the shelf life of "apple” in the local ingredient information set is 30 days
  • the starting time is May 1.
  • the freshness indicator corresponding to the ingredient information corresponding to "apple” is "fresh”.
  • the ingredient icon may include, in addition to the image of the ingredient and the name of the ingredient, an explicit identifier of the freshness of the ingredient.
  • the dominant freshness indicator is a display representation of the freshness of the ingredients
  • the freshness of the ingredients is the freshness of the ingredients.
  • the ingredient management application draws a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient during the process of displaying the ingredient management interface.
  • this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
  • FIG. 4 is another food material management interface shown in this application according to an exemplary embodiment.
  • each ingredient icon also includes an explicit freshness indicator.
  • the freshness of Ingredient 1 and Ingredient 12 is explicitly marked as the word "Expired” displayed on the picture of the ingredient, indicating that the freshness level of Ingredient 1 and Ingredient 12 is "Expired”; the freshness of Ingredient 4 and Ingredient 6
  • the dominant mark is a text mark and a progress bar with the content "2 days remaining” displayed below the image of the ingredients.
  • the progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life, indicating that the remaining two days of the ingredients 4 and 6 expire. That is, it is about to expire; the freshness of the remaining ingredients is explicitly marked as a progress bar, and the progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life.
  • the ingredient management application displays the ingredient management interface according to the ingredient information of the existing ingredients in the local ingredient information set, according to the freshness identifiers and storage location identifiers corresponding to the existing ingredients, the existing ingredients in each storage room are sorted.
  • the icon of the ingredients is displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
  • the controller 220 detects the switch signal of each of the cabinet doors separately through the detector 240, records the switch state of the cabinet door according to the detected switch signal, and analyzes the user's operation of the cabinet door according to the switch state information behavior.
  • the RFID tag in the storage room is detected to obtain the identification information of the RFID tag; according to the identification information of the RFID tag in the storage room, the storage status of the ingredient information in the local ingredient information collection is updated .
  • the user may input an ingredient adding instruction by operating the ingredient adding control in the ingredient management interface.
  • the ingredient management application displays an ingredient library interface in response to an ingredient addition instruction input by the user, and the ingredient library interface displays a large number of optional ingredient icons, each ingredient icon corresponding to an ingredient information.
  • the user can select the ingredient to be added by inputting the selection operation of an ingredient icon.
  • the selected ingredient icon can be added to the ingredient management interface, and on the other hand, the ingredient information corresponding to the selected ingredient icon can be added to the local. A collection of ingredient information and mark it as put.
  • the ingredient library interface includes a tab switch bar and a content area
  • the tab switch bar includes multiple tab controls
  • the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area.
  • the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
  • FIG. 5 is an ingredient management interface shown in some exemplary embodiments of the present application.
  • the ingredient management interface further includes a recipe display area 510.
  • the recipe display area 510 displays recipe controls 511-515 generated according to the recipe AE returned by the server.
  • the corresponding recipe name and cover image are displayed.
  • the user can click any recipe control to view the detailed content of the recipe, and the user can click the page turning button ">" to view more recipes.
  • the ingredient management application After receiving the recipe information returned by the server, the ingredient management application enters the recipe display interface from the ingredient management interface, and displays the recipe returned by the server in the recipe display interface.
  • the ingredient management application provides an independent recipe display interface, and the recipe returned by the server is displayed in the recipe display interface.
  • FIG. 7 is a recipe display interface shown in some exemplary embodiments of the present application, which may specifically be an interface displayed after the user clicks on the recommended recipe interface when the ingredient management interface shown in FIG. 3 is displayed.
  • the recipe display interface displays a return button and recipe controls 701-710 generated according to recipes A-J returned by the server, and the recipe controls display the corresponding recipe name and cover image.
  • the user can click any recipe control to view the detailed content of the recipe, and can click the back button to return to the ingredient management interface.
  • the ingredient management application determines the weight value corresponding to each existing ingredient according to the freshness level of each existing ingredient in each recipe, wherein the weight values corresponding to different freshness levels are different; and then calculates the corresponding weight value of all existing ingredients in each recipe.
  • the sum of the weight values is used to reflect the overall freshness of all the existing ingredients in the recipe; finally, the recipes are sorted based on the corresponding addition results of each recipe to determine the recommended priority of each recipe.
  • the recipe information returned by the server includes recipe A-recipe E, and the existing ingredients included in recipe A-recipe E respectively are shown in the following table:
  • ingredient names of ingredients 1-5 included in recipe A-recipe E look up the freshness labels of ingredients 1-5 from the local information collection, and determine the freshness levels of ingredients 1-5 as shown in the following table:
  • the lower the freshness level, the higher the corresponding weight value, and the summation result corresponding to the recipe can reflect the overall freshness of the existing ingredients in the recipe, so the overall freshness based on the existing ingredients in the recipe is lower.
  • the corresponding recommendation priority is higher, and the recipes AE are arranged according to the descending order of the summation results corresponding to the recipes AE, and the recommended priority order of the recipes AE can be determined as follows:
  • the priority of the recommended recipes is determined according to the freshness of the existing ingredients, and the recipes AE are displayed in the order of the recommended priorities shown in the table above, which can remind users to eat ingredients with low freshness in time , and give priority to displaying corresponding recipes for users to avoid spoilage and waste of ingredients and improve user experience.
  • FIG. 8 is an ingredient management interface shown in some exemplary embodiments of the present application. Different from the ingredient management interface shown in FIG. 6 , in the ingredient management interface, the display order of recipes A-E in the pop-up window 810 is recipe C, recipe E, recipe B, recipe A, recipe D.
  • the ingredient management application displays a recipe detail interface in response to a user's selection operation (eg, a click operation) on the displayed recipe control. Among them, the detailed content of the corresponding recipe is displayed in the recipe details interface.
  • FIG. 9 is a recipe details interface shown in some exemplary embodiments of the present application. As shown in FIG. 9 , the interface displays a cover image 901 of a recipe, a recipe name 902 , an ingredient list area 903 and a recipe introduction area 904 , among them, the ingredients and amounts involved in the recipe are listed in the ingredient list area, and the method steps are displayed in the method introduction area.
  • the ingredient management application in response to the user's selection operation on the displayed recipe control, jumps to the recipe video playback page according to the recipe video playback address in the recipe information, and further, the user can click the recipe in the recipe. Watch how-to videos on the video playback page.
  • the pop-up window on the ingredient management interface or the independent recipe display interface further includes an expired ingredient reminder area corresponding to each storage room, and the expired ingredient reminder area displays the expired ingredients in the corresponding storage room. ingredients icon.
  • FIG. 10 is an ingredient management interface shown in some exemplary embodiments of the present application.
  • the pop-up window further includes a plurality of expired ingredient reminder areas , which are respectively an expired food reminder area 101 corresponding to the refrigerating room, an expired food reminder area 102 corresponding to the changing room, and an expired food reminder area 103 corresponding to the cooling room.
  • Each expired ingredient reminder area displays the expired existing ingredients in the corresponding storage room.
  • the expired ingredient reminder area 101 displays the expired existing ingredients 11-13 in the refrigerator compartment
  • the expired ingredient reminder area 102 displays Expired existing ingredients 14-15 in the freezing chamber
  • expired ingredients 16-17 in the changing chamber are displayed in the expired ingredient reminder area 103.
  • the recipe includes a main ingredient and an auxiliary ingredient
  • the main ingredient is generally an ingredient in a larger amount
  • the auxiliary ingredient generally refers to an ingredient or a condiment in a smaller amount.
  • the embodiment of the present application further provides a method for pushing information, specifically a method for pushing recipe information for a user on the display screen of the refrigerator, as shown in FIG. 12 , the method may include:
  • S101 Receive at least one recipe issued by the server according to the existing ingredients in the storage room, where each recipe includes at least one of the existing ingredients.
  • the method before the receiving the at least one recipe delivered by the server according to the existing ingredients in the storage room, the method further includes: reading the existing ingredients in the storage room from the local ingredient information set, the existing ingredients In the local ingredient information, the storage state is an ingredient in the state of being put in; send a recipe recommendation request to the server, the recipe recommendation request at least includes the ingredient name of the existing ingredient, and the recipe recommendation request is used to make the server according to the The ingredient name of the existing ingredient matches a recipe that includes at least one of the existing ingredient.
  • S102 Determine the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient.
  • S103 Determine a recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe.
  • the method of the present application further includes: in response to the user's selection operation on the displayed target recipe control, displaying the detailed content of the corresponding recipe.
  • the method of the present application further includes: displaying on the user interface a plurality of food material display areas corresponding to each storage room, and according to the freshness identification and storage location identification corresponding to the existing food ingredients, each storage room is displayed.
  • the ingredient icons of the existing ingredients in the room are displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
  • the user can select an ingredient icon in the ingredient library interface through a single-click or long-press operation.
  • the ingredient management application directly adds ingredient information corresponding to the ingredient icon selected by the user to the local ingredient information set, and marks it as a storage state.
  • the refrigerator controller periodically executes the following steps shown in FIG. 13 by running an ingredient management application, that is, every preset time interval, executes the following steps shown in FIG. 13 , the preset time interval The interval is the preset reminder period. As shown in Figure 13:
  • S201 Determine a target ingredient, where the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room.
  • the ingredient management application since the ingredient management application periodically executes S201-S203 to remind the user to consume the expired ingredients in the refrigerator in time, the expired ingredients whose expiration time is longer than the reminder period should be reminded ingredients, and the expiration time is less than or equal to the expiration of the reminder period The ingredients should be the ingredients that have not been reminded.
  • S201 first determine the expired ingredients in the existing ingredients and the expiration time of each expired ingredient according to the time-related information or the freshness identifier of the existing ingredients in the storage room; Or the expired ingredient equal to the reminder period is determined as the first expired ingredient.
  • expiration time current time - expiration time.
  • the unread historical reminder messages before the preset time cut-off point in the notification application are obtained, and the preset time cut-off point refers to a time point earlier than the preset time interval of the current time point; according to The name of the ingredient contained in the historical reminder message determines the target ingredient indicated by the historical reminder message.
  • all expired ingredients in the storage compartment are identified as target ingredients.
  • S202 Generate a reminder message according to the target ingredient, where the reminder message includes an ingredient name of the target ingredient.
  • the reminder message is generated for the first expired ingredient, it can be ensured that only one reminder is performed for each expired ingredient, and the repeated reminder strategy can be prevented from causing trouble to the user.
  • the reminder state identifier corresponding to the first expired ingredient is modified from the first identifier to the second identifier.
  • FIG. 14 is an application scenario exemplarily shown in this application.
  • the scenario includes LAN I and refrigerators and terminal devices A-E in LAN I, where terminal device A, terminal device B, and terminal device C are active devices in LAN I.
  • the ingredient management application on the refrigerator can send device discovery messages through the communicator, such as UDP (User Datagram Protocol, User Datagram Protocol) broadcast messages and/or multicast messages.
  • the active devices A-C can receive the device discovery message sent by the refrigerator, and send a response message, such as a UDP unicast message, to the ingredient management application on the refrigerator according to the IP address of the refrigerator in the device discovery message.
  • the ingredient management application sequentially receives the response messages sent by the active devices A-C within the preset waiting time period (5S), it can be determined that the active devices A-C exist in the local area network.
  • 5S preset waiting time period
  • the device discovery message includes a UDP broadcast message carrying a device discovery identifier
  • the UDP broadcast message includes the local IP address, that is, the IP address of the refrigerator terminal.
  • the active device in the local area network After receiving the UDP broadcast message sent by the refrigerator, the active device in the local area network confirms that the message is a device discovery message according to the device discovery identifier in the UDP broadcast message, and parses the refrigerator from the UDP broadcast message in response to confirming that the message is a device discovery message.
  • the IP address of the UDP broadcast message is sent to the refrigerator according to the parsed IP address, and the response message includes the IP address of the active device.
  • the device discovery message includes a multicast message sent to the terminal device in the target network, and the multicast message carries the device discovery identifier and the local IP address.
  • the target network refers to the network where the refrigerator terminal is located.
  • the active device in the target network After receiving the multicast message sent by the refrigerator, the active device in the target network confirms that the message is a device discovery message according to the device discovery identifier in the multicast message, and parses the message from the multicast message in response to confirming that the message is a device discovery message
  • the IP address of the refrigerator is obtained, and a response message to the multicast message is sent to the refrigerator according to the resolved IP address, and the response message includes the IP address of the active device.
  • the device discovery message includes both the above-mentioned UDP broadcast message and multicast message, that is, the ingredient management application simultaneously sends the UDP broadcast message to the terminal device in the local area network and the multicast message to the terminal device in the target network.
  • the active device in the local area network or the active device in the target group network After receiving the UDP broadcast message or the multicast message, the active device in the local area network or the active device in the target group network sends a response message to the ingredient management application according to the IP address of the refrigerator in the UDP broadcast message or the multicast message.
  • the terminal devices in the target network are all or part of the terminal devices in the local area network.
  • the reminder message When there are active devices in the local area network, push a reminder message to at least one active device. When there is no active device in the local area network, the reminder message is displayed on the display through a notification application.
  • the IP addresses of the respective active devices are parsed from the response messages sent by the respective active devices, and then according to the IP addresses of the respective active devices, the reminder messages generated in S202 are sent to the respective active devices in a UDP unicast manner.
  • Each active device so that each active device displays the reminder message on its screen after receiving the reminder message sent by the refrigerator.
  • the terminal devices in the local area network include display devices such as smart TVs or smart large screens.
  • the terminal device After receiving the reminder message sent by the refrigerator end, the terminal device displays the received reminder message in the user interface according to the preset display logic and method. It should be noted that the present application does not limit the logic and manner in which the terminal device displays the reminder message.
  • the display device may display the reminder message in the current user interface in the form of a modeless dialog box, so as to remind the user to consume the expired ingredients in time without affecting the user's viewing or operation of the current User Interface.
  • FIG. 15 is a user interface of a display device exemplarily shown in the application. As shown in FIG. 15 , the user interface includes a video playback screen 701 and a pop-up window prompt 702 displayed at the upper right corner of the upper layer of the video playback screen 70.
  • the pop-up window prompt 702 displays the text content of the reminder message, specifically "watermelon and yogurt have expired, please eat them in time".
  • each terminal device in the local area network or target network corresponds to a priority
  • different terminal devices correspond to different priorities.
  • the ingredient management application determines the preset priority of each active device according to the device information of each active device, such as the IP address, and determines the active device with the highest priority as the target device. Then, according to the IP address of the target device, the reminder message generated in S202 is sent to the target device, so as to display the reminder message in the user interface of the target device, thereby realizing the purpose of reminding the user to consume expired ingredients in time.
  • the priorities of terminal devices A-E in LAN I are terminal device A, terminal device B, terminal device C, terminal device D, and terminal device E in descending order.
  • the food management application determines that the active device A is the target device according to the priority corresponding to the active device AC, and then sends a reminder message to the active device A according to the IP address of the active device A. .
  • the notification application is further configured to receive a preset operation on the displayed reminder message input by the user, such as a viewing operation, a clearing operation, and the like.
  • a preset operation on the displayed reminder message input by the user, such as a viewing operation, a clearing operation, and the like.
  • the notification application receives the aforementioned preset operation, it will mark the reminder message as read or clear. After clearing the reminder message, delete the reminder message operated by the user. Otherwise (ie, in the case where the aforementioned preset operation is not received), the state of the reminder message is kept as the unread state or the reminder message is retained.
  • Fig. 16 is a schematic diagram of a refrigerator display user interface exemplarily shown in this application.
  • a notification message box 802 and a "clear" button are displayed on the upper layer of the ingredient management interface 801, and a reminder is displayed in the notification message box 802
  • the text content of the message is specifically "watermelon and yogurt have expired, please eat in time”.
  • the user can click the "Clear” button to cancel the display of the notification message box, and instruct the notification application to clear the reminder message.
  • the user can also click on the notification message box to view the message details.
  • the target ingredient can be determined according to the newly generated expired ingredient in the storage room and the ingredient indicated by the unread historical reminder message. Reminding the expired ingredients indicated by the unread historical reminder message and/or the newly generated expired ingredients in the refrigerator can avoid repeating multiple reminders for the same expired ingredient and affecting the user experience. Then, a reminder message is generated according to the target ingredients, and active devices in the local area network are actively discovered at the same time. When an active device is found in the local area network, a reminder message is pushed to at least one active device, and other active devices are used to remind users to consume expired ingredients in time, not limited to reminding on the refrigerator side, and no need to rely on cloud platforms and external networks, flexibility Powerful and resource-saving. When there is no active device in the local area network, push the reminder message to the notification application.
  • the embodiment of the present application further provides a message reminding method, the execution subject of the method includes but is not limited to the controller of the above refrigerator.
  • the recommended recipe can be completed by the interaction between the refrigerator and the server, and one or more other terminal devices (including but not limited to: smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens) can also be into the interaction. No matter how several terminal devices interact with the server, they are finally displayed on their corresponding displays, so as to be more intuitively provided to the user, and to improve the correlation between the ingredients in the refrigerator and the user.
  • terminal devices including but not limited to: smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens
  • FIG. 17A shows a UI schematic diagram of a TV application according to an embodiment of the present application.
  • the TV display screen is configured to display other interactive controls while displaying the application UI interface
  • the interactive controls may include, for example, TV homepage controls, search controls, message button controls, mailbox controls, browsing Controls, Favorites Controls, Signal Bar Controls, etc.
  • FIG. 17B shows a UI schematic diagram of a display device recommending recipe data according to an embodiment of the present application.
  • the display device provided by the present application includes a display screen, and the display screen is used to display a user interface, and the user interface can provide interactive functions for the user. different functions.
  • the display screen of the display device may be implemented as the third display 280 of the drawings.
  • the refrigerator can obtain the information of the stored food in real time through the following methods.
  • the controller of the refrigerator acquires an image of the storage room, and processes the image of the storage room to obtain the grid position; then, the refrigerator acquires the user's hand trajectory, and selects the corresponding fitting trajectory based on the movement trend of the hand trajectory , the fitting trajectory is the hand trajectory at the time of item access; according to the fitting trajectory and grid position, the item access position is calculated and obtained, so that the storage or retrieval of ingredients in the refrigerator can be monitored in real time, and the user's refrigerator storage can be obtained.
  • Detailed information of the ingredients such as the location of the ingredients in the refrigerator, the storage time, the remaining days of the shelf life, etc.; finally, the refrigerator uploads the ingredients stored in the user's refrigerator to the server provided in this application.
  • the recommended recipe data includes attribute information of the recipe, wherein the attribute information of the recipe includes main ingredients required by the recipe, dish taste, cooking method, suitable crowd, suitable scene, cuisine, dish, efficacy, and Properties elements such as required kitchen tools.
  • the recipes and the attribute information of the recipes are associated and stored in the media resource library of the server provided by this application, so that they can be accessed and used.
  • the user's smart refrigerator reports the information of the ingredients stored in the user's refrigerator to the server in the cloud, and the second controller of the server or the recommended recipe business system will regularly query every day to determine the main ingredient information of the current refrigerator, and according to the The main ingredient information is queried to determine the recommended recipe data, and the recommended recipe data is saved.
  • the recommended recipe application of the display device requests the recommended recipe data
  • the saved recommended recipe data is sent to the display device to improve the response speed.
  • the third controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes, the third controller includes the first recommended recipe data and the second recommended recipe data when the received recommended recipe data includes the first recommended recipe data and the second recommended recipe.
  • a mapping relationship is constructed according to the preset matching characteristics of different users bound by the display device and the recipes in the recommended recipe data, a user list is generated based on the mapping relationship, and a focus position in the user list is generated according to the The user at the location controls the second recommendation window to display the recommended recipe data mapped by the user, wherein the user list and the second recommendation window are simultaneously displayed in the user interface.
  • the user list in the figure includes 3 users: father, mother, Dabao Dabaoda, among which,
  • the preset matching features of the user's father are: taste: spicy, fresh; others: reduce blood lipids;
  • the present application also provides a method for recommending recipes on the server side.
  • the refrigerator in the figure is a 4-door refrigerator, and its camera is arranged inside the refrigerator and is configured to capture the internal images of the refrigerator, for example, to obtain the images of the refrigerator compartment and the freezer compartment inside the refrigerator, and send them to the controller for identifying the ingredients As well as generating recommended recipe data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

La présente demande divulgue un réfrigérateur, un dispositif d'affichage, un serveur, un procédé de recommandation et un procédé de rappel de message. Le réfrigérateur comprend : un corps de réfrigérateur dans lequel est disposée une chambre de stockage, au moins un produit alimentaire étant stocké dans la chambre de stockage ; une porte de réfrigérateur disposée au niveau d'une ouverture de la chambre de stockage ; un écran d'affichage disposé sur la porte de réfrigérateur et utilisé pour afficher une interface utilisateur ; et un dispositif de commande connecté à l'écran d'affichage et conçu pour : recevoir au moins une recette émise par un serveur en fonction des produits alimentaires existants dans la chambre de stockage, chaque recette comprenant au moins un produit parmi les produits alimentaires existants ; déterminer, en fonction de l'heure actuelle et des informations temporelles préenregistrées des produits alimentaires existants, la fraîcheur des produits alimentaires existants dans la recette ; déterminer la priorité de recommandation de la recette en fonction de la fraîcheur des produits alimentaires existants dans la recette ; et afficher, en prenant l'ordre décroissant des priorités de recommandation de toutes les recettes comme l'ordre d'affichage des recettes, une partie ou la totalité des recettes sur l'interface utilisateur.
PCT/CN2021/102312 2020-08-24 2021-06-25 Réfrigérateur, dispositif d'affichage, serveur, procédé de recommandation et procédé de rappel de message Ceased WO2022041992A1 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202010855107.X 2020-08-24
CN202010855107.XA CN111984838A (zh) 2020-08-24 2020-08-24 一种显示设备、服务器、冰箱及推荐食谱的方法
CN202110606093.2 2021-05-25
CN202110606093.2A CN113251727A (zh) 2021-05-25 2021-05-25 冰箱及信息推荐方法
CN202110617466.6 2021-05-28
CN202110617466.6A CN114294884B (zh) 2021-05-28 2021-05-28 冰箱及消息提醒方法

Publications (1)

Publication Number Publication Date
WO2022041992A1 true WO2022041992A1 (fr) 2022-03-03

Family

ID=80354192

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/102312 Ceased WO2022041992A1 (fr) 2020-08-24 2021-06-25 Réfrigérateur, dispositif d'affichage, serveur, procédé de recommandation et procédé de rappel de message

Country Status (1)

Country Link
WO (1) WO2022041992A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114820122A (zh) * 2022-04-22 2022-07-29 海信视像科技股份有限公司 一种食材存储设备、终端设备以及采购清单生成方法
CN116045602A (zh) * 2022-12-29 2023-05-02 珠海格力电器股份有限公司 一种冰箱内物品移动方法、装置、设备及存储介质
WO2023202221A1 (fr) * 2022-04-22 2023-10-26 海信视像科技股份有限公司 Dispositif électronique et procédé de traitement de données
CN117131215A (zh) * 2022-05-20 2023-11-28 青岛海尔电冰箱有限公司 食材管理方法、存储介质、系统及冰箱

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140102127A1 (en) * 2009-05-11 2014-04-17 Kwanho YUM Mobile terminal, operating method thereof, and refrigerator
CN106327098A (zh) * 2016-08-31 2017-01-11 九阳股份有限公司 一种冰箱及其菜谱确定方法
CN111552874A (zh) * 2020-04-24 2020-08-18 海信集团有限公司 一种冰箱及食谱推荐方法
CN111984838A (zh) * 2020-08-24 2020-11-24 聚好看科技股份有限公司 一种显示设备、服务器、冰箱及推荐食谱的方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140102127A1 (en) * 2009-05-11 2014-04-17 Kwanho YUM Mobile terminal, operating method thereof, and refrigerator
CN106327098A (zh) * 2016-08-31 2017-01-11 九阳股份有限公司 一种冰箱及其菜谱确定方法
CN111552874A (zh) * 2020-04-24 2020-08-18 海信集团有限公司 一种冰箱及食谱推荐方法
CN111984838A (zh) * 2020-08-24 2020-11-24 聚好看科技股份有限公司 一种显示设备、服务器、冰箱及推荐食谱的方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114820122A (zh) * 2022-04-22 2022-07-29 海信视像科技股份有限公司 一种食材存储设备、终端设备以及采购清单生成方法
WO2023202221A1 (fr) * 2022-04-22 2023-10-26 海信视像科技股份有限公司 Dispositif électronique et procédé de traitement de données
CN117131215A (zh) * 2022-05-20 2023-11-28 青岛海尔电冰箱有限公司 食材管理方法、存储介质、系统及冰箱
CN116045602A (zh) * 2022-12-29 2023-05-02 珠海格力电器股份有限公司 一种冰箱内物品移动方法、装置、设备及存储介质

Similar Documents

Publication Publication Date Title
WO2022041992A1 (fr) Réfrigérateur, dispositif d'affichage, serveur, procédé de recommandation et procédé de rappel de message
CN111811182B (zh) 一种冰箱及食谱推荐方法
JP2005276171A (ja) 調理アシストシステム、情報端末、及びサーバ
US20170293964A1 (en) Consumable Goods Inventory Management System
WO2021204115A1 (fr) Procédé de production de données, procédé de traitement de données, procédé d'exécution de données et dispositif
WO2022068536A1 (fr) Procédé de recommandation d'informations, dispositif de stockage d'ingrédients, et serveur
WO2022001768A1 (fr) Réfrigérateur
CN111984838A (zh) 一种显示设备、服务器、冰箱及推荐食谱的方法
CN115587245A (zh) 菜谱清单的推荐方法、装置、存储介质及电子装置
CN116235011B (zh) 显示设备及界面显示方法
CN108172273A (zh) 一种基于访客的冰箱食材推荐方法
KR20160116449A (ko) 요리 레시피 제공 애플리케이션 시스템
CN114048375A (zh) 菜谱推荐方法、装置、设备及存储介质
CN112417282B (zh) 信息推荐方法、食材储藏设备及服务器
CN111552874B (zh) 一种冰箱及食谱推荐方法
CN112199406A (zh) 信息推荐方法、食材存储设备及服务器
US20240296008A1 (en) Multi-terminal food information processing method, display apparatus and food storage apparatus
CN118742894A (zh) 食材存储设备及食材库和菜谱的排序方法
CN114115626A (zh) 一种查询食材存储设备食材的方法及显示设备
CN106951541A (zh) 烹饪信息推荐、获取方法及装置
JP7633971B2 (ja) 食材管理システム
CN116089719A (zh) 菜谱推荐方法、装置、设备和介质
CN114143578A (zh) 一种食材提醒方法及显示设备、服务器
CN115082149A (zh) 一种电子设备、服务器及烹饪设备推荐方法
CN106815463A (zh) 储物家电及其食材管理方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21859834

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21859834

Country of ref document: EP

Kind code of ref document: A1