CN113063261B - Refrigerator control method, refrigerator and computer-readable storage medium - Google Patents
Refrigerator control method, refrigerator and computer-readable storage mediumDownload PDFInfo
- Publication number
- CN113063261B CN113063261BCN202010007958.9ACN202010007958ACN113063261BCN 113063261 BCN113063261 BCN 113063261BCN 202010007958 ACN202010007958 ACN 202010007958ACN 113063261 BCN113063261 BCN 113063261B
- Authority
- CN
- China
- Prior art keywords
- refrigerator
- determining
- working mode
- image data
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/003—Arrangement or mounting of control or safety devices for movable devices
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
Description
Technical Field
The application relates to the technical field of intelligent refrigerators, in particular to a refrigerator control method, a refrigerator and a computer readable storage medium.
Background
With the popularization of intelligent refrigerators and the emergence of large-screen refrigerators, refrigerators have been endowed with more abundant functions than just cabinets that can be used for refrigerating food. For example, the existing refrigerator includes a series of functions such as interconnection with a mobile phone, and can solve a lot of troubles for users. But as far as the refrigerator itself is concerned, its main function is still to store and manage food materials.
It should be noted that although the existing intelligent refrigerator has many functions, the switching of the operation modes of the refrigerator is still not intelligent enough, and the user needs to set and adjust the refrigerator by himself. For example, when the refrigerator is empty and not used for a long time, if the user does not adjust the working mode of the refrigerator, the refrigerator will operate according to the current working mode, resulting in waste of power; when the refrigerator is empty but the user uses it frequently, the refrigerator does not intelligently remind the user that the refrigerator is empty, and the user easily forgets to supplement food to the refrigerator. Therefore, how to intelligently adjust the working mode of the refrigerator and better store and manage food materials becomes a problem which needs to be solved urgently.
Disclosure of Invention
The application mainly aims to provide a refrigerator control method, a refrigerator and a computer readable storage medium, and aims to intelligently control the refrigerator to switch working modes and improve user experience.
In a first aspect, the present application provides a refrigerator control method, the refrigerator including a compartment and a camera installed in the compartment, the refrigerator control method including:
acquiring image data of the compartment through the camera, and determining the vacancy rate of the refrigerator according to the image data;
if the vacancy rate is larger than a preset vacancy rate threshold value, acquiring the historical use frequency of the refrigerator within a preset time period;
determining a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode according to the historical use frequency;
and operating according to the target working mode and the target operating parameters.
In a second aspect, the present application also provides a refrigerator, which includes a camera, a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the refrigerator control method as described above.
In a third aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the refrigerator control method as described above.
The application provides a refrigerator control method, a refrigerator and a computer readable storage medium, wherein image data of a compartment of the refrigerator are acquired through a camera installed in the compartment, the vacancy rate of the refrigerator is determined according to the image data so that the using condition of the refrigerator can be known, if the vacancy rate is larger than a preset vacancy rate threshold value, the historical using frequency of the refrigerator in a preset time period is acquired, then a target working mode of the refrigerator and a target operating parameter corresponding to the target working mode are determined according to the historical using frequency, finally the refrigerator is controlled to operate according to the target working mode and the target operating parameter, a proper working mode when the refrigerator is vacant is determined, the refrigerator can be intelligently controlled to switch the working mode, and user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a refrigerator control method according to an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating sub-steps of the refrigerator control method of FIG. 1;
fig. 3 is a schematic view of a scenario for implementing the refrigerator control method provided in this embodiment;
FIG. 4 is a schematic view of a display screen of a refrigerator according to an embodiment of the present disclosure;
fig. 5 is a schematic block diagram of a structure of a refrigerator according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flowcharts shown in the figures are illustrative only and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The embodiment of the application provides a refrigerator control method, a refrigerator and a computer-readable storage medium. The refrigerator control method can be applied to a refrigerator which can be a compression type refrigerator, an absorption type refrigerator, an electromagnetic vibration type refrigerator and the like, wherein the refrigerator comprises a chamber and a camera arranged in the chamber, and the camera is used for collecting image data in the chamber.
Certainly, the refrigerator control method can also be applied to terminal equipment or a server, and the terminal equipment can be electronic equipment such as a mobile phone, a tablet computer, a notebook computer, a desktop computer and an intelligent television; the server may be a single server or a server cluster including a plurality of servers.
The following explanation will be given by taking an example in which the refrigerator control method is applied to a refrigerator.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a flowchart illustrating a refrigerator control method according to an embodiment of the present disclosure.
As shown in fig. 1, the refrigerator control method includes steps S101 to S104.
And S101, acquiring image data of the compartment through the camera, and determining the vacancy rate of the refrigerator according to the image data.
The refrigerator in the embodiment comprises a compartment and a camera installed in the compartment, wherein the compartment can be a refrigerating compartment, a heat preservation compartment, a freezing compartment and the like. The camera can be monocular camera, two mesh cameras, 2D cameras and degree of depth cameras etc., the camera can be a plurality of, and arrange the different walls of room.
When the control method of the embodiment is operated by the processor of the refrigerator, the image data of the chamber can be acquired at regular time, and the regular time can be interval time or time point and can be flexibly set by a user, which is not specifically limited in the present application; the method and the device for acquiring the image data in the room can also be used for starting the camera to acquire the image data in the room shot by the camera when receiving an image data acquisition request, for example, a user can generate the image data acquisition request by triggering a button on a refrigerator, or a mobile terminal such as a mobile phone and an IPAD (internet protocol ad) is provided with a corresponding APP application program, the user can generate the image data acquisition request by triggering a corresponding option in an APP operation interface, then the mobile terminal sends the image data acquisition request to the refrigerator, and the refrigerator acquires the image data in the room based on the received image data acquisition request.
It should be noted that the image data acquisition request may be included in an operation mode determination instruction for determining a target operation mode of the refrigerator according to a vacancy rate and a historical usage frequency of the refrigerator. Specifically, a user sends a working mode determining instruction through a button, a control, a menu bar or a control page to determine a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode, the working mode determining instruction carries an image data obtaining request, and the refrigerator controls the camera to collect image data in the chamber based on the image data obtaining request. By triggering the working mode determining instruction, the working mode suitable for the refrigerator is intelligently determined according to the actual condition of the refrigerator, and the food materials in the refrigerator can be better stored and managed.
In an embodiment, when it is detected that the door of the refrigerator is closed, timing is started, and when the timed time reaches a preset time threshold, the camera is started, and image data of the compartment is acquired through the camera. It should be noted that a door control switch is disposed at the door of the refrigerator, and the door control switch is turned on or off according to the switch of the door to detect the opening and closing state of the door, wherein the door control switch may be a micro switch or a proximity switch.
And starting timing when the door of the refrigerator is detected to be closed through the timer in the refrigerator, and starting the camera until the timed time reaches a preset time threshold value. It should be noted that the preset time threshold may be set according to actual situations, and one or more preset time thresholds may be set, which is not specifically limited in this application. Illustratively, the preset time threshold is set to be 24 seconds and 24 hours, and when the time counted by the timer reaches 24 seconds and 24 hours, the processor generates an image data acquisition request, starts a camera based on the image data acquisition request, acquires the image data of the compartment and determines the vacancy rate of the refrigerator.
In one embodiment, determining the vacancy rate of the refrigerator according to the image data comprises the following steps: identifying an area in which an article in the refrigerator is located based on the image data; determining the volume of the compartment occupied by the article according to the area; and acquiring the total volume of the chamber, and determining the vacancy rate of the refrigerator according to the total volume and the volume of the chamber occupied by the articles. It should be noted that the memory of the refrigerator is pre-stored with a completely empty background image of the compartment, and the area where the articles in the refrigerator are located is determined according to the comparison result by comparing the image data with the background image. The total volume of the compartment may be directly obtained from a storage of the refrigerator, in some embodiments, infrared light may also be emitted by an infrared light detection assembly, and then the total volume of the compartment and the volume of the compartment occupied by the articles are determined according to the intensity of the received infrared light, where the infrared light detection assembly is composed of an infrared light source and a light sensing device, and the application is not particularly limited.
Further, calculating the ratio of the volume of the articles in the compartment to the total volume to obtain the occupancy rate of the refrigerator; and calculating the vacancy rate of the refrigerator according to the occupancy rate. For example, when the volume of the compartment occupied by the article is 10 cubic decimeters and the total volume is 25 cubic decimeters, the occupancy rate is 40%. The vacancy rate of the refrigerator is equal to the difference between 1 and the occupancy rate of the refrigerator, for example, when the occupancy rate is 40%, the vacancy rate of the refrigerator is 60%.
In one embodiment, the specific method of determining the volume of the compartment occupied by the item is: determining the area of the region and distance information between the region and a camera; and determining the volume of the compartment occupied by the article according to the area and distance information. It should be noted that, according to the number of the pixel points of the region in the image data, the area of the region may be determined, and the larger the number of the pixel points of the region is, the larger the area of the region is. The distance information between the area and the camera can be determined according to the position marks of the area in the image data, the position marks are preset in the compartment, for example, metal sheets installed on a shelf of the compartment, the distance between each position mark and the camera is measured and stored in advance, and the distance information can be more accurately determined according to the position marks of the area.
Acquiring a corresponding table between a prestored volume and area and distance information, wherein the area and distance information has a corresponding relation with the volume; and inquiring the corresponding table according to the area and distance information, and determining the volume of the compartment occupied by the articles. It should be noted that the correspondence table is obtained through a plurality of experiments. It will be appreciated that the volume is proportional to the area and also to the distance in the distance information, the greater the area and distance, the greater the volume of the compartment occupied by the article; conversely, the smaller the area and distance, the smaller the volume of the compartment occupied by the article.
And S102, if the vacancy rate is larger than a preset vacancy rate threshold, acquiring the historical use frequency of the refrigerator in a preset time period.
After the vacancy rate of the refrigerator is obtained, whether the vacancy rate is larger than a preset vacancy rate threshold value needs to be judged; if the vacancy rate is larger than a preset vacancy rate threshold value, acquiring the historical use frequency of the refrigerator within a preset time period; and if the vacancy rate is less than or equal to a preset vacancy rate threshold value, subsequent operations are not required to be executed. It should be noted that the vacancy rate threshold may be flexibly set by a user, and optionally, the vacancy rate threshold is 70%, that is, when the vacancy rate of the refrigerator is higher than 70%, a subsequent step needs to be performed to determine whether to switch the operation mode of the refrigerator. The preset time period may be set according to actual conditions, and this is not specifically limited in the present application.
In one embodiment, the obtaining of the historical usage frequency of the refrigerator within a preset time period includes: determining the door opening and closing times of the refrigerator in a preset time period, and obtaining the historical use frequency of the refrigerator according to the door opening and closing times. The opening and closing times of the refrigerator door are the opening or closing times of the refrigerator door, it needs to be explained that a preset time period can be set according to actual conditions, the application is not specifically limited to this, and the historical use frequency is equal to the ratio of the opening and closing times of the refrigerator door to the preset time period. Illustratively, if the number of door opening and closing times of the refrigerator within 1 day (24 hours) is queried to be 5, the historical use frequency of the refrigerator is 5 times/day.
In one embodiment, the obtaining of the historical use frequency of the refrigerator within a preset time period includes: determining the article taking and placing times of the refrigerator in a preset time period, and obtaining the historical use frequency of the refrigerator according to the article taking and placing times. The article taking and placing times are the times for taking and placing articles in the refrigerator. It should be noted that the preset time period may be set according to an actual situation, which is not specifically limited in the present application, and the historical use frequency is equal to a ratio of the number of times of taking and placing the article to the preset time period. For example, if the number of article taking and placing times of the refrigerator within 1 day (24 hours) is queried to be 10, the historical use frequency of the refrigerator is 10 times/day.
Specifically, the number of times items in the refrigerator are taken and placed may be determined by a Radio Frequency Identification (RFID) technology. The article in the refrigerator is pasted with the identification tags, when each tag leaves the refrigerator or enters the refrigerator, the number of the tags can be counted, and the article taking and placing times can be obtained by inquiring the number of the counts in the preset time period. Or, also can settle a plurality of weight inductors in the refrigerator, at every turn when the refrigerator is taken and is placed article, the weight information that the weight inductor gathered all can change, when every turn when the absolute value of the weight value of change is greater than preset weight value, the weight value and the moment of this change of record, can obtain article through the historical record in the inquiry preset time quantum and get and put the number of times.
And S103, determining a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode according to the historical use frequency.
Through the historical use frequency, whether the user has used the refrigerator frequently recently can be known. According to the using condition of a user on the refrigerator, the target working mode of the refrigerator and the target operation parameters corresponding to the target working mode are determined, and the working mode and the operation parameters of the refrigerator can be better controlled. For example, when the refrigerator is empty and not used for a long time, the refrigerator can be intelligently controlled to enter an energy-saving mode, so that the waste of power resources is avoided; when the refrigerator is empty but the user uses the refrigerator frequently, the refrigerator can be intelligently controlled to remind the user that the refrigerator is empty and food needs to be supplemented to the refrigerator in time.
In an embodiment, when the historical use frequency is smaller than a preset first use frequency threshold, determining that a target operation mode of the refrigerator is a first operation mode and an operation parameter corresponding to the first operation mode, wherein the current operation power of the refrigerator is reduced by the first operation mode; and when the historical use frequency is greater than a preset second use frequency threshold value, determining that the target working mode of the refrigerator is a second working mode and the operating parameters corresponding to the second working mode, wherein the second working mode sends a prompt for supplementing articles to a user. Wherein the second usage frequency threshold is greater than or equal to the first usage frequency threshold.
It should be noted that, the second usage frequency threshold and the first usage frequency threshold may be set according to actual situations, and the first operation mode may be a holiday mode, where the holiday mode is a mode that the temperature of the refrigerator is controllably increased if the refrigerator is not used for a long time, and the holiday mode has corresponding operation parameters. The second working mode can be a reminding mode, and the reminding mode is that the refrigerator is frequently used and reminding information is sent to a user so as to remind the user of the vacancy condition of the refrigerator, and the reminding mode has corresponding operating parameters. The intelligence of the refrigerator is improved by controllably switching the first operating mode and the second operating mode.
In an embodiment, if the second usage frequency threshold is greater than the first usage frequency threshold, when the historical usage frequency is between the first usage frequency threshold and the second usage frequency threshold, it is determined that the target operation mode of the refrigerator is the current operation mode. It should be noted that the current operation mode may be a normal mode, and the normal mode is a normal operation mode of the refrigerator.
And step S104, operating according to the target working mode and the target operating parameters.
And the refrigerator operates according to the determined target working mode and the target operation parameters. The target working mode can be one of a holiday mode, a reminding mode and a common mode, and the holiday mode, the reminding mode and the common mode have respective corresponding operating parameters. When the working mode of the refrigerator is switched to the target working mode, the refrigerator operates according to respective corresponding operating parameters, the operating parameters comprise the time length of the refrigerator operating according to the operating parameters, and the time length can be flexibly set by a user. By entering the target working mode and operating according to the target operation parameters, the intelligent adjustment of the working mode of the refrigerator is realized, and the user experience is improved.
In one embodiment, when the operation mode of the refrigerator is switched to the target operation mode, the display panel or the mode indicator of the refrigerator is adjusted accordingly. The display panel can be a liquid crystal display screen, an LED display screen and the like, and in some embodiments, the working mode of the refrigerator can be controlled and switched through the display panel. The mode indicator is used for indicating the current operation mode of the refrigerator, and it can be understood that the mode indicator may also be a controller for switching the operation mode of the refrigerator.
Referring to fig. 2, fig. 2 is a schematic view of a scenario for implementing the refrigerator control method provided in this embodiment.
As shown in fig. 2, a user triggers and generates an operation mode confirmation instruction through a control page on the mobile terminal, and the mobile terminal sends the operation mode confirmation instruction to the refrigerator, so as to determine a target operation mode of the refrigerator according to an actual situation of the refrigerator. After the refrigerator receives the working mode confirmation instruction, the camera A is started based on the image data acquisition request in the working mode confirmation instruction, and image data of the refrigerator compartment are acquired through the camera A, so that subsequent operations are executed according to the image data.
According to the refrigerator control method provided by the embodiment, the image data of the chamber is acquired through the camera installed in the chamber of the refrigerator, the vacancy rate of the refrigerator is determined according to the image data so as to know the use condition of the refrigerator, if the vacancy rate is larger than the preset vacancy rate threshold, the historical use frequency of the refrigerator in the preset time period is acquired, the target working mode of the refrigerator and the target operation parameter corresponding to the target working mode are determined according to the historical use frequency, then the refrigerator is controlled to operate according to the target working mode and the target operation parameter, the refrigerator can be intelligently controlled to switch the working mode, and the user experience is improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of another refrigerator control method according to an embodiment of the present application.
As shown in fig. 3, the refrigerator control method includes steps S201 to S205.
Step S201, acquiring image data of the compartment through the camera, and determining the vacancy rate of the refrigerator according to the image data.
The camera in this embodiment is installed in the compartment of refrigerator, can be for monocular camera, binocular camera, 2D camera and degree of depth camera etc. the compartment can be for refrigerating compartment, heat preservation compartment and freezing compartment etc.. It should be noted that when the refrigerator includes more than two compartments, the operation mode of each compartment may be different.
The vacancy rate of the refrigerator can be determined according to the image data, specifically, a region different from a pre-stored background image in the image data is determined, the occupancy rate of the refrigerator is determined according to the region, and the vacancy rate of the refrigerator is calculated according to the occupancy rate. The background image is an image of a compartment shot when the refrigerator is completely empty, and the empty rate of the refrigerator is equal to 1 minus the occupancy rate of the refrigerator.
Step S202, if the vacancy rate is larger than a preset vacancy rate threshold, acquiring the historical use frequency of the refrigerator in a preset time period.
Judging whether the vacancy rate is larger than a preset vacancy rate threshold value or not; if the vacancy rate is larger than a preset vacancy rate threshold value, acquiring the historical use frequency of the refrigerator within a preset time period; and if the vacancy rate is less than or equal to a preset vacancy rate threshold value, the subsequent operation is not required to be executed. It should be noted that the vacancy rate threshold and the preset time period may be set according to actual situations, which is not specifically limited in this application. Illustratively, the vacancy rate threshold is 70% and the preset time period is 24 hours.
Step S203, determining the type of food materials in the refrigerator according to the image data.
And inputting the image data into a preset convolutional neural network to obtain the type of the food materials in the refrigerator. The convolutional neural network comprises an input layer, a plurality of convolutional layers, a pooling layer, a default frame layer and an output layer, wherein the default frame layer is used for selecting the aspect ratio of a default frame according to the plurality of convolutional layers.
Specifically, the training samples are input into the deep learning convolutional neural network, and the deep learning convolutional neural network is trained by using a deep learning frame caffe, so that the trained convolutional neural network can be obtained. The training samples are images of various food materials, including various types of foods such as vegetables, fruits and meat. And detecting the image data through the trained convolutional neural network to obtain the type of the food materials in the refrigerator. It is to be understood that other suitable image recognition methods or technologies may also be used to detect the food material type in the refrigerator, for example, various methods such as a scale invariant feature transformation algorithm, an image feature extraction and matching algorithm based on corner points, an image matching and recognition based on local features, an image feature extraction algorithm based on visual information, etc. may be used, and the present application is not limited in particular.
In one embodiment, the convolutional neural network comprises a preprocessing sublayer, a feature recognition sublayer and an output layer, and image data is preprocessed through the preprocessing sublayer to obtain preprocessed image data; and performing feature recognition on the preprocessed image data based on a feature extraction sublayer to obtain the type of the food material in the refrigerator. The preprocessing sublayer is used for preprocessing a target image, and the preprocessing process comprises smoothing denoising, corrosion, expansion and the like. At the same time, the image data is further processed according to detection methods, such as edge detection, gray scale variation, speckle detection, depth detection, etc. The feature extraction sub-layer is used for performing feature identification on the preprocessed image data to determine the type of the food material in the image data, wherein the identified food material features can be the shape of the food material, the color of the food material, the pattern of the food material and the like. The output layer is used for outputting the identified food material types, and the output food material types can be one or more. The food material type in the refrigerator is identified through the convolutional neural network, and the accuracy of food material type identification can be improved.
Step S204, determining a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode according to the historical use frequency and the food material type.
In one embodiment, when the historical use frequency is smaller than a preset first use frequency threshold, determining that the target operation mode of the refrigerator is a first preset operation mode; determining temperature information from a mapping relation table of preset food material types and temperature information according to the food material types; and generating a target operation parameter of the first preset working mode according to the temperature information. The first preset working mode can be selected as an energy-saving mode, and the energy-saving mode is used for saving energy consumption of the refrigerator. The first usage frequency threshold may be set according to actual conditions, and may be optionally 1 time/day. The mapping relation table of the food material types and the temperature information can also be set according to actual conditions, the method is not particularly limited, and the temperature information suitable for different food material types is different. It can be understood that, when the food material types are multiple, the mapping relationship table is queried to obtain multiple temperature information, and at this time, an average or a mode of the multiple temperature information is taken as target temperature information, and the target operation parameter of the first preset operation mode is generated according to the target temperature information.
In an embodiment, when the historical usage frequency is greater than a preset second usage frequency threshold, determining that the target operation mode of the refrigerator is a second preset operation mode; and determining the target operation parameters of the second preset working mode according to the food material types. The second preset working mode can be selected as a reminding mode, and the reminding mode is used for sending a prompt for supplementing articles to a user. The second use frequency threshold value can be set optionally according to actual conditions and is 2 times/day. When the target working mode of the refrigerator is a reminding mode, reminding information of the reminding mode is determined according to the type of food materials in the refrigerator, wherein the reminding information can comprise the type of the food materials in the refrigerator, the type of the food materials with more occurrence times in historical habit data of the refrigerator, and reminding information for reminding a user of supplementing articles.
Exemplarily, please refer to fig. 4, wherein fig. 4 is a schematic view of a display screen of a refrigerator provided in an embodiment of the present application. As shown in fig. 4, when the refrigerator is in the reminding mode, reminding information is displayed on a display screen of the refrigerator, and the reminding information includes a prompt word of "the refrigerator needs to supplement articles", food material types of "cabbage, grape and potato" which are refrigerated, and "corn and apple" which are suggested for supplement.
And S205, operating according to the target working mode and the target operating parameters.
And the refrigerator operates according to the determined target working mode and the target operation parameters. The target working mode can be an energy-saving mode and a reminding mode, and the reminding mode and the energy-saving mode have respective corresponding operating parameters. When the working mode of the refrigerator is switched to the target working mode, the refrigerator operates according to the respective corresponding operation parameters, the operation parameters comprise the time length of the refrigerator operating according to the operation parameters, and the time length can be flexibly set by a user. By entering the target working mode and operating according to the target operation parameters, the intelligent adjustment of the working mode of the refrigerator is realized, and the user experience is improved.
According to the refrigerator control method provided by the embodiment, the image data of the chamber is acquired through the camera installed in the chamber of the refrigerator, the vacancy rate of the refrigerator is determined according to the image data so as to know the use condition of the refrigerator, if the vacancy rate is larger than the preset vacancy rate threshold value, the historical use frequency of the refrigerator in the preset time period is acquired, the type of food materials in the refrigerator is determined according to the image data, the target working mode of the refrigerator and the target operation parameters corresponding to the target working mode are determined according to the historical use frequency and the type of the food materials, then the refrigerator is controlled to operate according to the target working mode and the target operation parameters, the refrigerator can be intelligently controlled to switch the working modes, and the user experience is improved.
Referring to fig. 5, fig. 5 is a schematic block diagram of a refrigerator according to an embodiment of the present disclosure. The refrigerator can be a compression type refrigerator, an absorption type refrigerator, an electromagnetic vibration type refrigerator and the like.
As shown in fig. 5, the refrigerator includes a camera, a processor, a memory, and a network interface connected through a system bus, wherein the memory may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program includes program instructions that, when executed, cause a processor to perform any one of the refrigerator control methods.
The processor is used for providing calculation and control capability and supporting the operation of the whole refrigerator.
The internal memory provides an environment for running a computer program in the non-volatile storage medium, which, when executed by the processor, causes the processor to perform any one of the refrigerator control methods.
The network interface is used for network communication, such as sending assigned tasks and the like. It will be understood by those skilled in the art that the structure shown in fig. 5 is a block diagram of only a portion of the structure relevant to the present application, and does not constitute a limitation on the refrigerator to which the present application is applied, and a particular refrigerator may include more or fewer components than those shown in the drawings, or combine certain components, or have a different arrangement of components.
It should be understood that the Processor may be a Central Processing Unit (CPU), and the Processor may be other general purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the refrigerator comprises a compartment and a camera mounted in the compartment, the processor being configured to run a computer program stored in the memory to implement the steps of:
acquiring image data of the compartment through the camera, and determining the vacancy rate of the refrigerator according to the image data;
if the vacancy rate is larger than a preset vacancy rate threshold value, acquiring the historical use frequency of the refrigerator within a preset time period;
determining a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode according to the historical use frequency;
and operating according to the target working mode and the target operating parameters. In one embodiment, when the determining of the target operation mode of the refrigerator and the target operation parameter corresponding to the target operation mode according to the historical usage frequency is implemented, the processor is configured to implement:
determining the type of food materials in the refrigerator according to the image data;
and determining a target working mode of the refrigerator and a target operation parameter corresponding to the target working mode according to the historical use frequency and the food material type.
In one embodiment, when the processor determines the target operation mode of the refrigerator and the target operation parameter corresponding to the target operation mode according to the historical use frequency and the food material type, the processor is configured to implement:
when the historical use frequency is smaller than a preset first use frequency threshold value, determining that the target working mode of the refrigerator is a first preset working mode;
determining temperature information from a mapping relation table of preset food material types and temperature information according to the food material types;
and generating a target operation parameter of the first preset working mode according to the temperature information.
In one embodiment, when the processor determines the target operation mode of the refrigerator and the target operation parameter corresponding to the target operation mode according to the historical use frequency and the food material type, the processor is configured to implement:
when the historical use frequency is larger than a preset second use frequency threshold value, determining that the target working mode of the refrigerator is a second preset working mode;
and determining the target operation parameters of the second preset working mode according to the food material types.
In one embodiment, the processor is further configured to, prior to the obtaining of the image data of the compartment by the camera, perform:
when the closing of the door of the refrigerator is detected, timing is started;
and when the timed time reaches a preset time threshold value, starting the camera.
In one embodiment, the processor, in implementing the determining the vacancy rate of the refrigerator from the image data, is configured to implement:
identifying an area in which an article in the refrigerator is located based on the image data;
determining the volume of the compartment occupied by the article according to the area;
and acquiring the total volume of the compartment, and determining the vacancy rate of the refrigerator according to the total volume and the volume of the compartment occupied by the articles.
In one embodiment, said processor, in effecting said measuring the volume of said compartment occupied by said item in dependence on said region, is adapted to effect:
determining the area of the region and distance information between the region and a camera;
and determining the volume of the compartment occupied by the article according to the area and distance information.
In one embodiment, the processor, when implementing the obtaining of the historical usage frequency within the preset time period of the refrigerator, is configured to implement:
determining the door opening and closing times of the refrigerator in a preset time period, and obtaining the historical use frequency of the refrigerator according to the door opening and closing times; or
Determining the article taking and placing times of the refrigerator in a preset time period, and obtaining the historical use frequency of the refrigerator according to the article taking and placing times.
It should be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the refrigerator described above may refer to the corresponding process in the foregoing embodiment of the refrigerator control method, and is not described herein again.
Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, where the computer program includes program instructions, and a method implemented when the program instructions are executed may refer to various embodiments of the refrigerator control method of the present application.
The computer-readable storage medium may be an internal storage unit of the refrigerator described in the foregoing embodiment, for example, a hard disk or a memory of the refrigerator. The computer readable storage medium may also be an external storage device of the refrigerator, such as a plug-in hard disk provided on the refrigerator, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items and includes such combinations. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of other like elements in a process, method, article, or system comprising the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (7)
1. A refrigerator control method, characterized in that the refrigerator includes a compartment and a camera installed in the compartment, the method comprising:
acquiring image data of the compartment through the camera, and determining the vacancy rate of the refrigerator according to the image data;
if the vacancy rate is larger than a preset vacancy rate threshold value, determining the door opening and closing times of the refrigerator in a preset time period, and obtaining the historical use frequency of the refrigerator according to the door opening and closing times;
determining a plurality of food material types in the refrigerator according to the image data;
when the historical use frequency is smaller than a preset first use frequency threshold value, determining that the target working mode of the refrigerator is a first preset working mode; determining a plurality of temperature information from a preset mapping relation table of food material types and temperature information according to the food material types; taking an average or mode of the plurality of temperature information as target temperature information, and generating a target operation parameter of the first preset working mode according to the target temperature information;
and operating according to the target working mode and the target operating parameters.
2. The method of controlling a refrigerator of claim 1, wherein the method further comprises:
when the historical use frequency is larger than a preset second use frequency threshold value, determining that the target working mode of the refrigerator is a second preset working mode;
and determining a target operation parameter of the second preset working mode according to the food material type.
3. The refrigerator control method of any one of claims 1-2, wherein before the acquiring image data of the compartment by the camera, further comprising:
starting timing when the door of the refrigerator is detected to be closed;
and when the timed time reaches a preset time threshold value, starting the camera.
4. The method as claimed in any one of claims 1-2, wherein said determining an empty rate of the refrigerator based on the image data comprises:
identifying an area in which an article in the refrigerator is located based on the image data;
determining the volume of the compartment occupied by the article according to the area;
and acquiring the total volume of the compartment, and determining the vacancy rate of the refrigerator according to the total volume and the volume of the compartment occupied by the articles.
5. The refrigerator control method as claimed in claim 4, wherein said measuring the volume of said compartment occupied by said articles according to said area comprises:
determining the area of the region and distance information between the region and a camera;
and determining the volume of the compartment occupied by the article according to the area and distance information.
6. A refrigerator, characterized in that the refrigerator comprises a camera, a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the refrigerator control method according to any one of claims 1 to 5.
7. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the refrigerator control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010007958.9ACN113063261B (en) | 2020-01-02 | 2020-01-02 | Refrigerator control method, refrigerator and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010007958.9ACN113063261B (en) | 2020-01-02 | 2020-01-02 | Refrigerator control method, refrigerator and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113063261A CN113063261A (en) | 2021-07-02 |
| CN113063261Btrue CN113063261B (en) | 2022-12-13 |
Family
ID=76559500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010007958.9AActiveCN113063261B (en) | 2020-01-02 | 2020-01-02 | Refrigerator control method, refrigerator and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113063261B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114543434A (en)* | 2022-01-26 | 2022-05-27 | 青岛海尔科技有限公司 | Method and device for adjusting energy-saving mode, storage medium and electronic device |
| CN115077191B (en)* | 2022-06-24 | 2023-04-07 | 珠海格力电器股份有限公司 | Refrigerating chamber, refrigerator and control method |
| CN115717807B (en)* | 2022-11-24 | 2024-06-25 | 珠海格力电器股份有限公司 | Control method of refrigeration house equipment, controller, air conditioner and refrigeration house |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010151367A (en)* | 2008-12-25 | 2010-07-08 | Panasonic Corp | Refrigerator |
| CN101922845A (en)* | 2010-05-07 | 2010-12-22 | 海信容声(广东)冰箱有限公司 | Periodic control of smart refrigerator and control method thereof |
| CN103443566A (en)* | 2011-03-02 | 2013-12-11 | 松下电器产业株式会社 | Refrigerator |
| CN104807285A (en)* | 2015-04-30 | 2015-07-29 | 青岛海尔股份有限公司 | Refrigerator and control method thereof |
| CN104897231A (en)* | 2015-04-30 | 2015-09-09 | 青岛海尔股份有限公司 | Refrigerator use volume detection method and device |
| CN105074365A (en)* | 2013-03-12 | 2015-11-18 | 株式会社东芝 | Refrigerators, camera devices, refrigerator door shelves, communication terminals, home appliance network systems, and in-box image display programs |
| CN105091493A (en)* | 2015-06-26 | 2015-11-25 | 青岛海尔股份有限公司 | Partition refrigeration control method and partition refrigeration control device of refrigerator refrigerating chamber |
| CN106123431A (en)* | 2016-06-24 | 2016-11-16 | 青岛海尔特种电冰柜有限公司 | refrigerator energy-saving control method and refrigerator |
| CN106200392A (en)* | 2016-06-30 | 2016-12-07 | 北京小米移动软件有限公司 | Operation information method to set up and device |
| CN106642977A (en)* | 2016-12-27 | 2017-05-10 | Tcl集团股份有限公司 | Frequency conversion method and device |
| CN106940118A (en)* | 2017-03-08 | 2017-07-11 | 佛山市小鲜互联电器科技有限公司 | A kind of controlling method for refrigerator |
| CN108168189A (en)* | 2017-12-25 | 2018-06-15 | 青岛海尔股份有限公司 | Refrigerating device and its control method |
| CN109357473A (en)* | 2018-10-24 | 2019-02-19 | 珠海格力电器股份有限公司 | Refrigerator, refrigerator control method and refrigerator control device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102395456B1 (en)* | 2016-06-09 | 2022-05-06 | 엘지전자 주식회사 | Refrigerator with temperature context awareness and method of controlling thereof |
| US10655907B2 (en)* | 2017-12-15 | 2020-05-19 | International Business Machines Corporation | Content and context aware microscopic cooling optimization for refrigerators |
- 2020
- 2020-01-02CNCN202010007958.9Apatent/CN113063261B/enactiveActive
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010151367A (en)* | 2008-12-25 | 2010-07-08 | Panasonic Corp | Refrigerator |
| CN101922845A (en)* | 2010-05-07 | 2010-12-22 | 海信容声(广东)冰箱有限公司 | Periodic control of smart refrigerator and control method thereof |
| CN103443566A (en)* | 2011-03-02 | 2013-12-11 | 松下电器产业株式会社 | Refrigerator |
| CN105074365A (en)* | 2013-03-12 | 2015-11-18 | 株式会社东芝 | Refrigerators, camera devices, refrigerator door shelves, communication terminals, home appliance network systems, and in-box image display programs |
| CN104807285A (en)* | 2015-04-30 | 2015-07-29 | 青岛海尔股份有限公司 | Refrigerator and control method thereof |
| CN104897231A (en)* | 2015-04-30 | 2015-09-09 | 青岛海尔股份有限公司 | Refrigerator use volume detection method and device |
| CN105091493A (en)* | 2015-06-26 | 2015-11-25 | 青岛海尔股份有限公司 | Partition refrigeration control method and partition refrigeration control device of refrigerator refrigerating chamber |
| CN106123431A (en)* | 2016-06-24 | 2016-11-16 | 青岛海尔特种电冰柜有限公司 | refrigerator energy-saving control method and refrigerator |
| CN106200392A (en)* | 2016-06-30 | 2016-12-07 | 北京小米移动软件有限公司 | Operation information method to set up and device |
| CN106642977A (en)* | 2016-12-27 | 2017-05-10 | Tcl集团股份有限公司 | Frequency conversion method and device |
| CN106940118A (en)* | 2017-03-08 | 2017-07-11 | 佛山市小鲜互联电器科技有限公司 | A kind of controlling method for refrigerator |
| CN108168189A (en)* | 2017-12-25 | 2018-06-15 | 青岛海尔股份有限公司 | Refrigerating device and its control method |
| CN109357473A (en)* | 2018-10-24 | 2019-02-19 | 珠海格力电器股份有限公司 | Refrigerator, refrigerator control method and refrigerator control device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113063261A (en) | 2021-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113063261B (en) | Refrigerator control method, refrigerator and computer-readable storage medium | |
| RU2650561C1 (en) | Method and device for generating information | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| US11599928B2 (en) | Refrigerator and method for managing products in refrigerator | |
| US8032430B2 (en) | Method and apparatus for mapping content descriptions to reusable containers | |
| CN109442670A (en) | Door and window closing reminding method and device based on air conditioner, storage medium and air conditioner | |
| US11421929B2 (en) | Food management system | |
| CN104949465A (en) | Refrigerator with face recognition function and article storing and taking method | |
| CN106052242A (en) | Food management method and food management system for intelligent refrigerator | |
| JP7584036B2 (en) | refrigerator | |
| CN106546063A (en) | The food information management method of refrigerating device and system | |
| CN111971684A (en) | Refrigerator, control method and system thereof | |
| CN105809134A (en) | Intelligent refrigeration device and method for monitoring intelligent refrigeration device | |
| CN107403248A (en) | Article control method, device, intelligent storage equipment and operating system | |
| JP7466117B2 (en) | Refrigerator, management system, and program | |
| CN113012656A (en) | Display screen control method, intelligent household appliance and storage medium | |
| CN105823778A (en) | Article identification method, and apparatus and system thereof | |
| CN113299367A (en) | Refrigerator-based menu recommendation method, refrigerator, menu recommendation system and medium | |
| CN113465264A (en) | Intelligent refrigerator and food material management method | |
| KR20190090290A (en) | Refrigerator with displaying image by identifying goods and method of displaying thereof | |
| CN111051799A (en) | Cold storage | |
| CN113239780A (en) | Food material determining method and device, electronic equipment, refrigerator and storage medium | |
| CN113486689B (en) | Refrigerator and food volume estimation method | |
| CN113465285B (en) | Refrigerator and food material storing and taking method | |
| CN113137797A (en) | Refrigerator control method, refrigerator and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |