CN113137797A - Refrigerator control method, refrigerator and computer-readable storage medium - Google Patents
Refrigerator control method, refrigerator and computer-readable storage mediumDownload PDFInfo
- Publication number
- CN113137797A CN113137797ACN202010066561.7ACN202010066561ACN113137797ACN 113137797 ACN113137797 ACN 113137797ACN 202010066561 ACN202010066561 ACN 202010066561ACN 113137797 ACN113137797 ACN 113137797A
- Authority
- CN
- China
- Prior art keywords
- refrigerator
- area
- region
- determining
- refrigeration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/003—Arrangement or mounting of control or safety devices for movable devices
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
Description
Technical Field
The application relates to the technical field of intelligent refrigerators, in particular to a refrigerator control method, a refrigerator and a computer readable storage medium.
Background
With the popularization of intelligent refrigerators and the generation of large-screen refrigerators, refrigerators have become more abundant than cabinets capable of refrigerating foods, but the most important function of the refrigerators is to store and manage food materials.
At present, the temperature is all adjusted according to the refrigeration gear to traditional refrigerator, on the one hand, can not effectively discern and refrigerate fast the article of just putting into the refrigerator, can not guarantee the new freshness of the edible material of putting into the refrigerator. On the other hand, different food materials are put into the refrigerator, the temperatures suitable for storage are different, and particularly, the fresh food materials can be kept fresh better at the temperature suitable for refrigeration. Therefore, how to effectively preserve the freshness of food materials put into the refrigerator becomes a problem which needs to be solved urgently.
Disclosure of Invention
The main purpose of the present application is to provide a refrigerator control method, a refrigerator and a computer-readable storage medium, which aim to intelligently control the refrigerator to refrigerate and improve the freshness of food materials in the refrigerator.
In a first aspect, the present application provides a refrigerator control method, including:
acquiring a thermal sensing image in the refrigerator, and determining whether an area with a preset color exists in the thermal sensing image;
if the regions with preset colors exist, determining the area of each region and the position information of each region in the refrigerator;
determining a refrigeration strategy of the refrigerator according to the area of each region and the position information of each region in the refrigerator;
and refrigerating according to the refrigerating strategy so that the color of each area in the thermal image is not a preset color.
In a second aspect, the present application further provides a refrigerator comprising a thermal sensor camera, a processor, and a memory, wherein:
the thermal sensing camera is used for collecting a thermal sensing image in the refrigerator;
the memory for storing a computer program executable by the processor;
the computer program, when executed by the processor, implements the steps of the refrigerator control method as described above.
In a third aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the refrigerator control method as described above.
The application provides a refrigerator control method, a refrigerator and a computer readable storage medium, and the refrigerator control method, the refrigerator and the computer readable storage medium are characterized in that the area of each region of preset color and the position information of each region in the refrigerator are determined in a thermal image in the refrigerator, a refrigeration strategy of the refrigerator is determined according to the area of each region and the position information of each region in the refrigerator, and then refrigeration is performed according to the refrigeration strategy, so that the color of each region in the thermal image is not the preset color, the temperature of food materials in the refrigerator corresponding to each region is rapidly reduced, the refrigerator can be intelligently controlled to refrigerate, and the freshness degree of the food materials in the refrigerator is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a refrigerator control method according to an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating sub-steps of the refrigerator control method of FIG. 1;
fig. 3 is a schematic view of a scene for implementing the refrigerator control method according to the embodiment;
fig. 4 is a schematic flowchart of another refrigerator control method according to an embodiment of the present disclosure;
fig. 5 is a schematic block diagram of a structure of a refrigerator according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation. The embodiment of the application provides a refrigerator control method, a refrigerator and a computer readable storage medium. The refrigerator control method can be applied to a refrigerator, the refrigerator can be a compression type refrigerator, an absorption type refrigerator, an electromagnetic vibration type refrigerator and the like, and the refrigerator comprises a thermal sensing camera for collecting thermal sensing images in the refrigerator. The thermal inductance image can effectively identify the food materials just placed into the refrigerator, and the food materials placed into the refrigerator are rapidly refrigerated, so that the freshness of the food materials placed into the refrigerator is locked to the maximum extent.
It can be understood that the refrigerator control method can also be applied to terminal equipment or a server, wherein the terminal equipment can be electronic equipment such as a mobile phone, a tablet computer, a notebook computer, a desktop computer and an intelligent television; the server may be a single server or a server cluster including a plurality of servers. Specifically, the terminal device or the server is used as an execution main body, takes on calculation and processing tasks, generates a control instruction, and sends the control instruction to the refrigerator so as to control the refrigerator to execute corresponding steps.
The following explanation will be given by taking an example in which the refrigerator control method is applied to a refrigerator.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a flowchart illustrating a refrigerator control method according to an embodiment of the present disclosure.
As shown in fig. 1, the refrigerator control method includes steps S101 to S104.
Step S101, acquiring a thermal sensing image in the refrigerator, and determining whether an area with a preset color exists in the thermal sensing image.
The refrigerator may include at least one compartment of a freezing compartment, a refrigerating compartment, and a warming compartment. The refrigerator comprises a thermal sensing camera for collecting thermal sensing images inside the refrigerator, and the thermal sensing camera can be arranged in at least one compartment of the refrigerator. Optionally, the thermal camera is mounted in a refrigerating chamber of the refrigerator and collects thermal images in the refrigerating chamber.
It should be noted that the refrigerator may acquire the thermal image at a fixed time or in real time, and the fixed time may be flexibly set by a user, which is not specifically limited in the present application. The refrigerator can also start the thermal sensing camera when receiving a thermal sensing image acquisition request so as to acquire the thermal sensing image inside the refrigerator, which is shot by the thermal sensing camera. For example, a user may trigger a button or a control on a refrigerator to generate a thermal image acquisition request, or a mobile terminal such as a mobile phone or an IPAD installs a corresponding APP application program, the user may trigger generation of the thermal image acquisition request through a corresponding option in an APP running interface, and then the mobile terminal sends the thermal image acquisition request to the refrigerator, and the refrigerator collects a thermal image inside the refrigerator based on the received thermal image request.
In one embodiment, after the door of the refrigerator is detected to be closed for the preset time, the thermal sensing image in the refrigerator is collected through the thermal sensing camera arranged in the refrigerator. Specifically, by a timer in the refrigerator, when the door of the refrigerator is detected to be closed, timing is started; and when the timed time reaches the preset time, starting a thermal sensing camera arranged in the refrigerator to collect thermal sensing images in the refrigerator. The preset time can be set according to actual conditions, and is not specifically limited in the application and is optional, wherein the preset time is 5 seconds.
It should be noted that a door control switch is disposed at the door of the refrigerator, and the door control switch is turned on or off according to the switch of the door to detect the opening and closing state of the door, wherein the door control switch may be a micro switch or a proximity switch.
In one embodiment, a Radio Frequency Identification (RFID) reader is installed in the refrigerator and is used for reading RFID tag information entering the refrigerator. When the refrigerator receives the RFID label information, judging whether the RFID label information is historical RFID label information; and if the RFID label information is not historical RFID label information, opening a thermal sensing camera in the refrigerator to collect a thermal sensing image in the refrigerator. The historical RFID tag information is RFID tag information read by an RFID reader within a preset time period, for example, RFID tag information read within a day. It should be noted that, if the read RFID tag information is not historical RFID tag information, it is indicated that the food material corresponding to the RFID tag information is a food material newly placed in the refrigerator, and the refrigerator can quickly refrigerate the food material, so as to ensure the freshness of the food material in the refrigerator.
After acquiring the thermal image of the interior of the refrigerator, it is necessary to determine whether an area of a preset color exists in the thermal image. In the thermal image, the regions in different temperature zones are represented by different colors, and the regions in the same temperature zone are represented by the same color. The preset color may be set according to actual conditions, and is optionally a color corresponding to a higher temperature in the thermal image, for example, the preset color is red. In addition, a plurality of colors can be selected as the preset color according to actual conditions, for example, red, yellow and orange can be used as the preset color.
Step S102, if the regions with preset colors exist, determining the area of each region and the position information of each region in the refrigerator.
And determining whether the thermal image has the area with the preset color or not, if so, indicating that the article in the temperature range corresponding to the preset color exists in the refrigerator, and the temperature of the article is not cooled down, so that the article can be identified through the thermal image. If the thermal sensing image does not have the area with the preset color, the refrigerator does not have the articles with the temperature range corresponding to the preset color, and subsequent processing is not needed.
It should be noted that the area of the preset color corresponds to the area in the temperature zone of the refrigerator, and the area of each of the areas and the position information of each of the areas in the refrigerator need to be determined to perform the subsequent operation.
In one embodiment, as shown in fig. 2, step S102 includes: substeps 1021 to substep S1022.
And a substep S1021, marking the boundary line of the area with the preset color in the thermal image to obtain at least one target area.
Specifically, detecting a region with a preset color in the thermal sensing image based on a preset edge detection algorithm to obtain a plurality of boundary position information of the region with the preset color; marking the region with the preset color according to the plurality of boundary position information of the region with the preset color to obtain a boundary line of the region with the preset color and obtain at least one target region. The edge detection algorithm comprises an edge detection algorithm based on search and an edge detection algorithm based on zero crossing, and is used for carrying out edge detection on a region with preset color in the thermal sensing image so as to mark the boundary line of the region with the preset color and obtain at least one target region with the preset color. The boundary line of the region having the preset color in the thermal image may be identified and marked by a histogram method, a region segmentation method, a threshold segmentation method, or the like, which is not further limited in this application.
And a substep S1022 of calculating an area of each of the target regions and determining location information of each of the target regions in the refrigerator.
Specifically, the number of pixel points of each target region is determined, and the area of each target region is determined according to the number of pixel points of each target region. It should be noted that the larger the number of the pixel points is, the larger the area of the target region is, the smaller the number of the pixel points is, and the smaller the area of the target region is. Furthermore, through the position information of each target area in the thermal image, the position information of the corresponding target area in the refrigerator can be determined.
The specific method for determining the position information of each target area in the refrigerator comprises the following steps: determining coordinate information of each target area in the thermal image; and determining the position information of each target area in the refrigerator according to the coordinate information of each target area in the thermal image. It should be noted that, an arbitrary point in the thermal image may be selected as an origin to establish a coordinate system, and coordinate information of a boundary point or a midpoint of each target area in the coordinate system may be determined. According to the coordinate information of the boundary point or the middle point of each target area in the coordinate system, the position information of each target area in the refrigerator can be determined. The memory is pre-stored with a corresponding table between coordinate information and position information, and the corresponding relation between each coordinate information and the position information can be determined by inquiring the corresponding table, so that the position information of each target area in the refrigerator is determined.
Further, after the position information of each target area in the refrigerator is determined, scanning each article in the refrigerator through a positioning radar to obtain three-dimensional information of each article; comparing the position information with the three-dimensional information of each article to obtain a comparison set of each position information; and adjusting the position information of the respectively corresponding target area in the refrigerator according to the comparison set of each position information. It can be understood that the three-dimensional information with the highest contrast in the comparison set with each piece of the position information is determined, and the three-dimensional information corresponding to each piece of the three-dimensional information is used as the position information to be adjusted, so that the determined position information in each refrigerator is more accurate.
Step S103, determining a refrigeration strategy of the refrigerator according to the area of each region and the position information of each region in the refrigerator.
According to the area of each region and the position information of each region in the refrigerator, the refrigeration strategy of the refrigerator can be determined. The refrigeration strategy may include at least one of a refrigeration gear, a refrigeration time, and a refrigeration mode, and the refrigeration strategy may also be to perform partition refrigeration on the refrigerator according to each piece of location information. It should be noted that, the refrigeration strategy of the refrigerator is determined according to the area and position information of each region, so that the intelligence of the refrigerator is improved.
In one embodiment, a plurality of air supply outlets are installed in the compartment of the refrigerator for outputting cold air; the specific way for determining the refrigeration strategy of the refrigerator is as follows: determining at least one air supply outlet to be opened according to the position information of each area in the refrigerator; and determining the air supply gear and/or air supply time of each air supply outlet to be opened according to the area of each region. Each air supply outlet has a corresponding area range and is connected with a cold source of the refrigerator through the ventilation pipeline, namely, cold air can be input into the compartment of the refrigerator through the air supply outlet.
It should be noted that when the position information is located in the area range corresponding to at least one air supply opening, the at least one air supply opening is determined to be an air supply opening to be opened. The refrigerator can control the opening or closing of each air supply opening, and can control the air supply gear and/or the air supply time of each air supply opening. The air supply gear and/or the air supply time of each air supply opening are determined based on the area of the corresponding area, for example, by inquiring a preset relation table between the pre-stored area and the air supply gear and/or the pre-stored air supply time. It is understood that the larger the area of the corresponding region, the larger the determined air supply shift and/or the longer the air supply time, and the smaller the area of the corresponding region, the smaller the determined air supply shift and/or the shorter the air supply time.
In one embodiment, the air supply gear of the air supply outlet is used for adjusting the air speed of cold air at the air supply outlet, and the air supply gear of the fan inside the refrigerator can be controlled through the air supply gear of the fan, and the larger the air supply gear of the fan is, the larger the air supply gear of the air supply outlet is. The air supply time of the air supply opening is the air outlet time of the air supply opening, and can be controlled by the fan or a valve at the air supply opening, namely the cold air output of the air supply opening can be effectively controlled by determining the running time of the fan or the opening time of the valve.
And step S104, cooling according to the cooling strategy so that the color of each area in the thermal image is not a preset color.
And cooling according to the cooling strategy, so that the color of each area in the thermal image can be changed rapidly and is not a preset color any more. On the other hand, the temperature of the food materials in the refrigerator corresponding to each region is rapidly reduced, freshness can be effectively and rapidly preserved, and user experience is improved.
In one embodiment, the cooling according to the cooling strategy includes: and outputting cold air according to the air supply gear and/or air supply time of each air supply outlet. And cold air is output according to the air supply gear and/or air supply time of each air supply outlet, the refrigerator is intelligently controlled to refrigerate aiming at the food materials just placed into the refrigerator, and the freshness of the food materials in the refrigerator is improved.
Referring to fig. 3, fig. 3 is a schematic view of a scenario for implementing the refrigerator control method provided in this embodiment.
As shown in fig. 3, a corresponding image acquisition instruction is generated by a trigger operation of a user on a control page of the mobile terminal, so that the mobile terminal sends the image acquisition instruction to the refrigerator. After the refrigerator receives the image acquisition instruction, the camera A is started based on the image acquisition instruction, and the thermal sensing image in the refrigerator is acquired through the camera A, so that subsequent operations are executed according to the thermal sensing image.
According to the refrigerator control method provided by the embodiment, the area of each region with preset color and the position information of each region in the refrigerator are determined in the thermal image in the refrigerator, the refrigeration strategy of the refrigerator is determined according to the area of each region and the position information of each region in the refrigerator, and then refrigeration is performed according to the refrigeration strategy, so that the color of each region in the thermal image is not the preset color, the temperature of the food material in the refrigerator corresponding to each region is rapidly reduced, the refrigeration of the refrigerator can be intelligently controlled, and the freshness degree of the food material in the refrigerator is improved.
Referring to fig. 4, fig. 4 is a schematic flow chart of another refrigerator control method according to an embodiment of the present application.
As shown in fig. 4, the refrigerator control method includes steps S201 to S206.
Step S201, acquiring a thermal sensing image in the refrigerator, and determining whether an area with a preset color exists in the thermal sensing image.
The refrigerator is internally provided with at least one thermal sensing camera for collecting thermal sensing images in the refrigerator. The collected thermal images in the refrigerator can be one or more, and when the collected thermal images are multiple, whether an area with a preset color exists in each thermal image is determined.
It should be noted that the color of the preset color in the thermal image is different from the color of the other areas in the thermal image, so that the temperature of the different areas can be distinguished by different colors, and the color of the area with higher temperature in the thermal image is set as the preset color, for example, red or yellow is set as the preset color. When the area with the preset color appears in the acquired thermal sensing image, the area in the refrigerator corresponding to the area can be known to have higher temperature, and the area with higher temperature in the refrigerator can be conveniently adjusted.
Step S202, if the regions with preset colors exist, determining the area of each region and the position information of each region in the refrigerator.
The area of the preset color corresponds to an area in the refrigerator within a preset temperature range, and the area of each area and the position information of each area in the refrigerator need to be determined so as to perform the subsequent operation.
In one embodiment, whether areas with preset colors exist in the thermal image or not is determined, and the area of each area is determined; and if the area of any one of the regions is smaller than the area of the preset region, screening any one of the regions to reserve the region with the area larger than or equal to the area of the preset region. It should be noted that the preset area can be flexibly set by the user. Through screening the region with preset color, the interference of the region with smaller area is eliminated, and the refrigeration efficiency is higher.
In an embodiment, the preset color may include two colors or a plurality of colors, for example, the preset color includes a first preset color and a second preset color, if there is no region of the first preset color in the thermal image, the region of the second preset color is detected, and the subsequent operation is performed according to the area of the region of the second preset color and the position information of each region in the refrigerator. Further, an embodiment of the present application provides another implementation that, when preset colors include a first preset color and a second preset color, regions of the first preset color and the second preset color are simultaneously detected, and a subsequent operation is performed according to areas of the regions of the first preset color and the second preset color and position information of each of the regions in the refrigerator. The first preset color and the second preset color can be flexibly set by a user, such as a honey orange color, a lemon color, a orange color and the like.
Step S203, obtaining image data of the interior of the refrigerator, and determining the type of food materials in the refrigerator according to the image data.
The refrigerator may include at least one compartment of a freezing compartment, a refrigerating compartment, and a warming compartment. The refrigerator comprises a camera for collecting image data inside the refrigerator, and the camera can be installed in at least one compartment of the refrigerator. Optionally, the camera is mounted in a cold room of the refrigerator and collects at least one image data in the cold room.
And sending the collected image data to a processor of the refrigerator, and determining the type of the food materials in the refrigerator according to the received image data by the processor. Specifically, the type of the food material in the refrigerator can be obtained by inputting the image data into a preset convolutional neural network. The convolutional neural network comprises an input layer, a plurality of convolutional layers, a pooling layer, a default frame layer and an output layer, wherein the default frame layer is used for selecting the aspect ratio of a default frame according to the plurality of convolutional layers.
In an embodiment, the training samples are input into the deep learning convolutional neural network, and the deep learning convolutional neural network is trained by using a deep learning frame, so that the trained convolutional neural network can be obtained. The training samples are images of various food materials, including various types of foods such as vegetables, fruits, and meat. And detecting the image data through the trained convolutional neural network to obtain the type of the food materials in the refrigerator. It is understood that other suitable image recognition methods or techniques may be used to detect the type of food material in the refrigerator, for example, various methods such as a scale invariant feature transformation algorithm, an angular point-based image feature extraction and matching algorithm, a local feature-based image matching and recognition, a visual information-based image feature extraction algorithm, etc. may be used, and the present application is not limited in particular.
Further, the convolutional neural network comprises a preprocessing sublayer, a feature recognition sublayer and an output layer, and image data are preprocessed through the preprocessing sublayer to obtain preprocessed image data; and performing feature recognition on the preprocessed image data based on a feature extraction sublayer to obtain the type of the food material in the refrigerator. The preprocessing sublayer is used for preprocessing a target image, and the preprocessing process comprises smoothing denoising, corrosion, expansion and the like. Meanwhile, the image data is further processed according to detection methods, such as edge detection, gray scale change, speckle detection, depth detection, and the like. The feature extraction sublayer is used for performing feature identification on the preprocessed image data to determine the type of the food material in the image data, wherein the identified food material features can be the shape of the food material, the color of the food material, the pattern of the food material and the like. The output layer is used for outputting the identified food material types, and the output food material types can be one or more. The food material type in the refrigerator is identified through the convolutional neural network, so that the accuracy of identifying the food material type in the refrigerator can be improved.
In an embodiment, according to the position information of each area in the refrigerator, the image data is marked to obtain target image data, and the target image data comprises at least one marked area; and identifying each marking area in the target image data based on a preset food material identification model to obtain the food material type of each marking area. It should be noted that each of the regions has corresponding location information in the refrigerator, and each of the location information also has a corresponding region in the image data. Wherein the correspondence between the position information within the refrigerator and the region in the image data may be set in advance by a user. It can be understood that, the area in the image data corresponding to each of the position information is marked to obtain target image data, where the target image data includes at least one marked area.
Further, the food material identification model comprises a deep learning convolutional neural network, and based on the convolutional neural network, each labeled region in the target image data is identified, so that the food material type of each labeled region can be obtained. It should be noted that the food material types may be one or more. The food material type in the target image data is identified through the convolutional neural network, the target food material type newly placed in the refrigerator can be known, and the refrigeration intelligence of the refrigerator is improved.
And S204, determining a refrigeration gear of the refrigerator according to the food material type.
Specifically, according to the food material type, determining temperature information from a preset mapping relation table of the food material type and the temperature information; and determining a refrigeration gear of the refrigerator according to the temperature information. The mapping relation table of the food material types and the temperature information can also be set according to actual conditions, the method is not particularly limited, and the temperature information suitable for different food material types is different. It can be understood that, when the food material types are multiple, the mapping relation table is queried to obtain multiple temperature information, at this time, the average or mode of the multiple temperature information can be taken as target temperature information, and each refrigeration gear has corresponding temperature range information, and a target refrigeration gear to which the target temperature information belongs is determined, so that the refrigeration gear of the refrigerator can be obtained. It should be noted that, the refrigeration gear of the refrigerator may also be determined by querying a mapping relationship table between the food material type and the refrigeration gear according to the food material type, which is not specifically limited in the present application.
In one embodiment, current season information and/or current region information are acquired, and a refrigeration gear range of the refrigerator is determined according to the current season information and/or the current region information; and determining a refrigeration gear of the refrigerator from the refrigeration gear range according to the food material type. It should be noted that the range of the refrigeration gears suitable for starting the refrigerator in different seasons or different regions is not consistent, for example, the refrigeration gear suitable for the refrigerator is 4-5 gears in winter, and the refrigeration gear suitable for the refrigerator is 2-3 gears in summer. And determining a refrigeration gear range of the refrigerator according to the current season information and/or the current region information, and selecting an appropriate refrigeration gear from the refrigeration gear range according to the type of the food material, wherein the determined refrigeration gear is more accurate, so that the refrigerator can better keep the freshness of the food material.
And S205, determining a refrigeration strategy of the refrigerator according to the refrigeration gear, the area of each region and the position information of each region in the refrigerator.
According to the refrigeration gear, the area of each region and the position information of each region in the refrigerator, the refrigeration strategy of the refrigerator can be determined. The refrigeration strategy can comprise a refrigeration gear, refrigeration time and a refrigeration mode, and the refrigeration strategy can also be the refrigeration gear, the area of each region and partition refrigeration of the refrigerator according to each position information. It should be noted that the refrigeration strategy of the refrigerator is determined according to the refrigeration gear, the area of each region and the position information, the refrigerator is intelligently controlled to refrigerate, a user does not need to manually adjust the refrigeration parameters of the refrigerator, and the user experience is improved.
In an embodiment, a specific method for determining the refrigeration strategy of the refrigerator is as follows: acquiring the refrigeration gear to be started; determining at least one air supply outlet to be opened according to the position information of each area in the refrigerator; and determining the air supply gear and/or air supply time of each air supply outlet to be opened according to the area of each region. Wherein, each air supply outlet has a respective corresponding area range and is connected with a cold source of the refrigerator through a ventilation pipeline. According to the refrigeration gear, cold air with the temperature corresponding to the refrigeration gear can be input into the compartment of the refrigerator through the air supply outlet, refrigeration can be effectively and rapidly carried out according to the refrigeration temperature suitable for food storage, and the freshness of the food can be better kept.
And S206, cooling according to the cooling strategy so that the color of each area in the thermal image is not a preset color.
And cooling according to the cooling strategy, so that the color of each area in the thermal image can be changed rapidly and is not a preset color any more. On the other hand, the temperature of the food materials in the refrigerator corresponding to each region is rapidly reduced, the food materials can be effectively and rapidly preserved, and the user experience is improved.
The refrigeration is carried out according to the refrigeration strategy, the refrigeration strategy comprises a refrigeration gear determined according to the type of the food material, and the temperature suitable for refrigeration is determined according to the food material put into the refrigerator, so that the freshness of the food material can be better maintained.
In the refrigerator control method provided by the above embodiment, by determining the area of each region of the preset color and the position information of each region in the refrigerator in the thermal image inside the refrigerator, determining the food material type in the refrigerator according to the image data inside the refrigerator, determining the refrigeration gear of the refrigerator according to the food material type, then determining the refrigeration strategy of the refrigerator according to the refrigeration gear, the area of each region and the position information of each region in the refrigerator, and finally performing refrigeration according to the refrigeration strategy, so that the color of each region in the thermal image is not the preset color, the temperature of the food material in the refrigerator corresponding to each region is rapidly reduced, the refrigerator can be intelligently controlled to perform refrigeration, and the freshness degree of the food material in the refrigerator is improved.
Referring to fig. 5, fig. 5 is a schematic block diagram of a refrigerator according to an embodiment of the present disclosure. The refrigerator can be a compression refrigerator, an absorption refrigerator, an electromagnetic vibration refrigerator and the like.
As shown in fig. 5, the refrigerator includes a thermal camera, a processor, and a memory, which are connected by a system bus, wherein the thermal camera is used for collecting a thermal image inside the refrigerator, and the memory may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program includes program instructions that, when executed, cause a processor to perform any one of the refrigerator control methods.
The processor is used for providing calculation and control capability and supporting the operation of the whole refrigerator.
The internal memory provides an environment for running a computer program in the nonvolatile storage medium, and the computer program, when executed by the processor, causes the processor to execute any one of the refrigerator control methods.
The refrigerator may further include a network interface connected to the system bus for performing network communication, such as transmitting assigned tasks, and the like. It will be understood by those skilled in the art that the structure shown in fig. 5 is a block diagram of only a portion of the structure relevant to the present application, and does not constitute a limitation on the refrigerator to which the present application is applied, and a particular refrigerator may include more or fewer components than those shown in the drawings, or combine certain components, or have a different arrangement of components.
It should be understood that the Processor may be a Central Processing Unit (CPU), and the Processor may be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the processor is configured to execute a computer program stored in the memory to implement the steps of:
acquiring a thermal sensing image in the refrigerator, and determining whether an area with a preset color exists in the thermal sensing image;
if the regions with preset colors exist, determining the area of each region and the position information of each region in the refrigerator;
determining a refrigeration strategy of the refrigerator according to the area of each region and the position information of each region in the refrigerator;
and refrigerating according to the refrigerating strategy so that the color of each area in the thermal image is not a preset color.
In one embodiment, the processor is provided with a plurality of air supply outlets in a compartment for realizing the refrigerator, and the air supply outlets are used for outputting cold air; when the refrigeration strategy of the refrigerator is determined according to the area of each region and the position information of each region in the refrigerator, the method is used for realizing that:
determining at least one air supply outlet to be opened according to the position information of each area in the refrigerator;
determining an air supply gear and/or air supply time of each air supply outlet to be opened according to the area of each region;
the refrigerating according to the refrigerating strategy comprises the following steps:
and outputting cold air according to the air supply gear and/or air supply time of each air supply outlet.
In one embodiment, the processor, when implementing the determining the refrigeration strategy of the refrigerator according to the area of each of the regions and the position information of each of the regions in the refrigerator, is configured to implement:
acquiring image data inside the refrigerator, and determining the type of food materials in the refrigerator according to the image data;
determining a refrigeration gear of the refrigerator according to the food material type;
and determining a refrigeration strategy of the refrigerator according to the refrigeration gear, the area of each region and the position information of each region in the refrigerator.
In one embodiment, when the determining of the refrigeration gear of the refrigerator according to the food material type is implemented, the processor is configured to implement:
acquiring current season information and/or current region information, and determining a refrigeration gear range of the refrigerator according to the current season information and/or the current region information;
and determining a refrigeration gear of the refrigerator from the refrigeration gear range according to the food material type.
In one embodiment, the processor, when enabling the determining of the type of food material within the refrigerator from the image data, is configured to enable:
according to the position information of each area in the refrigerator, marking the image data to obtain target image data, wherein the target image data comprises at least one marking area;
and identifying each marking area in the target image data based on a preset food material identification model to obtain the food material type of each marking area.
In one embodiment, the processor, in effecting said determining the area of each said region and the location information of each said region within the refrigerator, is adapted to effect:
marking a boundary line of a region with a preset color in the thermal sensing image to obtain at least one target region;
and calculating the area of each target area, and determining the position information of each target area in the refrigerator.
In one embodiment, the processor, in performing the determining the location information of each of the target areas within the refrigerator, is configured to perform:
determining coordinate information of each target area in the thermal image;
and determining the position information of each target area in the refrigerator according to the coordinate information of each target area in the thermal image.
In one embodiment, before acquiring the thermal image of the inside of the refrigerator, the method is further used for realizing:
after the door of the refrigerator is detected to be closed for the preset time, the thermal sensing image in the refrigerator is collected through the thermal sensing camera arranged in the refrigerator.
It should be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the refrigerator described above may refer to the corresponding process in the foregoing embodiment of the refrigerator control method, and is not described herein again.
Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, where the computer program includes program instructions, and a method implemented when the program instructions are executed may refer to various embodiments of the refrigerator control method of the present application.
The computer-readable storage medium may be an internal storage unit of the refrigerator described in the foregoing embodiment, for example, a hard disk or a memory of the refrigerator. The computer readable storage medium may also be an external storage device of the refrigerator, such as a plug-in hard disk provided on the refrigerator, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A refrigerator control method, comprising:
acquiring a thermal sensing image in the refrigerator, and determining whether an area with a preset color exists in the thermal sensing image;
if the regions with preset colors exist, determining the area of each region and the position information of each region in the refrigerator;
determining a refrigeration strategy of the refrigerator according to the area of each region and the position information of each region in the refrigerator;
and refrigerating according to the refrigerating strategy so that the color of each area in the thermal image is not a preset color.
2. The control method of a refrigerator according to claim 1, wherein a plurality of blowing ports for outputting cool air are installed in the compartment of the refrigerator; the determining the refrigeration strategy of the refrigerator according to the area of each region and the position information of each region in the refrigerator comprises the following steps:
determining at least one air supply outlet to be opened according to the position information of each area in the refrigerator;
determining an air supply gear and/or air supply time of each air supply outlet to be opened according to the area of each region;
the refrigerating according to the refrigerating strategy comprises the following steps:
and outputting cold air according to the air supply gear and/or air supply time of each air supply outlet.
3. The method as claimed in claim 1, wherein the determining a cooling strategy of the refrigerator according to the area of each zone and the location information of each zone in the refrigerator comprises:
acquiring image data inside the refrigerator, and determining the type of food materials in the refrigerator according to the image data;
determining a refrigeration gear of the refrigerator according to the food material type;
and determining a refrigeration strategy of the refrigerator according to the refrigeration gear, the area of each region and the position information of each region in the refrigerator.
4. The refrigerator control method of claim 3, wherein the determining a refrigeration gear of the refrigerator according to the food material type comprises:
acquiring current season information and/or current region information, and determining a refrigeration gear range of the refrigerator according to the current season information and/or the current region information;
and determining a refrigeration gear of the refrigerator from the refrigeration gear range according to the food material type.
5. The refrigerator control method of claim 3, wherein the determining of the type of food material in the refrigerator according to the image data comprises:
according to the position information of each area in the refrigerator, marking the image data to obtain target image data, wherein the target image data comprises at least one marking area;
and identifying each marking area in the target image data based on a preset food material identification model to obtain the food material type of each marking area.
6. The refrigerator control method of any one of claims 1-5, wherein said determining an area of each of said regions and location information of each of said regions within said refrigerator comprises:
marking a boundary line of a region with a preset color in the thermal sensing image to obtain at least one target region;
and calculating the area of each target area, and determining the position information of each target area in the refrigerator.
7. The refrigerator control method of claim 6, wherein said determining location information of each of said target areas within said refrigerator comprises:
determining coordinate information of each target area in the thermal image;
and determining the position information of each target area in the refrigerator according to the coordinate information of each target area in the thermal image.
8. The method of controlling a refrigerator according to any one of claims 1 to 5, wherein before the acquiring the thermal image of the inside of the refrigerator, further comprising:
after the door of the refrigerator is detected to be closed for the preset time, the thermal sensing image in the refrigerator is collected through the thermal sensing camera arranged in the refrigerator.
9. A refrigerator, comprising a thermal sensor camera, a processor, and a memory, wherein:
the thermal sensing camera is used for collecting a thermal sensing image in the refrigerator;
the memory for storing a computer program executable by the processor;
the computer program, when executed by the processor, implements the steps of the refrigerator control method of any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the refrigerator control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066561.7ACN113137797A (en) | 2020-01-20 | 2020-01-20 | Refrigerator control method, refrigerator and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010066561.7ACN113137797A (en) | 2020-01-20 | 2020-01-20 | Refrigerator control method, refrigerator and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113137797Atrue CN113137797A (en) | 2021-07-20 |
Family
ID=76809204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010066561.7APendingCN113137797A (en) | 2020-01-20 | 2020-01-20 | Refrigerator control method, refrigerator and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113137797A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114935405A (en)* | 2022-05-10 | 2022-08-23 | 西安商汤智能科技有限公司 | Constant-temperature animal monitoring method and constant-temperature animal monitoring equipment |
| CN115704622A (en)* | 2021-08-05 | 2023-02-17 | 海信集团控股股份有限公司 | Intelligent refrigerator and food material storing and taking action identification method |
| CN116222139A (en)* | 2023-03-15 | 2023-06-06 | 宁波方太厨具有限公司 | Temperature control method and system for refrigerator, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH04187970A (en)* | 1990-11-21 | 1992-07-06 | Matsushita Refrig Co Ltd | Rapid cooling controller for refrigerator |
| CN1475774A (en)* | 2002-08-17 | 2004-02-18 | Lg������ʽ���� | Infrared sensor part and refrigerator with the infrared sensor |
| CN1525126A (en)* | 1999-09-09 | 2004-09-01 | ������������ʽ���� | Freezer-refrigerator, how to operate the freezer-refrigerator |
| CN104879985A (en)* | 2015-05-21 | 2015-09-02 | 青岛海尔股份有限公司 | Refrigerator |
| CN104990357A (en)* | 2015-06-26 | 2015-10-21 | 青岛海尔股份有限公司 | Partition refrigeration control method and device for refrigerating chamber of refrigerator |
| CN107843044A (en)* | 2016-09-21 | 2018-03-27 | 比亚迪股份有限公司 | Object detecting method in object detecting system, vehicle and refrigerator in refrigerator |
| CN109269216A (en)* | 2018-09-28 | 2019-01-25 | 珠海格力电器股份有限公司 | Temperature control method, device, equipment, storage medium and processor |
| US20190264975A1 (en)* | 2016-06-09 | 2019-08-29 | Lg Electronics Inc. | Temperature-context-aware-refrigerator and method for controlling same |
- 2020
- 2020-01-20CNCN202010066561.7Apatent/CN113137797A/enactivePending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH04187970A (en)* | 1990-11-21 | 1992-07-06 | Matsushita Refrig Co Ltd | Rapid cooling controller for refrigerator |
| CN1525126A (en)* | 1999-09-09 | 2004-09-01 | ������������ʽ���� | Freezer-refrigerator, how to operate the freezer-refrigerator |
| CN1475774A (en)* | 2002-08-17 | 2004-02-18 | Lg������ʽ���� | Infrared sensor part and refrigerator with the infrared sensor |
| CN104879985A (en)* | 2015-05-21 | 2015-09-02 | 青岛海尔股份有限公司 | Refrigerator |
| CN104990357A (en)* | 2015-06-26 | 2015-10-21 | 青岛海尔股份有限公司 | Partition refrigeration control method and device for refrigerating chamber of refrigerator |
| US20190264975A1 (en)* | 2016-06-09 | 2019-08-29 | Lg Electronics Inc. | Temperature-context-aware-refrigerator and method for controlling same |
| CN107843044A (en)* | 2016-09-21 | 2018-03-27 | 比亚迪股份有限公司 | Object detecting method in object detecting system, vehicle and refrigerator in refrigerator |
| CN109269216A (en)* | 2018-09-28 | 2019-01-25 | 珠海格力电器股份有限公司 | Temperature control method, device, equipment, storage medium and processor |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115704622A (en)* | 2021-08-05 | 2023-02-17 | 海信集团控股股份有限公司 | Intelligent refrigerator and food material storing and taking action identification method |
| CN114935405A (en)* | 2022-05-10 | 2022-08-23 | 西安商汤智能科技有限公司 | Constant-temperature animal monitoring method and constant-temperature animal monitoring equipment |
| CN116222139A (en)* | 2023-03-15 | 2023-06-06 | 宁波方太厨具有限公司 | Temperature control method and system for refrigerator, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111442604B (en) | Refrigerator and control method thereof | |
| CN113137797A (en) | Refrigerator control method, refrigerator and computer-readable storage medium | |
| CN109631456B (en) | refrigerator | |
| EP3852038B1 (en) | Food management system, server apparatus, and refrigerator | |
| JP7584036B2 (en) | refrigerator | |
| KR102217024B1 (en) | Refrigerator, controlling method thereof and system | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| CN101498539B (en) | Energy-saving refrigerator and its energy-saving method | |
| CN103822431B (en) | A kind of refrigerator | |
| JP7466117B2 (en) | Refrigerator, management system, and program | |
| CN106679327A (en) | Intelligent refrigerator based on RFID scanning and containing object management method thereof | |
| CN106642969A (en) | Refrigerator food management method and refrigerator | |
| CN110969047A (en) | Method and device for identifying food materials and refrigerator | |
| KR20220011450A (en) | Object identifying device, server and method of identifying thereof | |
| KR20110130901A (en) | Apparatus and method for storing food in refrigerator | |
| CN111240217B (en) | State detection method and device, electronic equipment and storage medium | |
| CN111488831B (en) | Food association identification method and refrigerator | |
| CN113465285B (en) | Refrigerator and food material storing and taking method | |
| CN113915887B (en) | A refrigerator and its ingredients positioning method | |
| CN113280560A (en) | Refrigerator control method, refrigerator and computer-readable storage medium | |
| CN113450505B (en) | Temperature control method and device of self-service vending machine | |
| CN115638599A (en) | Foodstuff information management method for refrigeration equipment, refrigeration equipment and readable storage medium | |
| KR20220105016A (en) | An apparatus for providing information on items kept in the refrigerator, and a storage medium that records a program that provides information on items kept in the refrigerator | |
| CN115638598A (en) | Foodstuff information management method for refrigeration equipment, refrigeration equipment and readable storage medium | |
| CN109269216A (en) | Temperature control method, device, equipment, storage medium and processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20210720 | |
| RJ01 | Rejection of invention patent application after publication |