CN114253169A - Intelligent home control system - Google Patents

Abstract

An intelligent household control system comprises a host, at least one sensor, a plurality of controlled devices and a notification device. The host machine judges the entrance and the exit of the family members according to the detection result of the at least one sensor, and controls the on-off of the controlled devices according to the member identities of the entered and the exit family members or informs a specific family member of executing backlog by the informing device. When judging that a to-do item cannot be executed or is forgotten to be executed by the specific family member, the host also reconfigures the to-do item.

Description

Intelligent household control system

Technical Field

The present invention relates to an intelligent home control system, and more particularly, to an intelligent home control system capable of controlling the on/off of a plurality of electronic devices according to the entrance and exit of a family member or notifying a specific family member of backlog of record execution.

Background

Smart homes are one of the rings in developing smart cities. However, besides basic control of household appliances and lamps, how to perform relative control according to the requirements of different family members is also an important issue. In addition, when a plurality of different events are detected, if the correlation of the different events can be judged and the correlated events can be actively suggested to be processed together, the technical effect of the smart home can be further improved, and the life convenience is improved.

In view of the above, the present invention provides an intelligent home control system for performing internal control or information prompt according to the identity of an entering member or an exiting member, so as to make an intelligent home more humanized.

Disclosure of Invention

The invention provides an intelligent home control system which judges the interaction relation between recorded backlogs and a current event and informs a specific member of the backlogs related to the current event to execute so as to improve the experience of a user of an intelligent home.

The invention also provides an intelligent home control system, which can actively reconfigure the assigned backlog when judging that the assigned backlog can not be completed.

The invention also provides an intelligent home control system comprising the memory, a plurality of sensors and the host. The memory is used for recording a plurality of backlogs, each of which is recorded by a transaction code, and the transaction code comprises a member bit, a category bit, a time bit, a place bit and an assignment bit. The host is coupled to the memory and the sensors, and is configured to, when one of the sensors detects a new event, assign a new event code of the new event and add the new event code to the memory, when an event is identified, assign the event code of the event, compare the event code with the recorded event codes to determine a related event of the event and update the assignment bit of the related event, and when it is determined that the related event is not executed according to an external sensor, reconfigure the related event.

The invention also provides an intelligent home control system comprising the memory, a plurality of sensors and the host. The memory is used for recording a plurality of backlogs, each of which is recorded by a transaction code, and the transaction code comprises a member bit, a category bit, a time bit, a place bit and an assignment bit. The host is coupled to the memory and the sensors, and is configured to, when an egress event is identified according to one of the sensors, assign an event code of the egress event, compare the event code with the recorded event codes to determine a backlog related to the egress event among the backlogs and update the assignment bit of the backlog, and when it is determined that the backlog is not executed according to an external sensor, reconfigure the backlog.

In the embodiment of the invention, the backlog includes events triggered by persons and events not triggered by persons, for example, the sensor detects that the stock of articles at home belongs to non-person triggering, the content of accessing the electronic calendar belongs to person triggering, and the analysis of conversations of family members also belongs to person triggering. The backlogs include at least one of purchasing an item, contacting a person, paying a fee, carrying an item, and going to a place, for example.

In the embodiment of the present invention, the current event is usually triggered by the family member, such as the family member going out and the family member making a phone call.

In order that the manner in which the above recited and other objects, features and advantages of the present invention are obtained will become more apparent, a more particular description of the invention briefly described below will be rendered by reference to the appended drawings. In the description of the present invention, the same components are denoted by the same reference numerals, and the description thereof is made herein.

Drawings

Fig. 1 is a block diagram of a smart home control system according to a first embodiment of the present invention;

fig. 2 is a schematic diagram of the correspondence relationship of the smart home control system of the first embodiment of the present invention;

fig. 3 is a block diagram of a smart home control system according to a second embodiment of the present invention;

fig. 4 is a flowchart of an operation method of a smart home control system according to a second embodiment of the present invention;

fig. 5 is a flowchart of an operation method of a smart home control system according to a third embodiment of the present invention;

fig. 6 is a schematic diagram of an operation method of a smart home control system according to a third embodiment of the present invention.

Wherein the reference numerals are as follows:

100. 300 intelligent household control system

11. 31 host

12. 32 internal memory

13. 331, 332 sensor

15. 35 input device

18. 38 network

19. 39 mobility/wear device

Detailed Description

The intelligent household control system provided by the embodiment of the invention is used for judging the entrance and exit of the family members according to the detection result of at least one sensor, controlling the on-off or operation intensity of a plurality of controlled devices according to the identities of the entered and exited family members, or informing a specific family member of executing the recorded backlog by using the informing device.

Fig. 1 is a block diagram of an intelligenthome control system 100 according to a first embodiment of the present invention. The intelligenthome control system 100 includes ahost 11, a memory 12, at least one sensor 13 (1 is shown here, but not limited thereto), a plurality of control switches 141-14N, and aninput device 15. The plurality ofcontrol switches 141 to 14N are, for example, electronic switches or valves (valve) for performing at least one of turning on and off the home appliance, turning on and off the security system, turning on and off the lamp, changing the operation intensity of the home appliance, changing the brightness of the lamp, and turning on and off the door and window.

The memory 12 includes a volatile memory and/or a non-volatile memory, and is used for pre-storing the corresponding relationship between the on/off states of the plurality of family members and the plurality ofcontrol switches 141 to 14N. The corresponding relationship is set by the family member in the setting stage, for example, the corresponding relationship is modified and set by using the human-machine interface of theinput device 15, wherein theinput device 15 includes at least one of a mouse, a keyboard, a joystick, a screen, a microphone (e.g., a voice assistant) and a touch device. In some embodiments, theinput device 15 is built in whole or in part into thehost 11.

Fig. 2 is a schematic diagram of the correspondence relationship of the intelligenthome control system 100 according to the first embodiment of the present invention. The memory 12 records information (shown as status representation in fig. 2) of whether each family member is at home, for example, when a certain family member is at home, the information is represented by a numerical value (shown as 1, for example) of at least one bit; and when a family member goes out, it is represented by a digital value of at least one bit (for example, shown as 0), in which whether or not the family member is at home is actively confirmed by thehost 11 according to the detection result of the sensor 13 (for example, described later). In other embodiments, whether a family member is at home may also be set via theinput device 15, for example, by pressing a button, talking in voice, or clicking an icon (icon) on a graphical interface.

The correspondence includes, for example, the relationship of a member to and from the switch group and/or the relationship of the remaining (or outgoing) member combinations to the switch combinations, as described in fig. 2. For example, when a male member enters and exits, the first switch group is turned on and off; when the female member enters and exits, the second switch group is turned on and off; when a senior and a kid (i.e., the remaining members) are left in the home, activating the first switch combination; the second switch combination is activated when no one is present in the home. Some family members do not activate any control switches, such as children. Each switch group or switch combination contains at least one control switch.

Thesensor 13 is used for acquiring activity data of a plurality of family members and transmitting the activity data to thehost 11 for access judgment, voiceprint judgment and face recognition. Thesensor 13 includes, for example, a CCD image sensor, a CMOS image sensor, a heat sensor, a sound sensor, a microwave sensor (e.g., RFID), or other sensors that can acquire data for identification and entry/exit determination. For example, when thesensor 13 is a sound sensor (e.g., a microphone), the activity data is included in the acquired voice data; when thesensor 13 is an image sensor, the activity data is contained in the acquired image frames; when thesensor 13 is a thermal sensor, the activity data is included in the acquired thermal image. For detecting the entrance and exit of a member, thesensor 13 is preferably disposed near the entrance or at least at a position capable of monitoring the entrance state, but the present invention is not limited thereto. If thesensor 13 is an audio sensor, it may be deployed in any location capable of receiving a member's speech.

In some embodiments, thesensor 13 comprises an Application Specific Integrated Circuit (ASIC) or a Digital Signal Processor (DSP), which performs a determination according to the activity data and then transmits the determination result (e.g., represented by at least one bit) to thehost 11 to control the corresponding control switch.

Thehost 11 may be any of various stationary or mobile calculators with computing functions, such as a personal computer, a notebook computer, a desktop computer, a tablet computer, a security server, and the like, without any particular limitation. Thehost 11 is coupled (e.g., wired or wireless) to a memory 12 and asensor 13 for receiving the activity data and accessing the memory 12. In some embodiments, the memory 12 is built in thehost 11.

Thehost 11 includes a processor, such as a central processing unit or a micro-processing unit, for determining a member identity of an in-out member of the plurality of family members according to the received activity data, accessing the corresponding relationship in the memory 12 according to the remaining members of the plurality of family members or the member identity of the in-out member, and controlling the on/off of the plurality of control switches 141-141N according to the corresponding relationship, so as to achieve the purpose of controlling the indoor device.

For example, when thesensor 13 is an image sensor, thehost 11 is configured to perform face recognition based on the image frames to identify the identity of the entering and exiting member. The face recognition can use a known face recognition algorithm, and only the face features or parameters of all family members are recorded in a setting stage. The facial features or parameters of each family member may be recorded in the memory 12 or in the cloud (cloud). When the image sensor is installed at the entrance and exit of the family, whenever a family member enters or exits, thehost 11 can identify the identity of the entering or exiting member and change the state setting of the memory 12 corresponding to the entering or exiting member, for example, from 1 to 0 or from 0 to 1, to indicate the state change of the entering or exiting member. Thehost 11 can control the control switches 141-14N according to the status of the member entering or exiting or the status combination of all the remaining members (i.e. the members at home) or the members outside (i.e. the members not at home).

For example, when a family member goes out, all the home appliances in his bedroom are turned off and the outgoing state can be displayed on the screen of theinput device 15. For example, when only a long person and a small person remain at home, the balcony window and the gas switch are closed, and the indoor camera or the heat sensor is turned on.

For example, when thesensor 13 is a sound sensor, thehost 11 is configured to perform voiceprint recognition based on the acquired voice data to identify the identity of the member entering and exiting the member and perform natural language analysis to determine the advancing direction of the member entering and exiting the member. For example, thehost 11 has a built-in conversation function, and can determine whether a family member is going out or entering according to a conversation with an entering member to control a corresponding switch group. The dialogue function may use a trained model and parameters installed in thehost 11, or may directly couple a commercially available smart voice device or smart speaker (e.g., as an input device) to thehost 11, without any particular limitation.

In other embodiments, thesensor 13 may include two or more sensors, such as an image sensor and a sound sensor, and thehost 11 may identify the identity of the member according to the image frames and determine the advancing direction of the member according to natural language analysis; or vice versa.

In some embodiments, thehost 11 is also connected to thenetwork 18 to receive location signals of a plurality of family members via thenetwork 18. Thenetwork 18 includes, for example, at least a wireless network and a local area network, etc. The positioning signal is provided by a positioning system of a mobile/wearable device 19 (such as, but not limited to, a smart phone, a smart band), and is transmitted to thehost 11 via thenetwork 18. In one embodiment, thehost 11 is used for determining the out-going members and the in-home members according to the positioning signals. In one embodiment, thehost 11 determines the family members associated with the positioning signal that enter a predetermined range (e.g., will come home) of thehost 11 as the expected remaining members, i.e., the family members will increase. Thehost 11 controls a plurality of control switches 141-14N, such as opening cold air, a window or a water dispenser in advance, according to the corresponding relationship between the remaining members and the expected remaining members accessing the memory 12. This embodiment is particularly suitable when there are no people at home (i.e. the number of remaining members is 0).

Fig. 3 is a block diagram of an intelligenthome control system 300 according to a second embodiment of the present invention. The smarthome control system 300 includes ahost 31, amemory 32, a plurality of sensors (2 are shown here, but not limited thereto), anelectronic calendar 34, an input device 35, and a notification device 36. In some embodiments, theelectronic calendar 34 may be composed by the input device 35 or the mobile/wearable device 39. In other embodiments, theelectronic calendar 34 has its own input interface for a separate electronic device.

Thememory 32 includes a volatile memory and/or a non-volatile memory for recording a plurality of backlogs, for example, at least one of purchasing an item, contacting a person, paying a fee, carrying an item, and going to a place, wherein the backlogs occur at the same or different times and are recorded by the smarthome control system 300. Each of the plurality of backlogs may be recorded with a plurality of bits of a transaction code, the transaction code including at least one of a member bit, a category bit, a time bit, and a place bit.

The member bit (e.g., "person" shown in fig. 3) is used to mark family members (or member identities) that are suitable for performing a backlog, e.g., when the numerical value of the member bit is 1, it indicates that the relevant backlog is suitable for being performed by male members; when the numerical value of the member bit is 0, it indicates that the associated backlog is suitable for execution by a female or young member; when the member bit is a null bit (denoted as N in fig. 3), it indicates that any family member can perform.

In some embodiments, a backlog is suitable or unsuitable for execution by a family member, such as an adult or male member (e.g., the member bits include two bits, one bit indicating whether adult and the other bit indicating whether male member), or by more than one family member, such as not senior and kids, based on more than one bit. That is, one to-do has a plurality of restrictions of family members, which are expressed in member bits.

In some embodiments, a backlog is set to be performed based on the priority of the family members, e.g., the member bit has another bit for indicating or defining a priority associated with a backlog. If a family member with a higher priority cannot perform a pending item (as indicated by another bit described below), the pending item is automatically changed to a family member with a lower priority. In some embodiments, the priority is set by more than one bit, e.g., one bit for male and one bit for adult; one bit for female and one bit for adult. In other embodiments, the priority is represented or defined by a time bit, which will be described later. That is, the member bit may comprise a plurality of bits for representing different characteristics of each family member, respectively.

The category bits (e.g., "event" shown in FIG. 3) are used to mark categories of backlog, such as the aforementioned purchase of items, contact of people, payment, carrying of items, travel to location (FIG. 3 at I)₁～I₃Representing different classes but not limited thereto) and the like. The family member can set and change the category of the backlog through the input device 35, or the category is preset in the smarthome control system 300.

The time bit (e.g., "time" shown in FIG. 3) is used to mark the execution time interval or urgency status of the backlog. For example, when the digital value of the time bit is "1" (indicated by I in fig. 3), it indicates that the related backlog is a normal event and does not need to be completed urgently, and at this time, when a family member related to a current event does not conform (for example, illustrated later), the family member may not be notified to execute the event; however, when the digital value of the time bit is "10" (indicated by II in fig. 3), it indicates that a pending event is an emergency event, and even if a family member related to a current event does not meet the current event, the family member is notified to execute the event. For example, when a backlog is set to be executed by a male member, if the time bit indicates an emergency, other family members may still be notified to execute the backlog. In some embodiments, even if a current backlog is marked as urgent, the current backlog is not notified to a specific member, such as, but not limited to, the senior or the child. That is, certain backlogs are always set to be executed or not executed by a particular family member.

Further, when the numerical value of the time bit is "11" (indicated by III in fig. 3), it indicates that a backlog is preferable to be executed in the morning; while other numerical values of the time bit may be used to indicate that a backlog is preferred to be performed in other time bands, such as in the afternoon or evening. That is, if desired, the time bits include more than one bit to indicate different characteristics of the pending transaction, such as priority, appropriate execution duration.

The location bit (e.g., "ground" shown in fig. 3) is used to mark the execution location of the backlog, such as a convenience store, a supermarket, a restaurant, a bookoffice, a friend's house (fig. 3 shows different locations as a-C, but not limited thereto), and so on. That is, different numerical values of the locality bit may be used to indicate different localities of the backlog.

In some embodiments, as long as the category bit of a backlog is determined, the corresponding member bit, time bit, and location bit are determined. In the present invention, a backlog may be performed by more than one family member, at more than one time period, and/or at more than one location.

It can be understood that the number of bits of the transaction code Ic can be set according to the information to be represented.

In another embodiment, the intelligenthome control system 300 may include a plurality of registers (registers) that respectively mark transaction codes, including member bits, category bits, time bits, and location bits. That is, thehost 31 sets the transaction code by setting the states of the plurality of registers.

The smarthome control system 300 sets a backlog entry code according to the detection results of thesensors 331 and 332 …. In some embodiments, the sensor is built in an intelligent household appliance, such as an intelligent refrigerator and an intelligent lamp. The intelligent refrigerator has a plurality of sensors therein for detecting the inventory of the articles and transmitting the detection result to thehost computer 31 after the intelligent refrigerator is coupled to thehost computer 31. In other embodiments, the sensor is, for example, a CCD image sensor, a CMOS image sensor, a thermal sensor, an acoustic sensor, a microwave sensor (e.g., RFID), or the like, which is provided independently.

Thehost 31 may be selected from various stationary or mobile calculators having a calculation function, for exampleSuch as a personal computer, a notebook computer, a desktop computer, a tablet computer, a security server, etc., without any specific limitation. Thehost 31 is coupled (e.g., wired or wireless) to thememory 32 and the plurality ofsensors 331, 332, and is configured to give a new event code of a new event and record the new event code in thememory 32 when the new event is detected by one of the plurality ofsensors 331, 332. For example, when the intelligent refrigerator detects that eggs run out or the intelligent lamp detects that the bulb is burned out, a signal is transmitted to thehost 31, thehost 31 regards the egg as a new to-do item, and the given member bit is N and the category bit is shopping (i.e. I)₁) Time bit is I (e.g. general event) and location bit is supermarket (e.g. a), and new event code is generated and recorded.

In some embodiments, thehost 31 is further configured to compare (e.g., compare each bit) the correlation or similarity between the new transaction code of the new backlog and the transaction codes of the multiple backlogs (existing backlogs) already recorded to determine whether to merge (combine) or Link (Link) the new backlog to one of the multiple existing backlogs (e.g., simultaneous notification). For example, when the member bit, the category bit, the time bit, and the location bit of the new backlog are completely the same as the log codes of some existing backlog or existing backlog list, thehost 31 may merge or link the new backlog to the existing backlog or existing backlog list, thereby improving the operation efficiency.

In some embodiments, if a bit of a new transaction code of a new transaction is set to Null (Null), the bit of the new transaction code is similar to or related to a corresponding bit of any existing transaction codes, i.e., Null is not limited to being Null and has the lowest priority. Thus, if the new to-do-matter is bound or chained to an existing to-do-matter with limited matter encoding, e.g., restricted to be performed by a specific member, for a specific period of time or at a specific location, the new to-do-matter (originally having a null bit) is restricted to have the same restriction as the bound or chained existing to-do-matter, i.e., the null bit is changed to be the same as the encoding of the existing to-do-matter.

In other words, thehost 31 monitors the incidental events in the home through the plurality ofsensors 331, 332 … and sequentially encodes and records them in thememory 32 as backlogs. In addition, the backlog can be obtained by checking theelectronic calendar 34, for example, a family member records a day and a person meeting in theelectronic calendar 34, and thehost 31, after checking theelectronic calendar 34, regards it as a new backlog and sets a log code (including bits of the person, the event, the time, the place, and the like shown in fig. 3) and records it in thememory 32 to notify the relevant family member of the backlog on the same day.

When thehost 31 recognizes the current event, the event code Ec of the current event is given, and the event code Ec is compared with the recorded event codes Ic to determine the backlog related to the current event in the pre-existing backlogs. For comparison with event codes, the current event preferably also includes representations of people, events, time, and places, for example, the event code includes at least one of an event member bit, an event category bit, an event time bit, and an event location bit as a relative event code. Similarly, in one embodiment, the event member bit, the event type bit, the event time bit, and the event location bit may be marked by a plurality of registers.

The comparison is, for example, to determine whether the corresponding bits are the same, and if the digital value of each bit of the event code or the indication of each register is the same as the digital value of each bit of the event code or the indication of each register (as mentioned above, the bit with priority) or at least a part of the indication is the same, the event code is regarded as the related to-do item (both are the same). In the comparison process, thehost 31 may first store the generated event code in thestorage 32 and then compare the event code with the existing item code, or directly compare the generated event code with the existing item code, and delete the event code when the comparison is completed. As described above, in the alignment process, if a matter code or an event code of a certain bit is represented or given as a Null bit (Null), the Null bit is similar or related to a relative phase.

In the present invention, the current events include, but are not limited to, personal-triggered events such as family member going out and family member making a call. As long as the person-motivated event can link while processing the existing backlog, it can be considered as the current event.

In one embodiment, assuming that thesensor 331 is an image sensor, thehost 31 is configured to identify a member identity (through face recognition as described above) according to an image frame acquired by the image sensor and determine whether to go out, for example, according to a traveling direction of a person image. When thehost 31 determines that a specific member is out, an event code of an out-going event is given, wherein an event member bit is set to, for example, a numerical value indicating a male member (if there are a plurality of male members in the family, an identity ID may be additionally indicated), an event category bit is set to, for example, a numerical value according to the copyright identification of the male member (for example, wearing a sportswear), an event time bit is set to, for example, a numerical value according to an out-going time, an event location bit is set to a null bit if it cannot be determined, or a going-to location is determined in another manner (for example, described later).

When thehost 31 determines that the out event has the related backlog, the notification device 36 is used to notify the related backlog of the current event. The notification device 36 is, for example, a mobile device, a display screen or a dialog system, and thehost 31 uses the notification device 36 to notify the out-going member of the items to be purchased, the places to be visited, the items to be carried, and the like.

In another embodiment, assuming that thesensor 332 is a sound sensor, thehost 31 is configured to recognize the identity of the member according to the voice data obtained by the sound sensor (through voiceprint recognition as described above) and determine whether to make a call (through natural language analysis as described above). After thehost 31 determines the identity of the family member in the call, the event code of the call event is given. For example, the event member bit may represent the identity of a family member in a call, the event category bit may represent a call, the event time bit may represent a call time, and the event location bit may be at home.

In the present invention, when thehost 31 cannot determine the characteristics of a certain bit of the member bit, the category bit, the time bit, or the location bit, the bit may be set as a null bit. Upon alignment, the null bit corresponds (e.g., is similar or related as described above) to any numerical value of the corresponding bit.

When thehost 31 determines that the call event has a related backlog, the notification device 36 is used to notify the related backlog of the current event, such as the content explained to the call party.

Similarly, thehost 31 may also determine and set a digital value of each bit of the current event according to the detection results of the plurality of sensors, for example, perform face recognition according to the image frames and confirm the travel location or activity according to the voice data.

In other embodiments, thehost 31 is configured to determine each bit of the event code of the current event according to a day schedule (day schedule). For example, when a family member goes to the same place or performs the same activity on a specific day every day or every week, thehost 31 determines that the family member goes out at the specific time, and then sets the event code of the going-out event, and actively compares the event code with the event codes of the accumulated events to confirm the related events. The day schedule may be set by the family members themselves or actively determined by the return of the mobilewearable device 39, for example.

In other embodiments, thehost 31 is configured to determine the event code according to the content of theelectronic calendar 34. For example, when thehost 31 recognizes that a family member is going out (e.g. based on image frames or voice data), the location and purpose of the family member can be known by checking theelectronic calendar 34, so that the digital value of each bit of the event code can be set for comparing with the recorded event code.

The location bit of the event code and/or the event location bit of the event code can be set according to the historical travel route of the family members, for example, stores, restaurants, addresses and the like passing through the route to and from the work location can be used for setting the location bit, and the method is not limited to a single destination location. For example, the smarthome control system 300 is also connected to thenetwork 38 to receive a home member's location signal through thenetwork 38, such as generated by the home member's mobile/wearable device 39 and transmitted to thehost 31 through thenetwork 38. Thereby, thehost 31 can determine the digital value of the location bit of the event code and/or the event code according to the historical travel path of the positioning signal. For example, a family member may pass through some places during commuting, thehost 31 marks the place bit of the item code of a backlog to include a plurality of passing places, and when thehost 31 detects that the family member is out of commute, the backlog may be regarded as the backlog related to the out-of-commute. It should be noted that, although the historical travel path is described as a work place, the invention is not limited thereto. The historical path can be determined according to any place where the family members frequently go.

In the present embodiment, when thehost 31 notifies the related to-do-nothing using the notification device 36, the related to-do-nothing is not immediately deleted from the list of the plurality of to-do-things. Thehost 31 deletes the completed backlog from the existing list of backlogs when one of the plurality of sensors detects that the backlog has been completed (e.g., eggs have been filled back into the box, a new light bulb has been installed), confirms that the backlog has been completed by the sound sensor, confirms that the backlog has been completed by theelectronic calendar 34, or confirms that the backlog has been completed by the input of the input device 35.

The event code and/or event code can be modified and set, for example, through a human-machine interface of the input device 35, wherein the input device 35 includes at least one of a mouse, a keyboard, a joystick, a screen, a microphone, and a touch device, for example. When the input device 35 is coupled to thehost 31, thehost 31 may perform corresponding control or response according to the installed software and/or hardware. In some embodiments, the input device 35 is built in whole or in part into thehost 31.

Referring to fig. 4, it is a flowchart of an operation method of the intelligenthome control system 300 according to the second embodiment of the present invention, including the following steps: confirming the out-of-home members (step S41); setting an event code (step S42); checking the relevant backlog of the event code (step S43); notifying the out-of-family members of the relevant to-do-matters (step S44); and confirming whether the relevant backlog is completed (step S45). The present event of the present embodiment is described by taking an exit event as an example. As previously mentioned, the present event may be another human-triggered event. Referring to fig. 3 and fig. 4, an embodiment of the operating method is described.

Step S41: before the current event occurs, it is assumed that at least one backlog has been recorded in thememory 32. As previously described, the backlog may be detected by thesensors 331, 332, or via the confirmationelectronic calendar 34, or entered via the input device 35. Thehost 31 detects a current event, such as the family member going out, through thesensors 331 and 332, and the detection method is described above, and therefore, the description thereof is omitted. When thehost 31 is activated by the present event, the process proceeds to step S42.

Step S42: thehost 31 sets the event code of the current event according to the detection result of the sensor or the information of other peripheral devices (such as theelectronic calendar 34 and the input device 35), including changing the digital value or the state of the register. As previously described, thehost 31 may store the generated event code in or out of thememory 32.

Step S43: next, thehost 31 checks whether there is a backlog related to the event code in the existing backlogs. As previously described, thehost 31 checks by comparing the event code with each transaction code. It can be understood that, when thememory 32 does not record any backlog, the comparison is not required.

Step S44: if thememory 32 contains the related backlog of the event code of the current event, thehost 31 uses the notification device 36 or the mobile/wearable device 39 to notify the event member to execute the related backlog. If the backlog inmemory 32 does not correspond to an (unrelated or dissimilar) event code (e.g., more than a predetermined number of corresponding bits have different numerical values), then the current event member is not notified and waits for other family members to be notified.

Step S45: finally, when thehost 31 receives the information that a backlog is completed, such as from thesensors 331 and 332 …, theelectronic calendar 34, the input device 35, and/or the mobile/wearable device 39, the completed backlog is deleted from thememory 32.

In the third embodiment, thehost 31 can further determine whether the out-member (detected by the plurality ofsensors 331, 332 … as described above) forgets or fails to perform the related to-do-items learned or assigned in step S44 according to the detection result of the external sensor, and reconfigure the related to-do-items, including reassignment, rescheduling and/or reminder. In the third embodiment, the sensor for detecting is referred to as an external sensor so as to be separated from the plurality ofsensors 331 and 332 … located indoors. The operation of the third embodiment is also implemented by the smarthome control system 300 of fig. 3.

It has to be noted that the external sensors of the third embodiment may be of the same kind as some of the sensors of the second embodiment, with the difference being the place where the detection is performed. Taking the mobile/wearable device 39 as an example, when the mobile/wearable device 39 of a certain family member is operated before leaving the home, the mobile/wearable device 39 belongs to the plurality of sensors of the second embodiment described above; and when the mobile/wearable device 39 of a certain family member is operated after leaving the home, the mobile/wearable device 39 belongs to the external sensor of the third embodiment. That is, the second embodiment mainly performs indoor detection, and the third embodiment reconfigures the assigned related backlogs according to the detection result of the external (or outdoor) sensor.

Referring to fig. 5, it is a flowchart of an operation method of the intelligenthome control system 300 according to a third embodiment of the present invention, including the following steps: assigning related backlogs of the out-of-home members (step S44'); detecting with an external sensor that the related to-do-not-do-matter is not executed (step S51); and reconfiguring the related backlogs (step S53), wherein the related backlogs of the embodiment that are not executed may be that the out-of-home members forget to execute or cannot execute due to other factors, without any specific limitation.

In one embodiment, fig. 5 is a flowchart continuing from step S41 to step S43 of fig. 4, and when the related to-do-things including the event code of the outgoing event (i.e. the current event) in thememory 32 is checked in step S43, thehost 31 updates the assignment bit (assign bit) of the related to-do-things to indicate that the related to-do-things has been assigned to a family member for execution, wherein steps S41 to S43 refer to the description of the second embodiment, and therefore are not repeated herein. When thehost 31 confirms that thememory 32 contains the backlog related to the event code of the outbound event, steps S44 and S44' are executed simultaneously. In addition, the manner of detecting the backlog and recording the member bit, the category bit, the time bit and the location bit of the backlog code is the same as that of the second embodiment, and thus the details are not repeated herein.

For example, as shown in FIG. 3, the transaction code Ic also contains assignment bits. When a backlog is not associated or assigned to any family member, the assignment bit is given a numerical value of 0 (e.g., as an initial setting); when an item to be transacted is associated with or assigned to a family member, the assignment bit is changed to the digital value 1. Similarly, the assignment bits may be represented by a scratch pad as another example. In another embodiment, the assignment bit may comprise more than one bit to indicate the identity ID of the particular family member to which the assignment or association is made. That is, the assignment bit is used to indicate whether each backlog has been assigned as an event and/or a family member's associated backlog.

Step S44': when detecting that a family member is going out, thehost 31 checks whether there is a backlog related to the out-going family member in thememory 32, and the determination method is as described in the second embodiment. When thehost 31 determines that the out-going family member has the relevant backlog, the assigned bit of the relevant backlog is updated, for example, but not limited to, changing the numerical value from 0 to 1.

Step S51: during the period that the family member is out, thehost 31 determines whether the related backlog is executed according to the detection result of any external sensor.

In one embodiment, the external sensor is an image sensor of a mobile/wearable device 39 of an out-of-home member. Thehost 31 is connected to thenetwork 38 to receive image frames of the image sensor of the mobile/wearable device 39 of the outgoing family member through thenetwork 38. Thehost 31 is configured to determine whether the related backlog is executed according to the image frame. For example, if the image frame received by thehost 31 through thenetwork 38 shows heavy rain and the family member is not driving out, thehost 31 determines that the family member may not be able to execute the related backlog, and then actively reconfigures the related backlog (step S53). A context indicating that the related backlog cannot be executed may be set in advance at thehost 31, and thehost 31 may use a learning model trained by machine learning based on a convolutional neural network, for example, according to the context recognizable by the image frame.

In other embodiments, the image sensor is not limited to be disposed on the mobile/wearable device 39, and may be a vehicle camera.

In another embodiment, the external sensor is a location device of the mobile/wearable device 39 of the outgoing family member. As described above, in one embodiment, the related backlogs may be determined by thehost 31 according to the historical path of the outgoing family member, and therefore, thehost 31 may determine whether the related backlogs can be executed according to the current path of the outgoing family member. For example, thehost 31 is connected to thenetwork 38 to receive a positioning signal of a positioning device of the mobile/wearable device 39 of an outgoing family member through thenetwork 38. Thehost 31 is configured to determine whether the related backlog is executed according to the current path of the positioning signal. For example, referring to fig. 6, thehost 31 determines that the historical path from home to company of the out-going family member is, for example, path a, and when thehost 31 receives the positioning signal of the mobile/wearable device 39, which indicates that the out-going family member is walking path B to company, thehost 31 determines that the out-going family member may not be able to execute the related backlog and actively reconfigures the related backlog (step S53). Thehost 31 may begin reconfiguring the relevant backlog when the outbound home member is within path B, or when the outbound home member arrives at the company.

In another embodiment, when thehost 31 receives the network information indicating that the path a is not available, thehost 31 actively reconfigures the related backlog.

In other embodiments, the positioning device is not limited to be disposed on the mobile/wearable device 39, and may be a positioning device for a vehicle.

In another embodiment, thehost computer 31 is connected to a checkout system of a store (such as but not limited to a supermarket or a convenience store) or a cloud storing invoices through thenetwork 38. Thus, the external sensor is for example a cash register or a scanner inside a shop, which can scan an image code or an RFID tag on the package of the goods. Thehost 31 is connected to thenetwork 38 to receive shopping lists (e.g., downloaded from a checkout system, mobile/wearable device 39, or cloud) of the out-of-home members over thenetwork 38. Thehost 31 is used for determining whether the related backlog is executed according to the shopping list, for example, checking whether the shopping list contains the items to be purchased. When thehost 31 determines that the shopping list does not include the items to be purchased, the relevant backlog is configured actively (step S53).

In another embodiment, thehost 31 is connected to thenetwork 38 to receive the store service time information through thenetwork 38. Thehost 31 is used for judging whether the related backlog is executed according to the store service time information. In the present embodiment, the external sensor is, for example, the mobile/wearable device 39 for detecting the setting of the service time by the web page or the community media of the store to which the outgoing family member desires to go. When thehost computer 31 determines that the time for the out-going family member to arrive at the store exceeds the service time, the relevant backlog is actively reconfigured (step S53).

In the present invention, thehost 31 can determine whether the related backlog can be executed according to data or information of any external sensor (including various sensors owned, used or used by family members), so as to actively respond to the execution status of the related backlog.

It should be noted that although the third embodiment is described in terms of shopping, the present invention is not limited thereto, and the backlog related to the third embodiment may also be the above-mentioned contact, payment or travel to the place, and thehost 31 reconfigures the backlog as long as thehost 31 is coupled to the external sensor through thenetwork 38 to receive the related data or information (such as the positioning signal, the image frame or the web page data) indicating that the backlog cannot be executed or forgotten to be executed.

In a third embodiment, the reconfiguration includes reassigning the current related backlogs (e.g., updating the assignment bit and re-checking whether the current related backlogs are suitable for execution by other family members according to the steps of fig. 4), rescheduling the current related backlogs (e.g., rescheduling the current related backlogs for the same family member to execute on other days, other places), and re-alerting the current related backlogs (e.g., again reminding the same family member about the current related backlogs through the notification device 36 and/or the mobile/wearable device 39).

When thehost 31 reconfigures the related to-do-list, the family members originally assigned to execute the related to-do-list are also notified through the notification device 36 or the mobile/wearable device 39.

It should be noted that, although the second embodiment is described by taking an example in which family members are going out, the present invention is not limited thereto. In other embodiments, if thememory 32 does not record any backlog when a family member goes out, the intelligenthome control system 300 still regards the going-out event as a current event and gives and records the event code Ec of the current event in thememory 32 when the going-out event is recognized. When a new to-do-event is generated during the family member's exit (e.g., detected by one of the sensors), thehost 31 gives a new event code for the new to-do-event and compares the new event code with the recorded event code to determine whether the new to-do-event is a related to the recorded exit event. If the new to-do-list belongs to the relevant to-do-list, thehost 31 may notify the out-going member to execute the new to-do-list through thenetwork 38; if the new to-do-list is not related to the relevant to-do-list, thehost 31 accumulates the new to-do-list in thememory 32 and waits to notify other family members of the new to-do-list, for example, the other family members notify when going out, as described in the above example of the second embodiment. As described above, whether or not to be correlated is determined based on, for example, the correlation or similarity between the new event code and the recorded event code.

In one embodiment, the notified family member may refuse to perform the associated backlog, such as by transmitting a rejection signal via the input device 35 or the mobile/wearable device 39, at which point thehost 31 continues to record the backlog and waits to notify other family members of the backlog (e.g., the backlog is suitable for execution by more than one family member). In the example where the relevant backlog can only be performed by the notified family member, thehost 31 responds that the relevant backlog cannot be rejected.

In the intelligent home control system of the present invention, the memory further stores software required for system operation and/or hardware or firmware required for system operation built in the host to operate the first and second embodiments.

The intelligent home control system of the invention can also assist the family members to search for specific objects (such as mobile phones, keys and the like), for example, the intelligent voice assistant informs the specific objects to be searched cooperatively, and the host computer carries out positioning through image recognition and then informs the specific objects through a notification device, for example, displaying on a screen or informing through voice.

The intelligent home control system can also actively remind the family members to take an umbrella or inform weather when detecting that the family members are going out and knowing that the family members are going to rain or have high temperature according to the network information.

The intelligent home control system can also actively contact family members to process through the mobile/wearable device when no person is at home and the fire is not monitored to be closed, and actively contact nearby fire brigades when the situation that the fire is about to occur is further monitored.

The smart home control system of the present invention may also monitor, for example by analyzing the acquired images, the eating status of the family members, and the host machine alerts using a notification device or a mobile/wearable device when it is found that an allergic food is about to be eaten.

The smart home control system of the present invention can also automatically notify the cleaning robot to perform cleaning or notify the family members using a notification device or a mobile/wearable device when it is monitored, for example, by analyzing the acquired image that an article is broken or a liquid appears on the floor.

The smart home control system of the present invention can also notify other family members using the notification device or the mobile/wearable device when monitoring, for example, by analyzing the acquired image or thermal image, that the family members are physically ill, such as fever, fall, or abnormal behavior, and actively contact the medical institution when further monitoring that the abnormal state continues to be left unattended.

The smart home control system of the present invention can also perform environmental control, such as raising the set temperature when it is monitored, for example, by analyzing the acquired image or thermal image, that the indoor temperature is too low, and a sheet or member is caught and gets a snivel. At this time, the controlled device is coupled to the host.

Although the above embodiments each illustrate a plurality of family members, the present invention is not limited thereto. The intelligent household control system can also be suitable for families with single members, and the control program is simpler. Meanwhile, the family members capable of activating or starting the intelligent family control system can be set and modified through the input equipment or the mobile/wearable device.

The first and second embodiments described above both detect the entrance and exit of a person by a sensor to perform corresponding functions, so the embodiments can be combined. That is, when the host detects the entrance and exit of the family member, the on-state of the switch is controlled and the related backlog is prompted. In addition, although the above embodiments are described by taking the case that the host automatically controls according to the detection result as an example, the family member may also use the mobile/wearable device to set and modify the content of the memory through the network.

In summary, different controls can be preferentially performed on different family members in the smart home, and prompts of people, events, time, places and objects related to backlog can be automatically provided for the outcoming members, so that the range of the smart control is expanded. Therefore, the present invention further provides an intelligent home control system (for example, fig. 1 and 3) and an operation method thereof (for example, fig. 4), wherein the host performs indoor automatic control and prompts the family member to execute the backlog when detecting that the family member enters the room according to the control mode and the backlog stored in the memory.

Although the present invention has been disclosed by way of examples in the foregoing, it is not intended to limit the invention thereto, and various changes and modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the invention. Therefore, the protection scope of the present invention is subject to the scope defined by the claims.

Claims (20)

Translated fromChinese

1.一种智能型家庭控制系统，该智能型家庭控制系统包含：1. An intelligent home control system comprising:内存，该内存用于记录多个待办事项，该多个待办事项的每一者以事项编码记录，该事项编码包含成员比特、类别比特、时间比特、地点比特及指派比特；memory for recording a plurality of to-do items, each of the plurality of to-do items is recorded with an item code, the item code including member bits, class bits, time bits, location bits, and assignment bits;多个传感器；以及multiple sensors; and主机，该主机耦接所述内存及所述多个传感器，并用于a host, which is coupled to the memory and the plurality of sensors, and is used for当所述多个传感器的其中一者检测到新待办事项时，给定该新待办事项的新事项编码并将其新增于所述内存，When a new to-do item is detected by one of the plurality of sensors, a new item code of the new to-do item is given and added to the memory,当识别到外出事件时，给定该外出事件的事件编码，When an out-of-office event is identified, given the event code of the out-of-office event,比对所述事件编码与已记录的多个事项编码，以决定所述多个待办事项中所述外出事件的相关待办事项并更新该相关待办事项的所述指派比特，及comparing the event code with the recorded multiple item codes to determine a related to-do item for the outgoing event in the multiple to-do items and update the assigned bit of the related to-do item, and当根据外部传感器判断所述相关待办事项未被执行时，重新配置所述相关待办事项。The related to-do items are reconfigured when it is judged according to the external sensor that the related to-do items are not executed.2.根据权利要求1所述的智能型家庭控制系统，其中所述主机还用于比较所述新待办事项的所述新事项编码与已记录的所述多个待办事项的所述多个事项编码之间的相关性，以决定是否将所述新待办事项合并或链结至所述多个待办事项的其中一者。2. The intelligent home control system according to claim 1, wherein the host is further configured to compare the new item code of the new to-do item with the multiple records of the plurality of to-do items. Correlations between item codes to determine whether to merge or link the new to-do item to one of the plurality of to-do items.3.根据权利要求1所述的智能型家庭控制系统，其中所述事件编码包含事件成员比特、事件类别比特、事件时间比特及事件地点比特至少一者。3. The intelligent home control system of claim 1, wherein the event code comprises at least one of event member bits, event class bits, event time bits, and event location bits.4.根据权利要求3所述的智能型家庭控制系统，其中所述多个传感器其中一者是图像传感器，所述主机用于根据所述图像传感器获取的图像帧给定所述外出事件的所述事件编码的所述事件成员比特、所述事件类别比特、所述事件时间比特及所述事件地点比特。4. The intelligent home control system according to claim 3, wherein one of the plurality of sensors is an image sensor, and the host is configured to give all the information about the outing event according to the image frames acquired by the image sensor. the event member bits, the event class bits, the event time bits and the event location bits of the event code.5.根据权利要求3所述的智能型家庭控制系统，其中所述多个传感器其中一者是声音传感器，所述主机用于根据所述声音传感器获取的语音数据给定所述外出事件的所述事件编码的所述事件成员比特、所述事件类别比特、所述事件时间比特及所述事件地点比特。5. The intelligent home control system according to claim 3, wherein one of the plurality of sensors is a sound sensor, and the host is configured to give all the information about the outing event according to the voice data acquired by the sound sensor. the event member bits, the event class bits, the event time bits and the event location bits of the event code.6.根据权利要求3所述的智能型家庭控制系统，其中所述主机还用于根据日课表给定所述外出事件的所述事件编码的所述事件成员比特、所述事件类别比特、所述事件时间比特及所述事件地点比特。6. The intelligent home control system according to claim 3, wherein the host is further configured to give the event member bits, the event category bits, all the event codes of the outgoing events according to the daily schedule. the event time bit and the event location bit.7.根据权利要求3所述的智能型家庭控制系统，还包含电子行事历，其中所述主机还用于根据所述电子行事历的内容决定所述事件编码及所述事项编码至少其中一者。7. The intelligent home control system according to claim 3, further comprising an electronic calendar, wherein the host is further configured to determine at least one of the event code and the event code according to the content of the electronic calendar .8.根据权利要求1所述的智能型家庭控制系统，其中所述重新配置包含重新指派、重新排程或重新提醒所述相关待办事项。8. The intelligent home control system of claim 1, wherein the reconfiguring includes reassigning, rescheduling, or re-reminding the related to-do items.9.根据权利要求1所述的智能型家庭控制系统，其中，所述指派比特用于表示每一待办事项是否已被指派为某一事件的相关待办事项。9. The intelligent home control system of claim 1, wherein the assignment bits are used to indicate whether each to-do item has been assigned as a related to-do item for an event.10.根据权利要求1所述的智能型家庭控制系统，其中，10. The intelligent home control system according to claim 1, wherein,所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的移动/穿戴装置的图像传感器的图像帧，且The host is also connected to a network to receive image frames over the network from an image sensor of an assigned family member's mobile/wearable device associated with the outing event, and所述主机还用于根据所述图像帧判断所述相关待办事项是否被执行。The host is further configured to determine whether the related to-do items are executed according to the image frame.11.根据权利要求1所述的智能型家庭控制系统，其中，11. The intelligent home control system according to claim 1, wherein,所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的移动/穿戴装置的定位信号，且the host is also connected to a network to receive, via the network, a positioning signal of a mobile/wearable device of an assigned family member associated with the outing event, and所述主机还用于根据所述定位信号的目前路径判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the current path of the positioning signal.12.根据权利要求1所述的智能型家庭控制系统，其中12. The intelligent home control system of claim 1, wherein所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的购物清单，且The host is also connected to a network to receive over the network a shopping list of designated family members associated with the outing, and所述主机还用于根据所述购物清单判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the shopping list.13.根据权利要求1所述的智能型家庭控制系统，其中13. The intelligent home control system of claim 1, wherein所述主机还连接至网络以通过该网络接收商店服务时间信息，且the host is also connected to a network to receive store hours of service information over the network, and所述主机还用于根据所述商店服务时间信息判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the store service time information.14.一种智能型家庭控制系统，该智能型家庭控制系统包含：14. An intelligent home control system comprising:内存，该内存用于记录多个待办事项，该多个待办事项的每一者以事项编码记录，该事项编码包含成员比特、类别比特、时间比特、地点比特及指派比特；memory for recording a plurality of to-do items, each of the plurality of to-do items is recorded with an item code, the item code including member bits, class bits, time bits, location bits, and assignment bits;多个传感器；以及multiple sensors; and主机，该主机耦接所述内存及所述多个传感器，并用于a host, which is coupled to the memory and the plurality of sensors, and is used for当根据所述多个传感器的其中一者识别到外出事件时，给定该外出事件的事件编码，When an out-of-office event is identified according to one of the plurality of sensors, given an event code for the out-of-office event,比对所述事件编码与已记录的多个事项编码，以决定所述多个待办事项中所述外出事件的相关待办事项并更新该相关待办事项的所述指派比特，及comparing the event code with the recorded multiple item codes to determine a related to-do item for the outgoing event in the multiple to-do items and update the assigned bit of the related to-do item, and当根据外部传感器判断所述相关待办事项未被执行时，重新配置所述相关待办事项。The related to-do item is reconfigured when it is judged according to the external sensor that the related to-do item has not been executed.15.根据权利要求14所述的智能型家庭控制系统，其中所述重新配置包含重新指派、重新排程或重新提醒所述相关待办事项。15. The intelligent home control system of claim 14, wherein the reconfiguring includes reassigning, rescheduling, or re-reminding the related to-do items.16.根据权利要求14所述的智能型家庭控制系统，其中，所述指派比特用于表示每一待办事项是否已被指派为某一事件的相关待办事项。16. The intelligent home control system of claim 14, wherein the assignment bits are used to indicate whether each to-do item has been assigned as a related to-do item for an event.17.根据权利要求14所述的智能型家庭控制系统，其中，17. The intelligent home control system of claim 14, wherein,所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的移动/穿戴装置的定位信号，且the host is also connected to a network to receive, via the network, a positioning signal of a mobile/wearable device of an assigned family member associated with the outing event, and所述主机还用于根据所述定位信号的目前路径判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the current path of the positioning signal.18.根据权利要求14所述的智能型家庭控制系统，其中18. The intelligent home control system of claim 14, wherein所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的购物清单，且The host is also connected to a network to receive over the network a shopping list of designated family members associated with the outing, and所述主机还用于根据所述购物清单判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the shopping list.19.根据权利要求14所述的智能型家庭控制系统，其中19. The intelligent home control system of claim 14, wherein所述主机还连接至网络以通过该网络接收商店服务时间信息，且the host is also connected to a network to receive store hours of service information over the network, and所述主机还用于根据所述商店服务时间信息判断所述相关待办事项是否被执行。The host is further configured to judge whether the related to-do items are executed according to the store service time information.20.根据权利要求14所述的智能型家庭控制系统，其中20. The intelligent home control system of claim 14, wherein所述主机还连接至网络以通过该网络接收与所述外出事件相关的受指派家庭成员的移动/穿戴装置的图像传感器的图像帧，且所述主机还用于根据所述图像帧判断所述相关待办事项是否被执行。The host is also connected to a network to receive image frames of an image sensor of a mobile/wearable device of an assigned family member related to the outing event through the network, and the host is further configured to determine the Whether the related to-do items are executed.

Images