US20150029334A1 - Doorbell communication systems and methods - Google Patents

Abstract

Doorbells can be used to detect visitors. A picture taken by the doorbell can be sent to a computing device. A user of the computing device can select areas within the picture. The doorbell can then detect visitors within the selected areas. Subsequent pictures from the doorbell can be analyzed according to the selected areas.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application claims the benefit of U.S. Provisional Patent Application No. 61/872,439; filed Aug. 30, 2013; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference.
• This application claims the benefit of and is a continuation-in-part of U.S. Nonprovisional patent application Ser. No. 14/099,888; filed Dec. 6, 2013; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference.
• This application claims the benefit of and is a continuation-in-part of U.S. Nonprovisional patent application Ser. No. 14/142,839; filed Dec. 28, 2013; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference.
• This application claims the benefit of and is a continuation-in-part of U.S. Nonprovisional patent application Ser. No. 14/275,811; filed May 12, 2014; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference. U.S. Nonprovisional patent application Ser. No. 14/275,811 claimed the benefit of U.S. Provisional Patent Application No. 61/859,070; filed Jul. 26, 2013; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference. U.S. Nonprovisional patent application Ser. No. 14/275,811 claimed the benefit of U.S. Nonprovisional patent application Ser. No. 14/098,772; filed Dec. 6, 2013; and entitled DOORBELL COMMUNICATION SYSTEMS AND METHODS; the entire contents of which are incorporated herein by reference.
BACKGROUND
• 1. Field
• Various embodiments disclosed herein relate to doorbells. Certain embodiments relate to doorbell methods to detect visitors.
• 2. Description of Related Art
• Doorbells can enable a person located outside of an entry point, such as a door, to alert a person inside of an entry point that someone outside would like to talk to someone inside. Doorbells sometimes include a button located near a door, such as a front door, side door, or back door of a home, office, dwelling, warehouse, building, or structure. Doorbells are sometimes used near a gate or some other entrance to a partially enclosed area. Pushing the doorbell sometimes causes a chime or other alerting sound to be emitted. In some cases, this alerting sound can typically be heard within a short distance from the entry point or sound source. For example, a homeowner located remotely from her home might not be able to hear the alerting sound, and thus, might not be aware that someone is ringing her doorbell. Thus, there is a need for devices and methods to alert remotely located individuals that someone seeks the attention of the homeowner, tenant, building guardian, or steward.
• In some cases, doorbells should detect the presence of a visitor. Some doorbells, however, may falsely detect the presence of a visitor. Some doorbells may fail to detect a visitor. Thus, there is need for devices and methods that increase the accuracy and/or reliability of doorbells detecting visitors.
SUMMARY
• Methods can include using a doorbell that is configurable to wirelessly communicate with a remotely located computing device, such as a cellular telephone, laptop, tablet, or desktop computer. Some embodiments include obtaining a doorbell that comprises a speaker, a microphone, a camera, and a button. In some embodiments, the camera acts as a motion sensor. A doorbell can include an infrared motion detection system. The button of the doorbell can be configurable to enable a visitor to sound a chime (e.g., a speaker or another sound emission device located inside a building). Some chimes are digital and others are mechanical.
• Several embodiments include using a doorbell system to detect a first visitor. The doorbell system can comprise a doorbell and a remote computing device such as a smartphone, laptop, tablet, or desktop computer. Some embodiments include obtaining the doorbell that comprises a camera, a speaker, a microphone, and a button, wherein the button is configurable to enable the first visitor to sound a chime. Methods can include configuring the camera of the doorbell such that the camera comprises a field of view, and using the camera of the doorbell to take a first image. The doorbell system can send the first image from the doorbell to the remote computing device, which can comprise an electronic display (e.g., a computer screen). Some methods include displaying the first image on the electronic display of the remote computing device and prompting a user of the remote computing device to select a first detection zone within the first image. The first detection zone can comprise a portion of the first image.
• Some embodiments include using the camera of the doorbell to take a second image, analyzing the second image to detect a first indication of the first visitor, and determining that the first indication of the first visitor in the second image is located outside of the first detection zone. The doorbell system can then decide not to send an alert to the remote computing device in response to determining that the first indication of the first visitor in the second image is located outside of the first detection zone. The alert can be configured to notify the remote computing device regarding a presence of the first visitor.
• Analyzing the second image can include determining if there are signs of seeing the visitor in the second image. In some embodiments, the system looks for indications of motion in the image. In several embodiments, the system compares a baseline image (e.g., the first image) to the second image in order to determine if there are areas in the second image that include an object (e.g., a visitor) that was not present in the first image. Thus, some embodiments use computer vision to identify the presence of a visitor within the detection zone.
• Several embodiments include using the camera of the doorbell to take a third image, and analyzing the third image to detect a second indication of the first visitor. Methods can include determining that the second indication of the first visitor in the third image is located inside of the first detection zone, and then sending the alert to the remote computing device in response to determining that the second indication of the first visitor in the third image is located inside of the first detection zone. In some embodiments, the alert is not sent unless other conditions are met.
• Some embodiments include displaying a grid pattern on the first image on the electronic display of the remote computing device such that the first image is divided into at least ten sections by lines that cross each other. The lines can include horizontal and vertical lines that intersect at 90 degree angles. The lines can be straight, curved, and/or wavy. The sections can be equal in size and shape. The sections can be irregular and can vary in size. Methods can include preventing the sending of the alert to the remote computing device until after detecting an indication of a visitor in at least two, four, and/or eight of the sections. Methods can include preventing the sending of the alert to the remote computing device until after detecting an indication of a visitor in at least twenty percent and/or forty percent of the sections.
• Several methods include selecting the first detection zone within the first image by the user touching at least a first subset of the sections on the electronic display of the remote computing device. Touching the first subset causes the first subset to be included in the first detection zone. The electronic display can be a touchscreen of a computer such as a smartphone or tablet. The user of the remote computing device can swipe the touchscreen to select a detection zone. Touching or clicking on each section is not necessary in some embodiments.
• Some methods include causing a second subset of the sections to be included in the first detection zone in response to the first subset comprising an outer perimeter that surrounds the second subset. For example, the user can swipe the touchscreen to form a closed shape. All sections at least partially located within the closed shape can be included in the first detection zone.
• Some embodiments include two, three, four, and/or many detection zones, which can be independent, interdependent, separate, and/or overlapping. Detecting a visitor in a first detection zone can lead to immediately notifying the user of the remote computing device. Detecting a visitor in a second detection zone can include additional safeguards against false-positives.
• Several embodiments include selecting the first detection zone by displaying the first image on the electronic display and then recording which areas of the first image the user indicates to include in the first detection zone by touching the electronic display. Some methods include calculating a percentage of the first detection zone that includes the second indication of the first visitor. The percentage can be a percentage of the area of the detection zone or can be a percentage of the sections. Methods can include sending the alert to the remote computing device in response to determining that the percentage of the detection zone exceeds a first threshold. The first threshold can be 10 percent or 30 percent.
• Some methods include sending a picture of a visitor to the remote computing device, and then waiting to open audio and/or video communication between the visitor and the user of the remote computing device until after determining a percentage of the first detection zone that includes an indication of the third visitor and calculating a time in which the indication of the third visitor has been in the first detection zone. Embodiments can include opening the audio communication between the third visitor and the user of the remote computing device in response to the percentage of the detection zone and the time. The percentage can be at least 10 percent and/or at least 25 percent. The time can be at least one second and/or at least four seconds.
• Indications of the visitor can be motion indications. Motion indications can be identified by comparing a baseline image to another image. The baseline image can be taken when a visitor is not present. Other indications of the visitor can include presence indications (e.g., indications that at least a portion of the visitor is present in the section being analyzed).
• Some embodiments include selecting the first detection zone by displaying the first image on the electronic display and then recording which areas of the first image the user indicates to include in the first detection zone by touching the electronic display. The remote computing device can prompt the user to select areas and/or sections to include in a detection zone. In some embodiments, the remote computing device does not display a grid on the calibration image, but the remote computing device prompts the user to select a portion of the image as the detection zone and/or prompts the user to select a portion of the image to exclude from the detection zone.
• Several embodiments include calculating a percentage of the first detection zone that includes the second indication of the first visitor and/or calculating a time in which the second indication of the first visitor has been in the first detection zone. Methods can include sending the alert to the remote computing device in response to the percentage of the detection zone and the time.
• The images used in several methods do not necessarily include the entire field of view of the camera of the doorbell. In some embodiments, the field of view comprises a portion, and the first image, the second image, and the third image consist of the portion of the field of view. Methods can further comprise selecting the portion of the field of view. In some embodiments, the images include the entire field of view of the camera.
• The portion of the field of view can be consistent between the calibration image and subsequent images to help the system accurately analyze the images. In some methods, the first image, the second image, and the third image consist of at least a portion of the field of view, wherein the method further comprises analyzing the portion of the field of view.
• Although doorbells can be used anywhere, in some embodiments, the camera of the doorbell is configured to record a portion of an entryway, wherein the first image, the second image, and the third image show the portion of the entryway.
• In some embodiments, the doorbell and the remote computing device are not physically coupled. Methods can include wirelessly sending the first image from the doorbell to the remotely located computing device. Some embodiments include sending the first image directly from the doorbell to the remote computing device without an intermediary server. This direct transmission can be via wires or can be wireless. Several embodiments include intermediary servers that enable the doorbell to communicate with the remote computing device via the Internet.
• Methods for using a doorbell system to detect a first visitor can include obtaining the doorbell that comprises a camera and a button. The camera can be configured such that the camera has a field of view. Several embodiments include using the camera of the doorbell to take a first image to calibrate the doorbell system and sending the first image from the doorbell to the remote computing device. Some methods include displaying the first image on the electronic display of the remote computing device. Several embodiments include prompting a user of the remote computing device to select a first detection zone within the first image. The first detection zone can comprise at least a portion of the first image. Methods can include configuring the doorbell system to ignore a second visitor located within the field of view but located outside of the first detection zone. Ignoring the second visitor can include failing to send a notification regarding the second visitor to the remote computing device (e.g., even if the doorbell otherwise responds to the second visitor, for example, by flashing an LED light).
• The system can ignore a visitor by not sending an alert regarding the visitor to the remote computing device. In some embodiments, the system does not send an alert to the remote computing device in response to the presence of the visitor outside the detection zone but inside the field of view of the camera and/or inside the image. Even when the system ignores a visitor, the system can record the visitor for future reference by the user. The user can then request to see visitors who were inside the field of view but not shown via alerts (because they were ignored due to being located outside the detection zone). Thus, the system can ignore the visitor in response to the presence of the visitor outside the detection zone, but the system can later provide information regarding the visitor to the user in response to a user's request. Sending an alert can include sending a push notification to a smartphone.
• Several methods include configuring the doorbell system to send a picture of a third visitor to the remote computing device in response to determining that the third visitor is located inside of the first detection zone as defined based on the first image. The first detection zone can be a two-dimensional zone rather than a three-dimensional area of the physical world. Thus, the detection zone can be decoupled from proximity.
• Some method embodiments include enabling audio and/or video communication between a visitor and the user of the remote computing device in response to detecting at least one indication of the visitor in at least two of the sections and/or in at least ten of the sections. In some embodiments, the sections with the detected indications must be adjacent to each other.
• Some embodiments include selecting the first detection zone within the first image by prompting the user of the remote computing device to indicate a first area by touching the first area on the electronic display of the remote computing device; recording the first area; and excluding the first area from the first detection zone. Methods can include ignoring a visitor in response to the visitor being located in the first area. The user can select areas for exclusion from the detection zone and can select areas for inclusion in the detection zone.
• Doorbells can comprise a motion sensor. Some embodiments include an infrared motion sensor. Methods can comprise ignoring the second visitor in response to disabling the motion sensor during a predetermined time period. The predetermined time period can be during certain hours of the day or night. The time period can be when the user is home or away from home (e.g., where the doorbell is mechanically coupled to the home). As used herein, “home” can include any type of stationary structure configured to shelter people (e.g., an office building).
• Several embodiments include using a doorbell system to detect at least one visitor. Methods can include configuring the camera of the doorbell such that the camera comprises a field of view and using the camera of the doorbell to take a first image to calibrate the doorbell system by establishing a baseline of an entryway. The baseline can be used to define a state without any visitors. Methods can include sending the first image from the doorbell to the remote computing device and displaying the first image on an electronic display of the remote computing device.
• Some methods include prompting a user of the remote computing device to select a first detection zone within the first image. The first detection zone can comprise a portion of the first image. The first detection zone can include a two-dimensional representation of an area in which the doorbell system is configured to respond to motion detection. Several embodiments include displaying a grid pattern on the first image on the electronic display of the remote computing device such that the first image is divided into at least six sections by lines that cross each other. The system can be configured to identify the first detection zone within the first image by the user choosing at least a first subset of the sections on the electronic display of the remote computing device. Choosing the first subset can cause the first subset to be included in the first detection zone.
• Several methods include configuring the doorbell system to ignore a second visitor located within the field of view but located outside of the first detection zone. Some embodiments include configuring the doorbell system to send a picture of a third visitor to the remote computing device in response to at least some of the following factors: (1) determining that the third visitor is located inside of the first detection zone as defined based on the first image, (2) determining that at least a predetermined percentage (e.g., thirty percent) of the first detection zone includes motion or visitors indicators, and (3) determining that the first detection zone has included the indicators for at least a predetermined amount of time (e.g., three seconds).
• Some methods include automatically excluding an area from a detection zone. Automatic exclusion can occur without the user excluding a specific area (even if the user configures settings that later lead to automatic exclusions). In some embodiments, indications indicative of motorized vehicles (e.g., cars, trucks, vans) are automatically excluded from a detection zone. These automatic calibration innovations can take many forms. Several methods include automatically excluding an area from a detection zone in response to detecting an object (e.g., a motorized vehicle) moving through the first detection zone at more than twenty-five miles per hour. Some methods include automatically excluding an area in response to detecting an infrared signal indicative of a motorized vehicle.
• Some embodiments include automatically excluding an area from the first detection zone in response to at least some of the following items: (1) detecting an indication of a visitor in a detection zone; (2) enabling audio communication between the doorbell and the remote computing device in response to detecting the indication of the visitor; and (3) using the doorbell to detect an absence of sound indicative of speaking. The area that is excluded can be the area in which the indication was detected.
BRIEF DESCRIPTION OF THE DRAWINGS
• These and other features, aspects, and advantages are described below with reference to the drawings, which are intended to illustrate, but not to limit, the invention. In the drawings, like reference characters denote corresponding features consistently throughout similar embodiments.
• FIG. 1 illustrates a front view of a communication system, according to some embodiments.
• FIG. 2 illustrates a computing device running software, according to some embodiments.
• FIG. 3 illustrates an embodiment in which a security system is connected to a building, according to some embodiments.
• FIGS. 4 and 5 illustrate diagrammatic views of a camera's field of view, according to some embodiments.
• FIG. 6 illustrates a front view of a remote computing device displaying a grid pattern on an image taken by a camera of a doorbell, according to some embodiments.
• FIG. 7 illustrates a front view of a remote computing device displaying a grid pattern on which sections have been selected to be part of a detection zone, according to some embodiments, according to some embodiments.
• FIG. 8 illustrates a front view of a remote computing device displaying a visitor partially located inside of a detection zone, according to some embodiments.
• FIG. 9 illustrates a diagrammatic view of a doorbell system, according to some embodiments.
DETAILED DESCRIPTION
• Although certain embodiments and examples are disclosed below, inventive subject matter extends beyond the specifically disclosed embodiments to other alternative embodiments and/or uses, and to modifications and equivalents thereof. Thus, the scope of the claims appended hereto is not limited by any of the particular embodiments described below. For example, in any method or process disclosed herein, the acts or operations of the method or process may be performed in any suitable sequence and are not necessarily limited to any particular disclosed sequence. Various operations may be described as multiple discrete operations in turn, in a manner that may be helpful in understanding certain embodiments; however, the order of description should not be construed to imply that these operations are order dependent. Additionally, the structures, systems, and/or devices described herein may be embodied as integrated components or as separate components.
• For purposes of comparing various embodiments, certain aspects and advantages of these embodiments are described. Not necessarily all such aspects or advantages are achieved by any particular embodiment. Thus, for example, various embodiments may be carried out in a manner that achieves or optimizes one advantage or group of advantages as taught herein without necessarily achieving other aspects or advantages as may also be taught or suggested herein.
• Doorbell systems can include a doorbell, a remote computing device, and a means of communication between the doorbell and the remote computing device. The means of communication can include the Internet, a wireless network, and/or a server. In some embodiments, the doorbell communicates with the remote computing device without using a server.
• Doorbells can include a means of visitor detection. For example, the doorbell can use a motion sensor. In some embodiments, the camera of the doorbell can be used to detect visitors by comparing a baseline image to a second image taken when the visitor is present.
• False positives can be problematic. Thus, some embodiments include defining at least one detection zone within the field of view (FOV) of the camera. The doorbell system can be configured such that areas outside of the detection zones will not trigger sending a notification to a user of a remote computing device.
• The detection zones can be created using many different methods. In some methods, a picture taken by the camera of the doorbell is displayed on the remote computing device. The picture is divided into sections by a grid. The user can select which areas of the grid should be included in the detection zones.
• FIG. 1 illustrates a security system202 (e.g., a doorbell) that includes acamera assembly208 and amotion detector218. When a visitor approaches the security system202 (e.g., rings a doorbell button212), thesecurity system202 can send a wireless notification to acomputing device204 that is located remotely relative to thesecurity system202.
System Embodiments
• Communication systems can provide a secure and convenient way for a remotely located individual to communicate with a person who is approaching a sensor, such as a proximity sensor or motion sensor, or with a person who rings a doorbell, which can be located in a doorway, near an entrance, or within 15 feet of a door. Some communication systems allow an individual to hear, see, and talk with visitors who approach at least a portion of the communication system and/or press a button, such as a doorbell's button. For example, communication systems can use a computing device to enable a remotely located person to see, hear, and/or talk with visitors. Computing devices can include computers, laptops, tablets, mobile devices, smartphones, cellular phones, and wireless devices (e.g., cars with wireless communication). Example computing devices include the iPhone, iPad, iMac, MacBook Air, and MacBook Pro made by Apple Inc. Communication between a remotely located person and a visitor can occur via the Internet, cellular networks, telecommunication networks, and wireless networks.
• Referring now toFIG. 1, communication systems can be a portion of a smart home hub. In some embodiments, thecommunication system200 forms the core of the smart home hub. For example, the various systems described herein enable complete home automation. In some embodiments, thesecurity system202 controls various electrical items in a home (e.g., lights, air conditioners, heaters, motion sensors, garage door openers, locks, televisions, computers, entertainment systems, pool monitors, elderly monitors). In some embodiments, thecomputing device204 controls thesecurity system202 and other electrical items in a home (e.g., lights, air conditioners, heaters, motion sensors, garage door openers, locks, televisions, computers, entertainment systems, pool monitors, elderly monitors).
• FIG. 1 illustrates a front view of a communication system embodiment. Thecommunication system200 can include a security system202 (e.g., a doorbell) and acomputing device204. Although the illustratedsecurity system202 includes many components in one housing, several security system embodiments include components in separate housings. Thesecurity system202 can include acamera assembly208 and adoorbell button212. Thecamera assembly208 can include a video camera, which in some embodiments is a webcam. Thesecurity system202 can include adiagnostic light216 and apower indicator light220. In some embodiments, thediagnostic light216 is a first color (e.g., blue) if thesecurity system202 and/or thecommunication system200 is connected to a wireless Internet network and is a second color (e.g., red) if thesecurity system202 and/or thecommunication system200 is not connected to a wireless Internet network. In some embodiments, thepower indicator220 is a first color if thesecurity system202 is connected to a power source. The power source can be power supplied by the building to which thesecurity system202 is attached. In some embodiments, thepower indicator220 is a second color or does not emit light if thesecurity system202 is not connected to the power source.
• The security system202 (e.g., a doorbell) can include an outer housing224, which can be water resistant and/or waterproof. The outer housing can be made from metal or plastic, such as molded plastic with a hardness of 60 Shore D. In some embodiments, the outer housing224 is made from brushed nickel or aluminum.
• Rubber seals can be used to make the outer housing224 water resistant or waterproof. Thesecurity system202 can be electrically coupled to a power source, such as wires electrically connected to a building's electrical power system. In some embodiments, thesecurity system202 includes a battery for backup and/or primary power.
• Wireless communication230 can enable the security system202 (e.g., a doorbell) to communicate with thecomputing device204. Some embodiments enable communication via cellular and/or WiFi networks. Some embodiments enable communication via the Internet. Several embodiments enable wired communication between thesecurity system202 and thecomputing device204. Thewireless communication230 can include the following communication means: radio, WiFi (e.g., wireless local area network), cellular, Internet, Bluetooth, telecommunication, electromagnetic, infrared, light, sonic, and microwave. Other communication means are used by some embodiments. In some embodiments, such as embodiments that include telecommunication or cellular communication means, thesecurity system202 can initiate voice calls or send text messages to a computing device204 (e.g., a smartphone, a desktop computer, a tablet computer, a laptop computer).
• Several embodiments use near field communication (NFC) to communicate between thecomputing device204 and thesecurity system202; between thesecurity system202 and thedoor lock250; and/or between thecomputing device204 and thedoor lock250. Thesecurity system208, thecomputing device204, and/or thedoor lock250 can include a NFC tag. Some NFC technologies include Bluetooth, radio-frequency identification, and QR codes.
• Some embodiments include computer software (e.g., application software), which can be a mobile application designed to run on smartphones, tablet computers, and other mobile devices. Software of this nature is sometimes referred to as “app” software. Some embodiments include software designed to run on desktop computers and laptop computers.
• Thecomputing device204 can run software with a graphical user interface. The user interface can include icons or buttons. In some embodiments, the software is configured for use with a touch-screen computing device such as a smartphone or tablet.
• FIG. 2 illustrates acomputing device204 running software. The software includes a user interface240 displayed on adisplay screen242. The user interface240 can include asecurity system indicator244, which can indicate the location of the security system that the user interface is displaying. For example, a person can use onecomputing device204 to control and/or interact with multiple security systems, such as one security system located at a front door and another security system located at a back door. Selecting thesecurity system indicator244 can allow the user to choose another security system (e.g., the back door security system rather than the front door security system).
• The user interface240 can include aconnectivity indicator248. In some embodiments, the connectivity indicator can indicate whether the computing device is in communication with a security system, the Internet, and/or a cellular network. Theconnectivity indicator248 can alert the user if thecomputing device204 has lost its connection with thesecurity system202; thesecurity system202 has been damaged; thesecurity system202 has been stolen; thesecurity system202 has been removed from its mounting location; thesecurity system202 lost electrical power; and/or if thecomputing device204 cannot communicate with thesecurity system202. In some embodiments, theconnectivity indicator248 alerts the user of thecomputing device204 by flashing, emitting a sound, displaying a message, and/or displaying a symbol.
• In some embodiments, if thesecurity system202 loses power, loses connectivity to thecomputing device204, loses connectivity to the Internet, and/or loses connectivity to a remote server, aremote server206 sends an alert (e.g., phone call, text message, image on the user interface240) regarding the power and/or connectivity issue. In several embodiments, theremote server206 can manage communication between thesecurity system202 and the computing device. In some embodiments, information from thesecurity system202 is stored by theremote server206. In several embodiments, information from thesecurity system202 is stored by theremote server206 until the information can be sent to thecomputing device204, uploaded to thecomputing device204, and/or displayed to the remotely located person via thecomputing device204. Theremote server206 can be a computing device that stores information from thesecurity system202 and/or from thecomputing device204. In some embodiments, theremote server206 is located in a data center.
• In some embodiments, thecomputing device204 and/or theremote server206 attempts to communicate with thesecurity system202. If thecomputing device204 and/or theremote server206 is unable to communicate with thesecurity system202, thecomputing device204 and/or theremote server206 alerts the remotely located person via the software, phone, text, a displayed message, and/or a website. In some embodiments, thecomputing device204 and/or theremote server206 attempts to communicate with thesecurity system202 periodically; at least every five hours and/or less than every 10 minutes; at least every 24 hours and/or less than every 60 minutes; or at least every hour and/or less than every second.
• In some embodiments, theserver206 can initiate communication to thecomputer device204 and/or to thesecurity system202. In several embodiments, theserver206 can initiate, control, and/or block communication between thecomputing device204 and thesecurity system202.
• In several embodiments, a user can log into an “app,” website, and/or software on a computing device (e.g., mobile computing device, smartphone, tablet, desktop computer) to adjust the security system settings discussed herein.
• In some embodiments, a computing device can enable a user to watch live video and/or hear live audio from a security system due to the user's request rather than due to actions of a visitor. Some embodiments include a computing device initiating a live video feed (or a video feed that is less than five minutes old).
• In some embodiments, the user interface240 displays animage252 such as a still image or a video of an area near and/or in front of thesecurity system202. Theimage252 can be taken by thecamera assembly208 and stored by thesecurity system202,server206, and/orcomputing device204. The user interface240 can include arecording button256 to enable a user to record images, videos, and/or sound from thecamera assembly208, microphone of thesecurity system202, and/or microphone of thecomputing device204.
• In several embodiments, the user interface240 includes apicture button260 to allow the user to take still pictures and/or videos of the area near and/or in front of thesecurity system202. The user interface240 can also include a sound adjustment button264 and amute button268. The user interface240 can include camera manipulation buttons such as zoom, pan, and light adjustment buttons. In some embodiments, thecamera assembly208 automatically adjusts between Day Mode and Night Mode. Some embodiments include an infrared camera and/or infrared lights to illuminate an area near thesecurity system202 to enable thecamera assembly208 to provide sufficient visibility (even at night).
• In some embodiments, buttons include diverse means of selecting various options, features, and functions. Buttons can be selected by mouse clicks, keyboard commands, and touching a touch screen. Many embodiments include buttons that can be selected without touch screens.
• In some embodiments, the user interface240 includes a quality selection button, which can allow a user to select the quality and/or amount of the data transmitted from thesecurity system202 to thecomputing device204 and/or from thecomputing device204 to thesecurity system202.
• In some embodiments, video can be sent to and/or received from thecomputing device204 using video chat protocols such as FaceTime (by Apple Inc.) or Skype (by Microsoft Corporation). In some embodiments, these videos are played by videoconferencing apps on thecomputing device204 instead of being played by the user interface240.
• The user interface240 can include a termination button276 to end communication between thesecurity system202 and thecomputing device204. In some embodiments, the termination button276 ends the ability of the person located near the security system202 (i.e., the visitor) to hear and/or see the user of thecomputing device204, but does not end the ability of the user of thecomputing device204 to hear and/or see the person located near thesecurity system202.
• In some embodiments, a button276 is both an answer button (to accept a communication request from a visitor) and is a termination button (to end communication between thesecurity system202 and the computing device204). The button276 can include the word “Answer” when the system is attempting to establish two-way communication between the visitor and the user. Selecting the button276 when the system is attempting to establish two-way communication between the visitor and the user can start two-way communication. The button276 can include the words “End Call” during two-way communication between the visitor and the user. Selecting the button276 during two-way communication between the visitor and the user can terminate two-way communication. In some embodiments, terminating two-way communication still enables the user to see and hear the visitor. In some embodiments, terminating two-way communication causes thecomputing device204 to stop showing video from the security system and to stop emitting sounds recorded by the security system.
• In some embodiments, the user interface240 opens as soon as the security system detects a visitor (e.g., senses indications of a visitor). Once the user interface240 opens, the user can see and/or hear the visitor even before “answering” or otherwise accepting two-way communication, in several embodiments.
• Some method embodiments include detecting a visitor with a security system. The methods can include causing the user interface to display on aremote computing device204 due to the detection of the visitor (e.g., with or without user interaction). The methods can include displaying video from the security system and/or audio from the security system before the user accepts two-way communication with the visitor. The methods can include displaying video from the security system and/or audio from the security system before the user accepts the visitor's communication request. The methods can include the computing device simultaneously asking the user if the user wants to accept (e.g., answer) the communication request and displaying audio and/or video of the visitor. For example, in some embodiments, the user can see and hear the visitor via the security system before opening a means of two-way communication with the visitor.
• In some embodiments, the software includes means to start the video feed on demand. For example, a user of the computing device might wonder what is happening near thesecurity system202. The user can open the software application on thecomputing device204 and instruct the application to show live video and/or audio from thesecurity device202 even if no event near thesecurity system202 has triggered the communication.
• In several embodiments, thesecurity device202 can be configured to record when thesecurity device202 detects movement and/or the presence of a person. The user of thecomputing device204 can later review all video and/or audio records when thesecurity device202 detected movement and/or the presence of a person.
• Referring now toFIG. 1, in some embodiments, theserver206 controls communication between thecomputing device204 and thesecurity system202, which can be a doorbell with a camera, a microphone, and a speaker. In several embodiments, theserver206 does not control communication between thecomputing device204 and thesecurity system202.
• In some embodiments, data captured by the security system and/or the computing device204 (such as videos, pictures, and audio) is stored by another remote device such as theserver206. Cloud storage, enterprise storage, and/or networked enterprise storage can be used to store video, pictures, and/or audio from thecommunication system200 or from any part of thecommunication system200. The user can download and/or stream stored data and/or storage video, pictures, and/or audio. For example, a user can record visitors for a year and then later can review conversations with visitors from the last year. In some embodiments, remote storage, theserver206, thecomputing device204, and/or thesecurity system202 can store information and statistics regarding visitors and usage.
• FIG. 3 illustrates an embodiment in which asecurity system202 is connected to abuilding300, which can include anentryway310 that has adoor254. Adoor lock250 can be configured to lock and unlock thedoor254.Electrical wires304 can electrically couple thesecurity system202 to the electrical system of thebuilding300 such that thesecurity system202 can receive electrical power from thebuilding300.
• Awireless network308 can allow devices to wirelessly access the Internet. Thesecurity system202 can access the Internet via thewireless network308. Thewireless network308 can transmit data from thesecurity system202 to the Internet, which can transmit the data to remotely located computingdevices204. The Internet and wireless networks can transmit data from remotely located computingdevices204 to thesecurity system202. In some embodiments, asecurity system202 connects to a home's WiFi.
• As illustrated inFIG. 3, one computing device204 (e.g., a laptop, a smartphone, a mobile computing device, a television) can communicate withmultiple security systems202. In some embodiments,multiple computing devices204 can communicate with onesecurity system202.
• In some embodiments, thesecurity system202 can communicate (e.g., wirelessly230) with atelevision306, which can be a smart television. Users can view thetelevision306 to see a visitor and/or talk with the visitor.
• As used herein, an “electronic device” is capable of displaying images, including videos. An electronic device consumes electrical power and is capable of running software. As used herein, the term “electronic device” should not be confused with the term “electronic key.” Many electronic key embodiments are not capable of displaying images, consuming electrical power, or running software.
Visitor Detection
• Referring now toFIGS. 1 and 3, methods can include using a doorbell (e.g., security system202) that is configurable to wirelessly communicate with a remotely locatedcomputing device204, such as a cellular telephone, laptop, or tablet. Some embodiments include obtaining a doorbell that comprises a speaker, a microphone, a camera, and a button. In some embodiments, the camera acts as a motion sensor. A doorbell can include an infrared motion detection system (e.g., motion detector218). Thebutton212 of the doorbell can be configurable to enable a visitor to sound a chime302 (e.g., a speaker or another sound emission device located inside of a building). Some chimes are digital and some chimes are mechanical.
• Several embodiments include using a doorbell system (e.g., communication system200) to detect a first visitor. The doorbell system can comprise a doorbell and aremote computing device204 such as a smartphone, laptop, tablet, or desktop computer. Some embodiments include obtaining the doorbell that comprises a camera, a speaker, a microphone, and a button, wherein the button is configurable to enable the first visitor to sound a chime.
• FIG. 4 illustrates a camera's field ofview840. Methods can include configuring the camera of the doorbell such that the camera comprises a field ofview840, and using the camera of the doorbell to take afirst image842. The doorbell system can send thefirst image842 from the doorbell to the remote computing device, which can comprise an electronic display242 (shown inFIG. 2). Some methods include displaying thefirst image842 on theelectronic display242 of the remote computing device, and prompting a user of the remote computing device to select afirst detection zone846 within thefirst image842. Thefirst detection zone846 can comprise a portion of thefirst image842. Thefirst image842 can comprise all or a portion of the camera's field ofview840.
• InFIG. 4, thevisitor844 is located inside of thedetection zone846. Anindication850 of thevisitor844 is also located inside of thedetection zone846. Theindication850 can be any evidence or data that suggests the presence of thevisitor844. InFIG. 5, thevisitor844 and theindication850 are located outside of thedetection zone846 in asecond image846. The first image842 (shown inFIG. 4) and thesecond image846 can show the same area (e.g., can include the same portion of the field of view840). Thedetection zone846 can consist of the same area (e.g., of an entryway) in both thefirst image842 and thesecond image846. In some embodiments, thefirst image842 does not include avisitor844 to help calibrate the system to a visitor-free state.
• Some embodiments include using the camera of the doorbell to take a second image, analyzing the second image to detect a first indication of the first visitor, and determining that the first indication of the first visitor in the second image is located outside of the first detection zone. The doorbell system can then decide to not send an alert232 (shown inFIG. 1) to the remote computing device in response to determining that the first indication of the first visitor in the second image is located outside of the first detection zone. The alert232 can be configured to notify the remote computing device204 (shown inFIG. 1) regarding a presence of the first visitor.
• Analyzing the second image can include determining if there are signs of seeing the visitor in the second image. In some embodiments, the system looks for indications of motion in the image. In several embodiments, the system compares a baseline image (e.g., the first image) to the second image in order to determine if there are areas in the second image that include an object (e.g., a visitor) that was not present in the first image. Thus, some embodiments use computer vision to identify the presence of a visitor within the detection zone.
• Several embodiments include using the camera of the doorbell to take a third image and analyzing the third image to detect a second indication of the first visitor. Methods can include determining that the second indication of the first visitor in the third image is located inside of the first detection zone, and then sending the alert to the remote computing device in response to determining that the second indication of the first visitor in the third image is located inside of the first detection zone. In some embodiments, the alert is not sent unless other conditions are met.
• FIG. 6 illustrates a front view of aremote computing device204 displaying agrid pattern254 on animage842. Some embodiments include displaying agrid pattern254 on thefirst image842 on theelectronic display242 of theremote computing device204 such that thefirst image842 is divided intosections528 bylines532 that cross each other. (Not allsections528 andlines532 are labeled inFIGS. 6-9 to increase the clarity of various features.)
• Thelines532 can include horizontal lines and vertical lines that intersect at 90 degree angles. The lines can be straight, curved, and/or wavy. The sections can be equal in size and shape. The sections can be irregular and can vary in size. Methods can include preventing the sending of the alert to the remote computing device until after detecting an indication of a visitor in at least two, four, and/or eight of the sections. Methods can include preventing the sending of the alert to the remote computing device until after detecting an indication of a visitor in at least twenty percent and/or forty percent of the sections (e.g., of a detection zone).
• FIG. 7 illustrates asubset538 of thesections528 that have been selected as part of a detection zone. Several methods include selecting the first detection zone within thefirst image842 by the user touching at least afirst subset538 of thesections528 on theelectronic display242 of theremote computing device204. Touching thefirst subset538 can cause thefirst subset538 to be included in the first detection zone. Theelectronic display242 can be a touchscreen of a computer such as a smartphone, tablet, or laptop. The user of theremote computing device204 can swipe the touchscreen to select a detection zone.
• Touching or clicking on each section is not necessary in some embodiments. Some methods include causing asecond subset542 of the sections to be included in the first detection zone in response to thefirst subset538 comprising an outer perimeter that surrounds thesecond subset542. For example, the user can swipe the touchscreen to form a closed shape. All sections at least partially located within the closed shape can be included in the first detection zone.
• Some embodiments include two, three, four, and/or many detection zones, which can be independent, interdependent, separate, and/or overlapping. Detecting a visitor in a first detection zone can lead to immediately notifying the user of the remote computing device. Detecting a visitor in a second detection zone can include additional safeguards against false-positives.
• Several embodiments include selecting the first detection zone by displaying the first image on the electronic display and then recording which areas (e.g., sections528) of the first image the user indicates to include in the first detection zone by touching the electronic display. Some methods include calculating a percentage of the first detection zone that includes the second indication of the first visitor. The percentage can be a percentage of the area of the detection zone or can be a percentage of the sections. Methods can include sending the alert to the remote computing device in response to determining that the percentage of the detection zone exceeds a first threshold. The first threshold can be 10 percent or 30 percent.
• Some methods include sending a picture of a visitor to the remote computing device, and then waiting to open audio and/or video communication between the visitor and the user of the remote computing device until after determining a percentage of the first detection zone that includes an indication of the visitor and calculating a time in which the indication of the visitor has been in the first detection zone. Embodiments can include opening the audio communication between the visitor and the user of the remote computing device in response to the percentage of the detection zone and the time. The percentage can be at least 10 percent and/or at least 25 percent. The time can be at least one second and/or at least four seconds.
• Indications of the visitor can be motions indications. Motion indications can be identified by comparing a baseline image to another image. The baseline image can be taken when a visitor is not present. Other indications of the visitor can include presence indications (e.g., indications that at least a portion of the visitor is present in the section being analyzed).
• Some embodiments include selecting the first detection zone by displaying the first image on the electronic display and then recording which areas of the first image the user indicates to include in the first detection zone by touching the electronic display. The remote computing device can prompt the user to select areas and/or sections to include in a detection zone. In some embodiments, the remote computing device does not display a grid on the calibration image, but the remote computing device prompts the user to select a portion of the image as the detection zone and/or prompts the user to select a portion of the image to exclude from the detection zone.
• Several embodiments include calculating a percentage of the first detection zone that includes the second indication of the first visitor and/or calculating a time in which the second indication of the first visitor has been in the first detection zone. Methods can include sending the alert to the remote computing device in response to the percentage of the detection zone and the time.
• The images used in several methods do not necessarily include the entire field of view of the camera of the doorbell. In some embodiments, the field of view comprises a portion, and the first image, the second image, and the third image consist of the portion of the field of view. Methods can further comprise selecting the portion of the field of view. In some embodiments, the images include the entire field of view of the camera.
• The portion of the field of view can be consistent between the calibration image and subsequent images to help the system accurately analyze the images. In some methods, the first image, the second image, and the third image consist of at least a portion of the field of view, wherein the method further comprises analyzing the portion of the field of view.
• Referring now ToFIG. 3, although doorbells can be used anywhere, in some embodiments, the camera of the doorbell is configured to record a portion of anentryway310, wherein the first image, the second image, and the third image show the portion of theentryway310.
• In some embodiments, the doorbell (e.g.,202) and theremote computing device204 are not physically coupled. Methods can include wirelessly sending the first image from the doorbell to the remotely located computing device. Some embodiments include sending the first image directly from the doorbell to the remote computing device without an intermediary server (e.g.,206 inFIG. 1). This direct transmission can be via wires or can be wireless. Several embodiments include intermediary servers that enable the doorbell to communicate with the remote computing device via the Internet.
• FIG. 8 illustrates avisitor844 in asecond image852. The visitor is partially in the detection zone846 (which was explained in the context ofFIG. 7). Thedetection zone846 was defined by selecting thesubsets538,542 inFIG. 7. By analyzing thedetection zone846, the system can detect indications of thevisitor844. The system can ignore visitor indications located outside of thedetection zone846. Visitor indications can include motion and/or infrared signatures indicative of humans. In some embodiments, the system analyzes an image to identify shapes indicative of humans.
• Methods for using a doorbell system to detect a first visitor can include obtaining the doorbell that comprises a camera and a button. The camera can be configured such that the camera has a field of view. Several embodiments include using the camera of the doorbell to take a first image to calibrate the doorbell system and sending the first image from the doorbell to the remote computing device. Some methods include displaying the first image on the electronic display of the remote computing device. Several embodiments include prompting a user of the remote computing device to select a first detection zone within the first image. The first detection zone can comprise at least a portion of the first image. Methods can include configuring the doorbell system to ignore a second visitor located within the field of view but located outside of the first detection zone.
• The system can ignore a visitor by not sending an alert regarding the visitor to the remote computing device. In some embodiments, the system does not send an alert to the remote computing device in response to the presence of the visitor outside of the detection zone but inside of the field of view of the camera and/or inside of the image. Even when the system ignores a visitor, the system can record the visitor for future reference by the user. The user can then request to see visitors who were inside of the field of view but not shown via alerts (because they were ignored due to being located outside of the detection zone). Thus, the system can ignore the visitor in response to the presence of the visitor outside of the detection zone, but the system can later provide information regarding the visitor to the user in response to a user's request. Sending an alert can include sending a push notification to a smartphone.
• Several methods include configuring the doorbell system to send a picture of a third visitor to the remote computing device in response to determining that the third visitor is located inside of the first detection zone as defined based on the first image. The first detection zone can be a two-dimensional zone rather than a three dimensional area of the physical world. Thus, the detection zone can be decoupled from proximity.
• Some method embodiments include enabling audio and/or video communication between a visitor and the user of the remote computing device in response to detecting at least one indication of the visitor in at least two of the sections and/or in at least ten of the sections. In some embodiments, the sections with the detected indications must be adjacent to each other.
• Some embodiments include selecting the first detection zone within the first image by prompting the user of the remote computing device to indicate a first area by touching the first area on the electronic display of the remote computing device; recording the first area; and excluding the first area from the first detection zone. Methods can include ignoring a visitor in response to the visitor being located in the first area.
• Doorbells can comprise a motion sensor. Some embodiments include an infrared motion sensor. Methods can comprise ignoring the second visitor in response to disabling the motion sensor during a predetermined time period. The predetermined time period can be during certain hours of the day or night. The time period can be when the user is home or away from home (e.g., where the doorbell is mechanically coupled to the home). As used herein, “home” can include any type of stationary structure configured to shelter people (e.g., an office building).
• Several embodiments include using a doorbell system to detect at least one visitor. Methods can include configuring the camera of the doorbell such that the camera comprises a field of view and using the camera of the doorbell to take a first image to calibrate the doorbell system by establishing a baseline of an entryway. The baseline can be used to define a state without any visitors. Methods can include sending the first image from the doorbell to the remote computing device and displaying the first image on an electronic display of the remote computing device.
• Some methods include prompting a user of the remote computing device to select a first detection zone within the first image. The first detection zone can comprise a portion of the first image. The first detection zone can include a two-dimensional representation of an area in which the doorbell system is configured to respond to motion detection. Several embodiments include displaying a grid pattern on the first image on the electronic display of the remote computing device such that the first image is divided into at least ten sections by lines that cross each other. The system can be configured to identify the first detection zone within the first image by the user choosing at least a first subset of the sections on the electronic display of the remote computing device. Choosing the first subset can cause the first subset to be included in the first detection zone.
• Several methods include configuring the doorbell system to ignore a second visitor located within the field of view but located outside of the first detection zone. Some embodiments include configuring the doorbell system to send a picture of a third visitor to the remote computing device in response to at least some of the following factors: (1) determining that the third visitor is located inside of the first detection zone as defined based on the first image, (2) determining that at least a predetermined percentage (e.g., thirty percent) of the first detection zone includes motion indicators, and (3) determining that the first detection zone has included the motion indicators for at least a predetermined amount of time (e.g., three seconds).
• Some methods include automatically excluding an area from a detection zone. Automatic exclusion can occur without the user excluding a specific area (even if the user configures settings that later lead to automatic exclusions). In some embodiments, indications indicative of motorized vehicles (e.g., cars, trucks, vans) are automatically excluded from a detection zone. These automatic calibration innovations can take many forms. Several methods include automatically excluding an area from a detection zone in response to detecting an object (e.g., a motorized vehicle) moving through the first detection zone at more than twenty-five miles per hour. Some methods include automatically excluding an area in response to detecting an infrared signal indicative of a motorized vehicle.
• Some embodiments include automatically excluding an area from the first detection zone in response to at least some of the following items: (1) detecting an indication of a visitor in a detection zone; (2) enabling audio communication between the doorbell and the remote computing device in response to detecting the indication of the visitor; and (3) using the doorbell to detect an absence of sound indicative of speaking. The area that is excluded can be the area in which the indication was detected.
• FIG. 9 illustrates adoorbell system528 that comprises a doorbell506 (e.g., security system202) and aremote computing device204. Thedoorbell506 has acamera assembly208 and adoorbell button212. Pressing thebutton212 can cause the chime302 (shown inFIG. 3) to sound (e.g., emit a “ding-dong” sound or another notification sound).
• Thecamera assembly208 is configured such that it has a field ofview840. Thecamera assembly208 can be positioned such that the field ofview840 shows an entryway878 (as illustrated inFIG. 9). Thecamera assembly208 can take afirst image862, which can be all or part of the field ofview840. As used herein, phrases such as “take an image” are used in a very broad sense. A picture can be taken and then recorded on any of the items listed herein. Taking a picture can mean that a camera was used as at least one of several items used to capture an image. Taking a picture can be part of taking a video. Thus, an item that takes a video also takes a picture. The camera can be a digital video camera.
• Thedoorbell system528 can send thefirst image862 to aremote computing device204. Theremote computing device204 can display thefirst image862 on anelectronic display242. Theremote computing device204 can prompt a user (of the remote computing device204) to select at least onedetection zone846 within thefirst image862. As illustrated inFIG. 9, thedetection zone846 is a portion of thefirst image862. Multiple detection zones can overlap or can be separate.
• Thedoorbell system528 can send data regarding the selecteddetection zone846 from theremote computing device204 to thedoorbell506. Thedoorbell506 can then focus on looking for visitors within thedetection zone846 and/or can ignore indications that are suggestive of a visitor if the indications are located outside of thedetection zone846.
• In some embodiments, a computer (e.g.,server206 orcomputing device204 inFIG. 1) that is located remotely from the doorbell506 analyzes each image. Thus, the computer can apply thedetection zone846 to analyses of images from the doorbell506 such that thedoorbell506 does not have to receive data regarding thedetection zone846. In some embodiments, thedoorbell506 sends an alert regarding a visitor to theremote computing device204, but then the computing device204 (and/or theserver206 inFIG. 1) blocks displaying the alert because the alert is from a visitor indication that was outside of thedetection zone846.
• Thecamera assembly208 can be used to take asecond image870. Thedetection zone846 selected from thefirst image862 can be positioned on thesecond image870 such that thedetection zone846 represents the same area in front of thecamera assembly208 in both thefirst image862 and thesecond image870. For example, thedetection zone846 can focus a visitor detection analysis on the same portion of an entryway in images taken by the camera assembly subsequent to thecamera assembly208 taking thefirst image862.
• Thedoorbell system528 can analyze thedetection zone846 of thesecond image870. Thedoorbell system528 can be used to analyze thesecond image870 to determine whether a first indication of thevisitor844 is located inside of thedetection zone846. InFIG. 9, thedoorbell system528 determines that a first indication of thevisitor844 is located outside of the detection zone846 (because thevisitor844 is located outside of thedetection zone846 in the second image870). Then, thedoorbell system528 can decide to not send an alert and/or can block sending an alert to theremote computing device204 in response to determining that the first indication of thevisitor844 is located outside of thedetection zone846.
• Thedoorbell system528 can be configured to notify theremote computing device204 regarding a presence of thevisitor844 by sending an alert (e.g., a push notification) to theremote computing device204.FIG. 9 illustrates the doorbell506 sending an alert232 to theremote computing device204. The alert232 can be sent directly from the doorbell506 to theremote computing device204. In some embodiments, the alert232 is sent directly and wirelessly. In some embodiments, the alert232 is sent via a server and/or via the Internet.
• After thesecond image870 was taken, thevisitor844 moved into thedetection zone846. Thevisitor844 is located at least partially inside thedetection zone846 in thethird image874. Thedoorbell system528 can analyze thethird image874 to detect an indication of thevisitor844. Thedoorbell system528 can determine that an indication of thevisitor844 is located inside thedetection zone846.
Interpretation
• None of the steps described herein is essential or indispensable. Any of the steps can be adjusted or modified. Other or additional steps can be used. Any portion of any of the steps, processes, structures, and/or devices disclosed or illustrated in one embodiment, flowchart, or example in this specification can be combined or used with or instead of any other portion of any of the steps, processes, structures, and/or devices disclosed or illustrated in a different embodiment, flowchart, or example. The embodiments and examples provided herein are not intended to be discrete and separate from each other.
• The section headings and subheadings provided herein are nonlimiting. The section headings and subheadings do not represent or limit the full scope of the embodiments described in the sections to which the headings and subheadings pertain. For example, a section titled “Topic 1” may include embodiments that do not pertain to Topic 1 and embodiments described in other sections may apply to and be combined with embodiments described within the “Topic 1” section.
• Some of the devices, systems, embodiments, and processes use computers. Each of the routines, processes, methods, and algorithms described in the preceding sections may be embodied in, and fully or partially automated by, code modules executed by one or more computers, computer processors, or machines configured to execute computer instructions. The code modules may be stored on any type of non-transitory computer-readable storage medium or tangible computer storage device, such as hard drives, solid state memory, flash memory, optical disc, and/or the like. The processes and algorithms may be implemented partially or wholly in application-specific circuitry. The results of the disclosed processes and process steps may be stored, persistently or otherwise, in any type of non-transitory computer storage such as, e.g., volatile or non-volatile storage.
• The various features and processes described above may be used independently of one another, or may be combined in various ways. All possible combinations and subcombinations are intended to fall within the scope of this disclosure. In addition, certain method, event, state, or process blocks may be omitted in some implementations. The methods, steps, and processes described herein are also not limited to any particular sequence, and the blocks, steps, or states relating thereto can be performed in other sequences that are appropriate. For example, described tasks or events may be performed in an order other than the order specifically disclosed. Multiple steps may be combined in a single block or state. The example tasks or events may be performed in serial, in parallel, or in some other manner. Tasks or events may be added to or removed from the disclosed example embodiments. The example systems and components described herein may be configured differently than described. For example, elements may be added to, removed from, or rearranged compared to the disclosed example embodiments.
• Conditional language used herein, such as, among others, “can,” “could,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment. The terms “comprising,” “including,” “having,” and the like are synonymous and are used inclusively, in an open-ended fashion, and do not exclude additional elements, features, acts, operations and so forth. Also, the term “or” is used in its inclusive sense (and not in its exclusive sense) so that when used, for example, to connect a list of elements, the term “or” means one, some, or all of the elements in the list. Conjunctive language such as the phrase “at least one of X, Y, and Z,” unless specifically stated otherwise, is otherwise understood with the context as used in general to convey that an item, term, etc. may be either X, Y, or Z. Thus, such conjunctive language is not generally intended to imply that certain embodiments require at least one of X, at least one of Y, and at least one of Z to each be present.
• The term “and/or” means that “and” applies to some embodiments and “or” applies to some embodiments. Thus, A, B, and/or C can be replaced with A, B, and C written in one sentence and A, B, or C written in another sentence. A, B, and/or C means that some embodiments can include A and B, some embodiments can include A and C, some embodiments can include B and C, some embodiments can only include A, some embodiments can include only B, some embodiments can include only C, and some embodiments can include A, B, and C. The term “and/or” is used to avoid unnecessary redundancy.
• While certain example embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions disclosed herein. Thus, nothing in the foregoing description is intended to imply that any particular feature, characteristic, step, module, or block is necessary or indispensable. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions, and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions disclosed herein.

Claims (29)

1. A method for using a doorbell system to detect a first visitor, wherein the doorbell system comprises a doorbell and a remote computing device, the method comprising:

obtaining the doorbell that comprises a camera and a button, wherein the button is configurable to enable the first visitor to sound a chime;

configuring the camera of the doorbell such that the camera comprises a field of view;

using the camera of the doorbell to take a first image;

sending the first image from the doorbell to the remote computing device, wherein the remote computing device comprises an electronic display;

displaying the first image on the electronic display of the remote computing device;

prompting a user of the remote computing device to select a first detection zone within the first image, wherein the first detection zone comprises a portion of the first image;

displaying a grid pattern on the first image on the electronic display of the remote computing device such that the first image is divided into at least six sections by lines that cross each other;

selecting the first detection zone within the first image by the user touching at least a first subset of the sections on the electronic display of the remote computing device, wherein touching the first subset causes the first subset to be included in the first detection zone;

using the camera of the doorbell to take a second image;

analyzing the second image to detect a first indication of the first visitor and determining that the first indication of the first visitor in the second image is located outside of the first detection zone, and then the doorbell system deciding to not send an alert to the remote computing device in response to determining that the first indication of the first visitor in the second image is located outside of the first detection zone, wherein the alert is configured to notify the remote computing device regarding a presence of the first visitor;

using the camera of the doorbell to take a third image;

analyzing the third image to detect a second indication of the first visitor and determining that the second indication of the first visitor in the third image is located inside of the first detection zone; and

sending the alert to the remote computing device in response to determining that the second indication of the first visitor in the third image is located inside of the first detection zone.

2. (canceled)

3. (canceled)

4. (canceled)

5. The method ofclaim 1, further comprising preventing the sending of the alert to the remote computing device until after detecting the second indication in at least two of the sections.

6. The method ofclaim 1, further comprising causing a second subset of the sections to be included in the first detection zone in response to the first subset comprising an outer perimeter that surrounds the second subset.

7. The method ofclaim 1, further comprising:

selecting the first detection zone by displaying the first image on the electronic display and then recording which areas of the first image the user indicates to include in the first detection zone by touching the electronic display;

calculating a percentage of the first detection zone that includes the second indication of the first visitor; and

sending the alert to the remote computing device in response to determining that the percentage of the first detection zone exceeds a first threshold.

8. The method ofclaim 7, wherein the second indication comprises a motion indication.

9. The method ofclaim 1, further comprising:

selecting the first detection zone by displaying the first image on the electronic display and then recording which areas of the first image the user indicates to include in the first detection zone by touching the electronic display;

calculating a percentage of the first detection zone that includes the second indication of the first visitor;

calculating a time in which the second indication of the first visitor has been in the first detection zone; and

sending the alert to the remote computing device in response to the percentage of the first detection zone and the time.

10. The method ofclaim 1, wherein the field of view comprises a portion, and wherein the first image, the second image, and the third image consist of the portion of the field of view, and wherein the method further comprises selecting the portion of the field of view.

11. The method ofclaim 1, wherein the first image, the second image, and the third image consist of at least a portion of the field of view, wherein the method further comprises analyzing the portion of the field of view.

12. The method ofclaim 1, the method further comprising configuring the camera of the doorbell to record a portion of an entryway, wherein the first image, the second image, and the third image show the portion of the entryway.

13. The method ofclaim 1, wherein the doorbell and the remote computing device are not physically coupled, the method further comprising wirelessly sending the first image from the doorbell to the remote computing device.

14. The method ofclaim 1, further comprising sending the first image directly from the doorbell to the remote computing device without using an intermediary server.

15. A method for using a doorbell system to detect a first visitor, wherein the doorbell system comprises a doorbell and a remote computing device, the method comprising:

obtaining the doorbell that comprises a camera and a button, wherein the button is configurable to enable the first visitor to sound a chime;

configuring the camera of the doorbell such that the camera comprises a field of view;

using the camera of the doorbell to take a first image to calibrate the doorbell system;

sending the first image from the doorbell to the remote computing device, wherein the remote computing device comprises an electronic display;

displaying the first image on the electronic display of the remote computing device;

prompting a user of the remote computing device to select a first detection zone within the first image of the camera, wherein the first detection zone represents a portion of the field of view of the camera, and wherein selecting the first detection zone comprises selecting a portion of the first image of the camera;

configuring the doorbell system to ignore a second visitor located within the field of view of the camera in response to the second visitor being located outside of the first detection zone, wherein ignoring the second visitor comprises not sending a first picture of the second visitor to the remote computing device; and

configuring the doorbell system to send a second picture of a third visitor to the remote computing device in response to determining that the third visitor is located inside of the first detection zone as defined based on the first image.

16. The method ofclaim 15, further comprising:

displaying lines on the first image on the electronic display of the remote computing device such that the first image is divided into sections by the lines; and

selecting the first detection zone within the first image by the user touching at least a first subset of the sections on the electronic display of the remote computing device.

17. The method ofclaim 15, further comprising enabling audio communication between the third visitor and the user of the remote computing device in response to detecting at least one indication of the third visitor in at least two of the sections.

18. The method ofclaim 15, further comprising selecting the first detection zone within the first image by prompting the user of the remote computing device to indicate a first area by touching the first area on the electronic display of the remote computing device; recording the first area; and excluding the first area from the first detection zone, wherein the method further comprises ignoring the second visitor in response to the visitor being located in the first area.

19. The method ofclaim 15, further comprising:

sending the second picture of the third visitor to the remote computing device, and then waiting to open audio communication between the third visitor and the user of the remote computing device until after determining a percentage of the first detection zone that includes an indication of the third visitor and calculating a time in which the indication of the third visitor has been in the first detection zone; and

opening the audio communication between the third visitor and the user of the remote computing device in response to the percentage of the first detection zone and the time.

20. The method ofclaim 19, wherein the percentage is at least ten percent and the time is at least four seconds.

21. The method ofclaim 15, wherein the doorbell comprises a motion sensor, and the method further comprises ignoring the second visitor in response to disabling the motion sensor during a predetermined time period.

22. The method ofclaim 15, further comprising sending the second picture of the third visitor directly from the doorbell to the remote computing device without using an intermediary server.

23. A method for using a doorbell system to detect a first visitor, wherein the doorbell system comprises a doorbell and a remote computing device, the method comprising:

obtaining the doorbell that comprises a camera and a button, wherein the button is configurable to enable the first visitor to sound a chime;

configuring the camera of the doorbell such that the camera comprises a field of view;

using the camera of the doorbell to take a first image to calibrate the doorbell system by establishing a baseline of an entryway;

sending the first image from the doorbell to the remote computing device, wherein the remote computing device comprises an electronic display;

displaying the first image on the electronic display of the remote computing device;

displaying a grid pattern on the first image on the electronic display of the remote computing device such that the first image is divided into at least ten sections by lines that cross each other;

selecting a first detection zone within the first image, wherein the first detection zone comprises a portion of the first image, and wherein the first detection zone comprises a two-dimensional representation of an area in which the doorbell system is configured to respond to motion detection;

selecting the first detection zone within the first image by the user choosing at least a first subset of the sections on the electronic display of the remote computing device, wherein choosing the first subset causes the first subset to be included in the first detection zone;

configuring the doorbell system to ignore a second visitor located within the field of view but located outside of the first detection zone, wherein ignoring the second visitor comprises not sending a first picture of the second visitor to the remote computing device; and

configuring the doorbell system to send a second picture of a third visitor to the remote computing device in response to determining that the third visitor is located inside of the first detection zone.

24. (canceled)

25. The method ofclaim 23, further comprising sending the second picture of the third visitor to the remote computing device in response to determining that the third visitor is located inside of the first detection zone, and in response to determining that at least twenty percent of the first detection zone includes motion indicators, and in response to determining that the first detection zone has included the motion indicators for at least three seconds.

26. A method for using a doorbell system to detect a first visitor, wherein the doorbell system comprises a doorbell and a remote computing device, the method comprising:

obtaining the doorbell that comprises a camera and a button, wherein the button is configurable to enable the first visitor to sound a chime;

configuring the camera of the doorbell such that the camera comprises a field of view;

using the camera of the doorbell to take a first image;

sending the first image from the doorbell to the remote computing device, wherein the remote computing device comprises an electronic display;

displaying the first image on the electronic display of the remote computing device;

prompting a user of the remote computing device to select a first detection zone within the first image, wherein the first detection zone comprises a portion of the first image;

selecting the first detection zone within the first image by the user touching at least a first subset of sections on the electronic display of the remote computing device, wherein touching the first subset causes the first subset to be included in the first detection zone;

causing a second subset of the sections to be included in the first detection zone of the doorbell in response to the first subset comprising an outer perimeter that surrounds the second subset;

using the camera of the doorbell to take a second image;

analyzing the second image to detect a first indication of the first visitor and determining that the first indication of the first visitor in the second image is located outside of the first detection zone, and then the doorbell system deciding to not send an alert to the remote computing device in response to determining that the first indication of the first visitor in the second image is located outside of the first detection zone, wherein the alert is configured to notify the remote computing device regarding a presence of the first visitor;

using the camera of the doorbell to take a third image;

analyzing the third image to detect a second indication of the first visitor and determining that the second indication of the first visitor in the third image is located inside of the first detection zone; and

sending the alert to the remote computing device in response to determining that the second indication of the first visitor in the third image is located inside of the first detection zone.

27. The method ofclaim 26, further comprising preventing the sending of the alert to the remote computing device until after detecting the second indication in at least two of the sections.

28. The method ofclaim 26, further comprising calculating a percentage of the first detection zone that includes the second indication of the first visitor, and sending the alert to the remote computing device in response to the percentage of the first detection zone exceeding a first threshold.

29. The method ofclaim 26, further comprising calculating a time in which the second indication of the first visitor has been in the first detection zone, and sending the alert to the remote computing device in response to the time exceeding a first threshold.

Images