US20110178618A1 - Method and apparatus for setting programmable features of a home appliance - Google Patents

Abstract

An interactive interface facilitates the setting of preferences and other programmable parameters of a home appliance. The interface is hosted by a server on a global computer network. The homeowner initiates a connection to the server and is presented with a graphical user interface for setting the preferences and features of the home appliance. Once the desired settings have been made, they are downloaded to the appliance either directly from the server or the homeowner's computer or indirectly using a portable transfer device.

Description

RELATED APPLICATIONS
• This is a continuation application of co-pending application Ser. No. 12/033,821, filed Feb. 19, 2008, which is a continuation of application Ser. No. 11/745,323, filed May 7, 2007, now U.S. Pat. No. 7,415,102, which is a continuation application of application Ser. No. 10/938,057, filed Sep. 9, 2004, now U.S. Pat. No. 7,215,746, which is a continuation of application Ser. No. 10/155,531, filed May 24, 2002, now U.S. Pat. No. 6,882,712, which is a continuation-in-part of application Ser. No. 09/415,299, filed Oct. 8, 1999, now U.S. Pat. No. 6,483,906, which is a continuation-in-part of application Ser. No. 09/351,270, filed Jul. 12, 1999, now U.S. Pat. No. 6,256,378, which is a continuation-in-part of application Ser. No. 09/235,709, filed Jan. 22, 1999, now U.S. Pat. No. 6,415,023.
BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• This invention relates generally to the field of setting programmable features of an appliance. More particularly, the invention provides a method and apparatus for conveniently setting various programmable features of an appliance using a graphical user interface accessed with a computer via a global computer network.
• 2. Prior Art
• The advent of microprocessors and other miniaturized electronics has facilitated the implementation of increasingly complex functions in home and office appliances. Typically, a relatively complex operator interface is required in order to invoke the various functions that are available. For example, home electronic devices such as televisions, VCRs, stereo receivers and the like are typically provided with sophisticated remote control devices. Such remote control devices have a large number of individual buttons that are used to directly control features of an appliance and/or that are used to navigate through on-screen menus. Because of the sophistication and complexity of the controls, owner's manuals for appliances are becoming increasingly voluminous and difficult to comprehend.
• Due to the growing complexity of modern appliances, many of the available features are never utilized by consumers, even as competition in the marketplace drives the proliferation of such features. A number of solutions have been proposed for making appliances easier to control and generally more “user friendly”. For example, U.S. Pat. No. 5,553,123 issued to Chan, et al. discloses a method for downloading set-up data via a telephone to an appliance controller. A user first initiates a telephone call to a remote site having a computer. The user communicates certain background information to the remote site, and set-up data is then downloaded via the telephone connection. The earpiece of the telephone is held in proximity to a microphone built into the appliance controller in order to receive the downloaded data. Upon receipt of the data, the controller is configured to operate the appliance.
• U.S. Pat. No. 5,600,711 issued to Yuen discloses an apparatus and methods for providing initializing settings to an appliance. When a user wishes to initialize the settings of an appliance, the user initiates a telephone connection with a remote site. The remote site then downloads a sequence of commands for initializing the settings in the appliance over the telephone connection. A remote control device for the appliance receives the sequence of commands and stores them in an internal memory. The remote control device is then aimed at the appliance and the user enters a command to transfer the stored sequence of commands to the appliance, thereby initializing the settings.
• U.S. Pat. No. 5,141,756 issued to Levine discloses a method of initializing a programmable control device, such as a remote controller for a video cassette recorder. The device is programmed by connecting it to a telephone system, dialing a remote initializing center preferably employing a computer, and providing the computer with information as to the environment of the control device by using touch tone keys to respond to audio inquiries transmitted by the computer. The computer then transmits the initializing program for loading into the memory of the control device.
• U.S. Pat. No. 5,774,063 issued to Barry, et al. discloses a method and apparatus for remote control of electronic devices from a computer. A transducer, such as an infrared transmitter, is coupled to a computer and aimed at an electronic device to be controlled. An application program running on the computer generates appropriate signals for control of the electronic device.
• U.S. Pat. No. 5,815,086 issued to Ivie, et al. discloses a method and apparatus for communicating commands to electrical appliances from remote locations. Various appliances within a structure, such as a house, are coupled to a signal-conducting bus, such as the AC power wiring bus of the structure. Appliance commands are issued over the bus from a central transmitter. Appliances may be directly coupled to the bus or may receive commands via an infrared signal from an infrared transmitting device coupled to the bus. A handheld control device may be supplied for controlling the various appliances, in which case, receivers for the handheld control device are coupled to the bus in various parts of the structure.
• U.S. Pat. No. 5,819,294 issued to Chambers discloses a programmable universal remote controller. A programming device is coupled to a computer and receives signals from conventional remote controllers. The programming device correlates the received signals with a database of stored signals used by various appliance manufacturers. The programming device then sends a complete set of appropriate control signals to the programmable universal controller.
• U.S. Pat. No. 5,228,077 issued to Darbee discloses a universal remote controller that may be programmed from a remote location. The remote controller receives programming data via a video or telephonic data transmission system.
• U.S. Pat. No. 5,488,571 issued to Jacobs, et al. discloses a system for transferring data from a video display monitor of a personal computer to a portable information device such as an appointment scheduling device. The video display is modulated to transmit data to an opto-electronic receiver in the portable information device.
• Microsoft Corporation has introduced a cordless phone having programmable functions controlled by a personal computer. The base station of the phone is coupled to the serial port of a computer and application software is installed on the computer to control operation of the phone.
SUMMARY OF THE INVENTION
• The present invention provides methods and apparatus for setting preferences and other parameters of an appliance. In preferred embodiments of the invention, a user initiates a connection to an interactive site on a global computer network. The site hosts a graphical user interface with which preferences and other parameters of an appliance may be set by the user. In some embodiments, set-up data for the appliance may be downloaded directly to the appliance from the user's computer or the interactive site. In other embodiments, set-up data for the appliance is downloaded from the user's computer or the interactive site to a transfer device where it is temporarily stored. The transfer device is then used to program the appliance. Since the appliance itself does not require a user interface for set-up procedures and programming, the appliance can be smaller, cheaper and lighter without sacrificing any functionality. In addition, the need for a printed user's manual is largely obviated since all of the information normally contained in such a manual can be obtained from the interactive site.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a functional block diagram of a first embodiment of the invention wherein an appliance receives data directly from a local computer.
• FIG. 2 is a functional block diagram of a second embodiment of the invention wherein an appliance receives data from a local computer via a transfer device.
• FIG. 3 is a functional block diagram of a transfer device as shown inFIG. 2.
• FIG. 4 illustrates a graphical user interface suitable for setting programmable features of a thermostat.
• FIG. 5 is a functional block diagram of a third embodiment of the invention wherein an appliance receives data directly from an interactive site server.
• FIG. 6 is a functional block diagram of a fourth embodiment of the invention wherein an appliance receives data from an interactive site server via a transfer device.
• FIG. 7 illustrates luminance modulation for transferring decimal data digits.
• FIG. 8 illustrates luminance modulation with dithering encoding.
• FIG. 9 illustrates luminance modulation with irregular graphic patterns.
• FIG. 10 illustrates bi-color phase modulation.
• FIG. 11 illustrates video bar code modulation.
• FIG. 12 illustrates a self-clocking data encoding scheme for use with the present invention.
• FIG. 13 is a functional block diagram of a receiving device suitable for use with the present invention.
• FIG. 14 illustrates a display screen having a portion thereof for data transfer.
• FIG. 15 is a plot of CRT photoresponse of a prototype system constructed in accordance with the present invention.
• FIG. 16 is a plot of a calibration sequence used in the prototype system.
DETAILED DESCRIPTION OF THE INVENTION
• In the following description, for purposes of explanation and not limitation, specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known methods and devices are omitted so as to not obscure the description of the present invention with unnecessary detail.
• The present invention finds application with a wide variety of home and office appliances. Some categories of appliances in which the invention may be utilized include clocks, telephones, televisions, television set-top decoders, video recorders, audio and video entertainment system components, refrigerators, conventional ovens, microwave ovens, dishwashers, irrigation systems, global positioning satellite (GPS) receivers, automobile heating, ventilating and air conditioning (HVAC) systems, automobile sound systems, home security systems, home HVAC systems, home master control systems, facsimile machines, copiers, cameras, postage meters, etc. “Programmable features” refer to any appliance features that may be altered. These include, for example, initialization or set-up parameters, stored data (e.g., telephone speed dial numbers or GPS receiver database) and the operating system or other internal software. Specific examples are given below to illustrate operation of the invention. However, it will be understood that the invention has general applicability to appliances of all types and to all types of programmable features within such appliances.
• “Appliances” will be understood to include any device or system that has programmable features, including those that not normally thought of as “appliances.” For example, an automobile has numerous on-board systems that are programmable in one way or another. Thus, the automobile itself may be viewed as an “appliance,” as may the individual systems. In a similar vein, a residential dwelling contains a number of individual appliances. The dwelling, together with the individual appliances, may be viewed collectively as a single “appliance.” This is particularly true if the individual appliances are connected to a home network. In this case, a single user interface may be provided to program the various systems and appliances of the dwelling. These may be communicated directly to a central controller on the home network or through a transfer device. A transfer device may be advantageously combined with a key to open the dwelling so that appliance features are programmed upon entering the dwelling. This is especially useful when there are multiple occupants in the dwelling. Each key may then carry the individual preferences of the respective occupant. Conflicts in preferences may be resolved through a priority hierarchy established when the preferences are programmed with the user interface. Of course, the invention is not limited to residential dwellings and may be employed as well with offices, stores and other habitable spaces.
• The invention also has applicability apart from setting programmable features of appliances. For example, the invention may be employed to purchase pay-per-view programming at an interactive web site. An authorization code may then be downloaded into the transfer device of the invention and transferred to a TV set-top box so that the purchased program will be “descrambled”. This approach eliminates the telephone connection required for most TV set-top boxes with pay-per-view capability.
• Another potential application for the invention is as a programmable “token”. For example, a consumer product manufacturer may offer discounts on certain of its products at its web site. Authorization to receive the discount may be downloaded into the transfer device of the invention and the transfer device may then be taken to a retailer. The transfer device is then used to transmit the discount authorization to a receiving terminal at the retailer. Ideally, the terminal would also have the ability to modify the stored contents of the transfer device so that the discount authorization could be cancelled once the discount is given. This same “token” approach can also be applied to pre-paid purchase transactions; reservations at restaurants, hotels, parks, etc.; entry authorization to entertainment venues or other secured areas and similar situations in which a conveniently transported authorizing token serves as an extended communication link from a computer system.
• A first embodiment of the invention is illustrated inFIG. 1. Anappliance10 receives set-up data from alocal computer12. In a typical application,local computer12 is a general purpose personal computer of the type now widely found in homes and offices. Details ofcomputer12 are not particularly relevant to the invention and are not shown. Typically,computer12 will comprise, at a minimum, a processing unit, a keyboard and a display. Additional input devices, such as a mouse or other pointing device, and output devices, such as a printer, may also be included as part ofcomputer12.
• Local computer12 is coupled to a remoteinteractive site server14 by a telecommunications link. In a typical embodiment of the invention,interactive site server14 would be accessible via the World Wide Web. Other appropriate means for connectingcomputer12 toserver14 could also be employed.Server14 contains programming for interactively setting the programmable features ofappliance10. Preferably,server14 presents to the owner ofappliance10, viacomputer12, a graphical user interface that is tailored toappliance10 and the programmable features thereof. Such interface can be thought of as a “virtual appliance”. This can be better understood from the discussion ofFIG. 4, below.
• In the embodiment illustrated inFIG. 1,appliance10 is coupled directly tolocal computer12. This embodiment is best suited for portable appliances that may be conveniently carried to the computer for set-up. The coupling betweenappliance10 andcomputer12 may be one-way from the computer or two-way. One-way communication may be accomplished optically by providingappliance10 with an optical sensor and modulating the display ofcomputer12 utilizing one or more of the techniques described below. Other communication techniques can be employed using audio, magnetic, inductive, infrared, or radio frequency coupling. Two-way communications are most conveniently established by connection to a serial port ofcomputer12. The serial port may be configured in accordance with any of the appropriate industry standards, such as, for example, Universal Serial Bus (USB), Fire Wire, etc. Naturally, this type of connection is not ideal for all appliances, but is particularly well-suited to portable appliances that may require a large amount of data. For example, loading data into a pocket organizer or similar type of personal digital assistant can be most conveniently accomplished with a serial port connection in the configuration illustrated inFIG. 1.
• A two-way connection also allows “synchronization” of the real appliance with the virtual appliance. Even though most of the feature configuration of an appliance will be done using the virtual appliance interface, there may still be features and settings that can be controlled directly at the real appliance. By periodically reestablishing a two-way connection with the computer, the virtual appliance can be updated with any changes in the settings of the real appliance.
• Another advantage of two-way communications is that it may be used to facilitate remote troubleshooting of appliances. Data from the appliance may be transmitted tocomputer12, and from there to the appliance manufacturer or support facility via an Internet or email connection. Analysis of the data can then be used to issue appropriate repair orders. In some cases, repairs may be effectuated by downloading connective software or firmware in the same manner that appliance set-up is accomplished.
• Some types of appliances can be readily adapted to utilize existing components for establishing communications withcomputer12. For example, electronic cameras inherently possess optical sensors that can be used to sense modulation of a computer display screen or other light source. The primary imaging path of the camera may be used in the case of video cameras and digital still cameras. This simply requires the addition of circuitry and/or software to decode the modulation and store the appropriate set-up parameters. Alternatively, the receiver of the camera's focusing range finder may be used as the optical sensor.
• In order to provide the appropriate interface for programming the features ofappliance10,server14 preferably receives data from the appliance manufacturer. Such data may be received periodically as new model appliances are released by the manufacturer or may be obtained byserver14 in real time with a dial-up connection to the manufacturer. The latter approach offers the advantage of insuring that the most recent product information is available toserver14. One method of insuring that the appropriate information forappliance10 is obtained byserver14 is to prompt the appliance owner to input the serial number of the appliance atcomputer12. This need only be performed once, since the serial number can thereafter be stored incomputer12 and/orserver14 for use in subsequent programming of the same appliance. Warranty registration for the appliance may be conveniently performed during this same procedure.
• An optional aspect of the invention is the ability ofserver14 to provide valuable feedback to the appliance manufacturer. During appliance set-up operations,server14 collects information concerning consumer's use of product features that can be useful in product marketing and new product design. The link betweenserver14 and the appliance manufacturer also facilitates new marketing opportunities. The manufacturer can readily target advertising to identified purchasers of its products. Also, the manufacturer can offer accessories and related products forappliance10. Such offers may be integrated with the set-up interface or may be directed to the appliance owner separately by email or conventional mail. It should be appreciated that the invention can facilitate warranty registration. Since the appliance owner is already communicating withserver14 to set programmable features of the appliance, it is a simple matter to collect the additional information necessary to complete warranty registration and, if desired, to provide additional demographic data to the manufacturer.
• FIG. 2 illustrates an alternative embodiment of the invention. This embodiment is similar to that ofFIG. 1, except that programming data is provided toappliance10 by atransfer device16. This transfer device receives the programming data fromlocal computer12 by a wired connection tocomputer12 or, by an opto-electronic or other wireless data link such as will be described more fully below. Furthermore, the transfer device may communicate with the appliance via a wired connection or via a wireless data link.
• FIG. 3 is a functional block diagram of asuitable transfer device16. At the heart ofdevice16 is acontrol electronics module102. Data modulated on the display screen ofcomputer12 is sensed byoptical detector104 upon activation of receiveswitch106. The data is demodulated byelectronics102 and is stored inmemory108. Upon confirmation of error-free transfer and storage of the data, a suitable indication is provided to the user by means ofindicator110, which may be, for example, a light emitting diode (LED). With the data loaded inmemory108,transfer device16 may be carried toappliance10, which may include a “docking” port fortransfer device16. Thus,transfer device16 may be an integral component ofappliance10, which is provided to the consumer by the appliance manufacturer. Alternatively,transfer device16 may be connected to an input port ofappliance10 with an electrical cable or “tether” which may have a fixed or removable connection to the transfer device and/or the appliance. In still other embodiments,appliance10 may be provided with an infrared receiver coupled to its internal control electronics. In the case of an IR link,transfer device16 is equipped with an appropriateinfrared transmitter114 and is held in proximity to the infrared receiver ofappliance10. Upon actuation of transmitswitch112, the data stored inmemory108 is appropriately modulated byelectronics102 and applied toinfrared transmitter114.Indicator110 may confirm to the user that the data has been transmitted. Alternatively, or in addition, an indicator may be provided onappliance10 to signal receipt of the data.Power source116, preferably in the form of common alkaline battery cells, provides electrical power to the components ofdevice16.
• Transfer device16 may be configured to transfer data from the appliance back to the computer as well. This facilitates synchronization of the virtual and real appliances as explained above. Data from the appliance may be loaded into the transfer device by means of an opto-electronic link in the same manner by which data is loaded from the computer. Preferably, however, the transfer device will have a direct electrical coupling to the appliance for applications involving two-way communications. Transfer of data into the computer may be accomplished in a number of ways. For example,transfer device16 may couple directly to a serial or parallel input port of the computer as discussed previously, in which case a single physical port on the transfer device may serve as both input port and output port. Alternatively,transfer device16 may include a sound transducer by which data may be transferred through a microphone coupled to the computer.
• Transfer device16 may be configured in various forms. Preferably,device16 is easily portable.Device16 may be in the form of a pen or wand withoptical detector104 andinfrared transmitter114 at one end.Transfer device16 may also be integrated with a conventional remote controller for those types of appliances that are commonly controlled remotely. In another variation,transfer device16 may be a removable module that is docked intoappliance10 as described above. In such case, communication between the transfer device and the appliance may be accomplished with a direct electrical connection through a suitable arrangement of electrical contacts.Transfer device16 may, in fact, comprise the “brains” ofappliance10 in the form of a microprocessor or equivalent device. Aside from the ease of programming features and functions of the appliance, such an arrangement offers the added benefit of facilitating service or replacement of the appliance's electronic components in the event of malfunction.
• The embodiment shown inFIGS. 2 and 3 is particularly well-suited to appliances that are relatively fixed in position and that require only limited amounts of data. Examples of such appliances abound in the home and office. One such example is a thermostat for a home HVAC system.FIG. 4 illustrates a graphical user interface for a thermostat as presented on a display ofcomputer12. Such interface is shown merely for purposes of illustration, it being understood that the particular features of the interface are largely a matter of design choice.
• Along the top of the display shown inFIG. 4 is aday strip122. The user may select any one of the days with a cursor to program the thermostat settings for that day. Below the day strip is atemperature selector124. Pointing at the up or down arrow with a mouse or other cursor positioning device, the user selects the desired temperature. To the right oftemperature selector124 there are a pair oftime windows126 and128. Using the appropriate up and down arrows, the user selects the starting and ending times for which the temperature selection applies. When the desired settings have been made, the user selectsENTER button130 to store the selections and then proceeds to make the next set of selections. For convenience, the ending time last entered may be automatically inserted into the starting time window. A graphical display132 of the selected temperature profile may be provided for the user's convenience.
• When all settings have been completed, the data is loaded intotransfer device16, which is then taken to the physical location of the thermostat for transfer of the data. Since all of the settings have been entered intocomputer12, they may be conveniently saved locally and/or byserver14 for subsequent use in revising these settings or for reloading the settings in the event of a power failure. A printed record of the settings may also be made fromcomputer12. For some appliances, a print-out following a set-up procedure may be used as a template for the appliance to indicate selected options and programmed features. For example, certain appliances may have unlabeled function buttons for which a template may be made once selected functions have been assigned to the buttons during a set-up procedure.
• It will be appreciated that a thermostat physically incorporating the interface shown inFIG. 4 would be quite large and costly in comparison to conventional thermostats. This is due primarily to the relative complexity of the interface, since the actual componentry to provide such flexibility of thermostat settings is actually quite small and inexpensive. Through use of the present invention, virtually unlimited flexibility in thermostat programming may be accomplished with a thermostat that is no larger and no more costly than a conventional thermostat. Indeed, a thermostat as just described could easily be made the size of a postage stamp.
• Another example of an “appliance” to which the present invention can be advantageously applied is the modern automobile. The driver interface for automobiles has become more and more complicated as more and more electronic and computer driven features have become available. Seat position and temperature, mirror position, audio entertainment settings, HVAC settings and navigational settings can all be set electronically. Many of the available settings are changed only infrequently, and thus may require reference to the owner's manual in order to change the settings manually. Naturally, different drivers have different preferences and this can result in a lengthy process of changing settings each time a different driver enters the vehicle. The present invention provides a convenient way to communicate driver preferences to the various electronic systems of an automobile. As explained above, a driver can set many of the desired preferences using an interactive program with a graphical user interface. A transfer device is then used to communicate the preferences to the automobile. In this particular example, the transfer device may also function as a key to enable operation of the automobile. Certain preferences, such as seat position and mirror position that are established in the automobile itself can be stored in the transfer device along with the preference data downloaded from the driver's home computer.
• Use of the present invention facilitates customized driver controls. For example, touch screen display panels are now used in many automobiles. Using a graphical user interface, a driver can design a customized set of controls for operating features of interest to that driver. One driver may wish to have certain radio selections readily available, whereas another driver may wish to have available a selection of destinations for the navigation system. These preferences are communicated via the transfer device as described above. Controls that are customized in this manner are not limited to touch screen selections. By the same process, driver defined functions may be assigned to buttons, dials and other mechanical controls as well to create individualized “function keys.” Furthermore, it will be appreciated that creating customized controls in this manner is not limited to the context of automobiles, but may be applied to any type of appliance.
• FIG. 5 illustrates another alternative embodiment of the invention. In this case, data forappliance10 is received directly fromserver14 rather thanlocal computer12. From the appliance owner's perspective, the appliance programming interface is otherwise identical to the previously described embodiments. Communication betweenserver14 andappliance10 may be telephonic.Appliance10 may incorporate a conventional modem, in which case communications may be two-way, or may simply have a data demodulator for one-way communications. Coupling ofappliance10 to the telecommunications network may be by a conventional RJ-11 connection. Alternatively,appliance10 may incorporate a cordless telephone module for communicating with a separate base station. Communications betweenserver14 andappliance10 could also be implemented with radio signals. For example,appliance10 could incorporate a conventional paging receiver.
• A particular example of the embodiment illustrated inFIG. 5 is a programmable telephone. Speed dial numbers and other programmable features of a telephone may be conveniently set using a graphical user interface hosted byserver14. Once the features have been programmed by the user,server14 simply places a call to the telephone. Appropriate data demodulation circuitry is incorporated in the telephone in order to download the data fromserver14.
• FIG. 6 illustrates a further embodiment of the invention generally similar to that ofFIG. 5, but incorporating a transfer device as in the embodiment ofFIG. 2. Here, however,transfer device16′ receives data directly fromserver14. As with the previously described embodiment, communication betweenserver14 andtransfer device16′ may be telephonic or by radio. One example of atransfer device16′ is embodied as a removable module or “card” of a telephone. Data for anappliance10 is downloaded fromserver14 to the telephone where it is demodulated and stored in the card. The card may then be taken toappliance10 to transfer the data to the appliance with an infrared or other data link.
• Another embodiment of the invention as illustrated inFIG. 6 is a “universal” remote controller that may be coupled to a telecommunications network by means of an RJ-11 jack or equivalent in the manner disclosed by Darbee in U.S. Pat. No. 5,228,077. The remote controller could thus function as a data transfer device in addition to its more conventional remote control functions.
• As discussed above, the transfer device or appliance of the present invention preferably receives data by means of an opto-electronic data link. Any suitable source of light modulation may be employed to transmit data to the transfer device or appliance. These include LEDs, incandescent bulbs, LCDs and CRTs. A convenient source of light modulation is the display screen of a local computer. At least a portion of the display of the local computer may be modulated to transmit data to the transfer device.
• Most current approaches to video modulation data transfer use sequential pulsing of the video image to provide a series of binary 1's and 0's. These binary bits are used with framing bits (start and stop bits) to form complete data bytes. Some of the current approaches rely on the scanning CRT image to serialize the data bits by providing a luminance pulse for each data bit. This approach will fail when applied to flat panel LCD screens because these screens do not have a scanning luminance response like that found with the CRT.
• Other methods provide a binary bit stream where each bit is produced at the video field rate. For a typical CRT, this provides one binary data bit each 16 msec. (60 fields per second). While this approach is viable for the CRT, it will not work well for flat panel displays. The slow response time of LCD panels mean that only a small number of data bits could be transferred per second. For a passive display, 3 bits would be possible (assuming 300 msec. response time). For active panels, 20 bits could be transferred. Using conventional start and stop bits, a passive panel would then be capable of transmitting 0.3 bytes per second andactive panels 2 bytes per second. This is too low a data rate for many applications.
• Various modulation schemes are proposed below that are suitable for use with both CRT and LCD displays.
1. Luminance Modulation
• A first approach to data modulation of a display screen employs luminance modulation. This method drives the display with varying levels of intensity. Each intensity level can represent an entire data digit. For example,FIG. 7 illustrates a method using 10 shades of gray to represent a decimal digit. The luminance level for each successive decimal digit or luminance “dwell” is generated as fast as the display can accommodate. For an active matrix LCD panel, 20 dwells could be sent in one second. This allows 20 digits of information per second, which is substantially faster than sending binary data.
• The luminance levels are detected by a photodetector in a receiving device. Discrete luminance levels can be generated using several different methods:
a) Gray Scales
• This method drives a spot on the display to one of several discrete shades of gray. The photodetector in the receiving device can detect the discrete levels and convert each level into a single digit value. Reference levels can also be sent periodically in the data stream to establish the black and white (highest/lowest) luminance levels. This allows the photodetector output to be scaled to more accurately detect each discrete gray level. One limitation to this method is that the gray scale response of the display may not be linear. In fact, gray scale levels are greatly affected by the monitor's contrast and brightness controls. These controls can be changed by the user and are not predictable or known constants.
b) Chromatic Luminance
• It is possible to convey various luminance levels by selecting different color combinations. Each color has a luminance component combined with a chroma component. Selecting different colors also selects different luminance levels. For example, dark brown has a low luminance while cyan has a high luminance. Note that what is being detected with this method is luminance—not color. Accurate luminance detection depends on the color response of the display, the monitor contrast, brightness and color settings, and the color response characteristics of the photodetector. Accurate detection using this method typically requires some form of calibration to match the photodetector response to the display color response.
c) Dithering
• With reference toFIG. 8, the currently preferred method displays a regular pattern of black and white pixels within a region of the display to produce an average luminance level. This “dithering” average level is created by dividing the entire detection region into a matrix of smaller discrete cells comprising one or more pixels. Each cell is either driven full white or full black. The ratio of black to white cells determines the overall, average luminance for the detection area. This method eliminates problems with unpredictable gray scale response in the display due to contrast or brightness settings.
• The dithering approach illustrated inFIG. 8 uses a rectangular matrix to obtain an average luminance for a given area. It is also possible to display other graphic patterns or characters which have a distinctive appearance while also presenting an average overall luminance. Some examples are shown inFIG. 9. Each of these have a unique luminance level when the black areas are averaged with the white background. This allows the photodetector to discriminate between unique patterns or characters to convert to a corresponding data value.
d) Multi-Color Modulation
• Another method is to use two or more color channels to provide a means of data modulation. For this method two or more photodetectors are used, each responsive to different portions of the color spectrum. For example, separate red and green photodetectors could be used to detect varying shades of each color. Using two channels allows data encoding using the luminance level of each color channel, or the phase between two color signals. Phase modulation works by modulating the color channels at a given rate, but varying the phase relationship between the two channels as shown inFIG. 10.
• To further increase the data density, it is possible to combine modulation of color luminance with color phase. Thus at any given sample interval, three parameters are available: red intensity, green intensity and phase relationship. If eight discrete values of each parameter are used, each sample point can represent 8³values or 1 of 512 discrete numerical values per sample. A disadvantage to this method is the requirement for two color-selective detectors. Also, color response can vary between displays, so some type of color calibration may be required.
2. Video Bar Code
• FIG. 11 illustrates another method of data encoding using video bar code modulation. This approach is similar to printed bar codes, but uses a higher density data coding. With this method, a video bar code is displayed across the screen. The user swipes a receiving device across the bar code to read data from the screen. Conventional printed bar codes work by using different spaces between vertical lines. The spacing relationship is translated into binary data bits. Multiple bits are combined to form bytes of data.
• Using a video image, data can be represented using luminance levels or color. This allows higher data density because each “bar” in the video bar code can represent an entire decimal digit instead of just a single binary bit. This increases data density by 8 to 10 times compared to conventional bar codes.
• FIG. 11 illustrates a video bar code using luminance levels. Note that luminance levels can be generated using the same methods as previously described for spot modulation. Each bar represents one of many luminance levels, for example, with 10 luminance levels each bar can represent a digit value of 0 to 9.
3. Color Modulation
• Chromatic luminance modulation was described above as a form of intensity modulation. It is also possible to employ a true color modulation in which specific color hues are used to represent corresponding numerical values. Depending on the range of hues used, an array of two or three separate detectors sensitive to different spectral components, such as by using appropriate filters, is required. A beam splitter may be employed to direct light to the individual detectors of the array in the receiving device.
4. Self Clocking
• Regardless of the method of modulation employed, it is desirable that the data transmission be self-clocking. This means that individual data characters are detected by the receiving device without precise time spacing between characters. This self-clocking approach allows for pauses to occur during the transmission of data characters without creating transmission errors. Pauses can occur in PCs if the operating system performs another task while the transmission is active. For example, multitasking operating systems will commonly write data between memory cache storage and disk drives. This activity can preempt the operation of other software and cause short pauses in the operation of lower level applications. For internet based data transfers, varying delays are also common when moving data between servers and client PCs.
• It is also important to accommodate different data rates depending on the type of display monitor being used. Prior to starting the data transfer, the user can make a selection to indicate the type of display being used. If the display is a CRT, a faster transfer rate may be used (up to 75 digits per second). If an active matrix display is being used the transfer rate will be slower (20 digits per second). While the selection of transfer rate is easily accomplished on the PC side, the receiving device will preferably be compatible with all available transfer rates. Using self clocking data allows the receiving device to receive data at the transmission rate, without the need for a data rate selection on the receiving device itself.
• An efficient self-clocking method using a non-binary data encoding is illustrated inFIG. 12. If luminance modulation is used the receiving device can detect each discrete luminance level change as a new digit. The length of time between successive digits is irrelevant. If the same digit value is sent twice in succession, a special “repeat” character can be used to indicate that the last digit value is repeating. As shown inFIG. 12, 11 indicates a repeating digit value. If the data stream contains three successive 4's, the encoded data will be 4-11-4. With this approach a single digit value is never repeated twice in succession. The detector can simply wait for each change in luminance level to indicate a new digit value has been sent. Timing relationships between characters is not significant.
5. Time Interval Modulation
• In contrast to self-clocking methods, another modulation approach is based on the time spacing between changes in intensity level or color. With this approach, only a limited number of intensity levels or colors is required. The number of discrete intensity levels or colors may be as few as two. The time interval between changes in intensity level or color has a number of possible discrete values, each of which corresponds to a numerical value. A significant advantage of this approach is that it is not sensitive to variations in display intensity or color fidelity. However, due to the characteristic response times, this approach is better suited to CRT displays than to LCD displays.
6. Receiving Device
• FIG. 13 is a block diagram of a receivingdevice200 suitable for use in connection with the present invention. Light emitted by (or reflected by) a display panel falls onphotodetector202. The output of the photodetector is amplified byamplifier204 and asserted at the input of the analog-to-digital (A/D)converter206. The digitized output, in this case comprising an 8-bit word, is presented as an input tomicrocontroller208. The operation ofmicrocontroller208 is controlled by program instructions stored in read only memory (ROM)210. These instructions govern the conversion of the raw digitized input from A/D converter206 into a data digit. The data digits are further processed in accordance with the particular functions to be accomplished by receivingdevice200. When configured as a transfer device, such astransfer device16 discussed previously, receivingdevice200 will further communicate the data digits or information derived therefrom to a host device via a wired or wireless interface. A random access memory (RAM)212 is coupled tomicrocontroller208 for use as a scratchpad memory, the use of which may include temporary storage of the data digits received from A/D converter206 or information derived therefrom. In many applications, receivingdevice200 will include auser interface214 comprising a display and/or various controls, such as function selection buttons and the like. Receivingdevice200 may also include a provision to allow for automatic calibration of the analog to digital converter. Apeak detector216 detects the peak white level in the received signal. This level is used to establish the upper range of A/D converter206. This allows the full range of the A/D converter to be used over the receiver's data detection range.
• Receivingdevice200 may be configured in any convenient form. As discussed above in connection withtransfer device16, receivingdevice200 may have an elongated cylindrical shape similar to a pen or a wand. In such case,photodetector202 may be conveniently located at one end of the device. However, it has been found that pen- or wand-shaped devices have disadvantages when used with LCD flat screen displays. If the device is pressed against the display, even with light pressure, the display may be distorted, thereby affecting the accuracy of the data transfer. For flat panel displays, a flat, card-shaped receiving device is preferred. Such a device may be held against the display screen without distorting the display.
• To ensure proper registration of the receiving device with the display screen, a visual indication of the area of the display screen that will contain the data modulation is preferably provided. As shown inFIG. 14, a rectangular area of the display screen, generally corresponding in size and shape to the card-shaped receiving device, may be configured as a window and may be labeled with a legend such as “place card here”.
• In the examples discussed above, a single photodetector (or paired detectors in the case of bi-color modulation) is used in combination with a single modulated region of the display screen. It will be appreciated that the data transfer rate can be multiplied by employing a suitable array of photodetectors in combination with a corresponding array of data transmission regions. Obviously, the array of detectors must be properly registered with the array of modulated regions on the display. This can present a challenge in the case of a handheld receiving device. One solution to this challenge is illustrated inFIG. 14. Here, the display is divided into four quadrants that are independently modulated. The receiving device includes an array of four independent photodetectors. By providing simple registration marks on both the display screen and the receiving device, the receiving device can be held against the display screen so that the photodetectors are in proper registration with the corresponding quadrants.
7. Experimental Results
• A prototype system has been constructed. The prototype receiving device is configured as a card having the same length and width as a standard credit card. A 9 mm round photodetector element is located in the center of one face of the card. Electronic circuitry within the card amplifies the output signal of the photodetector, which is then applied as an analog input to a conventional personal computer system where A/D conversion is performed. The photodetector element is designed to detect the average luminance over a 9 mm round area of the display screen. The detector consists of a translucent glass window and a photo-Darlington transistor photodetector mounted in a plastic enclosure.
• The prototype system employs luminance modulation using the dithering approach discussed above. A total of 12 luminance levels are used to represent ten decimal values plus two additional values to indicate formatting and repeating characters. Using a CRT display, the prototype system has achieved data transfer rates of 20 characters per second.
• The photodetector in the receiver detects the luminance change as the electron beam in the CRT passes over the detector. This screen phosphor glows with a brightness related to the average screen luminance. For a CRT display, the beam is constantly scanning the screen. This creates a pulse as the beam passes over the detector. Therefore, the signal detected is a pulse which repeats at the frame rate of the display (typically 13 to 17 msec. per field).FIG. 15 is an actual capture of the signal received by the detector using a CRT-based display.
• Since the received signal is a pulse, a software algorithm processes the A/D conversion readings in order to establish the luminance level represented by the peaks of the detected pulses. The software algorithm is then capable of decoding these levels back into packets of data.
• It is desirable for the system to automatically adapt to varying intensity levels on the display. Different luminance levels will result due to variances in the brightness response of the display, the sensitivity characteristics of the photodetector and also due to adjustment of the brightness and contrast settings of the monitor.
• To automatically adjust for these differences, the system provides a calibration sequence at the start of each data transmission. As illustrated inFIG. 16, the calibration pattern consists of a staircase of each of the 12 luminance levels used. A full white pulse (level 12) is sent at the start of the sequence, followed by values of 0 to 12. This signal is detected by the receiver and used to establish the actual 12 discrete levels obtained from the monitor. InFIG. 16, the bottom signal is the actual pulse waveform received by the photodetector. The top signal is that obtained after processing by a software algorithm.
• It will be recognized that the above-described invention may be embodied in other specific forms without departing from the spirit or essential characteristics of the disclosure. Thus, it is understood that the invention is not to be limited by the foregoing illustrative details, but rather is to be defined by the appended claims.

Claims (44)

1. A transfer device comprising:

one or more microprocessors to assist the transfer device in:

receiving programming data for setting a programmable feature of a home appliance over a global computer network, and

transferring the received programming data to the at least one home appliance over a data link.

2. The transfer device ofclaim 1, wherein the data link between the transfer device and the at least one home appliance is wireless.

3. The transfer device ofclaim 1, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

4. The transfer device ofclaim 1, wherein the home appliance is an audio and video entertainment system.

5. The transfer device ofclaim 1, wherein the home appliance is a home security system.

6. A home appliance comprising:

one or more microprocessors to assist the home appliance in:

receiving programming data for setting a programmable feature of the home appliance through a data link with a transfer device, the programming data originating from a computer connected to a global computer network;

utilizing the received programming data to set the programmable feature of the home appliance.

7. The home appliance ofclaim 6, wherein the data link is wireless.

8. The home appliance ofclaim 6, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

9. The home appliance ofclaim 6, wherein the home appliance is an audio and video entertainment system.

10. The home appliance ofclaim 6, wherein the home appliance is a home security system.

11. A server comprising:

a computer storage medium having computer executable instructions for:

causing a device in global computer network communication with the server to display information about one or more programmable features of one or more home appliances;

receiving programming data over the global computer network from the device to set a programmable feature of the one or more home appliances; and

sending programming data over the global computer network to a transfer device, the transfer device being in communication with the one or more home appliances.

12. The server ofclaim 11, wherein the communication between the transfer device and the one or more home appliances is wireless.

13. A system comprising:

a server comprising a computer storage medium having computer executable instructions for:

causing a device in global computer network communication with the server to display information about at least one programmable feature of one or more home appliances,

receiving programming data over the global computer network for setting at least one programmable feature of one or more home appliances, and

sending programming data over the global computer network to a transfer device,

wherein the transfer device comprises one or more microprocessors to assist in:

receiving the programming data over the global computer network, and

transferring the programming data to the one or more home appliances over a data link.

14. The system ofclaim 13, wherein the data link is wireless.

15. A method comprising:

using a computer to navigate over a global computer network to a remote site;

viewing information provided by the remote site relating to at least one programmable feature of at least one home appliance;

selecting the at least one programmable feature of the at least one home appliance; and

initiating the transfer of set-up data representing the at least one programmable feature of the least one home appliance from the remote site to a transfer device, the transfer device being in communication with the at least one home appliance.

16. The method ofclaim 15, wherein the communication between the transfer device and the at least one home appliance is wireless.

17. The method ofclaim 15, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

18. The method ofclaim 15, wherein the home appliance is an audio and video entertainment system.

19. The method ofclaim 15, wherein the home appliance is a home security system.

20. A method comprising:

providing a remote interactive site accessible over a global computer network via a computer, the interactive site relating to at least one programmable feature of at least one home appliance;

receiving a command over the global computer network to set a programmable feature of the at least one home appliance; and

in response to receiving the command, sending programming data representing the command to a transfer device, the transfer device being in communication with the at least one home appliance.

21. The method ofclaim 20, wherein the transfer device is in wireless communication with the at least one home appliance.

22. The method ofclaim 20, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

23. The method ofclaim 20, wherein the home appliance is an audio and video entertainment system.

24. The method ofclaim 20, wherein the home appliance is a home security system.

25. A transfer device comprising:

a data receiver configured to receive programming data for setting a programmable feature of a home appliance over a global computer network from a computer; and

a data transferor configured to transfer the received programming data to the at least one home appliance over a data link.

26. The transfer device ofclaim 25, wherein the data link is wireless.

27. The transfer device ofclaim 25, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

28. The transfer device ofclaim 25, wherein the home appliance is an audio and video entertainment system.

29. The transfer device ofclaim 25, wherein the home appliance is a home security system.

30. A home appliance comprising:

a data receiver configured to receive programming data through a data link with a transfer device, the programming data originating from a computer connected to a global computer network; and

a data processor configured to utilize the received programming data to set a programmable feature of the home appliance.

31. The home appliance ofclaim 30, wherein the data link between the data receiver and the transfer device is wireless.

32. The home appliance ofclaim 30, wherein the home appliance is a heating, ventilating and air conditioning (HVAC) system.

33. The home appliance ofclaim 30, wherein the home appliance is an audio and video entertainment system.

34. The home appliance ofclaim 30, wherein the appliance is a home security system.

35. A server comprising:

a storage medium having executable instructions for:

causing a device in global computer network communication with the server to present a graphical user interface depicting one or more programmable features of one or more home appliances;

receiving data over the global computer network from the device to set a programmable feature of the one or more home appliances; and

sending programming data over the global computer network to a transfer device, the transfer device being in communication with the one or more home appliances.

36. The server ofclaim 35, wherein the communication between the transfer device and the one or more home appliances is wireless.

37. A system comprising:

a server comprising a storage medium having executable instructions for:

causing a device in global computer network communication with the server to present a graphical user interface depicting at least one programmable feature of one or more home appliances,

receiving data over the global computer network for setting at least one programmable feature of one or more home appliances, and

sending programming data over the global computer network to a transfer device,

wherein the transfer device comprises:

a data receiver configured to receive the programming data over the global computer network, and

a data transferor configured to transfer the programming data to the one or more home appliances over a data link.

38. The system ofclaim 37, wherein the data link between the data transferor and the one or more home appliances is wireless.

39. A method comprising:

providing a remote interactive site accessible over a global computer network via a computer, the interactive site relating to at least one programmable feature of an appliance;

receiving a command over the global computer network to set a programmable feature of the appliance; and

in response to receiving the command, sending programming data representing the command to the appliance.

40. The method ofclaim 39, wherein the appliance is a home master control system.

41. The method ofclaim 39, wherein the appliance is a security system.

42. The method ofclaim 39, wherein the appliance is a heating, ventilating and air conditioning (HVAC) system.

43. A system comprising:

a server comprising a computer storage medium having computer executable instructions for:

causing a device in global computer network communication with the server to display information about at least one programmable feature of a home master control system,

receiving programming data over the global computer network for setting at least one programmable feature of the home master control system, and

sending programming data over the global computer network to the home master control system,

wherein the home master control system comprises one or more microprocessors to assist in:

receiving the programming data over the global computer network, and

setting the at least one programmable feature of the home master control system.

44. A server comprising a computer storage medium having computer executable instructions for:

causing a device in global computer network communication with the server to display information about at least one programmable feature of a home master control system;

receiving programming data over the global computer network for setting at least one programmable feature of the home master control system; and

sending programming data over the global computer network to the home master control system.

Images