TECHNICAL FIELDThe present disclosure is related generally to wireless device communication and, more particularly, to an electronic device carrying out functions based on reflected electromagnetic radiation from an accessory.
BACKGROUNDWith the introduction of short-range communication technologies, such Bluetooth®, electronic devices, such as smart phones, can be wirelessly connected with many types of accessories. When such connection occurs, the accessory typically communicates its capabilities and properties to the electronic device so that the electronic device can interact appropriately with the accessory. There are many types of accessories, however, that have no wireless capability and, in many cases, no power. Such non-wireless accessories include cases, skins, holsters, and folios. Yet there are many possible functions that could be performed with respect to such accessories if there were some mechanism for the electronic devices to obtain information about them.
DRAWINGSWhile the appended claims set forth the features of the present techniques with particularity, these techniques, together with their objects and advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
FIG. 1A is an overview of a the interaction between an electronic device and an accessory according to an embodiment;
FIG. 1B andFIG. 1C depict an electronic device attached to a folio according to an embodiment;
FIG. 2 is a simplified block diagram of a representative electronic device according to an embodiment;
FIG. 3 shows the interaction between a folio cover and the electronic device according to an embodiment;
FIG. 4 shows two example reflection profiles;
FIGS. 5A,5B, and5C show how an electronic device obtains a reflection profile from a folio cover by using a pattern on a folio cover according to an embodiment;
FIGS. 6A,6B, and6C show how an electronic device obtains a reflection profile from a folio cover by using a pattern on the folio cover according to another embodiment; and
FIG. 7 shows steps taken by the electronic device to carry out functions based on reflected electromagnetic radiation according to an embodiment.
DESCRIPTIONThis disclosure is generally directed to a method and electronic device for carrying out functions based on electromagnetic radiation (“EMR”) reflected from an accessory. According to various embodiments, the accessory has physical characteristics or physical features that reflect EMR with an identifiable profile. Examples of such physical characteristics include the color, shape, finish, texture, unique stickers, or material of the accessory. Examples of physical features include a pattern, sticker, barcode, or hole on the accessory. Different reflection profiles are stored in the electronic device and each profile is mapped to a particular function of the electronic device.
In one embodiment, the method can be used to distinguish between different folios. For example, each folio can have a unique reflective surface (unique color, texture, size, pattern, etc.). As the folio is closed over the device (e.g., over the display that the folio protects) and over a proximity detector (EMR sensor) of the electronic device, the range between the folio cover and the EMR sensor is reduced (e.g., from about 1 foot, when the folio is not attached to the device to zero inches, when the folio is closed). The electronic device sweeps the power of one or more EMR transmitters (e.g., the power of infrared light-emitting diodes (LEDs)), the sensitivity of the EMR sensor, or both until the output of the EMR sensor is out of saturation (e.g., from 1 inch to 0 inches). The electronic device then captures a received reflection profile. Relying on colors may allow a limited number of folios to be identified. In one embodiment, the electronic device simply determines whether the color is bright, dark, or medium.
Turning toFIG. 1A, according to various embodiments, anelectronic device100 transmits EMR96 (e.g., infrared light, radio waves, or visible light), which is reflected off of anaccessory94 of theelectronic device100. Theelectronic device100 senses the reflected EMR98 and, based on characteristics of the reflected EMR98, carries out a predetermined function with respect to the accessory. Possible implementations of theelectronic device100 include a cell phone, smartphone, personal digital assistant, dedicated camera, and portable music player. Although depicted inFIG. 1 as a mobile electronic device, theelectronic device100 need not be mobile. Possible implementations of theaccessory94 include a folio, stylus, headset, a wearable product, and a dock for the electronic device (which could reflect a code for auto-pairing).
Turning toFIG. 1B, theelectronic device100, according to an embodiment, hashousing102, and adisplay104 integrated with thehousing102. Theelectronic device100 is attached to afolio106. Thefolio106 has acover108 that is attached to the rest of thefolio106 by ahinge110. Thecover108 has aninterior surface112. Integrated with thehousing102 and on or embedded within anupper surface114 of theelectronic device100 are anEMR sensor118, afirst EMR source120A, asecond EMR source120B, and athird EMR source120C (referred to generically as EMR source or sources120). Possible implementations of theEMR sources120 include infrared light sources (such as infrared light emitting diodes), radio frequency sources, and visible light sources.
Turning toFIG. 1C, thecover108 of thefolio106 has an embeddedwaveguide122 which, in one embodiment, is a thin, plastic structure such as a fiber fishing line. When thecover108 is closed over theelectronic device100, thewaveguide122 couples thesecond EMR source120B and thethird EMR source120C to theEMR sensor118 so that EMR originating from the second andthird EMR sources120B and120C are directed to theEMR sensor118. According to an embodiment,areas121 are transparent to the EMR emitted by theEMR sources120, thereby allowing interaction with theelectronic device100 using theEMR sources120 and theEMR sensor118 to take place when thecover108 is closed. According to one embodiment, theEMR sensor118 receives three serial reflections whencover108 is closed (from the three EMR sources120). As will be described in further detail below, these serial pulses result in potential nine potential folio combinations (000, 001, 010, 011, 100, 101, 110, 111) for a given color.
Turning toFIG. 2, the electronic device100 (FIG. 1) further includes one or morewireless transceivers201, anapplication processor203, amemory205, one or more output components207 (including the first, second, andthird EMR sources120A,120B, and120C), and one or more input components209 (including, if implemented with a touch screen, the display104). Stored within the memory105 is amapping data structure206. Anaccelerometer225 and theEMR sensor118 are electrically coupled to thesensor hub224. Thesensor hub224 may be implemented as a low-power processor (i.e., a processor that consumes less power than the application processor203), which can carry out methods described herein. The term “processor” may refer to either thesensor hub224 or to theapplication processor203. Other components of theelectronic device100 include aelectronic device interface215 and apower supply217. The components depicted inFIG. 2 are coupled directly or indirectly with one another by one or more communication links218 (e.g., an internal communication bus). Thewireless transceivers201 include acellular transceiver211 and a wireless local area network (“WLAN”)transceiver213.
In an embodiment of the disclosure, thesensor hub224, in addition to controlling the various sensors, also serves to control operation of the display104 (and the functionality that supports it) when theelectronic device100 is in a sleep mode. In contrast, which theelectronic device100 is awake, the display104 (and the functionality that supports it) is under the control of theapplication processor203.
Possible implementations of theapplication processor203 include a microprocessor, microcomputer, and application-specific integrated circuit. One or both theapplication processor203 and thesensor hub224 execute instructions retrieved from thememory205 in order to carry out methods and functions of the electronic device as described herein.
It is to be understood thatFIG. 2 is provided for illustrative purposes only, and is not intended to be a complete schematic diagram of the various components required for an electronic device.
Continuing withFIG. 2, themapping data structure206 maps different EMR characteristics (as detected by the EMR sensor118) to different functions to be carried out by theelectronic device100. Examples of functions include changing the lighting of thedisplay104, painting a particular area of thedisplay104, changing the color images on thedisplay104, turning on thedisplay104, turning off thedisplay104, changing an alert type for thedevice100, changing the volume of thedevice100, changing the call handling of thedevice100, launching an application, turning theelectronic device100 on, turning theelectronic device100 off, redirecting display updates (and user touch interactions) to/from a second (alternative) display, and putting theelectronic device100 into sleep mode
Turning back toFIG. 1B, one or more of theEMR sources120 project EMR, which is reflected off of the accessory94 (FIG. 1A). TheEMR sensor118 detects the reflected EMR and generates a signal based on characteristics of the reflected EMR. Such characteristics may include one or more of wavelength, frequency, waveform, reflection profile, reflection pattern, and reflection amplitude, of the reflected EMR98 (FIG. 1A). Thesensor hub224 receives the signal and provides the signal to the application processor203 (FIG. 2). Theapplication processor203 references the mapping data structure206 (FIG. 2) to select a function theelectronic device100 should perform.
Continuing withFIG. 1B, an example of a mapping between EMR characteristics and functions ofelectronic device100 is as follows: a first set of EMR characteristics maps to turning theelectronic device100 off, a second set of EMR characteristics maps to putting theelectronic device100 into a low-power mode, and a third set of EMR characteristics maps to displaying a clock atlocation104A. In addition to mapping EMR characteristics directly the functions, the mapping data structure206 (FIG. 2) may also map the visible light characteristics to the type or model of the accessory or to capabilities of the electronic device.
In an embodiment, the electronic device100 (FIG. 1B) transmits EMR having different characteristics in different time slots. This allows thedevice100 to identify which EMR source transmitted the EMR that reflected off of the accessory and is ultimately detected byEMR sensor118. In one example, thefirst EMR source120A transmits in the first time slot, thesecond EMR source120B transmits in the second time slot, and thethird EMR source120C transmits in the third time slot, with the process repeating.
According to an embodiment, one or more characteristics of the reflected EMR translate to a code, such as a binary code. An example scenario is as follows: reflected EMR that is predominately blue translates to a binary zero, while reflected EMR that is predominately red translates to a binary one.
According to an embodiment, theEMR sources120 transmit EMR in a sequential manner so that their reflected EMR translates into a multi-bit binary code. In this embodiment, when thecover108 is closed (FIG. 1C) theEMR sensor118 receives three serial reflections—one from thefirst EMR source120A (proximity reflection), one from thesecond EMR source120B (via thewaveguide122 or by allowing it to exit the folio through a window in that specific folio type and reflect off of the user) and one from thethird EMR source120C (via thewaveguide122 or allowing it to exit as previously discussed). These serial pulses could constitute a code that may potentially map to nine different folios (000, 001, 010, 011, 100, 101, 110, 111). Additionally, such a code can include not just colors and sequence—but could mix-in other reflection characteristics as well to create a more comprehensive code (from reflections).
In one example, thefirst EMR source120A pulses EMR for a 9.6 microsecond pulse every 10 millisecond interval beginning at time 0, thesecond EMR source120B pulses EMR for a 9.6 microsecond pulse every 10 millisecond interval beginning attime 120 microseconds (which is the gap between pulses) and thethird EMR source120C pulses EMR for a 9.6 microsecond pulse every 10 millisecond interval beginning at time 240 microseconds. In this way, theEMR sensor118 detects the reflected EMR from each EMR source at a distinct moment in time and translates each instance into a binary zero and a binary one, resulting in a three bit number. Each three bit number might be associated with a different folio or even a different accessory altogether. The mapping data structure206 (FIG. 2) could also map each three bit number to a different function that theelectronic device100 is to take, where each action is associated to thefolio106 or other type of accessory94 (FIG. 1A) with which theelectronic device100 is associated.
TurningFIG. 3, a description of the interaction between theelectronic device100 and thefolio106 in an embodiment of the disclosure will now be provided. Under normal use, thedistance302 between thefolio cover108 and theEMR sensor118 as well as theangle300 between them varies as a user opens or closes thefolio cover108. In one embodiment, theelectronic device100 determines a function to perform with respect to thefolio cover108 by varying the transmit power of one or more of theEMR sources120 the receive power of theEMR sensor118, or both, so as to take theEMR sensor118 out of a saturated state. Theelectronic device100 determines the reflection profile of thefolio cover108 which, in this embodiment, is the curve of outputsignal EMR sensor118 versus the angle of thefolio cover108 with respect to theEMR sensor118. Theelectronic device100 then refers to the mapping data structure206 (FIG. 2) to determine the function to which the reflection profile maps. The reflection profile represents the color of thefolio cover108, and the function to which the profile maps may relate one or both the color and reflectance of thefolio cover108. For example, if the reflection profile relates to the color red, the function to which the profile maps may be to display a clock shown on thedisplay104 atlocation104A a red tint.
In one example, the processor mapping data structure206 (FIG. 2) indicates that, based on the reflection profile, theelectronic device100 should, when thefolio cover108 is closed, display the time on thedisplay104 atposition104A—e.g., because thefolio cover108 has a translucent window atposition112A. In another example, if no window is available, theelectronic device100 should turn off thedisplay104 to conserve power.
Continuing withFIG. 3, according to an embodiment, for theelectronic device100 to be able to distinguish colors, theEMR sensor118 needs to operate in the linear region (not saturated). For example, if the accessory is thefolio106, then after theelectronic device100 detects thecover108 has been closed—i.e., theelectronic device100 sweeps the transmit power of theEMR sources120 or the gain of theEMR sensor118, or both—the electronic device monitors the rise in the output of theEMR sensor118 from zero toward saturation. Alternatively, theelectronic device100 could start the sweep at saturation and end at zero. Based on the rise profile while in the linear region (i.e., the reflection profile), theelectronic device100 begins to determine what the color thecover108 is or what type of folio thefolio106 is.
Put another way, the transmit power of theEMR sources120, the gain of theEMR sensor118, or both are swept following closure of thecover108 from high to low or low to high (low corresponds to little or no detection by theEMR sensor118, while high corresponds to high detection or saturation detection). Theelectronic device100 captures the reflected EMR while sweeping the transmit power of theEMR sources120 or receive gain of theEMR sensor118, or both, over a range of transmit powers and sensitivities. This capture represents a reflection profile.
Each folio color or folio material maps to a reflection profile. For example, bright colors cause theEMR detector118 to generate an output signal sooner and reach saturation levels much earlier than other colors when thecover108 of thefolio106 is closed and vice versa. Each folio has a profile associated with it (slope, curve shape, etc.). These profiles are stored in the mapping data structure206 (FIG. 2). Once thecover108 is detected and closed, theelectronic device100 compares the detected profile with the stored profiles in order to identify the folio and sets the functionality of theelectronic device100 accordingly.
FIG. 4 depicts reflection profiles400 according to an embodiment. The reflection profiles400 is plotted on a graph whose x-axis is the angle300 (FIG. 3) between thefolio cover108 and theEMR sensor118, and whose y-axis is the output signal of theEMR sensor118. Region S represents the saturation region of theEMR sensor118. Thefirst reflection profile402 shows a lower reflectance for thelower surface112, thus indicating that thelower surface112 has one or more of the following qualities: a lower reflectance color, a darker color (e.g., black), flatter material, or coarser material. In contrast, thesecond reflection profile404 shows a higher reflectance for the lower surface112 (requiring further separation between the device and folio to get out of saturation), thus indicating that thelower surface112 has one or more of the following qualities: a higher reflectance color, a lighter color (e.g., silver), a higher reflectance (e.g., shiny) material, or a smooth.
According to another embodiment, depicted inFIGS. 5A,5B, and5C, thelower surface112 of thefolio cover108 has afirst pattern500 that indicates a first function that theelectronic device100 is to perform. Accordingly, themapping data structure206 maps the different patterns to respective functions of theelectronic device100. The first pattern has white portions504 and dark portions506. As thefolio cover108 is closed—i.e., theangle502 between thelower surface112 of thefolio cover108 changes, the EMR transmitted from theEMR source120 moves across different parts of thefirst pattern500. As the EMR from the EMR source reflects off of a dark portion506 of thepattern500, the output signal (FIG. 5C) of the EMR sensor118 (which is based on the reflected EMR) drops, whereas when the EMR from theEMR source120 reflects off of a white portion504, the output signal rises.
FIGS. 6A,6B, and6C depict thelower surface112 of thefolio cover108 having a second,broken pattern600 that indicates a second function that theelectronic device100 is to perform. Thesecond pattern600 has white portions604 and dark portions606. As with the example ofFIGS. 5A,5B, and5C, when thefolio cover108 is closed, theangle602 between thelower surface112 of thefolio cover108 changes, and the EMR transmitted from theEMR source120 moves across different parts of thesecond pattern600. As the EMR from the EMR source reflects off of a dark portion606 of thepattern600, the output signal (FIG. 6C) of theEMR sensor118 drops, whereas when the EMR from theEMR source120 reflects off of a white portion604, the output signal rises.
Turning toFIG. 7, amethod700 according to an embodiment of the disclosure proceeds as follows. Atblock702, the electronic device (FIG. 1A) transmits EMR to an accessory94 (arrow96). Atblock704, theelectronic device100 detects a reflection of the EMR off of the accessory94 (arrow98). A characteristic of the reflected EMR maps to a predetermined function of theelectronic device100, and the predetermined function is associated with theaccessory94. Atblock706, theelectronic device100 performs the predetermined function.
It can be seen from the foregoing that a method, electronic device, and accessory for carrying out functions based on reflected electromagnetic radiation have been described. It should be understood that the exemplary embodiments described therein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each embodiment should typically be considered as available for other similar features or aspects in other embodiments.
While one or more embodiments of the have been described with reference to the figures, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from their spirit and scope of as defined by the following claims.