CROSS-REFERENCE TO RELATED APPLICATION(S)This application is a continuation patent application of U.S. patent application Ser. No. 15/692,810, filed Aug. 31, 2017, entitled “Keyless Keyboard with Force Sensing and Haptic Feedback,” which is a nonprovisional patent application of and claims the benefit of U.S. Provisional Patent Application No. 62/393,989, filed Sep. 13, 2016, entitled “Keyless Keyboard with Force Sensing and Haptic Feedback,” the disclosure of which is hereby incorporated herein by reference in its entirety.
FIELDThe described embodiments relate generally to computing input devices. More particularly, the present embodiments relate to force- and/or touch-sensitive input devices having haptic feedback.
BACKGROUNDTraditional computing input devices, such as mice, keyboards, and trackpads, tend to operate using dedicated keys or buttons. The operation of each key or button may be tied to a particular function or command. However, traditional input devices lack the flexibility to accommodate expansive features offered by newer devices, operating systems, and software. As a further drawback, the dedicated keys or buttons of traditional input devices are unable to adapt to different user needs and preferences.
Alternative input devices, such as touch-input devices, appear to offer some greater flexibility for input scenarios and customization than mechanical keyboards, mice, and similar input devices. However, touch sensitive input devices often have a flat, inflexible input surface that gives little or no tactile feedback to a user and may therefore be less desirable for many scenarios than traditional input devices.
Therefore, improved input devices are needed to provide both greater flexibility and customizability while providing feedback to a user during operation.
SUMMARYAn input device for an electronic device may include an enclosure and a top member coupled to the enclosure and defining an input surface having multiple differentiated input regions. The input device may further include a first force sensing system associated with a first area of the top member including a first group of the differentiated input regions, the first force sensing system configured to determine a first force associated with a first force input applied within the first area, and a second force sensing system associated with a second area of the top member including a second group of the differentiated input regions, the second force sensing system configured to determine a second force associated with a second force input applied within the second area. The input device may further include a touch sensing system configured to determine which input region from the first group of the differentiated input regions corresponds to the first force input and to determine which input region from the second group of the differentiated input regions corresponds to the second force input.
The first force sensing system may be configured to determine the first force independently of the second force sensing system. The first group of the differentiated input regions may correspond to keys typically selected by a first finger of a user's hand, and the second group of the differentiated input regions may correspond to keys typically selected by a second finger of the user's hand.
The multiple differentiated input regions may correspond to keys of a keyboard. The multiple differentiated input regions may be visually differentiated on the top member. The input device may be configured to detect a key press of a particular input region by detecting, within a given group of the differentiated input regions, both a touch location and a force value satisfying a force threshold. The input device may further comprise a haptic output system configured to produce a tactile output in response to detecting the key press.
The haptic output system may include a first actuator having a first actuation axis along a first direction and a second actuator having a second actuation axis along a second direction that is not parallel to the first direction. The input device may be configured to alternate between actuating the first actuator and the second actuator in response to detecting successive key presses.
The first and the second force sensing systems may be part of a group of force sensing systems, and the group of force sensing systems may define two rows of force sensing regions on the top member. The first and second groups of the differentiated input regions may be oriented substantially diagonally with respect to a longitudinal axis of the input device.
A keyboard for an electronic device includes an enclosure and a cover coupled to the enclosure and defining an input surface. The keyboard also includes a first actuator within the enclosure and coupled to the cover and a second actuator within the enclosure and coupled to the cover. The first actuator is configured to impart, to the cover, a first force along a first axis that is substantially parallel to the input surface, and the second actuator is configured to impart, to the cover, a second force along a second axis that is perpendicular to the first axis and substantially parallel to the input surface.
The first actuator may be configured to oscillate along the first axis to impart the first force to the cover, and the second actuator may be configured to oscillate along the second axis to impart the second force to the cover. The keyboard may further include a force sensing system within the enclosure and configured to detect the successive force inputs on the input regions.
The keyboard may be incorporated into an electronic device that includes a display coupled to the enclosure, wherein the display is distinct from the keyboard. The input surface may include input regions representing character input keys, and the first actuator and the second actuator may be configured to provide haptic feedback to a user to induce a sensation representative of a mechanical key. The keyboard may be configured to alternate between actuating the first actuator and the second actuator in response to successive force inputs on the input regions. The keyboard may also or instead be configured to actuate the first and second actuator substantially simultaneously (or such that the actuations of the first and second actuators overlap in time).
A force sensing system for an electronic device may include a cover defining an input surface comprising multiple input regions each corresponding to an input key. The cover may be configured to locally deform in response to an input force applied to an input region of the multiple input regions. The force sensing system may include a capacitive sense layer below the cover, a compliant material between the cover and the capacitive sense layer and below the input regions, and a processor electrically coupled to the capacitive sense layer. The processor may be configured to determine a force value of the input force based on a change in capacitance between the capacitive sense layer and an input member applied to the input region, and determine a location of the input force based on which of a set of electrodes detected the change in capacitance. The capacitive sense layer may include a set of electrodes each having an area that is the same or smaller than an area of the input regions. The force sensing system may be configured to differentiate between force inputs having centroids about 3.0 cm apart or less.
The force sensing system may be coupled to a lower portion of an enclosure of a notebook computer and may be configured as a keyboard for the notebook computer. The multiple input regions may be visually differentiated to define a keyboard for the notebook computer. The notebook computer may include a display coupled to an upper portion of the enclosure.
The cover may be formed from a glass. The glass may have an elastic modulus in a range of about 60 to about 80 GPa. The glass may have a thickness in a range of about 0.1 to about 0.5 mm. The compliant material may have a thickness in a range of about 0.5 mm to about 2.0 mm. The compliant material may be a foam.
The force sensing system may exclude additional capacitive sense layers between the cover and the compliant material.
The input surface may include multiple input regions each corresponding to an input key, and the capacitive sense layer may include a set of electrodes each having an area that is the same or smaller than an area of the input regions.
A method of detecting a key press includes determining a number of fingers in contact with an input surface of an electronic device, and determining a force threshold indicative of a key press based at least in part on the number of fingers in contact with the input surface. The method may further include detecting a force input that satisfies the force threshold, and in response to detecting the force input, registering a selection of an input region corresponding to a text character.
The operation of determining the number of fingers in contact with the input surface may include using a touch sensing system to determine the number of fingers in contact with the input surface. The force threshold may be between about 25 and 150 grams higher than a baseline force for the determined number of fingers in contact with the input surface.
The method may further include detecting a touch input corresponding to a movement across the input surface, and in response to detecting the touch input corresponding to the movement across the input surface, changing a position of a cursor on a display of the electronic device. The operation of detecting the force input may include detecting the force input with a force sensing system, and the operation of detecting the touch input comprises detecting the touch input with a touch sensing system.
BRIEF DESCRIPTION OF THE DRAWINGSThe disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
FIG.1 depicts an example input device.
FIG.2 depicts an example input device with haptic actuators.
FIGS.3A-3C depict simplified cross-sectional views of the input device ofFIG.2 showing an example haptic output.
FIGS.4A-4C depict simplified cross-sectional views of the input device ofFIG.2 showing another example haptic output.
FIGS.5A-5C depict simplified cross-sectional views of the input device ofFIG.2 showing yet another example haptic output.
FIGS.6A-6C depict simplified cross-sectional views of the input device ofFIG.2 showing an example haptic actuator.
FIGS.6D-6E depict example arrangements of haptic actuators relative to a cover of an input device.
FIGS.7A-7B depict an input device with example force sensing regions.
FIGS.8A-8C depict simplified cross-sectional views of a force sensing system.
FIGS.9A-9B depict simplified cross-sectional views of a force sensing system, showing example capacitive sensors.
FIGS.10A-10C depict an example localized force sensing system.
FIGS.11A-11B depict simplified cross-sectional views of a force sensing system, showing example strain gauges.
FIG.12 depicts a simplified cross-sectional view of a force sensing system, showing an example force sensing element.
FIG.13 is a graph illustrating example force thresholds.
FIG.14 depicts an example process of detecting a key press.
FIGS.15A-15C depict generation of input regions according to user interaction.
FIGS.16-17 depict examples of software interactions with an input device with an adaptive display.
FIGS.18-19 depict example embodiments of input devices.
FIG.20 depicts an example electronic device.
The use of cross-hatching or shading in the accompanying figures is generally provided to clarify the boundaries between adjacent elements and also to facilitate legibility of the figures. Accordingly, neither the presence nor the absence of cross-hatching or shading conveys or indicates any preference or requirement for particular materials, material properties, element proportions, element dimensions, commonalities of similarly illustrated elements, or any other characteristic, attribute, or property for any element illustrated in the accompanying figures.
Additionally, it should be understood that the proportions and dimensions (either relative or absolute) of the various features and elements (and collections and groupings thereof) and the boundaries, separations, and positional relationships presented therebetween, are provided in the accompanying figures merely to facilitate an understanding of the various embodiments described herein and, accordingly, may not necessarily be presented or illustrated to scale, and are not intended to indicate any preference or requirement for an illustrated embodiment to the exclusion of embodiments described with reference thereto.
DETAILED DESCRIPTIONReference will now be made in detail to representative embodiments illustrated in the accompanying drawings. It should be understood that the following descriptions are not intended to limit the embodiments to one preferred embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as can be included within the spirit and scope of the described embodiments as defined by the appended claims.
The following disclosure relates to an input device that uses touch and/or force sensing to detect user inputs, and uses haptic outputs to provide feedback to a user. One example of such an input device is a keyboard that does not have mechanical or movable keys. Instead, the keyboard may have a flat, keyless input surface, such as a glass or metal layer, and may include touch and/or force sensing systems to determine when a user touches and/or presses on the surface. Haptic actuators may provide physical feedback to indicate that a user has pressed the keyless surface with sufficient force to register an input. The haptic actuators may induce a physical sensation that is similar to or representative of a mechanical key. For example, when a user presses the surface of the keyboard with sufficient force, the surface may vibrate or otherwise move to indicate to the user that the intended input has been registered.
Using force sensing in addition to touch sensing may allow a user to use a keyless keyboard more similarly to a mechanical keyboard. For example, when typing, users typically rest multiple fingers on the keyboard. With only touch sensing on a keyless keyboard (e.g., without force sensing), it may be difficult or impossible to determine whether a user is attempting to select a particular key, or whether the user is merely resting a finger on that key. Force sensing, instead of or in addition to touch sensing, allows a keyless keyboard to differentiate between incidental contact and intentional key selections.
Force sensing in a keyless keyboard may be either global or local. For global force sensing, the keyboard may determine a total amount or magnitude of force applied to the surface regardless of the position or number of fingers on the surface. As noted above, however, users may rest their fingers on keys that are not being actively selected. Moreover, different users may rest different numbers of fingers on the keys, or rest them with different amounts of force. And the same user may rest different numbers of fingers on the keys at different moments while typing. Thus, the force threshold for detecting a key press may change depending on how many fingers are touching the keyboard. Accordingly, a keyboard with global force sensing may set a force threshold that determines whether a key is pressed based on the number of fingers that are in contact with the surface at a given time (as detected by a touch sensing system, for example).
For local force sensing, the keyboard may determine an amount or magnitude of force applied to a particular location or locations on the surface. One example local force sensing system uses a pixelated capacitive sense layer below the surface of the keyboard. When pressed, the user's finger may form a depression in the keyboard surface beneath the finger. The pixelated capacitive sense layer may detect the depth and/or location of the depression to determine both an amount and a location of a force. Keyboards may use either global or local force sensing alone, or they may use a combination of these techniques.
Haptic output may also be global or local. For global haptic outputs, the entire keyboard surface may move to provide a haptic output. In such cases, all of the fingers that are resting on the keyboard surface may sense the haptic output. Global haptic outputs may be produced, for example, with a haptic actuator that moves the entire surface in-plane with an input surface of the keyboard (e.g., an x- or y-direction) or out-of-plane with the input surface (e.g., a z-direction). In some embodiments, in order to provide discrete global haptic outputs for subsequent key presses, multiple haptic actuators may be provided. For example, a single haptic actuator that vibrates the input surface may not be able to produce successive, discrete haptic outputs with a key-strike frequency of a user. Accordingly, multiple haptic actuators may be used. In some cases, the actuators may produce different haptic outputs, such as vibrations in different directions. Users may be able to differentiate between such outputs, even if they are produced substantially simultaneously.
For local haptic outputs, only a portion of the keyboard may move. For example, localized haptic actuators such as piezoelectric elements may cause localized deformations in the surface that are felt only (or primarily) by a finger directly under the deformation. In another example, electrostatic elements may selectively apply an electrostatic charge to the input surface or to portions thereof. The electrostatic charge may alter or modify a tactile or touch-based stimulus that is perceived by a user. The electrostatic charge may cause an actual or perceived change in friction or surface roughness between an object (e.g., the user's finger) and the input surface by electrostatically attracting the user's finger to the surface. A keyboard may use global or local haptic outputs, alone or in combination, to provide a desired haptic output to the user.
Because the keyboard does not have mechanical keys, the keyboard may provide numerous other features and functions beyond mere keyboard input. For example, the keyboard may include an adaptive display to render visual information, such as an outline of an input region (e.g., representing a key) and an indication of its function (e.g., a glyph). In this way, the location, size, spacing and/or arrangement of the keys may vary. As another example, the input surface of the keyboard may act as a touch pad to detect touch inputs (e.g., moving a cursor, manipulating user interface elements) as well as typing inputs.
While the instant discussion uses a keyboard as an example input device that uses force sensing to detect inputs and haptic outputs to provide tactile feedback, these techniques may be used in other input devices as well. For example, where the input device includes an adaptive display, the display may present representations of varied affordances or objects that can be manipulated and for which physical feedback can be provided, such as audio mixers, buttons, musical instruments, etc. Moreover, force sensing and haptic outputs may be used in devices other than flat, keyboard-like input devices. For example, a rotating input device, such as a knob, may detect inputs with force sensing systems and provide haptic outputs to convey feedback to a user.
These and other embodiments are discussed below with reference to the figures. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes only and should not be construed as limiting.
FIG.1 illustrates anexample keyboard100 that uses force sensing systems to detect user inputs and uses haptic actuators to provide tactile outputs. As shown, thekeyboard100 is in the form of a stand-alone keyboard. However, thekeyboard100 may be coupled to other devices (physically and/or communicatively), such as a desktop computing system (FIG.18), a laptop or notebook computing system (FIGS.16 and17), a cover for a portable electronic device (FIG.19), a mouse, and so on. Example internal components of the keyboard100 (and/or a computing device to which thekeyboard100 may be physically or communicatively coupled) are described below with respect toFIG.20.
As shown inFIG.1, thekeyboard100 includes anenclosure102 and a top member or cover104 coupled to theenclosure102. Theenclosure102 may provide structural support to the top member or cover104, and may include additional features such as asupport stand108. As described herein, thekeyboard100 may include within theenclosure102 components such as force sensing systems, haptic actuators, touch sensing systems, display components, and the like.
The cover104 (or top member) defines an input surface of thekeyboard100. In the present example, thecover104 is positioned on a top surface of thekeyboard100, instead of physical keys. Thecover104, or top member, may be or may include any appropriate materials, such as glass, metal, plastic, etc. Thecover104 may include or be coupled to other layers, such as filters, coatings, touch-sensitive layers, liquid crystal layers, display components (e.g., organic light emitting diode (OLED) layers, light sources, light guides), and the like. Although shown without any mechanical keys, thekeyboard100 may also include one or more mechanical keys.
Thecover104 may operate as a touch-sensitive surface. For example, thecover104 may respond to a touch input and may include or be coupled to a touch sensing system configured to determine the location of a touch input on thecover104. Thecover104 may receive a wide variety of touch inputs, which may be used to interpret a diverse set of commands or operations.
Thecover104 may additionally or alternatively be configured to operate as a force-sensitive surface. For example, thecover104 may include or be coupled to a force sensing system configured to detect a location and/or amount of force applied to thecover104. The force sensing system may include (or may be operably connected to) force sensing circuitry configured to determine or estimate an amount of applied force. The force sensing circuitry may output a signal or otherwise register that an input has been detected in response to determining an amount of force that exceeds a force threshold. The force threshold may be fixed or variable, and more than one threshold may be provided corresponding to different inputs. For example, the threshold may be based on the number of fingers in contact with thecover104.
Thecover104 may also includedifferentiated input regions106. For example, at least some of thedifferentiated input regions106 may correspond to character input keys (e.g., alphanumeric characters, symbolic characters, text spaces, tabs, and the like). In some cases, other keys may control other aspects of a device without necessarily resulting in a character input (e.g., to control audio volume, screen brightness, or other device functions).
Thedifferentiated input regions106 may be regions of a cover (or other top member that defines an input surface) that are visually and/or tactilely differentiated or distinguished from one another with paint, ink, etching, grooves, bumps, ridges, textures, or the like.Differentiated input regions106 may correspond to character input keys (e.g., keys of an alphanumeric keyboard), buttons, or other affordances.Differentiated input regions106 may be referred to herein simply asinput regions106.
In some cases, thedifferentiated input regions106 may be differentiated from one another virtually. For example, thecover104 may include or be part of an adaptable display. The adaptable display may be an illuminated display that is configured to display visual indicia that correspond to one or moredifferentiated input regions106. Where thedifferentiated input region106 is virtually defined by the adaptable display, it may be referred to as a virtual key. One or more different sets of visual indicia may be displayed, depending on the type of affordance being emulated, user preference, and/or an application being controlled by thekeyboard100.
Thekeyboard100 may also include various other components or devices depicted or not depicted inFIG.1. In particular, thekeyboard100 may also include one or more ports or electrical connectors positioned along one or more sides of theenclosure102. The ports may include, for example, a USB connection port, an IEEE 1394 data port, audio connection port, video connection port, or other electrical hardware port that is configured to transmit and/or receive signals or data. The ports may also include a power connection port that is configured to receive electrical power from an external source such as a wall outlet or other power source. Thekeyboard100 may also include awired communication connection110 for connecting to another device, or thekeyboard100 may include wireless transmitters and/or receivers for communicating with another device. Other internal components may be included, such as a processing unit. Several such internal components are described below with respect toFIG.20.
As noted above, thekeyboard100 may include haptic actuators that are configured to move or otherwise impart a force to theentire cover104 or top member of thekeyboard100.FIG.2 is a top view of thekeyboard100, illustrating an example that includes afirst actuator202 and asecond actuator206 within theenclosure102 and coupled to thecover104. The first andsecond actuators202,206 may be coupled anywhere within or to thekeyboard100 as long as they impart a force to thecover104 or otherwise produce a haptic output detectible on a top member of thekeyboard100.
The first andsecond actuators202,206 may impart to thecover104 or other top member forces along different axes or directions. For example, thefirst actuator202 may impart a force along an actuation axis or direction indicated by thearrow204, while thesecond actuator206 may impart a force along an actuation axis or direction indicated by thearrow208. These directions may be substantially perpendicular to one another, though other relative orientations are also possible (e.g., parallel, 45 degrees, 30 degrees, etc.).
A single actuator may not be capable of providing haptic outputs (or desirable haptic outputs) at a rate sufficient to keep up with some users' typing speed. For example, some typists may strike keys at a frequency of up to ten characters per second (or more), and a single haptic actuator may not be able to produce outputs at this frequency, especially haptic outputs with relatively longer durations (e.g., outputs that are longer than 100 ms). Outputs of such durations may be desirable, however, to more closely mimic the tactile sensation of clicking on a mechanical key, or to otherwise provide a desirable user experience. Accordingly, a second haptic actuator may be provided.
By positioning the first andsecond actuators202,206 so that they impart perpendicular forces on thecover104, interference between the motions or vibrations caused by the actuators may be reduced. For example, if the first andsecond actuators202,206 imparted forces along the same axes, the motions or vibrations imparted to thecover104 by each actuator may cancel each other out, or otherwise interfere with each other. Moreover, it may be difficult or impossible for a user to differentiate haptic outputs from the different actuators, especially when they are both active at the same time (e.g., to indicate simultaneous or overlapping key presses). By having the actuators apply force in different directions (e.g., along perpendicular or non-parallel directions), a user may be able to discern when two haptic outputs are provided, even if the outputs overlap. While the outputs may feel the same or similar to one another (e.g., a user may not be able to differentiate the direction of the haptic actuator that produced a particular output), the start and/or end of a haptic output from one actuator may be detectable to a user even when it occurs during a haptic output from the other actuator.
The first andsecond actuators202,206 may be actuated in an alternating pattern. In some cases, the first andsecond actuators202,206 may be actuated in an alternating pattern only when a typing speed (e.g., a frequency of force inputs) exceeds a certain value, such as a frequency that is above the response frequency of only a single actuator. In such cases, if the typing speed is below the value, only one of the actuators may be used (or they may be used in a pattern other than an alternating pattern). Other patterns or schemes for actuating the first andsecond actuators202,206 in response to force inputs are also contemplated.
The first andsecond actuators202,206 may be any appropriate mechanisms or systems for producing haptic outputs or otherwise imparting a force to thecover104. Suitable actuators may include electromechanical actuators, piezoelectric actuators (e.g., piezoelectric actuators coupled directly to thecover104, piezo benders below thecover104 that lift or move the cover104), linear actuators, voice coil motors, Lorentz force actuators, electro-active polymer actuators, and so on. For example, the first andsecond actuators202,206 may be linear actuators each including a coil and a corresponding magnet, where passing a current through a coil moves the corresponding magnet (or otherwise imparts a force on the magnet).
The first andsecond actuators202,206 may impart forces to thecover104 to produce varying kinds of haptic outputs. For example, the first andsecond actuators202,206 may oscillate along their respective axes (arrows204,208 inFIG.2), thus imparting a vibration or oscillation to thecover104. As another example, the first andsecond actuators202,206 may impart a single impulse (e.g., a single application of force in a single direction) to thecover104. In either case, the force may be applied to a move a weight that is coupled to the actuator, or the force may be applied directly to thecover104.
WhileFIG.2 illustrates two actuators, some embodiments may include more actuators. In such cases, the actuators may be positioned to impart forces or oscillations along different directions (e.g., offset by 45 degrees from one another). Alternatively, some of the actuators may impart forces or oscillations along the same directions.
The first andsecond actuators202,206 may impart forces to the cover104 (or top member) that are in plane (or substantially in plane) with the input surface defined by thecover104 or other top member.FIGS.3A-3C depict a simplified cross-sectional view of the input device ofFIG.2, viewed along line B-B inFIG.2. For simplicity, the cross-section shown inFIGS.3A-3C does not include internal features, components, layers, sensors, etc. that may be present in thekeyboard100. Moreover, the position of thesecond actuator206 is merely for illustration, and may be positioned in a different location or to a different component than shown inFIGS.3A-3C. For example, thekeyboard100 may include additional layers or components below (and optionally coupled to) thecover104. In such cases, thesecond actuator206 may be below the additional layers or components.
FIG.3A shows thekeyboard100 before afinger300 touches thecover104. In this state, thesecond actuator206 is at rest.FIG.3B shows thekeyboard100 after an input has been registered by thekeyboard100 or a device coupled to the keyboard (e.g., after thefinger300 has pressed on thecover104 with a force that satisfies a force threshold). Thesecond actuator206 imparts a force on thecover104 that causes thecover104 to move in the direction ofarrow302. Thesecond actuator206 may then reverse the direction of the force, causing thecover104 to move in the direction of arrow304 (FIG.3C). The motion of thecover104 may be a wholesale motion of the cover104 (e.g., the cover moves, even if only microns in either direction), or it can correspond to motion caused by a vibration or oscillation propagating through thecover104 in the directions of thearrows302,304 (which may not result in a translation of the cover104).
FIGS.2 and3A-3C illustrate actuators that impart forces that are in-plane (e.g., substantially parallel) to a top member of thekeyboard100. However, other types of actuators may be used instead or in addition to those described above. For example,FIGS.4A-4C depict an example of thekeyboard100 where an actuator causes the top member to move in a direction that is out-of-plane with the input surface of the top member (e.g., perpendicular to the direction of a force input).
FIGS.4A-4C depict a partial cross-sectional area of thekeyboard100, viewed along line B-B inFIG.2, illustrating an out-of-plane haptic output that may be produced by an actuator. As depicted inFIG.4A, when afinger400 is detected approaching the cover104 (e.g., by a capacitive touch sensing system), thecover104 may be moved upward (indicated by the arrow402) by an actuator. As thefinger400 continues its downward motion, the actuator may permit or cause thecover104 to move downward, as indicated by thearrow404 inFIG.4B. Once thefinger400 moves a threshold distance or releases downward pressure, the actuator may move the input surface upward (indicated by thearrow406 inFIG.4C), which may return the input surface to its original position or move it further upward.
In embodiments where thewhole cover104 moves (e.g., as described with respect toFIGS.3A-3C and4A-4C), thecover104 may be suspended relative to theenclosure102 by a suspension system (not shown). The suspension system may take many forms, and may include springs, foams, compliant members or materials, or other mechanisms that allow thecover104 to move relative to theenclosure102 to provide a haptic output.
In some embodiments, a subset of the movements depicted inFIGS.4A-4C may be implemented. For example, in response to a force input, an actuator may cause thecover104 to “pop” or deflect upwards as depicted inFIG.4A and quickly return. As another example, the actuator may instead cause thecover104 to deflect downward as depicted inFIG.4B and quickly return as depicted inFIG.4C in response to the force input.
The haptic outputs described with respect toFIGS.2-4C are examples of actuators that produce global haptic outputs, or haptic outputs that affect or can be felt across the entire surface of thekeyboard100. In some cases, local haptic outputs may be used instead of or in addition to global haptic outputs. For example,FIGS.5A-5C depict a partial cross-sectional area of thekeyboard100, viewed along line B-B inFIG.2, illustrating a local haptic output that may be produced by an actuator or a combination of actuators.
As shown inFIG.5A, as afinger500 approaches aninput region502 of thecover104, a sensor such as a touch or proximity sensor may detect the presence and/or approach of thefinger500. Once thefinger500 is detected approaching, an actuator may cause theinput region502 of thecover104 to move upward to meet thefinger500. For example, an electromechanical or piezoelectric actuator operatively coupled to thecover104 may be actuated to cause a localized deflection of theinput region502. The actuators that locally deform thecover104 may be any suitable actuator, such as electromechanical actuators, piezoelectric actuators (e.g., piezoelectric actuators coupled directly to thecover104, piezo benders below thecover104 that locally deform the cover104), linear actuators, voice coil motors, Lorentz force actuators, electro-active polymer actuators, and so on.
As thefinger500 continues to press downward, the actuator may allow theinput region502 to move downward as depicted inFIG.5B. As depicted inFIG.5C, once thefinger500 moves a threshold distance or releases downward pressure, the actuator may cause theinput region502 to move upward again, whether returning theinput region502 to its original position or moving further upward. Whether the movements depicted inFIGS.5A-5C are implemented individually or together, they may provide to a user the sensation of a click or motion similar to a key or button press. In some embodiments, multiplesuch input regions502 may be defined and separately controllable across thecover104 to provide localized feedback across the input surface defined by the cover104 (or other top member).
As noted above, in some embodiments, a subset of the movements depicted inFIGS.5A-5C may be implemented. For example, in response to a force input, an actuator may cause theinput region502 to “pop” or deflect upwards as depicted inFIG.5A and quickly return. As another example, the actuator may instead cause theinput region502 to deflect downward as depicted inFIG.5B and quickly return as depicted inFIG.5C in response to the force input.
FIGS.6A-6C depict simplified cross-sectional views of the input device ofFIG.2, viewed along line B-B inFIG.2, showing an examplehaptic actuator601 that may produce localized deformations or deflections of acover104. For example, thehaptic actuator601 may be configured to retract and/or extend vertically (as oriented inFIGS.6A-6C) to impart tactile outputs to thecover104.FIG.6A shows thehaptic actuator601 in a resting or neutral state, whileFIG.6B shows thehaptic actuator601 in a retracted state, resulting in a localized depression of thecover104.FIG.6C shows thehaptic actuator601 in an extended state, resulting in a localized protrusion of thecover104.
Thehaptic actuator601 may be affixed to thecover104 and a lower support, such as theenclosure102, so that when thehaptic actuator601 retracts (e.g., is shortened vertically), thehaptic actuator601 pulls down on thecover104 and locally deforms and/or deflects thecover104. Thehaptic actuator601 may be affixed to thecover104 and the enclosure102 (or any other suitable component or structure) with an adhesive, such as a pressure or heat sensitive adhesive, epoxy, glue, or the like.
Thehaptic actuator601 may include electrode layers604 (e.g.,604-1, . . . ,604-n) interleaved with compliant layers602 (e.g.,602-1, . . . ,602-n). In order to produce haptic outputs, and in particular to retract or shorten theactuator601, the electrode layers604 may be selectively electrically charged such that the electrode layers (e.g., adjacent electrode layers) are attracted to one another. For example, a first electrode layer604-1 may be positively charged and a second electrode layer604-2 may be negatively charged, thus causing the first and second electrode layers604-1,604-2 to be attracted to one another. This attraction force may result in a first compliant layer602-1 being deformed as the first and second electrode layers604-1,604-2 are drawn together by the attractive force between the electrodes (e.g., an electrostatic force). Similar charges may be applied to other electrode layers604 to cause the wholehaptic actuator601 to retract. On the other hand, to extend thehaptic actuator601 to produce an upwards force on the cover104 (e.g., to form a protrusion), the electrode layers604 may be electrically charged with a same or similar charge, causing the electrode layers604 to repel one another. For example, all of the electrode layers604 may be positively charged. The resulting repulsive force (e.g., electrostatic repulsion) may cause the compliant layers602 to stretch vertically, thus producing a localized protrusion or deformation in thecover104.
Thehaptic actuator601 may be configured to produce various types of haptic outputs. For example, thehaptic actuator601 may be repeatedly pulsed to produce a vibration, or it may be actuated once to produce a deformation in one direction followed by a return to a neutral state, producing a single “pop” type haptic output. These and other types of haptic outputs may include retractions of thehaptic actuator601, extensions of the haptic actuator, or both types of movements. For example, a vibration may be produced by cyclically applying a certain charge to the electrode layers604 so that they are attracted to adjacent electrode layers604, thus compressing the compliant layers602 and retracting theactuator601. When the charge is removed between cycles, the electrode layers604 may produce no forces, thus letting thehaptic actuator601 return to a neutral position. Similarly, a vibration may be produced by cyclically applying a charge to the electrode layers604 that result in the electrode layers604 repelling one another, followed by removal of the charges to allow thehaptic actuator601 to return to the neutral position. A vibration may also be produced by alternating between attractive and repulsive charges, resulting in an alternating retraction and extension of theactuator601. Similar modes of operation may be used to produce non-repeating haptic outputs, such as a single “pop” type output described above.
WhileFIGS.6A-6C show a singlehaptic actuator601, a keyboard (e.g., the keyboard100) or other input device or device may include multiplehaptic actuators601.FIG.6D shows an example arrangement ofhaptic actuators601 relative to thecover104. In particular,FIG.6D showshaptic actuators601 arranged in a keyboard pattern in which at least oneactuator601 is beneath each input region (which may correspond to keys of a keyboard layout). For example, asingle actuator601 may underlie each letter and number key, while some input regions, such as aregion605 that may correspond to a space bar, may includemultiple actuators601. In some cases, instead of mappingactuators601 to particular input regions, as shown inFIG.6D, theactuators601 may be arranged in a grid pattern. Alternatively, thekeyboard100 may include a discretehaptic actuator601 for each of a subset of keys, while other keys share ahaptic actuator601. For example, each letter and number key of thekeyboard100 may correspond to a differenthaptic actuator601, while other groups of non-letter keys, such as a tab key, caps lock key, left-shift key, and left control key, may share a commonhaptic actuator601.
FIG.6E shows another example arrangement ofhaptic actuators601 relative to thecover104. In this example, thehaptic actuators601 may be formed from a single sheet or otherwise interconnected via one or moreconnecting elements606. The connectingelements606 may be the same material that formed the compliant layers602 of theactuators601 themselves. In some cases, thehaptic actuators601 and the connectingelements606 may be an integrated structure. For example, thehaptic actuators601 and the connectingelements606 may be formed by cutting continuous sheets of compliant material to form theactuators601, the connectingelements606, andgaps610. Such sheets may then be laminated with the electrodes604 to form a unitary sheet ofactuators601 and connectingelements606. While the connectingelements606 may join thehaptic actuators601 into a single common structure, the connectingelements606 may omit the electrode layers604. This configuration can maintain electrical isolation of theactuators601 to allow independent actuation of theactuators601.
Thegaps610 may provide clearance around thehaptic actuators601 to allow lateral deformation of theactuators601 when the actuators are compressed. In some cases thegaps610 are free space (e.g., air), while in other cases another material is introduced into the gaps, such as a material that is more compliant than the compliant layers602 (and therefore allow lateral deflection of the compliant layers602).
The connectingelements606 may provide several benefits. For example, they may provide additional structural support to thecover104 by providing less unsupported area betweenadjacent actuators601. Further, they may help isolate or localize deflections produced by force inputs and/or key selections, which may improve local force and/or touch sensing functions. For example, it may improve the resolution with which a force sensing system can detect the location of a force input.
As shown inFIGS.6A-6C, thehaptic actuator601 is used to produce localized haptic outputs. For example, thecover104 is shown locally deflecting or deforming in response to an extension or retraction of thehaptic actuator601. Such protrusions and depressions in thecover104 may be facilitated by acover104 that is sufficiently flexible to produce local deformations and/or deflections. For example, where thecover104 is glass, the glass may have an elastic modulus in a range of about 60 to 80 GPa, and a thickness in a range of about 0.1 mm to 0.5 mm. Other dimensions, properties, and materials (e.g., plastic, fabric, metal) are also possible. Further, thecover104 may be reinforced or stiffened in certain areas to help isolate deformations and/or deflections produced by thehaptic actuator601. For example, ribs may be formed on or applied to the bottom of thecover104 between varioushaptic actuators601. The ribs may extend to another structure, such as theenclosure102, or they may extend only partially to another structure (such as theribs1007 shown inFIGS.10B and11B).
Thehaptic actuator601 may be configured to produce global haptic outputs, such as those described with respect toFIGS.4A-4C. In such cases, thecover104 may be configured to resist or minimize local deformations or deflections, such that the forces applied by thehaptic actuator601 may be perceived anywhere on the cover104 (or at least over a greater area than that of the haptic actuator itself). For example, thecover104 may be thicker and/or stiffer than acover104 used for localized haptic outputs. More particularly, thecover104 may be glass having a thickness in a range of about 0.75 to 2.0 mm. Alternatively, thecover104 may be metal, plastic, or the like. Further, where global haptic outputs are used, a device may include multiplehaptic actuators601, which may be operated simultaneously or individually.
Thehaptic actuator601 may include any suitable number of compliant layers602 and electrode layers604. For example, thehaptic actuator601 may include 40 compliant layers602 and41 electrode layers604, with each compliant layer602 sandwiched between two electrode layers604. The electrode layers604 may be formed of or include any suitable material, such as gold, aluminum, copper, indium tin oxide (ITO), or the like. The compliant layers602 may likewise be formed of or include any suitable material such as silicone, latex, elastomers, polymers, gels, or any other compliant material. The compliant layers602 may be any suitable thickness, such from about 10 microns to about 50 microns thick. In some case they are about 25 microns thick. When viewed from the top, theactuator601 may have any suitable shape, such as square, rectangular, round, or the like. In some cases, when viewed from the top (e.g., through the cover104) theactuator601 has length and width dimensions of about 40×40 mm, about 25×25 mm, or about 15×15 mm. In some cases, theactuator601 has substantially the same dimensions as an input region (e.g., a virtual key) that it underlies. Other dimensions are also contemplated.
Haptic actuators601 may be arranged in a keyboard100 (or other input device) in any suitable manner. For example,
Any of the foregoing haptic outputs may be produced in response to thekeyboard100 detecting a force input that satisfies a threshold (e.g., a force threshold). In particular, the haptic outputs may be used to indicate to a user that they have pressed thekeyboard100 with enough force to register the input. In this way, thekeyboard100 may induce a sensation that mimics or suggests the action of a mechanical keyboard, with the haptic output representing the sensation of a collapsing mechanical key. Moreover, properties of the haptic output or outputs used by thekeyboard100 may be selected or optimized to provide a tactile feeling that is similar to that of a collapsing mechanical key. In some cases, the haptic outputs may not be produced in response to inputs corresponding to incidental contact due to fingers resting on thekeyboard100, low-force inputs due to touch inputs to the keyboard100 (e.g., when the input surface is being used as a trackpad), or the like.
As noted above, a keyless keyboard, such as thekeyboard100, may include one or more force sensing systems that facilitate detection of user inputs. As used herein, a force sensing system corresponds to any combination of mechanisms and associated processors, software, etc. that can determine an amount of force applied to a surface or to a portion thereof. force sensing systems may include one or more force sensing elements, such as piezoelectric elements, strain gauges, optical displacement sensors, or the like.
In some embodiments, a single force sensing system may be used to determine an aggregate amount of force applied to the cover104 (e.g., global force sensing). However, this type of force sensing system may provide insufficient information to determine a location of the physical contact that is producing the detected force. (Or it may not be able to determine the location to a suitable resolution.) Accordingly, where global force sensing is used, a touch sensing system may be used to determine the location of each contact between a user's finger (or other implement or input member) and thecover104. Accelerometers may also be used in conjunction with the touch sensing system and the force sensing system to determine the location of a force input. For example, one or more accelerometers, and associated processors, may detect vibration or motion signatures that are indicative of an input from a particular finger or at a particular location on the input surface of thekeyboard100. Together, a touch sensing system and a global force sensing system (and, optionally, accelerometers) may be used to determine when and where a user is attempting to apply an input on the surface of thekeyboard100.
In other embodiments, multiple force sensing systems (or multiple force sensing elements associated with a single force sensing system) may be used to determine an amount of force applied to discrete areas or known locations on thecover104. For example, in some cases, eachinput region106 of the keyboard100 (e.g., corresponding to the size and/or location of a traditional key such as a character input key) is associated with its own unique force sensing system or force sensing element. In other words, each key is separately monitored to detect force inputs. In some cases, instead of monitoring the force of each individual key, thekeyboard100 is divided into multiple force sensing regions or pixels, at least some of which include multiple keys. In particular, based on typical typing patterns, there may be groups of keys that are unlikely to be contacted simultaneously. For example, a user may rest his or her fingers along a “home row” or a central row of keys, and move his or her fingers away from the home row to strike individual keys. Because of the horizontal positioning of a user's fingers relative to the keyboard, it is less likely that a user will be touching multiple keys in a single column at any given time. As a more specific example, on a traditional “QWERTY” keyboard, a user's fingers may be resting on the “a” key while striking the “f” key, but it is less likely that the user's fingers will be resting on the “a” key while striking the “q” key. Accordingly, it may be possible to increase the precision of a force-sensitive keyboard by providing force sensing pixels (as opposed to a global force sensing system, for example) without resorting to a different force sensing system or force sensing element for each key.
Such force sensing pixels may encompass different groups of input regions and may detect forces substantially independently of one another. For example, a force input applied to one force sensing pixel may be detected by a force sensing system (or element) associated with that force sensing pixel, but may not be detected by a force sensing system (or element) associated with a different force sensing pixel (or it may not satisfy a detection threshold of the second force sensing system or element). In some cases, each force sensing pixel (and/or a force sensing element associated with each force sensing pixel) produces a force value distinct from each other force value. For example, a processor may use a first force sensing system or element associated with a first force sensing pixel (independently of a second force sensing system or element that is associated with a different force sensing pixel) to determine the force applied to the first force sensing pixel. Similarly, the processor may use the second force sensing system or element associated with the second force sensing pixel (independently of the first force sensing system or element) to determine the force applied to the second force sensing pixel. Accordingly, each force sensing pixel can be independently evaluated to determine whether a force input has been applied to that particular force sensing pixel and/or the amount of force applied to the particular pixel.
FIGS.7A-7B depict thekeyboard100 with different example force sensing regions or force pixel arrangements. InFIG.7A, force sensing regions702 (or pixels) are arranged in substantially two rows, with a first row aboveline701 and a second row belowline701. Theline701 divides the keyboard roughly in half lengthwise, and there are tenforce sensing regions702 in each row. InFIG.7B,force sensing regions704 are also arranged in substantially two rows, with a first row aboveline703 and a second row belowline703.FIG.7B includes eightforce sensing regions704 in each row. Theforce sensing regions704 may be oriented substantially diagonally (with respect to a longitudinal axis of the keyboard extending from left to right inFIG.7B). This arrangement may correspond to a typical typing pattern, where each particular finger tends to be used to press keys in diagonal groupings.
In some embodiments, such as those shown inFIGS.7A-7B, each row includes at least eight force sensing regions. In this way, each row includes at least a separate force sensing region for each area that is accessible by (or typically struck by) a particular finger (excluding thumbs in the case of the eight pixel arrangement). Moreover, at least a subset of theforce sensing regions702,704 encompass groups of at least two separate input regions/keys (e.g., the force sensing regions are configured to detect a force applied to at least two separate input regions/keys).
The arrangement of the force sensing regions inFIGS.7A-7B, including which keys are encompassed by each force sensing region, are merely examples. In various embodiments, force sensing regions may encompass different input regions (e.g., keys) than those shown in these figures.
The force sensing regions702 (FIG.7A) and704 (FIG.7B) may each correspond to one force sensing system or element. That is, a force applied to anywhere in theforce sensing regions702,704 may result in a single force value without regard to the location of the force. As noted above, the force sensing system or element may use any suitable force sensing technology and/or technique, including capacitive force sensing, piezoelectric force sensing, strain gauges, or the like. The force sensing system or element for eachforce sensing region702,704 may be located below the force sensing region and within theenclosure102 of thekeyboard100. Thecover104 may be segmented along the borders of theforce sensing regions702,704 to allow each force sensing region to move at least somewhat independently of one another. In some embodiments, thecover104 is grooved along the borders of theforce sensing regions702,704 (e.g., on the bottom surface or the top surface). The grooves may allow theforce sensing regions702,704 to move substantially independently of one another and may reduce the extent to which one force sensing region deflects in response to a force applied to an input region in a neighboring force sensing region. This may improve the independence of the force detected at each force sensing region.
The force sensing systems or elements associated with each force sensing region (e.g., theregions702,704) may be configured to detect key presses in response to different force values. For example, force inputs detected in the force sensing regions may be compared against different force thresholds. Thus, force sensing regions that are typically subjected to lower forces, such as those typically struck by a user's pinky finger, may use a different (e.g., lower) force threshold than those regions typically struck with greater force, such as those typically struck by a user's index finger or thumb.
FIGS.8A-8C show partial cross-sectional views of the keyboard100 (e.g., viewed along line A-A inFIG.1), illustrating an example localizedforce sensing system800 that may be used in conjunction with the embodiments described herein. As described herein, theforce sensing system800 may provide localized force sensing such that both the force and location of individual force inputs from a finger, stylus, or other implement or input member may be determined. Moreover, the resolution of theforce sensing system800 may be substantially equal to or greater than the resolution of the input regions, such that each force input can be reliably associated with a given input region.
Theforce sensing system800 may include a cover802 (corresponding to thecover104 inFIG.1, for example), acompliant material804, and acapacitive sense layer806. Thecover802 may define an input surface, as described above with respect to thecover104. Theforce sensing system800 determines a force by detecting a change in capacitance caused by a changing proximity of the user's finger808 (or other implement or input member) to thecapacitive sense layer806. In particular, thecover802 may locally deform or deflect in response to applied force inputs, thereby compressing or otherwise deforming thecompliant material804 and allowing the user's finger808 (or any other implement or input member that capacitively couples to the capacitive sense layer806) to move closer to thecapacitive sense layer806.
The deflection and/or compression behavior of thecompliant material804 and/or thecover104 may be modeled so that a processer associated with theforce sensing system800 can determine an amount of force of a given force input. In particular, known forces may be applied to thecover802 in various locations to determine the change in capacitance resulting from a given amount of force applied to a given location. This information may be stored in a table, as an equation representing a force versus capacitance curve, or in any other data structure or algorithm that can be used to correlate a capacitance value with a force value.
Instead of or in addition to capacitive sensors, other types of sensors may be used to detect a change in distance between thecover802 and a lower layer. For example, thecapacitive sense layer806 may be replaced (or may be supplemented) by an array of optical displacement sensors that detect local deformations of thecover802. Where distance or displacement sensors are used, known forces may be applied to thecover802 in various locations to determine the sensor values that result from a given amount of force applied to a given location. This information may be stored in a table, as an equation representing a force versus displacement curve, or in any other data structure or algorithm that can be used to correlate a change in displacement or distance (as measured by the optical displacement sensors, for example) with a force value.
FIG.8B shows theforce sensing system800 while thecover802 is locally deformed by afinger808 or other input member. Thecover802 may deform locally in response to a localized force input. In other words, thecover802 is not so stiff or rigid that a finger press of a typical typing force cannot produce a local deformation ordepression810 in thecover802. A non-local deflection of the cover802 (e.g., a downward translation) may also occur in response to the force input.
Thecover802 may be formed from or include any suitable material, such as glass, metal, polycarbonate, sapphire, or the like. The dimensions and/or the material of thecover802 may be selected to provide a suitable local deformation profile (e.g., diameter and depth). For example, thecover802 may have an elastic modulus in a range of about 60 to 80 GPa, and a thickness in a range of about 0.1 mm to 0.5 mm.
Thecompliant material804 may be formed from or include any suitable material, such as foam, gel, silicone, an array of compliant material dots or structures (e.g., formed from silicone), liquid, air, or the like. Thecompliant material804 may support thecover802 over a touch and/or force sensitive area of thecover802, such as the area of thecover802 that defines input regions (e.g., keys). For example, as shown inFIG.1, thecompliant material804 may be positioned under substantially theentire cover104, or only under the region on which the input regions orkeys106 are defined. The support provided by thecompliant material804 may help to isolate the effect of a force input applied to thecover802 to a limited area of thecover802. More particularly, when a force input, such as a finger press corresponding to a key press on thecover802, is applied to a force sensing system that does not include thecompliant material804, thecover802 may tend to deflect substantially globally. For example, if a force sensing system has an air gap rather than a compliant material, a finger press may deform thecover802 all the way to the edges of the cover. On the other hand, where thecompliant material804 is included, thecompliant material804 prevents or reduces deflection or deformation of thecover802 in areas that are not directly contacted by an object (or in the immediate vicinity).
Thecompliant material804 may also provide a predictable force-versus-displacement relationship, which may be exploited by theforce sensing system800 to help determine force values for force inputs. For example, thecompliant material804 may help to improve the consistency of the force-versus-displacement response across the input surface of thecover802, especially as compared to aforce sensing system800 that uses an air gap instead of acompliant material804. More particularly, without thecompliant material804, a force applied near a center of the cover802 (e.g., away from the supported edges of the cover802) may cause more deflection of thecover802 than the same force applied near an edge of thecover802. The supportive effect of thecompliant material804 may help prevent or limit the amount of sagging or global deflection in response to an input force, especially away from the edges or supported areas of thecover802. In this way, input forces applied to the center and the edges of the cover802 (and indeed any area of the cover802) may result in a similar deformation. Moreover, due to the large area of support provided to thecover802 by thecompliant material804, those deformations may be more localized (e.g., smaller) than they would be without thecompliant material804, thus producing higher resolution touch and force sensing results.
Thecompliant material804 may be a single continuous sheet, multiple sheet segments, or other shapes or configurations (e.g., dots, pillars, pyramids, columns, discs, or the like). The dimensions and/or the material of the compliant material804 (or any other property, such as poisons ratio, stiffness, hardness, durometer, etc.) may be selected to provide a suitable local deformation profile in conjunction with thecover802. For example, thecompliant material804 may have a thickness in a range of about 0.5 mm to about 2.0 mm. Where thecompliant material804 comprises multiple compliant members or materials (e.g., dots, pillars, sheets, etc.), each compliant member may have substantially the same thickness, such that the distance between thecover802 and an underlying sense layer (e.g., the sense layer806) is substantially the same over the area that includes input regions.
The materials and dimensions of thecover802 and thecompliant material804 may be optimized and/or evaluated together to provide a suitable local deformation profile. In some embodiments, thecover802 is a glass layer having a thickness of about 0.3 mm and an elastic modulus of about 70 GPa, and thecompliant material804 is a foam having a thickness of about 0.5 mm.
The local deformation characteristics of theforce sensing system800 may allow multiple adjacent force inputs to be detected and separately identified. For example, thecover802 and thecompliant material804 may experience sufficiently distinct depressions in response to force inputs that are spaced as close as 3.0 cm (e.g., 3.0 cm or more) from each other, as measured between geometric centroids of the force inputs. In some cases, thecover802 and thecompliant material804 may experience sufficiently distinct depressions in response to force inputs that are even closer, such as 2.5, 2.0, or even 1.0 cm from each other.FIG.8C shows theforce sensing system800 subjected to two force inputs from twoseparate fingers808,812 (or other input members or implements). Each finger/input member produces its own depression (814,816, respectively). The centroids of thefingers808,812 inFIG.8C may be as close as 3.0 cm (or closer) to one another. As the distance between the centroids of thefingers808,812 increases, the respective depressions become even more distinct than shown inFIG.8C.
FIGS.9A-9B show partial cross-sectional views of force sensing systems, illustrating example configurations of a capacitive sense layer. In particular,FIG.9A illustrates aforce sensing system900, which may correspond to theforce sensing system800, that includes a cover902 (e.g., thecover802,104), a compliant material904 (e.g., the compliant material804), and a capacitive sense layer906 below thecompliant material904. The capacitive sense layer906 is configured to capacitively couple directly to a user'sfinger903 or other object that is brought into contact with thecover902, such as a stylus or pen. In particular, the capacitive sense layer906 may detect thefinger903 via self-capacitance. Because the capacitive sense layer906 capacitively couples directly to the user'sfinger903, other capacitive sense layers (such as an electrode or drive layer that capacitively couples to the sense layer906) may not be included. More particularly, some embodiments of theforce sensing system900 may not include another capacitive sense layer between thecover902 and the compliant material904 (or between thecover902 and the capacitive sense layer906).
The capacitive sense layer906 may include asubstrate910, such as a circuit board or flex-circuit material, and a group ofelectrodes912. Theelectrodes912 may be conductive traces applied to thesubstrate910 and coupled to a processor and/or other electronic components that facilitate determining the capacitance changes due to the presence of the finger903 (and thus the force). The locations of theelectrodes912 may be known so that the detection of a change in capacitance at a givenelectrode912 can indicate, to a device, where on thecover902 the force input is located.
The size of theelectrodes912 may define a resolution of theforce sensing system900. For example, theelectrodes912 may be the same size or smaller (e.g., in surface area or any other appropriate dimension) than an input region (e.g., a virtual key). In such cases, it may be possible to determine from theforce sensing system900 what key a user has selected. That is, if one ormore electrodes912 that are below a particular key (e.g., theinput region106,FIG.1) detect a change in capacitance corresponding to a threshold force, then theforce sensing system900 and/or a device to which it is connected may register a selection of that key. Because of the resolution of such a force sensing system, it may not be necessary to use a separate touch sensing system to determine where on the input surface a force input is applied.
FIG.9B illustrates aforce sensing system916, which may correspond to theforce sensing system800, that includes thecover902, thecompliant material904, and a capacitive sense layer914 below thecompliant material904. The capacitive sense layer914 includeselectrodes920 disposed on a substrate918 (e.g., a circuit board or flex circuit). Theelectrodes920 are paired such that a capacitance between twoelectrodes920 is monitored or measured, as illustrated by the capacitor symbols inFIG.9B. When the finger903 (or other implement) deforms thecover902 and approaches theelectrodes920, thefinger903 changes the capacitance measured betweenelectrodes920 that are proximate thefinger903. In particular, thefinger903 changes the permittivity or dielectric constant of the area around theelectrodes920. Theforce sensing system916 and its associated components and processors can detect the change in capacitance between thoseelectrodes920 to determine an amount of deformation, and thus an amount of force applied to thecover902. Like theforce sensing system900, theforce sensing system916 may not include a second sense layer between thecover902 and thecompliant material904.
Theforce sensing systems900,916 described above provide localized force detection, where both the location of a force input and the amount of force of the force input may be determined by the force sensing systems. Also, the resolution of theforce sensing systems900,916 may be high enough that the locations of force inputs from individual fingers can be distinguished from one another.
FIGS.10A-10C show example localized force sensing system that may be used in conjunction with the keyboard100 (or any other suitable input device or electronic device). The force sensing systems shown inFIGS.10A-10C use strain gauges to determine an amount of force applied to an input surface. In particular, and as shown in more detail inFIGS.11A-11B, the strain gauges can be used to determine an amount of deflection or deformation of an input surface (e.g., the cover104), which can then be correlated to an amount of force associated with the input.
FIG.10A shows an exampleforce sensing system1001 that includes asubstrate1002. Thesubstrate1002 may correspond to thecover104 inFIG.1, or it may correspond to a component that may be disposed below (e.g., coupled to a bottom of) a cover such as thecover104. Thesubstrate1002 may be formed from or include any suitable material, such as glass, polymer, flexible circuit material, polyester film, or the like.
Theforce sensing system1001 includesstrain gauges1004 applied to or otherwise integrated with thesubstrate1002. Thestrain gauges1004 may be any suitable configuration and may be formed of any suitable material. For example, thestrain gauges1004 may include a conductor having a serpentine or coil pattern (or any other suitable pattern) and disposed on a film or other substrate. In some cases, thestrain gauges1004 may include at two or more substrates or films, each having a coiled or serpentine conductor and laminated with one another. This configuration may facilitate filtering or rejection of noise, interference, or other undesirable effects on thestrain gauges1004 caused by temperature, magnetic fields, or the like.
Thestrain gauges1004 may have any suitable size and may be arranged on thesubstrate1002 in any suitable pattern. For example, as shown, thestrain gauges1004 may all be substantially the same size and arranged in a regular grid pattern on thesubstrate1002. Thestrain gauges1004 may have any suitable size as viewed from the top of thesubstrate1002, such as about 10×10 mm, 15×15 mm, or any other suitable size. While thestrain gauges1004 may not be mapped directly to individual keys or input regions of a keyboard, the location of a force input on thesubstrate1002 may be determined by analyzing signals from multiple (e.g., all) of thestrain gauges1004 to identify an estimated location (e.g., a centroid) of the input, regardless of where the input is applied on thesubstrate1002 or other associated input surface.
In some cases, however,respective strain gauges1004 may be positioned to correspond to respective keys or input regions. For example,FIG.10B shows aforce sensing system1009 in which a pattern ofstrain gauges1005 on asubstrate1003 essentially mimics a pattern of keys or input regions, such that each key or input region of a keyboard has at least onestrain gauge1005 disposed thereunder. Accordingly, a force measured by a givenstrain gauge1005 can be used to independently determine whether a corresponding key or input region has been actuated by a user, without reference to strain gauges associated with other keys or input regions.
Where each key or input region is associated with at least one unique strain gauge, the substrate1003 (which may correspond to thecover104 or a component that is disposed below a cover) may includeribs1007 formed on or otherwise coupled to thesubstrate1003. Theribs1007 may help isolate deformations and/or deflections produced by force and/or touch inputs applied to thesubstrate1003 or an overlying cover, as shown and described in greater detail with respect toFIG.11B. Where a device includes an adaptable display to produce virtual input regions at different locations on acover104, such ribs may be omitted to facilitate more uniform force sensing over the surface of the input surface.
FIG.10C shows aforce sensing system1011 having a pattern ofstrain gauges1008 that are larger than those shown inFIG.10A, illustrating another example arrangement of strain gauges on a substrate for a force sensing system. While thestrain gauges1008 are larger than those shown inFIG.10A, they may still provide suitable resolution for determining the location of a force input. For example, by detecting and analyzing signals from multiple strain gauges1008 (e.g., to determine a centroid of a force input), it may be possible to determine the location of a force input with a resolution of +/−about 5 mm, which may be suitable for many input regions that may be shown on an input surface or displayed on an adaptable display, such as keyboard keys (e.g., virtual keys), gaming inputs, or other affordances.
FIG.11A shows a partial cross-sectional view of the keyboard100 (e.g., viewed along line A-A inFIG.1), illustrating an example in which the force sensing system1001 (FIG.10A) is incorporated in thekeyboard100. As shown inFIG.11A, afinger1105 is applying a force to the substrate1002 (which may correspond to the cover104), producing alocal depression1102 in thesubstrate1002. Thestrain gauges1006 that are coupled to the depressed region of thesubstrate1002 may produce a signal or other detectable phenomenon corresponding to the relative amount of deflection and/or strain experienced by thesubstrate1002 due to the deformation. By evaluating thestrain gauges1006, a magnitude of the force input applied by thefinger1105 may be determined, as well as a location of the force input.
Thekeyboard100 inFIG.11A shows alower component1106, which may correspond to theenclosure102 or another internal component or structure of an electronic device. As shown, thesubstrate1002 may be separated from thelower component1106 by agap1104. Thegap1104 may be empty (e.g., it may be an air gap), or it may be fully or partially filled with a material, such as a compliant material similar to thecompliant material704 described with respect toFIGS.7A-7C (e.g., foam, gel, silicone, an array of compliant material dots or structures (e.g., formed from silicone), or the like). The compliant material may help support thesubstrate1002 and may help to localize and/or isolate deflections of thesubstrate1002 caused by force inputs.
FIG.11B shows a partial cross-sectional view of the keyboard100 (e.g., viewed along line A-A inFIG.1), illustrating an example in which the force sensing system1009 (FIG.10B) is incorporated in thekeyboard100. As shown inFIG.11B, afinger1107 is applying a force to the substrate1003 (which may correspond to the cover104), producing alocal depression1108 in thesubstrate1003. As described with respect toFIG.10B, theforce sensing system1009 may includeribs1007 formed on or otherwise coupled to thesubstrate1003. The ribs may isolate and localize deflections of thesubstrate1003 caused by force inputs. For example, as shown inFIG.11B, the force input from thefinger1107 is largely contained between the ribs1007-2 and1007-3. Accordingly, the strain gauge1005-3 may be subjected to a larger strain than nearby strain gauges (e.g., strain gauges1005-2,1005-4), thus reducing the likelihood of false detections of key presses at nearby or adjacent keys or input regions.
Thekeyboard100 inFIG.11B shows alower component1112, which may correspond to theenclosure102 or another internal component or structure of an electronic device. As shown, thesubstrate1003 may be separated from thelower component1112 by agap1110. Thegap1110 may be empty (e.g., it may be an air gap), or it may be fully or partially filled with a material, such as a compliant material similar to thecompliant material704 described with respect toFIGS.7A-7C (e.g., foam, gel, silicone, an array of compliant material dots or structures (e.g., formed from silicone), or the like). The compliant material may help support thesubstrate1003 and may help to further localize and/or isolate deflections of thesubstrate1003 caused by force inputs.
FIG.12 shows a partial cross-sectional view of the keyboard100 (e.g., viewed along line A-A inFIG.1), showing a force-sensingsystem1200 that uses anactuator1201 to detect forces applied to a substrate1208 (which may correspond to the cover104). Thekeyboard100 inFIG.12 shows alower component1210, which may correspond to theenclosure102 or another internal component or structure of an electronic device.
Theactuator1201 may correspond to thehaptic actuator601 described herein. In particular, theactuator1201 may provide both haptic actuation functions, as described above, as well as force sensing functions. For example, the actuator1201 (which may have the same construction as the haptic actuator601) includes compliant layers1206 sandwiched between electrode layers1204. The electrode layers1204 may be used as electrodes in a mutual-capacitance sensing scheme. For example, one electrode layer may be used as a drive electrode and another electrode layer may be used as a sense electrode. When the sense and drive electrodes are moved closer together, such as when afinger1202 or other implement deforms thesubstrate1208 and compresses theactuator1201, a processor or other circuitry may detect resulting electrical changes, which can be correlated to an amount of force applied via the force input. More particularly, the force-sensingsystem1200 may use a force versus capacitance (or other electrical phenomenon) correlation to determine the amount of force that corresponds to a measured capacitance value (or other electrical value).
In some embodiments, only two electrode layers of the electrode layers1204 in theactuator1201 are used for capacitive force sensing. In other embodiments, more electrode layers1204 are used, such as all of the electrode layers. As described above, an actuator may include 40 compliant layers1206 and41 electrode layers1204. In such cases, all 41 electrodes may be used for capacitive sensing. Fewer electrodes may also be used.
Notably, theactuator1201 may detect applied forces and produce haptic outputs substantially simultaneously. For example, a haptic signal may have a relatively low frequency (e.g., between 2 and 200 Hz, though other frequencies are also possible), while a drive signal for a drive electrode of a capacitive sensor may have a relatively high frequency (e.g., between 100 and 200 kHz, though other frequencies are also possible). Accordingly, such frequencies may be applied to electrode layers of theactuator1201 substantially simultaneously such that a haptic output is produced while electrical changes due to force inputs are also detected. Processors and/or circuitry of theforce sensing system1200 may compensate for any compression or extension of the compliant layers1206 due to the haptic output when sensing force inputs in order to mitigate any contamination of the force measurement by the haptic output.
Where akeyboard100 includes force sensing regions that may be struck or actuated by more than one finger (such as a single force sensing region covering an entire keyboard or the force sensing pixels described above), the force sensing system may adjust or select a force threshold based on the number of fingers that are in contact with the surface.
For example, a typical force input indicative of a user attempting to actuate a virtual key on a flat surface may range from about 25 to about 150 grams. Accordingly, when a force sensing system detects a force input above that value, it should register a selection of the virtual key. However, if a user is resting multiple fingers on the surface of the keyboard, the force sensing system may detect a non-zero baseline force. This variability in the baseline force may result in false positive detections of force inputs, effectively lowering the amount of force necessary to trigger an input. As one example, if the baseline force due to three fingers resting on a keyboard is 20 grams, simply resting a fourth finger on the keyboard may be enough to cause the device to falsely identify a force input.
Accordingly, the force sensing system may dynamically determine the force threshold that is indicative of a key press based on the number of fingers in contact with an input surface of the keyboard at a given time.FIG.13 illustrates agraph1300 showing three example baseline forces and force thresholds based on different numbers of fingers in contact with an input surface (e.g., the cover104). In particular, thebaseline force1302 may correspond to a force of one finger resting on the surface. The force threshold is then set at acertain value1306 above thebaseline force1302, resulting in theforce threshold1304. Similarly, thebaseline force1308 may correspond to a force of two fingers resting on the surface, and the force threshold may be set at acertain value1312 above thebaseline force1302, resulting in theforce threshold1310. Where three fingers are determined to be resting on the surface, the force threshold may be set at acertain value1318 above the baseline force of1314, resulting in theforce threshold1316. In some cases, the force threshold is set between about 25 to about 150 grams higher than the baseline force, such as about 30 grams above the baseline force, regardless of the value of the baseline force. In other situations, the force threshold may be set to different amounts above the baseline force, depending on the number of fingers that are in contact with the surface.
The baseline forces1302,1308, and1314 may be determined based on the number of fingers resting on the input surface of a keyboard. For example, the baseline force corresponding to one finger resting on the surface may be determined to be 10 grams. Thus, when one finger is detected on a surface, the baseline force may be 10 grams regardless of any actual detected force applied to the surface. Similarly, when two fingers are detected on the surface, the baseline force may be 20 grams, and so on. Accordingly, the force threshold may be determined at any given time based on the number of fingers in contact with the input surface and without regard to an actual amount of force being applied to the surface by the fingers.
FIG.14 depicts anexample process1400 for detecting a key press on an input surface of an electronic device. Theprocess1400 may be implemented on any of the example devices discussed herein. Theprocess1400 may be used, for example, to determine what actions (if any) the electronic device should perform in response to the force input, and may be implemented using, for example, the processing unit and other hardware elements described with respect toFIG.20. Theprocess1400 may be implemented as processor-executable instructions that are stored within the memory of the electronic device.
Inoperation1402, a number of fingers in contact with an input surface of an electronic device (e.g., the surface of thecover104,FIG.1) is determined. For example, a touch sensing system of thekeyboard100 may be used to determine how many fingers are in contact with thecover104.
Inoperation1404, a force threshold indicative of a key press is determined. For example, thekeyboard100 determines a force threshold that, if satisfied, will result in thekeyboard100 registering a selection of an input region (e.g., a virtual key). The force threshold is determined based at least in part on the number of fingers in contact with the input surface. For example, the force threshold may be between about 25 and about 150 grams higher than a baseline force for the number of fingers determined to be in contact with the input surface. The baseline force for each finger in contact may be 10 grams. Thus, each additional finger in contact with the input surface may add another 10 grams to the baseline force. Other values are also possible. Also, the baseline force for each number of fingers may not increase linearly. For example, the baseline force for one finger may be 10 grams, and the baseline force for eight fingers may be 40 grams.
Inoperation1406, a force input satisfying the force threshold is detected. The force input may be detected with a force sensing system, such as any of the force sensing systems described above.
Inoperation1408, in response to detecting the force input atoperation1406, a selection of an input region may be registered. For example, if a force input satisfying the threshold is determined to have been applied to a location of a key, a selection of that key (which may correspond to a text character, for example), is registered. Thekeyboard100 may communicate the selection to an electronic device, which may execute an appropriate action or response (such as inputting the text character into an application).
In some cases, a force threshold may instead or additionally be established based on the magnitude of detected force inputs. That is, different users may type or apply inputs to a keyboard with different forces. More particularly, a first user may type with a relative lower force for each key strike (e.g., with an average force of about 10 grams), while a second user may type with a relatively larger force for each key strike (e.g., with an average force of about 100 grams). Accordingly, thekeyboard100 may adapt to individual users by adjusting the force threshold after detecting a number of inputs. For example, thekeyboard100 may detect inputs that are indicative of typing inputs (e.g., key presses), such as inputs applied to key regions and/or inputs having frequencies or other patterns indicative of key presses, and may determine average forces of those inputs. Thekeyboard100 may then adjust the force threshold based on the average forces of the key presses. Thus, if the force threshold is significantly below a user's average typing force as detected by thekeyboard100, thekeyboard100 may mistake lighter touches (that were not intended as key presses) as key presses. On the other hand, if the force threshold is significantly above a user's average typing force as detected by thekeyboard100, thekeyboard100 may not recognize all of the user's inputs as key presses. Accordingly, thekeyboard100 may dynamically set the force threshold based on an average detected force input. In some cases, the force threshold may be set to a predetermined amount below the average typing force, such as 1%, 5%, 10%, or 20% lower than the average typing force (or any other suitable value).
The average typing force may be detected at any suitable interval, such as on a time-based periodic basis (e.g., every 1 hour, every 5 hours, etc.), or on an event-based basis (e.g., every time a word-processing application is opened, every time a computer is restarted, etc.). Other intervals, periods, and triggering events are also contemplated.
A keyless keyboard may also include a touch sensing system that detects touch and/or motion-based inputs (e.g., swipes, pinches, rotations, or taps), similar to a trackpad. Accordingly, a touch input corresponding to a movement across the input surface may be detected. In response to detecting the touch input corresponding to the movement across the input surface, a position of a cursor on a display of an electronic device may be changed. The touch sensing system may share the same input surface as the keys of the keyboard, such that a user can interact with the surface of the flat keyboard in various ways, including typing (e.g., force inputs) and traditional trackpad inputs (e.g., swipes, pinches, rotations, taps, and the like).
As noted above, thekeyboard100 may include an adaptable display that can change the layout of the keys (e.g., virtual keys) on the surface of thekeyboard100.FIGS.15A-17 illustrate example layouts and other functions that may be implemented in akeyboard100 that includes both force sensing and haptic outputs.
For example, as described with reference toFIGS.15A-15C, aninput device1500 may detect the location of a user'sfingers1532 and define multiple input regions according to where and how the user places his or herfingers1532. This may improve user experience by allowing varying arrangements, sizes, and positions of the input regions (or keys)1506.
As depicted inFIG.15A, theinput surface1504 may initially be inactive, with no defined input regions or visual indications of the input regions. As a user'sfingers1532 approach theinput surface1504, theinput surface1504 may become active as shown inFIG.15B. For example, theinput surface1504 may incorporate proximity sensors, such as touch sensing systems, which detect the presence and/or location of the user'sfingers1532. These sensors may detect a desired location for defining theinput regions1506. Theinput regions1506 may alternatively be defined in response to additional user action, such as the performance of a gesture, touching of theinput surface1504, or pressing of theinput surface1504.
In concurrence with or in response to the input regions1506 (e.g., virtual keys) being defined on theadaptive input surface1504, theinput regions1506 may be indicated visually. For example, a display within theinput surface1504 may visually indicate the location of thevirtual keys1506. The locations of thevirtual keys1506 may also or instead be indicated tactilely. For example, actuators (e.g., piezoelectric actuators, electrostatic elements, etc.) may provide vibrations or other outputs that may be perceived by a user as a physical boundary of thevirtual keys1506. For example, when a user places a finger directly in the center of a virtual key1506, no haptic output may be provided. When the user moves that finger to a key boundary (or places the finger on the key boundary initially), the actuator may produce an output, thus indicating to the user that their finger is on a key boundary.
The location of the input regions and corresponding visual indicia of the input regions may further be adaptive according to user interaction. For example, theinput device1500 may further include computer-readable memory storing multiple keyboard layouts, each of which has a corresponding visual representation. The layout depicted inFIG.15B may be a first layout (e.g., a first configuration of virtual keys), whileFIG.15C may be a second layout (e.g., a second configuration of virtual keys). Additional layouts may also be stored within theinput device1500, or may be transmitted to theinput device1500 by another computing device.
As depicted inFIG.15C, if a user'sfingers1532 are placed in a different arrangement or location on theinput device1500, theinput regions1506 may be differently defined (e.g., according to a second keyboard layout). As illustrated inFIG.15C, a user's fingers are placed on a previously inactive input surface at an angle to each other rather than a straight line as depicted inFIG.15B. The input device may recognize this placement as corresponding to an ergonomic keyboard layout (e.g., a second stored keyboard layout), and defineinput regions1506 and corresponding visual indicia of the input regions accordingly. These examples are illustrative in nature, and further keyboard layouts or input schemes may be implemented according to the present invention, whether due to user interaction, programmed preferences, or software controls through applications in communication with the input device.
An input device that includes force sensing, haptic outputs, and an adaptive display may be used to define user interfaces other than traditional keyboards.FIG.16 depicts anexample input device1600 incorporated within a notebook orlaptop computer1642 in which an alternative user input is produced on anadaptive input surface1604.
Thenotebook computer1642 comprises anenclosure1602 having an upper portion with adisplay1644 and a lower portion housing aninput device1600. The enclosure may further house various components, such as a processing unit (which may be shared with the processing unit of theinput device1600 or may be separate), memory, computer-readable media, input/output ports, sensors, microphones, speakers, etc. Theinput device1600 may include a force sensing system, a touch sensing system, and one or more haptic actuators (not shown). Any of the force or touch sensing systems or haptic actuators described herein may be used in theinput device1600.
Theinput device1600 has an adaptive input surface1604 (which may correspond to thecover104 inFIG.1 or any other cover described herein). Theinput surface1604 is shown adapted to interact with an active software application rendered on thedisplay1644 of thenotebook computer1642; here, a music player. Theinput surface1604 has defined input regions, including media playback controls1646 and avirtual trackpad1648. Theinput surface1604 also defines an input region forvolume control1650. As a user slides afinger1632 along thevolume control1650, the touch and/or force sensing systems of theinput device1600 may detect the motion of the user'sfinger1632, and the haptic actuators may be activated (e.g., caused to oscillate or vibrate the input surface1604) and provide haptic feedback to the user. The haptic feedback may increase in intensity (e.g., frequency or amplitude) as thefinger1632 slides to increase volume, and the intensity of the haptic feedback may decrease as thefinger1632 slides to decrease volume.
Similarly,FIG.17 depicts anexample input device1700 incorporated within anotebook computer1742. Thenotebook computer1742 comprises anenclosure1702 having an upper portion with adisplay1744 and a lower portion housing aninput device1700 according to the present invention.
Theinput device1700 has an adaptive input surface1704 (which may correspond to thecover104 inFIG.1 or any other cover described herein). Theinput surface1704 is shown adapted to interact with a user interface of a software application rendered on thedisplay1744 of thenotebook computer1742; here, a web browser. Assuming that theinput surface1704 previously defined a standard keyboard layout comprising virtual keys, as the web browser is opened thevirtual keys1706 may be shifted and/or truncated while avirtual trackpad1748 may be repositioned to the center of theinput surface1704. With thevirtual trackpad1748 more prominently located, auser1732 may more easily navigate web pages which may frequently require moving apointer1752 and clicking links.
As illustrated inFIGS.18-19, an input device according to the present invention, such as a keyless keyboard, may be implemented in many forms. Input devices may be incorporated into devices such as a notebook computer, as shown above with respect toFIGS.16 and17, or they may be separate devices in communication with a host computer or other device as illustrated with respect toFIGS.18-19.
FIG.18 depicts anexample keyboard1800 in communication with adesktop computer1854. Thekeyboard1800 may be in communication with thedesktop computer1854 through a wired or wireless connection. Thekeyboard1800 has an enclosure and anadaptive input surface1804 positioned within the enclosure. Theinput surface1804 defines aninput region1812, which may correspond to a character input key. Thekeyboard1800 may include force sensing systems and/or haptic actuators or haptic output systems described herein.
FIG.19 depicts anexample input device1900 incorporated into a cover case. The cover case may be attached to and in communication with a portabletablet computing device1956. Theinput device1900 may be in communication with thetablet1956 through a wired connection, an electrical contact connection, or a wireless connection. Theinput device1900 has anadaptive input surface1904 which defines an input region1912. Theinput device1900 may include force sensing systems and/or haptic actuators or haptic output systems described herein.
The example devices illustrated in the above figures are intended to be illustrative in nature, and can be implemented in a number of other manners. Further, while the above examples are illustrated with flat, generally smooth input surfaces, the present invention can also be implemented using curved, bent, textured, rough, and other types of surfaces.
FIG.20 depicts example components of an input device in accordance with the embodiments described herein. The schematic representation depicted inFIG.20 may correspond to components of the devices depicted herein. However,FIG.20 may also more generally represent other types of devices that include force sensing systems and controllable haptic feedback elements in accordance with the embodiments described herein.
As shown inFIG.20, adevice2000 includes aprocessing unit2058 operatively connected tocomputer memory2060. Theprocessing unit2058 may be operatively connected to thememory2060 component via an electronic bus or bridge. Theprocessing unit2058 may include one or more computer processors or microcontrollers that are configured to perform operations in response to computer-readable instructions. Where incorporated into a larger device such as a notebook computer, theprocessing unit2058 may be the central processing unit (CPU) of the larger device. Additionally or alternatively, theprocessing unit2058 may include other processors within thedevice2000 including application specific integrated chips (ASIC) and other microcontroller devices. Theprocessing unit2058 may perform functionality described in the examples above.
Thememory2060 may include a variety of types of non-transitory computer-readable storage media, including, for example, read access memory (RAM), read-only memory (ROM), erasable programmable memory (e.g., EPROM and EEPROM), or flash memory. Thememory2060 is configured to store computer-readable instructions, sensor values, and other persistent software elements.
In this example, theprocessing unit2058 is operable to read computer-readable instructions stored on thememory2060. The computer-readable instructions may adapt theprocessing unit2058 to perform the operations or functions described herein. The computer-readable instructions may be provided as a computer-program product, software application, or the like.
Thedevice2000 may also include abattery2062 that is configured to provide electrical power to the components of thedevice2000. Thebattery2062 may include one or more power storage cells that are linked together to provide an internal supply of electrical power. Thebattery2062 may be operatively coupled to power management circuitry that is configured to provide appropriate voltage and power levels for individual components or groups of components within thedevice2000. Thebattery2062, via power management circuitry, may receive power from an external source, such as an AC power outlet. Thebattery2062 may store received power so that thedevice2000 may operate without connection to an external power source for an extended period of time, which may range from several hours to several days.
Thedevice2000 may also include a display2020 (or multiple displays2020). Thedisplay2020 may include a liquid crystal display (LCD), organic light emitting diode (OLED) display, electroluminescent (EL) display, electrophoretic ink (e-ink) display, or the like. If thedisplay2020 is an LCD or e-ink type display, thedisplay2020 may also include a backlight component that can be controlled to provide variable levels of display brightness. If thedisplay2020 is an OLED or EL type display, the brightness of thedisplay2020 may be controlled by modifying the electrical signals that are provided to display elements. Thedisplay2020 may include a standalone display such as the display1744 (FIG.17), and/or an adaptive display of a keyboard or other input device. For example, adisplay2020 may be incorporated into a keyboard to present various keyboard layouts or other user interfaces.
In some embodiments, thedevice2000 includes one ormore input devices2064. Theinput device2064 is a device that is configured to receive user input. Theinput device2064 may include, for example, a push button, a touch-activated button, or the like. In some embodiments, theinput device2064 may provide a dedicated or primary function, including, for example, a power button, volume buttons, home buttons, scroll wheels, and camera buttons. Generally, a touch sensing system and a force sensing system may also be classified as input devices. However, for purposes of this illustrative example, the touch sensing system (touch sensing element2018 and touch sensing circuitry2070) and force sensing system (forcesensing element2066 and force sensing circuitry2072) are depicted as distinct components within thedevice2000.
Thedevice2000 may include a touch sensing system (or multiple touch sensing systems). A touch sensing system may include atouch sensing element2018, or multipletouch sensing elements2018, andtouch sensing circuitry2070. The touch sensing system may also include or incorporate other components of an electronic device, such as a cover or input surface of an electronic device. The touch sensing element(s)2018 may include electrodes, electrode layers, or other components, and may be configured to operate in accordance with a mutual-capacitance or self-capacitance touch-sensing scheme, as described above. Touch sensing element(s)2018 for other types of touch sensing schemes may additionally or alternatively be used, such as elements for surface acoustic wave sensors, resistive sensors, infrared sensors, and the like.
Thedevice2000 may also includetouch sensing circuitry2070. Thetouch sensing circuitry2070 may be operably coupled to the touch sensing element(s)2018 to form all or part of the touch sensing system. Thetouch sensing circuitry2070, in conjunction with the touch sensing element(s)2018, may detect and estimate the location of a touch on or near an input surface (such as an input surface of a keyless keyboard). Thetouch sensing circuitry2070 may further output signals or other indicia indicating the detected location of a touch. Thetouch sensing circuitry2070 may further be operably coupled to theprocessing unit2058.
Thedevice2000 may also include a force sensing system (or multiple force sensing systems). A force sensing system may correspond to any component or group of components that detects and/or estimates an amount of force applied to an input surface. For example, a force sensing system may include aforce sensing element2066, or multipleforce sensing elements2066, and forcesensing circuitry2072. The force sensing system may also include or incorporate other components of an electronic device, such as a cover or input surface of an electronic device. Where a device includes multiple force sensing systems, each force sensing system may include its own separate components (e.g., each may have a different force sensing element and force sensing circuitry), or they may share some components (e.g., each force sensing system may each have its own force sensing element, but may share force sensing circuitry).
The force sensing element(s)2066 may produce changes in electrical values (e.g., resistance, capacitance, voltage, etc.), detectible signals, or the like, in response to force inputs applied to the keyless keyboard (or other force-sensitive input device). The sensing element(s)2066 may be implemented as one or more layers, such as layers of electrodes or other conductive materials. Example force sensitive elements are described above, and may include capacitive sensing elements, electrodes, piezoelectric materials, strain gauges, and the like.
Theforce sensing circuitry2072 may be operably coupled to theforce sensing element2066 to form all or part of the force sensing system. Theforce sensing circuitry2072, in conjunction with the force sensing element(s)2066, may detect and estimate an amount of force applied to an input surface. In some embodiments, theforce sensing circuitry2072 may further detect a location of an applied force. Theforce sensing circuitry2072 may further output signals or other indicia indicating an estimated amount of applied force. In some embodiments, theforce sensing circuitry2072 may operate using a dynamic or adjustable force threshold. Theforce sensing circuitry2072 may only output signals in accordance with an applied force exceeding the force threshold. Theforce sensing circuitry2072 may further be operably coupled to theprocessing unit2058.
Thedevice2000 may also include a haptic actuator2026 (or multiple haptic actuators2026). Thehaptic actuator2026 may be controlled by theprocessing unit2058, and may provide haptic feedback to a user interacting with thedevice2000, such as illustrated above with respect toFIGS.2-6C. In some embodiments, multiplehaptic actuators2026 may provide localized macro haptic feedback at different areas of an input surface.
Thedevice2000 may also include acommunication port2068 that is configured to transmit and/or receive signals or electrical communication from an external or separate device. Thecommunication port2068 may couple to an external device via a cable, adaptor, or other type of electrical connector. In some embodiments, thecommunication port2068 may be used to couple thedevice2000 to a host computer. Thecommunication port2068 may receive control information from an external device, which may be used to operate and/or control thedevice2000.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the described embodiments. However, it will be apparent to one skilled in the art that the specific details are not required in order to practice the described embodiments. Thus, the foregoing descriptions of the specific embodiments described herein are presented for purposes of illustration and description. They are not targeted to be exhaustive or to limit the embodiments to the precise forms disclosed. It will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings. For example, while the methods or processes disclosed herein have been described and shown with reference to particular operations performed in a particular order, these operations may be combined, sub-divided, or re-ordered to form equivalent methods or processes without departing from the teachings of the present disclosure. Moreover, structures, features, components, materials, steps, processes, or the like, that are described herein with respect to one embodiment may be omitted from that embodiment or incorporated into other embodiments.