US20180164996A1 - Contextually-based functional assignment for a user-manipulable element on an input device - Google Patents

Abstract

In certain embodiments, a computer-implemented method includes detecting a selectable control element on a graphical user interface (GUI), determining an editable parameter associated with the selectable control element, associating a control of the editable parameter with a user-manipulable element on an input device, and generating and sending, to the input device, control data causing the input device to assign a performance characteristic to the user manipulable element based on properties of the editable parameter. In some aspects, the user manipulable element can be a rotatable knob on the input device. The performance characteristic may include a rotation resistance of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter (e.g., by controlling an electro-magnetic actuator to set the ratchet or non-ratchet modes), or a depressible knob.

Description

CROSS-REFERENCES TO RELATED APPLICATIONS
• This application is a non-provisional application and claims the benefit and priority of U.S. Provisional Application No. 62/433,187, filed on Dec. 12, 2016, and titled “CONTEXTUALLY-BASED FUNCTIONAL ASSIGNMENT FOR A USER-MANIPULABLE ELEMENT ON AN INPUT DEVICE,” which is hereby incorporated by reference in its entirety for all purposes.
BACKGROUND
• Peripheral devices generally include any auxiliary device that can be used to interface human and computer. Some common peripheral devices include keyboards, computer mice, image scanners, speakers, microphones, web cameras, and more.
• Keyboards and computer mice, in particular, have improved in function and performance over the last few decades to increase user productivity. For instance, the advent of function keys, key pads, programmable hot keys, scroll wheels, and the like, have helped users become more efficient by placing commonly used functions in quickly accessible locations. However, despite these improvements, more powerful, feature-laden software (e.g., Photoshop®) still requires users to navigate cumbersome and sometimes non-intuitive interfaces with nested menus and windows that still can make for highly inefficient work-sessions, especially for software users that are not highly experienced or steeped in the particular software. New developments are needed to improve the user interface, streamline workflow, and increase work efficiencies across a broad spectrum of applications.
BRIEF SUMMARY
• In certain embodiments, a computer-implemented method includes detecting, by a processor on a host computing device, a selectable control element on a graphical user interface (GUI) and determining, by the processor, an editable parameter associated with the selectable control element. The method further includes associating a control of the editable parameter with a user-manipulable element on an input device, and generating and sending, by the processor to the input device, control data causing the input device to assign a performance characteristic to the user manipulable element based on properties of the editable parameter. In some aspects, the user manipulable element can be a rotatable knob on the input device. Alternatively, the input device can be a standalone device (e.g., not associated with a keyboard, computer mouse, or the like).
• The performance characteristic may include a rotation resistance of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter, or a depressible knob. In some aspects, the control data controls an electro-magnetic actuator (e.g., clutch) in the control knob to set the ratchet mode and non-ratchet mode of operation. The method can further include receiving a first input data corresponding to a rotation of the knob, receiving a second input data corresponding to the rotation of the knob, and applying the first input data and second input data to the editable parameter as a single continuous input when the first and second inputs are received within a threshold time.
• In some embodiments, the knob can further include a touch sensor on a surface of the knob, and associating a control of the editable parameter with the knob can further include assigning a function with the touch sensor. The function may include entering a value of the editable parameter in response to receiving input data corresponding to a touch detected by the touch sensor, switching to a second editable parameter associated with the selectable control element in response to receiving input data corresponding to a touch detected by the touch sensor, or the like.
• In some embodiments, the knob can include a second touch sensor on a perimeter of the knob, where the function may include switching to a second editable parameter associated with the selectable control element in response to receiving input data corresponding to a touch detected by the touch sensor, and input data corresponding to a touch detected by the second touch sensor. In some cases, the knob can further include one or more additional touch sensors around a perimeter of the knob to detect multiple simultaneous touches on the perimeter. The selectable control element can be one of a selectable icon on the GUI, a selectable item in a menu on the GUI, or a graphical element on the GUI.
• In certain embodiments, the method can further include receiving, by the processor, input data corresponding to a movement of a cursor on the GUI, where the detecting the selectable control element on the GUI occurs in response to detecting when the cursor is placed over the selectable control element. The user-manipulable element can include a touch sensor, and the assigning the performance characteristic to the user-manipulable element can be performed further in response to receiving an input corresponding to a touch on the touch sensor.
• In some embodiments, an input device includes a housing, a processor disposed in the housing, a user-manipulable knob disposed on the housing and controlled by the processor, and a ratchet system disposed in the knob to apply one of a ratcheted or non-ratcheted mode to the knob, where the processor (of the input device) can control an operational configuration of the user-manipulable knob based on control data received from the host computing device, where the operational configuration may correspond to a contextual usage of the input device on the host computing device. The operational configuration can include an assigned ratcheted or non-ratcheted mode based on the control data. In some implementations, the input device further includes a touch sensor controlled by the processor and disposed on a surface of the knob to detect a touch, where the operational configuration further includes an assigned function associated with the touch sensor.
• In certain embodiments, a computer-implemented system includes one or more processors, and one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including detecting, by a processor on a host computing device, a selectable control element on a graphical user interface (GUI), determining, by the processor, an editable parameter associated with the selectable control element, associating a control of the editable parameter with a user-manipulable element on an input device, and generating and sending, by the processor to the input device, control data causing the input device to assign a performance characteristic to the user manipulable element based on properties of the editable parameter. The user manipulable element can be a rotatable knob on the input device.
• In some embodiments, the performance characteristic may include a rotation resistance (e.g., torque friction) of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter, or a depressible knob. In some aspects, the control data controls an electro-magnetic actuator (e.g., clutch) in the control knob to set the ratchet mode and non-ratchet mode of operation. The one or more non-transitory computer-readable storage mediums can further contain instructions configured to cause the one or more processors to perform operations including receiving a first input data corresponding to a rotation of the knob, receiving a second input data corresponding to the rotation of the knob, and applying the first input data and second input data to the editable parameter as a single continuous input when the first and second inputs are received within a threshold time.
• In certain embodiments, the knob can further include a touch sensor on a surface of the knob, where associating a control of the editable parameter with the knob can further include assigning a function with the touch sensor. The function can include entering a value of the editable parameter in response to receiving input data corresponding to a touch detected by the touch sensor, or switching to a second editable parameter associated with the selectable control element in response to receiving input data corresponding to a touch detected by the touch sensor, or the like.
• In further embodiments, the knob can include one or more additional touch sensors around a perimeter of the knob to detect multiple simultaneous touches on the perimeter. In some cases, the one or more non-transitory computer-readable storage mediums further contain instructions configured to cause the one or more processors to perform operations including receiving, by the processor, input data corresponding to a movement of a cursor on the GUI, where the detecting the selectable control element on the GUI can occur in response to detecting when the cursor is placed over the selectable control element. The user-manipulable element can include a touch sensor, and assigning the performance characteristic to the user-manipulable element can be performed further in response to receiving an input corresponding to a touch on the touch sensor.
BRIEF DESCRIPTION OF THE DRAWINGS
• The detailed description is set forth with reference to the accompanying figures.
• FIG. 1 shows a typical implementation for a system utilizing a contextually-based functional assignment for a user-manipulable element on an input device, according to certain embodiments.
• FIG. 2 shows a system for operating an input device, according to certain embodiments.
• FIG. 3 shows a system for operating a host computing device, according to certain embodiments.
• FIG. 4 shows a user-manipulable element, according to certain embodiments.
• FIG. 5 shows a cutaway view of a user-manipulable element, according to certain embodiments.
• FIG. 6 shows a magnetic ratchet for a user-manipulable element, according to certain embodiments.
• FIG. 7 shows a bi-stable clutch mechanism for an input device, according to certain embodiments.
• FIG. 8 shows a simplified flow diagram for associating a function with a user-manipulable element on an input device, according to certain embodiments.
• FIG. 9 shows aspects of associating a function with a user-manipulable object, according to certain embodiments.
• FIG. 10 shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments.
• FIG. 11 shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments.
• FIG. 12A shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments.
• FIG. 12B shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments.
• FIG. 13A-C shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments.
DETAILED DESCRIPTION
• Aspects of the present disclosure relate generally to input devices, and in particular to aspects of assigning a function to a user-manipulable object on an input device, according to certain embodiments.
• In the following description, various embodiments of assigning a function to a user-manipulable object on an input device will be described. For purposes of explanation, specific configurations and details are set forth in order to provide a thorough understanding of the embodiments. However, it will be apparent to one skilled in the art that certain embodiments may be practiced or implemented without every detail disclosed. Furthermore, well-known features may be omitted or simplified in order to prevent any obfuscation of the novel features described herein.
Conceptual Overview of Certain Embodiments
• Some embodiments of the invention relate to a user-manipulable element (e.g., a knob) disposed on an input device (e.g., keyboard) that can be assigned a function based on a contextual interaction on a graphical user interface (GUI). More specifically, the input device may include a user-manipulable knob (see, e.g.,element150 ofFIG. 1), a ratchet system disposed in the knob to apply a ratcheted or non-ratcheted mode, and one or more touch-sensitive sensors (“touch sensor(s)”) disposed on a surface of the knob. An operational configuration can be applied to the knob which may control one or more aspects of knob rotation, knob rotation resolution, knob rotation resistance (e.g., torque friction), knob ratchet/no-ratchet modes, touch-based functions, and the like, as further discussed below. The operational configuration can be based on a contextual usage of the input device. For example, selecting alphanumeric text on a display may cause the knob to control functions associated with alphanumeric text, such as font size, font type, font color, font position, and the like, as further discussed below.
• The input device can be controlled by a host computing device. For instance, one or more processors of the host computing device can detect a selectable control element on a GUI (e.g., alphanumeric text), determine an editable parameter (e.g., font size) associated with the selectable control element, and associate a control of the editable parameter with a user-manipulable element on an input device. The one or more processors can further generate and send control data causing the input device (e.g., a processor of the input device) to assign a performance characteristic to the knob based on properties of the editable parameter. As discussed above, the performance characteristic may include a rotation resistance of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), a setting of a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter, a function of one or more touch sensors on the knob, or a depressible function (e.g., button press). In some aspects, the control data can control an electro-magnetic actuator (e.g., clutch) in the control knob to set the ratchet mode and non-ratchet mode of operation. In certain configurations, the touch sensor(s) may enter a value (e.g., controlled by rotating the knob) in response to receiving input data corresponding to a touch detected by the touch sensor, or switch to a second editable parameter associated with the selectable control element in response to the input data.
Typical System Environment for Certain Embodiments
• FIG. 1 shows a typical implementation for asystem100 utilizing a contextually-based functional assignment for a user-manipulable element150 on aninput device140, according to certain embodiments.System100 may includecomputer110,display120, input device130 (e.g., “computer mouse130”), and input device140 (e.g., “keyboard140”).Keyboard140 can include a user-manipulable element150 (“knob150”). Forsystem100,input device130 andkeyboard140 can be configured to control aspects ofcomputer110 anddisplay120, as would be understood by one of ordinary skill in the art.Computer110 can be referred to as a “host computer” or a “host computing device.”
• Computer110 may include a machine readable medium (not shown) that is configured to store computer code, such as keyboard driver software, and the like, where the computer code is executable by a processor (e.g., processor(s)302) ofcomputer110 to affect control ofcomputer110 byinput devices130 and/or140. The various embodiments described herein generally refer to inputdevice140 as a keyboard or similar input device, however it should be understood thatinput device140 can be any input/output (I/O) device, user interface device, control device, input unit, or the like.
• The user-manipulable element is typically described as a knob throughout this disclosure, however it should be understood that any suitable user-manipulable element can be used, such as a button, scroll wheel, trackball, joystick, slider, or the like, as would be understood by one of ordinary skill in the art. A “knob,” as described herein, can be interchangeably referred to as a “dial” or “crown.”
• Input device140 is typically described as a keyboard throughout this disclosure, however it should be understand that any suitable input device that can include a user-manipulable object, as described herein, can be used including, but not limited to, a computer mouse, a remote control device, a wearable device (e.g., smart watch, wristband, glasses), a smart phone, or the like.
• The host computing device is typically described as a desktop or laptop computing device. However, it should be understood that the host computing device can be any suitable computing device further including a tablet computer, a smart phone, a virtual or augmented reality interface (e.g., having 2D or 3D displays), a holographic interface, or the like. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• FIG. 2 shows a system for operating aninput device140, according to certain embodiments.System200 includes processor(s)210,memory array220,power management system230,communication system240, andinput detection250. Each of the system blocks220-250 can be in electrical communication with the processor(s)210 (e.g., via a bus system).System200 may further include additional systems that are not shown or discussed to prevent obfuscation of the novel features described herein. System blocks220-250 may be implemented as separate modules, or alternatively, more than one system block may be implemented in a single module. In the context described herein,input device140 can be a keyboard withknob150, as described above with respect toFIG. 1.
• In certain embodiments, processor(s)210 comprises one or more microprocessors (μCs) and can be configured to control the operation ofsystem200. Alternatively, processor(s)210 may include one or more microcontrollers (MCUs), digital signal processors (DSPs), or the like, with supporting hardware and/or firmware (e.g., memory, programmable I/Os, etc.), as would be appreciated by one of ordinary skill in the art. Processor(s)210 can control some or all aspects of operation of input device140 (e.g., system block220-250). Alternatively or additionally, some of system blocks220-250 may include an additional dedicated processor, which may work in conjunction withprocessor210. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• Memory array220 may be configured to store information pertaining to one or more operational configurations ofinput device140. As further discussed below, one or more operational configurations ofinput device140 may include setting performance characteristics ofknob150, including but not limited to, a rotation resistance of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter, a function of a depressible knob, a sensitivity of one or more touch sensors onknob150, functions associated with multiple detected touches on knob150 (by the touch sensors), their corresponding locations, and the like, as further discussed below.
• Memory array220 can further include stored input values associated with corresponding keys ofkeyboard150, as would be understood by one of ordinary skill in the art. Additionally,memory array220 can store one or more software programs to be executed by processors (e.g., in processor(s)210). It should be understood that “software” can refer to sequences of instructions that, when executed by processing unit(s) (e.g., processors, processing devices, etc.),cause system200 to perform certain operations of software programs. The instructions can be stored as firmware residing in read only memory (ROM) and/or applications stored in media storage that can be read into memory for processing by processing devices. Software can be implemented as a single program or a collection of separate programs and can be stored in non-volatile storage and copied in whole or in-part to volatile working memory during program execution.
• Power management system230 can be configured to manage power distribution, recharging, power efficiency, and the like, forinput device140. In some embodiments,power management system230 can include a battery (not shown), a USB based recharging system for the battery (not shown), and power management devices (e.g., low-dropout voltage regulators—not shown). In certain embodiments, the functions provided bypower management system230 may be incorporated into processor(s)210. The power source can be a replaceable battery, a rechargeable energy storage device (e.g., super capacitor, Lithium Polymer Battery, NiMH, NiCd), or a corded power supply. The recharging system can be an additional cable (specific for the recharging purpose) or it can use a USB connection to recharge the battery.
• Communications system240 can be configured to provide wireless communication withcomputer110, or other devices and/or peripherals, according to certain embodiments.Communications system240 can be configured to provide radio-frequency (RF), Bluetooth®, infra-red (IR), ZigBee®, or other suitable communication technology to communicate with other computing devices and/or peripheral devices.System200 may optionally comprise a hardwired connection tocomputer110. For example,keyboard140 can be configured to receive a Universal Serial Bus (USB) cable to enable bi-directional electronic communication withcomputer110 or other external devices. Some embodiments may utilize different types of cables or connection protocol standards to establish hardwired communication with other entities.
• Input detection250 can control the detection of a user-interaction with input elements oninput device140. For instance,input module250 can detect user inputs onknob150, key presses on the various keys of input device140 (e.g., QWERTY keys, function keys, number pad keys, etc.), or other suitable input elements or device such as a media control button, voice-over-internet-protocol (VoIP) button, touch sensors (e.g., touch pads) and the like. In some embodiments,input detection250 can work in conjunction withmemory array220 to detect inputs oninput device150 and associate various functions with each input element (e.g., knob150).
• Although certain necessary systems may not expressly discussed, they should be considered as part ofsystem200, as would be understood by one of ordinary skill in the art. For example,system200 may include a bus system to transfer power and/or data to and from the different systems therein.
• It should be appreciated thatsystem200 is illustrative and that variations and modifications are possible.System200 can have other capabilities not specifically described herein. Further, whilesystem200 is described with reference to particular blocks, it is to be understood that these blocks are defined for convenience of description and are not intended to imply a particular physical arrangement of component parts. Further, the blocks need not correspond to physically distinct components. Blocks can be configured to perform various operations, e.g., by programming a processor or providing appropriate control circuitry, and various blocks might or might not be reconfigurable depending on how the initial configuration is obtained.
• Embodiments of the present invention can be realized in a variety of apparatuses including electronic devices implemented using any combination of circuitry and software. Furthermore, aspects and/or portions ofsystem200 may be combined with or operated by other sub-systems as required by design. For example,input detection250 and/ormemory220 may operate within processor(s)210 instead of functioning as a separate entity. In addition, the inventive concepts described herein can also be applied to a mouse, keypad, or other similar input device. For instance, aspects ofsystem200 can be applied to a computer mouse, includingknob150. Further,system200 can be applied to any of the input devices described in the embodiments herein, whether explicitly, referentially, or tacitly described (e.g., would have been known to be applicable to a particular input device by one of ordinary skill in the art). The foregoing embodiments are not intended to be limiting and those of ordinary skill in the art with the benefit of this disclosure would appreciate the myriad applications and possibilities.
• FIG. 3 shows asystem300 for operating a host computing device (e.g., host computing device110), according to certain embodiments.System300 can be used to implement any of the host computing devices discussed herein with respect toFIGS. 1 and 4-13 and the myriad embodiments defined herein or within the purview of this disclosure but not necessarily explicitly described.System300 can include one ormore processors302 that can communicate with a number of peripheral devices (e.g., input devices) via abus subsystem304. These peripheral devices can include storage subsystem306 (comprisingmemory subsystem308 and file storage subsystem310), userinterface input devices314, userinterface output devices316, andnetwork interface subsystem312.User input devices314 can be any of the input device types described herein (e.g., keyboard, computer mouse, remote control, etc.).User output devices316 can be a display of any type, including computer monitors, displays on handheld devices (e.g., smart phones, gaming systems), or the like, as would be understood by one of ordinary skill in the art. Alternatively or additionally, a display may include virtual reality (VR) displays, augmented reality displays, holographic displays, and the like, as would be understood by one of ordinary skill in the art.
• In some examples,internal bus subsystem304 can provide a mechanism for letting the various components and subsystems ofcomputer system300 communicate with each other as intended. Althoughinternal bus subsystem304 is shown schematically as a single bus, alternative embodiments of the bus subsystem can utilize multiple buses. Additionally,network interface subsystem312 can serve as an interface for communicating data betweencomputer system300 and other computer systems or networks. Embodiments ofnetwork interface subsystem312 can include wired interfaces (e.g., Ethernet, CAN, RS232, RS485, etc.) or wireless interfaces (e.g., Bluetooth®, BLE, ZigBee®, Z-Wire®, Wi-Fi, cellular protocols, etc.).
• In some cases, userinterface input devices314 can include a keyboard (keyboard140), a presenter, a pointing device (e.g., mouse, trackball, touchpad, etc.), a touch-screen incorporated into a display, audio input devices (e.g., voice recognition systems, microphones, etc.), Human Machine Interfaces (HMI) and other types of input devices. In general, use of the term “input device” is intended to include all possible types of devices and mechanisms for inputting information intocomputer system300. Additionally, userinterface output devices316 can include a display subsystem, a printer, or non-visual displays such as audio output devices, etc. The display subsystem can be any known type of display device. In general, use of the term “output device” is intended to include all possible types of devices and mechanisms for outputting information fromcomputer system300.
• Storage subsystem306 can includememory subsystem308 andfile storage subsystem310.Subsystems308 and310 represent non-transitory computer-readable storage media that can store program code and/or data that provide the functionality of embodiments of the present disclosure. In some embodiments,memory subsystem308 can include a number of memories including main random access memory (RAM)318 for storage of instructions and data during program execution and read-only memory (ROM)320 in which fixed instructions may be stored.File storage subsystem310 can provide persistent (i.e., non-volatile) storage for program and data files, and can include a magnetic or solid-state hard disk drive, an optical drive along with associated removable media (e.g., CD-ROM, DVD, Blu-Ray, etc.), a removable flash memory-based drive or card, and/or other types of storage media known in the art.
• It should be appreciated thatcomputer system300 is illustrative and not intended to limit embodiments of the present disclosure. Many other configurations having more or fewer components thansystem300 are possible. The various embodiments further can be implemented in a wide variety of operating environments, which in some cases can include one or more user computers, computing devices or processing devices, which can be used to operate any of a number of applications. User or client devices can include any of a number of general purpose personal computers, such as desktop or laptop computers running a standard or non-standard operating system, as well as cellular, wireless and handheld devices running mobile software and capable of supporting a number of networking and messaging protocols. Such a system also can include a number of workstations running any of a variety of commercially available operating systems and other known applications for purposes such as development and database management. These devices also can include other electronic devices, such as dummy terminals, thin-clients, gaming systems and other devices capable of communicating via a network.
• Most embodiments utilize at least one network that would be familiar to those skilled in the art for supporting communications using any of a variety of commercially available protocols, such as TCP/IP, UDP, OSI, FTP, UPnP, NFS, CIFS, and the like. The network can be, for example, a local area network, a wide-area network, a virtual private network, the Internet, an intranet, an extranet, a public switched telephone network, an infrared network, a wireless network, and any combination thereof.
• In embodiments utilizing a network server, the network server can run any of a variety of server or mid-tier applications, including HTTP servers, FTP servers, CGI servers, data servers, Java servers, and business application servers. The server(s) also may be capable of executing programs or scripts in response to requests from user devices, such as by executing one or more applications that may be implemented as one or more scripts or programs written in any programming language, including but not limited to Java®, C, C# or C++, or any scripting language, such as Perl, Python or TCL, as well as combinations thereof. The server(s) may also include database servers, including without limitation those commercially available from Oracle®, Microsoft®, Sybase® and IBM®.
• Such devices also can include a computer-readable storage media reader, a communications device (e.g., a modem, a network card (wireless or wired), an infrared communication device, etc.), and working memory as described above. The computer-readable storage media reader can be connected with, or configured to receive, a non-transitory computer-readable storage medium, representing remote, local, fixed, and/or removable storage devices as well as storage media for temporarily and/or more permanently containing, storing, transmitting, and retrieving computer-readable information. The system and various devices also typically will include a number of software applications, modules, services or other elements located within at least one working memory device, including an operating system and application programs, such as a client application or browser. It should be appreciated that alternate embodiments may have numerous variations from that described above. F or example, customized hardware might also be used and/or particular elements might be implemented in hardware, software (including portable software, such as applets) or both. Further, connections to other computing devices such as network input/output devices may be employed.
Aspects of the Use and Configuration of the User-Manipulable Element
• FIG. 4 shows a user-manipulable element450, according to certain embodiments. User-manipulable element (“knob”)450 can be disposed on any suitable input device (e.g., keyboard440) and may includetop surface456 andside surface458.Top surface456 may include touch sensor(s)457 andside surface458 may include touch sensor(s)459.Knob450 can be rotated alongpath451 and, in some cases, can be depressible alongpath452 to register a “button click” as would be understood by one of ordinary skill in the art.
• Knob450 can include various performance characteristics that can be set or controlled locally (e.g., by processor210), remotely (e.g., via control signal generated by processor(s)302), or a combination thereof. Some performance characteristics can include a rotation resistance (ofknob450, a rotational input resolution of knob450 (e.g., rotation sensitivity), a depressible knob function, setting a ratchet or non-ratchet mode of operation (e.g., via a magnetic clutch and ratchet system disposed inknob450—as described below in conjunction withFIGS. 5-7) toknob450 based on properties of an editable parameter (e.g., associated with a selectable control element on a host computing device—further discussed below). In certain embodiments,touch sensors457,459 can detect a single touch or simultaneous touches. One performance characteristic of touch sensors can include a touch sensitivity (e.g., resolution). In some cases, one or more touch sensors on knob450 (e.g.,sensor454,457) can operate as a touch pad, allowing a user to, e.g., move a cursor on a display. In further embodiments,knob450 can be a standalone unit. For instance,knob450 may not be associated with another input device (e.g., keyboard, computer mouse, etc.) and may operate independently (e.g., controlled by system200).
• In certain embodiments,touch sensors454 and457 may have similar functions, different functions, or complimentary functions. One example of a complimentary function is thattop touch sensor457 can be used for course adjustments (e.g., large scale zoom) whileside touch sensor454 may control fine adjustments (e.g., small scale zoom). In some cases,top touch sensor457 can be used to enter a value (see, e.g.,FIG. 12A), or open a menu (e.g., pressingsensor457 opens a visual UI menu allowing a user to switch between functions by rotatingknob450 or selecting with a computer mouse-controlled cursor).
• In some cases, a user may want to have a quick-access method of getting back to a global setting, such as a non-context sensitive setting forknob450. For example, if a user is in a photo editing application and has a specific tool selected, turningknob450 may change aspects of the selected tool. If the user wants to change a different parameter all together (e.g., volume), pressing down knob450 (depressing along path452) and rotating whileknob450 is depressed may be configured to perform an alternative function (e.g., switching to desktop, scroll up/down, volume control, etc.). One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• Rotational resistance can range from no rotational resistance (e.g., no added resistance) to a high resistance to prevent a user fromrotating knob450. For example, if a value (e.g., brightness) can be adjusted to a setting that can range from 0 to 100,knob450 can be configured to provide a relatively high rotational resistance at each limit. For instance, a rotational resistance may be low (i.e., a user can easily rotate knob450) from 1-99, and rotational resistance may be high (i.e., a user cannot rotateknob450 any further) at 0 and 100. In some embodiments, the rotational resistance may follow a particular torque profile such that the rotational resistance is lowest at 50 and increases linearly or non-linearly as the minimum and maximum limits are approached. Any suitable force profile can be applied, as would be understood by one of ordinary skill in the art. Rotational resistance can be referred to as a torque friction, rotational friction, a torque profile (e.g., rotational resistance over a range), or the like.
• Ratchet and non-ratchet mode may be set based on any suitable criteria. For example, ratchet mode may better apply to applications that have a finite number of settings, such as a selection of a number of available paint brushes in Photoshop®, a number of font sizes that are available, or the like. A non-ratcheted mode may be well suited for more analog settings that have a continuous or high number of settings, such as a selection of a color from a band of hundreds, thousands, or millions of available colors, a scroll bar (e.g., to scroll through a 100+ page document), a volume, or the like.
• Aspects of a Magnetic Ratchet Assembly
• FIG. 5 shows a cutaway view of a user-manipulable element (“knob”)500 with a magnetic ratchet system disposed therein, according to certain embodiments. A ratchet system can be used to implement a simulated ratcheting effect onknob500 when activated. When deactivated,knob500 may rotate freely with no ratcheting effect. In some embodiments, aspects of the ratcheting including the magnitude of each ratchet (e.g., how much travel between each ratchet “click”) and a resistance of the ratchet (e.g., how much force is required to rotateknob500 in ratchet mode) can be controlled by, for example,processor210,processor302, or a combination thereof, as further discussed below. In one example,knob500 may be configured for a ratcheting mode of operation when a finite or limited number of quantized selections are available and/or low resolution is required. For instance, a font size or font type for alphanumeric text on a GUI may be appropriate. In that case, some users may find that it is intuitive to associate ratcheting or “clicking” with each selection. In another example,knob500 may be configured for a non-ratcheting mode of operation when a large number of choices are available, high resolution is required, or a continuous gradient or scale of values can be selected. A ratcheting mode, even with high resolution (e.g., small “clicks”) would necessarily skip certain values in a continuous spectrum of choices. A non-ratcheting mode can allow a user to select any value with high precision, which may be desirable in certain situations (e.g., selecting a color for a 3D model in a continuous spectrum of available colors). One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• In certain embodiments, a ratcheting effect is implement viaknob500, as shown and described with respect toFIGS. 5-7 and the accompanying Appendix. In some embodiments, a knob with an embedded magnetic ratcheting system may include a magnetic ratchet, a clutch including a fixed disc and a mobile friction disc, a bi-stable electromagnetic clutch actuator, a magnetic angular sensor, a switch actuated by axial displacement of the knob, and a proximity detector electrode on the shaft end. Referring toFIG. 5,knob500 includesknob portion505,knob ratchet armature510,switch520,angular sensor525,angular sensor magnet530, bi-stable electromagneticclutch actuator535, clutch controlmobile armature540, non-magneticclutch disc545, switchablemagnetic wheel550,ratchet assembly555, fixedfriction disc560, and printed circuit board (PCB) withelectrode proximity detection565. The operation of which would be understood by one of ordinary skill in the art with the benefit of this disclosure.
• FIG. 6 showsmagnetic ratchet600 for a user-manipulable element, according to certain embodiments. In some embodiments,magnetic ratchet600 can include two similar armatures with teethed wheels and a ring magnet assembled on a plastic rim. Improved torque efficiency can be obtained with two air gaps contributing to a reluctance variation.Magnetic ratchet600 is shown withknob armature610, andarmature magnet assembly620, which can be free or locked. The operation of which would be understood by one of ordinary skill in the art with the benefit of this disclosure.
• FIG. 7 shows a bi-stableclutch mechanism700 for an input device (e.g., knob450), according to certain embodiments. A bi-stable function of the actuator may be obtained by adding a non-linear force of a reluctant magnetic circuit loaded by a ring magnet and a nearly constant force of a helicoidal spring (see, e.g., the Appendix). In some implementations, the spring force can contribute to brake the teethed armatures to achieve the ratcheting effect by pushing against the clutch disc. When the ratchet is off, the magnetic reluctance force may be higher than the spring force, causing the magnetic circuit to remain closed and allowing the ratchet wheel to turn freely. In some embodiments, a non-magnetic clutch disc can be placed between the ratchet wheel (teethed armatures) and the clutch control armature to separate the two magnetic circuits. In some cases, the non-magnetic clutch disc can also be used to adapt the gap of the control system because the other parts stacked on the shaft may not be able to be controlled with tight tolerances. The clutch position can be controlled by means of a coil. To switch off the ratchet effect, a negative current can be fed into the coil to produce a pulling force on the clutch control armature (e.g., moving clutch disc), which can be higher than the spring force. Referring toFIG. 7, bi-stableclutch mechanism700 can include a passage for anelectrode wire705, a plastic ratchet bearing710, a clutch fixed magnetic disk715 (e.g., crimped on the shaft), a PCB withelectrode720, teeth armature725, ratchetring magnet730, teeth armature735, non-magneticclutch disc740,clutch control armature745,spring750,coil bell armature755,coil760,ring magnet765 andshaft770. The operation of which would be understood by one of ordinary skill in the art with the benefit of this disclosure.
• Although many of the embodiments described herein use an electro-magnetic actuator to implement the ratchet/non-ratchet functions, it should be understood that other implementations may use different mechanisms to provide a controllable ratchet function. For instance, some embodiments may employ mechanical/friction ratchet mechanisms that can be actuated by a direct current (DC) motor (e.g., see Appendices). One of ordinary skill in the art with the benefit of this disclosure would understand the many variations, modifications, and alternative embodiments thereof.
• At a high level of abstraction, software operating on a host computing device (e.g., executed by processor302) typically manages mapping functions (e.g., mapping editable parameters associated with selectable control element with user-manipulable element (e.g., knob450) on an input device, as further discussed below) and interfacing between computer software running on the host computing device (e.g., Photoshop®) and the connected input device (e.g., knob450). Alternatively or additionally, some management may be performed, in part, by aspects (e.g., processor210) of the corresponding input device. From a user perspective, the user-manipulable element may be associated with the graphical element closest to a cursor on a display. For example, as a user moves a cursor toward a first graphical element (e.g., selectable control element),knob450 can be dynamically programmed to control an editable parameter (e.g., font type) associated with that graphical element. Similarly, as the user moves the cursor towards a second selectable control element,knob450 may be automatically and dynamically programmed to control an editable parameter (e.g., volume) associated with the second selectable control element. Alternatively or additionally, associating the user-manipulable object with the editable parameter of a selectable control element can be based on other criteria other than a location of a cursor. For example, a selectable control element may be selected to be associated with a user-manipulable object based on historical usage. Thus, a “most used” selectable control element may be selected irrespective of the location of the cursor. Other methods of selection are possible, as would be understood by one of ordinary skill in the art. The following embodiments describe just some of the many embodiments that fall within the purview of this disclosure.
• FIG. 8 shows a simplified flow diagram800 for associating a function with a user-manipulable element on an input device, according to certain embodiments.Method800 can be performed by processing logic that may comprise hardware (circuitry, dedicated logic, etc.), software operating on appropriate hardware (such as a general purpose computing system or a dedicated machine), firmware (embedded software), or any combination thereof In certain embodiments,method800 can be performed byprocessor302 ofsystem300, as shown and described above with respect toFIGS. 1 and 3.
• Atstep810,method800 can include detecting, by aprocessor302 on ahost computing device110, a selectable control element on a graphical user interface (GUI), according to certain embodiments. A GUI can be a graphical window, virtual desktop, applications, or any image on a display (e.g., display120) that a user can interact with. A selectable control element can include any graphical element that can be controlled by a user. For example, some common selectable control elements can include desktop or window-based selectable icons, scroll bars, task bar elements, tabs, text, media players, media player controls (e.g., volume, pan, bass/treble, media transport controls, etc.), hyperlinks, or the like. One of ordinary skill in the art would understand the many possible types of selectable control elements that could be selectable on a GUI. In some embodiments, some control elements may not be “selectable” such that a user cannot manipulate or interact with the control element. For instance, a web page or PDF document may have a single page with no controllable element (e.g., no scroll bar). In such instances, non-selectable elements, such as alphanumeric text may be detected and used as described herein. In further embodiments, certain control elements may not be “selectable” from a current view and may be nested in various dropdown menus or interfaces. For example, a media player may include different skins (e.g., background images) with a selectable list of skins (i.e., the control element) buried in a nested menu. In such instances, the control element is not immediately selectable in a current view (outside of the corresponding menu bar), but can be detected nonetheless byhost computing device110. In certain embodiments,software configuring knob450 may access particular software operating on the host computing device to determine what elements are included in a particular window. For instance, presentation software can be accessed to determine what is included in each particular slide (e.g., embedded hyperlinks, spreadsheets, images, etc.), which is readily available and easily accessible as would be understood by one of ordinary skill in the art. Similarly, photo editing software (e.g., Photoshop®) can be accessed to determine what selectable control elements (e.g., icons, menus, etc.) are available. It should be understood that the various methods of identifying elements described with respect toFIG. 8 can be applied to any of the figures, embodiments, systems, or methods, etc., described herein, as would be understood by one of ordinary skill in the art.
• Atstep820,method800 can include determining, byprocessor302, an editable parameter associated with the selectable control element, according to certain embodiments. An editable parameter can be any adjustable value, setting, mode of operation, or the like, associated with the selectable control element. For example, a selectable control element can be alphanumeric text and the editable parameter can include a font size, font type, font color, text position (e.g., text can be moved on the display in an x and y direction), or the like. In another example, a media player can be the selectable control element and the editable parameter can include a volume, pan, bass/treble settings, media transport controls, and the like. In a further example, a photo may be the selectable control element and the editable parameters can include a zoom (magnification), pan control, brightness, contrast, filter selection, etc. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments of possible selectable control elements and editable parameters.
• Atstep830,method800 can include associating a control of the editable parameter with user-manipulable element150 on aninput device140, according to certain embodiments. User-manipulable element150 can be a knob, button, scroll wheel, trackball, joystick, slider, or the like, as would be understood by one of ordinary skill in the art. One example of associating a control of the editable parameter with user-manipulable element150 (knob150) can include associating a font-size selection for alphanumeric text ondisplay120 withknob150. More non-limiting examples of are provided inFIGS. 9-13C. The examples provided herein generally describe associating a control of the editable parameter with a single user-manipulable element150. Some embodiments may associate the editable parameter with multiple user-manipulable elements150. In some cases, the same editable parameter for a selectable control element can be associated with different user-manipulable elements150 based on certain contexts. For instance, a volume control on a media player may be associated withknob150 during typical use, but may opt to associate the volume control with a slider or touch sensor onkeyboard140 when certain applications (e.g., digital audio workstation) are in use to, for example, makeknob150 available for other purposes. Control data and control signal can be used interchangeably throughout this disclosure.
• Atstep840,method800 can include generating control data to assign a performance characteristic to user-manipulable element150 based on properties of the editable parameter. The control data can be in any suitable format that can control aspects (e.g., user-manipulable element150) ofinput device140, as would be understood by one of ordinary skill in the art. A performance characteristic forknob150 can include a rotation resistance of the knob, a rotational input resolution of the knob (e.g., rotation sensitivity), setting a ratchet or non-ratchet mode of operation for the knob (e.g., via an internal magnetic clutch) based on the properties of the editable parameter, or a depressible feature (e.g.,knob150 can be depressed like a button click). For buttons, touch sensors, sliders, or any other user-manipulable element150, editable parameters can include button sensitivity, touch sensitivity, haptic feedback intensity, or the like. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.Steps830 and840 can be separate steps or can be performed in a single step (e.g., generating control data to both associate an editable parameter with a user-manipulable element and assign a performance characteristic to the user-manipulable element. Atstep850,method800 can include sending, by the host computing device (e.g., processor302), the control signal to the input device (e.g., processor210).
• It should be appreciated that the specific steps illustrated inFIG. 8 provide aparticular method800 for assigning a function to a user-manipulable element on an input device, according to certain embodiments. Other sequences of steps may also be performed according to alternative embodiments. For example, alternative embodiments may perform the steps outlined above in a different order. Moreover, the individual steps illustrated inFIG. 8 may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional steps may be added or removed depending on the particular applications. For example,method800 can further include receiving a first input data corresponding to a rotation of the knob, receiving a second input data corresponding to the rotation of the knob, and applying the first input data and second input data to the editable parameter as a single continuous input when the first and second inputs are received within a threshold time. In this example, a user may turnknob150 by 180 degrees, let go ofknob150, andre-grab knob150 to turn it for an additional 70 degrees (e.g., if the user cannot sufficiently turnknob150 in a single turn). To determine whether the user intended the two turns to be separate or treated as a single continuous turn, a threshold time (e.g., less than 1 second) can be tracked between each input. For multiple inputs that occur within the threshold time, the inputs can be treated as a single continuous input. Any suitable threshold time can be used, which may be shorter or longer that the examples provided herein.
• In another example,method800 can further include receiving, byprocessor302, input data corresponding to a movement of a cursor on the GUI, where the detecting the selectable control element on the GUI occurs in response to detecting when the cursor is placed over the selectable control element. One of ordinary skill in the art would recognize and appreciate many variations, modifications, and alternatives ofmethod800.
• FIG. 9 shows aspects of asystem900 for associating a function with an input device that corresponds to a selectable control element on a display, according to certain embodiments. More specifically, a user manipulates first input device930 (e.g., computer mouse, presenter, etc.) to movecursor922 over selectable control element (“text”)924 ondisplay920. The host computer (e.g., host computer110) can then detectcontrol element924, determine certain editable parameters associated withtext924, associate a control of the editable parameter with a user-manipulable element (e.g., knob950) on a second input device (e.g., keyboard940) and generate a control signal to cause the second input device (e.g.,processor210 of keyboard940) to assign a performance characteristic (e.g., knob rotation) to the user-manipulable element based on properties of the editable parameter. For instance,text924 can include editable parameters such as font size and font type, which can include a number of discrete values. Thus,processor302 may determine that a rotation function would be better suited to cycle through available values (e.g., font sizes8-72) then successive button presses (e.g., depressing knob950) or successive touch sensor touches (e.g., touch sensor457) may be. In some embodiments,processor210 ofinput device940 may determine the appropriate user-manipulable element to apply, whilehost computer110 merely sends a control signal indicating what editable parameters need to be assigned. In some cases, the assignment can be controlled, in part, by bothprocessors302 and210. One of ordinary skill in the art with the benefit of this disclosure would understand the many variations, modifications, and alternative embodiments thereof.
• In some embodiments, multiple editable parameters can be associated with a user-manipulable element (e.g., rotation of knob950) and prioritized in a hierarchical fashion. Referring toFIG. 9, a font size, font type, and font color are associated withalphanumeric text924 and assigned toknob950, respectively. In certain aspects, a user can cycle through and switch between each editable parameter. For instance, a detected touch on a touch sensor (e.g., sensor457) may execute a switch from font size to font type. A subsequently detected touch on the touch sensor may cause a switch from font size to font color, and so on. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• The example shown inFIG. 9 shows a user manually selecting control element (“text”)924. Alternatively or additionally,system900 may automatically select a selectable control element without requiring user interaction. Automatic selection can be performed based on any suitable criteria, such as a hierarchy of preferred editable parameters, by machine learning based on previous user selections and interactions, by application-based preset conditions, or the like, and by any combination thereof.
• FIG. 10 shows aspects of associating a function with a user-manipulable object150 on aninput device1040, according to certain embodiments, and includes display1020 (e.g., operated by aspects of system300), keyboard1040 (e.g., operated by aspects of system300), andknob1050. As described above, a ratchet or non-ratchet mode of operation can selectively be applied to a user-manipulable control based on properties of a corresponding editable parameter. In some cases, it may be advantageous to apply a ratchet mode of operation toknob1050 when alphanumeric text is detected ondisplay1020, as a limited number of discrete settings (e.g., font size, font type, number of brushes, number of selectable tabs, etc.) may be more intuitively controlled with discrete positions onknob1050. Referring toFIG. 10, asknob1050 is rotated clockwise, larger discrete font sizes (or any suitable editable parameter associated with a detected selectable control element) are applied to the corresponding text (e.g., selectable control element) ondisplay1020. In alternative embodiments, font size or font type could, for example, be associated withknob1050 having the ratchet mode turned off such that the rotation ofknob1050 is smooth and changes in the underlying editable parameter can be configured to change between values asknob1050 is rotated a certain distance (e.g., switch values every 20 degree rotation). In some embodiments, multiple performance characteristics may be associated with a single editable parameter. For instance,knob1050 may be configured to control a font type asknob1050 is rotated, a ratchet mode may be applied, and a resistance of rotation may be configured to increase or decrease as the selected values increase or decrease. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• In some embodiments, the number of ratchet positions in 360 degrees of rotation can be controlled by software operating on host computing device (e.g., via method800). In some cases, a ratchet torque (e.g., rotational resistance) can be configured to correspond to a number of ratchet positions. For example, a low number of ratchet positions (e.g., line width) may have a higher relative rotational resistance associated with it (e.g., harder for a user to rotate knob1050), while a high number of ratchet positions (e.g., number of brushes) may have a lower relative rotational resistance associated with it (e.g., easier for a user to rotate knob1050). Some embodiments can include very high rotational resistance when a minimum or maximum software value is reached to indicate to the user that the corresponding parameter (e.g., volume) cannot be increased or decreased beyond a current value. In some cases, a default value may have a higher rotation resistance than adjacent ratchet settings to indicate a center position, default value, preferred setting, or the like. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• FIG. 11 shows aspects of associating a function with a user-manipulable object1150 on aninput device1140, according to certain embodiments, and includes display1120 (e.g., operated by aspects of system300), keyboard1140 (e.g., operated by aspects of system300), andknob1150. As described above, a ratchet or non-ratchet mode of operation can selectively be applied to a user-manipulable control based on properties of a corresponding editable parameter. In some cases, it may be advantageous to apply a non-ratchet mode of operation toknob1150 when an image is detected ondisplay1120 and a corresponding editable parameter has a very high number of settings (e.g., continuous, high resolution color gradient). In such cases, it may be more intuitively controlled with a continuous rotation onknob1150. Referring to the non-limiting example shown inFIG. 10, asknob1150 is rotated clockwise,value indicator1165 can increase as it moves to the right on colorgradient selection bar1160. Typically, non-ratchet conditions may be well-suited for editable parameters that have high granularity, sensitive adjustments, or the like. Alternatively, some embodiments may employ a ratchet mode of operation to select colors. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof
• In certain embodiments, a non-ratchet mode may be applied to provide a user with an “analog” control over the associated editable parameter. In some cases, the friction torque (e.g., rotational resistance) ofknob1150 can depend on the software parameter type (e.g., editable parameter). For instance, scrolling in a large document may causeknob1150 to be configured in non-ratchet mode with a low rotational resistance (e.g., for fast scrolling), while a volume control (e.g., selectable control element) may causeknob1150 to have a high rotational resistance (e.g., to prevent inadvertent large changes in volume). Rotational resistance may be set to a maximum value when a minimum or maximum value for an editable parameter is met (e.g., scroll at top or bottom of document). In some cases, a default value may have a higher rotational resistance than adjacent settings ofknob1150 to give the impression of a single ratchet “dip” at a default position. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• FIG. 12A shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments. In certain situations, a user may want to cycle through a number of settings and/or values to determine a preferred outcome without necessarily entering the value until they are sure of their selection. In such cases, a touch sensor (e.g., touch sensor457) disposed onknob1250 can be configured to enter a currently selected value when touched. Referring toFIG. 12A, the alphanumeric text “design” is selected and the user is manipulatingknob1250 to set a particular value for a corresponding editable parameter (e.g., font size). The user can then tap the touch sensor onknob1250 to “enter” the value selected, thereby confirming a user intent to apply a specific setting. In some embodiments,processor210 may receive the touch sensor input signal and relay the signal to the corresponding host computing device (e.g., host computer110) to apply the setting. Alternatively or additionally, the control signal from the host computer that initially detected the “design” text and determined one or more associated editable parameters may cause the touch sensor ofknob1250 to control the “enter value” function as described above. In some cases, the control signal may provide the editable parameters and the input device (e.g., processor210) may select and control which user manipulable element is assigned the “enter value” function. One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• FIG. 12B shows aspects of associating a function with a user-manipulable object on an input device, according to certain embodiments. In certain situations, a user may want to switch between editable parameters to achieve a particular setting for the selectable control element. In such cases, a touch sensor (e.g., touch sensor457) disposed onknob1250 can be configured to switch between selectable elements associated with a currently selected control element. Referring toFIG. 12B, the alphanumeric text “technology” is selected. In response to the user touching the touch sensor, the selected editable parameter switches from font size to font type, and subsequent rotations ofknob1250 change the font type accordingly. In some embodiments,processor210 may receive the touch sensor input signal and relay the signal to the corresponding host computing device (e.g., host computer110) to apply the setting. Alternatively or additionally, the control signal from the host computer that initially detected the “design” text and determined one or more associated editable parameters may cause the touch sensor ofknob1350 to control the “enter value” function as described above. In some cases, the control signal may provide the editable parameters and the input device (e.g., processor210) may select and control which user manipulable element is assigned the “switch” function. In some embodiments, the switching function (or any function) can be associated with other controls, keys, etc. (e.g., assigned hot keys, function keys, etc., of a corresponding input device).
• Some embodiments may associate other functions with the one or more touch sensors onknob1250. For instance, short presses, long presses, multiple presses, and the like, can be configured to cause different functions to occur. In some cases, a single short press may implement validation (e.g., enter a value of an editable parameter—as described above), a long press may switch the editable parameter of the corresponding selectable control element, and a double tap may change a position in a menu hierarchy (e.g., switching from a first level including fonts, colors, and tools, to a lower level of fonts including font size and font type). One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• Proximity detection can be used with the one or more touch sensors, according to certain embodiments. For instance, power management functions (e.g., operated by power management block230) may be associated with proximity detection where the supporting electronics forknob1250 can turn on when a user's hand is determined to be in close proximity, which may be advantageous for power sensitive cordless input devices (e.g., keyboards, computer mice, etc.). One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• FIGS. 13A-C show aspects of associating a function with a user-manipulable object, according to certain embodiments.FIGS. 13A-C includedisplay1320 with a selected control element (e.g., gray scale gradient bar), aknob1350 on an input device, and a corresponding touchsensitive region1354 around a side portion or perimeter ofknob1350. In some cases, a user may wish to adjust an editable parameter associated withknob1350 to a value that they cannot reach with a single rotation. In some configurations, an adjusted value may revert back to a default value when a user let's go of knob1350 (e.g.,touch sensor1354 may detect that a user is no longer touching knob1350). This may be the case when entering a value occurs in response to touching a touch sensor, as discussed above with respect toFIG. 12A. With this setting, it can be cumbersome and inefficient is a user has to keep their fingers on a touch sensor while trying to rotate a knob beyond 270 degrees or more, for example. One solution may be to taptouch sensor1250 half way through the rotation to “save” the setting and then re-grip the knob to continue the rotation.
• In certain embodiments, a threshold time can be used to determine when an input is intended to be completed. For instance, inFIG. 13A, the user rotatesknob1350 approximately 100 degrees causing an adjustment of a gray-scale gradient bar ondisplay1320. InFIG. 13B, the user let's go ofknob1350 and repositions his hand to continue rotatingknob1350, causing adjustment of the gradient bar to pause. InFIG. 13C, the user continues the rotation ofknob1350 for an additional 100 degrees, thereby causing the adjustment of the gradient bar to continue. In some embodiments, if the time between the user letting go ofknob1350 inFIG. 13B andre-gripping knob1350 inFIG. 13C is less than a threshold time (e.g., 2 seconds), then the adjustments ofFIGS. 13A and 13C are treated as a continuous adjustment and the default auto-reset function mentioned above would be avoided. The threshold time can be any suitable value and may be shorter or longer than the examples provided herein. Thus, in certain embodiments,processor210 can receive a first input data corresponding to a rotation ofknob1350, receive a second subsequent input data corresponding to the rotation ofknob1350, and apply the first input data and second input data to a corresponding editable parameter as a single continuous input when the first and second inputs are received within the threshold time.
• In some embodiments,touch sensors1354 can detect multiple simultaneous touches (e.g., thumb, forefinger, and middle finger detection when adjusting knob1350), which can be useful for location-dependent touch detection. For instance, some embodiments may increase a sensitivity of the adjustment of an editable parameter when a user gripsknob1350 with three fingers instead of two. In some cases, a memory buffer (e.g.,memory array220 or308) can be used to store how certain users interact withknob1350. For instance, a first user may typically use two fingers at diametrically opposed locations on knob1350 (i.e., user grip profile), while a second user may typically gripknob1350 with three fingers, or with two fingers at different non-diametrically opposed locations. In such instances (e.g., through machine learning viaprocessor210 and/or302), certain editable parameters with particular sensitivities may be assigned toknob1350 in response to detecting a particular selectable control element when the first user is determined to be interacting with knob1350 (e.g., based on previous first user interactions), and different editable parameters with different sensitivities may be assigned toknob1350 in response to detecting the selectable control element when the second user is determined to be interacting with knob1350 (e.g., based on the grip profile). One of ordinary skill in the art would understand the many variations, modifications, and alternative embodiments thereof.
• Other variations are within the spirit of the present disclosure. Thus, while the disclosed techniques are susceptible to various modifications and alternative constructions, certain illustrated embodiments thereof are shown in the drawings and have been described above in detail. It should be understood, however, that there is no intention to limit the disclosure to the specific form or forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions and equivalents falling within the spirit and scope of the disclosure, as defined in the appended claims.
• The use of the terms “a” and “an” and “the” and similar referents in the context of describing the disclosed embodiments (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. The terms “comprising,” “having,” “including,” and “containing” are to be construed as open-ended terms (i.e., meaning “including, but not limited to,”) unless otherwise noted. The term “connected” is to be construed as partly or wholly contained within, attached to, or joined together, even if there is something intervening. The phrase “based on” should be understood to be open-ended, and not limiting in any way, and is intended to be interpreted or otherwise read as “based at least in part on,” where appropriate. Recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. All methods described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The use of any and all examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illuminate embodiments of the disclosure and does not pose a limitation on the scope of the disclosure unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the disclosure.

Claims (20)

What is claimed is:

1. A computer-implemented method comprising:

detecting, by a processor on a host computing device, a selectable control element on a graphical user interface (GUI);

determining, by the processor, an editable parameter associated with the selectable control element;

associating a control of the editable parameter with a user-manipulable element on an input device; and

generating and sending, by the processor to the input device, control data causing the input device to assign a performance characteristic to the user-manipulable element based on properties of the editable parameter.

2. The method ofclaim 1 wherein the user-manipulable element is a rotatable knob on the input device.

3. The method ofclaim 2 wherein the performance characteristic is a rotation resistance of the knob.

4. The method ofclaim 2 wherein assigning the performance characteristic to the knob further includes setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter.

5. The method ofclaim 4 wherein the control data controls an electro-magnetic actuator in the knob to set the ratchet mode and non-ratchet mode of operation.

6. The method ofclaim 2 wherein the performance characteristic is a rotational input resolution of the knob.

7. The method ofclaim 2 further comprising:

receiving a first input data corresponding to a rotation of the knob;

receiving a second input data corresponding to the rotation of the knob; and

applying the first input data and second input data to the editable parameter as a single continuous input when the first and second input data are received within a threshold time.

8. The method ofclaim 2 wherein the knob further includes a touch sensor on a surface of the knob, and wherein associating a control of the editable parameter with the knob further includes assigning a function with the touch sensor.

9. The method ofclaim 8 wherein the function includes entering a value of the editable parameter in response to receiving input data corresponding to a touch detected by the touch sensor.

10. The method ofclaim 8 wherein the function includes switching to a second editable parameter associated with the selectable control element in response to receiving input data corresponding to a touch detected by the touch sensor.

11. The method ofclaim 8 wherein the knob further includes a second touch sensor on a perimeter of the knob, and wherein the function includes switching to a second editable parameter associated with the selectable control element in response to receiving:

input data corresponding to a touch detected by the touch sensor; and

input data corresponding to a touch detected by the second touch sensor.

12. The method ofclaim 8 wherein the knob further includes one or more additional touch sensors around a perimeter of the knob to detect multiple simultaneous touches on the perimeter.

13. The method ofclaim 1 wherein the selectable control element is one of:

a selectable icon on the GUI;

a selectable item in a menu on the GUI; or

a graphical element on the GUI.

14. The method ofclaim 1 further comprising:

receiving, by the processor, input data corresponding to a movement of a cursor on the GUI,

wherein the detecting the selectable control element on the GUI occurs in response to detecting when the cursor is placed over the selectable control element.

15. The method ofclaim 14 wherein the user-manipulable element includes a touch sensor, and wherein assigning the performance characteristic to the user-manipulable element is performed further in response to receiving an input corresponding to a touch on the touch sensor.

16. An input device comprising:

a housing;

a processor disposed in the housing;

a user-manipulable knob disposed on the housing and controlled by the processor; and

a ratchet system disposed in the knob to apply one of a ratcheted or non-ratcheted mode to the knob,

wherein the processor controls an operational configuration of the user-manipulable knob based on control data received from the host computing device, the operational configuration corresponding to a contextual usage of the input device on the host computing device, and

wherein the operational configuration includes an assigned ratcheted or non-ratcheted mode based on the control data.

17. The input device ofclaim 16 further comprising:

a touch sensor controlled by the processor and disposed on a surface of the knob to detect a touch,

wherein the operational configuration further includes an assigned touch sensor mode based on the control data.

18. A computer-implemented system:

one or more processors; and

one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:

detecting, by a processor on a host computing device, a selectable control element on a graphical user interface (GUI);

determining, by the processor, an editable parameter associated with the selectable control element;

associating a control of the editable parameter with a user-manipulable element on an input device; and

generating and sending, by the processor to the input device, control data causing the input device to assign a performance characteristic to the user-manipulable element based on properties of the editable parameter.

19. The system ofclaim 18 wherein the user manipulable element is a rotatable knob on the input device, and wherein the performance characteristic is a rotation resistance of the knob.

20. The system ofclaim 19 wherein assigning the performance characteristic to the knob further includes setting a ratchet or non-ratchet mode of operation to the knob based on the properties of the editable parameter.

Images