For buttons/keys and the apparatus and method and base of the input of " finger writing " mixed typeIn low gabarit/geometry-variable controller of handThe cross reference of related application
This application claims 62/191528 He of sequence number submitted for 26th respectively on July 13rd, 2015 and August in 2015The priority of 62/210413 U.S. Provisional Patent Application, its entire disclosure are incorporated herein by reference herein
Technical field
The present invention relates to " mixing " input unit (man-machine interface) based on hand, is used more particularly to allowing to utilizeTechnical ability that family has been provided with and the method for compact, singlehanded exercisable symbol and characters input method independent of vision andDevice.
Here a kind of new dynamic/deformable human-computer interaction device (method and apparatus/controller) is also discussed, morePrecisely, it is related to the controller based on hand of geometry-variable, it is variable for (sum of human engineering) of offer on demandInterface, so that user is interacted using hand, so as to provide more flexible/various interactive mode, and may simulate various (be based onHand) controller/device (including user experience), so that user can have various ways interaction, without being switched to otherController.
Background technology
With the development of computer and home entertainment system/intelligent electric appliance, system have it is more and more need will even/onNet, therefore be connected to website/service, inputs URL, and it is very universal, but mesh (such as game machine) to search for and fill in these systemsPreceding game console or many other intelligent electric appliance/smart televisions cannot provide character easy to use/convenient/symbol inputMechanism.
It is known in the art that such as control stick, mouse, game paddle, touch pad, keyboard, data glove, key(and paired) uses the controller based on hand of disk etc. usually together with one or more controlled machines.This controller leads toOften there are button, touch pad on the surface of controller, control stick and touch feedback etc. control, and generally according to user and machineBetween specific interactive mode be laid out, for example, the control frequently used does more, and be easy to finger and get at.
But introducing and the demand that is easily interacted with a variety of devices with VR technologies, this " special " controllerJust seem underaction, can not it is effective/more easily control different devices.
The suggested solution provided in the present invention, by using one it is unique can multiple geometries/The device manipulated with hand that variable-geometry (can be changed) of change/conversion between form, at least one kind pair in these formsIt is functional in hand/finger manipulation (control on device/controller), so as to provide variable interface to the user, and allowsOn demand/dynamic changes interface, so as to allow more neatly to operate and integrate multiple controller/devices, without physicallyChange controller in the hand of user, and provide the experience of uniqueness to the user, while still with the manipulation technical ability of existing control.
Here low gabarit (shape) control of the similar control bar mode using touch sensitive zone (pad, screen) is also discussed.(alternatively) it can be used in the controller based on hand of geometry-variable (control interacted as user).
The content of the invention
Definition.It is unless the context otherwise requires, otherwise following as used in the specification and the appended claimsTerm should have indicated implication：
Finger writing：Pass through the figure on the surface of tip (top of such as forefinger, middle finger or thumb) touch/drafting of fingerCase (or sequence of touch event/stroke), substantially character, symbol or by using finger tip (or top of thumb) on surfaceThe navigation (for example, sliding, rotation) " mark " of upper writing.Resulting pattern form can be similar to hand-written, but fingerWriting need not be related to pen or writing pencil, and only need a finger (to may also mean that come the shape that draws a design and draw thisThe action of kind pattern form).
The direction of the hand/finger writing of " normal/comfortable " (for surface)：
In routine/normal grip of controller, in order to cosily carry out " finger writing ", usually by fingerThe surface that (or thumb) is write needs to be oriented at least partially in user, such as (but not limited to) upward or towards side but not(for example, being considered in the range of the user oriented 180 degree in part on the direction of " deviating from " user.) as direction allow handRefer to (or thumb) the position of relative comfort " writing " on the surface (when) there is certain accuracy.(when use forefinger or middle fingerWhen, the corresponding hand position of this " normal/comfortable " hand/finger writing position is pronation, or towards not being consideredThe side surface direction of user oriented, and for thumb be written on certain situation assistant position be palm portion upwards orUser is partially toward, rather than is highly desirable to away from the direction of user).
Commonly/standard (game console) operating gesture/(posture of hand/finger)：
Game console/handle of user for being interacted with computer system/game console usually has multiple controlsAxis processed, such as control stick and buttons/keys and/or touch area,
" layout " of control (button, control stick, touch pad) allow generally for multiple controls manipulated at the same time by different fingers/Operation, and it is considered as to play to play that user, which has " normal " grip/posture (for example, with thumb joystick/keyboard)," standard " or " normal " (by design) posture/posture.New touch pad finger writing input method in the present invention also based onThis standard/normal gesture (posture of hand/finger), and allow index/middle finger there is no (significant/substantially) to interrupt otherText input is carried out in the case of the operation of finger.
The control of hand/finger manipulation：Finger is dimensioned in hand/finger manipulation (such as, but not limited to button, key, control stick(particularly game paddle sample)), the control of touch sensitive zone (such as, but not limited to touch pad/touch-screen etc.).
Hand/finger control surface：
There is the control of one or more hand/finger manipulations on one surface of one controller, for user mutual.
Partly a pair of of gear of one gear (including bevel gear) of (tooth) gear or only some whole circular arc is with teeth, anotherPart is smooth (rather than movement of driving pairing/meshing gear) or is not present.
Allow at first hand-held or wearable interactive device/controller that input is provided from multiple fingers it is convenient (andPossibly even singlehanded) into line character/symbol input (to such as, but not limited to computer system/host, but be not limited to swimIn the systems/devices that host/TV/set-top box/audio devices/controller of playing is connected or controlled) without (user) visionOr in the embodiment of the method for the help of sound, including：
Provide compact/limited size to the user (such as, but not limited to：Stamp/seal size or be enough to accommodate useThe size of finger writing method " write/draw " character/symbol, and had better not it is too big-than exceeding allow to draw 2 soCharacter/symbol area size) touch sensitive means/device (such as, but not limited to touch pad, touch-screen and etc.), itsOn the surface of the hand-held/wearable device or the hand-held/wearable device is attached to, is had " just at oneOften/it is comfortable " hand/finger writing direction (ergonomics) surface position at, and can easily be existed by userThe hand/being touched in finger writing posture by the finger tip of user/of one " normal/comfortable " is got at；(size of touch sensitive regions is not smallIn 6mm × 6mm, it may not be necessary to more than the size of normal finger writing character/symbol)；The desired touch area can be withWith border/(tactile) prompting come show for finger writing input effective touch sensitive region, can be for example but unlimitedIn：Projection/depression or convex/concave region on surface, edge, protrusion etc. or than peripheral region have differenceThe surface (material) of sense of touch/texture, user is relied solely on finger, just energy distinguishable region (confirms or helps without visionHelp/position))；
At " touch information " (" finger writing ") of touch sensitive regions sensing user, it is such as, but not limited to touch location/coordinate,Event, pattern, power/size (if pad is available) etc.,
It will be sent from the information/data of sensor collection on hand-held/movement/wearable device/controller or being connected(host) computer system on finger writing identification module；
" finger writing " is identified from the collected data/information；
And it is expected recognition result can with other inputs from the user (if any), such as user holds/byUnder the posture (while user perform finger writing) made of key/button or user be combined to form the word of outputSymbol/symbol or order；If for example, user perform finger writing input when press on (holdings) described controller additionallyKey (such as those can be defined as the function key of such as " shift " or " Fn " key etc), then the result exported will exist with userKeyed on keyboard, and the result for pressing corresponding function key (such as shift or Fn keys) on (holding) keyboard is consistent.
By recognition result (such as character/symbol or order) be output to down-stream system/interface (such as, but not limited to text orKeyboard receiving interface, or such as GUI component input frame of text/URL/ search, IME (Input Method Editor) window etc..).
In relevant embodiment, data/event/information from the touch pad/region may be with " real-time or closeMode in real time " is transferred to the finger writing identification module, such as, but not limited to on current touch point and timestampPosition/coordinate event/information " bag ", either " section " of current (continuous) curve or when touch system determines whole wordAccord with that the corresponding pattern being transfused to.
In a related embodiment, (alternatively) user can be prompted the candidate item of identification by (vision or the sense of hearing), or automaticallyComplete；
In a relevant embodiment, this method, which still further comprises to merge, freely to be used for its beyond handwriting inputThe information of the exercisable buttons/keys/touch sensitive regions of its finger so that user can use key combination (together with hand-written) to carry outComplicated and convenient input, these key/buttons can provide such as Caps, and Shift, Control, Fn, symbol, space, is returnedThe efficiency of non-" visible " character/function key such as return, or allow user quickly to be selected from candidate item/be automatically performed is middle.
In relevant embodiment, it may be desirable to by user (from same while finger writing input is performedHand or another hand) other key/buttons press event or gesture (such as, but not limited to other fingers press event or handGesture) it is combined to determine output character/symbol or direction/order；For example, if user is when finger writing input is performedPress (holding) Fn keys or (Shift) key that performs is (by same finger or another hand on hand, if the situation is applicable in(for example, in the case where both hands have controller)), then the result exported will be keyed in user on keyboard, and is pressed and (protectedHold) result of corresponding function key (such as shift or Fn keys) is consistent on keyboard.
In relevant embodiment, output character/symbol may be in similar to keyboard interface or simulation interface；
In the another embodiment of method, it is allowed to from one or a pair of (when " being a pair for both hands in controllerWhen) allow multiple fingers not disturbing existing capability/finger manipulation/game operation (such as ability with thumb manipulation control stickAnd other buttons) in the case of carry out convenient (and even singlehanded) character input, while provide and it be connected toComputer system input (such as, but not limited to game console) hand-held or wearable interactive device/controller,Including：
Provide compact/limited size to the user (such as, but not limited to：Stamp/seal size or be enough to accommodate useThe size of finger writing method " write/draw " character/symbol, and had better not it is too big-allow to write as 2 than exceedingThe area size of character/symbol is not so that meet ergonomic designs) touch sensitive means/device and (such as, but not limited to touchTemplate, touch-screen and etc.), it is located on the surface of the hand-held/wearable device or is attached to the hand-held/can wearDevice is worn, and the touch area has hand/finger writing posture that a surface direction is adapted to " normal/comfortable ", and be located atHand of the user at one " normal/comfortable "/can be by the position of the finger tip institute " conveniently touch/get at " of user in finger writing posturePut.
" conveniently touch/get at " position of being somebody's turn to do of the touch area (is such as, but not limited to played in the input unitController) on its (surface) or it is associated connect, can be accessed by forefinger or middle finger and carry out " finger writing " and at the same timeThe normal posture of other control/buttons on holding operation input device/controller (such as game console)-in other words,The position of touch area is when user keeps normal operating posture to carry out normally input/manipulation and not with input wordIn the range of Fu Shi, forefinger and middle finger can be easily accessible by -- possible position (or：The solstics of touch-surface) (normally holdingUnder appearance) centered on the root joint of forefinger (or forefinger is connected to the position of palm), radius is in the sphere of the length of forefinger.
" finger writing " is performed by the identification module on controller to identify, or information/number that finger writing is inputted(host) computer system connected, such as, but not limited to PC, tablet computer, intelligence electricity are transmitted to from controller according to/eventDepending on or game machine and perform identification there), it is expected such identification it is contemplated that (if any) same by other fingersWhen input or final output result is formed (if for example, user presses by gesture that controller/input system detectsCtrl or Fn keys, output result are pinned these keys just as user and are inputted on keyboard)；
By recognition result (such as character/symbol or order) be output to down-stream system/interface (such as, but not limited to text orKeyboard receiving interface, or such as GUI component input frame of text/URL/ search, IME (Input Method Editor) window etc..
The identification of (vision or the sense of hearing) candidate item input can be prompted in relevant (optional) user, or it is automatic completeInto；
In relevant embodiment, the touch area pad can be modular and can be from controller addition/shiftingRemove.
In relevant embodiment, touch area pad can be " collapsible "/" folding " or can be byIt is mobile so that when finger writing input is not required in user, touch area/pad can be by " folding/folding " or from " operative positionPut " remove to prevent obstacle/obstruction finger normal operating (such as game paddle button/joystick).
In (method) another embodiment, it is allowed to (such as but unlimited from hand-held or wearable pointing device/controllerIn mouse or 3D mouses) convenience (or even with one hand) character input, there is provided what the 3D controllers of position/movement input were connected to itComputer system) without disturbing existing function/operation/navigation to include：
Provide compact/limited size to the user (such as, but not limited to：Postage-stamp-sized, it is sufficiently large to use finger writingMethod comes " picture " and rewrites a character, and ideally cannot be too big, such as allow more than 2 characters in ergonomic positionsController on be difficult to arrangement/port) touch sensitive device that connects on said surface or on said surface is (such as, but not limited toTouch pad, touch-screen etc.) hand-held/wearable instruction device and touch area have gesture and facial expression/finger book towards " normal "The direction write, and at the position of " convenient to reach ", the finger tip of user can be in " normal " position；
The position of this " convenient reachable " of touch area/device on (surface) or with the input unit (exampleAs but be not limited to mouse, 3D mouses, 3D controllers) connection, the input unit by forefinger or middle finger and can keep just" finger writing " gesture operation device is often performed while operation；For example, touch area can be located at mouse " left side " or " in "On button, " middle key " position or the region of more top can also be located at, so that left-handed person can also operate this touch pad/regionEasily；
Carry out " finger writing " identification (by the identification module on controller or by finger writing input information/data/Event is sent to (host) computer system connected from controller), it is expected such identification it is contemplated that (ifWords)) input at the same time by other fingers-for example (be such as, but not limited to mouse/3D mouses from other keys on controller or 3D is controlledOther key/function key of device processed) on key/button pressing, it can be by another finger of user (for example, userCtrl or Fn keys are pinned, output result is pinned these keys just as user and inputted on keyboard)；Or by controller/input systemThe gesture detected of uniting forms final output result；
By recognition result (such as character/symbol or order) be output to down-stream system/interface (such as, but not limited to text orKeyboard receiving interface, or such as GU work element input frames of text/URL/ search, FE (Input Method Editor) window etc..
In the first embodiment of the control device based on hand of geometry-variable, which includes：
The hinged or touch component that at least two, which can mutually rotate ,/movement/moves, and at least one component can fitShare the opereating specification of the hand/finger at family (such as, but not limited to：Be dimensioned for the palm of user) and device on one or moreA in check actuator/power-driven mechanism, and at least one (or 2) component that is operably connected/is connected to, its energyAt least one " actively/move " component of enough rotation/movement/displacements, form/shape is from the control controlled for form/shapeDevice be converted to other subsequent controls (its can either coordinate with appropriate user interface or by appropriate user interface intoRow is coordinated, or can handle request, so that the device of current shape is consistent with currently (expected) user interface, for fittingWhen interactive requirements/preference, different application/software for needing interaction/input from the user can be different)；
At least one " hand/finger control surface " (control device thereon with hand/finger manipulation) is positioned at described " mainOn at least one in dynamic/activity " component, which is operably connected with driving mechanism, can move/revolveTurn/shift (relative to other members).
In at least one in geometry/shape of the control device based on hand, it is allowed to which user uses hand/handRefer to operate the control on " surface for being used for hand/finger control ", such as, but not limited to：The control for performing machine is connected to dressPut, perform input/interaction, such as, but not limited to touch input, push button/button, manipulate control stick etc..；
In at least one other geometry/shape of the control device based on hand, it is allowed to user perform withThe operation based on hand of previous different mode, such as, but not limited to (without any button or is touched defeated using gesture inputEnter), or at least using one group, (this means the manually operated control of this form can be with not exactly the same before controlIt is a subset or superset of previous control, or it can include different control/input mediums)；
Therefore, by switching/changing into different geometry/shapes, the device allow user in a different manner/shapeFormula performs the control with computer implemented system (it is expected/require user mutual)/and interact, arrive another without changing and controlDevice processed, and may also can simulate the physical experiences of different type control.
In relevant embodiment, which is also：
1) at least two components with the surface for being used for hand/finger control, and at least one in the component are includedIt is a can by the actuator/driving mechanism (relative to other components) movement/rotation/displacement,
Or 2) be made of at least three (removable) component, at least three (removable) component can be mutually shifted/revolveTurn, and exist on by the moveable part of the actuator/driving mechanism driving and be used at least one of hand/finger controlSurface.
In further related embodiment, it is expected dynamically or " on demand " be performed according to currently interactive requirementThis change of form/shape is (such as, but not limited to：It is different when changing from a controller to another controllerDifferent controller of unit simulation etc.).
In a relevant embodiment, which includes at least three (removable) component, these components can be moved mutuallyDynamic/rotation, component can be moved with different time sequencings, and always not mobile at the same time.
In further relevant embodiment, with the movement or conversion for being used for component, (component exists for the movement of componentThe mobile sequence at least two opportunity/stage (or step) moved at a series of different time/phase of movements, similar to instituteDescribe in Fig. 3 a) in；
In further relevant embodiment, by using the common actuator (example of power train (such as, but not limited to axis)Such as but it is not limited to servo) drive the different opportunity of at least two in the sequence/step/phase/operation/(tooth) gearTransmission system), can be with different time/phase (such as, but not limited to：Rotation angle, travel distance etc.) actuator is exportedIt is converted into movement (in the different time) example of different component but is not limited to the drivetrain system shown in Fig. 1 d and Fig. 3).
In a related embodiment, it is expected that at least two surface for the control of hand/finger can angularly shape each otherInto and hand/finger reaches at the same time so that user can operate different controls these tables using different finger/thumbsFace is in the same time.
In a related embodiment, it is desirable to which (at least) one of these forms are low profile/non-obstruction/least interference form (examplesBut be not limited to the form as shown in Fig. 1 (c)) to allow user, for other purposes/operation, (such as, but not limited to gesture is defeatedEnter, press other buttons or operate other devices without from removing/discharge the device on hand) hand/finger is used, andAnd at least one form/shape is that " function " form can easily operate control on " hand/finger control surface ".
In relevant embodiment, the mechanism can render (at least) two planes (one is used for thumb/control stick) andOne be used to indexing/other fingers change (such as rotate, such as 90 degree) from folding position and arrive expanded position, two airplane interlocking typesThe controller stable into one.
In a relevant embodiment, at least one folding axis (in addition to thumb) of movable member and userThe average folding axis (vector) of finger it is at least one substantially parallel.
In a relevant embodiment, there can be a controller to have on the surface of the another hand of user availableFingers/hand moves the controller of operation, which can be used together with the hand control device of the geometry-variable to be formedComplete controller；
In further relevant embodiment, stablize when the control device based on hand of geometry-variable is in (some)During form, it is desirable to which 2 controllers can be attached/be coupled, and the stable form is such as, but not limited to when it is expandedTo " holding entirely " pattern, so that controller that for example both hands can be connected/coupled by user is used as " single-piece ", possible (but not limited to)As standard game pads.
In another relevant embodiment, in the hand in addition to using the hand control device of geometry-variable" auxiliary " controller, " the secondary side " that the exercisable control of finger and " layout " on controller surface are similar to game mat are (usualIt is " left side ") to be likely to be dependent on user be that (in this case, it is the right side of game paddle, and variable for the right hand or left handGeometry hand control device forms a complete controller in the left-hand side of user)；
In one embodiment, in addition to normal control-rod/manipulation rod unit, it is also desirable to which there is at least one drivingThe control-rod or control stick of mechanism (actuator for being such as, but not limited to connected to shape/form control system), and at least (exampleAs but be not limited to the touch sensitive region of such as touch pad/screen curtain, button, knob etc.) one or more it is hinged/touch" actively/removable " component, it can be driven with movement/rotation (example with the exercisable control of hand/finger by the driving mechanismAs but be not limited to " rotating up " or " pop-up ") to the position/position that can easily reach of fingers/hand of user, desirably rootAccording to needing or dynamically model- following control shape/form control system so that user can be in control/control stick on control stickAnd/or control during " original " control described in operation at the same time on " actively/activity " component.
In relevant embodiment, the control on " actively/removable " component include being operatively coupled to touch and finger/The touch pad or touch-screen of hand-written discrimination system so that user can perform text input fingers/hand using touch pad/screen curtainIdentifying system is write, while operates control/control stick and other controls.
In one embodiment, it is desired to have at least one driving mechanism and (is such as, but not limited to connected to shape/form controlThe actuator of system processed) game console (such as game paddle or Wii microcontrollers) or remote controllers to normal controlBar/lever assembly processed, and it is at least one it is hinged/touch it is (such as but unlimited with the operable control of hand/finger on itIn touch sensitive region, such as touch pad/screen curtain, button, knob etc.) " actively/removable " described driving mechanism move/Position/position that the fingers/hand of rotation (such as, but not limited to " rotate up " or " pop-up ") to user can be reached easily, is managedThink that ground is as needed or dynamically follow control/control system of shape so that user can be in direct game controller/remote controlDevice and in " original " control on the game console/remote controler at the same time described in operation on " actively/removable " componentControl.
In relevant embodiment, the control on " actively/removable " component include being operatively coupled to touch and finger/The touch pad or touch-screen of hand-written discrimination system so that user can perform text input fingers/hand using touch pad/screen curtainIdentifying system is write, while operates game console/remote controler and other controllers.
Geometry-variable hand control related embodiment in, it is desirable to the device be it is wearable (or：It can accommodateThe hand and/or arm of user simultaneously move together), the such as, but not limited to shape of the gloves of gloves/half or with band (such as Fig. 1In component 112 on), (be considered as the body of wearable device so as to be fixed to hand/palm/wrist/arm of userLimbs/part of body and control can be performed), or with for attachment to/be connected with gloves/wearable device, be used in combinationHand or arm move together.
In the geometry-variable for the user experience (including tactile) that can simulate multiple controller/hand-held device/instrumentsThe control based on hand one embodiment in, which can change between multiple (stablize) geometries of simulation sizeBecome/(at least in some forms), relative to the control position (position for being similar to the original tool/device being just modeled) of hand(such as (but not limited to))：Driving is extremely for an at least mobile driving mechanism (the such as, but not limited to rotation or movement of servo control mechanism)A few component is with movement/rotation/displacement so that and the geometry of device changes to minimum form from low profile " storage ", withThe form for simulating the small processor (thin handle) of such as dagger etc (has slightly larger profile, this can be with such as, but not limited toIn the following manner is completed)：In Fig. 1, control such as 15 or 20 degree of one small degree of the rotation of servomechanism 105 complete in this caseExpand 60 degree entirely), fishing rod, golf clubs；Or the geometry of device can be controlled to become medium " earth-grasping force "Form (or even the profile of bigger, this can be carried out in a similar way, such as, but not limited to：In Fig. 1, by servo control mechanism105 controls is rotate the degree of one " medium " or " medium ", such as 30 degree or 40 degree, compared with 60 degree be fully deployed), completelyHold with a firm grip and (be fully deployed, such as the earth-grasping force of game paddle)., can also be by the member drives in a relevant embodimentTo one or more " surmounting " forms (being more than " complete " grasp), it can be such as, but not limited to：Somewhat change the " transmission in figureSystem " allows the responsible gear for driving another component 115 or gear (such as 125) gear to pass through the selection of (additional) deviceProperty separate (and again engage), what such as, but not limited to similar clutch was controlled by shape/shape control system or userDevice/mechanism so that component 115 can optionally rotate (not remains stationary) in 125 degree of separation and 115 according to " form " requirementIn the case of non-rotary, control system controls servo control mechanism 105 than 60 degree of rotation bigger journeys of complete dilation in the caseSpend (such as 90 or 120-150 degree) so that component (in this case 113) (or can keep together with palm with palmComponent 112) formed 120-170 degree angle, this by formed support user's palm shape/form (when user's palmar aspect courtUnder) mouse, while allow user clicked in a manner of similar to a mouse click button on member 113 such as 116 control；Alternatively, it is generally desirable to, component 115 can also rotate to the angle of " grasping completely " bigger than 90 degree, such as, but not limited toAbout 120-150 degree so that user can also operate some controls member 115 using thumb, it strengthens " mouse " formFunction；
In further related embodiment, at least one optical position tracker or motion detector or similar are further includedMovement/position tracking device, the such as, but not limited to optical design detection device of camera or similar camera, such as light/ laser mouse so that the movement of user's hand on the surface can be not required external sensor in the case of be traced/Detection；Movement/the position tracking device is ideally in " palm " side of hand, but be not limited on component 112 or 113Or close to their (in the form of stretching out and get at)；
B) (it is related to) low profile and adjusts control stick (device and correlation technique).
The method of another physical User experience for carrying out analog joystick for variable-geometry controller includes：Using touch-sensitiveThe elastic membrane of region (such as, but not limited to touch (touch-screen)) with (master) touch area at the top of is used together so that when controlling notWhen placed in the middle, user can feel the power of the finger from them, and the direction of power and adaptability (passing through tactile) instruction fromCenter " drift " or " distance ".
In a related embodiment of analog joystick device, which includes：Touch area (pad,Screen) input, thin elastic membrane (such as, but not limited to by attachment/coupling) at the top of touch area and optional can be addedGround elastic membrane has projection/button/knob at or near the center of control/touch area, or such as user orientedTactile markings/pattern or some form of tactile patterns on surface, so that user, which can work as finger, touches different regionsWhen (this contributes to him/her using tactile to position or find the center of control without seeing it)；Therefore, when user presses compression elasticityFilm (by finger or by pressing centre button/knob (if applicable)), the sub-fraction of corresponding film contacts againTouch sensitive region, and touch sensitive region (such as, but not limited to touch pad, touch-screen) detectable " touch point " y is satMark, can be converted into control stick x, y by by the x of touch point, y-coordinate and control stick center (center of control stick)Be projected in touch pad coordinate and be compared to input-this can be such as, but not limited to：By subtract " touch point " x, y with" control stick central projection point " x, y-coordinate carries out coordinate, and may perform additional operations scaling/direction/correction for direction etc. so thatControl stick can be simulated in a manner of the low profile more slightly higher than touch pad.
In a relevant embodiment, also it is desirable to which Teflon or other coatings for reducing coating with resistance can be appliedIn the opposite side of the film towards touch area surface so that be easy to move (towing) (such as touch pad/screen around touch areaCurtain) with the finger down elastic membrane of user or press centre button/knob.
Therefore, when this input of user's operation, resistance will reflect that it is excentric apart from how far, when user discharges itWhen, it can be with automatic centering.
In one embodiment of relevant apparatus (as shown in Figure 2), elastic membrane (such as, but not limited to rubber) can placeIn the frame, this film can have docking/coupling mechanism (mechanical coupling of such as, but not limited to such as screw, lip etc.Or the other methods of the tacky surfaces (heat-sensitive glue etc.) on the magnetic coupling mechanism of magnet or the frame of film) (In touch sensitive region/around corresponding homologue), it is by touch sensitive region (such as pad/touch (in controller)Screen) top on the film of (and cover at least a portion) fix/configuration file) joystick, while can also remove when necessary,So that user can directly operate touch sensitive zone；
In a relevant embodiment, can by button/projection/button (its shape and size can be similar to touchThe shape and size of the title division of the cribbage-board control stick of ginger/thumb of user) it is placed on the elastic membrane and makes its perceptual imageFinger joystick and it can operate in a similar way.
In a relevant embodiment, there can be replaceable film (or together with frame) that there is different film bulletsProperty so that the control can be customized/be adjusted to comfortable/desired level by user；In relevant embodiment, the sense of touch area of padDomain (or size) can also be adjusted by (software) (such as, but not limited to when from touch pad x, tune when y-coordinate is converted to joystick x, yWhole " ratio " inputs as described above), to adapt to the different demands of user, it is however generally that, larger region allows more accurate moveIt is dynamic/to aim at, and less region allows more flexible/quick movement/rotation to input.
In relevant embodiment, there can be different methods to fix the film, and it is sensitive to be fixed to touchRegion, is such as, but not limited to placed in the plane (as shown in Figure 1a), and it wants to the film example in different " styles "As having different tactile patterns on it) or " folding " similar structures are used, as shown in Fig. 2 (b),
It is worth noting that, although the film shown in some drawings and touch area have similar shapes and sizes,But they need not be the shape of identical (or closely similar) in the implementation, such as, but not limited to：Shape film can be it is circular,And the shape of touch sensitive region (such as tablet or touch-screen) can be square/rectangular (may have circular edge), andAnd usually touch sensitive region size is roughly the same or the film that is more than.Film may only cover one of touch sensitive regionDivide (especially in the case of a touch screen, wherein the part of only " screen " is used for " input analog joystick " by " distribution "Purpose).Can have different types of coupling (in addition to shown in Fig. 2, such as can use circle to arrive square to fix filmFixed to rectangular touch sensitive area, (use is such as, but not limited to mechanical, attachment/bonding by circular film for shape " adaptation " frameThe coupling device of agent (heat sensitive adhesive), magnetic (using magnet) etc..
As described above, this low-key control rod controller can be used in combination or be used in variable-geometry as control deviceIn the hand control device of shape.
In the related embodiment of control (such as, but not limited to Fig. 1 shown in those) of the geometry-variable based on handIn, the control (110 in such as, but not limited to Fig. 1) that is used at least one surface for the control of hand/finger is as above instituteThe low-key control rod controller stated.
Brief description of the drawings
The preceding feature of the present invention will be better understood, in the accompanying drawings with reference to described in detail below in refer to the attached drawing：
Fig. 1 shows a kind of variable-geometry controller that can be combined with hand-held wearable device (not shown).(b) in116 " surfaces for being used for hand/finger control " 113 that can be operated by the finger (such as, but not limited to forefinger) of the hand of user, andAnd it has multiple (showing 2) articulated elements 112 and 115, they can (relative to) respectively along axis 101 and 103 rotate.112 can be attached to wearable device/shoulder strap and be placed in the palm of user, and can be the hands along user(102) the curved form of substantially/mean direction of " handkerchief folding line " or " folded-seam ", it is allowed to which the top of the hand of user is withPortion folds/rotates against.
115 be that second of the control of button 111 with such as touch pad/control stick 110 and thereon etc " is used forThe surface of hand/finger control ", and can be in operation/function position/configuration as shown in (b) and low profile/non-profile (a)Or the blocking position in (c).(a) can be as in (c) in low profile/non-blocking or between the operation format/configuration of (b)Rotated between position/shape/form.These changes can by actuator/driving mechanism such as 105 (servo) shown in figure andRelevant power train (such as, but not limited to axis and transmission system, such as part (tooth) gear) drives.
Fig. 1 (c) shows to form low profile, and " folding/folding " form/shape of the control of non-blocking shape, it allows to useFamily performs other operation/inputs using hand/finger, such as uses gesture or the touch pad by lower button/other devices.
Fig. 1 (d) shows that driving mechanism (such as servo control mechanism) 105 is driven by the bearing 122 being fixed on component 112(transmission) axis 121, axis is rotated around axis 101 and drive part (tooth) causes the gear (right/train) 123 of component 113, the component113 be fixed to 105 with relative to 112 rotation (its usually not relative to user palm relative motion).Similarly, (At 113 rotating different time/phase, 113 with enough angles (such as, but not limited to more than 75 degree, to allow anotherComponent 115 from 112 rotates up) " opening ") when, part (tooth) bevel gear drives 125 bearings 127 by being fixed on 113Moving axis 126, and it is rotated along axis 103 and the supporting structure by being fixed on component 115 (such as, but not limited to 128)Make its rotate and under), and switch between folded form and extension form, the thumb of user can be operated cosily, such as Fig. 1(b) shown in.It is worth noting that, (there are some parts part (tooth) gear tooth and some parts to be smooth and not " driveIt is dynamic " pinion, such as, but not limited to those shown in Fig. 3 (b)) it allows 112 and 115 in the 105 different time/phases turnedPosition rotates, and will not usually be activated (when possibility is overlapping) at the same time.
Fig. 2, which is shown, to form the manipulation of low profile type by adding elastic membrane at the top of touch area 201The control of bar, and film can be fixed in Petting Area using the frame (and correlative coupling device in 205 and 202) of filmOn domain and it is expected removable/commutative.
Fig. 2 (a) shows difference " style " (such as those different touching of having shown in 203 ' of elastic membrane 203 and 203 'Feel those of pattern), or some films have centre button/knob 204 as top/head of control stick) can putPut in frame 205 or 205 ' in.Fig. 2 (b) shows rotation/folding mode of fixed film.
Fig. 3 shows controller (such as remote controler for smart television/intelligent electric appliance) 301, it, which has, is used for fingerWrite input touch-surface/region, such as available for the top left region of forefinger and thumb (being shown as 303) can by index orMiddle finger or thumb reach character/symbol of handwriting input.
Can also have can define (optional) side button 302 (such as function key, such as, but not limited to Ctrl,Shift, alt, Fn) and used by other fingers.
Fig. 4 shows that mouse (either 2D or 3D location/motions device) 401 can have and is used for finger writing inputTouch-surface/region, such as on left button (being shown as 403A), or be shown as in center section 403B " on " (or inBetween button/roller 402 upside), handwriting input for character/symbol can be reached by index or middle finger.
There can also be the 405 (work(such as such as, but not limited to Ctrl, shift, alt, Fn of (optional) side button that can be definedEnergy key).
Fig. 5 shows that wearable controller (such as game console as gloves) can have (foldable/mouldBlock) control and in 2 planes for " finger writing input " touch area (one be used for forefinger write input,One be used for thumb joystick picture input) (1) be for finger writing input forefinger touch area, (2) are to be used for thumbThe touch area or control stick/button (one or more) direction of control, just as a common game paddle/controller.(1)(2) can be foldable/folding when not in use so that they will not hinder/hinder hand/finger to perform other workDynamic/gesture.
Fig. 6 shows typical game console 601, it can have one or more can be by the control stick of thumb manipulation602, and can have the touch pad area 605 for orientation input.It, which can also have, is used for such as in top left region (such as 603BIt is shown) finger writing input touch-surface/region, or can eject as shown in 603A, folding or " additional " (moduleChange) type, the handwriting input of character/symbol can be reached by index or middle finger.
There can also be the button of (optional) side, can define (such as function key, but Ctrl, Shift, Alt are not limited to,Fn)。
Fig. 7 shows the singlehanded type game console 701 including position tracking/motion sensing, it, which can also have, is used forTouch-surface/region (such as touch pad touch pads) 702 of finger/thumb writing input, or similar to Fig. 6, it can be withIt can also eject, foldable or " additional " (modularization) type touch pad, and optional side button (such as function key,Such as, but not limited to Ctrl, Shift, Alt, Fn).
Fig. 8 shows the difference that can cause part (tooth) gear in two control surfaces (Fig. 8 (b) and Fig. 1 (d))Periodically/phase (such as Fig. 8 axis servomotor rotate during, in the different time, variable-geometry controller (two in l is schemedOn a different component 113 and 115) rotation (and stopping)：(a) top shows that vertical dimensions Rot1 is the component of Fig. 1 (d)The rotation of the first surface of control on 113.When it reaches close to 90 degree from initial position (it is sufficiently wide with the expansion of permission 115)When, it rotates (113) first.In the lower part of (a), longitudinal size Rot2 represents the control on the component 115 of Fig. 1 (d)The rotation in the 2nd face.115 start to rotate up 90 degree, and 115 start after 113 stop rotating.Due to servo steering angle and transmissionThan that can change, the timing of servo and steering angle are exemplary.It is " main on axis servomotor in the gear shown in Fig. 3 (b)Dynamic/active " gear (or bevel gear) is 1.5 times of the diameter of " passive " gear, and each is that have about 60 degree of (otherRegion is smooth or is not present) it is expressed as Ang1 and Ang3, the phase difference between two gears allows them differentMoment drives different components (payload), such as 113 and 115, and gear ratio allows it to change servo steering angle (at thisIn each phase at 60 degree or sos) to the required steering angle for loading (113 and 115) respective about 90 degree (being shown as Ang2).
In a relevant embodiment, power train can have the engaged/disengaged mechanism similar to clutch to oneOr some (tooth) gear, so as to the timing or movement of (dynamically) adjustment member.
(in certain embodiments) is also possible to, " actively/movement " component (such as 113,115) can be allowed to differenceThe rotation of phase/time, and may more than 90 degree, (some forms may need somewhat change biography from original (" foldings ") positionDynamic system, such as, but not limited to：To the engaged/disengaged mechanism on demand of the similar clutch of one or more part (tooth) gear additions),This may (but not limited to) be used to form the shape that simulation " mouse " operates, it is (such as but unlimited wherein 113 can rotate toIn) about 150 degree, so that the index for feeling similar to mouse of the global shape (and supporting item) of device and other fingers, and115 optionally can be folded or be rotated to it is (such as but unlimited from " extension " position of folding position about 120-150 degreeIn) so that thumb can easily get at control in " mouse-like " configuration/form of device.
Embodiment
In the device (controller) of user for being interacted with computer system (such as, but not limited to game console)In embodiment, the computer system includes：
Such as control stick and buttons/keys and/or touch area etc in layout on the surface of controller it is multiple" axis " controller allows generally for multiple controllers to be manipulated/operated at the same time by different fingers, these finger pricks are to specific (specific) holding posture/gesture (for example, two hands on control stick, with the thumb on control stick/keyboard), the consideration of this handle" standard/normal " (by design) gesture (hand/finger gesture) of the controller.
It is on the surface of the hand-held/Wearable device or hinged with the hand-held/Wearable deviceTouch sensitive region (such as, but not limited to touch pad, touch-screen), can be easily when hand/other fingers of user are into fashionablePass through forefinger or middle finger corresponding " regular/normal " (game console) operating gesture/(posture of hand/finger)-such as thumb" on the controller " (such as control stick)-and allow finger (forefinger or middle finger) do finger write on one be used in touch sensitive regionsOn handwriting input " normal " hand/finger writing position；
One example (but not limited to) of the finger writing position of " normal " can be：When user hold it is normal/Standard operation posture for it is normal when, the position of touch area be when user keep normal operating posture carry out normally input/Manipulate and not when with input character, forefinger and middle finger possible position in the range of being easily accessible by (or：Touch-surfaceSolstics) in (under normal grip position) centered on the root joint of forefinger (or forefinger is connected to the position of palm), radius isIn the sphere of the length of forefinger." plane " in touch pad/region can also be for example flat with thumb controllers (such as control stick)Face angularly arranges, or in modularized design, can add a convenient position/need not when neededWhen, or in foldable/moveable design, it can " stretch out/eject "/it is unfolded/is discharged into a convenient position, permitsPerhaps comfortable finger writing input；
(such as, but not limited to PC, tablet computer, intelligence are electric on the controller or in (host) computer system of connectionDepending on) " finger writing " identification module (it can be such as but not limited to identical with existing hand-written module) or game machine)；
Therefore, described " finger writing " identification module handles the touch from the touch sensitive regions/finger writing event/numberAccording to (and be desirably also contemplated for by user with other caused event/information, such as (but not limited to) those are defined as" function key ") and (or " translating into ") character/symbol/order is generated as user's input (arriving down-stream system).
(in a related embodiment) when user carry out finger writing when, other fingers can be pressed/kept/Key/button/touch sensitive regions of touch are arranged on the input unit/controller on (surface), are desirably arranged in and are used for finger bookWrite in the plane of plane (usual) angled (such as, but not limited to 90 degree) in touch pad/region of input, so as to otherFinger (one or more) (including for keep hand-held device those) can perform extra input (such as, but not limited to：At the same time), " function key " that (advance) defines, such as shift, Ctrl or Fn keys etc. are such as, but not limited to pinned, or in fingerMake choice (and determining output character/symbol or direction/order) after writing input to candidate item (character, symbol) immediately,If for example, user perform pressed while finger writing input on (holding) described controller other buttons (such as thatA little function keys that can be defined as such as " shift " or " Fn " key), then the result exported will be keyed in user on keyboard,And the result for pressing corresponding function key (such as shift or Fn keys) on (holding) keyboard is consistent.In a relevant embodimentIn, this method, which still further comprises, merges freely to be used for exercisable buttons/keys of other fingers beyond handwriting input/tactileThe information in quick region so that key combination (together with hand-written) progress can be used complicated by user and easily input, these buttons/Button can provide the effect of non-" visible " character/function keys such as such as CAPs, Shift, Control, Fn, symbol, space, returnCan, or allow user quickly to be selected from candidate item/be automatically performed is middle.In relevant embodiment, it may be desirable to will useFamily while finger writing input is performed (from the same hand or another hand) other key/buttons press event orGesture (such as, but not limited to other fingers press event or gesture) is combined to determine output character/symbol or direction/lifeOrder；For example, if user presses (holding) Fn keys when finger writing input is performed or (Shift) key that performs is (by sameOne finger or another hand on hand, (for example, in the case where both hands have controller) if the situation is applicable in).
In a relevant embodiment, it is expected additional key/button (such as, but not limited to such as Shift, Ctrl,The function key of Fn etc.) on same hand-hold device/wearable device, and another finger for being arranged in user can operate thisPlace/button of a little buttons, while user performs finger writing input (for example, being arranged in other fingers or thumb can easily arriveThe side of the same controller reached, while grip controller and user can be operated with a hand；
In another related embodiment, it is expected (such as, but not limited to such as Shift, the function key of Ctrl, Fn etc.) sameOn hand-hold device/wearable device and it is disposed in other fingers of user and can operates the place of these key/buttonsFinger writing input (for example, being arranged in the controller side that the finger of another hand or thumb can be accessible to, while holds controlDevice processed allows user with the hands to operate；
Above-mentioned identification process needs to consider what is detected (if any) by other fingers while input or by fingerGesture controller/input system come formed final output result (if for example, user pin controller side key (such asIt is defined as Ctrl or Fn keys), output result pins these keys and type on keyboard just as user).
In another embodiment of the user apparatus for being interacted with computer system, including：
The wearable controller of the gloves of such as game console etc, which can have, to be used in two at an angle to each otherThe control of the finger writing input of plane (one is used for forefinger write-in input, and one is used for thumb joystick and inputs) and Petting AreaDomain (is such as, but not limited to not limited to vertical), as shown in figure 5, (1) is the touch area for the forefinger of finger writing input,(2) it is touch area or control stick/button (s) for thumb control direction, just as in a normal game paddle/controlOn device.(1) and (2) can be foldable/folding when not in use so that they will not hinder/hinder hand/finger to performOther activity/gestures.
In one embodiment, for tracking the wearable device of user's posture (for example, gloves (half gloves), are similar toWearing has the wearable device of sensor (or beacon/producer or pursuer)) also have can be inserted into/modularization or collapsible/The module (such as touch pad/screen curtain) (alternatively on-demand) that the forefinger of the touch input user of folding can touch；
Alternatively, there are gloves other to touch/press input area or button so that other fingers can provide defeated at the same timeEnter.
Support touch/structure at key-press input interface can collapse/compress, so as to need not when without interference with other gesturesIdentification (as captured)；
(host) computer system (such as, but not limited to PC, tablet on the wearable controller of glove-like or in connectionComputer, smart television or game console etc.) on " finger writing " identification module)；
In order to make " finger writing " identification module processing touch from the touch sensitive regions/finger writing event/Data (and desirably further contemplating other finger movement/gestures, such as finger for " function key "), and generate (or " conversionFor ") character/symbol/order as user input (arriving down-stream system).
In a relevant embodiment, it is desirable to which finger writing can be above and below the gesture of other fingers/hands palm or handExplained in text.
In a related embodiment, the candidate item of identification can be selected using the gesture of other fingers.
In another embodiment of the user apparatus for being interacted with computer system, including：
For tracking the wearable device of user gesture, such as with the hand exercise and/or gesture for tracking userSensor (or beacon/producer or tracker), while touch input module (such as touch pad/screen curtain) is located at thumb side(side identical with the back of the hand), class gloves (or the half gloves) shape that can be easily got at the forefinger (or middle finger) of the same handWearable device；
" finger writing " identification on (such as, but not limited to PC, tablet computer, smart television or game machine etc.)Module, or be worn on the wearable controller of glove-type or (host)；
In order to make the identification module processing touch from touch area/finger writing incoming event/data (and desirablyFurther contemplate other finger movement/gestures of such as " function key ") and generate character/symbol (one or more) as user it is defeatedEnter and (arrive down-stream system)；
For providing input (such as, but not limited to computer system/host computer systems, such as but limit from the multiple fingers of permissionIn game console/host computer system) hand-held or wearable interactive device/controller into the device of line character/symbol inputIn embodiment, TV/setting box/audio system/device of device/controller connection or control) (it is easily possibly even singleHand) it is not required the vision of (user) or the device of the help of voice to include：
Compact/limited size (is such as, but not limited to：Postage-stamp-sized, it is sufficiently large with next " picture " using finger writing methodA character is rewritten, and desirably less big (such as allowing more than 2 characters) makes it difficult to arrange/be used for ergonomicsPort on the controller of position) touch sensitive device/region on the surface or on the surface is (such as, but not limited toTouch pad, touch-screen etc.) hand-held/wearable device, in the hand/finger writing position of " normal ", it can pass through user'sFinger tip (or top of thumb) easily reaches (ergonomics) position；(size of touch sensitive region is not less than than 6mm x6mm is big, perhaps need not be more than the size for accommodating normal finger writing character/symbol；
One ideal/expectation situation is that the touch area can have border/(tactile) prompting to indicate to be used for fingerEffective touch sensitive region of input is write, such as, but not limited to：Convex/concave or convex/concave region on surface, sideEdge, protrusion etc. can also be the surfaces (material) for having different texture/tactile with peripheral region so that user can individually use handRefer to distinguishable region without vision (confirmation or help/positioning).
For by from " touch information/data " (" finger writing ") of sensor collection (such as, but not limited to touch location/Coordinate, event, pattern, power/size (if pad can provide) etc.) finger is sent in hand-held/movement/wearable device/controlOn device or connection (host) if in computer system write identification module-identification module on the controller, the mouldBlock can be simple as wired connection, and long-range connection (such as wired or nothing is needed if identification module is considered soLine connects and related protocol), and may need to add extra packet to transmit touch event/data (such as by repairingChange/be added to existing communication protocol).
(it is for example but unlimited for " finger writing " identification module of " touch information/data " (" hand-written ") described in handlingIn essentially identical with handwriting recognition module)
Therefore, touch/finger writing of the resume module from the touch area for " finger writing " identificationEvent/data (and desirably further contemplate by user with other caused event/information, such as (but not limited to) those quiltsIt is defined as the character of " function key ") and (or " translating into ") character/symbol/order is generated as user's input (to downstream systemSystem).
Can be by other hands when that can arrange that user performs finger writing input on input unit/controller (surface)Refer to key (one or more)/button (one or more)/one or more touch sensitive regions of pressing/holding/touch, desirably clothPut the plane (usual) angled (such as, but not limited to 90 degree) in touch pad/region with being inputted for finger writingIn plane so that other fingers (including for keeping finger hand-held device) can perform extra input, such as, but not limited toPin " function key " that (institute) defines, such as shift, Ctrl or Fn keys, or be immediately performed after finger writing input pairThe selection (and determining output character/symbol or direction/order) of candidate item (character, symbol), if for example, user is performingFinger writing presses the displacement of (holding) Fn keys when inputting, then the result exported will be keyed in user on keyboard, and pins and (protectHold) result of corresponding function key (such as shift or Fn keys) is consistent on keyboard.
And it is expected recognition result can with other inputs from the user (if any), such as user holds/byUnder the posture (while user perform finger writing) made of key/button or user be combined to form the word of outputSymbol/symbol or order；If for example, user perform finger writing input when press on (holdings) described controller additionallyKey (such as those can be defined as the function key of such as " shift " or " Fn " key etc), then the result exported will exist with userKeyed on keyboard, and the result for pinning corresponding function key (such as shift or Fn keys) on (holding) keyboard is consistent.
In relevant embodiment, data/event/information from the touch pad/region may be with " real-time or closeMode in real time " is transferred to the finger writing identification module, such as, but not limited to on current touch point and timestampPosition/coordinate event/information " bag ", either " section " of current (continuous) curve or when touch system determines whole wordAccord with that the corresponding pattern being transfused to.
In relevant embodiment, it may be desirable to (from the same hand or the another hand) for performing user at the same time itsHis key/button presses event or gesture (such as, but not limited to other fingers press event or gesture) combination to determine outputCharacter/symbol or direction/order；For example, if user presses the shifting of (holding) Fn keys when performing finger writing and inputtingPosition (by same finger or another aspect on hand, if applicable (for example, if both hands have controller)),Output will be identical with the user type on keyboard, then pin (Shift) key or Fn keys.
In above all of related embodiment, device can have/expose with keyboard interface or defeated including key entry/characterGeneral the HID interface or COM/ entered flows similar or simulation interface (output character/symbol) interface；
In another embodiment for the device of convenient (or even one hand can be used) character input, from hand-held or canInstruction device/controller (such as, but not limited to mouse or 3D mouses) of wearing, 3D location of controls/movement input (are connected toComputer system), without disturbing existing function/operation/navigation, including：
Compact dimensions/limited size (is such as, but not limited to：Stamp/seal size or be enough to accommodate using finger bookThe size of write method " write/draw " character/symbol, and had better not it is too big-than exceeding allow 2 such words of draftingThe area size of symbol/symbol) sensitive means/device (such as, but not limited to touch pad, touch-screen and etc.) is touched, it is located atOn the surface of the hand-held/wearable device or the hand-held/wearable device is attached to, is had at one " normal/to relaxIt is suitable " hand/finger writing direction (ergonomics) surface position at, and can be easily by user at oneThe hand/being touched in finger writing posture by the finger tip of user/of " normal/comfortable " is got at；(size of touch sensitive regions is not less than6mm × 6mm, it may not be necessary to more than the size of normal finger writing character/symbol)；
The position of this " conveniently the getting at " of touch area/device on (surface) or with the input unit (such asBut mouse is not limited to, 3D mouses, 3D controllers) it can be got at and be performed in holding normal operating by forefinger or middle finger" finger writing " gesture device at the same time；For example, touch area can be located at mouse " left side " or " in " on button, can also be located at" middle key " position or the region of more top, so as to left-handed person, can also to operate this touch pad/region easy；
On the controller " finger writing " identification module (its can be such as but not limited to it is available hand-writtenIdentification module is same or similar), or " long-range "/data/finger in (host) computer system of connection writes from controllerEnter the event to mainframe computer system), such identification it is expected it is contemplated that other fingers input-example at the same time (if any)Such as from the pressing of the key/button of the additional key on controller but be not limited on mouse/3D mouses or 3D controllers can at the same time byOther key/function key of another finger manipulation of user) or by posture that controller/input system detects to be formed most(if be used for for example, user pins Ctrl or Fn keys, output result pins these keys and in keyboard to output result just as user eventuallyUpper key entry)；
Therefore, described " finger writing " identification module handles the touch from the touch area/finger writing event/numberAccording to (and be desirably additionally contemplates that by user with other caused event/information, such as (but not limited to) it is defined as " functionKey ") and (or " translating into ") character/symbol/order is generated as user's input (arriving down-stream system).
Since suitable system/method/device can embody in a variety of forms here, some of them may be withSome in the disclosed embodiments are entirely different.Therefore, concrete structure and function detail disclosed herein are only representativeness's；But in this respect, they are considered as to provide optimal embodiment for disclosed purpose, and to define model of the present inventionThe claim enclosed provides the foundation.
Some typical situations are discussed：
1. game console：Information is sent during broadcasting, or easily input URL/ texts carry out browse/search
User game console is taken standard/normal crawl/operation posture/gesture, and playing game (such asNavigated using thumb) while, user can easily touch the touch sensitive region of handwriting input using forefinger, such as originallyThe text invention, and input short message or search text box for teammate；When browsing catalogue/internet, user can also be easy toGround directly inputs text to URL or search window without QWERT keyboards using this finger writing plate.
2. smart television：User is using the remote controler crawl posture of standard, and while TV is watched, user can facilitateGround is using index or thumb in the remote controler inputing characters equipped with " finger writing " Petting Area/keyboard.Touch/finger writingSystem identification can be identified, and downstream system/interface provides text or order.Alternatively, touch system can also identify withThe similar slip of the touch-screen of smart mobile phone, scaling or other navigation commands.
3. mouse：
Clicked on right mouse button crawl mouse, while user can use " finger writing " of middle finger or forefinger on mouse to touchTemplate inputing characters or order, and text can be inserted into immediately, search box or addition quick gloss, (hand) need not leave mouseMark.
In one embodiment, controller/input unit based on hand of geometry-variable can by that can form at least twoMoveable part formed shape/model/form/position of movable part, a kind of form/shape be " being fully deployed " pattern/Form, can accommodate the hand of user, and allow user easily/ergonomically manipulate control (or：Not expensePower), while.For example, when the direction of each control is optimized for finger, the surface of control rod/control-rodMay be with some button/triggers not at grade, such as " plane " thumb on control surface and palm are at an angle(such as, but not limited to vertical), when forefinger operates at the same time, the plane and first of the chain of command (such as button/trigger) of forefinger operationA (such as, but not limited to 90 degree or so), such as the situation in Xbox or PS.In fact, for the body for allowing user to keep identicalTest, we can by between game paddle controller with same or similar direction/position/space to thumb and other handsFingering row accordingly control comes to these controllers carry out " simulation " these controls such as control stick, button and they with playSimilar relative tertiary location/the layout of handle controller), this is by adjusting the control table for thumb and other fingers respectivelyAngle between 2 planes in face simultaneously adjusts control and is laid out these planes so that in the functional form/shape of " extension ", itWith the sensation similar to handle (being modeled)/control experience；
May also have the form of one " low-key ", wherein 2 face/surfaces fold/be folded into relatively small (totality) volume/Size/profile (or the more shape of " flat "), for example, in this mode/forming apparatus profile elevations h (all the points it is maximum away fromFrom device to palm plane) it is no more than the 60% of " extension " functional form.In this way, user can be (more easily) using theirsHand/finger carries out other gestures (such as analogue-key or slip) or purpose (such as press buttons/keys) on another device.
Shape/form change/conversion drives (such as, but not limited to servo (one or more)) by driving mechanism, and wishesSuch change is hoped to be triggered or provide on demand；
In a relevant embodiment, driving mechanism can be driven with for the control (as described above) based on handAt least two components of face/surface so that its from fold (such as, but not limited to rotation/movement/displacement, as picture is rotated by 90 °)/Folding position/form may cause 2 face/surface interlockings to form stable controller to expansion/functional location.
In one embodiment, controller/input unit based on hand of geometry-variable is by different axis (sidesTo) on 2 parts moved form, so as to form two surfaces of certain angle (such as, but not limited to 90 degree) to hold respectivelyReceive the thumb of user and forefinger (and other fingers)-user can easily and comfortably reach control on the two surfaces,Without adjusting grip/grip locations/posture/gesture or grasping, so as to allow to coordinate/while from thumb and other finger exercisesThe control of work/manipulation (such as aimed at thumb, while shot with forefinger/pull trigger).
As shown in Figure 1, surface can arch upward, its sensation is more met ergonomics, and allow to be formed when folding compared withSmall " profile ".
In Fig. 1, one (or multiple) limited (distance/rotation) stroke can be used or activate mechanism, such as withThe partly servo control mechanism of the power train of (tooth) gear, to provide " 2 (or more) phase " movement from actuator (such as servoStructure 105) a spinning movement, the stage 1 open for forefinger finger control (such as 113) a surface, ideally withMultiple (adjustable/customizable) angles are opened, and the stage 2 is upright/rotate up " thumb control " surface, and alternatively the stage 3 can be withThey are locked together (power supply is manual).
In one embodiment, a kind of controller/input unit based on hand of ergonomics geometry-variable includes：First component with the surface for the control of hand/finger and can be along the different rotating articulated elements of axis, the structureOne in part can be the ergonomics for meeting palm, and optionally can be attached to palm (palm) on hand simultaneouslyMoved together with hand without relative movement, so that the first component " props up " palm so as to allow (example by the componentSuch as but it is not limited to：Simulate physical form/surface/interface/grasping of different instrument/handles of different size/shapes) device withIt is converted into that (" mode of operation " is with the surface (" for the control of hand/finger with the rotating multi-form/shape of different angleTwo control surface components ") another articulated element can also be rotated relative to the first component, and itself can alsoWith control of which, so as on both surfaces with hand/(such as, but not limited to 90 degree) so that the thumb of user and other handsThese controls (mode that can be similar to user's operation game paddle) can be operated at the same time by referring to." the second control surface structurePart " can rotate to the angle of parallel (or close to parallel, such as parallel within 20 degree), fold and permit so as to " folding "Perhaps first component rotate and ensure low profile when device be in " low-key " pattern/form and bottom line for other purposes/behaviourInterference/stop of the hand of work/finger movement, such as, but not limited to other buttons of gesture input/control or another control of touch.
There can be (or multiple) actuator in the control surface, or drive this shape to become according to controlChange.A kind of design is to use a servo-drive system in the bottom of chain of command, it is connected to a biography with part (tooth) gear(some is all with teeth for gear, and another part is smooth, rather than the such gear driving rotation of driving one for moving axisAgainst the component (mean its contact palm and do not relatively moved with palm) of " support/contact " palm, another part(tooth) bevel gear driving second controls face component, when the first chain of command is in the hand of " expansion " pattern/angle (being more than 60 degree)During palm, the second control face component " upward " (entered function position)；
In a relevant embodiment, it is generally desirable to, there may be breech lock/locking mechanism between (movement) component,Breech lock/the locking mechanism can be driven by actuator or by hand by relative position (such as when second surface is fully deployed)The component of " locking " or more so that when user's operation, control surface has the sensation of more " firm ".
There can be extra state to carry out analog mouse, wherein second surface is not unfolded and the first control surface is furtherRotation is (more than 90 degree, close to 120 or 150 degree), so as to provide it support gesture when palm is used as palm as a mouse.In addition, when using " mouse mode ", in face of " desktop " surface (or：Palm towards direction) device on can have positionPut or motion tracer, such as to provide movement (coordinate or increment) information accurate for optical mouse chip and lens.
Due to suitable system, means here, method (such as, but not limited to sensor, actuator, controller etc.) canTo realize in a variety of forms, some of them may be entirely different with some in the disclosed embodiments.Therefore, hereinDisclosed concrete structure and function detail are only representational.