US20010045941A1 - Force feedback system including multiple force processors - Google Patents

Abstract

A force feedback interface including a haptic accelerator that relieves the computational burden associated with force feedback generation from a force feedback processor. The force feedback processor is preferably a device microprocessor included in the interface device and separate from a controlling host computer for determining forces to be output. The haptic accelerator quickly determines velocity and/or acceleration information describing motion of a user manipulatable object from raw position data received from sensors of the interface device and representing the position of the user object. The velocity and/or acceleration data is used by the force feedback processor in the determination of forces to be output on the user object. The haptic accelerator can in some embodiments also quickly and reliably determine condition forces which depend on the motion of the user object, thus relieving additional computation burden from the force feedback processor and permitting the force feedback processor to focus on determining other types of forces and overseeing the operation of the force feedback interface device.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
• This application is a continuation-in-part of co-pending parent patent application Ser. No. 08/534,791, filed Sep. 27, 1995, on behalf of Rosenberg et al., entitled, “Method and Apparatus for Controlling Human-Computer Interface Systems Providing Force Feedback,” assigned to the assignee of the present application, and which is incorporated by reference herein.[0001]
BACKGROUND OF THE INVENTION
• The present invention relates generally to interface devices for allowing humans to interface with computer systems, and more particularly to computer interface devices that allow the user to provide input to computer systems and provide force feedback to the user.[0002]
• Computer systems are used extensively in many different industries to implement computer controlled applications and tasks, and are also very popular with the mass market of home consumers. A computer system typically displays a visual environment to a user on a display screen or other visual output device. Users can interact with the displayed environment to perform functions and tasks on the computer, such as playing a game, experiencing a simulation or virtual reality environment, using a computer aided design system, operating a graphical user interface (GUI), performing file manipulation, or otherwise influencing events or images depicted on the screen. Such user interaction can be implemented through the use of a human-computer interface device, such as a joystick, mouse, trackball, stylus, tablet, pressure-sensitive ball, or the like, that is connected to the computer system controlling the displayed environment. Typically, the computer updates the environment in response to the user's manipulation of a user-manipulatable physical object such as a joystick or mouse, and provides feedback to the user utilizing the display screen and, typically, audio speakers. The computer senses the user's manipulation of the object through sensors provided on the interface device.[0003]
• In some interface devices, tactile and/or haptic feedback is also provided to the user, more generally known as “force feedback.” These types of interface devices can provide physical sensations to the user manipulating a user manipulable object of the interface device. For example, the Force-FX controller from CH Products, Inc. and Immersion Corporation may be connected to a computer and provides forces to a user of the controller. Typically, motors or other actuators are coupled to the user object and are connected to the controlling computer system. The computer system can provide forces on the object in conjunction with application program events by sending control signals to the actuators. The computer system can thus convey physical force sensations to the user in conjunction with other supplied feedback as the user is grasping or contacting the object of the interface device.[0004]
• In most of the prior art force feedback interface devices, the host computer directly controls forces output by the actuators of the interface device, i.e., a host computer closes a control loop around the system to generate sensations and maintain stability through direct host control. FIG. 1 illustrates a block diagram of a[0005]control system10 having a typical host controlled loop architecture. A user manipulatedobject12, such as a joystick, of aninterface device13 is moved by a user to interface with ahost computer14 having a host CPU (or microprocessor)16,memory17, adisplay device18, and I/O circuitry19.Sensors20 detect the position of the user object in provided degrees of freedom and buttons or other controls may also be provided to detect user actions. The sensor data including position data is sent to hostcomputer14 over abi-directional communication bus21 that is typically connected to aninterface card22 plugged into the host computer. To complete the control loop,host computer14 sends force commands overbus20 toactuators24, and the actuators output forces to the user viauser object12.
• The configuration of FIG. 1 has disadvantages in the inexpensive mass market, since the functions of reading sensor data and outputting force values to[0006]actuators24 can be a computational burden on the host processor which detracts from the performance of the host in other host tasks and application program execution. In addition,low bandwidth interfaces22 are often used in mass market computer systems, which reduces the ability of the host computer to control realistic forces requiring high frequency signals.
• Some prior art force feedback devices employ a more sophisticated computational architecture having a dedicated microprocessor local to the interface device that communicates with the host computer through a high-level command language. As shown in FIG. 2, a[0007]local microprocessor26 reads sensors and control actuators in response to commands from the host computer. The local microprocessor reports data and creates force feedback sensations as a result of parsing host commands. Such an architecture is disclosed, for example, in issued U.S. Pat. No. 5,576,727, and is used in the abovementioned Force-FX joystick from CH Products and Immersion Corp. The advantage of this architecture is that the local microprocessor can reduce the computational burden on the host computer associated with generating force feedback sensations. This is particularly important for “closed loop” force feedback sensations such as simulated springs, dampers, and inertias which are generated as a function of motion of the user manipulatable object as reported by the sensors. These “closed loop” sensations, referred to herein as “condition forces” or “conditions” are computationally intensive because sensors must be read and actuators must be controlled in a very rapid control loop. Such a loop of reading sensors, performing computations on sensor data, and controlling actuators must be performed on the order of 1000 times per second to achieve high fidelity force feedback functionality. Having a local microprocessor perform these closed loop condition forces in response to high level commands from the host computer allows the host application to maintain control over the sensations without being burdened with actually performing the rapid control loops. This enables the use of force feedback with host applications such that the performance of the host application is not significantly degraded when implementing force feedback functionality.
• While the above dual-processor architecture is a significant improvement over traditional force feedback architectures, cost constraints on the local microprocessor limit the speed/performance of that processor and thus limit the fidelity of local “closed loop” force sensations. There is a need to develop low-cost methods of reducing the computational burden of the local microprocessor associated with high-fidelity closed loop “conditions” such as springs, dampers, and inertias. This is because low-cost local microprocessors lack the processing speed to perform the force feedback computations of closed-loop conditions while at the same time perform other tasks such as controlling communication with the host computer, decoding commands, reporting sensor data, and creating “open loop” force feedback “effects,” such as jolts, vibrations, etc. The local microprocessor, however, must be kept low-cost and simple to manufacture for mass market force feedback interface devices so that the interface device is competitively priced in the high volume, aggressive home computer and home video game markets.[0008]
SUMMARY OF THE INVENTION
• The present invention is directed to a new computer architecture for use in a force feedback interface device that further distributes the computational burden associated with force feedback generation by providing a haptic accelerator chip. The accelerator chip performs support functionality so as to relieve the computational burden on the local microprocessor of the interface device and increase performance and fidelity of forces at a low cost.[0009]
• More specifically, the force feedback interface device is used with a host computer which displays and updates an application program such as a graphical simulation on a display device in response to user manipulation of the interface device. The host computer commands force feedback sensations in response to the user manipulation and in coordination with events within the graphical simulation. The interface device includes a user manipulatable object graspable by the user, such as a mouse or a joystick, an actuator for outputting a force on the user manipulatable object, and a sensor for outputting a raw sensor signal indicative of a position of the user manipulatable object. A force feedback processor determines output force commands for commanding forces to be applied on the user object by the actuator. A haptic accelerator separate from the force feedback microprocessor receives the raw sensor signals and outputs processed signals derived from the raw sensor signals, where the processed signals are sent to and used, at least in part, by the force feedback processor for determining the forces. In the preferred embodiment, the raw sensor signals represent a position of the user object in a degree of freedom, and the processed signals represent a velocity and/or an acceleration of the user object. The haptic accelerator thus performs fast and efficient velocity and acceleration determination from raw position signals.[0010]
• The haptic accelerator includes logic components for fast processing of the raw sensor data into the processed data. In one embodiment, the sensor is a digital optical encoder providing two raw sensor signals, and the haptic accelerator determines a position and direction of the user object from the two raw sensor signals. The haptic accelerator preferably includes a quadrature module for determining the position data using the two raw sensor signals and a motion processing module having a counter for counting a time interval between the raw signals to determine the velocity of the user object. The haptic accelerator may also include multiple latches for storing the time interval and a previous time interval such that the haptic accelerator can determine the acceleration of the user object. Furthermore, the haptic accelerator may include fault prevention logic for detecting errors and invalid signals from the sensor, and a filter for rejecting spurious raw sensor signals. The haptic accelerator can further include a multiplexer for multiplexing the position data with the velocity data. The haptic processing unit can additionally include a summing node for summing different condition force magnitudes determined substantially simultaneously by the haptic processing unit and for outputting the resultant condition force magnitude to the actuator.[0011]
• An advanced embodiment of the haptic accelerator is also included in the present invention. The advanced haptic accelerator can include the components described above as well as a haptic processing unit for determining condition force magnitudes, such as for stiffness, damping, and inertia conditions, which are output from the haptic processing unit to the actuator. The condition forces are dependent on a position, velocity, or an acceleration of the user object. In this embodiment, the force feedback processor preferably determines time-varying effect forces, such as jolts and vibrations. The haptic accelerator can include a parameter storage register for storing parameters received from the force feedback processor that modify the condition forces determined by the haptic processing unit, such as a spring constant, a damping constant, and a simulated mass constant. In some embodiments, the force feedback processor outputs effect forces to the haptic processing unit, and the haptic processing unit sums the effect forces with the condition forces and outputs the summed forces to the actuator.[0012]
• In the preferred embodiment, the force feedback processor is a device microprocessor separate from the host computer system and local to the force feedback interface device. The device microprocessor receives high-level host commands from the host computer, computes force magnitudes in response to the high-level commands, and outputs the force magnitudes to the actuator. Alternatively, the force feedback processor is a microprocessor included in the host computer system. A method of the present invention provides fast computation of forces for a force feedback interface device and can be implemented in a similar manner to the apparatus described above.[0013]
• An analog embodiment of the force feedback device includes an analog position sensor for outputting an analog position signal, an analog circuit separate from the host computer which receives the raw analog position signals, computes an analog velocity of said user object from the position, and outputs processed signals derived from the position signals and which include representations of the computed velocity. A device microprocessor (or other force feedback processor) computes forces and receives the analog position signal and the processed signals from the analog circuit and uses the analog position and velocity, at least in part, to determine the forces to be output on the user object.[0014]
• In another aspect of the present invention, smooth force sensations are provided to a user manipulatable object used in a force feedback interface device that is coupled to a host computer executing a program with which the user interacts. Sensor signals from the interface device are executing a program with which the user interacts. Sensor signals from the interface device are used, at least in part, in the determination of force values to be output to a brushless motor (e.g., DC motor) included in the interface device. Force signals are output, equivalent to the force values, to the brushless motor using sinusoidal commutation, where the force values are converted into forces applied to the user object by the brushless motor, which preferably operates at low speeds. The forces are coordinated with events displayed within the program. In some embodiments, a haptic accelerator on the force feedback device may include a controller for sinusoidal commutation of the brushless motor. This sinusoidal commutation provides the high-fidelity forces necessary in a force feedback interface device using a brushless motor.[0015]
• The methods and apparatus of the present invention advantageously provide increased ability in a force feedback device to quickly and realistically output forces to a user manipulated object in coordination with an application program updated on a host computer. The haptic accelerator of the present invention is dedicated to simple but computationally burdensome tasks such as determining velocity and acceleration from position information of the user object, and can handle such tasks in parallel and more quickly than the force feedback processor. The advanced haptic accelerator performs additional tasks such as the determination of condition forces. This functionality allows these computationally burdensome tasks to be offloaded from the force feedback processor, allowing that processor to more quickly and efficiently determine other forces and to oversee other force feedback tasks. This also allows the force feedback processor and interface device to be implemented as a much more inexpensive device, which is critical in the home and video game mass market. Other features of the present invention allow realistic and effective forces to be provided with a low cost interface device.[0016]
• These and other advantages of the present invention will become apparent to those skilled in the art upon a reading of the following specification of the invention and a study of the several figures of the drawing.[0017]
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a block diagram of a force feedback system of the prior art using direct host-controlled forces;[0018]
• FIG. 2 is a block diagram of a force feedback system of the prior art using a local microprocessor for control of forces;[0019]
• FIG. 3 is a block diagram of a force feedback system of the present invention including a haptic accelerator for assistance in the computation of forces;[0020]
• FIG. 4 is a block diagram of a basic embodiment of the haptic accelerator of the present invention;[0021]
• FIG. 5 is a block diagram of an advanced embodiment of the haptic accelerator of the present invention;[0022]
• FIG. 6 is a flow diagram illustrating a method of implementing the force feedback system using a haptic accelerator of FIG. 3;[0023]
• FIG. 7 is a block diagram illustrating an alternative force feedback system in which the haptic accelerator of the present invention is used in a host controlled force feedback system;[0024]
• FIG. 8 is a block diagram of the basic haptic accelerator of the present invention;[0025]
• FIG. 9 is a schematic diagram illustrating an embodiment of the filter of the haptic accelerator of FIG. 8;[0026]
• FIG. 10 is a schematic diagram illustrating a quadrature module of the haptic accelerator of FIG. 8;[0027]
• FIG. 11 is a schematic diagram illustrating a motion processing module of the haptic accelerator of FIG. 8;[0028]
• FIG. 12 is a block diagram illustrating an example of the advanced haptic accelerator of FIG. 5;[0029]
• FIG. 13 is a flow diagram of a process in which the haptic processing unit of FIG. 12 determines condition forces;[0030]
• FIG. 14 is a graph of a stiffness force with reference to position versus force output;[0031]
• FIG. 15 is a schematic diagram of an alternate analog circuit embodiment of the haptic accelerator of FIG. 3; and[0032]
• FIG. 16 is a block diagram of a control system of the present invention for controlling a brushless motor in a force feedback interface device.[0033]
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
• FIG. 3 is a block diagram of a[0034]force feedback system30 including a computational architecture of the present invention for use in force feedback interface devices.System30 includes ahost computer32, aninterface device34, and a communication bus36.
• [0035]Host computer32 is preferably a personal computer, workstation, video game console, or other computing or display device, such as an IBM-PC compatible computer or Macintosh personal computer, a SUN or Silicon Graphics workstation, a video game console available from Nintendo, Sega, or Sony, a “set top box” which can be used, for example, to provide interactive television or Internet functions to users, or a “network” or “internet” computer which allows users to interact with a local or global network using standard connections and protocols such as used for the Internet and World Wide Web.Host computer32 commonly includes a host CPU38 (or host microprocessor), random access memory (RAM)40, read-only memory (ROM)42, input/output (I/O) electronics44, adata bus46, adisplay device48, and anaudio output device50.Host CPU38 can include a variety of available microprocessors from Intel, AMD, Motorola, Cyrix, or other manufacturers.Microprocessor38 can be single microprocessor chip, or can include multiple primary and/or co-processors.CPU38 preferably retrieves and stores instructions and other necessary data fromRAM40 andROM42 as is well known to those skilled in the art.
• [0036]Host computer32 preferably implements a host application program with which a user is interacting viainterface device34 and other peripherals, if appropriate. For example, the host application program can be video game, Web page, medical simulation, word processor, CAD program, or other application program that utilizes input frominterface device34 and outputs force feedback to theinterface device34. Herein, for simplicity, operating systems and graphical user interfaces, such as Windows®, MS-DOS, MacOS, Unix, X-Windows, etc. are also referred to as “application programs.” Also,computer32 may be referred as displaying “graphical objects” or “computer objects.” These objects are not physical objects, but are logical software unit collections of data and/or procedures that may be displayed as images bycomputer32 ondisplay screen48, as is well known to those skilled in the art. For example, a displayed cursor or a simulated cockpit of an aircraft might be considered an “object”. Suitable software drivers which interface software with computer input/output (I/O) devices are well known to those skilled in the art.
• [0037]Display device48 can be included inhost computer32 and can be a standard display screen (LCD, CRT, etc.), 3-D goggles, projector, or any other visual output device. Typically, the host application program provides images to be displayed ondisplay device48 and/or other feedback, such as auditory signals. Images describing a GUI, a simulation, a moving, first person point of view can be displayed, as in a virtual reality game, or a third-person perspective of objects, backgrounds, etc. can be displayed.Audio output device50, such as speakers, can be coupled tohost CPU38 via amplifiers, filters, and other circuitry well known to those skilled in the art.Host CPU38 outputs signals to speakers to provide sound output to the user when an “audio event” occurs during the implementation of the host application program. Other types of peripherals can also be coupled tohost CPU38, such as storage devices (hard disk drive, CD ROM drive, floppy disk drive, etc.), printers, and other input and output devices.Data bus46 is internal tohost computer32 and allows communication between the various components of the host computer.
• Communication bus[0038]36 couples thehost computer32 to theinterface device34.Host computer system32 can receive sensor signals or data via communication bus36 from sensors ofinterface device34 and other information.CPU38 can receive data from bus36 using I/O electronics44, and can use I/O electronics44 to control other peripheral devices.Host computer system32 can also output commands to interfacedevice34 via bus36 to cause force feedback for theforce feedback system30.
• The bi-directional bus[0039]36 sends signals in either direction betweenhost computer32 and theinterface device34. Bus36 can be a serial interface bus providing data according to a serial communication protocol, a parallel bus using a parallel protocol, or other types of buses. An interface port ofhost computer32, such as an RS232 serial interface port, connects bus36 tohost computer32. One preferred serial interface used in the present invention is the Universal Serial Bus (USB). The USB standard provides a relatively high speed serial interface that can provide force feedback signals in the present invention with a high degree of realism. USB can also source power to drive actuators and other devices, allow multiple devices to share the same bus, and provide timing data that is encoded along with differential or position data. In another embodiment, an additional bus can be included to communicate betweenhost computer32 andinterface device34 which is coupled to a second port of the host computer, such as a “game port”, such that two buses are used simultaneously to provide a increased data bandwidth.
• Interface device[0040]34 (which can be considered a “peripheral” of host32) includes alocal microprocessor54,local clock56, local memory58,haptic accelerator60,sensors62,actuators64, and usermanipulatable object66.Interface device34 may also include additional electronic components for communicating via standard protocols on bus36. Some electronic components ofinterface device34 can alternatively be included inhost34 or in its own separate housing.
• [0041]Local microprocessor54 preferably coupled to bus36 and may be closely linked tointerface device34 to allow quick communication with other components of the interface device.Processor54 is considered “local” to interfacedevice34, where “local” herein refers toprocessor54 being a separate microprocessor from any processors or CPU's38 inhost computer32. “Local” also preferably refers toprocessor54 being dedicated to force feedback and sensor I/O of the forcefeedback interface system30, and being closely coupled to sensors and actuators of theinterface device34, such as within the housing of or in a housing coupled closely todevice34.Microprocessor54 can be provided with software instructions to perform various functions or tasks, including waiting for commands or requests fromhost computer32, parsing/decoding the command or request, and handling/controlling input and output signals according to the decoded command or request. In addition,processor54 preferably operates independently ofhost computer32 by reading sensor signals and calculating appropriate forces utilizing those sensor signals, time signals, and force processes selected in accordance with a host command, and output appropriate control signals to the actuators. Suitable low-cost microprocessors for use aslocal microprocessor54 include the MC68HC711E9 by Motorola and the PIC 16C74 by Microchip, for example.Microprocessor54 can include one microprocessor chip, or multiple processors and/or co-processor chips. In other embodiments,microprocessor54 can include digital signal processor (DSP) functionality.
• For example, in one host-controlled embodiment that utilizes[0042]microprocessor54,host computer34 can provide low-level force commands over bus36, whichmicroprocessor54 directly transmits to the actuators. In a different, local control loop embodiment,host computer32 provides high level supervisory commands tomicroprocessor54 over bus36, andmicroprocessor54 manages low level force control loops to sensors and actuators in accordance with the high level commands and independently of thehost computer32. In the local control embodiment, themicroprocessor54 can process inputted sensor signals to determine appropriate output actuator signals by following the instructions of a “force process” that may be stored in local memory and includes calculation instructions, formulas, force magnitudes, or other data. The force process can command distinct force sensations, such as vibrations, textures, jolts, or even simulated interactions between displayed objects. Sensor signals received and used bymicroprocessor54 are also reported tohost computer32, which updates a host application program and outputs force control signals as appropriate. For example, if the user moves a user manipulatable object, thecomputer32 receives position and/or other signals indicating this movement and can move a displayed cursor in response. These embodiments are described in greater detail in co-pending applications Ser. No. 08/534,791 and Ser. No. 08/566,282, both incorporated by reference herein in their entirety.
• A[0043]local clock56 can be coupled to themicroprocessor54 andhaptic accelerator60 to provide timing data, similar tosystem clock46 ofhost computer32; the timing data might be required, for example, to compute forces output by actuators62 (e.g., forces dependent on calculated velocities or other time dependent factors). In alternate embodiments using the USB communication interface, timing data for microprocessor54 (and, in some embodiments, for haptic accelerator60) can be retrieved from the USB interface.
• Local memory[0044]58, such as RAM and/or ROM, is preferably coupled tomicroprocessor54 ininterface device34 to store instructions formicroprocessor54 and store temporary and other data.Microprocessor54 may also store calibration parameters in a local memory58 such as an EEPROM. Memory58 may be used to store the state of the force feedback device or other information.
• [0045]Haptic accelerator60 of the present invention is an integrated circuit (IC) coupled tomicroprocessor54 and tosensors62 andactuators64 of the interface device which performs support functions forlocal microprocessor54. The support functions are associated with closed loop “condition” sensations which are computationally burdensome to thelocal microprocessor54.Haptic accelerator60 can be implemented according to different embodiments; a basic embodiment is described with reference to FIG. 4, and an “advanced” embodiment is described with reference to FIG. 5. Thehaptic accelerator60 can be implemented on a separate IC frommicroprocessor54, or alternatively on the same portion of silicon on which microprocessor is implemented. Also,haptic accelerator60 can be implemented as a digital signal processor (DSP) or the equivalent, especially if the functions of the haptic accelerator are to be optimized for mathematical operations. In yet other embodiments, the haptic accelerator (or the haptic processing unit within the advanced haptic accelerator) can be implemented as a (low-level) microprocessor, separate from the (high-level)local microprocessor54 and working in conjunction withmicroprocessor54. Thus, two local microprocessors can be used: one for overseeing communication with the host computer and determining time varying effect forces, and the other for performing haptic-specific tasks such as determining velocity/acceleration and condition forces. This functionality is described in greater detail below. In such an embodiment, the haptic accelerator microprocessor might be the same type of microprocessor asprocessor54, or a lower cost microprocessor.
• [0046]Sensors62 sense the position, motion, and/or other characteristics of auser object66 along one or more degrees of freedom and provide signals tomicroprocessor54 including information representative of those characteristics. Typically, asensor62 is provided for each degree of freedom along which object66 can be moved, or, a single compound sensor can be used for multiple degrees of freedom. Example of sensors suitable for embodiments described herein are digital rotary optical encoders, which sense the change in position of an object about a rotational axis and provide digital signals indicative of the change in position. Linear optical encoders may similarly sense the change in position ofobject66 along a linear degree of freedom. A suitable optical encoder is the “Softpot” from U.S. Digital of Vancouver, Wash. Alternatively, analog sensors such as potentiometers can be used. It is also possible to use non-contact sensors at different positions relative tointerface device34, such as Polhemus (magnetic) sensors for detecting magnetic fields from objects, or an optical sensor such as a lateral effect photo diode having an ernitter/detector pair. Furthermore, either relative or absolute sensors can be employed.
• A sensor interface (not shown) may optionally be included in[0047]interface device34 to convert sensor signals to signals that can be interpreted by themicroprocessor54 and/orhost computer34. For example, a digital sensor interface (for digital sensors) or an analog sensor interface (for analog sensors) can be used. Such circuits, or equivalent circuits, are well known to those skilled in the art. For example, an electronic interface is described in U.S. Pat. No. 5,576,727, which is hereby incorporated by reference herein. Alternately, microprocessor54 (and/or haptic accelerator60) can perform these interface functions without the need for a separate sensor interface. Or, sensor signals from the sensors can be provided directly tohost computer32, bypassingmicroprocessor54 andhaptic accelerator60.
• [0048]Actuators64 transmit forces touser object66 in one or more directions along one or more degrees of freedom in response to signals output bymicroprocessor54 and/orhost computer34, i.e., they are “computer controlled.” Typically, anactuator64 is provided for each degree of freedom along which forces are desired to be transmitted.Actuators64 can include two types: active actuators and passive actuators. Active actuators include linear current control motors, stepper motors, pneumatic/hydraulic active actuators, a torquer (motor with limited angular range), a voice coil actuator, and other types of actuators that transmit a force to an object. Passive actuators can also be used foractuators64, such as magnetic particle brakes, friction brakes, or pneumatic/hydraulic passive actuators, and generate a damping resistance or friction in a degree of motion. In yet other embodiments, passive (or “viscous”) damper elements can be provided on bearings of a mechanical apparatus ofinterface device34. In some embodiments, all or some ofsensors62 andactuators64 can be included together as a sensor/actuator pair transducer.
• An actuator interface (not shown) can be optionally connected between the[0049]actuators64 andmicroprocessor54. The interface converts signals frommicroprocessor54 into signals appropriate to drive the actuators. The interface can include power amplifiers, switches, digital to analog controllers (DACs), and other components. Such interfaces are well known to those skilled in the art. In alternate embodiments, actuator interface circuitry can be provided withinmicroprocessor54, withinhaptic accelerator60, or within the actuators. A power supply (not shown) can optionally be coupled toactuators64 to provide electrical power. Active actuators typically require a separate power source to be driven. Alternatively, if the USB or a similar communication protocol is used, actuators and other components can draw power from the USB and thus have no (or reduced) need for a power supply.
• User manipulatable object[0050]66 (“physical object” or “manipulandum”) is preferably grasped or gripped and manipulated by a user in degrees of freedom provided by theinterface device34. By “grasp,” it is meant that users may releasably engage a portion of the object in some fashion, such as by hand, with their fingertips, or even orally in the case of handicapped persons. For example, images can be displayed and/or modified ondisplay screen48 of thecomputer34 in response to such manipulations. Suitable user objects66 include a joystick, mouse, stylus, steering wheel, aircraft control, pool cue, medical instrument, or other article.
• A mechanical apparatus (not shown) is typically used in[0051]interface device34 to provide degrees of freedom of movement for usermanipulatable object66. The mechanical apparatus can be one of several types of mechanisms, including a gimbal mechanism, slotted yoke mechanism, flexible structure, etc. For example, mechanisms disclosed in co-pending patent applications Ser. Nos. 08/275,120, 08/344,148, 08/374,288, 08/400,233, 08/489,068, 08/560,091, 08/623,660, 08/664,086, 08/709,012, 08/736,161, 08/756,745, and U.S. Pat. No. 5,576,727, all hereby incorporated by reference herein in their entirety, can be included.
• Other input devices (not shown) can also optionally be included in[0052]interface system30 and send input signals tomicroprocessor54 and/orhost computer32. Such input devices can include buttons, such as buttons on the user object66 (e.g. a mouse or joystick) used to supplement the input from the user to a GUI, game, simulation, etc. Also, dials, switches, foot pedals, voice recognition hardware (with software implemented by host34) or other input mechanisms can be used. A safety or “deadman” switch can also be included to provide a mechanism to allow a user to override and deactivate theactuators64 or require a user to activate the actuators, for safety reasons. Some embodiments of safety switches are described in co-pending patent application Se. No. 08/623,660.
• One input device that is preferably included in[0053]interface device34 is a haptic “volume” knob or force volume knob68. Volume knob68 can be adjusted by a user to reduce or increase the magnitude of forces output byactuators64. The user can thus adjust the overall level of forces to a desired or preferred level during normal operation of the force feedback system independently of software running on thehost computer34. In addition, certain force volume settings can be provided for specific purposes; for example, one setting of the knob or switch can be recommended for adults, while the other, lower-magnitude force setting can be recommended for children. Or, a player may wish to lower the overall magnitudes of forces after playing a force-feedback game for some time, and can switch the forces from a high-magnitude “turbo” mode to a lower-magnitude “normal” mode. Preferably, the microprocessor54 (or haptic accelerator60) can handle force volume functions by checking the state of the knob constantly, by waiting for an input signal from the knob, or by receiving an interrupt signal from the knob. Themicroprocessor54 can multiply a determined total force by a constant dictated by the position of the volume knob and output the final force accordingly. Alternatively, a separate component or circuit can be used to limit current to theactuators64 or otherwise adjust the magnitude of output forces. Such a component can be coupled between a power supply and actuators, or in another position allowing force magnitudes to be reduced after the microprocessor/haptic accelerator have determined the force. In other embodiments, force68 volume control can be implemented as a slider, lever, buttons, switch, or other input device.
• In some embodiments of[0054]interface system30,multiple interface devices34 can be coupled to asingle host computer34 through bus36 (or multiple buses36) so that multiple users can simultaneously interface with the host application program or host computer (in a multi-player game or simulation, for example). In addition, multiple users can interact with the host application program and with each other usingmultiple interface systems30 andnetworked host computers34, as is well known to those skilled in the art.
• In another mode of the force[0055]feedback interface device34, force feedback can be generated for a user completely independently of host commands andhost computer34. For example, “reflex” forces can be output byactuators64 whenever a certain input or event occurs, such as when a button oninterface device34 is pressed by the user. The microprocessor detects the activation or press of the button and the microprocessor and/or haptic accelerator immediately outputs a force or sequence of forces that are associated with the button and also based on other conditions, but does not need any commands from the host when outputting these forces in the reflex mode. However, a previous command from the host computer can associate a particular reflex force sensation with a button or other event. Such an embodiment is described in greater detail in copending patent application Ser. No. 08/623,660.
• In a “demonstration” mode similar to the reflex mode,[0056]interface device34 can produce predetermined forces when theuser object66 is moved or manipulated by the user. Themicroprocessor54 does not report data to the host computer or supervise communication to the host computer when in this mode, nor does it receive host commands. Instead, forces are generated solely based on button or other input device activations and motion of the user object, completely independent of the host computer. A force “volume” knob and other controls (such as described above) may be provided on the user object to allow the user to select different force outputs, effects, conditions, and/or force magnitudes. The forces produced can be any of the previously mentioned force effects or conditions, such as a stiffness condition or jolt effect; or virtual walls, springs, textures, etc. can also be output forces in this mode. Demonstration mode is quite useful to demonstrate to potential customers the functionality of theinterface device34 without requiring that ahost computer32 be connected to the interface device. For example, in a store having a display of several joysticks, a store manager may not desire to connect a host computer to each joystick having force feedback functionality. Yet, it is desirable to allow the customers to manipulate the joysticks in actual operation to allow them to experience the forces produced by the joystick. The demonstration mode allows customers to sample a wide range of force sensations produced by a particular device while allowing the store manager flexibility in providing demonstration models.
• FIG. 4 is a block diagram illustrating a[0057]basic embodiment60′ ofhaptic accelerator60 of the present invention.Haptic accelerator60′ is preferably hard-wired circuitry that performs processing on incoming sensor data; one circuitry embodiment is described below with respect to FIG. 8.Accelerator60′ preferably receivesraw sensor data70 fromsensors62, such as digital pulses output when an incremental change in a rotary or linear shaft is detected by the sensor.Accelerator60 then generates processed data or signals72 representative of the position, velocity and/or acceleration of the usermanipulatable object66 in one or more degrees of freedom and sends thesignals72 to microprocessor54 (and/or to host CPU38).Haptic accelerator60 can receive inputs from multiple sensors, such that position, velocity and acceleration data for each of the sensors is output as processed signals72.
• In the preferred embodiment,[0058]sensor62 is a digital encoder that provides digital pulses as a portion of the sensor that is coupled to theuser object66 moves incremental distances. In the preferred embodiment, this is an optical encoder with an A channel for sending A pulses and a B channel for sending B pulses; for example, a suitable optical encoder is the HED5550 made by Hewlett-Packard. The A and B pulses do not track absolute position, but are simply output by the sensor each time an incremental step or distance is passed (i.e., the pulses track relative position). For example, using a rotary optical encoder, pulses are sent out on A channel and B channel as a rotary encoder disk that is coupled to a rotatable shaft is rotated about an axis such that detectors in the encoder detect the disk's incremental movement. Two channels are used so that thehaptic accelerator60 can monitor not only the number of pulses as the shaft rotates, but also the direction that the shaft is rotating. A linear optical encoder functions similarly with linearly moving parts. Using these pulses fromsensor62,haptic accelerator60 can generatesignals72 representative of the incremental position change of the user object, can generate processedsignals72 representative of the velocity, and can also optionally generate processedsignals72 representative of the acceleration of the user object. The method by which the haptic accelerator generatesdata72 representative of position, velocity, and acceleration based on an input of raw encoder pulses will be described in detail below. Thehaptic accelerator60 makes the position, velocity, and/or acceleration data available to thelocal microprocessor54 orhost computer32 that is overseeing creation of force feedback sensations. Such position, velocity, and/or acceleration data is important because “condition” force sensations require such data to be implemented effectively.
• “Conditions” or “condition forces”, as the terms are used herein, refer to force sensations that depend on motion of the user manipulatable object. For example, a “stiffness” or “restoring spring” feel sensation requires position data, a damping feel sensation requires velocity data, and an inertia feel sensation requires acceleration data. A stiffness condition provides a force sensation such that force applied to the user manipulatable object is proportional to a displacement X of the user object as modified by a constant k (F=kX). This can produce a spring-like force on the user object, where the force in a particular direction may get stronger (or weaker) in proportion to the distance from an origin point or other location. A damping condition provides a force sensation such that force is proportional to a velocity V (or velocity squared) as modified by a constant b (F=bV or F=bV*V). This can produce a “sluggish” force sensation, as if the user manipulatable object were moved through a thick liquid or other viscous material. An inertia condition provides a force feedback sensation such that force is proportional to acceleration A as modified by a constant m (F=mA), and can be used to produce a simulated mass or weight on virtual objects when the objects are “carried” by a user-controlled graphical object. Friction is another condition that may be implemented as a constant force in a direction opposing the direction of movement of the user manipulatable object. These types of condition forces are also described in detail below. Herein, the term “motion of the user object” refers to position, velocity, and acceleration, or even other motion-derived characteristics, of the user object as it moves in one or more degrees of freedom.[0059]
• The above-described[0060]haptic accelerator60 has many benefits to forcefeedback system30. In the prior art, there are two ways that position, velocity, and/or acceleration data has been made available to the processor performing control over force feedback sensations. One method has been to use multiple sensors: position sensors such as encoders, velocity sensors such as tachometers, and acceleration sensors such as accelerometers. The processor reads data from each of these sensors to receive very accurate and high speed data. While ideal, this is a very costly solution that is economically impossible for low-cost consumer products. In an ideal low cost embodiment, a single sensor is used (such as a position sensor) from which velocity and/or acceleration data is generated. This, too, is presented in the prior art, but in all cases, the computation of velocity and/or acceleration from digital position data is performed by the processor that is overseeing the force feedback sensations. This is a substantial burden to the processor because velocity and acceleration must be computed very quickly to provide realistic conditions and other force sensations to the user, and because the processor has other computational obligations such as executing application programs or overseeing communication. Thehaptic accelerator60, by generating velocity and/or acceleration data separately from the force feedback processor, greatly reduces the burden on the processor. The circuitry ofhaptic accelerator60 is also superior to a microprocessor at generating the velocity and acceleration data because it can deal with rapid asynchronous events better than a serial microprocessor that handles asynchronous events using interrupts. In addition, thehaptic accelerator60 can function very quickly because it does not need to handle other functions, thus generating very accurate data. Finally, the haptic accelerator is not a microprocessor, and thus can generate multiple signals in parallel and easily process signals from multiple sensors simultaneously without a problem.
• FIG. 5 is a block diagram of an advanced embodiment of[0061]haptic accelerator60″. This version of the haptic accelerator includes all of the functionality described with reference to FIG. 4 for the basic embodiment, and also includes additional functionality which further reduces the burden on the force feedback processor. As described above, a force feedback “condition” includes force feedback sensations wherein the force is a function of position, velocity, and/or acceleration of the user manipulatable object. When using the architecture shown in FIG. 3 with the basic haptic accelerator of FIG. 4, thehaptic accelerator60 provides thelocal microprocessor54 with representations of position X, velocity V, and acceleration A. Knowing parameters (k, b, m) and other parameters, thelocal microprocessor54 then computes and outputs the force values (i.e. force magnitudes) required for conditions such as stiffness, damping, and inertia. This works well, but requires that the local microprocessor continually perform these simple condition operations (such as F=kX) and output values to the actuators very quickly (ideally, at least 1000 times per second). In other words, the force feedback processor is closing the loop for the condition forces which is computationally very simple but is a burden because it needs to happen very quickly to remain stable.
• The alternate embodiment illustrated in FIG. 5 demonstrates that this burden can also be removed from the microprocessor by implementing the[0062]haptic accelerator60″ to accept parameters such as k, b, and m from the microprocessor and then to compute and control condition forces independently of the microprocessor. In other words, thehaptic accelerator60″ closes the loop for condition sensations, allowing the microprocessor to perform supervisory control by modulating parameters when necessary but not closing the loop. Thus, as shown in FIG. 5,haptic accelerator60″ receives raw sensor signals70 fromsensors62 and outputs position, velocity, and/or acceleration signals72 (“processed data”) to the microprocessor, as explained above. The microprocessor then sends all or part of the processed data to the host computer (if applicable) and/or uses the processed data in the determination of effect forces (described below). In addition,haptic accelerator60″ computes and outputs force control signals orforce values74, representing condition forces, to actuators64.Haptic accelerator60″ also receives haptic parameters76, such as k, b, m, or other parameters, from microprocessor54 (or host computer32) which customize the conditions and affect the computation of condition forces. For example, thehaptic accelerator60″ can compute force F from the equation F=kx, where the parameter k is input from the microprocessor. The relationships such as F=kx, F=ma, and F=bV are preferably hardwired into the haptic accelerator circuitry to provide the fastest computation speed. Other condition forces, such as texture and friction, can also be implemented by the haptic accelerator. For example, a spatially-varying texture would provide a force depending on the spatial position of theuser object66 to achieve a desired force sensation, such as a stick being dragged over a grating, where the texture output force is zero when the user object is between simulated “bumps” and the texture output force is a predetermined magnitude when the user object is on a simulated bump. This texture can also be used in conjunction with other conditions, such as a damping force, or with effects such as jolts. Friction can be implemented as essentially a normalized damping force, where a force of constant magnitude resists motion of the user object according to a friction coefficient, and can be modeled as realistically as possible with the constraints of the hardware used. In alternate embodiments, the haptic accelerator can also determine more complex conditions according to more complex equations or algorithms.
• In the advanced embodiment of[0063]haptic accelerator60″, themicroprocessor54 or38 is not required to compute condition forces, since haptic accelerator is doing so. However, other types of forces, also known as “effect forces”, “effects” or “open loop forces”, should continue to be computed and controlled by themicroprocessor54. Effects are such forces as jolts, vibrations, or other forces that do not necessarily require position, velocity or acceleration data to be determined. Some effect forces or other forces computed bymicroprocessor54, however, may require position, velocity and/or acceleration data; thus, the processeddata72 is still sent to the microprocessor. In some embodiments, processeddata72 need only include position data; optionally, it may include the velocity and/or acceleration data as well.
• As an example, a force feedback mouse is used as a[0064]user object66 as described in co-pending application Ser. No. 08/756,745, incorporated by reference herein. Thehost computer system32 executes an application program, such as a word processor. A cursor used to access functions in the word processor is displayed ondisplay device48, where the displayed location of the cursor is controlled by the position of the user manipulatable object in a user object workspace. Raw data fromposition sensors62 on theinterface device34 are fed into thehaptic accelerator60″, and this data is processed into position, velocity, and acceleration data and fed to thelocal microprocessor54 on board theinterface device34.Microprocessor54 prepares for transmission to the host, and at least some of the processed data (e.g., the position data) is then sent via a communication channel36 such as a Universal Serial Bus to thehost computer32, where it is made accessible to cursor control software. The cursor in the word processor is then drawn on the display in the appropriate location. By viewing the display and controlling the user manipulatable object, the user maneuvers the cursor and interacts with the software. The cursor might interact with another graphical object in the word processor. For example, the cursor can interact with a graphical representation of a tab marker by dragging the tab-marker to a new location. As the tab marker moves, the software determines that a force sensation should be generated that is associated with simulated inertia and damping of dragging a tab marker. The software has been instructed to make the tab-marker feel heavy and viscous to the user as though there is significant resistance to sliding. This feel, for example, might facilitate accurate positioning of the tab.
• To enact the force sensation associated with the tab marker, the[0065]host CPU38 sends out a high-level command indicating that such a feel should be presented to the user. This command is transmitted over a communication channel36 such as a Universal Serial Bus and is received by thelocal microprocessor54 on board the force feedback interface device. This local processor then parses/decodes the command and controls theactuators64 accordingly. A parameter for damping (b) and inertia (m) would likely be determined by the microprocessor (and/or sent by the host with the high level command), then a force value would be generated as a function of the manipulation of the user object, such as F=(bV+ma). The force value would cause the actuator(s)64 to apply an appropriate force to theuser object66.
• The advantage of the advanced[0066]haptic accelerator60″ is in increased offload of computational burden from theprocessor54. In the case of the basic haptic accelerator of FIG. 4, the local microprocessor would receive data representative of velocity V and acceleration A from thehaptic accelerator60′, multiply the values by the desired parameters, then output the appropriate force to the actuators. The local microprocessor is closing the loop, and thehaptic accelerator60′ is only assisting by generating V and/or A values in parallel with microprocessor operations. However, in the case of the advancedhaptic accelerator60″, the local microprocessor would set values on the input terminals of the haptic accelerator that represent the desired parameters and thehaptic accelerator60″ would control the actuators directly, closing the loop itself. The parameters might include any parameters associated with the desired condition sensation such as stiffness coefficients, damping coefficients, mass values, offsets, dead-bands, and saturation values (these parameters are described in greater detail subsequently). This hardware implementation of the condition control loop within the haptic accelerator greatly offloads computational burden from thelocal processor54. This is particularly helpful in the case where the local processor is also generating time varying effects such as jolts or vibrations. If the local processor is producing a vibration overlay that is to be superimposed on a condition such as a damping, thehaptic accelerator60″ can generate the closed loop damping condition while thelocal processor54 generates the open loop vibration effect in parallel, greatly enhancing performance. FIG. 6 describes this division of labor in greater detail.
• In some embodiments, the[0067]local processor54 can modulate parameters to thehaptic accelerator60 very quickly, thus controlling the characteristics of condition sensations at a high level but allowing the haptic accelerator to do the computation work. For example, a spring (stiffness) force might be output which has a variable spring constant depending on the position of theuser object66 or depending on other factors. Themicroprocessor54 can change k quickly and output different k values to the haptic accelerator, which computes and outputs the condition force values to theactuators64.
• In addition, in an alternate embodiment, the advanced[0068]haptic accelerator60″ can receive position data from position sensors, velocity data from velocity sensors, and/or acceleration data from acceleration sensors. Although this embodiment may typically be more expensive than using only position sensors, it still allows the advanced haptic processor to control condition forces and thus offloads computational burden frommicroprocessor54.
• FIG. 6 is a flow diagram illustrating a[0069]method80 of implementing theforce feedback system30 using ahaptic accelerator60.Method80 illustrates the division of labor between the local processor and the advanced embodiment (FIG. 5) of thehaptic accelerator60 of the present invention. The process starts at82, and instep84, thehost computer32 receives data from the forcefeedback interface device34 which is representative of motion of the usermanipulatable object66. For example, the host computer may receive position, velocity, and/or acceleration data. Innext step86, the application program running on the host computer determines that a force sensation is required to be output on theuser object66. This force sensation can be dictated by one or more of several possible factors or events in the application program, including the interaction between a user-controlled displayed graphical object (such as a cursor) or viewpoint with one or more other simulated objects, a random or simulated event in the program (such as a collision between graphical objects), an event dictated by another connected user, etc.
• In[0070]step88, the host application sends a high level command (or “host command”) to theinterface device34 over communication channel36. In step90, thelocal processor54 parses/decodes the incoming command from the host to determine functions commanded by the host and extract host parameters sent with the command. Thelocal processor54 is preferably running software stored in local memory58 which parses the incoming commands. The commands may instruct theprocessor54 to select and execute a routine locally stored in memory58 to control the outputting of a desired force sensation, to read sensors, to report sensor values to the host, and/or to perform other tasks; such routines are described in greater detail in co-pending application Ser. No. 08/566,282. The host parameters sent with the command may specify the particular characteristics of a commanded force sensation, such as duration, magnitude, particular degrees of freedom and/or directions in which the force is to be applied, constants (such as k, m, b), or other data. These host parameters may sometimes be embedded in a command, or may be implied; e.g., a command may have a default parameter value which the microprocessor can determine using a locally stored software table or other stored data.
• In[0071]step92, themicroprocessor54 determines whether the host command instructs a condition or an effect to be output. Some commands may require both a condition and an effect to be implemented, in which case both branches fromstep92 are performed. If an effect is instructed,step94 is implemented, in which the local processor generates and sends a time-based signal or force value toactuators64 in an open loop configuration. That is, theprocessor54 outputs force magnitudes directly to the actuators to command forces on theuser object66, preferably according to a force routine implemented by the processor such as an algorithm, profile or sequence of previously-stored forces, etc. The process is then complete at99.
• If a condition is instructed by the host command in[0072]step92, then step96 is implemented, in which the local processor sends parameters to thehaptic accelerator60″. As described with reference to FIG. 5, these parameters may include mass, damping, and/or spring (m, b, k) constants, as well as other types of parameters. Instep98, thehaptic accelerator60″ receives the sensor values, computes a condition force using on-board algorithms and the received parameters, and outputs force values to the actuators as influenced by the parameters. Thus, the haptic accelerator is executing force routines such as F=ma to determine and output F to the actuators. Afterstep98, the process is complete at99.
• In the process FIG. 6, at its most basic level, the[0073]local processor54 reads high level commands from the host computer, parses those commands, and oversees the generation of force sensations. The local processor directly handles the generation of open loop effects, such as jolt and vibration forces, because these are complex time varying signals that are best handled by a processor. The open loop effects may involve complex processing to synthesize the time varying signals, but speed is not critical because stability is not an issue for open loop effects. Thehaptic accelerator60 handles the generation of closed loop conditions. This is an ideal division of labor because closed loop conditions are simple to create but should be output very fast by brute force cycling; otherwise, stability requirements will be violated. Using, for example, hard-wired logic inhaptic accelerator60 is better than a processor for such functionality because the logic can function very quickly, using asynchronous input, without being burdened by other tasks or processes.
• The[0074]local microprocessor54 also performs many other functions in the preferred embodiment. The local processor oversees communication with the host computer, receives high level commands, parses the commands, oversees the generation of force sensations, oversees the superposition of conditions and effects, reads sensor values from the sensors directly or from the haptic accelerator, processes the sensor data, sends the sensor data back to the host computer, monitors basic status such as safety flags, and reports basic status of the interface device to the host computer. These functions may involve receiving host commands that instruct multiple sensations to happen simultaneously. The local processor mediates the appropriate functions and data flow to perform multiple superimposed force effects. In some embodiments, the microprocessor can synthesize a single complex wave form that combines one or more effects; for example, combining 2 different vibration forces or a jolt and a vibration force. When multiple conditions are to be output, the microprocessor can in some embodiments reduce multiple overlapping parameters to a single set of combined parameters, in effect creating a single condition that combines the multiple conditions. This is described in greater detail with respect to FIG. 13.
• FIG. 7 is a block diagram illustrating an alternative force feedback system[0075]100 in which thehaptic accelerator60 of the present invention is used in a host controlled force feedback system. System100 includes ahost computer32′ and aninterface device34′.Host computer32′ includes ahost CPU38,RAM40,ROM42, adisplay device48, other I/O49, and an audio device (not shown) coupled to adata bus46 similar to the equivalent components described with reference to FIG. 3. In this embodiment,host CPU38 performs the functionality of thelocal microprocessor54 shown in FIG. 3, including directly controlling forces output by theactuators64 by sending force values to the actuators.
• In addition to the components described above,[0076]host computer32′ includeshaptic accelerator60 andinterface electronics102 included on aninterface card104 or similar device that can be coupled to thedata bus46 of thehost computer32′.Haptic accelerator60 receives raw sensor signals fromsensors62 of theinterface device34′, as described above. The haptic accelerator processes the raw signals into position, velocity, and/or acceleration data and sends the processed data to interfaceelectronics102, which provides the processed data to the host computer and thus removes the computational burden of calculating these values from the host.Interface electronics102 provides the force values from thehost CPU38 to theactuators64. When using the advancedhaptic accelerator60″ of FIG. 5, thehaptic accelerator60 may also receive parameters fromhost CPU38 viainterface electronics102, and compute and send condition force values to actuators64 (this functionality is shown in dashed lines).
• In the prior art host controlled embodiments not including a[0077]haptic accelerator60, the host CPU was be responsible for computing velocity and acceleration values and also creating both conditions and effects in a closed loop configuration. In the embodiment of FIG. 7, thehaptic accelerator60 reduces the computational burden from thehost CPU38 in the generation of velocity and acceleration values and closed loop condition sensations.
• FIG. 8 is a block diagram of the[0078]haptic accelerator60′ of the present invention. Thehaptic accelerator60 can in some embodiments be implemented in a programmable logic device (PLD), field-programmable gate array (FPGA), DSP, some other programmable logic device, or an application specific integrated circuit (ASIC). Several subsystems are shown, some or all of which may be implemented in a specific embodiment. The subsystems include afilter120, aquadrature counter122, andmotion processing module124.
• Raw sensor signals[0079]70 are initially input to the haptic accelerator fromsensors62 of theinterface device34. In the preferred embodiment, a two channel optical encoder is used as thesensor62, which provides two channels of data on lines126aand126bsimultaneously in response to rotation of an encoded wheel or tape within an optical sensor, as described above. The signals on lines126aan126brepresent pulses generated when a wheel or tape of the encoder is detected at an incremental position, as is well known to those skilled in the art.
• Encoder signals A and B are initially sent through a[0080]digital filter120 that compares the past three samples of the incoming signal. A filtered signal is only allowed to transition from low to high or from high to low if the last three samples unanimously agree (i.e., are all 1's or all 0's). This filtering rejects spurious signals that can result in gained or lost encoder counts. An example of a circuit that can be utilized asfilter120 is described with respect to FIG. 9.
• The filtered signals A and B are output from[0081]filter120 and input toquadrature module122, which includes a decode and position counter.Quadrature module122 keeps a count of pulses produced by either channel as an indication of incremental motion of the wheel or tape, which indicates the position of theuser object66 in a degree of freedom. By comparing the pulses on both channels, the direction of motion of the user object can also be determined. This method of tracking an encoded wheel using two channels (A and B) is well known in the prior art and is typically called quadrature decoding. Quadrature decoding is often performed by a discrete IC such as an HCTL-2016 from Hewlett Packard. In the present invention, the quadrature functionality is included within thehaptic accelerator60 to reduce the cost associated with a discrete IC. An example of circuitry suitable to be used asquadrature module122 is described with reference to FIG. 10.
• [0082]Quadrature module122 outputs position data determined from the signals A and B to amultiplexer136, which multiplexes the position data with velocity and acceleration data as described below.
• [0083]Motion processing module124 also receives the dual signals A and B fromfilter120 and provides velocity and/or acceleration processing for the filtered sensor signals. The velocity and acceleration function uses the same types of counters, latches, and flip-flops that are used in the quadrature module, but in a different way.Module124 includes logic128 to receive the A and B signals, to decode the direction of the movement of the user object, to detect the edge of the signals, and to prevent faults.Counter130 is used to count the time that has elapsed since the last encoder pulse. This value is then latched bylatch132, which provide a very clean signal that is inversely proportional to velocity of the user object (the faster the sensor motion, the smaller the time interval between encoder ticks). A subsequent time interval can be latched bylatch134, and the change between these two time intervals provides an indication of acceleration of the user object. In alternate embodiments, more than two successive time intervals can be measured in order to provide averaged data that may be cleaner than when using only two values. Such measuring of multiple values does not require the typical host processor or local processor burden of measuring multiple samples and additionally filtering the signals.
• For example, velocity can be obtained using the relationship v=ΔX/count(i), where ΔX is a constant equal to the encoder resolution. Acceleration can be obtained using the relationship,[0084]$a=\frac{2\Delta X\left[1\mathrm{count}\left(i\right)-1/\mathrm{count}\left(i-1\right)\right]}{\left[\mathrm{count}\left(i\right)+\mathrm{count}\left(i-1\right)\right]}-$

  
• The[0085]motion processing module124 can use the same oscillating clock that is used by the quadrature module122 (described below). Post-processing of the velocity and acceleration signals (for example, inverting the count value output bylatch132 to obtain a direct indication of velocity) can either be accomplished on the local microprocessor, on the host processor, or directly on advancedhaptic accelerator60″. A circuit suitable for use as themotion processing module124 is described with reference to FIG. 11.
• FIG. 9 is a schematic diagram illustrating an embodiment of the[0086]filter120 of thehaptic accelerator60 shown in FIG. 8. Signal A on channel121aand signal B in channel121bare treated identically in the filtering process. A signal A or B is latched by one of D-flip flops140. Flip-flops140 store three successive signals according to the clock input and output the three successive values to AND gate144 and NOR gate146. Flip-flop148 receives the outputs from gates144 and146 and outputs a high signal if the three successive values are all high values. The circuit of FIG. 9 can also be simplified if desired by eliminating the first flip-flop on each channel, and by using an XNOR gate on each channel instead of an AND gate and a NOR gate. The output signals are output to thequadrature circuit122 andmotion processing module124 as shown in FIG. 8.
• FIG. 10 is a schematic diagram illustrating the[0087]quadrature module122 of FIG. 8. The quadrature module receives filtered signals A and B. Theportion150 of the circuit determines the direction in which the encoder/user object is moving. The first flip-flops152 and gates154 and156 retrieve the newest bit pair from the signals A and B. The second set of flip-flops158 andgates160 and162 store the last bit pair that was previously input on signals A and B. ANDgate164 outputs a high signal when the last bit pair is 11 and the newest bit pair is 00; this instructs the flip-flop166 to output a high value, indicating to thecounter175 to count up since the sensor is moving in the direction corresponding to counting up. AND gate168 outputs a high signal when the last bit pair is 00 and the newest bit pair is 11, thus instructing flip-flop170 to output a signal to instruct counter175 to count down since the sensor is being moved in the direction associated with counting down. In alternate embodiments, the six flip-flop direction decode circuit can be simplified to use only one D-type flip-flop with one signal on the input and one signal on the clock.
• The[0088]portion172 of the circuit keeps a count that matches the changing position of the encoder/user object from the time the encoder was initialized. The XOR gate174 operates on the A and B signals to provide the least significant bit of the count. The next bit is provided by signal B directly, and all subsequent bits are provided bycounter175. The direction-decode circuitry inportion150 provides a pulse that causes the counter to increment or decrement when appropriate, as explained above. The value of thecounter175 is output to alatch176 that holds a stable value that can be read by the host CPU or another external device.Latch176 is controlled by a latch inhibitlogic subcircuit177, which releases the latch when the enable of AND gate178 goes high and a low byte has been accessed as indicated by a high output from flip-flop180. The high and low bytes of the latch are multiplexed by amultiplexer182 so that a number larger than the bus width can be separated into parts and placed on thedata bus183. Thedata bus183 is routed to multiplexer 136 as shown in FIG. 11.
• FIG. 11 is a schematic diagram illustrating the[0089]motion processing module124 shown in FIG. 8.Module124 is a circuit that is preferably programmed into the custom integrated circuit in whichhaptic accelerator60 is implemented. The signal B from thefilter120 is input to an edge detection circuit188 that provides an edge indicator pulse each time there is a rising edge on channel B. The edge indicator pulse in input to counter130 (also shown in FIG. 8), that is triggered to count by the rising edges of the B signal such that a new count starts each time the B signal rises.
• The[0090]counter130 is coupled to latch132 and loads a counter value intolatch132 if two conditions are met. First, the last two states of the B signal must be both up or both down, as detected by thedirection decode circuit190. Second, the latch inhibit logic192 must not be indicating that a read is presently occurring. These two conditions are checked as a fault prevention function. If these conditions are met, the next time the B signal rises (with a new value), the previous counter value is loaded fromcounter130 into alatch132 that is coupled to the output ofcounter130, and a new count is begun bycounter130. Concurrently, the old latched value is shifted to the right, fromlatch132 into anotherlatch134. When an external device queries the haptic accelerator, both of these counts are available on output bus199. Only one count need be used to indicate velocity, and can be the count value fromlatch132 or latch134 (a velocity based on the new count is obtained from thelatch132 count value, and a velocity based on the old count is obtained fromlatch134 count value). At least two of the count values must be used to derive an acceleration. In one embodiment, acceleration may be determined by inverting both counts, taking the difference of those two values, dividing the quantity by the most recent count, and multiplying by the position resolution of the optical encoder.
• An important feature of the present invention that allows accurate data to be input and output is the[0091]dedicated circuits188,190,192, and194 used for trapping errors and invalid signals. For example, if the encoder changes direction in the middle of an interval count, that interval will be invalid. Fault prevention logic, including direction decodecircuit190 and latch inhibit logic192, makes sure that a count is latched only if the last two encoder pulses have been in the same direction and if a read is not occurring. Latch inhibit logic192 is similar in structure and function to the latch inhibitlogic177 of FIG. 10. Another potential problem is overflow of the time counter that occurs if the encoder is moving too slowly and the counter reaches its maximum value before the next encoder pulse arrives. The three-flip-flop state machine194 makes sure that a velocity overflow flag and acceleration overflow flag are set as soon as overflow occurs. In order for the velocity flag to be reset, two successive encoder pulses must occur in the same direction, without overflow. In order for the acceleration flag to be reset, the conditions for resetting the velocity flag must be met twice.
• The outputs from the[0092]latches132 and134 are augmented with the outputs from the state machine194 and are multiplexed bymultiplexer196 onto aparallel data bus198. Data onbus198 andbus183 is then multiplexed onto bus199 bymultiplexer197, and bus199 is coupled to themicroprocessor54 as shown in FIG. 3. In an embodiment such as the one in FIG. 7, where the haptic accelerator is used directly with the host computer, data bus199 can be coupled to the host data bus via thecard interface electronics102 shown in FIG. 7.
• In other embodiments, alternative circuits structures can be provided for[0093]motion processing module124. For example, additional filters can be provided (although the signals are prefiltered by the same digital filter120), or counter130 can be provided with an increased count capability such that the counter only latches count values after more than one encoder pulse has gone by; for example, the counter can count values every 5 encoder pulses to measure the time between 5 pulses. The time is then divided by 5 to achieve an average time between pulses. Increasing the clock speed applied to the counter will increase time resolution, resulting in increased velocity and acceleration resolution, as well as the ability to deal with faster velocities, though it may require a larger counter and latches. Increasing the counter and latch size enables one to deal with smaller velocities. Further improvements such as the implementation of adders, multipliers, dividers, table lookup, etc., can be included in the embodiment of the advanced embodiment of the haptic accelerator chip.
• FIG. 12 is a block diagram illustrating an example of the advanced[0094]haptic accelerator60″ described above with reference to FIG. 5.Accelerator60″ includes afilter120, a quadrature decode andposition counter122, amotion processing module124, and amultiplexer136 substantially similar to the equivalent components described above with reference to FIG. 8 foraccelerator60′. In addition,accelerator60″ includes a demultiplexer200, a parameter storage register202, ahaptic processing unit204, and an optional pulsewidth modulation block206.
• Demultiplexer[0095]200 receives data fromdata bus207 from themicroprocessor54, including constants and parameters for condition forces. Input parameters are sent via bus209 to parameter storage register202. Address and control lines208 are used by local microprocessor54 (or host CPU38) to enable the demultiplexer to write parameters to parameter storage register202, which stores the parameters so that thehaptic processing unit204 may access the parameters when appropriate. The condition parameters preferably include positive and negative stiffness (+k, −k), positive and negative damping (+b, −b), mass (m), positive and negative saturation (+sat, −sat), deadband size (db), and location offset (offset). Preferably, only one set of any of the parameter values can be stored at one time, so that thehaptic processing unit204 may retrieve only one set of each type of parameter. Alternatively, multiple sets of parameters can be stored in the parameter storage register for the haptic processing unit to retrieve simultaneously and use to compute simultaneous (summed or overlaid) condition forces, such as a spring force and a damping force or two spring forces having different k values. In yet other embodiments, multiple sets of parameters might be stored and the HPU can select the proper parameter set to use for a particular condition force.
• The parameter values in register[0096]202 are accessible to thehaptic processing unit204, which uses the parameters to weight determinations of condition force values which are proportional to the desired output actuator force. The haptic processing unit is preferably a circuit implemented on the haptic accelerator chip (FPGA, ASIC, etc.) Thehaptic processing unit204 uses on-board force algorithms to compute output condition forces, as explained above with reference to FIG. 5. In alternate embodiments, other condition forces such as friction and texture can be provided by the haptic processing unit using similar parameters and on-board algorithms. The method by which thehaptic processing unit204 operates is described in greater detail with respect to FIG. 13.
• The demultiplexer[0097]200, in some embodiments, also separates out force values frommicroprocessor54 that represent force effects and sends the force effect values tohaptic processing unit204 online211. The force effects can be summed with force conditions determined by the HPU, as detailed below. Alternatively,microprocessor54 can send the force effect values directly to an actuator or to a different circuit for the summation of conditions and effects, or themicroprocessor54 can do the summation itself.
• Some actuator amplifiers or control circuitry require a pulse-width modulated (PWM) signal. To control an actuator amplifier that requires a PWM signal, the haptic accelerator can optionally include on-board PWM capability in the form of[0098]PWM block206. Block206 can receive a signal represented as a binary number and convert it to at least two pulse streams per actuator and 2 to 4 control lines for H-bridge electronics (to drive motor in both directions) as is well known. The “on” time of the pulse stream can be proportional to the desired force (or velocity) of the actuator, as is well known to those skilled in the art.
• FIG. 13 is a flow diagram of a process whereby[0099]haptic processing unit204 of FIG. 12 determines condition forces. Circuits to implement the described mathematical operations are well known to those skilled in the art. Thehaptic processing unit204 receivesposition data210 from thequadrature module122 shown in FIG. 12. The position data is used to calculate stiffness forces or “restoring” forces which are forces that are proportional to an offset distance from an origin position of the user manipulatable object. Such forces are typically determined using the relationship F=kx, as described above. Thus, in step212, the haptic processing unit retrieves k parameter values from the parameter storage register202. Instep214, the haptic processor optionally retrieves parameters to further specify the restoring force, such as deadband (db), positive/negative saturation (+sat, −sat), and offset parameters.
• FIG. 14 shows a graph relationship of a stiffness force with reference to position (x) versus force output (F). The stiffness force parameters described in[0100]step214 modify the force condition at different distances from an origin point O. A stiffness force is a linear force vs. displacement relationship. The stiffness force increases in magnitude the further the object is moved from the local origin O, and is applied in a direction opposing the deviation of the user object from the local origin. A stiffness force can be described as a “spring return”, since it feels to the user as if a strong spring resists displacement of the user object away from the local origin O. In the described example, the stiffness force can be modeled using Hooke's Law, where resistance force F is proportional to the displacement or deviation x. X is the deviation along an axis or degree of freedom (−x indicates an opposite direction to +x) and k is a spring constant defining the magnitude of force. In other embodiments, a stiffness force can be modeled with an exponential stiffness or other relationship rather than linear stiffness.
• Also, as shown in FIG. 14, a saturation region[0101]215 can be provided as defined by the parameters +sat and −sat, where the magnitude of force generally remains constant when the user object is moved past the distance specified by the saturation parameters. Positive and/or negative saturation regions can be defined for each degree of freedom. In some embodiments, the saturation force magnitude can be limited to a predetermined percentage of the maximum possible output force in a the selected degree of freedom, so that effect (or “overlay”) forces can be overlaid on top of the restoring force sensation or other condition. In other embodiments, impulse shaping can perform this limiting function, as described in co-pending application Ser. No. 08/747,841, filed Nov. 13, 1996 by Rosenberg et al. and incorporated by reference herein.
• A[0102]deadband region216 can also be provided as defined by the parameter db, which defines a deadband distance. The deadband is a region centered about the origin O in which forces are zero. The deadband facilitates movement of the usermanipulatable object66 about a center position without feeling the restrictive restoring force. The deadband can be offset from the origin O using the offset parameter, which specifies a positive or negative offset distance.
• The described parameters may or may not be used, or may be used only partially, such as in a single direction of a degree of freedom. Referring back to FIG. 13, the[0103]processing unit204 determines the restoring condition force using the retrieved parameters at a summingnode228, and sums the result with other forces as described below.
• The[0104]haptic processing unit204 also receives the count(i) value from thelatch132 of themotion processing module124 to determine a damping condition and other velocity-related conditions. Instep216, the haptic processing unit reciprocates the count(i) value to obtain a current velocity of the user manipulatable object. It should be noted that the HPU may instead obtain a one-count older velocity value by reciprocating the count (i-1) value instead of the count (i) value, and use the older velocity value in the damping condition determination. Instep218, the HPU retrieves damping parameters −b and +b from the parameter storage register202 in order to determine a damping condition force. The damping parameters are used similarly to the k parameters described above, but in a F=bv or similar relationship. Instep220, the haptic processing unit retrieves other applicable parameters to determine the damping force, such as deadband and saturation parameters. These parameters can modify the damping force similarly to the stiffness force shown in FIG. 14. Typically, an offset parameter is not used for a damping force for stability reasons.
• The damping condition force is then determined based on the velocity of the user manipulatable object and the damping parameters at a summing[0105]node228, and the resulting damping force is summed with other forces as described below.
• The[0106]haptic processing unit204 also receives the count (i-1) value fromlatch134 of themodule124 to determine, in conjunction with the count(i) value, an intertia condition and/or other acceleration-related force. Instep222, the haptic processing unit performs a calculation to determine acceleration using count(i) and count (i-1), as described above. Instep224, the HPU retrieves a mass parameter m from the parameter storage register in order to determine an inertia force. Other types of parameters that can be used in acceleration-related forces can also be retrieved. In step226, other characterizing types of parameters may be retrieved, such as deadband and saturation parameters as described above. An inertia condition force or other type of force is then determined based on the acceleration of theuser object66 and retrieved parameters and is summed with other forces as described below.
• Summing[0107]node228 performs a summation of all the condition forces determined in the above steps byhaptic processing unit204. For example, both a stiffness force and a damping force might be desired condition forces that the application programmer desires to be output simultaneously to the user. Thehaptic processing unit204 would determine the stiffness force and the damping force values separately, then sum them atnode228. The resulting summed force value is then sent out to the actuators or actuator control circuitry.
• Optionally, time-varying force values[0108]230 for implementing force effects or overlays (or other types of force values) can be routed to thehaptic processing unit204 online211 shown in FIG. 12. The local microprocessor54 (or host32) preferably determines the force effects. The effects can be input to the summingnode228 and can be summed with the condition force values determined by the haptic processing unit, and the total summed force values are then sent to theactuators64. This allows theactuators64 to be controlled by thehaptic accelerator60 without further involvement from a microcontroller ormicroprocessor54. In an alternative embodiment, themicroprocessor54 or other controller can send effect forces separately to the actuators simultaneously with the haptic accelerator sending condition force values to the actuators.
• Summing[0109]node228 is shown implemented within thehaptic accelerator60, but the summing function can alternatively be performed bymicroprocessor54 or by a separate summing circuit. A separate summing circuit can be implemented as, for example, an operational amplifier in a well-known summing configuration (for an analog embodiment). If themicroprocessor54 performs the summing, the haptic processing unit would send any computed condition forces to the microprocessor, and the microprocessor would sum those conditions with any computed effect forces and output the result to the actuators. One advantage of performing the summing on the microprocessor is that the microprocessor can handle complicated situations in which some “intelligence” is required. For example, if the magnitude sent to the actuators must be limited to a value of 100, and five forces ofmagnitude30 must be summed, then some forces might take precedence over others, some forces might be limited more than others, or other actions might be necessary to limit the total force magnitude yet retain a high-fidelity force sensation for the user. Themicroprocessor54 is often better suited to handle such complications thanhaptic processor60. However, summing performed by the haptic accelerator is typically faster and offloads computational burden from the microprocessor.
• The above haptic accelerator embodiments assume that a digital sensor such as an optical encoder is used for[0110]sensors62. However, all of the above concepts can be used with analog sensors such as potentiometers. In the case of potentiometers, an analog to digital converter (ADC) can be coupled to the analog output of the potentiometers and the resulting digital bits can be processed by thehaptic accelerator60. For example, the least significant bits from the ADC output can be used as the pulse that triggers the timers or counters of thequadrature decode counter122 andmotion processing module124. The two least significant bits can be used to obtain the direction of the sensor and user manipulatable object. These components would replace the A and B encoder channels and related components.
• Although the[0111]haptic accelerator60 may be implemented as a stand alone chip, it may also be implemented on the same piece of silicon (or other substrate) as thelocal microprocessor54. A custom ASIC can be provided with amicroprocessor54 core that runs in parallel with the discrete logic for thehaptic accelerator60. The advantage to having a single chip is that the same functionality can be produced at a significantly lower cost in volume for the mass consumer market.
• FIG. 15 is a schematic diagram of an alternate circuit embodiment[0112]250 ofhaptic accelerator60. In this embodiment, an analog circuit is used to determine velocity of the usermanipulatable object66. Acceleration of the user manipulatable object can also be determined utilizing a similar analog circuit250.
• Circuit[0113]250 includes analog position sensors252, analog differentiator254, and analog to digital converter (ADC)256. Position sensors252 function assensors64 in the interface device, and are shown as analog potentiometers. Other types of analog sensors can also be used. A two-degree-of-freedom circuit is shown, where an x-axis sensor252adetermines position along an x-axis, and a y-axis sensor252bdetermines position along a y-axis.
• Analog differentiator[0114]254 includes two subcircuits, each subcircuit coupled to one of the analog sensors252. The differentiator converts the analog position signal from sensors252 into an analog velocity signal V_out. For example, in the example embodiment shown, the output potentiometer voltage range from 0 to 5 volts. This sensor voltage is input to an operational amplifier260. The output voltage of the op amp is proportional to the resistance value R of resistor R2 and the capacitance value C of capacitor C1, as shown by the relationship V_out=−RC (dV_in/dt). When the inverting input264 to the op amp260 is biased to 2.5 volts, the resulting output is offset, yielding V_out=2.5 v −/+RC (dV_in/dt). The values R and C of the resistor R2 and the capacitor C1 are then chosen to produce a 2.5 volt signal at the maximum expected velocity of usermanipulatable object66. For example, suitable values are R=470 K-ohm and C=0.33 uF, yielding a gain of about 0.15. This would produce an output velocity signal of 1 volt for a full scale voltage change in the potentiometer output in one half of a second (Vout=2.5−0.15*(5/0.5)). The values of resistor R1 and capacitor C2 are chosen as to effectuate a low pass filter, as is well known in the art.
• The output velocity signals from the subcircuits of the differentiator[0115]254 are then provided to aADC256aor256b. ADC's256 convert the velocity signals to digital signals suitable for input tolocal microprocessor54. ADC's256 also convert the analog position signals from potentiometers252 to digital signals and input the digital signals tomicroprocessor54. ADC's256 can be provided as separate components, or can be included withinmicroprocessor54. In alternate embodiments, ADC's256 can be implemented as other equivalent circuits, such as counter circuits or one shots devices, as is well known to those skilled in the art.
• [0116]Local microprocessor54 uses the velocity signals to determine a force dependent on velocity, such as a damping force described above. The position signals are used to determine a stiffness force or other types of forces as described above. The damping force and any other forces are then summed and the total force magnitude is output to optional power electronics (actuator interface)258 and then to theactuators64, which output the force on theuser object66.
• The acceleration of user[0117]manipulatable object66 can also be provided by analog circuit250 so that inertias and other acceleration-related forces may be determined. A second differentiator circuit, substantially similar to differentiators254, can be included to receive the velocity outputs from differentiator254 and differentiate the velocity signals to achieve acceleration signals. The R and C values can also be similar to the values used in differentiator254. The acceleration signal output from such a circuit can be input tomicroprocessor54 similarly to the velocity outputs from differentiators254 so that the microprocessor may determine inertia forces and other acceleration-dependent forces.
• In an alternate embodiment, a second microprocessor can be used in addition to[0118]microprocessor54 to receive the velocity and/or acceleration signals and calculate and output condition forces, leaving the control of effect forces tomicroprocessor54. Preferably, such a second microprocessor would be an inexpensive processor, since a fast, powerful microprocessor is unnecessary for such condition force determination and control.
• In yet another embodiment, the analog circuit[0119]250 can be used in conjunction with functionality of the advancedhaptic accelerator60″. For example, the analog sensors252 and differentiators254 can provide analog positions and velocities (and accelerations) to ADC's256, which convert the analog signals to digital values and input the digital values tohaptic processing unit204. The haptic processing unit uses the values to determine condition forces as described above.
• FIG. 16 is a block diagram of a control system of the present invention for controlling a brushless motor in a force feedback interface device, and which is readily adapted for use with the haptic accelerator of the present invention.[0120]
• [0121]Motor300 is a DC brushless motor which can be used asactuator64 to provide forces to theuser object66 as described above.Motor300, as a brushless motor, includes wire windings wrapped around a housing or stator and magnets positioned within the stator to be used as a rotor that rotates within the stator. Brushless DC motors typically have either two or three windings. As is well known to those skilled in the art, current is induced in the windings to create an electromagnetic field and to cause the magnetic rotor to rotate.
• Using a[0122]brushless motor300 has several advantages over brush type DC motors, especially when applied to force feedback applications as described herein. Conventional brush-type DC motors have friction characteristics due to their brushes that limit performance and fidelity of generated forces. This friction can often be felt by a person using a haptic device; in these cases it would be valuable to eliminate such friction. Brushless motors, in contrast, operate with a much reduced amount of friction. over brush-type motors.
• Since brushless motors lack brushes to control the flow of current in the windings, alternating current must be commutated based upon knowledge of the position of the rotor. A common, simple way to obtain knowledge of the position of the rotor and thus control the brushless motor is by using a Hall effect sensor. The Hall effect sensors sense magnetic fields and can be used to sense the position of the rotor, thereby allowing a controller to induce current in an appropriate wire to drive the rotor. However, Hall effect sensors are crude devices such that only a vague sense of the position of the rotor may be sensed. For example, the space through which the rotor rotates is typically divided into a number of sectors, such as six, and the Hall effect sensor determines in which sector that a particular reference point on the rotor is current located. However, the crudeness of this sensing technique typically causes a “torque ripple” in which the torque output of the motor varies.[0123]
• Due to the torque ripple caused by crude control using Hall effect sensors, brushless DC motors are not typically used in haptic or force feedback applications. However, the present invention provides precise rotor position sensing by using resolvers or optical encoders. Precise knowledge of the rotor position allows precise sinusoidal commutation of the current to the windings to be implemented, resulting in a very smooth torque output of the brushless motor. However, sinusoidal commutation has only traditionally been used in industries completely unrelated to force feedback interface devices for a user, such as aerospace industries, radar devices, research, etc. The sinusoidal commutation of brushless motors as in the present invention is applied to force feedback interface systems, where the smooth torque output is crucial to the performance of an interface device.[0124]
• Sinusoidal commutation of a brushless motor can be implemented using well-known circuits. For example, a brushless servo motor control chipset MC1231A is offered by Performance Motion Devices for providing sinusoidal commutation to a brushless motor. Other types of control circuits can also be used.[0125]
• A[0126]brushless processing unit310 is shown in FIG. 16. The processing unit can include a control circuit for sinusoidal commutation, such as the PMD chipset described above. In addition, the digital integrated circuit technology andhaptic accelerator60 described herein can also be applied to or provided with sinusoidal brushless motor commutation for haptic feedback. For example, when controlling a three-phase brushless motor300, the output stage described for the haptic accelerator can be tripled, either using digital output or pulse-width modulation (PWM). For example, a PWM block can be provided for each coil, so that three PWM blocks are used for each motor. Three H-bridges, 3 digital lines, and three pulse streams can be provided for each brushless motor.
• Digital force commands[0127]312 can be accepted bybrushless processing unit310 from thehost computer32 ormicroprocessor54 instead of using a haptic processing unit (or in addition to using the HPU). The brushless processing unit (BPU)310 is provided to determine sinusoidal waveforms for the different motor windings. In the preferred implementation, the sinusoidal waveform determination is performed using one or more lookup tables314, which can be stored in memory on board the chip with the brushless processing unit, or on another chip local to theinterface device34. For example, a position of the rotor is provided to the BPU from command312, and the BPU retrieves the entries in the look up table corresponding to the received position. The entries can be a number of values indicating the proportion of current to be output to the particular coils. Thus, for three-phase motor, three percentage values can be stored. Alternatively, the sinusoidal waveform can be generated by direct calculation if sufficient processing power exists on the haptic accelerator.
• The sinusoidal commutation of haptic system motors of the present invention, combined with the haptic accelerator controller of the present invention, is important for the performance improvement it can bring to haptic devices, as well as for the cost savings. Substantial savings may result from placing the brushless motor control electronics on the[0128]haptic accelerator60. Substantial savings may also result because the application of haptic feedback is fundamentally different from typical brushless motor applications. Haptic feedback devices usually command specific forces, rather than motion or velocities that are commanded in typical brushless motor applications. Brushless motors in haptic feedback devices also move at very slow speeds compared to typical brushless applications, so many of the electronics associated with making a general-purpose brushless motor controller can be discarded for substantial cost savings. For example, a force feedback motor may not spin at all if only a resistive force is desired to be applied to oppose the force imparted by the user on the user object. This is known as applying a force “at stall”, since the motor shaft need not be moving to apply the resistive force. This is in contrast to previous brushless motor applications, which typically rotate or spin objects using the motor.
• As with the haptic accelerator described above, the brushless motor controller can be implemented in a programmable logic device (PLD), field-programmable gate array (FPGA), some other programmable logic device, or an application specific integrated circuit (ASIC).[0129]
• While this invention has been described in terms of several preferred embodiments, it is contemplated that alterations, permutations and equivalents thereof will become apparent to those skilled in the art upon a reading of the specification and study of the drawings. For example, many different types of forces and combinations of forces can be applied to the user object depending on the particular effect or condition desired. Also, many types of host application programs and force feedback interface devices can make use of the haptic accelerator functionality disclosed herein. Also, the haptic accelerator can be implemented in a wide variety of hardware forms. Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to limit the present invention. It is therefore intended that the following appended claims include all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.[0130]

Claims (56)

What is claimed is:

1. A control system for a force feedback device used in providing force sensations to a user interfacing with an application program and with visual images displayed by a display device in accordance with said application program and in accordance with manipulations of said force feedback device by said user, the control system comprising:

a force feedback processor for determining output force commands for commanding forces to be applied on a user manipulatable object grasped by a user, said forces being applied by at least one actuator coupled to said force feedback processor and to said user manipulatable object; and

a haptic accelerator coupled to at least one sensor of said force feedback interface device and separate from said force feedback processor, said haptic accelerator receiving raw sensor data from said at least one sensor and providing processed data from said raw sensor data, said haptic accelerator including logic components for fast processing of said raw sensor data into said processed data, said processed data including position data representing a current position of said user object in at least one degree of freedom and velocity data representing a current velocity of said user object in at least one degree of freedom, said processed data being sent to said force feedback processor to be used in said determination of output forces on said user manipulatable object.

2. A control system as recited in

claim 1

wherein said processed data includes acceleration data representing a current acceleration of said user object in at least one degree of freedom.

3. A control system as recited in

claim 1

wherein said sensor is a digital optical encoder providing two raw sensor signals, and wherein said haptic accelerator determines a position of said user object and a direction of said user object in said degree of freedom using said two raw sensor signals.

4. A control system as recited in

claim 3

wherein said haptic accelerator includes a quadrature module for determining said position data using said two raw sensor signals, said position data describing a position of said user object.

5. A control system as recited in

claim 4

wherein said haptic accelerator includes a motion processing module having a counter for counting a time interval between raw signals from said digital optical encoder such that said haptic accelerator may provide said velocity of said user manipulatable object.

6. A control system as recited in

claim 4

wherein said haptic accelerator includes a motion processing module having a counter for counting a time interval between raw signals from said digital optical encoder such that said haptic accelerator may provide an acceleration of said user manipulatable object.

7. A control system as recited in

claim 6

wherein said haptic accelerator includes a plurality of latches for storing said time interval and a previous time interval such that said haptic accelerator may provide said acceleration of said user manipulatable object.

8. A control system as recited in

claim 7

wherein said haptic accelerator includes fault prevention logic for detecting errors and invalid signals from said sensor.

9. A control system as recited in

claim 8

wherein said haptic accelerator includes a filter for rejecting spurious raw sensor signals.

10. A control system as recited in

claim 1

wherein said application program is executed by a host computer system coupled to said force feedback interface device, and wherein said force feedback processor is a device microprocessor separate from said host computer system and local to said force feedback interface device.

11. A control system as recited in

claim 1

wherein said application program is executed by a host computer system coupled to said force feedback interface device, and wherein said force feedback processor is a microprocessor included in said host computer system.

12. A control system as recited in

claim 1

wherein said device microprocessor determines time-varying effect forces, and wherein haptic accelerator includes a haptic processing unit for determining condition forces, said condition forces being output from said haptic processing unit to said actuator.

13. A control system as recited in

claim 12

wherein said haptic accelerator includes a parameter storage register for storing parameters received from said device microprocessor, said parameters modifying said condition forces determined by said haptic processing unit.

14. A control system as recited in

claim 13

wherein said parameters include at least one of a spring constant, a damping constant, and a simulated mass constant.

15. A control system as recited in

claim 13

wherein said haptic accelerator includes a quadrature module for determining said position data from said raw sensor signals, and wherein said haptic accelerator further includes a multiplexer for multiplexing said position data with said velocity data.

16. A control system as recited in

claim 1

wherein said user manipulatable object is one of a mouse and a joystick.

17. A control system as recited in

claim 16

wherein said haptic accelerator is provided on a portion of silicon and said force feedback processor is provided on said portion of silicon.

18. A force feedback interface device for use with a host computer displaying a graphical simulation on a display device, said host computer displaying and updating said graphical simulation in response to user manipulation of said interface device and commanding force feedback sensations in response to said user manipulation and in coordination with events within said graphical simulation, the interface device comprising:

a user manipulatable object graspable by said user and movable in a degree of freedom;

an actuator for outputting a force on said user manipulatable object;

a sensor for outputting a raw sensor signal indicative of a position of said user manipulatable object in said degree of freedom;

a device microprocessor separate from said host computer and coupled to said host computer and to said actuator, said device microprocessor receiving high-level host commands from said host computer and determining forces in response to said high-level commands, said microprocessor causing said determined forces to be output by said actuator; and

a haptic accelerator separate from said device microprocessor that receives said raw sensor signals and outputs processed signals derived from said raw sensor signals, said processed signals being sent to and used, at least in part, by said device microprocessor for determining said forces.

19. A force feedback interface device as recited in

claim 18

wherein said processed signals provided by said haptic accelerator include position signals indicating a position of said user manipulatable object in said degree of freedom and at least one of velocity signals

20. A force feedback interface device as recited in

claim 19

wherein said processed signals provided by said haptic accelerator include acceleration signals indicating an acceleration of said user manipulatable object in said degree of freedom.

21. A force feedback interface device as recited in

claim 19

wherein said sensor is a digital optical encoder providing two raw sensor signals, and wherein said haptic accelerator determines a position of said user object and a direction of said user object in said degree of freedom using said two raw sensor signals.

22. A force feedback interface device as recited in

claim 18

wherein said haptic accelerator includes a quadrature module for determining said position signals using said two raw sensor signals, said position signals describing a position of said user object.

23. A force feedback interface device as recited in

claim 22

wherein said haptic accelerator includes a motion processing module having a counter for counting a time interval between raw signals from said digital optical encoder such that said haptic accelerator may provide said velocity signals.

24. A force feedback interface device as recited in

claim 23

wherein said motion processing module includes a plurality of latches for storing said time interval and a previous time interval such that said haptic accelerator may provide acceleration signals.

25. A force feedback interface device as recited in

claim 23

wherein said device microprocessor determines time-varying effect forces, and wherein haptic accelerator includes a haptic processing unit for determining condition forces, said condition forces being output from said haptic processing unit to said actuator.

26. A force feedback interface device as recited in

claim 25

wherein said condition forces include a restoring spring force, a damping force, and an inertia force.

27. A force feedback interface device as recited in

claim 26

wherein said effect forces include a vibration and a force jolt.

28. A force feedback interface device as recited in

claim 27

wherein said haptic accelerator includes a parameter storage register for storing parameters received from said device microprocessor, said parameters modifying said condition forces determined by said haptic processing unit.

29. A force feedback interface device as recited in

claim 28

wherein said parameters may include a spring constant, a damping constant, and a simulated mass constant.

30. A force feedback interface device as recited in

claim 25

wherein said haptic accelerator includes fault prevention logic for detecting errors and invalid signals from said sensor.

31. A force feedback interface device as recited in

claim 28

wherein said haptic accelerator includes a filter for rejecting spurious raw sensor signals.

32. A force feedback interface device as recited in

claim 28

wherein said haptic accelerator further includes a multiplexer for multiplexing said position signals with said velocity and acceleration signals.

33. A force feedback interface device as recited in

claim 18

wherein said actuator includes a brushless DC motor, wherein said microprocessor controls said brushless DC motor using sinusoidal commutation.

34. A force feedback interface device as recited in

claim 18

wherein said actuator includes a brushless DC motor, wherein said haptic accelerator controls said brushless DC motor using sinusoidal commutation.

35. A force feedback interface device as recited in

claim 25

wherein said haptic processing unit includes a summing node for summing different condition forces determined substantially simultaneously by said haptic processing unit and outputting said summed condition force to said actuator.

36. A force feedback interface device as recited in

claim 25

wherein said device microprocessor outputs said effect forces to said haptic processing unit, and wherein said haptic processing unit includes a summing node for summing said effect forces determined by said microprocessor with said condition forces determined by said haptic processing unit and outputting said summed forces to said actuator.

37. A force feedback interface device as recited in

claim 25

wherein said user manipulatable object is one of a mouse and a joystick.

38. A haptic accelerator used in a force feedback interface device coupled to a host computer system, said haptic accelerator being separate from a force feedback processor and offloading computational burden from said force feedback processor, said haptic accelerator comprising:

a quadrature module that receives raw sensor signals from a sensor, said quadrature module utilizing a counter to provide position signals from said raw sensor signals, said position signals indicating a position of said user manipulatable object in a degree of freedom, wherein said position signals are provided to a force feedback processor to be used in a determination of forces by said force feedback processor; and

a motion processing module that receives said raw sensor signals from said sensor, said motion processing module utilizing a counter to provide velocity signals, said velocity signals being provided to said force feedback processor to be used in a determination of forces by said force feedback processor.

39. A haptic accelerator as recited in

claim 38

further comprising a filter coupled to said sensor, said filter rejecting spurious raw sensor signals from said sensor and providing filtered raw sensor signals to said quadrature module and to said processing module.

40. A haptic accelerator as recited in

claim 38

further comprising a haptic processing unit coupled to said quadrature module and said motion processing module, said haptic processing unit receiving said position signals and said velocity and acceleration signals and determining force values using said signals, said force values being output to an actuator of said force feedback interface device to cause said actuator to apply forces to said user manipulatable object.

41. A haptic accelerator as recited in

claim 40

wherein said force values are condition force values for causing said actuator to output condition forces on said user manipulatable object, said condition forces being dependent on a position, velocity, or an acceleration of said user manipulatable object.

42. A haptic accelerator as recited in

claim 40

further comprising a parameter storage register coupled to said haptic processing unit and to said force feedback processor, said parameter storage register being operative to receive parameters from said force feedback processor and allow said haptic processing unit to retrieve said parameters.

43. A haptic accelerator as recited in

claim 38

wherein said motion processing module includes latches for providing acceleration signals to be used by said force feedback processor in a determination of acceleration-dependent forces.

44. A haptic accelerator as recited in

claim 40

further comprising a pulse width modulation circuit operative to receive said force values from said haptic processing unit and provide said force values to said actuator in pulse width modulated form.

45. A method for providing fast computation of forces for a force feedback interface device, the method comprising:

receiving raw sensor signals from a sensor, said raw sensor signals being provided in response to motion of a user manipulatable object in a degree of freedom;

determining a position, a velocity, and an acceleration of said user manipulatable object using said raw sensor signals, said determining being implemented by a haptic accelerator;

determining force values describing forces to be applied to said user manipulatable object, said force values being determined based on at least one of said position, said velocity, and said acceleration, said force values being determined by a force feedback microprocessor separate from said haptic accelerator; and

outputting said force values to said actuator, said actuator outputting forces on said user manipulable object in response to and based on said force values.

46. A method as recited in

claim 45

wherein said force values are effect force values, and further comprising determining condition force values using said haptic accelerator, said condition force values being based on at least one of said position, said velocity, and said acceleration.

47. A method as recited in

claim 46

wherein condition force values based on said position are determined simultaneously with condition force values based on said velocity and said acceleration, and further comprising summing force values based on said position with force values based on said velocity and said acceleration.

48. A method as recited in

claim 47

further comprising summing said condition force values with said effect force values provided by said force feedback microprocessor and outputting a resultant summed force to said actuator.

49. A method for providing smooth force sensations to a user manipulatable object used in a force feedback interface device, said user manipulatable object being grasped by a user, said force feedback interface device being coupled to a host computer executing a program with which said user interacts by manipulating said user manipulatable object, said method comprising:

receiving sensor signals from a sensor included in said force feedback interface device;

determining force values to be output to a brushless motor included in said force feedback interface device, wherein said sensor signals are used, at least in part, in said determination of force values;

outputting force signals equivalent to said force values to said brushless motor using sinusoidal commutation such that said force values are converted into forces applied to said user manipulatable object by said brushless motor, said forces being coordinated with events displayed within said program by said host computer coupled to said force feedback interface device.

50. A method as recited in

claim 49

wherein said brushless motor is a brushless DC motor.

51. A method as recited in

claim 49

wherein said brushless motor includes a rotor having magnets, and wherein said forces are output to said user manipulatable object by rotating said rotor at stall to provide a resistive force.

52. A method as recited in

claim 51

wherein said program is a graphical simulation.

53. A method as recited in

claim 51

wherein said sensor signals include information representing a position of said user manipulatable object in at least one degree of freedom.

54. A force feedback interface device for use with a host computer displaying a graphical simulation on a display device, said host computer displaying and updating said graphical simulation in response to user manipulation of said interface device and commanding force feedback sensations in response to said user manipulation and in coordination with events within said graphical simulation, the interface device comprising:

a user manipulatable object graspable by said user and movable in a degree of freedom;

an actuator for outputting a force on said user manipulatable object;

an analog position sensor for outputting an analog sensor signal representing an analog position of said user manipulatable object in said degree of freedom;

an analog circuit separate from said host computer and operative to receive said raw analog sensor signals, to compute an analog velocity of said user manipulatable object from said analog position, and to output processed signals derived from said raw sensor signals, said processed signals including representations of said computed velocity; and

a device microprocessor separate from said host computer and said analog circuit, said microprocessor coupled to said host computer and to said actuator, said device microprocessor receiving high-level host commands from said host computer and computing forces in response to said high-level commands, said microprocessor outputting said forces to said actuator, said device microprocessor also receiving said analog sensor signal from said analog position sensor and said processed signals from said analog circuit and using said analog position and said analog velocity, at least in part, to determine said forces.

55. A force feedback interface device as recited in

claim 54

further comprising an analog to digital converter that receives said analog position from said analog position sensor and receives said analog velocity from said analog circuit and converts said position and said velocity into a digital form for use by said microprocessor.

56. A force feedback interface device for use with a host computer displaying a graphical simulation on a display device, said host computer displaying and updating said graphical simulation in response to user manipulation of said interface device and commanding force feedback sensations in response to said user manipulation and in coordination with events within said graphical simulation, the interface device comprising:

object means graspable by said user and movable in a degree of freedom;

force means for outputting a force on said object means;

sensing means for outputting a raw sensor signal indicative of a position of said object means in said degree of freedom;

microprocessor means separate from said host computer and coupled to said host computer and to said force means, said microprocessor means receiving high-level host commands from said host computer and determining forces in response to said high-level commands, said microprocessor means causing said determined forces to be output by said force means; and

means separate from said microprocessor means for receiving said raw sensor signals and outputting processed signals derived from said raw sensor signals, said processed signals being sent to and used, at least in part, by said microprocessor means for determining said forces.

Images