MOTION SENSOR
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to motion sensors and, more particularly, to a motion sensor disposed in close proximity to a physical body and which produces an asymmetrical output signal in response to symmetrical movement of the body.
2. Description of the Relevant Art
Many input devices are used to input data to machines. For example, keyboards, joysticks, mice, track balls, and light pens often are used to input data into a computer, usually so that operations may be selected without the necessity of keying in multiple commands on a keyboard. However, mastering the ope'ra- tion of such input devices is often difficult because the hand movements required to operate the device do not correspond to the visual feedback presented by the display screen of the computer.
One method and apparatus for overcoming the foregoing disadvantage is to use a data processing apparatus for converting gestures and positions of the hand of a physical operator into a virtual operator, such as an animated version of the hand, for manipulating virtual objects defined by a computer. In order to accomplish the translation from the gestures and movements of the physical operator into corresponding gestures and movements of a virtual operator, flex sensors are disposed in close proximity
SUBSTITUTE SHEET to the physical operator for producing an output signal in response to movement of the operator's body. One example of such a flex sensor is disclosed in U.S. Patent No. 4,542,291, issued to Thomas G. Zimmerman and assigned to the present assignee. In the embodiments disclosed, the sensors are placed on a glove for detecting the movements and gestures of the hand of the operator. Each sensor comprises a flexible tube having two ends, a reflective interior wall within the flexible tube, and a light source placed within one end of the flexible tube. A photosensitive detector placed within the other end of the flexible tube measures the amount of direct and reflected light received from the light source as the tube is bent. Another input device used for a somewhat dif¬ ferent purpose is described in U.S. Patent No. 4,414,537, issued November 8, 1983, to G. Grimes, entitled "Digital Data Entry Glove Interface." The Grimes patent discloses a glove with sensors for detecting the flexing of finger joints, sensors for detecting contact between various portions of the hand, and sensors for detecting the orientation of the hand. The Grimes device is used for translating discrete hand positions representing alpha¬ numeric characters into corresponding electrical signals. Although the foregoing devices visually oper¬ ate satisfactorily, the sensors used may give erroneous information in certain circumstances. For example, if sensors are positioned to detect bending at a junction of two members which pivot symmetrically with respect to an axis, but only movement on one side of the axis provides usable data, the computer may be unable to determine if the output produced by the sensors corre¬ spond to movement in the desired direction. That is, the sensors provide the same signal when the two membersare _n symmetrically opposite positions so that the computer may receive and process the data as if the data represented movement in the relevant direction when, in fact, that is not the case. Consequently, the computer is unable to translate the movements of the operator into the proper form, or the translation is performed incorrectly and the results are meaningless.
SUMMARY OF THE INVENTION The present invention is directed to a motion sensor for measuring movement of a physical body which moves symmetrically with respect to a boundary. The motion sensor monitors movement of the body and pro¬ vides an asymmetrical output signal in response to the symmetrical movement of the body. In one embodiment of the present invention, a plurality of motion sensors are placed over the joints of a hand and provide an asymmetrical output signal which indicates the direc¬ tion of movement of the hand. To avoid providing in¬ correct data when a part of the hand, e.g. , a finger, is hyperextended, the motion sensors comprise an opti¬ cal fiber disposed between a light source and a light sensor. An upper portion of the optical fiber is treated, e.g., by abrasion or notching, so that trans¬ mission loss of light being communicated through the optical fiber is increased only when the fiber bends in one direction. In another embodiment of the present inven¬ tion, a flexible tube is disposed in close proximity to a finger joint and bends in response to bending of the finger. A light source and light sensor are provided on opposite ends of the tube for continuously indicat- ing the extent of bending of the tube. A wedge is dis¬ posed between the tube and the finger for setting the tube in a prescribed orientation, e____g_._. straight, when the finger is in a prescribed position, e.g. , hyper¬ extended. In this manner, the symmetry of the output signal which ordinarily would result from bending of the tube on opposite sides of the axis of movement is avoided. In a further embodiment of the invention, a light source and light sensor are positioned in close proximity to a finger joint so that bending of the fin¬ ger toward the palm causes the source and sensor to move away from each other. Bending the finger in the other direction causes the source and sensor to move toward each other. A guide faces the light emitted by the source toward the sensor so that the degree of bending may be determined by the amount of light re- ceived by the sensor.
BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is an overall perspective view of a data processing system according to the present inven- tion wherein movements of a part of a body of a physi¬ cal operator are converted into a virtual operator for manipulating a virtual object represented in the data processing system.
Fig. 2 is a view of a finger bent in a normal direction of movement.
Fig. 3 is a view of a finger which illustrates the finger in a hyperextended position.
Fig. 4a is a back view of an instrumented glove assembly according to the present invention. Fig. 4b is a palm-side view .of the instru¬ mented glove assembly of Fig. 4a.
Fig. 4c is a side view of the instrumented glove assembly of Fig. 4a.
Fig. 5 is a sectional detailed view of one finger of the instrumented glove assembly of Figs. 4a, 4b, and 4c with the finger having an extended orienta¬ tion.
Fig. 6 is a sectional detailed view of one finger of the instrumented grove assembly of Figs. 4a, 4b, and 4c with the finger having a bent orientation. Figs. 7a and 7b are straight and bent views, respectively, of an optical fiber having an abraded upper surface.
Figs. 8a and 8b are straight and bent views, respectively, of an optical fiber having a notched up¬ per surface.
Figs. 9a and 9b are straight and bent views, respectively, of a layered multimode step index optical fiber having a portion of the upper layer removed. Fig. 10 is a view of an alternative embodi¬ ment of the invention wherein a retroreflector is fit¬ ted on the end of an optical fiber.
Fig 11 is a graph showing light intensity as a function of movement of the finger of Figs. 5 and 6. Fig. 12a is a back view of an alternative embodiment of an instrumented glove assembly according to the present invention.
Fig. 12b is a palm-side view of the instru¬ mented glove assembly of Fig. 11. Fig. 12c is a side view of the instrumented glove assembly of Fig. 11.
Fig. 13 is a sectional detailed view of an alternative embodiment of the instrumented glove assem¬ bly disposed on a finger in a hyperextended orienta- tion.
Fig. 14 is a sectional detailed view of the instrumented glove assembly of Fig. 13 with the finger having a bent orientation.
Fig. 15 is a sectional detailed view of an alternative embodiment of an instrumented glove assem¬ bly disposed on a finger in a hyperextended orienta¬ tion.
Fig. 16 is a sectional detailed view of the instrumented glove assembly of Fig. 15 with the finger having a bent orientation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Fig. 1 is an overall perspective view of a data processing system 4 wherein movements of a part of the body 10 of a physical operator 12 are converted into a virtual operator 16 for manipulating a virtual object 18 represented on a display screen of data pro¬ cessing system 4. The movements of physical operator 12 preferably are converted into virtual operator 16 through instrumentation disposed in close proximity to a part of the body 10 of physical operator 12, prefera¬ bly on the clothing of physical operator 12. For pur¬ poses of illustration, the movements of a hand 22 of physical operator 12 are converted into virtual opera¬ tor 16 through a glove 24. It is to be understood, however, that the present invention may be employed along any part of the body of physical operator 12 which may be used for entering data into data processing system 4.
Figs. 2 and 3 are diagrams illustrating a part of the body of physical operator 12, e.g., a fin¬ ger 30, the movement of which is useful for entering data into data processing system 4. As with many parts of the body, finger 30 is capable of moving symmetri¬ cally with respect to a boundary line X. The movement o the lower side of boundary X illustrated in Fig. 2 may be termed the "normal" field of movement, since that is the direction of movement which is normally employed to manipulate an object. The movement on the other side of boundary X, depicted in Fig. 3, may be termed the "null" field of movement, the measurement of which has little or no value in some applications. If a sensor disposed on finger 30 measures only the amount of bend of finger 30 and not its direction, then there is no way of determining whether the data provided by
SUBSTΓΓOTΈ SHEET the sensor represents movement in the normal or null field, and hence whether the data should be processed or disgarded as irrelevant.
Fig.s 4a, 4b, and 4c illustrate one embodi- ment of a glove assembly 24 used to enter data into data processing system 16. Glove assembly 24 contains several sensors 34 disposed next to the finger joints of the hand for responding to gestures of the hand. The software portion of data processing system 4 receives gesture-indicating data from sensors 34 and enters com¬ mands into data processing 4 according to the gestures recognized. These commands relate to the conversion of movements of the hand 22 of physical operator 12 into virtual operator 16. Figs. 5 and 6 illustrate one embodiment of sensor 34 for detecting movement of finger 30 in a pre¬ scribed direction. As shown therein, sensor 34 comprises a light source 38, a source of electromagnetic radiation, preferably a sensor for electromagnetic^ radiation, pre- ferably a light sensor 42, and an optical fiber 46 for communicating the light emitted by source 38 to sensor 42. To increase the transmission loss of light being communicated through optical fiber 46 when the fiber is bent, the upper surface 50 thereof may be treated as shown in Figs. 7a, 8a, and 9a. As shown in Fig. 7a, upper surface 50 has abrasions 54 disposed therein so that, when the fiber is bent as shown in Fig. 7b, a significant amount of light impinging upon abrasions 54 will be allowed to pass through upper surface 50, and hence never reach sensor 42. As shown in Fig. 8a, an¬ other technique for increasing the transmission loss through optical fiber 46 is to form upper surface 50 having a plurality of notches 58 so that, when the fiber is bent as shown in Fig. 8b, the surfaces of notches 58 substantially increase the angle of incidence of light rays impinging against upper surface 50 above the crit¬ ical angle at which the light would be reflected, and hence a significant amount of light is transmitted through upper surface 50 and never reaches sensor 42. A similar effect may result by appropriate treatment of a layered multiple step index optical fiber 46 having an inner core 62 and an outer core 64 as shown in Fig. 9a. Outer core 64 preferably has a higher index of reflection than air. For increasing the transmission loss through fiber 46, the outer core 64 is removed on upper surface 50 so that air forms a boundary with core 62. Accordingly, the indices of reflection at the boundary of core 62 are brought substantially closer, and a significant amount of light impinging on the mod¬ ified boundary is allowed to pass through and never reaches sensor 42. In all three embodiments, there will be some transmission loss when the fiber is straight, as a result of light impinging on the treated upper surface. This transmission loss increases when optical fiber 46 is bent concavely downward (i.e. , in the normal field of movement) . On the other hand, the transmission loss decreases when optical fiber 46 is bent concavely upward (i.e. , in the null field of movement) because light reflected by the lower surface of optical fiber 46 is reflected at an angle which avoids contact with the treated portion of upper surface 50. The net result is that the output from each sensor 34 resembles the graph of Fig. 10, and the signal symmetry of known sensors is avoided.
To decrease the amount of wiring required by the system, the embodiment of sensor 34 illustrated in . Fig. 11 may be used. In this embodiment, light source 38 and light sensor 42 may be disposed on one side of optical fiber 46, and optical fiber 46 may have a retroreflector 68 disposed on its other end so that light emitted by light source 38 is reflected by retro- reflector 68 and communicated to sensor 42 back through optical fiber 46. Still further simplicity results by using the embodiment of sensor 34 disclosed in Figs. 12a, 12b, and 12c. As shown therein, optical fiber 46 originates and terminates at a control block 72, which contains the associated light sources 38 and light sen- sors 42 (not shown) . Preferably, optical fiber 46 loops around each finger of hand 22, and the upper surface of optical fiber 46 is treated as hereinbefore described in the vicinity of each joint to be monitored.
Figs. 13 and 14 disclose another embodiment of the present invention particularly well suited for a sensor constructed in accordance with U. S. Patent No. 4,542,291. As shown therein, sensor 34 includes a light source 38 and a light sensor 42 disposed on opposite ends of a flexible tube 76 for providing a signal con- tinuously indicative of the extent of the bending of finger 30. To avoid signal symmetry when the finger is bent in the null field, a wedge 80 is disposed between tube 76 and finger 30 for setting the tube in a pre¬ scribed orientation when finger 30 is in a prescribed position. Preferably, wedge 80 sets tube 76 generally straight when finger 30 is positioned at the limit of movement in the null field as shown in Fig. 13. Soft¬ ware within data processing system 4 then may be drafted to calculate the amount of bend in finger 30 in the normal field of movement.
Figs 15 and 16 illustrate another embodiment of the present invention wherein a light source 38 and a light sensor 42 are positioned on finger 30 so that bending of finger 30 causes source 38 and sensor 42 to move relative to each other. Preferably, the light emitted by source 38 should always face sensor 42 when source 38 and sensor 42 move relative to each other to facilitate measurements. This may be accomplished, for example, by connecting an optical fiber 80 to one of source 38 or sensor 42, preferably source 38, so that a free end 84 of optical fiber 80 faces the other source or sensor, preferably sensor 42. The free end 84 of optical fiber 80 then may be disposed within a guide, preferably a flexible tube 88, so that the light emitted by source 38 will face sensor 42 when source 38 and sensor 42 move relative to each other. Tube 88 prefer- ably is connected to the source or sensor located prox¬ imate to the free end 84 of optical fiber 80 to enhance reliability of the guiding function. When this embodi¬ ment is in operation, light emitted by source 38 will be detected by sensor 42 as it is emitted from the free end 84 of optical fiber 80. If finger 30 bends in the normal field of movement, e.g., downward, then free end 84 of optical fiber 80 moves away from sensor 42, and hence the light detected by sensor 42 decreases- in in¬ tensity. On the other hand, when finger 30 moves in the null field, the free end 84 of optical fiber 80 moves closer to sensor 42 until it touches sensor 42 and the intensity of light received by sensor 42 remains the same. As a result, signal symmetry again is elimi¬ nated. While the above is a complete description of a preferred embodiment of the present invention, various modifications are obvious to those skilled in the art. For example, the upper surface of optical fiber 46 in Figs. 5 and 6 may be treated in any way which increases the transmission loss through the upper portion of the fiber, such as by scraping, index matching through paint or other coating, etching with acid, eccentric scoring, and by deformation of the upper surface through laser, heat, or ultrasonic methods. The embodiment of sensor 34 disclosed in Figs. 15 and 16 may be used by encir¬ cling the sensor around the torso of the body to measure expansion and contraction of the torso as a result of inhalation and exhalation. Furthermore, optical fiber 80 in these embodiments may be eliminated, and light source 38 may be disposed on a track which maintains source 38 facing sensor 42. Consequently, the description should not be used to limit the scope of the invention which is properly described in the claims.