CN101055193A - Noncontact input operation device for in-vehicle apparatus - Google Patents

Abstract

Translated fromChinese

在汽车导航或者汽车音频的车载装置中，为检测手从哪个方向接近操作部，在操作部设置周围多个检测器。此时，决定各检测器的视野和位置，使在检测器组中无死角。若知道车内乘员的位置关系，由检测方向可判别操作者是司机还是乘员。同时，操作部周围配置的多个检测器，也可作为用于司机在驾驶中能够进行的手势的简单的操作的检测器使用。在司机侧的检测器最初检测到手时，判断为司机要做手势，由检测器检测到手的顺序推定进行的手势，对设备发布与手势对应的预先决定的命令，由此，司机不用注视按钮等操作部，就能够进行基于手势的简单操作。另外，通过把各检测器的检测范围做成面状，包围操作部周围，能够有效减小检测器死角，也能够减少检测器数。

In car navigation or car audio in-vehicle devices, in order to detect from which direction a hand approaches the operation unit, a plurality of detectors are provided around the operation unit. At this time, the field of view and position of each detector are determined so that there is no dead space in the detector group. If the positional relationship of the occupants in the vehicle is known, it can be determined whether the operator is the driver or the occupant by the detection direction. At the same time, the plurality of detectors arranged around the operating portion can also be used as detectors for simple operations of gestures that can be performed by the driver while driving. When the driver's side detector detects a hand for the first time, it is judged that the driver is making a gesture, and the gesture is estimated from the order in which the hand was detected by the detector, and a predetermined command corresponding to the gesture is issued to the device, so that the driver does not need to look at the button, etc. The operation unit enables simple operations based on gestures. In addition, by forming the detection range of each detector in a planar shape and surrounding the periphery of the operation part, it is possible to effectively reduce the dead angle of the detector and also reduce the number of detectors.

Description

The noncontact input operating device of car-mounted device

Technical field

The present invention relates to carry out the method and the device thereof of order input to vehicle-mounted devices such as car audio, auto navigations.

Background technology

The input media of vehicle-mounted device such as car audio, auto navigation (input part) has button that is positioned on telepilot or the body or the button class that shows more on the body picture.Because the problem in space is set, the most sizes of these button classes are smaller, number is also few, and the switching by manner of execution and layering, design multiple function, and in the operation of reality, need watch these buttons or picture attentively.But, because the driver watches attentively and the device danger of driving no direct relation, problem is arranged also on rules in driving, so in driving or make it can not carry out push-botton operation or can use and not watch good such gesture or voice command etc. attentively.As identifying operation person's gesture (hand signal), to an example of the technology of equipment input, the example of JP-A-2005-141542 " noncontact input interface unit " is arranged.This is the order of a plurality of detecting devices from reacting according to the motion (gesture) of hand of equipment, and definite gesture of carrying out on the contrary comes into force the order corresponding with it for equipment.Just can import because only before detecting device, make a gesture,, can realize more at an easy rate than image recognition gesture by the use video camera so position, notice that must confirming button than for input often will be shifted to the push-botton operation safety beyond driving.But in order input by the identification gesture, because distribute a gesture for an input, thus be fit to several shirtsleeve operations, and for carrying out more complicated operations, will too much increase the kind or the number of times of gesture, so need be left the button class of carrying out complicated operations.

Summary of the invention

Here, though have co-driver beyond the driver that in car travels, is arranged on the driver's seat also can watch attentively device operate, in addition the high performance by display device, also want to operate such requirement the car driver people in addition that travels.Therefore, seek in car travels, also permit such operation, promptly need only discern simple gesture input, and watch the operation of button or touch pad for the co-driver beyond the driver attentively for the driver.For realizing this point, not only need to discern gesture, need also to judge that present operator is that driver or the co-driver beyond it and respective operations person change and show or the function of method of operating.

In addition, the many operations of general driver than the more familiar display device of co-driver, have the driver also utilize waiting signal of short duration down time, want to carry out the such requirement of operation of display device.The requirement of wishing to be continued by co-driver the operation that can not finish in of short duration down time is arranged in driving again.

For differentiating the operator is whom, can around operating portion a plurality of detecting devices be set, make it possible to detect hand from which direction near operating portion.At this moment, need make detecting device just can not detect can not operating of contacts portion like that is detector set do not have the visual field and the position that the dead angle determines each detecting device like that.Thus, the button of operating operation portion or the hand of switch to confirm by detecting device.Usually, because on the detected direction people that will operate is being arranged at first, so, be driver or co-driver to differentiating the operator then by the detection side if know the position relation of passenger in car.Simultaneously, a plurality of detecting devices of configuration around the operating portion are also as the detecting device use that is used for the shirtsleeve operation of pass through gesture that the driver can carry out in driving.In the initial detection of the detecting device of driver's side occasion in one's hands, be judged as the driver and will do gesture, detect the order of hand by detecting device and infer the gesture of carrying out, for equipment the order that be predetermined corresponding with gesture come into force, the driver does not watch the operating portion of button etc. attentively thus, just can carry out the shirtsleeve operation by gesture.

In addition, planar by the sensing range of each detecting device is made, surround around the operating portion, can reduce the dead angle of detecting device effectively, also can reduce the number of detecting device.

Have again, if replace only differentiating the detecting device that has or not of object, use measures the range sensor of the distance of object, then not only can differentiate the people that the people that will operate is driver's seat or front passenger's seat, and can to differentiate be operation or the gesture of the people on the pillion, even perhaps in the occasion of operating, also can form order to the input corresponding with distance in one's hands by the driver.

Have again, make image display device subsidiary on input operating device have the infrared ray projection function of the object detection device of infrared reflection type by making, be added in the projection infrared ray of going up backlight of image display device, be used in a plurality of infrared receivers that are equipped with around the input operating device and be received in catoptrical structure on the detected object thing, just can just can reduce the dead angle of detecting device by inexpensive method to wider scope projection infrared ray.In addition, be equipped with infrared receiver, so the increase of the degree of freedom of configuration is also very effective for the miniaturization of device because around operating means, need only.

Have again, the driver begins to operate and the occasion that must begin to drive before finishing the purpose operation when car stops, by the operator can be selected is the picture state of preserving in the operation, still make display device have the function that the operator is changed to co-driver, co-driver is operated halfway, and the continuation that follow-up operation can be undertaken waiting by the driver when stopping next time is operated.

Description of drawings

Fig. 1 is the front skeleton diagram according to an embodiment of the input operating device of car-mounted device of the present invention.

Fig. 2 is the side skeleton diagram of the embodiment that puts down in writing of Fig. 1.

Fig. 3 is the inner structure skeleton diagram of the embodiment that puts down in writing of Fig. 1.

Fig. 4 is an example of the signal graph of the gesture input among the embodiment that puts down in writing of Fig. 1.

Fig. 5 is an example of the signal graph of the gesture input among the embodiment that puts down in writing of Fig. 1.

Fig. 6 is an example of the signal graph of the gesture input among the embodiment that puts down in writing of Fig. 1.

Fig. 7 is an example of the signal graph of the gesture input among the embodiment that puts down in writing of Fig. 1.

Fig. 8 is an example of the signal graph of the gesture input among the embodiment that puts down in writing of Fig. 1.

Fig. 9 is the cross section skeleton diagram of an example of the structure of object detection device.

Figure 10 is the cross section skeleton diagram of an example of structure with object detection device of fan-shaped surveyed area.

Figure 11 is side and the top skeleton diagram of another embodiment of the object detection device that uses among the present invention of expression.

Figure 12 is the outboard profile of example of the surveyed area of the expression occasion of using object detection device shown in Figure 11.

Figure 13 is the front skeleton diagram according to another embodiment of the input operating device of car-mounted device of the present invention.

Figure 14 is an example of the signal graph of the gesture input in the embodiment of Figure 13 record.

Figure 15 is an example of the signal graph of the gesture input in the embodiment of Figure 13 record.

Figure 16 is the front skeleton diagram according to another embodiment of the input operating device of car-mounted device of the present invention.

Figure 17 is an example of the signal graph of the gesture input in the embodiment of Figure 16 record.

Figure 18 is an example of the signal graph of the gesture input in the embodiment of Figure 16 record.

Figure 19 is the front skeleton diagram according to another embodiment of the input operating device of car-mounted device of the present invention.

Figure 20 is the lateral section skeleton diagram of the embodiment that puts down in writing of Figure 19.

Figure 21 is the inner structure skeleton diagram of the embodiment that puts down in writing of Figure 19.

Figure 22 is an example of the signal graph of the gesture input in the embodiment of Figure 19 record.

Figure 23 is an example of the signal graph of the gesture input in the embodiment of Figure 19 record.

Figure 24 is an example of the signal graph of the gesture input in the embodiment of Figure 19 record.

Figure 25 A-25D is a skeleton diagram of replacing an embodiment of function according to the operation of car-mounted device of the present invention.

Figure 26 is illustrated in according to the operation of car-mounted device of the present invention to replace in the function from the key diagram of the flow process that begins to operate the end operation picture.

Symbol description

The input operating device of 1 car-mounted device, 2 object detection devices, 2a object detection device A, 2b object detection device B, 2c object detection device C, the 2d infrared ray projector, the 2e infrared receiver, but 2f sensing range, 3 hands, the moving direction of 3a hand, 4 touch plate type LCD, the contact plate operating area that shows on the 4a display, 5 push-button switchs, 6 range sensors, 6a range sensor range finding direction, 7 bearing circle, 8 driver's seat spaces, 9 codriver's seat spaces, the 10 infrared ray projectors, the 10a infrared light-emitting component, 10b projection lens, 10c projection rod-shaped lens, 11 projection infrared rays, 12 reflected infrareies, 13 infrared receivers, 13a infrared receiver component, 13b receive uses lens, 13c receives and uses rod-shaped lens, 14 detected object things, 15 light backlight form devices, 16 comprise ultrared backlight, the detecting device A of 17a infrared receiver, the detecting device B of 17b infrared receiver, the detector C of 17c infrared receiver, the detecting device D of 17d infrared receiver, the upper picture of 18a navigation feature, the second layer picture of 18b navigation feature, 18c operation are preserved and are selected picture, 18d map picture, 19 are used for the touchpad operation button of shutoff operation picture, 20a dead ship condition determination step, the step of the full operation of 20b permission display device for mounting on vehicle, 20c vehicle travelling state determination step, the 20d operation is preserved and is selected picture prompting step, the 20e operation is preserved and is selected the overtime determination step of picture, the selection determination step that the 20f operation is preserved, the operation screen login step during 20g starting next time, 20h operator identification decision step, 20i operation screen prompting step.

Embodiment

Fig. 1 represents that Fig. 2 represents its outboard profile according to the front skeleton diagram of an embodiment of the input operating device of car-mounted device of the present invention, and Fig. 3 represents its inner structure skeleton diagram, and Fig. 4 represents the example of detection signal figure to Fig. 8.In this example,input operating device 1 is the part of auto-navigation system, have with theLCD 4 of touch pad, as the infrared reflection type object detection device A, B, the C (2a that surround push-button switch 5,2b, 2c) and therange sensor 6 of infrared reflection formula or ultrasonic reflections formula.Generally, the display device of auto-navigation system is many installs on the instrument panel between driver'sseat side space 8 and the codriver's seat side space 9, is positioned at the position that can both see, operate from driver's seat and codriver's seat.The operation of system uses the 4a of touchpad operation portion onbutton 5 or theLCD 4 to operate.But, for operating these buttons or touch pad, need watch the demonstration on button or theLCD 4 attentively, be dangerous by the driver in driving.Therefore, the intent of the present invention is, utilize object detection device A, B, C (2a, 2b, 2c) andrange sensor 6, differentiating the operator is driver or the people of codriver's seat side or the people of pillion, be that driver's occasion only can be carried out the operation by simple gesture in car travels, do not accept the input ofbutton 5 ortouch pad 4a, no matter whether the occasion of the people beyond the driver is can both be frombutton 5 ortouch pad 4a input in car travels.Theobject detection device 2a of infrared reflection type, thesensing range 2f of 2b, 2c, as from Fig. 1, Fig. 2 as can be known broadening be fan-shaped, to use the occasion ofhand touch button 5 ortouch pad 4a at the co-driver of driver or codriver's seat, the degree of passing through, be zone, but can adjust according to the physique of the co-driver of driver or codriver's seat or the position at seat from the distance of detecting device about vehicle rear side is upward to the elbow of the co-driver of driver or codriver's seat.In addition, the finding range 6a ofrange sensor 6, longer than object detection device, distance is far away more wide more a little downwards, near the maximum distance as the front seats back, becomes the degree that covers the input operating device front.As shown in Figure 3, become the noncontact input signal from the signal ofobject detection device 2a, 2b, 2c andrange sensor 6 and become thecontact plate 4a that contacts input andbutton 5 input signal and from car give travel signal to the handling part transmission of input operating device, processed, send to the car-mounted device body as appropriate command.Signal is generally exported when detecting the state of removing side brake in travelling.Narrate the operating principle in the present embodiment below.At first, identification about the operator, being action button etc. from the driver's seat side as shown in Figure 1 stretches out one'shand 3 occasion to inputoperating device 1, because detecting device A (2a) has fan-shaped sensing range, so it is common action can not be avoided the detection of detecting device A (2a), detected at first on detecting device A (2a).Therefore, from undetected state whatever, occasion to the detection signal that has detecting device A (2a), can be judged as from the driver's seat side has the detected object thing to enter, that is the entering of driver's hand, with give from vehicle travel signal, in handling part, judge, if then make from the contact input signal ofbutton 5 orcontact plate 4a invalidly under steam, only receive gesture input.If the control by the gesture input is in the auto navigation process, then carry out the basic operation that need not watch picture attentively of the change etc. of the moving of map, switching, picture brightness, if the control of audio frequency, then carry out the volume change, begin to regenerate, stop, F.F., backrush, the basic operation that need not watch picture attentively of skipping song etc.Equally, in the occasion that produces detection signal from undetected state whatever to detecting device B (2b), enter because can be judged as from the detected object thing of codriver's seat side that is the hand that will operate, so even do not make from the input signal ofbutton 5 ortouch pad 4a under steam yet invalid.Having, is the information of the people beyond the driver to vehicle fitting transfer operation person again, shows the picture beyond the picture displayed in travelling usually, also can carry out the demonstration of more complicated actions menu or to the change of the distribution ofbutton 5 functions etc.In addition, from the signal ofrange sensor 6 with the occasion that the outer measured value of the detection distance of detecting device A (2a) takes place, be judged to be the operation of the co-driver of pillion.If, in the occasion that has taken place at first from the detection signal of detector C (2c), perhaps from the signal ofrange sensor 6 with the interior value of the detection distance of detecting device A (2a) in the occasion that has taken place at first, as the input signal that is not common state, for safety, before described blackout, make the contact input by button etc. and utilize the noncontact input of gesture all invalid.

The identification of gesture input is described below by the example of detection signal figure.Can discern at least six kinds of drivers' gesture in the present embodiment with detecting device and range sensor.Fig. 4 is the example by the detection signal of driver's gesture input.Among the figure, the detection signal of detecting device becomes not have to detect and is positioned at following state, just detects the signals of two choosings that are positioned at top state.In addition, the range sensor signal, the occasion that is positioned at bottom represents not have the detected object thing, be positioned at a following side and be illustrated in remote detection, horizontal dotted line above approaching is more represented the detection that distance is short more, horizontal dotted line is represented the shortest mensuration distance, can not carry out range determination than this nearer distance, only detects the detected object thing and exists.In this example, driver's gesture is illustrated near brandish, return the occasion of hand the central authorities of input operating device in the horizontal direction example.The hand that stretches into from the driver's seat side is at first detected by detecting device A, then enters the sensing range of detector C, enters the sensing range of range sensor, is returned.Therefore the detection signal figure is shown in the vertical dotted line of Fig. 4, the detection signal of detecting device A at first takes place, the detection signal of detector C takes place thereupon, then after the range sensor signal takes place, with the reverse order blackout, from the feature of this signal graph, can take place to discern this gesture correspondence order or to the input of car-mounted device.

Fig. 5 is the example by the detection signal of driver's other gesture input.In this example, driver's gesture is illustrated near brandish, return the occasion of hand the codriver's seat side of input operating device in the horizontal direction example.The occasion difference of representing at Fig. 4 of having inserted hand midway is because brandishing hand, so the detection signal of detecting device B takes place in the generation of the detection signal of detecting device A near the codriver's seat side.By this difference, can differentiate the difference of above-mentioned two kinds of gestures.

Fig. 6 is the example by the detection signal of driver's other gesture input.In this example, driver's gesture be illustrated in input operating device about brandish the example of the occasion that hand extracts out near the central authorities upward from the below.Driver's hand was at first detected by detecting device A in the moment of inserting input operating device, because move upward from the below, detect with detector C, after extracting out from the surveyed area of detector C, detect by range sensor, after extracting out, extract out from the surveyed area of detecting device A from the surveyed area of range sensor.For the gesture of expression example shown in Figure 4, can be by not detecting the state difference of detector C and range sensor simultaneously.Driver's gesture from above brandish the occasion of extraction downwards, detection signal that can be by range sensor and detector C is to distinguish with opposite the occurring in sequence of example of Fig. 6.

Fig. 7 is the example by the detection signal of driver's other gesture input.In this example, driver's gesture be illustrated in input operating device about near the central authorities top make hand near input operating device, turn back to the example of the occasion of level.In Fig. 7, identical with previous example, driver's hand is at first detected by detecting device A, then detect with range sensor, but because hand near input media, so the range finding consequential signal of range sensor also becomes upper right liter.Even can produce moving forward and backward of a little,, still make the size of the approaching occasion amplitude of hand become big clearly so the range finding consequential signal of range sensor also vibrates because common hand moves horizontally also.Therefore can distinguish by setting suitable threshold, can make the input of conduct based on the analog quantity of the size of amplitude.In addition with this example on the contrary make hand away from the occasion of action, the range finding consequential signal of range sensor becomes upper left liter, this also can distinguish.In the occasion that the gesture of the co-driver that passes through codriver's seat is imported, the generation figure of the detecting device A of above-mentioned example, the detection signal of detecting device B alternately.

Fig. 8 represents the signal graph example of the example that the gesture of the co-driver of pillion is imported.The co-driver of representing pillion in this example makes hand approaching towards input operating device, and after keeping, extracts the state of hand out from the sensing range of range sensor.The detection of range sensor distance is than the detection distance of object detection device A, B, C, makes under the approaching state of hand in that the co-driver of pillion is common, do not enter in the detection distance of object detection device A, B, C.Therefore, the signal that upper right liter on the signal at range sensor on the signal graph, only occurs.On the contrary, take away the occasion of the action of hand from input media at the co-driver of pillion, because produce the signal graph that descends in the signal of range sensor to the right, so the two can be distinguished, and then identical with example among Fig. 7, can be according to the input of the size of the amplitude of the size by amount of movement as analog quantity.

An example of structure that has the object detection device in the fan-shaped wide visual field of in above-mentioned example, using below by relatively expression with general infrared reflection type sensor construction.Fig. 9 represents the cross section skeleton diagram of an example of the structure of object detection device.Infrared reflection formula object detection device in this example, be received on the detected object thing 14 reflection withinfrared receiver 13 and return the light 12 that comes from the projectioninfrared ray 11 of theinfrared ray projector 10, become occasion more than certain intensity in detected intensity of reflected light, the object detection signal takes place.Theinfrared ray projector 10 has infrared light-emitting component 10a in inside, bring together, throw from the infrared ray that sends here with lens 10b with projection.For obtaining long projection distance, projectioninfrared ray 11 is generally brought together and is the light beam shape.Infrared receiver 13 has infrared receiver component 13a and receives uses lens 13b, and projectioninfrared ray 11 imports infrared receiver component 13a to the reflected light 12 of reflection on detected object thing 14 by receiving with lens 13b.Light beyond the wavelength band that uses, optical filter is added in receiver-side, it is not passed through, and then infrared ray stray light for distinguishing the reflected light 12 on the detected object thing and existing naturally, usually projectioninfrared ray 11 is modulated,infrared receiver 13 is avoided stray light by receiving synchronously with it.In this routine object detection device,, for covering input operating device, no dead angle needs a plurality of detecting devices, so need have the object detection device of fan-shaped surveyed area because, make surveyed area narrow as detecting device forprojection infrared ray 11 is brought into together the light beam shape.

Figure 10 is the cross section skeleton diagram according to an example of the object detection device with fan-shaped visual field of the such general object detection device making of expression example among Fig. 9.With the different projection of the being not only theinfrared ray projector 10 lens 10b of the general object detection device of Fig. 9, and, also set up reception rod-shaped lens 13c inoptical receiver 13 sides with projection rod-shaped lens 10c.So-called rod-shaped lens is columnar lens, have enter rod-shaped lens bring light together not to columnar short transverse broadening, become fan-shaped characteristic at the circumferencial direction broadening as shown in Figure 10.By using this rod-shaped lens 10c to become fan-shaped to projectioninfrared ray 11 broadenings.And then utilize rod-shaped lens that the visual field broadening ofoptical receiver 13 is become fan-shaped too inoptical receiver 13 sides, can constitute object detection device thus with fan-shaped wide visual field.In addition, replace single rod-shaped lens, also can use a plurality of rod-shaped lens or cylindrical lens, also can use the optical element that has the film like of said function by micro-structures such as lenticules, also can use to optically merging to have the lens of projection with the one of lens 10b and two kinds of function mades of rod-shaped lens 10c.

Figure 11 represents the side of another embodiment of the object detection device that uses in the present invention and top skeleton diagram.In the present embodiment, not with 10 one-tenth fan-shaped projection infrared rays of an infrared ray projector, but by a plurality ofinfrared ray projectors 10 being lined up row, each infrared ray projected area being overlapped, as all making planar infrared ray projected area.The reflected light on the detected object thing of planar projectioninfrared ray 11,infrared receiver 13 receptions by the wide visual field detect the detected object thing.10 groups of the infrared ray projectors because andinfrared receiver 13 synchronization actions in the corresponding wide visual field, so and above-mentioned example same, even also very strong for stray light.Figure 12 is the outboard profile that is illustrated among Fig. 1,2 surveyed area of the occasion of using object detection device shown in Figure 11 in the object detection device of input operating device of expression example.Compare with Figure 12, have the surveyedarea 2f broadening that is positioned near theobject detection device 2a of input operating device, the advantage that the dead angle reduces.In this example, a plurality of infrared ray projectors still not necessarily need to make the projection infrared ray to overlap closely near arranging.In addition, the projection infrared ray is overlapped use like that a plurality of ultrared infrared ray projectors of the fan-shaped projection of one-tenth that in Figure 10, use in the object detection device of example.

Figure 13 represents the front skeleton diagram of an alternative embodiment of the invention, and Figure 14 and Figure 15 represent the example of detection signal figure.In the present embodiment,, range sensor is not set, uses 3 object detection devices with fan-shaped sensing range as the low-priced edition of above-mentioned example.It is configured to, object detection device A (2a) is configured in driver's side, object detection device B (2b) is configured in the codriver's seat side, make the closed tilted configuration like that in lower end of surveyedarea 2f, object detection device C (2c) is configured in the inboard, upper end of detecting device A, B, and is configured in the position that does not take the contact input area.By such configuration, because the hand that stretches out when the driver will operate is necessarily detected earlier by object detection device A (2a), same, the hand that the co-driver of codriver's seat stretches out is detected earlier by object detection device B (2b), so can the identifying operation person.In the present embodiment, can discern 3 kinds of drivers' gesture input at least.Figure 14 is the example by the detection signal of driver's gesture input.In this example, driver's gesture be illustrated in input operating device about brandish the example of the occasion that hand extracts out near the central authorities upward from the below.As shown in figure 14, driver's hand at first hand near the time detect by detecting device A after, near the surveyed area lower end of detecting device B, be detected immediately.Then, when hand moves upward, extract out from the surveyed area of detecting device B, after extracting out by the surveyed area of detector C, the surveyed area from detecting device A comes out at last.The detection that occurs in sequence with detecting device B, C becomes the signal graph feature in the detection of detecting device A like this, and the identification of this action is possible, can be used as gesture input use by a corresponding order being sent to car-mounted device.Driver's gesture near the central authorities about input operating device from above brandish the occasion of extraction downwards, the order of occurrence of the detection signal of detecting device B and C is opposite in Figure 14, because detector C detects, extracts back detecting device B out and detects, extract, so this also can discern thereafter.Figure 15 is an example of the detection signal of another gesture input of driver.In this example, driver's gesture is illustrated near the example of the following occasion of brandishing hand in the horizontal direction near the codriver's seat side, returning of central authorities up and down of input operating device.As shown in figure 15, driver's hand, at first hand near the time detect by detecting device A after, near the codriver's seat side, carry out detecting device B surveyed area enter detection.Then the surveyed area from detecting device B is extracted out when hand returns, and extracts out from the surveyed area of detecting device A at last.Because below near the central authorities up and down of input operating device, do gesture,, can distinguish with the action of Figure 14 by the detection signal that does not have detector C so do not enter the surveyed area of detector C.In addition, in the present embodiment,, become the signal graph of the signal graph of the detecting device A that exchanged among Figure 14,15 and detecting device B, can discern, can be used as the gesture input and use in the occasion that the co-driver of codriver's seat side carries out the gesture input.

Figure 16 represents the front skeleton diagram of another embodiment of the present invention, and Figure 17 and Figure 18 represent the example by the detection signal figure of gesture input.In the present embodiment, the surveyed area of object detection device becomes the shape near rhombus asbutton 5 that surrounds input operating device or theinput area 4a on the touch pad, object detection device A, B are arranged on driver's side, object detection device C, D are arranged on the codriver's seat side.Therefore, the configuration of detecting device is different with above-mentioned example, but because will be from the hand of driver's side operation input operating device, at first by detecting one of among object detection device A or the B, will be from the hand of codriver's seat side operation, at first by detecting one of among object detection device C, the B, so can differentiate the co-driver that the people that will operate is driver or codriver's seat side.Figure 17 is the example by the detection signal of driver's gesture input.In this example, be illustrated near the example of brandishing the occasion of hand extraction from the below upward of driver's side of input operating device.As can be seen from Figure 16, near the surveyed area of detecting device A and detecting device B part driver's side of input operating device overlaps.Detect from the below hand by detecting device A, then after detecting, extract out, extract out from the surveyed area of detecting device B thereafter from the surveyed area of detecting device A by detecting device B towards the driver of top.Because be near the gesture driver's side, so detector C, D are reactionless, in the detection signal figure of detecting device A, B, signal as detecting device A takes place earlier, behind the zone that the signal through detecting device A and B overlaps in time, only become the feature of the signal of detecting device B, this gesture can be identified, and the corresponding order to car-mounted device can take place.Near driver's driver's side of gesture at input operating device from above brandish the occasion that hand is extracted out downwards, the signal graph of detecting device A and B becomes opposite sequence, is that feature can be discerned with it.Figure 18 is the example by the detection signal of another gesture input of driver.In this example, expression driver's gesture is near brandish the occasion that hand returns near the codriver's seat side in the lower end of input operating device in the horizontal direction example.As shown in figure 18, driver's hand, at first make hand near the time detect by detecting device A after, near the surveyed area that enters detecting device D the codriver's seat side is detected.Then, when returning hand, extract out, extract out from the surveyed area of detecting device A at last from the surveyed area of detecting device D.Because near the lower end of input operating device, do gesture,,, can distinguish with the action of Figure 18 by there not being the detection signal of detecting device B, C so do not enter the surveyed area of detecting device B and C.In addition, carry out the occasion of gesture input at the co-driver of codriver's seat side at present embodiment, become the signal graph that the signal graph of detecting device A among Figure 17,18 and detecting device B is replaced with the signal graph of detecting device D and C respectively, can discern equally, can be used as the gesture input and use.The characteristics of present embodiment have, on above-below direction, brandish gesture when input of the action of hand at the co-driver of driver or codriver's seat, do not need handle to reach near the input operating device central authorities, can be near end about the input scan device with little motion input.

Figure 19 represents the front skeleton diagram of another embodiment of the present invention, and Figure 20 represents its lateral section skeleton diagram, and Figure 21 represents its inner structure skeleton diagram, and Figure 22 represents example from the detection signal figure of the gesture of driver's side input to Figure 24.In auto-navigation system etc., use with theimage display device 4 of touch pad at a lot of occasions additional function of touchpad on backlight liquid crystal displays.Its structure is, makes for white light backlight that identical brightness adjusts is arranged by the color liquid crystal filtrator on whole image, exports the difference of color or brightness, as image.The white light source that this is backlight uses fluorescent tube or LED more.As this light source backlight, by the infrared light-emitting component of additional infrared LEDs etc., on white light the outer infrared ray in additional people viewing area, utilize and have the element of infrared ray through the function of liquid crystal filtering device, can all throwinfrared ray 16 from picture.Detect this infrared ray by the infrared receiver that uses limits vision that around image display device, dispose, suitable and on detected object objects such as hand, reflect the light that returns, can differentiate detected object things such as hand wherein, figure according to detector signal, same with above-mentioned example, direction that can the identifying operation person, gesture etc.In Figure 19, embodiment shown in Figure 20, as the infrared receiver of detecting device, identical with the example of Figure 10, have into the visual field of fan-shaped broadening, receive the reflected light that comprises ultrared 16 irradiation object things backlight, the existence of inspected object from LCD 4.The infrared ray composition that comprises in backlight, for alleviating the interference that causes owing to inner and outside other light sources, as shown in figure 21, modulated in the infrared ray back light synchronously with detecting device as infrared receiver, but and other example is same, because be the modulation outside the viewing area, human eye be cannot see.In the mode of this embodiment, because backlight liquid crystal display is also used as the infrared ray projector part of object detection device, so have and only dispose infrared receiver and save very much the space, so and, as a result of be difficult to form the feature at dead angle because utilize ultrared projection wide ranges backlight.In the present embodiment, the driver is for driving the hand that input operating device stretches into, by comprising ultrared 16 irradiations backlight, by infrared receiver A (17a) detection earlier of driver's side.On the contrary, in the occasion that the co-driver of codriver's seat side will be operated,,, can carry out respective operations person's processing so can the identifying operation person be the co-driver of driver or codriver's seat side because this hand detects at first with detecting device B (17b).

Figure 22 is an example of the detection signal that causes of the gesture input by the driver.In this example, expression driver's gesture is flatly brandished the example of the detection signal figure of the occasion that hand returns to about the input operating device near the central authorities from starting with near the input operating device downside.Driver's hand, is detected by detector C (17c) after detecting device A (17a) detects by comprising ultrared backlightliquid crystal display 16 irradiations.By the constant hand that returns of former state, because at first extract out, extract out from the surveyed area of detecting device A (17a) at last, so that this detection signal figure forms is such as shown in figure 22 from the surveyed area of detector C (17c).By near the input operating device downside to about do gesture near the central authorities, never come the detection signal of self-detector B and detector C, the detection signal of detector C takes place in the detection of detecting device A, after the end, thereafter the detection signal of detecting device A finishes such feature, can discern this gesture, make as the corresponding order of gesture input luminous.

Figure 23 is an example of the detection signal that causes of another gesture input by the driver.In this example, expression driver's gesture for brandish hand in the horizontal direction near the codriver's seat side of input operating device, the example of the occasion returned.Different with the occasion of inserting hand of partwaying shown in Figure 4, because hand brandishes near the codriver's seat side, so the detection signal of detecting device B takes place in the generation of the detection signal of detecting device A.By this difference, can differentiate the difference of above-mentioned two kinds of gestures.

Figure 24 is an example of the detection signal that causes of another gesture input by the driver.In this example, expression driver's gesture near the central authorities about input operating device from below brandish the example of the occasion of hand extraction upward.Driver's hand, at first detect in the moment of inserting input operating device by detecting device A, so detect by detector C because move upward from the below, after extracting out from the surveyed area of detector C, detect by range sensor, after extracting out, extract out from the surveyed area of detecting device A from the surveyed area of range sensor.For the gesture of expression Figure 22, example shown in Figure 23, the detection signal of detecting device B does not take place in the detection of detecting device A, can distinguish by detector C and detecting device D sequence detection.Driver's gesture be from above brandish the occasion of extraction downwards, the detection signal by range sensor and detector C can be used as the gesture input and utilizes can discern with opposite the occurring in sequence of example of Figure 24.In addition, be the occasion of the co-driver of codriver's seat the operator, in Figure 22, Figure 23, Figure 24, replace, so can discern because of the signal graph of detecting device A and the signal graph of detecting device B.

(other embodiment)

Figure 25 A-25D represents that car-mounted device of the present invention operation replaces the skeleton diagram of an embodiment in the function, and Figure 26 represents from the key diagram of the flow process that begins to operate the end operation picture.In addition, the example of explanation is to represent form later on, is not limited thereto.

18a is a upper picture example of selecting the occasion of navigation feature.Usually, theinput field 4a in display device for mounting on vehicle on a plurality of touch pads of configuration on the picture operates by pushing it.For example in the occasion of using navigation feature from facility name lookup destination, push " searching the destination "such input field 4a from the picture of 18a, advance to next operation screen 18b, then push the input field of " facility title ", become from facility tabulation guide look and select from the picture of 18b.It is very difficult to carry out profound like that operation in the of short duration down time of waiting signal etc., even because finish the purpose operation end operation picture of also having to so far, and must be once more from the upper picture when operating next time.Here the have to occasion of interrupting halfway, before turning back to map picture 18d, make the operator select whether to preserve thepicture 18c of operation by prompting, last time resume operations can continue when operating next time, even perhaps in running car if the driver beyond the operator, also can continue the operation.Here,picture 18c can be used as introduction and shows that car begins to travel, and also can show this picture from the first-class request of touch pad by the operator.Here so-called co-driver refer to codriver's seat or pillion with drive irrelevant object.In addition, the replacement of also can be between preceding monitor and pillion monitor etc. between a plurality of monitors, operating.In addition, do not having the occasion of co-driver,, beginning such setting from continuing, then in the time of next waiting signal, can continue and operate the efficient height if be chosen in when operating next time even driver self thinks the occasion of complete operation.Operation is preserved and is selectedpicture 18c, also can automatically switch to map picture 18d, perhaps also can surround operation and preserve and select theinput field 19 of the picture on the picture (18c) switch to map picture 18d by pushing in the moment through the stand-by time that is set by the user in advance.In addition, even, also can select autosave operation passing through the still occasion of the selection of no user of predefined stand-by time.

Figure 26 represents from beginning to operate the flow process that operation screen finishes.Atstep 20a, from state of the rotation of the state of the state of side brake, engine, tire etc., from the condition judgement car of any traveling apparatus whether during stopping.If car is in stopping then advancing to step 20b (Yes), if car under steam then advance to step 20f (No).Step 20b operator is that the driver might as well might as well receive all operations by co-driver.Same atstep 20c andstep 20a, from the condition judgement of any traveling apparatus such as side brake soon car whether to begin to travel, advance to step 20d (Yes) if car will begin to travel, preserve in step 20d prompting operation and select picture 18c.Judge for the operation of operation preservation selection picture whether in predefined setting-up time, carry out at step 20e.Then advance to step 20f (Yes) as in setting-up time, operating, advance tostep 20g being judged to beovertime occasion.At step 20f, judge and whether select to preserve operation.Advance tostep 20g (Yes) in the occasion of selecting to preserve operation, at unselected occasionend operation.At step 20g, the processing that the picture of prompting is preserved when operating asnext time.At step 20h, whether decision person is driver's co-driver in addition.This judgement can use above-mentioned object detection device to carry out.If the operator is co-driver then advances to step 20i (Yes), is driver's occasion end operation picture (No) theoperator.At step 20i, prompting as long as the operator is the occasion of co-driver, just can continue operation at the picture ofstep 20g registration.

Claims (16)

Translated fromChinese

1.一种车载装置用输入操作装置，其特征在于，1. An input operation device for a vehicle-mounted device, characterized in that在输入操作装置周围装备3个以上的物体检测器，制作、发送检测对象物的、与通过多个该物体检测器的多个检测信号图形对应的车载装置的输入信号。Three or more object detectors are provided around the input operation device, and an input signal of the vehicle-mounted device corresponding to a plurality of detection signal patterns passing through the plurality of object detectors is created and transmitted.2.根据权利要求1所述的车载装置用输入操作装置，其特征在于，2. The input operation device for a vehicle-mounted device according to claim 1, wherein:从该物体检测器的一系列的检测信号图形判别对于该输入操作装置的操作者的存在方向，以该信息切换该输入操作装置的功能，或者制作、发送向车载装置的输入信号。From a series of detection signal patterns of the object detector, the presence direction of the operator with respect to the input operation device is determined, and the function of the input operation device is switched based on the information, or an input signal to the vehicle-mounted device is created and transmitted.3.根据权利要求1以及2中任何一个所述的车载装置用输入操作装置，其特征在于，3. The input operation device for a vehicle-mounted device according to any one of claims 1 and 2, wherein:各物体检测器是具有一对红外线投射器和捕捉该红外线的在检测对象物上的反射光的红外线接收器的红外线反射型的检测器，而且从红外线投射器发射的红外光展宽成扇形。Each object detector is an infrared reflective detector having a pair of infrared projectors and an infrared receiver for capturing reflected light of the infrared rays on the object to be detected, and the infrared light emitted from the infrared projectors spreads in a fan shape.4.根据权利要求1以及2中任何一个所述的车载装置用输入操作装置，其特征在于，4. The input operation device for a vehicle-mounted device according to any one of claims 1 and 2, wherein:各物体检测器，由同步运动的多个红外线投射器和一个红外线接收器组成。Each object detector is composed of a plurality of infrared projectors and an infrared receiver moving synchronously.5.根据权利要求1以及2中任何一个所述的车载装置用输入操作装置，其特征在于，5. The input operation device for a vehicle-mounted device according to any one of claims 1 and 2, wherein:具有至少一个能够测量到测定对象物的距离的距离传感器，制作、发送与来自该距离传感器的测量数据和多个该物体检测器的多个检测信号图形的组合对应的向车载装置的输入信号。It has at least one distance sensor capable of measuring the distance to the object to be measured, and generates and transmits an input signal to the vehicle-mounted device corresponding to a combination of measurement data from the distance sensor and a plurality of detection signal patterns of the plurality of object detectors.6.根据权利要求1以及2中任何一个所述的车载装置用输入操作装置，其特征在于，6. The input operation device for a vehicle-mounted device according to any one of claims 1 and 2, wherein:该输入操作装置具有图像显示装置，而且该图像显示装置具有红外线的发光功能，各物体检测器，包含捕捉在该红外线的检测对象物上的反射光的红外线接收器。The input operation device has an image display device, and the image display device has an infrared light emitting function, and each object detector includes an infrared receiver for capturing reflected light on the infrared detection target object.7.一种车载装置，其特征在于，7. A vehicle-mounted device, characterized in that,在输入操作装置周围具有3个以上的物体检测器，制作、发送检测对象物的、与多个通过该检测器引起的多个检测信号图形对应的向车载装置的输入信号。There are three or more object detectors around the input operation device, and an input signal to the vehicle-mounted device is generated and transmitted corresponding to a plurality of detection signal patterns caused by the detectors.8.根据权利要求7所述的车载装置，其特征在于，8. The vehicle-mounted device according to claim 7, wherein:该输入操作装置，从通过该物体检测器的一系列的检测信号图形判别对于该输入操作装置的操作者的存在方向，以该信息切换该输入操作装置的功能，或者制作、发送向车载装置的输入信号。The input operation device judges the presence direction of the operator of the input operation device from a series of detection signal patterns passing through the object detector, switches the function of the input operation device based on the information, or creates and transmits a message to the vehicle-mounted device. input signal.9.根据权利要求7以及8中任何一个所述的车载装置，其特征在于，9. The vehicle-mounted device according to any one of claims 7 and 8, wherein:该输入操作装置中的各物体检测器，是具有一对红外线投射器和捕捉该红外线的在检测对象物上的反射光的红外线接收器的红外线反射型的检测器，而且从红外线投射器发射的红外光展宽成扇形。Each object detector in the input operation device is an infrared reflective detector having a pair of infrared projectors and an infrared receiver that captures the reflected light of the infrared rays on the object to be detected, and the infrared rays emitted from the infrared projectors are The infrared light spreads out into a fan shape.10.根据权利要求7以及8中任何一个所述的车载装置，其特征在于，10. The vehicle-mounted device according to any one of claims 7 and 8, wherein:该输入操作装置的各物体检测器，由同步运动的多个红外线投射器和一个红外线接收器组成。Each object detector of the input operation device is composed of a plurality of infrared projectors and an infrared receiver moving synchronously.11.根据权利要求7以及8中任何一个所述的车载装置，其特征在于，11. The vehicle-mounted device according to any one of claims 7 and 8, wherein:该输入操作装置，具有至少一个能够测量到测定对象物的距离的距离传感器，制作、发送与来自该距离传感器的测量数据和多个该物体检测器的多个检测信号图形的组合对应的向车载装置的输入信号。The input operation device has at least one distance sensor capable of measuring the distance to the object to be measured, and creates and transmits a vehicle-mounted signal corresponding to a combination of measurement data from the distance sensor and a plurality of detection signal patterns of a plurality of object detectors. input signal to the device.12.根据权利要求7以及8中任何一个所述的车载装置，其特征在于，12. The vehicle-mounted device according to any one of claims 7 and 8, wherein:该输入操作装置具有图像显示装置，而且该图像显示装置具有红外线的发光功能，各物体检测器，包含捕捉在该红外线的检测对象物上的反射光的红外线接收器。The input operation device has an image display device, and the image display device has an infrared light emitting function, and each object detector includes an infrared receiver for capturing reflected light on the infrared detection target object.13.根据权利要求7以及8中任何一个所述的车载装置，其特征在于，13. The vehicle-mounted device according to any one of claims 7 and 8, wherein:在车在停止状态时从接受了来自驾驶者的操作的状态转移到行驶状态时，该输入操作装置显示用于选择是否保存所述操作的画面。The input operation device displays a screen for selecting whether to save the operation when the vehicle is in a stopped state and transitions from a state of receiving an operation from a driver to a running state.14.根据权利要求13所述的车载装置，其特征在于，14. The vehicle-mounted device according to claim 13, wherein:该输入操作装置中的所述画面的显示，检测是否要转移到行驶状态并自动进行显示，或者根据所述驾驶者的输入进行显示。The display of the screen in the input operation device detects whether to shift to the driving state and displays it automatically, or displays it according to the driver's input.15.根据权利要求13所述的车载装置，其特征在于，15. The vehicle-mounted device according to claim 13, wherein:该输入操作装置中的所述画面，在经过规定的时间后自动地消失，转移到地图显示画面。The above-mentioned screen in the input operation device automatically disappears after a predetermined time elapses, and shifts to a map display screen.16.根据权利要求13所述的车载装置，其特征在于，16. The vehicle-mounted device according to claim 13, wherein:在保存了该输入操作装置中的所述操作后，在有来自同乘者的操作的场合，显示所述操作的画面。After storing the operation in the input operation device, when there is an operation from the passenger, the screen for the operation is displayed.

Images