FIELD OF THE INVENTIONThe present invention relates to alertness monitoring for drivers of motor vehicles.[0001]
BACKGROUND OF THE INVENTIONThe following patents are believed to represent the current state of the art:
[0002] | | 3,227,998; | 3,631,446; | 3,654,599; | 3,935,830; | 3,980,999; |
| 4,007,357; | 4,017,843; | 4,104,621; | 4,450,438; | 4,463,347; | 4,496,938; | 4,509,040; |
| 4,518,954; | 4,564,833; | 4,565,997; | 4,581,607; | 4,586,032; | 4,594,583; | 4,604,611; |
| 4,611,199; | 4,673,913; | 4,794,536; | 4,853,672; | 4,984,646; | 4,996,657; | 5,057,834; |
| 5,097,917; | 5,282,135; | 5,465,079; | 5,488,353; | 5,548,273; | 5,568,127; | 5,570,087; |
| 5,570,698; | 5,585,785; | 5,675,313; | 5,684,455; | 5,684,462; | 5,689,241; | 5,709,281; |
| 5,714,925; | 5,717,606; | 5,729,619; | 5,745,031; | 5,765,116; | 5,786,765; | 5,795,306; |
| 5,798,695; | 5,805,079; | 5,805,720; | 5,813,993; | 5,815,070; | 5,821,860; | 5,835,008; |
| 5,835,028; | 5,847,648; | 5,850,193; | 5,867,587; | 5,900,819; | 5,917,415; | 5,923,263; |
| 5,925,082; | 5,939,989; | 5,942,979; | 5,969,616; | 5,982,287; | 6,023,227; | 6,061,610; |
| 6,064,301; | 6,067,020; | 6,087,941; | 6,087,943; | 6,091,334; | 6,097,286; | 6,097,295; |
| 6,172,610. |
|
SUMMARY OF THE INVENTIONThe present invention seeks to provide an improved methodology and system for monitoring the alertness of drivers of motor vehicles.[0003]
There is thus provided in accordance with a preferred embodiment of the present invention a methodology for determining the alertness of a driver of a motor vehicle including:[0004]
sensing at least one first movement characteristic of at least a first part of a motor vehicle;[0005]
sensing at least one second movement characteristic of at least a second part of the motor vehicle;[0006]
employing at least one time relationship between the at least one first movement characteristic and the at least one second movement characteristic in order to sense and to distinguish between driver initiated movements and non-driver initiated movements; and[0007]
determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0008]
There is also provided in accordance with a preferred embodiment of the present invention, a methodology for determining the alertness of a driver of a motor vehicle including:[0009]
employing at least one time relationship between at least one first movement characteristic of at least a first part of a motor vehicle and at least one second movement characteristic of at least a second part of the motor vehicle in order to sense and to distinguish between driver initiated movements and non-driver initiated movements; and[0010]
determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0011]
There is additionally provided in accordance with a preferred embodiment of the present invention a methodology for determining the alertness of a driver of a motor vehicle including:[0012]
sensing at least one first movement characteristic of at least a first part of a motor vehicle;[0013]
sensing at least one second movement characteristic of at least a second part of a motor vehicle; and[0014]
employing the at least one first movement characteristic and the at least one second movement characteristic in order to determine the alertness of the driver of the motor vehicle.[0015]
There is further provided in accordance with a preferred embodiment of the present invention a methodology for determining the alertness of a driver of a motor vehicle including:[0016]
sensing at least one first movement characteristic of at least a first part of[0017]
a motor vehicle;[0018]
sensing at least one second movement characteristic of at least a second part of the motor vehicle;[0019]
employing the at least one first movement characteristic and the at least one second movement characteristic in order to sense driver initiated movements; and[0020]
determining the alertness of the driver of the motor vehicle based at least partially on the sensed driver initiated movements.[0021]
There is additionally provided in accordance with a preferred embodiment of the present invention a system for determining the alertness of a driver of a motor vehicle including:[0022]
a first sensor sensing at least one first movement characteristic of at least a first part of a motor vehicle;[0023]
a second sensor sensing at least one second movement characteristic of at least a second part of the motor vehicle;[0024]
a distinguisher, employing at least one time relationship between the at least one first movement characteristic and the at least one second movement characteristic in order to sense and to distinguish between driver initiated movements and non-driver initiated movements; and[0025]
an alertness determiner, determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0026]
There is further provided in accordance with a preferred embodiment of the present invention a system for determining the alertness of a driver of a motor vehicle including:[0027]
a distinguisher, employing at least one time relationship between at least one first movement characteristic of at least a first part of a motor vehicle and at least one second movement characteristic of at least a second part of the motor vehicle in order to sense and to distinguish between driver initiated movements and non-driver initiated movements; and[0028]
an alertness determiner, determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0029]
There is still further provided in accordance with a preferred embodiment of the present invention a system for determining the alertness of a driver of a motor vehicle including:[0030]
a first sensor, sensing at least one first movement characteristic of at least a first part of a motor vehicle;[0031]
a second sensor, sensing at least one second movement characteristic of at least a second part of a motor vehicle; and[0032]
a distinguisher, employing the at least one first movement characteristic and the at least one second movement characteristic in order to determine the alertness of the driver of the motor vehicle.[0033]
There is yet further in accordance with a preferred embodiment of the present invention provided a system for determining the alertness of a driver of a motor vehicle including:[0034]
a first sensor, sensing at least one first movement characteristic of at least a first part of a motor vehicle;[0035]
a second sensor, sensing at least one second movement characteristic of at least a second part of the motor vehicle;[0036]
a distinguisher, employing the at least one first movement characteristic and the at least one second movement characteristic in order to sense driver initiated movements; and[0037]
an alertness determiner, determining the alertness of the driver of the motor vehicle based at least partially on the sensed driver initiated movements.[0038]
There is still further provided in accordance with a preferred embodiment of the present invention a methodology for determining the alertness of a driver of a motor vehicle including:[0039]
sensing at least one characteristic of driver initiated movements of at least one part of a motor vehicle;[0040]
sensing at least one characteristic of non-driver initiated movements of at least one part of a motor vehicle; and[0041]
determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0042]
There is additionally provided in accordance with a preferred embodiment of the present invention a system for determining the alertness of a driver of a motor vehicle including:[0043]
a driver initiated movement sensor, sensing at least one characteristic of driver initiated movements of at least one part of a motor vehicle;[0044]
a non-driver initiated movement sensor, sensing at least one characteristic of non-driver initiated movements of at least one part of a motor vehicle; and[0045]
a determiner, determining the alertness of the driver of the motor vehicle based on at least one relationship between the driver initiated movements and the non-driver initiated movements.[0046]
Preferably, the at least one characteristic of driver initiated movements is extent.[0047]
Preferably, the at least one characteristics of non-driver initiated movements is extent.[0048]
In accordance with a preferred embodiment of the present invention, extent of driver initiated movements includes at least one of:[0049]
the integrated magnitude of the driver initiated movements;[0050]
the RMS average of the magnitude of the driver initiated movements;[0051]
the number of peaks of the driver initiated movements per unit time.[0052]
In accordance with a preferred embodiment of the present invention, extent of non-driver initiated movements includes at least one of:[0053]
the integrated magnitude of the non-driver initiated movements;[0054]
the RMS average of the magnitude of the non-driver initiated movements;[0055]
the number of peaks of the non-driver initiated movements per unit time.[0056]
Preferably, the sensing at least one characteristic of driver initiated movements of at least one part of a motor vehicle and the sensing at least one characteristic of non-driver initiated movements of at least one part of a motor vehicle include sensing at least one first movement characteristic and sensing at least one second movement characteristic of the motor vehicle.[0057]
Preferably, the at least one first movement characteristic includes a steering wheel movement characteristic and the at least one second movement characteristic includes a road wheel movement characteristic.[0058]
In accordance with a preferred embodiment of the present invention, the at least one first movement characteristic and the at least one second movement characteristic include movement characteristics of first and second locations along a steering assembly extending from a steering wheel to at least one road wheel of the motor vehicle.[0059]
Preferably, the at least one first movement characteristic includes a steering assembly movement characteristic and the at least one second movement characteristic includes a vehicle body movement characteristic.[0060]
In accordance with a preferred embodiment of the present invention, the at least one first movement characteristic includes a steering assembly movement characteristic and the at least one second movement characteristic includes a vehicle chassis movement characteristic.[0061]
Preferably, the first and second locations are located respectively at or upstream of and at or downstream of a power steering unit forming part of the steering assembly.[0062]
In accordance with a preferred embodiment of the present invention, the first location is at a steering wheel forming part of the steering assembly.[0063]
Preferably, the at least one first movement characteristic is angular displacement of the steering wheel; and[0064]
the at least one second movement characteristic is a steering angle of at least one road wheel.[0065]
In accordance with a preferred embodiment of the present invention, the at least one first movement characteristic is displacement; and[0066]
the at least one second movement characteristic is displacement.[0067]
Alternatively, the at least one first movement characteristic is displacement; and[0068]
the at least one second movement characteristic is acceleration in at least one direction.[0069]
In a further alternative, the at least one first movement characteristic is displacement; and[0070]
the at least one second movement characteristic is acceleration in at least one direction.[0071]
Preferably, determining also employs the speed of the vehicle.[0072]
In accordance with a preferred embodiment of the present invention, the driver initiated movement sensor sensing at least one characteristic of driver initiated movements of at least one part of a motor vehicle and the non-driver initiated movement sensor sensing at least one characteristic of non-driver initiated movements of at least one part of a motor vehicle include a first sensor, sensing at least one first movement characteristic and a second sensor sensing at least one second movement characteristic of the motor vehicle.[0073]
Preferably, the system also includes a driver alertness alarm, responsive to an alarm from the driver alertness determiner for providing an alarm to a driver deemed not to be sufficiently alert.[0074]
BRIEF DESCRIPTION OF THE DRAWINGSThe present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:[0075]
FIGS. 1A and 1B are simplified pictorial illustrations of a methodology for determining the alertness of a driver of a motor vehicle in accordance with a preferred embodiment of the present invention, respectively illustrating operation when a driver is alert and when a driver is not alert;[0076]
FIG. 2 is a simplified pictorial illustration of a system operative to provide the functionality of FIGS. 1A and 1B and showing inter alia a steering assembly and part of a chassis of a typical motor vehicle as well as illustrating a plurality of locations where measurements of motion may be made in accordance with a preferred embodiment of the present invention;[0077]
FIG. 3A is a simplified flow chart of the functionality of FIGS. 1A and 1B in accordance with one preferred embodiment of the present invention;[0078]
FIG. 3B is a simplified flow chart of the functionality of FIGS. 1A and 1B in accordance with another preferred embodiment of the present invention;[0079]
FIG. 3C is a simplified flow chart of the functionality of FIGS. 1A and 1B in accordance with yet another preferred embodiment of the present invention;[0080]
FIG. 4A is an illustration of the functionality of FIGS. 1A and 1B in accordance with one preferred embodiment of the present invention over a first time period corresponding to a first set of driving conditions and driver conditions;[0081]
FIG. 4B is an illustration of the functionality of FIGS. 1A and 1B in accordance with one preferred embodiment of the present invention over a second time period corresponding to a second set of driving conditions and driver conditions;[0082]
FIG. 4C is an illustration of the functionality of FIGS. 1A and 1B in accordance with one preferred embodiment of the present invention over a third time period corresponding to a third set of driving conditions and driver conditions;[0083]
FIG. 5 is a diagram in the form appearing also in FIGS. 1A and 1B, illustrating data points produced in accordance with the present invention from the data appearing in FIGS. 4A, 4B and[0084]4C; and
FIG. 6 is a simplified flow chart illustrating application of alertness criteria to driving samples in accordance with a preferred embodiment of the present invention.[0085]
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTSReference is now made to FIGS. 1A and 1B, which are simplified pictorial illustrations of a system and methodology for determining the alertness of a driver of a motor vehicle in accordance with a preferred embodiment of the present invention, respectively illustrating operation when a driver is alert and when a driver is not alert.[0086]
As seen in FIGS. 1A and 1B, a determination of the alertness of the driver is made based on a statistical relationship between at least one characteristic of driver initiated movements of at least one part of a motor vehicle and at least one characteristic of non-driver initiated movements of at least one part of a motor vehicle.[0087]
A typical driver initiated movement includes controlled movements of the motor vehicle, as for example by the driver turning the steering wheel. A typical non-driver initiated movements of the motor vehicle includes uncontrolled movements of the motor vehicle, as for example by the car encountering an uneven section of the road, a gust or unbalanced vehicle wheels.[0088]
In the preferred embodiment of the invention illustrated in FIGS. 1A and 1B, the at least one characteristic of both driver initiated movements and of non-driver initiated movements is extent. The use of the term “extent”, when used with “driver initiated motions” and “non-driver initiated motions”, is intended to convey measures of such motions. This measure may be derived in one or more different ways.[0089]
It is appreciated that alternatively different characteristics or metrics may be employed for driver initiated movements and for non-driver initiated movements.[0090]
As will be described hereinbelow, for the purposes of the present invention, extent may be one or more of at least the following parameters for driver initiated movements:[0091]
the integrated magnitude of the driver initiated movements;[0092]
the RMS average of the magnitude of the driver initiated movements;[0093]
the number of peaks of the driver initiated movements per unit time.[0094]
Likewise, extent may be one or more of at least the following parameters for non-driver initiated movements:[0095]
the integrated magnitude of the non-driver initiated movements;[0096]
the RMS average of the magnitude of the non-driver initiated movements;[0097]
the number of peaks of the non-driver initiated movements per unit time.[0098]
Alternatively or additionally extent may involve one or more additional parameters. The term “magnitude” as used in the present application may refer to the amount of movement, irrespective of whether that movement is linear movement, angular movement or a combination thereof. Additionally, the term “magnitude” as used in the present application may also refer to a mathematical combination of the movement and another parameter, such as the vehicle speed.[0099]
The “THRESHOLD” lines shown in FIGS. 1A and 1B define a predetermined relationship between driver initiated movements and non-driver initiated movements and shows the minimum extent of the driver initiated movements expected for the corresponding extent of non-driver initiated movements, which may be typically measured for a series of alert drivers or, alternatively may be typically established for specific alert drivers.[0100]
In practice, the threshold is preferably determined by correlating a statistically valid sampling of the results of the measuring the driver alertness, see for example the data presented in FIG. 5, with acceptable levels of driver alertness as measured by external means, such as visual records of the appearance of the driver or outputs of various biometric sensors. In setting the threshold, typically care is taken not to provide false alarms unnecessarily, which would result in driver dissatisfaction and refusal to use the system. In practice, a threshold is determined or selectable, which does not fail to provide an alarm when the driver is not sufficiently alert.[0101]
Turning to FIG. 1A, it is appreciated that operation of a motor vehicle by an alert driver is preferably characterized in that for at least a predetermined majority of a multiplicity of different time periods, a metric of the extent of driver initiated movements at least equals a corresponding metric of the extent of non-driver initiated movements.[0102]
FIG. 1B shows that corresponding operation of a motor vehicle by an non-alert driver is preferably characterized in that for at least a predetermined majority of a multiplicity of different time periods, a metric of the extent of driver initiated movements does not at least equal a corresponding metric of the extent of non-driver initiated movements.[0103]
Thus, it may be understood that, for example, when a driver is alert, as the magnitude of non-driver initiated motions increases, the frequency of occurrence of driver initiated motions should increase generally correspondingly.[0104]
Reference is now made to FIG. 2, which is a simplified pictorial illustration of a steering assembly and part of a chassis of a typical motor vehicle, illustrating a plurality of locations therealong where measurements of motion may be made in accordance with a preferred embodiment of the present invention.[0105]
In the motor vehicle shown in FIG. 2 and designated generally by[0106]reference numeral100, there is provided aconventional steering assembly102, including asteering wheel104, asteering wheel shaft106, connecting the steering wheel to apower steering unit108, as well as right and leftlinkages110 and112 which connect the power steering unit toroad wheels114 and116, respectively.
It is appreciated that the present invention may also be used with motor vehicles, which do not include a[0107]power steering unit108.
In accordance with a preferred embodiment of the present invention, a driver alertness determining system is provided including a[0108]computation unit120 which receives inputs from one or more angular motion sensors, preferably including a first angular motion sensor122 disposed adjacentsteering wheel shaft106 at the steering wheel side thereof, a secondangular motion sensor124 disposed adjacentsteering wheel shaft106 at the power steering unit side thereof, a thirdangular motion sensor126 disposed adjacent one oflinkages110 and112, a fourthangular motion sensor128 disposed adjacent aroad wheel114 or116 and anacceleration sensor130 mounted on achassis portion132 thereof.
[0109]Computation unit120 also preferably receives an input from avehicle speed sensor134 and provides a driver sensible output via adriver alertness alarm136, which may be any suitable alarm such as a tactile, visual, audio or audiovisual alarm.
As will be described hereinafter in detail, preferably inputs are received from two of the angular motion sensors, one adjacent the road wheels and one adjacent the steering wheel. Alternatively or additionally, an input from the[0110]acceleration sensor130 in combination with one or more inputs from angular motion sensors may be employed.
Reference is now made to FIG. 3A, which is a simplified flow chart illustrating the functionality of FIGS. 1A and 1B in accordance with one preferred embodiment of the present invention. As seen in FIG. 3A, data from a road wheel influenced displacement sensor, such as either of[0111]sensors126 and128, is normalized, atblock200, preferably to eliminate variations in measurements resulting from differences in the magnitudes of motion sensed by different sensors. Typical normalized data from the road wheel sensor128 (FIG. 2) as a function of time, appear as a solid line in trace A1 of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
It is appreciated that the term “displacement” as used throughout may, where suitable, refers to either or both of linear and angular displacements. In the case of steering wheel motion, the sensed displacement is angular displacement. In the case of road wheel displacement, either or both of angular displacement of the road wheel itself and linear displacement of elements coupled thereto may be sensed.[0112]
The output of[0113]block200, is then filtered, atblock202, to remove noise, which in this case preferably includes all signal components having frequencies in excess of approximately 10 Hz. Typical normalized and filtered data from the road wheel sensor128 (FIG. 2) as a function of time, appear as a solid line in trace A2 of FIG. 4A, trace B2 of FIG. 4B and trace C2 of FIG. 4C.
The output of[0114]block202 is split into high and low frequency components, preferably above and below 4 Hz, as indicated inblock204. The high frequency component of typical normalized and filtered data from the road wheel sensor128 (FIG. 2) appears as trace A3 of FIG. 4A, trace B3 of FIG. 4B and trace C3 of FIG. 4C. The low frequency component of typical normalized and filtered data from sensor128 (FIG. 2) as a function of time, appear as a solid line in each of trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C.
It is appreciated that the high frequency component, namely, the component above 4 Hz, is typical of the non-driver initiated movements. However, the component below 4 Hz may include both driver initiated movements and non-driver initiated movements.[0115]
The high frequency component output of[0116]block204 is further processed, together with the data of the vehicle sensor134 (FIG. 2), as indicated in ablock206, to further characterize this component. The functionality ofblock206 may include one or more of calculating RMS values, average values, and standard deviations of the high frequency component, typically coupled with the data from the vehicle speed sensor134 (FIG. 2), over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The output of[0117]block206 is employed to determine the extent of non-driver initiated motion, as indicated in ablock208.
The low frequency component output of[0118]block204 is further processed as indicated in ablock210, as is described hereinbelow.
Data from a steering wheel influenced angular displacement sensor, such as either of[0119]sensors122 and124, is normalized, atblock212, preferably to eliminate variations in measurements resulting from differences in the magnitudes of the motion sensed by different sensors. Typical normalized data from the steering wheel sensor122 (FIG. 2) as a function of time, appear as a dashed line in trace A1 of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
The output of[0120]block212, is then filtered, atblock214, to remove noise, which in this case preferably includes all signal components having frequencies in excess of approximately 10 Hz. Typical normalized and filtered data from the steering wheel sensor122 (FIG. 2) as a function of time, appear as a dashed line in trace A2 of FIG. 4A, trace B2 of FIG. 4B and trace C2 of FIG. 4C.
The output of[0121]block214 is preferably supplied to block210, which is operative to determine the sign of the phase difference between the output ofblock214 and the output ofblock204, which are respectively represented by the dashed and solid lines in trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C for each of a multiplicity of discrete time durations. This phase difference is defined to be positive, when the output ofblock214, representing the steering wheel influenced motion, leads the output ofblock204, representing the low frequency component of the road wheel influenced motion.
There exist various known techniques for determining the phase difference, any suitable one of which may be employed herein. The particular technique employed does not form part of the present invention.[0122]
When the phase difference is positive the relevant time duration to which that data relates is indicated, at[0123]block216, to be driver initiated motion duration, indicated by a relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing driver initiated motion is then analyzed, atblock218, typically to determine the frequency of occurrence of driver initiated motions, which is an indication of the extent of driver initiated motions. Alternatively or additionally to determining the frequency of occurrence of driver initiated motions, any other suitable metric of the extent of driver initiated motions may be employed.
The frequency of occurrence of driver initiated motions may be determined by counting the number of extrema points in the dashed line appearing in trace A[0124]4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C during the driver initiated motion durations corresponding to the relatively thick lines in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. These extrema points are indicated by circles drawn on the relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C.
When the phase difference is negative, the relevant time duration to which that data relates is indicated, at[0125]block220 to be non-driver initiated motion duration, indicated by a relatively thin line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing non-driver initiated motion is then analyzed, atblock222, in order to further characterize this data. The functionality ofblock222 may include one or more of calculating RMS values, average values, and standard deviations of the low frequency component, typically coupled with the data of the vehicle speed sensor (FIG. 2), over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The output of[0126]block222 is supplied to block208 along with the output fromblock206 in order to determine the extent of non-driver initiated motion. The functionality ofblock208 may be summarized as providing a metric indicating the level of non-driver initiated motion over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The level of non-driver initiated motion may be expressed in a number of possible ways, such as a linear or non-linear combination of low frequency and high frequency data, which reflects one or both of magnitude of such motion and frequency of direction change of such motion. Preferably, a linear combination of the low frequency and high frequency data is employed and reflects both magnitude and frequency of direction change.[0127]
The outputs of[0128]blocks208 and218 are employed in ablock224 to determine whether a driver meets alertness criteria, as will be described hereinbelow with reference to FIGS. 5 and 6.
Reference is now made to FIG. 3B, which is a simplified flow chart illustrating the functionality of FIGS. 1A and 1B in accordance with another preferred embodiment of the present invention. Generally speaking, the embodiment of FIG. 3B differs from that of FIG. 3A in that the embodiment of FIG. 3B does not separate or separately employ the high frequency portion of the output of a road wheel displacement sensor.[0129]
As seen in FIG. 3B, data from a road wheel influenced displacement sensor, such as either of[0130]sensors126 and128, is normalized, atblock300, preferably to eliminate variations in measurements resulting from differences in the magnitudes of motion sensed by different sensors. Typical normalized data from the road wheel sensor128 (FIG. 2) as a function of time, appear as a solid line in trace A1 of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
The output of[0131]block300, is then filtered, atblock302, to remove noise and other irrelevant data, which in this case preferably includes all signal components having frequencies in excess of approximately 4 Hz. Typical normalized and filtered data from the road wheel sensor128 (FIG. 2) as a function of time, appear as a solid line in trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C.
The output of[0132]block302 is further processed as indicated in ablock310, as is described hereinbelow.
Data from a steering wheel influenced angular displacement sensor, such as either of[0133]sensors122 and124, is normalized, atblock312, preferably to eliminate variations in measurements resulting from differences in the magnitudes of motion sensed by different sensors. Typical normalized data from the steering wheel sensor122 (FIG. 2) as a function of time, appear as a dashed line in trace A1 of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
The output of[0134]block312, is then filtered, atblock314, to remove noise, which in this case preferably includes all signal components having frequencies in excess of approximately 4 Hz. Typical normalized and filtered data from sensor the steering wheel122 (FIG. 2) as a function of time, appear as a dashed line in trace A2 of FIG. 4A, trace B2 of FIG. 4B and trace C2 of FIG. 4C.
The output of[0135]block314 is preferably supplied to block310, which is operative to determine the sign of the phase difference between the output ofblock314 and the output ofblock302, which are respectively represented by the dashed and solid lines in trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C for each of a multiplicity of discrete time durations. This phase difference is defined to be positive, when the output ofblock314, representing the steering wheel influenced motion, leads the output ofblock302, representing the road wheel influenced motion.
There exist various known techniques for determining the phase difference, any suitable one of which may be employed herein. The particular technique employed does not form part of the present invention.[0136]
When the phase difference is positive, the relevant time duration to which that data relates is indicated, at block[0137]316, to be driver initiated motion duration, indicated by a relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing driver initiated motion is then analyzed, atblock318, typically to determine the frequency of occurrence of driver initiated motions, which is an indication of the extent of driver initiated motions. Alternatively or additionally to determining the frequency of occurrence of driver initiated motions, any other suitable metric of the extent of driver initiated motions may be employed.
The frequency of occurrence of driver initiated motions may be determined by counting the number of extrema points in the dashed line appearing in trace A[0138]4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C during the driver initiated motion durations corresponding to the relatively thick lines in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. These extrema points are indicated by circles drawn on the relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C.
When the phase difference is negative, the relevant time duration to which that data relates is indicated, at[0139]block320 to be non-driver initiated motion duration, indicated by a relatively thin line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing non-driver initiated motion is then analyzed, atblock322, in order to further characterize this data. The functionality ofblock322 may include one or more of calculating RMS values, average values, and standard deviations of the low frequency component, typically coupled with the data of the vehicle speed sensor134 (FIG. 2), over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The output of[0140]block322 is supplied to block308 in order to determine the extent of non-driver initiated motion. The functionality ofblock308 may be summarized as providing a metric indicating the level of non-driver initiated motion over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The level of non-driver initiated motion may be expressed in a number of possible ways, such as a linear or non-linear combination of data, which reflects one or both of magnitude of such motion and frequency of direction change of such motion. Preferably, a linear combination of the data is employed and reflects both magnitude and frequency of direction change.[0141]
The outputs of[0142]blocks308 and318 are employed in ablock324 to determine whether a driver meets alertness criteria, as will be described hereinbelow with reference to FIGS. 5 and 6.
Reference is now made to FIG. 3C, which is a simplified flow chart illustrating the functionality of FIGS. 1A and 1B in accordance with still another preferred embodiment of the present invention. Generally speaking, the embodiment of FIG. 3C differs from that of FIG. 3A in that data from an accelerometer, such as the lateral component of data from an acceleration sensor[0143]130 (FIG. 2) fixed to the chassis of a vehicle, is employed instead of data from a road wheel influenced displacement sensor. It is appreciated that as a further alternative, the data from both a road wheel influenced displacement sensor and from an accelerometer may be employed. It is also appreciated that a vertical component from an accelerometer may be employed to represent non-driver initiated motion.
As seen in FIG. 3C, data from an accelerometer, such as[0144]acceleration sensor130, is normalized, atblock400, preferably to eliminate variations in measurements resulting from differences in the magnitudes and dimensions of motions sensed by different sensors. Typically, the normalized data from the lateral component of the output of acceleration sensor130 (FIG. 2) as a function of time, appear as a solid line in trace A1 of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
The output of[0145]block400, is then filtered, atblock402, to remove noise, which in this case preferably includes all signal components having frequencies in excess of approximately 10 Hz. Typical the normalized and filtered data from the lateral component of the output of acceleration sensor130 (FIG. 2) as a function of time, appear as a solid line in trace A2 of FIG. 4A, trace B2 of FIG. 4B and trace C2 of FIG. 4C.
The output of[0146]block402 is split into high and low frequency components, preferably above and below 4 Hz, as indicated inblock404. The high frequency component of typical normalized and filtered data from the lateral component of the output of acceleration sensor130 (FIG. 2) as a functions of time, appear as trace A3 of FIG. 4A, trace B3 of FIG. 4B and trace C3 of FIG. 4C. The low frequency component of typical normalized and filtered data from the lateral component of the output of acceleration sensor130 (FIG. 2) as a function of time, appear as a solid line in each of trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C.
The high frequency component output of[0147]block404 is further processed, typically with the data from the vehicle speed sensor134 (FIG. 2), as indicated in ablock406, to further characterize this component. The functionality ofblock406 may include one or more of calculating RMS values, average values, and standard deviations of the high frequency component, typically with the data from the vehicle speed sensor134 (FIG. 2), over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C. Optionally, a vertical component of the output ofacceleration sensor130 may also be employed inblock406.
The output of[0148]block406 is employed to determine the extent of non-driver initiated motion, as indicated in ablock408.
The low frequency component output of[0149]block404 is further processed as indicated in ablock410, as is described hereinbelow.
Data from a steering wheel influenced angular displacement sensor, such as either of[0150]sensors122 and124, is normalized, atblock412, preferably to eliminate variations in measurements resulting from differences in the magnitudes of motion sensed by different sensors. Typical normalized data from the steering wheel sensor122 (FIG. 2) as a function of time, appear as a dashed line in trace Al of FIG. 4A, trace B1 of FIG. 4B and trace C1 of FIG. 4C.
The output of[0151]block412, is then filtered, atblock414, to remove noise, which in this case preferably includes all signal components having frequencies in excess of approximately 10 Hz. Typical normalized and filtered data from the steering wheel sensor122 (FIG. 2) as a function of time, appear as a dashed line in trace A2 of FIG. 4A, trace B2 of FIG. 4B and trace C2 of FIG. 4C.
The output of[0152]block414 is preferably supplied to block410, which is operative to determine the sign of the phase difference between the output ofblock414 and the output ofblock404, which are respectively represented by the dashed and solid lines in trace A4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C for each of a multiplicity of discrete time durations. This phase difference is defined to be positive, when the output ofblock414, representing the steering wheel influenced motion, leads the output ofblock404, representing the low frequency component of the road wheel influenced motion.
There exist various known techniques for determining the phase difference, any suitable one of which may be employed herein. The particular technique employed does not form part of the present invention.[0153]
When the phase difference is positive, the relevant time duration to which that data relates is indicated, at[0154]block416, to be driver initiated motion duration, indicated by a relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing driver initiated motion is then analyzed, atblock418, typically to determine the frequency of occurrence of driver initiated motions, which is an indication of the extent of driver initiated motions. Alternatively or additionally to determining the frequency of occurrence of driver initiated motions, any other suitable metric of the extent of driver initiated motions may be employed.
The frequency of occurrence of driver initiated motions may be determined by counting the number of extrema points in the dashed line appearing in trace A[0155]4 of FIG. 4A, trace B4 of FIG. 4B and trace C4 of FIG. 4C during the driver initiated motion durations corresponding to the relatively thick lines in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. These extrema points are indicated by circles drawn on the relatively thick line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C.
When the phase difference is negative, the relevant time duration to which that data relates is indicated, at[0156]block420 to be non-driver initiated motion duration, indicated by a relatively thin line in trace A5 of FIG. 4A, trace B5 of FIG. 4B and trace C5 of FIG. 4C. The data representing non-driver initiated motion is then analyzed, atblock422, in order to further characterize this data. The functionality ofblock422 may include one or more of calculating RMS values, average values, and standard deviations of the low frequency component, typically with the data from the vehicle speed sensor134 (FIG. 2), over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The output of[0157]block422 is supplied to block408 along with the output fromblock406 in order to determine the extent of non-driver initiated motion. The functionality ofblock408 may be summarized as providing a metric indicating the level of non-driver initiated motion over successive time periods, three of which are represented by respective FIGS. 4A, 4B and4C.
The level of non-driver initiated motion may be expressed in a number of possible ways, such as a linear or non-linear combination of low frequency and high frequency data, which reflects one or both of magnitude of such motion and frequency of direction change of such motion. Preferably, a linear combination of the low frequency and high frequency data is employed and reflects both magnitude and frequency of direction change.[0158]
The outputs of[0159]blocks408 and418 are employed in ablock424 to determine whether a driver meets alertness criteria, as will be described hereinbelow with reference to FIGS. 5 and 6.
It is appreciated that in the embodiments of FIGS. 3A and 3B, the output of[0160]acceleration sensor130 may be employed in place of or in addition to the output of a road-wheel influenced angular displacement sensor.
Reference is now made to FIGS. 5 and 6, which illustrate utilization of determinations of extent of driver initiated and non-driver initiated motions for determining driver alertness. Typically, the Threshold Line is initially determined as discussed hereinabove ([0161]step600, FIG. 6).
Preferably, as seen in FIG. 5, for each given time period, such as the three time periods represented by FIGS. 4A, 4B and[0162]4C, the extent of driver initiated motion and the extent of non-driver initiated motion are plotted in “Extent Space” (step602, FIG. 6). Each such time period is represented by a single point in “Extent Space”. Thus it may be seen in FIG. 5, that apoint550 represents the extent of driver initiated motion and the extent of non-driver initiated motion for the time period represented by FIG. 4A.
In the embodiments of FIGS. 3A, 3B and[0163]3C, the extent of driver initiated motions is preferably derived from the frequency of their occurrence, as exemplified by the number of circles appearing in traces A5, B5 and C5, respectively in FIGS. 4A, 4B and4C.
In the embodiments of FIGS. 3A and 3C, the extent of non-driver initiated motions is preferably derived from the amplitude of the high frequency component of the non-driver initiated motions, as exemplified by the amplitudes appearing in traces A[0164]3, B3 and C3, typically combined with the amplitude of the low frequency component of the non-driver initiated motions taken together with other data relating thereto, such as the frequency of occurrence.
In the embodiment of FIG. 3B, the extent of non-driver initiated motions is preferably derived from the amplitude of the low frequency component of the non-driver initiated motions taken together with other data relating thereto, such as the frequency of occurrence.[0165]
Referring again to FIG. 5,[0166]point560 represents the extent of driver initiated motion and the extent of non-driver initiated motion for the time period represented by FIG. 4B and pointy570 represents the extent of driver initiated motion and the extent of non-driver initiated motion for the time period represented by FIG. 4C.
Similar plots in FIGS. 1A and 1B represent the extent of driver initiated motion and the extent of non-driver initiated motion for a relatively large number of time periods.[0167]
As seen in FIGS. 1A, 1B and[0168]5, there appears a threshold line that differentiates couples of the extent of driver initiated motion and the extent of non-driver initiated motion for a given time period and being characteristic of driver alertness (above the line) and non-alertness (below the line).
In reality, this threshold line may be fixed or variable as the result of variations in one or more parameters, including, inter alia, vehicle speed, elapsed duration of trip, known or earlier determined driving characteristics of the driver, travel conditions and type of vehicle.[0169]
A determination of driver alertness or non-alertness may be a cumulative determination based on a weighting of the points appearing above and below the threshold line, once a statistically acceptable sample is achieved ([0170]steps604 and606, FIG. 6). Alternatively or additionally, it may be a determination based on the change in the position of successive points relative to the threshold line and relative to each other as time passes.
Based on the determination of driver alertness or non-alertness made from time to time, an appropriate alarm indication is provided to the driver (step[0171]608, FIG. 6), preferably via alarm136 (FIG. 2).
It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove as well as variations and modifications which would occur to persons skilled in the art upon reading the specification and which are not in the prior art.[0172]