US5963148A - Road situation perceiving system - Google Patents
Road situation perceiving systemDownload PDFInfo
- Publication number
- US5963148A US5963148AUS08/929,010US92901097AUS5963148AUS 5963148 AUS5963148 AUS 5963148AUS 92901097 AUS92901097 AUS 92901097AUS 5963148 AUS5963148 AUS 5963148A
- Authority
- US
- United States
- Prior art keywords
- road
- image
- abnormal
- temperature zone
- temperature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096708—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
- G08G1/096716—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information does not generate an automatic action on the vehicle control
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096733—Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place
- G08G1/09675—Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place where a selection from the received information takes place in the vehicle
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096766—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
- G08G1/096791—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is another vehicle
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/0969—Systems involving transmission of navigation instructions to the vehicle having a display in the form of a map
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
Definitions
- the present inventionrelates to a road situation perceiving system for perceiving snow, ice, a person, an animal and other impediments and obstacles existing on a road ahead of a subject vehicle without relying on a driver's visual judgment.
- a techniqueis known from a Japanese Patent Application Laid-open No. 89298/85, which judges whether it is possible for a subject vehicle to pass through a curve ahead of the subject vehicle in a traveling direction at the current speed by estimating a radius of curvature of the curve based on map data obtained by a navigation system. According to the known technique an alarm is given to a driver when it is determined that it is impossible for the subject vehicle to pass through the curve at the current speed.
- the above known techniqueit is possible to perceive the condition of the curve of the road ahead at a position short of the curve to perform a countermeasure such as a speed reduction.
- the above known techniquehas a limitation in that it is impossible to perceive an iced condition of a road ahead of the subject vehicle or a potentially hazardous situation such as an existence of a walker on a road.
- the known techniquedoes not alleviate a burden on the driver in a poor-visibility condition, particularly, in the night or in a fog, of having to perceive such road conditions and obstacles.
- a road situation perceiving systemcomprising: a map information outputting means for outputting map information as an aggregate of a plurality of coordinate points constituting a map; a subject-vehicle position detecting means for detecting the position of a subject vehicle on the map; a road shape detecting means for detecting a shape of a road ahead of the position of the subject vehicle based on the map information; an image forming means for forming an image of a road area ahead of the vehicle based on the detected road shape; a temperature profile detecting means for detecting a temperature profile ahead of the vehicle; a superposing means for superposing the temperature profile on the image of the road area; an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area; an alarm means for providing an alarm to a driver of the subject vehicle; and a control means for operating the alarm means when it is determined that there is the abnormal-temperature zone in
- the image of the road area ahead of the vehicleis formed from the road shape based on the map information, and the temperature profile is superposed on the road area to judge whether there is the abnormal-temperature zone existing in the road area.
- an alarmis given to the vehicle driver.
- a road situation perceiving systemcomprising: a camera means for talking an image ahead of a vehicle; a road area judging means for judging a road area within the image by an image-processing; a temperature profile detecting means for detecting a temperature profile ahead of the vehicle; a superposing means for superposing the temperature profile on the image of the road area; an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area; an alarm means for providing an alarm to a driver of the vehicle; and a control means for operating the alarm means when it is determined that there is the abnormal-temperature zone.
- the image ahead of the vehicle taken by the camera meansis subjected to an image-processing to determine the road area.
- the temperature profile ahead of the vehicleis superposed on the road area to judge whether there is the abnormal-temperature zone existing in the road area.
- an alarmis given to the vehicle driver.
- the abnormal-temperature zoneis judged as a low-temperature zone equal to or lower than a predetermined temperature.
- the third feature of the present inventionit is possible to timely prevent a slipping of the vehicle due to snow or ice by judging the existence of the low-temperature zone ahead of the vehicle equal to or lower than the predetermined temperature, so that an appropriate countermeasure may be timely performed, if necessary.
- the abnormal-temperature zoneis judged as a high-temperature zone equal to or higher than a predetermined temperature.
- the fourth feature of the present inventionit is possible to timely prevent the collision of the vehicle against a person or an animal by judging the existence of the high-temperature zone ahead of the vehicle equal to or higher than the predetermined temperature, so that an appropriate countermeasure may be timely performed, if necessary.
- the road situation perceiving systemfurther includes a display means for displaying the image of the road area, and when it is determined that there is the abnormal-temperature zone, the control means displays the position of the abnormal-temperature zone on the image of the road area.
- the fifth feature of the present inventionit is possible to reliably inform the driver of the position of an oncoming obstacle or hazardous situation even in the night or in a poor-visibility condition by displaying the abnormal-temperature zone on the image of the road area.
- FIG. 1is a block diagram illustrating the entire arrangement of a road situation perceiving system according to a first embodiment of the present invention
- FIG. 2is a flow chart for explaining the operation of the system of FIG. 1;
- FIG. 3is a diagram illustrating a road shape read from a course searching means
- FIG. 4is a diagram illustrating a method for converting a road shape into an image
- FIG. 5is an illustration of an image of a road area displayed on a display means.
- FIG. 6is a block diagram similar to FIG. 1, but showing a second embodiment.
- a navigation system NV for a vehicleincludes an inertial navigating device 3 to which signals from a yaw rate sensor 1 and a vehicle speed sensor 2 are input, a map information outputting means 4 using an IC card or CD-ROM, and a map matching means 5 for superposing a vehicle travel locus output by the inertial navigating device 3 and a map information output by the map information outputting means 4 on each other.
- the navigation system NVfurther preferably includes a GPS unit 7 to which a signal from GPS antenna 6 is input, a subject-vehicle position detecting means 8 for detecting the position of a subject vehicle based on position coordinates output by the map matching means 5 and position coordinates output by the GPS unit 7, and a course searching means 10 for searching a course to a destination based on a destination coordinate signal from a destination input means 9 and subject-vehicle position coordinates output from the subject-vehicle position detecting means 8.
- a road situation perceiving section SDincludes a road shape detecting means 11 for detecting a road shape in a predetermined range ahead of the position of the subject vehicle from a road searched by the course searching means 10, an image forming means 12 for converting the road shape detected by the road shape detecting means 11 into an image of a road area viewable by a driver of the vehicle, a display means 13 such as a CRT for displaying the image formed by the image forming means 12, and a temperature profile detecting means 14 such as an infrared camera.
- the road situation perceiving section SDfurther includes a superposing means 15 for superposing the temperature profile ahead of the subject-vehicle position detected by the temperature profile detecting means 14 on the image formed by the image forming means 12, an abnormal-temperature zone judging means 16 for judging whether there is an abnormal-temperature zone (low temperature or high temperature) within the road area on which the temperature profile has been superposed, and a control means 18 which operates an alarm means 17 such as buzzer, chime, voice and the like and displays the abnormal-temperature zone on the image of the road area displayed on the display means 13, when it is determined that the abnormal-temperature zone exists.
- an alarm means 17such as buzzer, chime, voice and the like
- the road shape detecting means 11reads the road shape in the predetermined range ahead of the subject-vehicle position from the course searching means 10.
- the road shape in the predetermined range ahead of the subject-vehicle positionis represented by a plurality of coordinate points P O (X O , Y O ), P 1 (X 1 , Y 1 ), P 2 (X 2 , Y 2 ), - - - P n (X n , Y n ) in an X-Y rectangular coordinate system having the origin provided by a subject vehicle position P O , a Y-axis in a direction of movement of the vehicle and an X-axis in a direction perpendicular to the direction of movement of the vehicle.
- the image forming means 12converts the road shape shown in FIG. 3 into an image of a road area which is actually perceivable visually by a driver.
- the road shape actually perceivable visually by the drivercan be obtained by converting the X-Y rectangular coordinate system shown in FIG. 3 into an x-y rectangular coordinate system shown in FIG. 4.
- the image of the road area actually perceivable visually by the drivercan be obtained by converting the coordinate points P 0 (X 0 , Y 0 ), P 1 (X 1 , Y 1 ), P 2 (X 2 , Y 2 ), - - - P n (X n , Y n ) representing the road shape in the X-Y rectangular coordinate system into coordinate points p 0 (x 0 , y 0 ), p 1 (x 1 , y 1 ), p 2 (x 2 , y 2 ), - - - p n (x n , y n ) in the x-y rectangular coordinate system and adding a road width to these coordinates points (see FIG. 4).
- a temperature profile ahead of the vehicleis detected by the temperature profile detecting means 14 such as an infrared camera.
- the image of the road area and the temperature profileare superposed on each other by the superposing means 15.
- the abnormal-temperature zone judging means 16determines at step S5 that there is a low-temperature zone equal to or lower than a predetermined temperature, such as caused by snow and ice existing within the road area, or that there is a high-temperature zone equal to or higher than a predetermined temperature, such as caused by a person and animal existing within the road area
- the control means 18operates the alarm means 17 to provide an alarm to the driver such as a warning sound or voice.
- the position of the high-or low-temperature zone detected within the road areais superposed on the road area displayed on the display means 13, such as a CRT, and is indicated by a red or blue or other highly noticeable color flashing.
- the drivereven in the night or other poor visibility condition, it is possible for the driver to timely perceive the kind and position of the obstruction or hazard ahead of the driver, thereby permitting the driver to take an advance countermeasure for avoiding the slipping of the vehicle due to snow or ice, or the collision against the person or animal.
- the iced state of a wetted road surface which is difficult to visually perceivecan be reliably perceived according to the invention at a position short of such road surface and hence, the driver is afforded the time to effect the countermeasure such as a speed-reduction or a steering maneuver for avoidance of the obstruction or hazardous situation.
- the second embodimentdoes not use the navigation system NV and in place thereof, uses a camera means 19 such as a video camera for taking an image ahead of the vehicle.
- the image ahead of the vehicle taken by the camera means 19is input to a road area judging means 20, where a road area is judged based on a white line or the like drawn on a road.
- a temperature profile detected by the temperature profile detecting means 14is superposed in the image of the road ahead of the vehicle. If there is an abnormal temperature zone existing within the road area, the control means 18 provides an alarm to the driver through the alarm means 17 and/or the display means 13.
- an operational effect similar to that in the first embodimentcan be achieved even in a vehicle which is not equipped with the navigation system.
- the displayis not necessarily required.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Atmospheric Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
- Instructional Devices (AREA)
- Emergency Alarm Devices (AREA)
Abstract
Description
This is a file wrapper continuation of prior application Ser. No. 08/605,948 filed Feb. 23, 1996 (now abandoned).
1. Field of the Invention
The present invention relates to a road situation perceiving system for perceiving snow, ice, a person, an animal and other impediments and obstacles existing on a road ahead of a subject vehicle without relying on a driver's visual judgment.
2. Description of the Related Art
A technique is known from a Japanese Patent Application Laid-open No. 89298/85, which judges whether it is possible for a subject vehicle to pass through a curve ahead of the subject vehicle in a traveling direction at the current speed by estimating a radius of curvature of the curve based on map data obtained by a navigation system. According to the known technique an alarm is given to a driver when it is determined that it is impossible for the subject vehicle to pass through the curve at the current speed.
In the above known technique, it is possible to perceive the condition of the curve of the road ahead at a position short of the curve to perform a countermeasure such as a speed reduction. However, the above known technique has a limitation in that it is impossible to perceive an iced condition of a road ahead of the subject vehicle or a potentially hazardous situation such as an existence of a walker on a road. Correspondingly, the known technique does not alleviate a burden on the driver in a poor-visibility condition, particularly, in the night or in a fog, of having to perceive such road conditions and obstacles.
Accordingly, it is an object of the present invention to provide a road situation perceiving system which is capable of perceiving a road situation ahead of the subject vehicle so that an appropriate countermeasure may be performed, if necessary, without relying on a driver's visual judgment.
To achieve the above object, according to a first aspect and feature of the present invention, there is provided a road situation perceiving system, comprising: a map information outputting means for outputting map information as an aggregate of a plurality of coordinate points constituting a map; a subject-vehicle position detecting means for detecting the position of a subject vehicle on the map; a road shape detecting means for detecting a shape of a road ahead of the position of the subject vehicle based on the map information; an image forming means for forming an image of a road area ahead of the vehicle based on the detected road shape; a temperature profile detecting means for detecting a temperature profile ahead of the vehicle; a superposing means for superposing the temperature profile on the image of the road area; an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area; an alarm means for providing an alarm to a driver of the subject vehicle; and a control means for operating the alarm means when it is determined that there is the abnormal-temperature zone in the road area.
With the first feature of the present invention, the image of the road area ahead of the vehicle is formed from the road shape based on the map information, and the temperature profile is superposed on the road area to judge whether there is the abnormal-temperature zone existing in the road area. When there is the abnormal-temperature zone existing, an alarm is given to the vehicle driver.
According to a second aspect and feature of the present invention, there is provided a road situation perceiving system, comprising: a camera means for talking an image ahead of a vehicle; a road area judging means for judging a road area within the image by an image-processing; a temperature profile detecting means for detecting a temperature profile ahead of the vehicle; a superposing means for superposing the temperature profile on the image of the road area; an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area; an alarm means for providing an alarm to a driver of the vehicle; and a control means for operating the alarm means when it is determined that there is the abnormal-temperature zone.
With the second feature of the present invention, the image ahead of the vehicle taken by the camera means is subjected to an image-processing to determine the road area. The temperature profile ahead of the vehicle is superposed on the road area to judge whether there is the abnormal-temperature zone existing in the road area. When there is the abnormal-temperature zone existing in the road area, an alarm is given to the vehicle driver.
According to a third aspect and feature of the present invention, in addition to the first or second feature, the abnormal-temperature zone is judged as a low-temperature zone equal to or lower than a predetermined temperature.
With the third feature of the present invention, it is possible to timely prevent a slipping of the vehicle due to snow or ice by judging the existence of the low-temperature zone ahead of the vehicle equal to or lower than the predetermined temperature, so that an appropriate countermeasure may be timely performed, if necessary.
According to a fourth aspect and feature of the present invention, in addition to the first or second feature, the abnormal-temperature zone is judged as a high-temperature zone equal to or higher than a predetermined temperature.
With the fourth feature of the present invention, it is possible to timely prevent the collision of the vehicle against a person or an animal by judging the existence of the high-temperature zone ahead of the vehicle equal to or higher than the predetermined temperature, so that an appropriate countermeasure may be timely performed, if necessary.
According to a fifth aspect and feature of the present invention, in addition to the first or second feature, the road situation perceiving system further includes a display means for displaying the image of the road area, and when it is determined that there is the abnormal-temperature zone, the control means displays the position of the abnormal-temperature zone on the image of the road area.
With the fifth feature of the present invention, it is possible to reliably inform the driver of the position of an oncoming obstacle or hazardous situation even in the night or in a poor-visibility condition by displaying the abnormal-temperature zone on the image of the road area.
The above and other objects, features and advantages of the invention will become apparent from the following detailed description of preferred embodiments taken in conjunction with the accompanying drawings.
FIG. 1 is a block diagram illustrating the entire arrangement of a road situation perceiving system according to a first embodiment of the present invention;
FIG. 2 is a flow chart for explaining the operation of the system of FIG. 1;
FIG. 3 is a diagram illustrating a road shape read from a course searching means;
FIG. 4 is a diagram illustrating a method for converting a road shape into an image;
FIG. 5 is an illustration of an image of a road area displayed on a display means; and
FIG. 6 is a block diagram similar to FIG. 1, but showing a second embodiment.
The present invention will now be described by way of preferred embodiments with references to the accompanying drawings.
Referring to FIG. 1, a navigation system NV for a vehicle includes an inertial navigatingdevice 3 to which signals from ayaw rate sensor 1 and avehicle speed sensor 2 are input, a map information outputting means 4 using an IC card or CD-ROM, and a map matching means 5 for superposing a vehicle travel locus output by the inertial navigatingdevice 3 and a map information output by the map information outputting means 4 on each other. The navigation system NV further preferably includes aGPS unit 7 to which a signal fromGPS antenna 6 is input, a subject-vehicle position detecting means 8 for detecting the position of a subject vehicle based on position coordinates output by the map matching means 5 and position coordinates output by theGPS unit 7, and a course searching means 10 for searching a course to a destination based on a destination coordinate signal from a destination input means 9 and subject-vehicle position coordinates output from the subject-vehicle position detecting means 8.
A road situation perceiving section SD includes a road shape detecting means 11 for detecting a road shape in a predetermined range ahead of the position of the subject vehicle from a road searched by the course searching means 10, animage forming means 12 for converting the road shape detected by the road shape detecting means 11 into an image of a road area viewable by a driver of the vehicle, a display means 13 such as a CRT for displaying the image formed by theimage forming means 12, and a temperature profile detecting means 14 such as an infrared camera. The road situation perceiving section SD further includes asuperposing means 15 for superposing the temperature profile ahead of the subject-vehicle position detected by the temperature profile detecting means 14 on the image formed by theimage forming means 12, an abnormal-temperature zone judging means 16 for judging whether there is an abnormal-temperature zone (low temperature or high temperature) within the road area on which the temperature profile has been superposed, and a control means 18 which operates an alarm means 17 such as buzzer, chime, voice and the like and displays the abnormal-temperature zone on the image of the road area displayed on the display means 13, when it is determined that the abnormal-temperature zone exists.
The operation of the first embodiment of the present invention will be described below with reference to the flow chart in FIG. 2.
First, at step S1, the road shape detecting means 11 reads the road shape in the predetermined range ahead of the subject-vehicle position from the course searching means 10. As shown in FIG. 3, the road shape in the predetermined range ahead of the subject-vehicle position is represented by a plurality of coordinate points PO (XO, YO), P1 (X1, Y1), P2 (X2, Y2), - - - Pn (Xn, Yn) in an X-Y rectangular coordinate system having the origin provided by a subject vehicle position PO, a Y-axis in a direction of movement of the vehicle and an X-axis in a direction perpendicular to the direction of movement of the vehicle.
Then, at step S2, the image forming means 12 converts the road shape shown in FIG. 3 into an image of a road area which is actually perceivable visually by a driver. Specifically, the road shape actually perceivable visually by the driver can be obtained by converting the X-Y rectangular coordinate system shown in FIG. 3 into an x-y rectangular coordinate system shown in FIG. 4. At this time, a group of parallel lines (X=const.) in the X-Y rectangular coordinate system is a group of radiate straight lines converging into a point which is infinitely remote from the vehicle, and a group of parallel lines (Y=const.) in the X-Y rectangular coordinate system is a group of parallel lines, the distance between the lines is more reduced at a more remote point in the x-y coordinate system.
Thus, the image of the road area actually perceivable visually by the driver can be obtained by converting the coordinate points P0 (X0, Y0), P1 (X1, Y1), P2 (X2, Y2), - - - Pn (Xn, Yn) representing the road shape in the X-Y rectangular coordinate system into coordinate points p0 (x0, y0), p1 (x1, y1), p2 (x2, y2), - - - pn (xn, yn) in the x-y rectangular coordinate system and adding a road width to these coordinates points (see FIG. 4).
Then, at step S3, a temperature profile ahead of the vehicle is detected by the temperature profile detecting means 14 such as an infrared camera. At step S4, the image of the road area and the temperature profile are superposed on each other by thesuperposing means 15. If the abnormal-temperature zone judging means 16 determines at step S5 that there is a low-temperature zone equal to or lower than a predetermined temperature, such as caused by snow and ice existing within the road area, or that there is a high-temperature zone equal to or higher than a predetermined temperature, such as caused by a person and animal existing within the road area, the control means 18 operates the alarm means 17 to provide an alarm to the driver such as a warning sound or voice. At the same time, the position of the high-or low-temperature zone detected within the road area is superposed on the road area displayed on the display means 13, such as a CRT, and is indicated by a red or blue or other highly noticeable color flashing.
Thus, even in the night or other poor visibility condition, it is possible for the driver to timely perceive the kind and position of the obstruction or hazard ahead of the driver, thereby permitting the driver to take an advance countermeasure for avoiding the slipping of the vehicle due to snow or ice, or the collision against the person or animal. Especially, the iced state of a wetted road surface which is difficult to visually perceive can be reliably perceived according to the invention at a position short of such road surface and hence, the driver is afforded the time to effect the countermeasure such as a speed-reduction or a steering maneuver for avoidance of the obstruction or hazardous situation.
A second embodiment of the present invention will be described below with reference to FIG. 6.
The second embodiment does not use the navigation system NV and in place thereof, uses a camera means 19 such as a video camera for taking an image ahead of the vehicle. The image ahead of the vehicle taken by the camera means 19 is input to a road area judging means 20, where a road area is judged based on a white line or the like drawn on a road. Thereafter, as in the first embodiment, a temperature profile detected by the temperature profile detecting means 14 is superposed in the image of the road ahead of the vehicle. If there is an abnormal temperature zone existing within the road area, the control means 18 provides an alarm to the driver through the alarm means 17 and/or the display means 13.
According to the second embodiment, an operational effect similar to that in the first embodiment can be achieved even in a vehicle which is not equipped with the navigation system.
Although the presently preferred embodiments of the present invention have been described in detail, the present invention is not limited to the above-embodiments, and it will be apparent to persons of ordinary skill in the art that various modifications may be made without departing from the spirit and scope of the invention defined in claims.
For example, it is possible to perform an automatic speed reduction and/or a steering assist for avoiding the obstruction or hazard in addition to providing the alarm by the alarm means. If the driver is informed of the sort, direction, distance and the like of the obstruction or hazard by a voice, the display is not necessarily required.
Claims (18)
1. A road situation perceiving system, comprising:
a map information outputting means for outputting map information as an aggregate of a plurality of coordinate points constituting a map;
a subject-vehicle position detecting means for detecting the position of a subject vehicle on the map;
a road shape detecting means for detecting a shape of a road ahead of the position of the subject vehicle based on the map information;
an image forming means for forming an image of a road area ahead of the vehicle based on the detected road shape;
a temperature profile detecting means for detecting a temperature profile ahead of the vehicle;
a superposing means for superposing said temperature profile on said image of the road area;
an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in said road area;
an alarm means for providing an alarm to a driver of the subject vehicle; and
a control means for operating said alarm means when it is determined that there is the abnormal-temperature zone.
2. A road situation perceiving system, comprising;
a camera means for taking an image ahead of a vehicle,
a road area judging means for judging a road area within said image by an image-processing;
a temperature profile detecting means for detecting a temperature profile ahead of the vehicle;
a superposing means for superposing said temperature profile on said image of said road area;
an abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone on or above a surface of said road area based on the superposed temperature profile on the image of the road area;
an alarm means for providing an alarm to a driver of the vehicle; and
a control means for operating said alarm means when it is determined that there is the abnormal-temperature zone.
3. A road situation perceiving system according to claim 1, wherein said abnormal-temperature zone is a low-temperature zone equal to or lower than a predetermined temperature.
4. A road condition perceiving system according to claim 1, wherein said abnormal-temperature zone is a high-temperature zone equal to or higher than a predetermined temperature.
5. A road situation perceiving system according to claim 1, further including a display means for displaying the image of the road area, and wherein when it is determined that there is the abnormal-temperature zone, said control means displays the position of said abnormal-temperature zone on said image of the road area.
6. A road situation perceiving system according to claim 2, wherein said abnormal-temperature zone is a low-temperature zone equal to or lower than a predetermined temperature zone.
7. A road situation perceiving system according to claim 2, wherein said abnormal-temperature zone is a high-temperature zone equal to or higher than a predetermined temperature.
8. A road situation perceiving system according to claim 2, further including a display means for displaying the image of the road area, and wherein when it is determined that there is the abnormal-temperature zone, said control means displays the position of said abnormal-temperature zone on said image of the road area.
9. A road situation perceiving system according to claim 1, further including means for inputting a destination of the subject vehicle, and said road shape detecting means detects the shape of the road ahead of the position of the subject vehicle additionally based on an input destination of the vehicle.
10. A road situation perceiving system according to claim 2, wherein said camera means takes an image of a space ahead of the vehicle.
11. A road situation perceiving system, comprising:
road image determining means for determining an image of a road area ahead of a subject vehicle;
temperature profile detecting means for detecting a temperature profile of temperatures throughout a space ahead of the subject vehicle;
abnormal-temperature zone judging means for judging abnormal-temperature zones on and above a surface of the road area ahead of the subject vehicle based on outputs from said road image determining means and said temperature profile detecting means; and
alarm means for providing an alarm to a driver of the vehicle when it is judged that there is an abnormal-temperature zone in the road area ahead of the subject vehicle;
said abnormal-temperature zone judging means judging whether there is an abnormal-temperature zone by comparing the output from the road image determining means to the output of said temperature profile detecting means; and
said abnormal-temperature zone judging means compares said outputs of said road image determining means and said temperature profile detecting means by superposing one of said outputs over the other.
12. A road situation perceiving system according to claim 11, further including:
means for outputting map information as an aggregate of a plurality of coordinate points constituting a map; and
subject vehicle position detecting means for detecting a position of the subject vehicle on the map; and
said road image determining means determines the image of the road area ahead of the vehicle based on outputs of said map information outputting means and said subject vehicle position detecting means.
13. A road situation perceiving system according to claim 12, further including means for inputting a destination of said subject vehicle, and said road image determining means further determines the image of the road area based on an input destination of said subject vehicle.
14. A road situation perceiving system according to claim 11, wherein said abnormal-temperature zone is a temperature zone outside of a predetermined temperature range.
15. A road situation perceiving system according to claim 11, further including a camera means for taking an image ahead of a vehicle; and
said road image determining means forms the image of the road area by an image-processing of said image taken by the camera means.
16. A road situation perceiving system according to claim 11, wherein said temperature profile detecting means comprises an infrared camera.
17. A road situation perceiving system, comprising:
road image determining means for determining an image of a road area ahead of a subject vehicle;
temperature profile detecting means for detecting a temperature profile of a space ahead of the subject vehicle:
abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area ahead of the subject vehicle based on outputs from said road image determining means and said temperature profile detecting means;
alarm means for providing an alarm to a driver of the subject vehicle when it is judged that there is the abnormal-temperature zone in the road area ahead of the subject vehicle; and
a superposing means for superposing said temperature profile on said image of the road area; and
said abnormal-temperature zone judging means judges whether there is the abnormal-temperature zone in said road area based on the superposed temperature profile on said image of the road area.
18. A road situation perceiving system, comprising:
road image determining means for determining an image of a road area ahead of a subject vehicle;
temperature profile detecting means for detecting a temperature profile of a space ahead of the subject vehicle;
abnormal-temperature zone judging means for judging whether there is an abnormal-temperature zone in the road area ahead of the subject vehicle based on outputs from still road image determining means and said temperature profile detecting means;
alarm means for providing an alarm to a driver of the subject vehicle when it is judged that there is the abnormal-temperature zone in the road area ahead of the subject vehicle; and
a display means for displaying the image of the road area; and
said alarm means displays the position of said abnormal-temperature zone on the display image of the road area when it is determined that there is the abnormal-temperature zone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/929,010US5963148A (en) | 1995-03-23 | 1997-09-08 | Road situation perceiving system |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP7-064587 | 1995-03-23 | ||
| JP7064587AJPH08263784A (en) | 1995-03-23 | 1995-03-23 | Road condition recognition device |
| US60594896A | 1996-02-23 | 1996-02-23 | |
| US08/929,010US5963148A (en) | 1995-03-23 | 1997-09-08 | Road situation perceiving system |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US60594896AContinuation | 1995-03-23 | 1996-02-23 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US5963148Atrue US5963148A (en) | 1999-10-05 |
Family
ID=13262538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US08/929,010Expired - Fee RelatedUS5963148A (en) | 1995-03-23 | 1997-09-08 | Road situation perceiving system |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US5963148A (en) |
| JP (1) | JPH08263784A (en) |
| DE (1) | DE19609488B4 (en) |
Cited By (59)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6173231B1 (en) | 2000-01-31 | 2001-01-09 | Navigation Technologies Corp. | Method and system for collecting data concerning thermal properties of roads for a geographic database and use thereof in a vehicle safety system |
| US20010010541A1 (en)* | 1998-03-19 | 2001-08-02 | Fernandez Dennis Sunga | Integrated network for monitoring remote objects |
| US6281806B1 (en) | 2000-10-12 | 2001-08-28 | Ford Global Technologies, Inc. | Driver road hazard warning and illumination system |
| US6459365B2 (en)* | 2000-03-08 | 2002-10-01 | Honda Giken Kogyo Kabushiki Kaisha | Dangerous area alarm system |
| US20020171739A1 (en)* | 2001-05-15 | 2002-11-21 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Surrounding conditions display apparatus |
| US20030043029A1 (en)* | 2001-08-31 | 2003-03-06 | Kabushiki Kaisha Tokai Rika Denki Seisakusho | On-vehicle infrared image display unit |
| US6531959B1 (en)* | 1999-07-13 | 2003-03-11 | Honda Giken Kogyo Kabushiki Kaisha | Position detecting device |
| US6538622B1 (en)* | 1999-01-26 | 2003-03-25 | Mazda Motor Corporation | Display apparatus on a vehicle |
| EP1152218A3 (en)* | 2000-04-24 | 2003-05-02 | Matsushita Electric Industrial Co., Ltd. | Navigation device |
| US20030138133A1 (en)* | 2002-01-18 | 2003-07-24 | Honda Giken Kogyo Kabushiki Kaisha | Device for monitoring around a vehicle |
| US6630891B1 (en) | 2002-05-27 | 2003-10-07 | Emery W. Dilling | Vehicle warning system |
| US20040051659A1 (en)* | 2002-09-18 | 2004-03-18 | Garrison Darwin A. | Vehicular situational awareness system |
| US6731204B2 (en) | 2002-02-19 | 2004-05-04 | Continental Teves, Inc. | Object detection system providing driver information through sound |
| US6748302B2 (en)* | 2001-01-18 | 2004-06-08 | Nissan Motor Co., Ltd. | Lane tracking control system for vehicle |
| US6759949B2 (en) | 2002-05-23 | 2004-07-06 | Visteon Global Technologies, Inc. | Image enhancement in far infrared camera |
| FR2851837A1 (en)* | 2003-02-27 | 2004-09-03 | Peugeot Citroen Automobiles Sa | Pedestrian detection method in environs of motor vehicle, uses thermal image of view ahead of vehicle, extracts hottest sources and compares them with characteristics of pedestrian, presenting enhanced display on in-vehicle screen |
| US20040189448A1 (en)* | 2003-03-24 | 2004-09-30 | Helmuth Eggers | Video display for a vehicle environment surveillance unit |
| US20040201483A1 (en)* | 2003-02-21 | 2004-10-14 | Stam Joseph S. | Automatic vehicle exterior light control systems |
| US20040204812A1 (en)* | 2003-04-09 | 2004-10-14 | Continental Teves Inc. | Road recognition system |
| US6819245B1 (en) | 2002-05-27 | 2004-11-16 | Emery W. Dilling | Security system |
| EP1491978A1 (en)* | 2003-06-27 | 2004-12-29 | Volkswagen Aktiengesellschaft | Identification of collision objects |
| EP1564703A1 (en)* | 2004-02-13 | 2005-08-17 | Fuji Jukogyo Kabushiki Kaisha | Vehicle driving assist system |
| US20050182540A1 (en)* | 2004-01-13 | 2005-08-18 | Makiko Sugiura | Pedestrian detection device, related method, air bag system and vehicle equipped with air bag system |
| US6956470B1 (en)* | 1999-09-03 | 2005-10-18 | Volkswagen Ag | Method and device for actively assisting a motor vehicle driver in a motor vehicle |
| US20050231339A1 (en)* | 2004-02-17 | 2005-10-20 | Fuji Jukogyo Kabushiki Kaisha | Outside-vehicle monitoring system |
| US7068844B1 (en)* | 2001-11-15 | 2006-06-27 | The University Of Connecticut | Method and system for image processing for automatic road sign recognition |
| US20060151223A1 (en)* | 2002-11-16 | 2006-07-13 | Peter Knoll | Device and method for improving visibility in a motor vehicle |
| US20060193498A1 (en)* | 2005-02-25 | 2006-08-31 | Jason Hartlove | System and method for detecting thermal anomalies |
| US7113098B1 (en) | 2002-08-29 | 2006-09-26 | Melvin Hayes | Animal accident reduction systems, methods, and apparatuses |
| US20060261975A1 (en)* | 2003-03-14 | 2006-11-23 | Liwas Aps | Device for detection of surface condition data |
| US20070086653A1 (en)* | 2005-10-18 | 2007-04-19 | The University Of Connecticut | Optical data storage device and method |
| US20070230744A1 (en)* | 2006-03-29 | 2007-10-04 | Mark Dronge | Security alarm system |
| EP1926048A1 (en)* | 2006-11-21 | 2008-05-28 | Harman Becker Automotive Systems GmbH | Presenting video images of a vehicle environment |
| US20080316011A1 (en)* | 2005-09-08 | 2008-12-25 | Johnson Controls Gmbh | Driver Assistance Device for a Vehicle and a Method for Visualizing the Surroundings of a Vehicle |
| US20090021355A1 (en)* | 2005-02-10 | 2009-01-22 | Dirk Meister | Driver Assistance System Having a Device for Detecting Special Situations |
| US20090237268A1 (en)* | 2008-03-18 | 2009-09-24 | Hyundai Motor Company | Information display system for vehicle |
| US20090259360A1 (en)* | 2008-04-15 | 2009-10-15 | Robert Bosch Gmbh | Determining microenvironment conditions |
| WO2010134824A1 (en)* | 2009-05-20 | 2010-11-25 | Modulprodukter As | Driving assistance device and vehicle system |
| US20110050459A1 (en)* | 2009-08-28 | 2011-03-03 | Alcatel-Lucent Usa Inc. | System and method to enhance safety and legal compliance by location analysis |
| US20110224862A1 (en)* | 2004-09-17 | 2011-09-15 | Honda Motor Co., Ltd. | Vehicular control object determination system and vehicular travel locus estimation system |
| WO2012000385A1 (en)* | 2010-07-02 | 2012-01-05 | 中国商用飞机有限责任公司 | Detecting device for detecting icing |
| WO2012000384A1 (en)* | 2010-07-02 | 2012-01-05 | 中国商用飞机有限责任公司 | Detecting device for detecting icing by image and detecting method thereof |
| GB2483226A (en)* | 2010-08-27 | 2012-03-07 | Cnap Me Operations Ltd | Compound network application platform |
| WO2014027131A1 (en)* | 2012-08-14 | 2014-02-20 | Nokia Corporation | Low light vision assistance |
| US8712624B1 (en)* | 2012-04-06 | 2014-04-29 | Google Inc. | Positioning vehicles to improve quality of observations at intersections |
| US20140136041A1 (en)* | 2012-09-07 | 2014-05-15 | Ford Global Technologies, Llc | Utilization of vehicle presence systems for powertrain response readiness and conserving energy |
| US8793046B2 (en) | 2012-06-01 | 2014-07-29 | Google Inc. | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| DE102013101639A1 (en)* | 2013-02-19 | 2014-09-04 | Continental Teves Ag & Co. Ohg | Method and device for determining a road condition |
| WO2015034844A1 (en)* | 2013-09-03 | 2015-03-12 | Flir Systems, Inc. | Infrared-based ice formation detection systems and methods |
| US9518830B1 (en)* | 2011-12-28 | 2016-12-13 | Intelligent Technologies International, Inc. | Vehicular navigation system updating based on object presence |
| US9643617B2 (en) | 2012-12-20 | 2017-05-09 | Continental Teves Ag & Co. Ohg | Friction coefficient estimation from camera and wheel speed data |
| US9676331B2 (en) | 2012-12-20 | 2017-06-13 | Continental Teves Ag & Co. Ohg | Method for determining a state of a pavement from surroundings sensor data |
| US10289920B2 (en) | 2013-11-15 | 2019-05-14 | Continental Teves Ag & Co. Ohg | Method and device for determining a roadway state by means of a vehicle camera system |
| US10501088B2 (en)* | 2015-10-22 | 2019-12-10 | Kyocera Corporation | Road surface state determination apparatus, imaging apparatus, imaging system, and road surface state determination method |
| CN111460865A (en)* | 2019-01-22 | 2020-07-28 | 阿里巴巴集团控股有限公司 | Driving assistance method, driving assistance system, computing device, and storage medium |
| US10739133B1 (en)* | 2003-06-17 | 2020-08-11 | Troxler Electronic Laboratories, Inc. | Method for determining a surface characteristic of a roadway using infrared radiation and an imaging device |
| US20210208587A1 (en)* | 2014-03-04 | 2021-07-08 | Cybernet Systems Corp. | All weather autonomously driven vehicles |
| US11636179B2 (en) | 2017-05-09 | 2023-04-25 | Arriver Software Ab | Apparatus for lane detection |
| US12429332B2 (en) | 2011-06-06 | 2025-09-30 | Traxler Electronic Laboratories Inc | Determining a surface characteristic of a roadway using an imaging device |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19722292B4 (en)* | 1997-05-28 | 2016-08-11 | MAIBACH Verkehrssicherheits- und Lärmschutzeinrichtungen GmbH | Method and arrangement for securing a mobile workstation on a roadway |
| DE19741631B4 (en)* | 1997-09-20 | 2013-08-14 | Volkswagen Ag | Method and device for avoiding and / or minimizing conflict situations in road traffic |
| DE19933504A1 (en)* | 1999-07-16 | 2001-01-25 | Bayerische Motoren Werke Ag | Method for the graphical representation of a road ahead |
| JP2001101596A (en)* | 1999-09-27 | 2001-04-13 | Mazda Motor Corp | Display device for vehicle |
| DE19949499A1 (en)* | 1999-10-14 | 2001-04-19 | Volkswagen Ag | Vehicle control device and method for a vehicle control device |
| JP3508665B2 (en)* | 1999-12-24 | 2004-03-22 | 株式会社豊田自動織機 | Steering support device |
| DE10047817B4 (en)* | 2000-09-27 | 2010-02-11 | Volkswagen Ag | Motor vehicle with means for reducing the risk of accidents |
| JP2002362302A (en)* | 2001-06-01 | 2002-12-18 | Sogo Jidosha Anzen Kogai Gijutsu Kenkyu Kumiai | Pedestrian detecting device |
| JP3817174B2 (en)* | 2001-12-28 | 2006-08-30 | 矢崎総業株式会社 | Vehicle image correction device and night driving visibility support device |
| FR2852725B1 (en)* | 2003-03-18 | 2006-03-10 | Valeo Vision | ON-LINE DRIVER ASSISTANCE SYSTEM IN A MOTOR VEHICLE |
| JP4697400B2 (en)* | 2005-03-01 | 2011-06-08 | 日本精機株式会社 | Vehicle display device |
| JP4814655B2 (en)* | 2006-03-02 | 2011-11-16 | 富士通株式会社 | Road surface state determination device and road surface state determination method |
| EP1894779B1 (en)* | 2006-09-01 | 2009-11-25 | Harman Becker Automotive Systems GmbH | Method of operating a night-view system in a vehicle and corresponding night-view system |
| DE102006056874B4 (en)* | 2006-12-01 | 2015-02-12 | Siemens Aktiengesellschaft | navigation device |
| JP4872829B2 (en)* | 2007-06-28 | 2012-02-08 | ソニー株式会社 | Imaging device |
| NO20083543L (en)* | 2008-08-14 | 2010-02-15 | Modulprodukter As | Automatic warning and / or slow down system for smooth driving |
| JP2010247580A (en)* | 2009-04-13 | 2010-11-04 | Toyota Motor Corp | Driving support device |
| JP5299047B2 (en)* | 2009-04-16 | 2013-09-25 | トヨタ自動車株式会社 | Travel control device |
| DE102010055773A1 (en) | 2010-12-23 | 2012-06-28 | Klaus Schneider | Portable temperature information system for warning unexpected changing road conditions e.g. snow formation to driver of passenger car, has unit computing frost point from humidity and temperature, where system measures surface temperature |
| KR101453654B1 (en)* | 2013-02-19 | 2014-11-04 | 한국과학기술원 | Road condition recognition system and method for automobile safety |
| CN111033590B (en)* | 2017-08-18 | 2022-09-09 | 索尼公司 | Vehicle travel control device, vehicle travel control method, and program |
| WO2019183751A1 (en)* | 2018-03-26 | 2019-10-03 | 深圳市锐明技术股份有限公司 | Detection and warning method for snow and ice in front of vehicle, storage medium, and server |
| DE102018108349A1 (en)* | 2018-04-09 | 2019-10-10 | Jacobs University Bremen Ggmbh | Apparatus for detecting ice formation probability or ice formation on a roadway of a road |
| CN113071412A (en)* | 2021-05-17 | 2021-07-06 | 浙江工业大学 | Vehicle-mounted infrared monitoring system and method |
| JP7707232B2 (en)* | 2023-05-15 | 2025-07-14 | ウーブン・バイ・トヨタ株式会社 | Data collection device, data collection method, computer program for data collection, and data collection instruction device |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS6089298A (en)* | 1983-10-19 | 1985-05-20 | 三菱電機株式会社 | Running information display |
| US4694295A (en)* | 1986-05-15 | 1987-09-15 | Miller Brett A | Vehicle blind spot detector |
| JPH0215890A (en)* | 1988-04-28 | 1990-01-19 | Nobelpharma Ab | Method and device for joining two element contained in structure for implantation and/or prosthetic |
| US4899296A (en)* | 1987-11-13 | 1990-02-06 | Khattak Anwar S | Pavement distress survey system |
| DE4035979A1 (en)* | 1989-11-10 | 1991-06-06 | Nissan Motor | NAVIGATION SYSTEM FOR MOTOR VEHICLES |
| US5206811A (en)* | 1989-11-10 | 1993-04-27 | Nissan Motor Company, Limited | Navigation system for automotive vehicle |
| US5270708A (en)* | 1991-04-08 | 1993-12-14 | Nissan Motor Co., Ltd. | Accident information providing system for automotive vehicle |
| JPH0660297A (en)* | 1992-08-05 | 1994-03-04 | Tokyo Cosmos Electric Co Ltd | Moving body navigation system and moving body broadcasting receiver |
| US5315295A (en)* | 1991-01-18 | 1994-05-24 | Mazda Motor Corporation | Vehicle speed control system |
| US5416476A (en)* | 1991-11-29 | 1995-05-16 | Rendon; Edward | Method and system for detecting potential icy conditions on roads |
| US5461357A (en)* | 1992-01-29 | 1995-10-24 | Mazda Motor Corporation | Obstacle detection device for vehicle |
| US5541590A (en)* | 1992-08-04 | 1996-07-30 | Takata Corporation | Vehicle crash predictive and evasive operation system by neural networks |
| US5555312A (en)* | 1993-06-25 | 1996-09-10 | Fujitsu Limited | Automobile apparatus for road lane and vehicle ahead detection and ranging |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02158900A (en)* | 1988-12-12 | 1990-06-19 | Mazda Motor Corp | Obstacle detector |
- 1995
- 1995-03-23JPJP7064587Apatent/JPH08263784A/enactivePending
- 1996
- 1996-03-11DEDE19609488Apatent/DE19609488B4/ennot_activeExpired - Fee Related
- 1997
- 1997-09-08USUS08/929,010patent/US5963148A/ennot_activeExpired - Fee Related
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS6089298A (en)* | 1983-10-19 | 1985-05-20 | 三菱電機株式会社 | Running information display |
| US4694295A (en)* | 1986-05-15 | 1987-09-15 | Miller Brett A | Vehicle blind spot detector |
| US4899296A (en)* | 1987-11-13 | 1990-02-06 | Khattak Anwar S | Pavement distress survey system |
| JPH0215890A (en)* | 1988-04-28 | 1990-01-19 | Nobelpharma Ab | Method and device for joining two element contained in structure for implantation and/or prosthetic |
| DE4035979A1 (en)* | 1989-11-10 | 1991-06-06 | Nissan Motor | NAVIGATION SYSTEM FOR MOTOR VEHICLES |
| US5206811A (en)* | 1989-11-10 | 1993-04-27 | Nissan Motor Company, Limited | Navigation system for automotive vehicle |
| US5315295A (en)* | 1991-01-18 | 1994-05-24 | Mazda Motor Corporation | Vehicle speed control system |
| US5270708A (en)* | 1991-04-08 | 1993-12-14 | Nissan Motor Co., Ltd. | Accident information providing system for automotive vehicle |
| US5416476A (en)* | 1991-11-29 | 1995-05-16 | Rendon; Edward | Method and system for detecting potential icy conditions on roads |
| US5461357A (en)* | 1992-01-29 | 1995-10-24 | Mazda Motor Corporation | Obstacle detection device for vehicle |
| US5541590A (en)* | 1992-08-04 | 1996-07-30 | Takata Corporation | Vehicle crash predictive and evasive operation system by neural networks |
| JPH0660297A (en)* | 1992-08-05 | 1994-03-04 | Tokyo Cosmos Electric Co Ltd | Moving body navigation system and moving body broadcasting receiver |
| US5555312A (en)* | 1993-06-25 | 1996-09-10 | Fujitsu Limited | Automobile apparatus for road lane and vehicle ahead detection and ranging |
Cited By (125)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8493442B2 (en)* | 1998-03-19 | 2013-07-23 | Lot 3 Acquisition Foundation, Llc | Object location information |
| US20010010541A1 (en)* | 1998-03-19 | 2001-08-02 | Fernandez Dennis Sunga | Integrated network for monitoring remote objects |
| US8335254B1 (en) | 1998-03-19 | 2012-12-18 | Lot 3 Acquisition Foundation, Llc | Advertisements over a network |
| US9609283B2 (en) | 1998-03-19 | 2017-03-28 | Cufer Asset Ltd. L.L.C | Mobile unit communication via a network |
| US7830962B1 (en) | 1998-03-19 | 2010-11-09 | Fernandez Dennis S | Monitoring remote patients |
| US7920626B2 (en) | 1998-03-19 | 2011-04-05 | Lot 3 Acquisition Foundation, Llc | Video surveillance visual recognition |
| US7839432B2 (en) | 1998-03-19 | 2010-11-23 | Dennis Sunga Fernandez | Detector selection for monitoring objects |
| US6538622B1 (en)* | 1999-01-26 | 2003-03-25 | Mazda Motor Corporation | Display apparatus on a vehicle |
| US6531959B1 (en)* | 1999-07-13 | 2003-03-11 | Honda Giken Kogyo Kabushiki Kaisha | Position detecting device |
| US6956470B1 (en)* | 1999-09-03 | 2005-10-18 | Volkswagen Ag | Method and device for actively assisting a motor vehicle driver in a motor vehicle |
| US6173231B1 (en) | 2000-01-31 | 2001-01-09 | Navigation Technologies Corp. | Method and system for collecting data concerning thermal properties of roads for a geographic database and use thereof in a vehicle safety system |
| US6459365B2 (en)* | 2000-03-08 | 2002-10-01 | Honda Giken Kogyo Kabushiki Kaisha | Dangerous area alarm system |
| EP1152218A3 (en)* | 2000-04-24 | 2003-05-02 | Matsushita Electric Industrial Co., Ltd. | Navigation device |
| US6281806B1 (en) | 2000-10-12 | 2001-08-28 | Ford Global Technologies, Inc. | Driver road hazard warning and illumination system |
| US6748302B2 (en)* | 2001-01-18 | 2004-06-08 | Nissan Motor Co., Ltd. | Lane tracking control system for vehicle |
| US20020171739A1 (en)* | 2001-05-15 | 2002-11-21 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Surrounding conditions display apparatus |
| US7126460B2 (en)* | 2001-05-15 | 2006-10-24 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Surrounding conditions display apparatus |
| US20030043029A1 (en)* | 2001-08-31 | 2003-03-06 | Kabushiki Kaisha Tokai Rika Denki Seisakusho | On-vehicle infrared image display unit |
| US7068844B1 (en)* | 2001-11-15 | 2006-06-27 | The University Of Connecticut | Method and system for image processing for automatic road sign recognition |
| US7130448B2 (en)* | 2002-01-18 | 2006-10-31 | Honda Giken Kogyo Kabushiki Kaisha | Device for monitoring around a vehicle |
| US20030138133A1 (en)* | 2002-01-18 | 2003-07-24 | Honda Giken Kogyo Kabushiki Kaisha | Device for monitoring around a vehicle |
| US6731204B2 (en) | 2002-02-19 | 2004-05-04 | Continental Teves, Inc. | Object detection system providing driver information through sound |
| US6759949B2 (en) | 2002-05-23 | 2004-07-06 | Visteon Global Technologies, Inc. | Image enhancement in far infrared camera |
| US6819245B1 (en) | 2002-05-27 | 2004-11-16 | Emery W. Dilling | Security system |
| US6630891B1 (en) | 2002-05-27 | 2003-10-07 | Emery W. Dilling | Vehicle warning system |
| US7113098B1 (en) | 2002-08-29 | 2006-09-26 | Melvin Hayes | Animal accident reduction systems, methods, and apparatuses |
| US20040051659A1 (en)* | 2002-09-18 | 2004-03-18 | Garrison Darwin A. | Vehicular situational awareness system |
| US20060151223A1 (en)* | 2002-11-16 | 2006-07-13 | Peter Knoll | Device and method for improving visibility in a motor vehicle |
| US8045760B2 (en)* | 2003-02-21 | 2011-10-25 | Gentex Corporation | Automatic vehicle exterior light control systems |
| US20040201483A1 (en)* | 2003-02-21 | 2004-10-14 | Stam Joseph S. | Automatic vehicle exterior light control systems |
| FR2851837A1 (en)* | 2003-02-27 | 2004-09-03 | Peugeot Citroen Automobiles Sa | Pedestrian detection method in environs of motor vehicle, uses thermal image of view ahead of vehicle, extracts hottest sources and compares them with characteristics of pedestrian, presenting enhanced display on in-vehicle screen |
| US20060261975A1 (en)* | 2003-03-14 | 2006-11-23 | Liwas Aps | Device for detection of surface condition data |
| US20100085175A1 (en)* | 2003-03-14 | 2010-04-08 | Liwas Aps | Device for detection of surface condition data |
| US7652584B2 (en)* | 2003-03-14 | 2010-01-26 | Liwas Aps | Device for detection of surface condition data |
| US8040248B2 (en) | 2003-03-14 | 2011-10-18 | Liwas Aps | Device for detection of surface condition data |
| US20040189448A1 (en)* | 2003-03-24 | 2004-09-30 | Helmuth Eggers | Video display for a vehicle environment surveillance unit |
| DE10313002A1 (en)* | 2003-03-24 | 2004-10-21 | Daimlerchrysler Ag | Video image display for a vehicle environment detection unit |
| DE10313002B4 (en)* | 2003-03-24 | 2006-03-23 | Daimlerchrysler Ag | Vehicle environment detection unit |
| US6807473B1 (en) | 2003-04-09 | 2004-10-19 | Continental Teves, Inc. | Road recognition system |
| US20040204812A1 (en)* | 2003-04-09 | 2004-10-14 | Continental Teves Inc. | Road recognition system |
| DE102004018088B4 (en)* | 2003-04-09 | 2017-11-30 | Continental Teves, Inc. | Lane recognition system |
| US11859966B2 (en) | 2003-06-17 | 2024-01-02 | Troxler Electronic Laboratories, Inc. | Determining a surface characteristic of a roadway using an imaging device |
| US10739133B1 (en)* | 2003-06-17 | 2020-08-11 | Troxler Electronic Laboratories, Inc. | Method for determining a surface characteristic of a roadway using infrared radiation and an imaging device |
| US10989530B1 (en) | 2003-06-17 | 2021-04-27 | Troxler Electronic Laboratories, Inc. | Determining a surface characteristic of a roadway using an imaging device |
| EP1491978A1 (en)* | 2003-06-27 | 2004-12-29 | Volkswagen Aktiengesellschaft | Identification of collision objects |
| US20050182540A1 (en)* | 2004-01-13 | 2005-08-18 | Makiko Sugiura | Pedestrian detection device, related method, air bag system and vehicle equipped with air bag system |
| US7526369B2 (en)* | 2004-01-13 | 2009-04-28 | Denso Corporation | Pedestrian detection device, related method, air bag system and vehicle equipped with air bag system |
| US7548634B2 (en) | 2004-02-13 | 2009-06-16 | Fuji Jukogyo Kabushiki Kaisha | Pedestrian detection system and vehicle driving assist system with a pedestrian detection system |
| EP1564703A1 (en)* | 2004-02-13 | 2005-08-17 | Fuji Jukogyo Kabushiki Kaisha | Vehicle driving assist system |
| US20050201590A1 (en)* | 2004-02-13 | 2005-09-15 | Fuji Jukogyo Kabushiki Kaisha | Pedestrian detection system and vehicle driving assist system with a pedestrian detection system |
| US7567687B2 (en)* | 2004-02-17 | 2009-07-28 | Fuji Jukogyo Kabushiki Kaisha | Outside-vehicle monitoring system |
| US20050231339A1 (en)* | 2004-02-17 | 2005-10-20 | Fuji Jukogyo Kabushiki Kaisha | Outside-vehicle monitoring system |
| US20110224862A1 (en)* | 2004-09-17 | 2011-09-15 | Honda Motor Co., Ltd. | Vehicular control object determination system and vehicular travel locus estimation system |
| US8165797B2 (en)* | 2004-09-17 | 2012-04-24 | Honda Motor Co., Ltd. | Vehicular control object determination system and vehicular travel locus estimation system |
| US7830242B2 (en)* | 2005-02-10 | 2010-11-09 | Robert Bosch Gmbh | Driver assistance system having a device for detecting special situations |
| US20090021355A1 (en)* | 2005-02-10 | 2009-01-22 | Dirk Meister | Driver Assistance System Having a Device for Detecting Special Situations |
| CN1825075B (en)* | 2005-02-25 | 2010-09-08 | 普廷数码影像控股公司 | System and method for detecting thermal anomalies |
| US7787663B2 (en) | 2005-02-25 | 2010-08-31 | Aptina Imaging Corporation, Inc. | System and method for detecting thermal anomalies |
| US20060193498A1 (en)* | 2005-02-25 | 2006-08-31 | Jason Hartlove | System and method for detecting thermal anomalies |
| GB2426327A (en)* | 2005-02-25 | 2006-11-22 | Agilent Technologies Inc | Detecting thermal anomalies using visual image and thermal image data |
| GB2426327B (en)* | 2005-02-25 | 2010-09-01 | Agilent Technologies Inc | System and method for detecting thermal anomalies |
| US7457441B2 (en)* | 2005-02-25 | 2008-11-25 | Aptina Imaging Corporation | System and method for detecting thermal anomalies |
| US20090136093A1 (en)* | 2005-02-25 | 2009-05-28 | Aptina Imaing Corporation | System and method for detecting thermal anomalies |
| US8519837B2 (en)* | 2005-09-08 | 2013-08-27 | Johnson Controls Gmbh | Driver assistance device for a vehicle and a method for visualizing the surroundings of a vehicle |
| US20080316011A1 (en)* | 2005-09-08 | 2008-12-25 | Johnson Controls Gmbh | Driver Assistance Device for a Vehicle and a Method for Visualizing the Surroundings of a Vehicle |
| US8155312B2 (en) | 2005-10-18 | 2012-04-10 | The University Of Connecticut | Optical data storage device and method |
| US20070086653A1 (en)* | 2005-10-18 | 2007-04-19 | The University Of Connecticut | Optical data storage device and method |
| US7526105B2 (en) | 2006-03-29 | 2009-04-28 | Mark Dronge | Security alarm system |
| US20090225166A1 (en)* | 2006-03-29 | 2009-09-10 | Mark Dronge | Security Alarm System |
| US7864983B2 (en) | 2006-03-29 | 2011-01-04 | Mark Dronge | Security alarm system |
| US20070230744A1 (en)* | 2006-03-29 | 2007-10-04 | Mark Dronge | Security alarm system |
| CN101187978B (en)* | 2006-11-21 | 2013-09-25 | 哈曼贝克自动系统股份有限公司 | Method and system for presenting video images |
| US9013578B2 (en)* | 2006-11-21 | 2015-04-21 | Harman Becker Automotive Systems Gmbh | Video image presentation system |
| EP1926048A1 (en)* | 2006-11-21 | 2008-05-28 | Harman Becker Automotive Systems GmbH | Presenting video images of a vehicle environment |
| US20080239078A1 (en)* | 2006-11-21 | 2008-10-02 | Harman Becker Automotive Systems Gmbh | Video image presentation system |
| US20090237268A1 (en)* | 2008-03-18 | 2009-09-24 | Hyundai Motor Company | Information display system for vehicle |
| US8493233B2 (en)* | 2008-03-18 | 2013-07-23 | Hyundai Motor Company | Information display system for vehicle |
| US8180518B2 (en)* | 2008-04-15 | 2012-05-15 | Robert Bosch Gmbh | System and method for determining microenvironment conditions external to a vehicle |
| US20090259360A1 (en)* | 2008-04-15 | 2009-10-15 | Robert Bosch Gmbh | Determining microenvironment conditions |
| GB2472969A (en)* | 2009-05-20 | 2011-02-23 | Modulprodukter As | Driving assistance device and vehicle system |
| WO2010134824A1 (en)* | 2009-05-20 | 2010-11-25 | Modulprodukter As | Driving assistance device and vehicle system |
| GB2472969B (en)* | 2009-05-20 | 2011-06-29 | Modulprodukter As | Driving assistance device and vehicle system |
| US20110050459A1 (en)* | 2009-08-28 | 2011-03-03 | Alcatel-Lucent Usa Inc. | System and method to enhance safety and legal compliance by location analysis |
| WO2011031425A1 (en)* | 2009-08-28 | 2011-03-17 | Alcatel-Lucent Usa Inc. | System and method to indicate overspeeding to driver by location analysis |
| EP2589928A4 (en)* | 2010-07-02 | 2014-11-05 | Commercial Aircraft Corp Cn | DETECTION DEVICE FOR DETECTING ICE FORMATION USING IMAGE AND DETECTION METHOD THEREOF |
| WO2012000384A1 (en)* | 2010-07-02 | 2012-01-05 | 中国商用飞机有限责任公司 | Detecting device for detecting icing by image and detecting method thereof |
| WO2012000385A1 (en)* | 2010-07-02 | 2012-01-05 | 中国商用飞机有限责任公司 | Detecting device for detecting icing |
| GB2483226A (en)* | 2010-08-27 | 2012-03-07 | Cnap Me Operations Ltd | Compound network application platform |
| US12429332B2 (en) | 2011-06-06 | 2025-09-30 | Traxler Electronic Laboratories Inc | Determining a surface characteristic of a roadway using an imaging device |
| US9518830B1 (en)* | 2011-12-28 | 2016-12-13 | Intelligent Technologies International, Inc. | Vehicular navigation system updating based on object presence |
| US10048076B2 (en) | 2011-12-28 | 2018-08-14 | Intelligent Technologies International, Inc. | On-board vehicular monitoring system |
| US9677893B2 (en) | 2011-12-28 | 2017-06-13 | Intelligent Technologies International, Inc. | Vehicular navigation system updating based on object presence/absence |
| US9910439B1 (en)* | 2012-04-06 | 2018-03-06 | Waymo Llc | Positioning vehicles to improve quality of observations at intersections |
| US12153432B2 (en) | 2012-04-06 | 2024-11-26 | Waymo Llc | Positioning vehicles to improve quality of observations at intersections |
| US9280156B1 (en) | 2012-04-06 | 2016-03-08 | Google Inc. | Positioning vehicles to improve quality of observations at intersections |
| US10782695B1 (en)* | 2012-04-06 | 2020-09-22 | Waymo Llc | Positioning vehicles to improve quality of observations at intersections |
| US8712624B1 (en)* | 2012-04-06 | 2014-04-29 | Google Inc. | Positioning vehicles to improve quality of observations at intersections |
| US11300962B1 (en) | 2012-04-06 | 2022-04-12 | Waymo Llc | Positioning vehicles to improve quality of observations at intersections |
| US9804601B2 (en) | 2012-06-01 | 2017-10-31 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US9327734B2 (en) | 2012-06-01 | 2016-05-03 | Google Inc. | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US11474520B2 (en) | 2012-06-01 | 2022-10-18 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US11845472B2 (en) | 2012-06-01 | 2023-12-19 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US10331133B2 (en) | 2012-06-01 | 2019-06-25 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US12428035B2 (en) | 2012-06-01 | 2025-09-30 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US8793046B2 (en) | 2012-06-01 | 2014-07-29 | Google Inc. | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| US10831196B2 (en) | 2012-06-01 | 2020-11-10 | Waymo Llc | Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data |
| CN104583841A (en)* | 2012-08-14 | 2015-04-29 | 诺基亚公司 | low light visual aid |
| CN104583841B (en)* | 2012-08-14 | 2017-12-05 | 诺基亚技术有限公司 | low light visual aid |
| WO2014027131A1 (en)* | 2012-08-14 | 2014-02-20 | Nokia Corporation | Low light vision assistance |
| US20150208004A1 (en)* | 2012-08-14 | 2015-07-23 | Nokia Corporation | Low light vision assistance |
| US9180860B2 (en)* | 2012-09-07 | 2015-11-10 | Ford Global Technologies, Llc | Utilization of vehicle presence systems for powertrain response readiness and conserving energy |
| US20140136041A1 (en)* | 2012-09-07 | 2014-05-15 | Ford Global Technologies, Llc | Utilization of vehicle presence systems for powertrain response readiness and conserving energy |
| US9643617B2 (en) | 2012-12-20 | 2017-05-09 | Continental Teves Ag & Co. Ohg | Friction coefficient estimation from camera and wheel speed data |
| US9676331B2 (en) | 2012-12-20 | 2017-06-13 | Continental Teves Ag & Co. Ohg | Method for determining a state of a pavement from surroundings sensor data |
| DE102013101639A1 (en)* | 2013-02-19 | 2014-09-04 | Continental Teves Ag & Co. Ohg | Method and device for determining a road condition |
| US10147002B2 (en) | 2013-02-19 | 2018-12-04 | Conti Temic Microelectronic Gmbh | Method and apparatus for determining a road condition |
| WO2015034844A1 (en)* | 2013-09-03 | 2015-03-12 | Flir Systems, Inc. | Infrared-based ice formation detection systems and methods |
| US10018609B2 (en) | 2013-09-03 | 2018-07-10 | Flir Systems, Inc. | Infrared-based ice formation detection systems and methods |
| US10289920B2 (en) | 2013-11-15 | 2019-05-14 | Continental Teves Ag & Co. Ohg | Method and device for determining a roadway state by means of a vehicle camera system |
| US11703879B2 (en)* | 2014-03-04 | 2023-07-18 | Cybernet Systems Corp. | All weather autonomously driven vehicles |
| US20210208587A1 (en)* | 2014-03-04 | 2021-07-08 | Cybernet Systems Corp. | All weather autonomously driven vehicles |
| US10501088B2 (en)* | 2015-10-22 | 2019-12-10 | Kyocera Corporation | Road surface state determination apparatus, imaging apparatus, imaging system, and road surface state determination method |
| US11636179B2 (en) | 2017-05-09 | 2023-04-25 | Arriver Software Ab | Apparatus for lane detection |
| CN111460865B (en)* | 2019-01-22 | 2024-03-05 | 斑马智行网络(香港)有限公司 | Driving support method, driving support system, computing device, and storage medium |
| CN111460865A (en)* | 2019-01-22 | 2020-07-28 | 阿里巴巴集团控股有限公司 | Driving assistance method, driving assistance system, computing device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| DE19609488B4 (en) | 2005-08-04 |
| DE19609488A1 (en) | 1996-10-02 |
| JPH08263784A (en) | 1996-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5963148A (en) | Road situation perceiving system | |
| US7486175B2 (en) | Vehicle drive assist system | |
| US9723243B2 (en) | User interface method for terminal for vehicle and apparatus thereof | |
| US6191704B1 (en) | Run environment recognizing apparatus | |
| US8600673B2 (en) | Driving assistance apparatus | |
| JP6428713B2 (en) | Information display device | |
| US7190282B2 (en) | Nose-view monitoring apparatus | |
| US20050125121A1 (en) | Vehicle driving assisting apparatus | |
| CN110857093A (en) | Vehicle travel control system | |
| US10866416B2 (en) | Display control device and display control method | |
| JP2008131648A (en) | Method and system for presenting video images | |
| US6614469B1 (en) | Method and apparatus for detecting deviation of automobile from lane | |
| JP2007296978A (en) | Confluence operation support device | |
| JP2007226666A (en) | Driving support method and driving support device | |
| JP2011070311A (en) | Driving support display device | |
| WO2019114030A1 (en) | Driving assistance system and method fusing navigation and intelligent vision | |
| US12071010B2 (en) | Onboard display device, onboard display method, and computer readable storage medium | |
| US20210061184A1 (en) | Method and apparatus for operating a camera-monitor system for a motor vehicle | |
| WO2017018192A1 (en) | Information display apparatus | |
| CN112449625B (en) | Method, system and trailer combination for assisting in scheduling operation of trailer combination | |
| JP4225189B2 (en) | Vehicle driving support device | |
| US8681219B2 (en) | System and method for driving assistance at road intersections | |
| JPH11283198A (en) | Traveling environment reporting device for vehicle | |
| JP3400093B2 (en) | Vehicle travel path estimation device | |
| JP2006273190A (en) | On-vehicle navigation device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| CC | Certificate of correction | ||
| FEPP | Fee payment procedure | Free format text:PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY | |
| FPAY | Fee payment | Year of fee payment:4 | |
| FPAY | Fee payment | Year of fee payment:8 | |
| REMI | Maintenance fee reminder mailed | ||
| LAPS | Lapse for failure to pay maintenance fees | ||
| STCH | Information on status: patent discontinuation | Free format text:PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 | |
| FP | Lapsed due to failure to pay maintenance fee | Effective date:20111005 |