CROSS-REFERENCE TO RELATED APPLICATIONSThe present application is a continuation of U.S. patent application Ser. No. 13/495,953, filed on Jun. 13, 2012, which claims priority of Korean Patent Application No. 10-2011-0090412 filed on Sep. 6, 2011, which are incorporated by reference in their entirety.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to a danger sensing apparatus of a vehicle and a control method thereof, and more particularly, to a danger sensing apparatus of a vehicle capable of reducing danger of passengers getting on/off a vehicle, and a control method thereof.
2. Related Art
A public transportation such as a bus driven on a road, and an educational institute vehicle and a mini-bus on which a plurality of persons get are vulnerable to an accident of passengers when the passengers get on/off them. Therefore, this accident has been frequently generated.
For example, the passengers getting on the vehicle may not recognize a two-wheeled vehicle such as a motorcycle and a bicycle approaching and entering a side of the vehicle when they get off the vehicle after the vehicle stops, and a driver driving the vehicle also has a difficulty in viewing the two-wheeled vehicle with a side rear-view mirror. In addition, the vehicle driver has a difficulty in detecting that the passengers get on/off the vehicle at the time of the stop of the vehicle with the naked eye, such that he/her closes a door or allows the vehicle to start in a situation in which the passengers get on/off the vehicle, thereby making it possible to cause an accident.
Meanwhile, a bus among public transportations according to the related art recognizes a situation in which the passengers get on/off the vehicle using a side rear-view mirror and a reflective mirror installed in a door region. In addition, a wireless image transmitting and receiving apparatus and method for a safety operation of a subway has been disclosed in Korean Patent Laid-Open Publication No. 2005-0010379.
However, since the bus according to the related art simply uses the side rear-view mirror and the reflective mirror installed in the door region, it has a difficulty in informing the passengers of the motorcycle, or the like, approaching a side of the vehicle and does not appropriately recognize the situation in which the passengers get on/off the vehicle when there are a number of passengers in the vehicle. In addition, the wireless image transmitting and receiving apparatus and method for a safety operation of a subway according to the related art may only confirm that the passengers get on/off the vehicle using a monitoring camera installed in a subway station, but may not automatically control a subway door and a drive train according to a danger situation.
RELATED ART DOCUMENTPatent DocumentKorean Patent Laid-Open Publication No. 2005-0010379
SUMMARY OF THE INVENTIONThe present invention provides a danger sensing apparatus of a vehicle capable of preventing an accident of passengers by analyzing a side of the vehicle and a situation of a door region of the vehicle at which the passengers get on/off the vehicle, and a control method thereof.
The present invention also provides a danger sensing apparatus of a vehicle capable of informing a driver of a danger situation and actively controlling a function of the vehicle, by automatically analyzing a side of the vehicle and a situation of a door region at which the passengers get on/off the vehicle, and a control method thereof.
In an aspect, a danger sensing apparatus of a vehicle is provided. The damage sensing apparatus includes: a data collecting unit disposed at each of a side rear-view mirror of the vehicle and an inner portion of the vehicle to collect a side region of the vehicle and a situation of a door region of the inner portion of the vehicle as data; a data analyzing unit analyzing the data collected from the data collecting unit to analyze a danger object approaching an outer side of the vehicle and the situation of the door region of the inner portion of the vehicle; and a controlling unit controlling operations of a drive train of the vehicle and the door based on a signal analyzed from the data analyzing unit.
The danger sensing apparatus may further include a data outputting unit outputting an alarm according to a danger situation based on the data collected from the data collecting unit and the data analyzed from the data analyzing unit.
The data outputting unit may include: a display unit displaying an alarm message according to the danger situation based on the data collected from the data collecting unit and the data analyzed from the data analyzing unit; and a sound outputter outputting an alert sound according to the danger situation based on the data analyzed from the data analyzing unit.
The data collecting unit may include: a camera module disposed at the side rear-view mirror and the inner portion of the vehicle to collect the outer side of the vehicle and the situation of the door region of the inner portion of the vehicle as image data; and a data transmitter transmitting the image data collected from the camera module to the data analyzing unit.
The data transmitter may transmit the collected image data to the data analyzing unit in at least one of wired and wireless schemes.
The data analyzing unit may include: a data receiver receiving the data transmitted from the data collecting unit; a danger analyzer analyzing the data received in the data receiver to analyze the danger object approaching the side of the vehicle and the situation of the door region; and a control signal generator generating a control signal based on data analyzed from the danger analyzer.
The danger object may include a motorcycle and a bicycle approaching the outer side of the vehicle.
The danger analyzer may analyze whether or not the danger object is present and a speed at which the danger object approaches the side of the vehicle, in the data received in the data receiver.
The situation of the door region may include a state indicating whether or not a passenger getting on/off the vehicle through the door is present and whether or not an object interposed between an entrance of the vehicle and the door is present.
The danger analyzer may analyze the state indicating whether or not the passenger getting on/off the vehicle through the door is present and whether or not the object interposed between the entrance and the door is present in the image data received in the data receiver.
The controlling unit may control the operations of the drive train of the vehicle and the door based on the control signal generated from the control signal generator in the case in which it is determined that the data analyzed from the danger analyzer corresponds to the danger situation, at the time of stop of the vehicle.
In another aspect, a control method of danger sensing of a vehicle is provided. The control method includes: (a) determining whether the vehicle stops; (b) collecting image data on an outer side of the vehicle and a door region of an inner portion of the vehicle in the case in which it is determined in step (a) that the vehicle stops; (c) analyzing whether or not a danger object approaching the outer side of the vehicle is present and a situation of the door region of the inner portion of the vehicle in the image data collected in step (b) to determine whether a danger situation is generated; and (d) controlling operations of a drive train of the vehicle and the door based on a signal analyzed in step (c).
The control method may further include, between steps (b) and (c), outputting the collected image data.
The control method may further include, between steps (c) and (d), outputting at least any one of an alarm message and an alarm sound in the case in which it is determined in step (c) that the danger situation is generated.
Step (b) may include: photographing the side of the vehicle and the situation of the door region of the inner portion of the vehicle; and transmitting the image data photographed in the photographing.
The transmitting of the image data photographed in the photographing may be performed in at least one of wired and wireless schemes.
Step (c) may include: receiving the image data transmitted in the transmitting; analyzing whether or not the danger object approaching the side of the vehicle is present and the situation of the door region of the inner portion of the vehicle from the received image data to determine whether the danger situation is generated; and generating a control signal in the case in which it is determined than the danger situation is generated.
In the determining of whether the danger situation is generated, whether or not the danger object approaching the side of the vehicle is present and a speed at which the danger object approaches the side of the vehicle may be analyzed, before the door is opened.
In the determining of whether the danger situation is generated, an entrance situation of a passenger getting on/off the vehicle through the door may be analyzed.
In the determining of whether the danger situation is generated, whether or not foreign materials are present between the door and the vehicle may be analyzed, after the door is closed.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is a configuration diagram showing an application of a danger sensing apparatus of a vehicle according to an exemplary embodiment of the present invention.
FIG. 2 is a control block diagram of the danger sensing apparatus of the vehicle according to the exemplary embodiment of the present invention.
FIGS. 3 and 4 are control flow charts of the danger sensing apparatus of the vehicle according to the exemplary embodiment of the present invention.
DESCRIPTION OF EXEMPLARY EMBODIMENTSHereinafter, a danger sensing apparatus of a vehicle and a control method thereof according to an exemplary embodiment of the present invention will be described in detail with reference to the accompanying drawings.
Prior to describing the danger sensing apparatus of the vehicle and the control method thereof according to the exemplary embodiment of the present invention, it is to be appreciated that the danger sensing apparatus of the vehicle and the control method thereof according to the exemplary embodiment of the present invention may be applied to a vehicle on which a plurality of passengers get, such as a bus, an educational institute vehicle, and a mini-bus.
FIG. 1 is a configuration diagram showing an application of a danger sensing apparatus of a vehicle according to an exemplary embodiment of the present invention; andFIG. 2 is a control block diagram of the danger sensing apparatus of the vehicle according to the exemplary embodiment of the present invention.
As shown inFIGS. 1 and 2, a danger sensingapparatus1 of avehicle2 according to an exemplary embodiment of the present invention is configured to include adata collecting unit10, adata analyzing unit30, a controllingunit50, and adata outputting unit70. The danger sensingapparatus1 of thevehicle2 collects and analyzes images of a side of thevehicle2 and adoor4 region opening/closing an entrance through whichpassengers6 get on/off the vehicle and controls adrive train3 of thevehicle2 and thedoor4.
Thedata collecting unit10 includes acamera module12 and adata transmitter14. Thedata collecting unit10 collects the side of thevehicle2 and a situation of thedoor4 region at which thepassengers6 get on/off the vehicle as data.
Thecamera module12 is disposed at a side rear-view mirror of thevehicle2 and thedoor4 region of a passenger entrance. Thecamera module12 is mounted on the side rear-view mirror in a direction toward the entrance through which thepassengers6 get on/off thevehicle2 when thevehicle2 stops and is disposed at thedoor4 region at which thepassenger6 get on/off. As described above, thecamera module12 is disposed at the side rear-view mirror and thedoor4 region of the entrance to photograph adanger object5 approaching the side of thevehicle2, a situation in which thepassengers6 get on/off thevehicle2 through the entrance, interpositions of foreign materials at the time of opening/closing of thedoor4 after thepassengers6 get on/off thevehicle2, and the like.
Thedata transmitter14 transmits image data photographed and collected by thecamera module12 to thedata analyzing unit30. Thedata transmitter14 uses at least one of a wired communication scheme and a wireless data transmission scheme in order to communicate with adata receiver32 of thedata analyzing unit30 to be described below. According to the exemplary embodiment of the present invention, thedata transmitter14 uses both of the wired communication scheme and the wireless data transmission scheme.
Meanwhile, thedata transmitter14 may transmit the image data photographed in thecamera module12 to adisplay unit72 of thedata outputting unit70 to be described below in real time. As described above, the image data transmitted from thedata transmitter14 in real time are displayed on thedisplay unit72 so that a driver of thevehicle2 may recognize a real time situation.
Thedata analyzing unit30 according to the exemplary embodiment of the present invention includes thedata receiver32, adanger analyzer34, and acontrol signal generator36. Thedata analyzing unit30 analyzes the image data transmitted from thedata collecting unit10 in real time to analyze a danger situation capable of being generated for thepassenger6 getting on/off thevehicle2 and generates a control signal in the case in which it is analyzed that the danger situation is generated.
Thedata receiver32 receives the image data transmitted from thedata transmitter14 of thedata collecting unit10 in the wired communication scheme and the wireless data transmission scheme.
Thedanger analyzer34 analyzes the image data received in thedata receiver32. Thedanger analyzer34 recognizes and analyzes an object corresponding to the danger situation of thepassenger6 when thevehicle2 stops.
First, thedanger analyzer34 analyzes and determines whether thedanger object5 approaching the side of thevehicle2 is present from the image data collected from thecamera module12 mounted on the side rear-view mirror. Thedanger analyzer34 analyzes and determines whether thedanger object5 is a two-wheeled vehicle such as a motorcycle or a bicycle when it is analyzed that thedanger object5 is present. Further, thedanger analyzer34 analyzes a speed at which the two-wheeled vehicle approaches the entrance of thevehicle2 in the case in which thedanger object2 is the two-wheeled vehicle such as the motorcycle or the bicycle.
Second, thedanger analyzer34 analyzes and determines a situation in which thepassengers6 get on/off thevehicle2 from the image data collected from thecamera module12 mounted on thedoor4 region when thevehicle2 stops.
Third, thedanger analyzer34 analyzes whether thepassengers6, the foreign materials, and the like, are interposed between the entrance and thedoor4 from the image data collected from thecamera module12 mounted on thedoor4 region before thevehicle2 starts to be driven from a state in which thevehicle2 stops.
The first to third analyses of thedanger analyzer34 as described above may be sequentially performed. For example, thedanger analyzer34 analyzes the danger situation of thedanger object5 approaching the side of thevehicle2, analyzes the situation in which thepassengers6 get on/off thevehicle2 in the case in which it is not determined that the analyzed data corresponds to the danger situation, and analyzes whether thepassengers6 and the foreign materials are interposed in a state in which thedoor4 is closed before thevehicle2 starts to be driven in the case in which it is not determined that the analyzed data corresponds to the danger situation (a process in which the passengers get on/off the vehicle2).
Thecontrol signal generator36 generates the control signal according to the analysis and the determination of thedanger analyzer34. That is, thecontrol signal generator36 generates a control signal allowing the controllingunit50 to control an operation of thedrive train3 of thevehicle2 and thedoor4 when it is determined that the data analyzed from thedanger analyzer34 corresponds to the danger situation.
Thecontrol signal generator36 generates a control signal allowing thedoor4 to be maintained in a closed state at the time of a danger situation of the side of thevehicle2 and generates a control signal allowing thedoor4 to be maintained in an opened state when thepassengers6 get on/off thevehicle2. In addition, thecontrol signal generator36 generates a control signal allowing thedoor4 to be opened when thepassengers6 or the foreign materials are interposed in a state in which thedoor4 is closed after it is determined that a process in which thepassengers6 get on/off thevehicle2 is completed.
Here, the control signal generated from thecontrol signal generator36 is preferential to a manual operation of the driver of thevehicle2. For example, when it is determined that the analyzed data corresponds to the danger situation after thevehicle2 stops, the control signal is preferentially operated as compared to an operation of thedoor4. In addition, when it is determined that the analyzed data corresponds to the danger situation before thevehicle2 starts to be driven, the control signal is preferentially operated as compared to an operation of thedoor4 and an operation of thedrive train3 of thevehicle2.
The controllingunit50 controls the operations of thedrive train3 of thevehicle2 and thedoor4 based on the signal generated from thecontrol signal generator36. That is, the controllingunit50 controls at least any one of the operations of thedrive train3 of thevehicle2 and thedoor4 according to the danger situation of the data analyzed from thedanger analyzer34.
For example, at the time of the stop of thevehicle2, the controllingunit50 receives the control signal provided from thecontrol signal generator36 to control the operation of thedoor4 so that thedoor4 is not opened, when it is determined that the data analyzed from thedanger analyzer34 corresponds to the danger situation in which thedanger object5 approaches thevehicle2. In addition, the controllingunit50 receives the control signal provided from thecontrol signal generator36 to control the operation of thedoor4 so that thedoor4 is maintained in the closed state when it is determined that the data analyzed from thedanger analyzer34 corresponds to the situation in which thepassengers6 get on/off thevehicle2 through the entrance. Further, before thevehicle2 starts to be driven, the controllingunit50 receives the control signal to preferentially control thedrive train3 of thevehicle2 so that thevehicle2 is not driven and control the operation of thedoor4 so that thepassengers6 or the foreign materials interposed between the entrance and thedoor4 may be removed, when it is determined that the data analyzed from thedanger analyzer34 corresponds to the situation in which thepassengers6 or the foreign materials are interposed between the entrance and thedoor4.
Finally, thedata outputting unit70 includes thedisplay unit72, asound outputter74, and analarm lamp76. Preferentially, thedata outputting unit70 outputs the image data collected from thecamera module12 of thedata collecting unit10 in real time. In addition, thedata outputting unit70 outputs an alarm so as to warn the driver of thevehicle2 and thepassengers6 of the danger situation in the case in which it is determined that the data analyzed from thedata analyzing unit30 corresponds to the danger situation. Here, the alarm may include an alarm message, an alarm sound, and the like.
Thedisplay unit72 displays the image data collected from thecamera module12 of thedata collecting unit10 in real time. In addition, thedisplay unit72 displays the alarm message in the case in which the data analyzed from thedata analyzing unit30 corresponds to the danger situation. Here, thedisplay unit72 may inform the driver and the passenger of the alarm through flicker of a screen in addition to the alarm message.
Thesound outputter74 outputs the alarm sound in the case in which the data analyzed from thedata analyzing unit30 corresponds to the danger situation. According to the exemplary embodiment of the present invention, a speaker capable of outputting the alarm sound is used as thesound outputter74.
Thealarm lamp76 uses light in order to inform the driver and the passenger of the alarm in the case in which the data analyzed from thedata analyzing unit30 corresponds to the danger situation. For example, thealarm lamp76 may be a warning light installed in a police car or a fire engine.
As described above, thedata outputting unit70 outputs the image data collected from thecameral module12 in real time so that the driver of thevehicle2 may be informed of the side of thevehicle2 and the situation of thedoor4 region in real time. In addition, thedata outputting unit70 outputs the alarm to the driver of thevehicle2 and thepassengers6 so as to prevent an accident in the case in which the data analyzed from thedata analyzing unit30 corresponds to the danger situation.
FIGS. 3 and 4 are control flow charts of the danger sensing apparatus of the vehicle according to the exemplary embodiment of the present invention.
A control method of adanger sensing apparatus1 of avehicle2 according to an exemplary embodiment of the present invention will be described with reference to a configuration shown inFIGS. 3 and 4.
First, it is determined whether thevehicle2 stops (S10). In the case in which it is determined that thevehicle2 stops, thecamera module12 of thedata collecting unit10 collects the image data on the side of thevehicle2 and the situation of thedoor4 region opening/closing the entrance (S30). Meanwhile, when it is determined in step (S10) that the vehicle is being driven, the driving of thevehicle2 is continuously performed while an operation of thecamera module12 as in a control flow to a process ‘A’.
In step (S30), thecamera module12 collects the image data in real time until the vehicle starts to be driven. In addition, thedisplay unit72 of thedata outputting unit70 displays the image data transmitted in real time (S50).
Next, thedata analyzing unit30 receives the image data transmitted from thedata collecting unit10 to analyze the danger situation of the image data (S70).
It is determined whether the data analyzed in step (S70) corresponds to the danger situation (S90). When it is determined in step (S90) that the analyzed data corresponds to the danger situation, it is determined whether thedanger object5 such as the motorcycle, the bicycle, or the like, approaches the side of the vehicle2 (S110). On the other hand, when it is not determined in step (S90) that the analyzed data corresponds to the danger situation, thedoor4 is open so that thepassengers6 get off the vehicle according to a control flow of ‘B’ (S190).
When it is determined in step (S110) that thedanger target5 is present at the side of thevehicle2 and approaches the side of thevehicle2, an alarm is output so as to inform the driver of thevehicle2 and thepassengers6 getting on thevehicle2 of the danger situation (S130). Here, the output alarm may be an alarm message displayed on thedisplay unit72, an alarm sound output from thesound outputter74, and a light emitted from thealarm lamp76. In addition, together with step (S130), thedoor4 is closed so that thepassengers6 getting on thevehicle2 do not get off the vehicle2 (S150).
Meanwhile, it is determined in step (S110) that thedanger object5 is not present at the side of thevehicle2, it is determined whether thepassengers6 are present in an entrance region according to a control flow of ‘C’ (S170) When it is determined in step (S170) that the passengers are present in the entrance region, thedoor4 is opened (S190).
Next, when it is determined in step (S170) that thepassengers6 are not present in the entrance region, it is determined whether thepassengers6 or the foreign materials are interposed between the entrance and thedoor4 at the time of closure of the door4 (S210). When it is determined in step (S210) that thepassengers6 or the foreign materials are interposed between the entrance and thedoor4 of the entrance region, thedoor4 is opened (S190). In addition, when it is determined in step (S210) that thepassengers6 or the foreign materials are interposed between the entrance and thedoor4 of the entrance region, thedrive train3 is controlled so that thevehicle2 is not driven (S230).
On the other hand, when it is determined in step (S210) that thepassengers6 or the foreign materials are not interposed between the entrance and thedoor4 of the entrance region, thedoor4 is closed (S250). Then, thevehicle2 starts so that it is driven (S270).
Here, from after the stop of thevehicle2 to before the start of the driving thereof, steps (S90 to S230) are repeatedly performed according to the image data collected from thedata collecting unit10 in real time and the analysis of the collected image data as in a control flow of ‘D’.
As set forth above, with the danger sensing apparatus of the vehicle and the control method thereof according to the exemplary embodiments of the present invention, the side of the vehicle and the situation of the door region when the passengers get on/off the vehicle at the time of the stop of the vehicle are collected and analyzed in real time, thereby making it possible to actively control the operations of the drive train of the vehicle and the door. Therefore, the accident capable of being generated when the passengers get on/off the vehicle may be prevented in advance.
Although the exemplary embodiments of the present invention has been described with reference to the accompanying drawings, those skilled in the art will appreciate that various modifications and alterations may be made without departing from the spirit or essential feature of the present invention. Therefore, it should be understood that the above-mentioned embodiments are not restrictive, but are exemplary in all aspects. It should be interpreted that the scope of the present invention is defined by the following claims rather than the above-mentioned detailed description and all modifications or alterations deduced from the meaning, the scope, and equivalences of the claims are included in the scope of the present invention.