技术领域technical field
本发明涉及车辆违规抓拍技术，特别涉及一种车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法。The invention relates to a vehicle violation capture technology, in particular to a capture device and a capture method for a vehicle passing a pedestrian crosswalk.
背景技术Background technique
我国道路交通安全法规规定，车辆在通过人行横道时需要礼让正在过马路的行人，但由于我国驾驶员的素质整体差异性较大，部分的驾驶员在通过人行横道时经常与行人争抢，有些甚至加速抢道，这种现象存在很大的安全隐患，容易出现车撞行人的交通事故。人行横道分为有信号灯控制和无信号灯控制，在有信号灯控制的人行横道上，当行人在绿灯期间通行时，由于我国道路交通管理法规的设置，依然会出现车辆与行人抢道的现象，如右转弯车辆或者左转弯车辆。从路权角度而言，行人在绿灯通过人行横道时拥有优先权，但由于行人属于弱势群体，因而当车辆不减速避让时行人必须进行避让，这对于行人在人行横道上的正常通行带来了影响。分析上述事件的原因，道路交通安全法规定，当车辆不影响行人通过人行横道时才可以右转或者是做转弯，因而驾驶员的抢道行为从道德角度和法律角度而言都是不正确的。目前所使用的车辆抓拍系统通常只对车辆的超速、闯红灯等现象进行监控，对于车辆在通过人行横道时与行人抢道的现象没有抓拍功能。my country's road traffic safety regulations stipulate that vehicles need to give way to pedestrians who are crossing the road when passing a crosswalk. However, due to the overall difference in the quality of drivers in our country, some drivers often compete with pedestrians when passing a crosswalk, and some even speed up. There is a great potential safety hazard in this phenomenon, and it is prone to traffic accidents where cars hit pedestrians. Pedestrian crosswalks are divided into signal light control and non-signal light control. On the pedestrian crossing with signal light control, when pedestrians pass during the green light period, due to the setting of road traffic management regulations in our country, there will still be vehicles and pedestrians rushing to the road, such as turning right. vehicles or vehicles turning left. From the point of view of right of way, pedestrians have priority when passing the crosswalk with a green light, but because pedestrians are vulnerable groups, pedestrians must give way when the vehicle does not slow down to avoid, which has an impact on the normal passage of pedestrians on the crosswalk. Analyzing the reasons for the above-mentioned incidents, the Road Traffic Safety Law stipulates that vehicles can only turn right or make a turn when they do not interfere with pedestrians passing the crosswalk. Therefore, the driver's behavior of grabbing the road is incorrect from both a moral and a legal point of view. The currently used vehicle capture system usually only monitors the phenomenon of vehicles speeding, running red lights, etc., and has no capture function for the phenomenon of vehicles rushing to cross the pedestrian crossing.
发明内容Contents of the invention
本发明的目的在于提供一种车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法，能够自动完成车辆通过人行横道时与行人抢道的抓拍过程，投资费用少，工作可靠性高，适合于大规模推广应用。The object of the present invention is to provide a kind of capturing device and method for snapping a vehicle with pedestrians when passing a crosswalk, which can automatically complete the snapping process of a vehicle and pedestrians when passing a crosswalk, with low investment cost and high work reliability, suitable for Large-scale promotion and application.
为达到上述目的，本发明采用以下技术方案予以实现。In order to achieve the above object, the present invention adopts the following technical solutions to achieve.
1、一种车辆通过人行横道时与行人抢道的抓拍装置，其特征在于，包括安装于人行横道路侧的立杆，所述立杆上安装有图像采集装置、微处理器和数据存储器，所述图像采集装置包括在所述立杆上设置的数字摄像机和红绿灯信号采集器；所述数字摄像机和红绿灯信号采集器的输出端连接至所述微处理器，所述微处理器的输出端连接至数据存储器。本技术方案的特点和进一步改进在于：1. A snapping device for grabbing pedestrians when a vehicle passes a pedestrian crossing, characterized in that it includes a pole installed on the side of the pedestrian crossing, and an image acquisition device, a microprocessor and a data memory are installed on the pole, and the The image acquisition device comprises a digital camera and a traffic light signal collector arranged on the pole; the output terminals of the digital camera and the traffic light signal collector are connected to the microprocessor, and the output terminals of the microprocessor are connected to data storage. The characteristics and further improvement of this technical solution are:
所述数据存储器为SD卡，其容量为16G。The data memory is an SD card with a capacity of 16G.
所述微处理器为DSP处理器，具体型号为TMS320。The microprocessor is a DSP processor, and the specific model is TMS320.
1、一种基于上述装置的车辆通过人行横道时与行人抢道的抓拍方法，基于上述的车辆通过人行横道时与行人抢道的抓拍装置，其特征在于，包括以下步骤：1, a kind of capture method based on the vehicle of above-mentioned device when passing pedestrian crossing and grabbing the way with pedestrian, it is characterized in that, comprises the following steps:
绿灯信号采集判断：红绿灯信号采集器采集人行横道指示灯的信息，当采集到人行横道指示灯为绿灯时输入微处理器。Green light signal acquisition and judgment: the traffic light signal collector collects the information of the pedestrian crosswalk indicator light, and inputs the information to the microprocessor when the pedestrian crosswalk indicator light is green.
图像采集：数字摄像机在接收到人行横道指示灯为绿灯时对人行横道进行图像采集。Image acquisition: The digital camera collects images of the pedestrian crosswalk when it receives the green light of the pedestrian crosswalk indicator light.
微处理器识别鉴定：微处理器对数字摄像机采集的图像进行识别鉴定，首先对人行横道上有无行人进行识别，以识别到的目标一直沿着垂直于人行横道标线方向前进鉴定为人行横道上有行人；其次对人行横道附近有无车辆进行识别，以识别到的目标与人行横道标线方向接近，且两者之间的夹角小于等于50度鉴定为人行横道附近有车辆；再对车辆是否有减速避让行人进行判断，以连续两次识别到的车辆位置和两次的时间差，计算出车辆的行驶速度，如果车辆的行驶速度一直大于15km/h，则鉴定为车辆没有避让行人。Microprocessor identification and identification: The microprocessor identifies and identifies the images collected by the digital camera. First, it identifies whether there are pedestrians on the crosswalk, and the identified target is identified as a pedestrian on the crosswalk if it moves along the direction perpendicular to the markings of the crosswalk. ;Secondly, identify whether there is a vehicle near the pedestrian crossing, so that the identified target is close to the direction of the pedestrian crossing marking, and the angle between the two is less than or equal to 50 degrees to identify a vehicle near the pedestrian crossing; Judgment is carried out, and the driving speed of the vehicle is calculated with the vehicle position recognized twice in a row and the time difference between the two times. If the driving speed of the vehicle is always greater than 15km/h, it is determined that the vehicle does not avoid pedestrians.
存入数据存储器：将微计算机识别鉴定为车辆没有避让行人的图像存入数据存储器，以作为交管部门处理违章提供依据。Store in the data memory: store the image identified by the microcomputer as the vehicle not avoiding pedestrians into the data memory, so as to provide a basis for the traffic control department to deal with violations.
本发明的车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法，通过红绿灯信号采集器和数字摄像机，完成对人行横道上车辆和行人图像的采集，采集完的信息输入微处理器，由微处理器根据采集的图像完成车辆是否避让行人的识别鉴定，将鉴定为车辆没有避让行人的图像存入数据存储器，以作为交管部门处理违章提供依据；本发明结构简单，可操作性强，投入成本少，可靠性高，适合于大规模推广应用。The capture device and the capture method thereof of the present invention when a vehicle crosses a pedestrian crossing, completes the collection of images of vehicles and pedestrians on the pedestrian crossing through a traffic light signal collector and a digital camera, and the collected information is input into a microprocessor, and the microprocessor The processor completes the identification and identification of whether the vehicle is avoiding pedestrians according to the collected images, and stores the images identified as vehicles not avoiding pedestrians into the data storage, so as to provide a basis for the traffic control department to deal with violations; the invention has simple structure, strong operability, and low investment cost Less, high reliability, suitable for large-scale promotion and application.
附图说明Description of drawings
下面结合附图和具体实施方式对本发明作进一步详细说明。The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.
图1为本发明的车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法的原理示意图。Fig. 1 is a schematic diagram of the principle of the capture device and the capture method of the vehicle passing the pedestrian crossing according to the present invention.
具体实施方式detailed description
参照图1，为本发明的车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法的原理示意图。其中，该抓拍装置包括安装于人行横道路侧的立杆，立杆上安装有图像采集装置、微处理器和数据存储器，图像采集装置包括在立杆上设置的数字摄像机和红绿灯信号采集器，其中，立杆高度大于等于四米，数字摄像机的镜头朝向人行横道，以保证数字摄像机的镜头能够拍摄到所要监测的整个人行横道及其附近区域，红绿灯信号采集器安装于人行横道的信号灯控制面板内，将红绿灯信号采集器的触点与人行横道的绿灯控制线相连接，并将此触点利用导线与微处理器的I/O接口连接，实时采集人行横道的绿灯信号，微处理器和数据存储器安装于立杆下方的控制盒内；数字摄像机和红绿灯信号采集器的输出端通过I/0接口连接至所述微处理器，微处理器的输出端通过I/0接口连接至数据存储器。本实施例中，采用的数据存储器为SD卡，其容量为16G，采用的微处理器为DSP处理器，具体型号为TMS320。Referring to FIG. 1 , it is a schematic diagram of the principle of the capture device and the capture method of the vehicle and the pedestrian rushing through the pedestrian crossing according to the present invention. Wherein, the capture device includes a vertical pole installed on the side of the pedestrian crossing, an image acquisition device, a microprocessor and a data storage device are installed on the vertical pole, and the image acquisition device includes a digital camera and a traffic light signal collector arranged on the vertical pole, wherein , the height of the pole is greater than or equal to four meters, the lens of the digital camera faces the crosswalk, so as to ensure that the lens of the digital camera can capture the entire crosswalk and its surrounding areas to be monitored, the traffic light signal collector is installed in the signal light control panel of the crosswalk, and the traffic light The contact of the signal collector is connected with the green light control line of the pedestrian crossing, and the contact is connected with the I/O interface of the microprocessor by a wire, and the green light signal of the pedestrian crossing is collected in real time. The microprocessor and the data memory are installed on the pole In the control box below; the output ends of the digital camera and the traffic light signal collector are connected to the microprocessor through the I/0 interface, and the output ends of the microprocessor are connected to the data memory through the I/0 interface. In this embodiment, the data memory used is an SD card with a capacity of 16G, and the microprocessor used is a DSP processor, and the specific model is TMS320.
本发明的车辆通过人行横道时与行人抢道的抓拍装置及其抓拍方法，该抓拍方法包括以下步骤：The present invention relates to a snapping device and a snapping method thereof for a vehicle passing a pedestrian crossing, and the snapping method comprises the following steps:
（1）绿灯信号采集判断：红绿灯信号采集器采集人行横道指示灯的信息，当采集到人行横道指示灯为绿灯时输入微处理器。人行横道红灯期间，行人应该在路边等候，因此，人行横道红灯期间车辆可以正常穿过人行横道，不存在与行人抢道需要抓拍的情况。只有当微处理器采集得到人行横道绿灯亮起时，本发明所提出的车辆通过人行横道时与行人抢道的抓拍方法才进入下一步继续运行。(1) Green light signal acquisition and judgment: The traffic light signal collector collects the information of the pedestrian crosswalk indicator light, and inputs the information to the microprocessor when the pedestrian crosswalk indicator light is green. During the red light of the pedestrian crossing, pedestrians should wait on the side of the road. Therefore, vehicles can pass through the pedestrian crossing normally during the red light of the pedestrian crossing. Only when the microprocessor collects and obtains that the green light of the pedestrian crossing is on, the snapping method of grabbing the way with pedestrians when the vehicle passed the pedestrian crossing proposed by the present invention just enters the next step to continue operation.
（2）图像采集：数字摄像机在接收到人行横道指示灯为绿灯时对人行横道进行图像采集，数字摄像机按规定的间隔时间对人行横道及其附近区域进行抓拍，以作为微处理器识别鉴定的图像库。(2) Image acquisition: The digital camera collects images of the pedestrian crosswalk when it receives the green light of the pedestrian crosswalk indicator, and the digital camera captures the pedestrian crosswalk and its surrounding areas at specified intervals as an image library for microprocessor identification.
（3）微处理器识别鉴定：微处理器对数字摄像机采集的图像进行识别鉴定，首先对人行横道上有无行人进行识别，以识别到的目标一直沿着垂直于人行横道标线方向前进鉴定为人行横道上有行人；其次对人行横道附近有无车辆进行识别，以识别到的目标与人行横道标线方向接近，且两者之间的夹角小于等于50度鉴定为人行横道附近有车辆；再对车辆是否有减速避让行人进行判断，以连续两次识别到的车辆位置和两次的时间差，计算出车辆的行驶速度，如果车辆的行驶速度一直大于15km/h，则鉴定为车辆没有避让行人。(3) Microprocessor identification and identification: The microprocessor identifies and identifies the images collected by the digital camera. First, it identifies whether there are pedestrians on the crosswalk, so that the identified target has been identified as a pedestrian crosswalk along the direction perpendicular to the pedestrian crosswalk markings. There are pedestrians on the pedestrian; secondly, identify whether there is a vehicle near the pedestrian crosswalk, so that the identified target is close to the direction of the pedestrian crosswalk marking, and the angle between the two is less than or equal to 50 degrees. Judging by decelerating and avoiding pedestrians, the vehicle's driving speed is calculated based on the two consecutive recognized vehicle positions and the time difference between the two times. If the vehicle's driving speed is always greater than 15km/h, it is determined that the vehicle has not avoided pedestrians.
（4）存入数据存储器：将微计算机识别鉴定为车辆没有避让行人的图像存入数据存储器SD卡中，完成车辆在人行横道上与行人抢道抓拍过程，以作为交管部门处理违章提供依据。(4) Store in the data memory: store the image identified by the microcomputer as the vehicle not avoiding pedestrians into the SD card of the data memory, and complete the capture process of the vehicle and pedestrians on the crosswalk to provide a basis for the traffic control department to deal with violations.
本发明的车辆通过人行横道时与行人抢道的抓拍装置，主要采用数字摄像机和DSP处理器，投资费用少，设计简单，可靠性高，而且不需要对现有人行横道设施进行改装。本发明的车辆通过人行横道时与行人抢道的抓拍方法，通过红绿灯信号采集器和数字摄像机，完成对人行横道上车辆和行人图像的采集，采集完的信息输入微处理器，由微处理器根据采集的图像完成车辆是否避让行人的识别鉴定，将鉴定为车辆没有避让行人的图像存入数据存储器，以作为交管部门处理违章提供依据，智能化高，可操作性强，对车辆违规的抓拍结果存储可靠，适合于大规模推广应用。The capture device of the present invention for grabbing pedestrians when vehicles pass through a pedestrian crossing mainly adopts a digital camera and a DSP processor, has low investment cost, simple design, high reliability, and does not need to refit existing pedestrian crossing facilities. In the method for snapping photos of vehicles and pedestrians rushing through the crosswalk in the present invention, the collection of images of vehicles and pedestrians on the crosswalk is completed through a traffic light signal collector and a digital camera. Complete the identification and identification of whether the vehicle is avoiding pedestrians, and store the images identified as vehicles not avoiding pedestrians into the data storage as a basis for the traffic control department to deal with violations. It is highly intelligent and operable, and stores the capture results of vehicle violations. Reliable and suitable for large-scale promotion and application.
尽管以上结合附图对本发明的实施方案进行了描述，但本发明并不局限于上述的具体实施方案，上述的具体实施方案仅仅是示意性的、指导性的，而不是限制性的。本领域的普通技术人员在本说明书的启示下，在不脱离本发明权利要求所保护的范围的情况下，还可以做出很多种的形式，这些均属于本发明保护之列。Although the embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative, instructive, and not restrictive. Under the enlightenment of this description, those skilled in the art can also make many forms without departing from the protection scope of the claims of the present invention, and these all belong to the protection of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310120185.5ACN103198659B (en) | 2013-04-08 | 2013-04-08 | Vehicle is by during crossing and the grasp shoot device that scrambles for roads of pedestrian and grasp shoot method thereof |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310120185.5ACN103198659B (en) | 2013-04-08 | 2013-04-08 | Vehicle is by during crossing and the grasp shoot device that scrambles for roads of pedestrian and grasp shoot method thereof |
| Publication Number | Publication Date |
|---|---|
| CN103198659A CN103198659A (en) | 2013-07-10 |
| CN103198659Btrue CN103198659B (en) | 2016-03-23 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310120185.5AExpired - Fee RelatedCN103198659B (en) | 2013-04-08 | 2013-04-08 | Vehicle is by during crossing and the grasp shoot device that scrambles for roads of pedestrian and grasp shoot method thereof |
| Country | Link |
|---|---|
| CN (1) | CN103198659B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104504896B (en)* | 2014-08-15 | 2017-06-27 | 上海市政工程设计研究总院（集团）有限公司 | A kind of traffic offence automatic production record and method |
| CN104183126A (en)* | 2014-09-16 | 2014-12-03 | 哈尔滨新中新华科电子设备有限公司 | Traffic persuasion system based on Zigbee technology |
| CN104575043B (en)* | 2014-11-28 | 2017-04-19 | 山东易华录信息技术有限公司 | Automatic prompt system and method during passing of motor vehicle through pedestrian crosswalk |
| CN104574979B (en)* | 2014-11-28 | 2017-06-06 | 山东易华录信息技术有限公司 | Motor line does not give way the camera system and method for behavior in accordance with the law through crossing |
| CN104574955B (en)* | 2014-11-28 | 2017-02-22 | 山东易华录信息技术有限公司 | System and method for recording behaviors that motor vehicles do not yield in accordance with law when passing through crossroad with Stop/Yield sign |
| CN104574980B (en)* | 2014-12-01 | 2017-11-17 | 山东易华录信息技术有限公司 | Record the not parking avoidance pedestrian's illegal activities system and method for crossing turning motor vehicle |
| CN104574981B (en)* | 2014-12-01 | 2017-06-06 | 山东易华录信息技术有限公司 | Do not give way the system and method for behavior at pass through crossing of giving way of record motor vehicle |
| CN104574995B (en)* | 2015-01-09 | 2017-06-06 | 山东易华录信息技术有限公司 | The system and method that record crossing right turning vehicle makes a dash across the red light and do not avoid pedestrian behavior |
| CN104680133B (en)* | 2015-02-04 | 2018-02-02 | 上海依图网络科技有限公司 | A kind of violation car allows people's behavior real-time detection method |
| CN106157694B (en)* | 2016-07-29 | 2019-04-19 | 深圳市元征科技股份有限公司 | A kind of the pedestrian anti-collision method for early warning and device of intersection |
| CN107622669B (en)* | 2017-10-25 | 2021-03-12 | 哈尔滨工业大学 | A method for identifying whether a right-turning motor vehicle yields to pedestrians |
| CN110490108B (en)* | 2019-08-08 | 2022-02-08 | 浙江大华技术股份有限公司 | Violation state marking method and device, storage medium and electronic device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1516366A (en)* | 2003-01-06 | 2004-07-28 | 西北工业大学 | DSP-based Red Light Monitoring System |
| CN1936998A (en)* | 2006-10-19 | 2007-03-28 | 姜廷顺 | System for automatically monitoring running vehicle that violating yield rule, and operation method therefor |
| CN101216996A (en)* | 2007-12-28 | 2008-07-09 | 云南澜博科技有限公司 | A method for monitoring vehicle offences by video |
| CN102201165A (en)* | 2010-03-25 | 2011-09-28 | 北京汉王智通科技有限公司 | Monitoring system of vehicle traffic violation at crossing and method thereof |
| CN102298844A (en)* | 2011-08-15 | 2011-12-28 | 无锡中星微电子有限公司 | Automatic rule breaking vehicle detection system and method |
| CN102592450A (en)* | 2012-02-22 | 2012-07-18 | 杭州海康威视数字技术股份有限公司 | System and method for snapshotting behavior of motor vehicles not giving precedence to pedestrians on zebra stripes |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1516366A (en)* | 2003-01-06 | 2004-07-28 | 西北工业大学 | DSP-based Red Light Monitoring System |
| CN1936998A (en)* | 2006-10-19 | 2007-03-28 | 姜廷顺 | System for automatically monitoring running vehicle that violating yield rule, and operation method therefor |
| CN101216996A (en)* | 2007-12-28 | 2008-07-09 | 云南澜博科技有限公司 | A method for monitoring vehicle offences by video |
| CN102201165A (en)* | 2010-03-25 | 2011-09-28 | 北京汉王智通科技有限公司 | Monitoring system of vehicle traffic violation at crossing and method thereof |
| CN102298844A (en)* | 2011-08-15 | 2011-12-28 | 无锡中星微电子有限公司 | Automatic rule breaking vehicle detection system and method |
| CN102592450A (en)* | 2012-02-22 | 2012-07-18 | 杭州海康威视数字技术股份有限公司 | System and method for snapshotting behavior of motor vehicles not giving precedence to pedestrians on zebra stripes |
| Publication number | Publication date |
|---|---|
| CN103198659A (en) | 2013-07-10 |
| Publication | Publication Date | Title |
|---|---|---|
| CN103198659B (en) | Vehicle is by during crossing and the grasp shoot device that scrambles for roads of pedestrian and grasp shoot method thereof | |
| CN108645628B (en) | Self-driving car test system based on road driving skills | |
| CN104361747B (en) | Recognition method for automatic capture and recognition method for vehicles not giving way to passengers on zebra crossing | |
| CN101593422B (en) | A Traffic Violation Detection Method Based on Video Tracking and Pattern Recognition | |
| CN100578562C (en) | The Method of Using Video to Monitor Vehicle Illegal Behavior | |
| CN102254429B (en) | Video identification-based detection method of detection device of violation vehicles | |
| CN103559792B (en) | A kind of identification of highway driving vehicle fatigue driving | |
| CN105046954B (en) | The current state dynamic detection system in crossing and method analyzed based on video intelligent | |
| CN104575043B (en) | Automatic prompt system and method during passing of motor vehicle through pedestrian crosswalk | |
| CN104574979B (en) | Motor line does not give way the camera system and method for behavior in accordance with the law through crossing | |
| CN100476899C (en) | Automatic monitoring system and operation method for driving vehicles in violation of yield regulations | |
| CN203759874U (en) | Traffic violation information collection system with video enhancement effect | |
| CN109979242A (en) | A kind of freeway tunnel lane change, overtake other vehicles prior-warning device and method | |
| CN102610099A (en) | Traffic violation detection system and traffic violation detection method for crossroads | |
| CN104282176A (en) | Intelligent community vehicle and pedestrian safety management method and system | |
| CN104575000A (en) | Method and system for recording illegal behaviors of motor vehicles entering jamming intersection | |
| CN204965764U (en) | System is dredged to urban traffic intelligence | |
| CN110379172A (en) | The generation method and device of traffic rules, storage medium, electronic device | |
| CN104809887A (en) | Detecting method for vehicle converse running on expressway and automatic alarm device | |
| CN202394386U (en) | Crossing vehicle high-definition comprehensive supervision service system based on Internet of things technology | |
| CN203535663U (en) | Lane recognition apparatus based on RFID technology | |
| CN103077608B (en) | Method for obtaining evidence of behavior of intentionally running yellow light of driver | |
| CN113177443A (en) | Method for intelligently identifying road traffic violation based on image vision | |
| CN104575045A (en) | System and method for automatically prompting motor vehicle passing through speed-reducing way-giving intersection to reduce speed for giving way | |
| CN108663368B (en) | A system and method for real-time monitoring of overall nighttime visibility of expressway road network |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20160323 | |
| CF01 | Termination of patent right due to non-payment of annual fee |