Movatterモバイル変換


[0]ホーム

URL:


CN108621948A - Vehicle panoramic viewing system and panoramic looking-around image generating method - Google Patents

Vehicle panoramic viewing system and panoramic looking-around image generating method
Download PDF

Info

Publication number
CN108621948A
CN108621948ACN201810669765.2ACN201810669765ACN108621948ACN 108621948 ACN108621948 ACN 108621948ACN 201810669765 ACN201810669765 ACN 201810669765ACN 108621948 ACN108621948 ACN 108621948A
Authority
CN
China
Prior art keywords
camera
vehicle
panoramic
fish eye
lens module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810669765.2A
Other languages
Chinese (zh)
Inventor
李松
马赟烽
郑小平
徐刚
刘亦安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HANGZHOU EVNET INTELLIGENT TECHNOLOGY Co Ltd
Original Assignee
HANGZHOU EVNET INTELLIGENT TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HANGZHOU EVNET INTELLIGENT TECHNOLOGY Co LtdfiledCriticalHANGZHOU EVNET INTELLIGENT TECHNOLOGY Co Ltd
Priority to CN201810669765.2ApriorityCriticalpatent/CN108621948A/en
Publication of CN108621948ApublicationCriticalpatent/CN108621948A/en
Pendinglegal-statusCriticalCurrent

Links

Classifications

Landscapes

Abstract

The invention discloses a kind of vehicle panoramic viewing system and panoramic looking-around image generating methods, wherein, the preceding camera of vehicle panoramic viewing system is located at the front of vehicle, and left camera is located at the left side of vehicle, right camera is located at the right side of vehicle, and rear camera is located at the rear of vehicle;Preceding camera, left camera, right camera and rear camera include the identical fish eye lens module of structure, and the wide-angle of fish eye lens module is 190 °;Processor, it is connect respectively with preceding camera, left camera, right camera, rear camera and Vehicular display device, for each image information obtained from preceding camera, left camera, right camera and rear camera to be spliced into panoramic looking-around image in real time, and panoramic looking-around image transmitting to Vehicular display device is shown.The present invention enables the image information of acquisition to generate panoramic looking-around image to which panorama covers vehicle angular field of view, expands driver's seat, improves travel safety.

Description

Vehicle panoramic viewing system and panoramic looking-around image generating method
Technical field
The present invention relates to automobile technical fields more particularly to a kind of vehicle panoramic viewing system and panoramic looking-around image to generateMethod.
Background technology
Automobile has obtained development at full speed since the end of last century is born.In recent years due to vehicle safety increasingly byPay attention to, pushed the appearance of many important innovations, such as anti-lock braking system, air bag, high strength safe seat storehouse and touchesHit buffering area etc..German automobiles manufacturer takes the lead in improving driver safety and whole driving body using many advanced technologiesIt tests.For example, in past 20 years, German automobiles release active track and keep auxiliary at first, pass through when automotive run-off-roadDirection of vibration disk reminds driver.Then it is exactly to utilize side radar, helps driver safety lane change.If there is vehicle is in thisThe lane change blind spot of vehicle, it can pass through the bright light prompting driver in outside rear-view mirror.Occurred parking again later, and advanced and brakeAuxiliary, this is the extension of cruise control, fast application can be braked before rear-end impact will occur, to reduce accident hazard.Over time, the gradual improvement and popularization of these functions especially introduces reverse image system to eliminate the blind of driverPoint.
Currently, the reverse image system based on image is to install camera, combining radar for backing car and car-mounted display in the tailstockDevice.But this kind of mode still has deficiency, image that can only cover limited region around the tailstock.It is regarded so that vehicle side and headstock existFeel blind area, this undoubtedly increases the hidden danger of safe driving;For example, in the urban district of narrow congestion and parking lot since vehicle can not be providedThe image information in front and vehicle side is susceptible to collision and scratch event.
Invention content
Vehicle panoramic viewing system and panoramic looking-around image generating method provided by the invention, main purpose are to overcomeThere are vision dead zone, caused driving hidden danger for existing vehicle side and headstock.
In order to solve the above technical problems, the present invention adopts the following technical scheme that:
A kind of vehicle panoramic viewing system, including Vehicular display device, processor and preceding camera, left camera, the right side are taken the photographAs head and rear camera;
The preceding camera is located at the front of vehicle, and the left camera is located at the left side of vehicle, the right camera positionIn the right side of vehicle, the rear camera is located at the rear of vehicle;
The preceding camera, left camera, right camera and rear camera include the identical fish eye lens module of structure,The wide-angle of the fish eye lens module is 190 °;
The processor, respectively with the preceding camera, left camera, right camera, rear camera and car-mounted displayDevice connects, in real time believing each image obtained from the preceding camera, left camera, right camera and rear cameraBreath is spliced into panoramic looking-around image, and the panoramic looking-around image transmitting to the Vehicular display device is shown.
As a kind of embodiment, the preceding camera is located at right over logo or among middle net;The rear cameraAt boot handle;The left camera is located at immediately below left-hand mirror;Under the right camera is located at right rear view mirror justSide.
As a kind of embodiment, the camber angle after the installation of the fish eye lens module of the preceding camera is 20 °~40°;Camber angle after the fish eye lens module installation of the rear camera is 20 °~40 °.
As a kind of embodiment, the camber angle after the fish eye lens module installation of the left camera is 5 °~15 °;Camber angle after the fish eye lens module installation of the right camera is 5 °~15 °.
As a kind of embodiment, the preceding camera, the structure phase of left camera, right camera and rear cameraTogether, including fish eye lens module, fixing bracket and connecting line;
The fish eye lens module, is fixed by the fixing bracket;
The connecting line is connect with the fish eye lens module, for making fish eye lens module carry out data with processorInteraction.
As a kind of embodiment, the optical unit of fish eye lens module is 8 groups 10;Wherein, since object sideThe 4th be stabilization lens, the 5th be focus lens.
As a kind of embodiment, the left camera is identical with right camera quantity, quantity is respectively 1,2,3It is a or 4.
Correspondingly, the present invention also provides a kind of panoramic looking-around image generating method, include the following steps;
By preceding camera configuration in the front of vehicle, left camera is configured in the left side of vehicle, right camera is configuredOn the right side of vehicle, rear camera is configured at the rear of vehicle;The preceding camera that is configured, left camera, right camera shootingHead and rear camera include the identical fish eye lens module of structure, and the wide-angle of the fish eye lens module is 190 °;
The preceding camera, left camera, right camera and each image information of rear camera shooting are obtained, and rightEach described image information is spliced, and the panoramic looking-around image that splicing obtains is shown.
It is described to obtain the preceding camera, left camera, right camera and rear camera as a kind of embodimentEach image information of shooting, splices each described image information, includes the following steps;
The preceding camera, left camera, right camera and each image information of rear camera shooting are obtained in real time,Described image information includes vehicle body characteristic information;
Preset vehicle body standard information is compared with vehicle body characteristic information and generates corresponding Map Searching table, according to instituteIt states Map Searching table and establishes each corresponding panorama Fusion Model;
Each described image information is spliced according to the panorama Fusion Model and Taylor's fitting, obtains panoramic looking-aroundImage.
As a kind of embodiment, panoramic looking-around image generating method provided by the invention is further comprising the steps of;
After obtaining panoramic looking-around image, the outdoor scene characteristic information in described image information is commented according to predetermined threshold valueEstimate, alerting signal is sent out according to assessment result, while preserving assessment result.
Compared with prior art, the technical program has the following advantages:
Vehicle panoramic viewing system and panoramic looking-around image generating method provided by the invention, using positioned at the front of vehiclePreceding camera, positioned at the left camera in the left side of vehicle, positioned at the right camera on the right side of vehicle and positioned at the rear of vehicleRear camera;These cameras all have the fish eye lens module that identical structure and wide-angle are 190 °;It will be each using processorImage information is spliced into panoramic looking-around image, is shown in Vehicular display device.The image information of acquisition is set to generate panoramic looking-aroundImage covers vehicle angular field of view to panorama, overcomes the problems, such as that there are vision dead zones for existing vehicle side and headstock.DriverThe panoramic looking-around image of automobile surrounding can be immediately seen by Vehicular display device in driver's cabin, therefore driver is travellingImage is looked around to travel with the real time panoramic that can be shown according to Vehicular display device when reversing, is expanded driver's seat, is made to driveThe person of sailing understands traffic information in time, improves travel safety.
Description of the drawings
Fig. 1 is the distribution schematic diagram for the vehicle panoramic viewing system that the embodiment of the present invention one provides;
Fig. 2 is the structural schematic diagram for the vehicle panoramic viewing system that the embodiment of the present invention one provides;
Fig. 3 is the structural schematic diagram of the optical unit of fish eye lens module;
Fig. 4 is the structural schematic diagram of the 4th lens in Fig. 3;
Fig. 5 is the structural schematic diagram of the 5th lens in Fig. 3;
Fig. 6 is the flow diagram for the panoramic looking-around image generating method that the embodiment of the present invention three provides.
In figure:1, Vehicular display device;2, processor;3, preceding camera;4, left camera;5, right camera;6, rear camera shootingHead;L1, the first lens;L2, the second lens;L3, the third lens;L4, the 4th lens;L41, the 41st lens;L42, the 4th12 lens;L43, the 43rd lens;L44, the 44th lens;L45, the 45th lens;L5, the 5th lens;L51、51st lens;L52, the 52nd lens;L53, the 53rd lens;L54, the 54th lens;L6, the 6th lens;L7, the 7th lens;L8, the 8th lens;L9, the 9th lens;L10, the tenth lens.
Specific implementation mode
Below in conjunction with attached drawing, the technical characteristic and advantage above-mentioned and other to the present invention are clearly and completely described,Obviously, described embodiment is only the section Example of the present invention, rather than whole embodiments.
It please refers to Fig.1 and Fig. 2, the vehicle panoramic viewing system that the embodiment of the present invention one provides, including Vehicular display device 1,Processor 2 and preceding camera 3, left camera 4, right camera 5 and rear camera 6;Before preceding camera 3 is located at vehicleSide, left camera 4 are located at the left side of vehicle, and right camera 5 is located at the right side of vehicle, and rear camera 6 is located at the rear of vehicle;BeforeCamera 3, left camera 4, right camera 5 and rear camera 6 include the identical fish eye lens module of structure, fish eye lens mouldThe wide-angle of group is 190 °;Processor 2, respectively with preceding camera 3, left camera 4, right camera 5, rear camera 6 and vehicle-mountedDisplay 1 connects, each for will be obtained in real time from preceding camera 3, left camera 4, right camera 5 and rear camera 6Image information is spliced into panoramic looking-around image, and panoramic looking-around image transmitting to Vehicular display device 1 is shown.
It should be noted that preceding camera 3, left camera 4, right camera 5 and rear camera 6 quantity be at least 1It is a.Overall structure between them can differ, but all there are one the identical fish eye lens module of structure, the flakes for toolThe wide-angle of camera lens module is 190 °, so that it is guaranteed that the image information without dead angle on one direction of vehicle can be obtained.For example, positionIt can pass by the image information of 190 ° of vehicle left side in the left camera 4 of vehicle left side.To according to the camera of above-mentioned configurationOutdoor scene characteristic information can not only be obtained, it is often more important that the vehicle characteristic information of vehicle itself can be got.Outdoor scene featureInformation refers to removing remaining characteristic information of vehicle characteristic information in image information, for example, road markings, pedestrian, buildingThe characteristic informations such as object, barrier and traffic lights.
Processor 2 can be the processing chip individually reset, be not take up the resource of existing processor 2 on vehicle, keep awayExempt from Caton phenomenon occur.The specific can be that being realized using FPGA processing boards.In this present embodiment, processor 2 can be to 4The image information in a direction carries out being spliced to form panoramic looking-around image, and presentation is directly overlapped in image information fusion band part.ThisRequirement of the kind mode to processor 2 is very low, can quickly handle image information and obtain panoramic looking-around image, then pass through car-mounted displayDevice 1 is presented in real time.So that driver can be immediately seen the panorama ring of automobile surrounding in driver's cabin by Vehicular display device 1Visible image.And panoramic looking-around image can be preserved in processor 2.Rather than existing seamed splicing on the market nowPanoramic looking-around system.The characteristics of system is all around to fill four wide-angle cameras in vehicle, wide-angle is at 150 degree to 180Between degree, image is handled and has been shown, simply image superposition cannot be got up, but by after image procossing, it is intermediateIt is car, image is placed on periphery.But have one disadvantage in that, the problem of due to technology, the place of four image mosaics is exactly fourOn a diagonal line, comprehensively smooth processing can not be carried out.Therefore, there are apparent four lines in the stitching portion of four images, usuallyUsing black line or gray line come the defect on concealing technique.And the above problem would not occur in the camera that the present invention configures.Yu QiIn his embodiment, the splicing of image information can realize that high-precision is seamless using the algorithm based on deep learning in processor 2Automatic calibration is supported in splicing.Improve the accuracy of panoramic looking-around image.It is not limited thereto.
Vehicular display device 1 is mounted in cockpit, can be realized using the existing display of vehicle;Also may be usedTo be an additionally mounted Vehicular display device 1.In this present embodiment, processor 2 can be integrated in Vehicular display device 1, to subtractFew occupied space.Driver can be immediately seen the panoramic looking-around figure of automobile surrounding in driver's cabin by Vehicular display device 1Picture.The content shown in Vehicular display device 1 can be shown under the control of a processor 2, vehicle-mounted according to different requirements,Display 1 can show different contents.
Vehicle panoramic viewing system provided by the invention, using positioned at the front of vehicle preceding camera 3, positioned at vehicleThe left camera 4 in left side, the right camera 5 positioned at the right side of vehicle and the rear rear camera 6 positioned at vehicle;These camerasAll have the fish eye lens module that identical structure and wide-angle are 190 °;Each image information is spliced into panorama using processor 2Image is looked around, is shown in Vehicular display device 1.The image information of acquisition is set to generate panoramic looking-around image to which panorama covers vehicleAngular field of view, overcomes the problems, such as that there are vision dead zones for existing vehicle side and headstock.Driver is in driver's cabin by vehicle-mountedDisplay 1 can be immediately seen the panoramic looking-around image of automobile surrounding, therefore driver can basis in traveling and reversingThe real time panoramic that Vehicular display device 1 is shown looks around image to travel, and expands driver's seat, driver is made to understand road conditions in timeInformation improves travel safety.
In order to improve the shooting effect of each camera, then for the installation principle of each camera being come with two aspectsIt realizes.First principle be:Come apart from the ground criterion that the higher the better with camera.Second principle be:Increase as far as possible and takes the photographAs the effective image-region of head.
For first principle:In this present embodiment, it is located at right over logo or among middle net using preceding camera 3;AfterwardsCamera 6 is located at boot handle;Left camera 4 is located at immediately below left-hand mirror;Under right camera 5 is located at right rear view mirror justSide.Preceding camera 3 and rear camera 6 are aligned with the central axes of vehicle.Further, preceding camera 3, left camera 4, right camera5 and rear camera 6 be located at same level.Camera is installed according to above-mentioned position so that the image letter of camera shootingClose intermediate more multiple edge is fewer in effective image-region in breath, keeps image truer after the processing of processor 2 and natural.
For second principle:In this present embodiment, the camber angle after being installed using the fish eye lens module of preceding camera 3It is 20 °~40 °;Camber angle after the fish eye lens module installation of rear camera 6 is 20 °~40 °.The flake mirror of left camera 4Camber angle after the installation of head mould group is 5 °~15 °;Camber angle after the fish eye lens module installation of right camera 5 is 5 °~15 °.Above-mentioned camber angle refers to camera after installation is fixed, the angle of the fish eye lens module and horizontal plane formation of camera.Usually, angle is to incline upwardly toward horizontal after just referring to camera installation.In other embodiment, preceding cameraCamber angle after 3 fish eye lens module installation can be one kind in 20 °, 25 °, 30 °, 35 ° and 40 °.Rear camera 6Camber angle after the installation of fish eye lens module can be one kind in 20 °, 25 °, 30 °, 35 ° and 40 °.The fish of left camera 4Camber angle after the installation of glasses head mould group can be one kind in 5 °, 10 ° and 15 °.The fish eye lens module of right camera 5 is pacifiedCamber angle after dress can be one kind in 5 °, 10 ° and 15 °.Camera is installed according to above-mentioned position, can be ensured effectivelyImage-region.For processor 2, the work of processor 2 is by irregular Partial Transformation in original image information at oneThe figure of a rule, in this transformation, image needs to stretch interpolation, and interpolation will influence clarity, and irregular image is in originalOccupied area is bigger in beginning image information, needs interpolation fewer, and image will be more clear.Therefore, when camera acquisitionIn the case of pixel sum is fixed, valid pixel area occupied is bigger, and image effect is better.
For preceding camera 3, left camera 4, right camera 5 and rear camera 6, mutual overall structure can be withIt differs.But the image information that obtains of this mode is to the display matter of the burden of processor 2 and the panoramic looking-around image of displayAmount influence is too big, generally not in this way.At least same, left camera shooting may be used in preceding camera 3 and rear camera 6First 4 and right camera 5 may be used it is same.Such case is usually caused by the fixed structure difference of camera.
Certainly, in order to improve the display quality of panoramic looking-around image, preceding camera 3, left camera 4, right camera 5 andThe structure of rear camera 6 is identical, including fish eye lens module, fixing bracket and connecting line;Fish eye lens module passes through fixationHolder is fixed;Connecting line is connect with fish eye lens module, for making fish eye lens module carry out data interaction with processor 2.GuFish eye lens module is fixed on vehicle by fixed rack, and fish eye lens module internal has accurate stepper motor, may be implementedCamera lens Telescopic and focusing can accurately control rotation angle, also exportable larger torque, can be turned with crawl, emergency stopSpeed and corner, which do not receive non-resistance or drag size, to be influenced.
It is illustrated in figure 3 the structural schematic diagram of the optical unit of fish eye lens module, the optical unit of fish eye lens moduleIt is 8 groups 10;Wherein, the 4th since object side is stabilization lens, and the 5th is focus lens.Specifically, optical unitInclude the first lens L1 configured in order since object side, the second lens L2, the third lens L3, the 4th lens L4, the 5th thoroughlyMirror L5, the 6th lens L6, the 7th lens L7, the 8th lens L8, the 9th lens L9 and the tenth lens L10;And the first lens L1,Second lens L2, the third lens L3, the 4th lens L4, the 5th lens L5, the 6th lens L6, the 7th lens L7, the 8th lens L8,9th lens L9 and the tenth lens L10 coaxial arrangements.I.e. stabilization lens are the 4th lens L4, and focus lens are the 5th lensL5.In focusing, the 5th lens L5 is moved along optical axis.When stabilization makes corrections, the 4th lens L4 is vertical relative to optical axisIt is moved on direction.Wherein, the second lens L2 and the 9th lens L9 is double surface non-spherical lens.So that fish eye lens moduleFocal length is short, and visual angle is big, and visual angle reaches 190 degree, for shooting at close range a wide range of Landscape Creation condition.
It should be noted that as shown in figure 4, the 4th lens L4 may include the 41st lens being sequentially coaxially arrangedL41, the 42nd lens L42, the 43rd lens L43, the 44th lens L44 and the 45th lens L55.Such as Fig. 5Shown, the 5th lens L5 can be made of lens group.4th lens L4 of this group's composition has good stabilizationIt can so that the picture image that vehicle obtains in the process of moving is stablized.
For example, the 5th lens L5 may include the 51st lens L51 being sequentially coaxially arranged, the 52nd lens L52,53rd lens L53 and the 54th lens L54.In other embodiment, the 4th lens L4 and the 5th lens L5 can be withIt is combined and is formed by other lenses.5th lens L5 of this group composition has good fixed-focus performance, can quick fixed-focus, andMoving range is small, realizes the fixed-focus group of lightweight.
Left camera 4 is identical with 5 quantity of right camera, and quantity is respectively 1,2,3 or 4.Left camera 4 and the right sideCamera 5 is equally spaced in the both sides of vehicle.Increase the quality of camera shooting by the way that multiple cameras are arranged, and to processingThe burden of the processing of device 2 will not be too heavy.
The content shown in Vehicular display device 1 can be processor 2 control under show.According to different requirements,Vehicular display device 1 can show different contents.For example, Vehicular display device 1 include can touch control display, can touch control display ringTouching signals should be generated in user's operation, processor 2 can control the content of the display of Vehicular display device 1 according to touching signals, thanSuch as switch panoramic looking-around image be forward sight, backsight, it is left front regard, right forward sight visual angle.And according to preset journey built in processor 2Sequence come realize auto-changeover control Vehicular display device 1 show content, that is to say, that processor 2 can obtain vehicle vehicle letterBreath, information of vehicles here includes being not limited to speed, direction information, gear information and identity information etc..It can be according to vehicleThe panoramic looking-around image that information shows Vehicular display device 1 is switched over or is adjusted.Such as when reversing gear, when turning, directlyShow that panoramic looking-around image, remaining time are not shown.In this citing that just differs.
Vehicle panoramic viewing system provided by Embodiment 2 of the present invention, difference lies in further include movement with embodiment oneEnd, mobile terminal are connect with processor 2, for carrying out data interaction with processor 2.Mobile terminal includes being not limited to mobile phone terminal, the ends PCAnd tablet end etc..Remote monitoring service can be carried out by mobile terminal, it is raw on the Vehicular display device 1 for being installed on automotive interiorAt automobile and its panoramic looking-around image of surrounding enviroment, and can be directly displayed in mobile terminal.
Make two side view field standard-sized sheet of vehicle, no longer by dead angle or so safety, if vehicle back car just enters the dead of both sidesWhen angular region, changing Lane is just easily caused danger in driving.The invention avoids such situations, and panoramic looking-around image is completeIt is presented in Vehicular display device 1, allows safety without dead angle, uncertain dangerous situation of dodging.It is driven on the way in more landform, panoramaThe situation that the picture of image helps driver to confirm vehicle periphery is looked around, by being drawn in real time around 1 display automobile of Vehicular display deviceFace facilitates it to carry out pavement behavior confirmation to the region for easily forming driving blind spot, and picture shows the wheel direction of automobile.CertainlyThis function can also bring more facilities when parking.
Based on the design of same invention, the embodiment of the present invention three provides a kind of panoramic looking-around image generating method, this methodImplementation can refer to above system process realize, repeat place it is no longer redundant later.
The embodiment of the present invention three provides a kind of panoramic looking-around image generating method, includes the following steps;
S100, preceding camera is configured in the front of vehicle, left camera is configured in the left side of vehicle, by right cameraConfiguration configures rear camera at the rear of vehicle on the right side of vehicle;The preceding camera that is configured, left camera, right camera shootingHead and rear camera include the identical fish eye lens module of structure, and the wide-angle of fish eye lens module is 190 °;
S200, preceding camera, left camera, right camera and each image information of rear camera shooting are obtained, andEach image information is spliced, the panoramic looking-around image that splicing obtains is shown.
When configuring each camera, it is only necessary to be configured in the way of in step S100.It is namely each square in vehicle's surroundingsAll configure camera upwards.Enable each image information direct splicing obtained that can obtain the panorama ring of no visual blind areaVisible image.Panoramic looking-around image generating method provided by the invention, driver pass through Vehicular display device in driver's cabinIt is immediately seen the panoramic looking-around image of automobile surrounding, therefore driver can show in traveling and reversing according to Vehicular display deviceReal time panoramic look around image to travel, expand driver's seat, driver made to understand traffic information in time, improve driving peaceQuan Xing.
In order to improve the quality of panoramic looking-around image, then proposing new requirement for the image processing function of processor.It needs the mutual coordinated effect of each camera then to be handled by image synthesis, forms regarding for a whole set of around full vehicleFrequency image.Traditional object distance measurement needs to use ultrasonic wave or laser radar, needs to install multiple sensings on vehicle bodyDevice, and four cameras are added, expense is relatively high.And tradition track based on computer vision, pedestrian and vehicle inspectionThe feature extracting method for needing engineer more complicated is surveyed, these methods have certain limitation in robustness.For example, adoptingIt is one of stronger feature of Generalization Capability with HOG features, but the detection result for complex background and when blocking is poor.
The specific joining method of the present invention can be the model realization established using modes such as deep learning, feature extractions.Deep learning is the research hotspot of current machine learning areas, it uses the deep layer table of mode Level by level learning feature from bottom to topShow.Deep learning can be applied to the fields such as lane detection, pedestrian detection, vehicle detection, respective objects are marked,And distance of the rectangle frame away from this vehicle is calculated to provide the functions such as anti-collision warning.The panoramic looking-around image tool obtained based on deep learningLook around that image is shown and each multi-view image shows, is lane detection and lane shift early warning, pedestrian detection, vehicle detection, precedingVehicle anti-collision warning, scrapes the functions such as identification at collision recognition.
Can utilize all kinds of figures in database for the panoramic looking-around image specific steps obtained using deep learningIdentification model is established as information is trained;The image information that each camera obtains is input in identification model again and is exported entirelyScape image information.Panorama image information includes the vehicle image information for being not limited to each visual angle, lane line image information, pedestrian imageThe data such as information, nearby vehicle image information.
The image information that each camera obtains is required to the process demarcated by one.I.e. to each image information intoBefore row splicing, need to demarcate image information.One of basic task of machine vision is the image letter obtained from cameraThe geological information for ceasing and calculating object in three dimensions, thus to rebuild and identify object.Camera is by imaging len by threeDimension scene projects to camera two dimension image plane, and the contact of three-dimensional scenic and two-dimentional image plane is established by the result demarcated.SoAccording to the actual physics coordinate and image coordinate system coordinate of calibration point, the geometrical model of camera lens is obtained, you can complete calibration, calibrationAlgorithm itself does not need to fixed calibration place, and the process entirely demarcated is automatically performed.
Vehicle to be calibrated specifically, is driven into the calibration position in calibration place by the step of being demarcated to image information.According to preset standard calibration image information, the input parameter as actual physics coordinate as calibration algorithm, calibration algorithm existsAutomatic detection angle point in the image information in the calibration place that camera photographed obtains image of the angle point in image coordinate system and sitsMark;Calibration can must be completed according to the actual physics coordinate and image coordinate of angle point.In addition, the physical coordinates of angle point are replaced, markAutomatic Calibration can be completed in new calibration place by determining algorithm.
In this present embodiment, it is to model to obtain panoramic looking-around image using the vehicle body characteristic information of vehicle itself.
Below for obtain preceding camera, left camera, right camera and rear camera shooting each image information,The specific steps that each image information is spliced;
S210, preceding camera, left camera, right camera and each image letter of rear camera shooting are obtained in real timeBreath, image information includes vehicle body characteristic information;
S220, preset vehicle body standard information is compared to the corresponding Map Searching table of generation with vehicle body characteristic information,Each corresponding panorama Fusion Model is established according to Map Searching table;
S230, each image information is spliced according to panorama Fusion Model and Taylor's fitting, obtains panoramic looking-around figurePicture.
It is demarcated it should be noted that vehicle need not enter specific place, it can be at any time according to vehicle body in image informationCharacteristic information and preset vehicle body standard feature information are demarcated, and the detailed process of calibration is shown in above-mentioned demarcating steps.Certainly,Traditional scaling method can be executed.
Vehicle body standard information is the standard information of each car itself.It is the feature generation previously according to each vehicle itself's.Namely vehicle body standard information and vehicle are one-to-one relationships.Panorama image information includes being not limited to each multi-view image to showShow that information, lane detection information and lane shift warning information, pedestrian detection information, vehicle detecting information, front truck collision are pre-Alert information, collision recognition information and scraping identification information etc..
The present invention is looked by the way that preset vehicle body standard information to be compared to the corresponding mapping of generation with vehicle body characteristic informationTable is looked for, establishing each corresponding panorama Fusion Model according to Map Searching table makes the panorama Fusion Model generated.According to panoramaFusion Model first carries out first time splicing, then carries out secondary splicing to spliced image for the first time by Taylor's fitting, obtainsPanoramic looking-around image.For fish-eye camera, because the distortion of neighboring area is very big, the model after Taylor's fitting can only be protectedDemonstrate,proving the region covered for calibration point has description well.Accurately to splice, it is necessary to use Taylor in intersecting areaThe secondary splicing of model calculates accurately outer ginseng.Avoid existing fish-eye camera model in the region close to 180 degree to 190 degreeIn cannot be corrected completely, caused intersecting area splicing effect is bad.It is fitted within close to 180 degree to 190 degree using TaylorIntersecting area do local fit, to improve the splicing of intersecting area.To four 190 degree of fish eye lenses, automatic calibration is supported.It is rightThe image information of acquisition is seamless spliced into line distortion reduction and perfection, that is to say, that real around vehicle without splicing lineThere is no blind area, shows a perfect whole scene.
The embodiment of the present invention four provides a kind of panoramic looking-around image generating method, compared with embodiment three, difference lies in,It is further comprising the steps of;
After obtaining panoramic looking-around image, the outdoor scene characteristic information in image information is assessed according to predetermined threshold value,Alerting signal is sent out according to assessment result, while preserving assessment result.
Assessment result can directly be added into for panorama image information, that is, the panorama image information after adding includes unlimitedIn lane detection information, lane shift warning information, pedestrian detection information, vehicle detecting information, front truck anti-collision warning information,Collision recognition information and scraping identification information etc..Monitoring can be assessed and identify slight damage to a vehicle body, substitute hand inspection.It will commentEstimate result.Mobile terminal is transmitted to using remote server, you can real-time remote monitoring identification substitutes subsequent fixed point by processorHand inspection.
Although the invention has been described by way of example and in terms of the preferred embodiments, but it is not for limiting the present invention, any this fieldTechnical staff without departing from the spirit and scope of the present invention, may be by the methods and technical content of the disclosure above to this hairBright technical solution makes possible variation and modification, therefore, every content without departing from technical solution of the present invention, and according to the present inventionTechnical spirit to any simple modifications, equivalents, and modifications made by above example, belong to technical solution of the present inventionProtection domain.

Claims (10)

CN201810669765.2A2018-06-262018-06-26Vehicle panoramic viewing system and panoramic looking-around image generating methodPendingCN108621948A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201810669765.2ACN108621948A (en)2018-06-262018-06-26Vehicle panoramic viewing system and panoramic looking-around image generating method

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201810669765.2ACN108621948A (en)2018-06-262018-06-26Vehicle panoramic viewing system and panoramic looking-around image generating method

Publications (1)

Publication NumberPublication Date
CN108621948Atrue CN108621948A (en)2018-10-09

Family

ID=63689333

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201810669765.2APendingCN108621948A (en)2018-06-262018-06-26Vehicle panoramic viewing system and panoramic looking-around image generating method

Country Status (1)

CountryLink
CN (1)CN108621948A (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN109285120A (en)*2018-11-212019-01-29北京汽车研究总院有限公司A kind of image mosaic, image calibration method, vehicle and calibration facility
CN109430984A (en)*2018-12-122019-03-08云南电网有限责任公司电力科学研究院A kind of image conversion intelligent and safe helmet suitable for electric power place
CN110239439A (en)*2019-06-212019-09-17上海大学 Vehicle Driving Panoramic Surround View Assist System
CN110276258A (en)*2019-05-212019-09-24智慧互通科技有限公司A kind of method and system identifying vehicle appearance
CN110706282A (en)*2019-10-312020-01-17镁佳(北京)科技有限公司Automatic calibration method and device for panoramic system, readable storage medium and electronic equipment
CN111137210A (en)*2019-11-282020-05-12天津津航技术物理研究所Vehicle-mounted panoramic observation system
CN111461972A (en)*2019-01-192020-07-28北京初速度科技有限公司Automatic navigation driving map updating method and system for underground garage
CN111546986A (en)*2020-04-302020-08-18北京大椽科技有限公司Trailer panoramic looking-around method
CN111582080A (en)*2020-04-242020-08-25杭州鸿泉物联网技术股份有限公司Method and device for realizing 360-degree all-round monitoring of vehicle
CN111754390A (en)*2020-05-112020-10-09上海欧菲智能车联科技有限公司Ring view display method and device, computer equipment and storage medium
CN111757057A (en)*2020-06-172020-10-09广州市泰睿科技有限公司Panoramic all-around display method, device, equipment and storage medium
CN111824019A (en)*2019-04-232020-10-27东莞潜星电子科技有限公司 A vehicle-mounted 3D panoramic surround view system
CN111931705A (en)*2020-09-152020-11-13徐工集团工程机械股份有限公司道路机械分公司Panoramic all-round looking system of articulated road roller, calibration method and articulated road roller
CN112184605A (en)*2020-09-242021-01-05华人运通(上海)自动驾驶科技有限公司Method, equipment and system for enhancing vehicle driving visual field
CN112422830A (en)*2020-11-192021-02-26湖北亿咖通科技有限公司Method and device for acquiring vehicle panoramic image and computer storage medium
CN112550172A (en)*2020-12-092021-03-26上海浦喆信息技术有限公司Panoramic camera information acquisition device and angle adjusting method
CN113002531A (en)*2021-02-082021-06-22深圳市海沃德科技有限公司Vehicle panoramic looking-around method, system, equipment and computer readable storage medium
CN113194309A (en)*2021-06-022021-07-30重庆渝微电子技术研究院有限公司Imaging quality evaluation system of 360-degree panoramic looking-around equipment
TWI735930B (en)*2019-08-122021-08-11曾威順Panoramic parking-assistance system, panoramic parking-assistance method and device using the same
CN113246862A (en)*2021-06-252021-08-13上海昶音通讯科技有限公司Data processing system and method for large automobile
CN113635834A (en)*2021-08-102021-11-12东风汽车集团股份有限公司Lane changing auxiliary method based on electronic outside rear-view mirror
CN113645395A (en)*2021-10-192021-11-12江苏日盈电子股份有限公司Vehicle-mounted 360-degree panoramic visual camera and application thereof
CN113741844A (en)*2021-09-022021-12-03杭州车厘子智能科技有限公司Interaction system and interaction method based on intelligent mobile terminal
CN113923447A (en)*2021-10-292022-01-11中汽院(重庆)汽车检测有限公司 A Delay Test Method for Vehicle Panoramic Surround View Test
CN114162048A (en)*2021-12-082022-03-11上海寅家电子科技股份有限公司System and method for ensuring safe driving of vehicle
CN114274948A (en)*2021-12-152022-04-05武汉光庭信息技术股份有限公司Automatic parking method and device based on 360-degree panorama
CN116071234A (en)*2022-12-302023-05-05郑州森鹏电子技术股份有限公司 A method and device for surround view splicing correction based on body posture and vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103253194A (en)*2013-05-172013-08-21黄梅县云泰时代光学仪器有限公司Traveling vehicle auxiliary system
CN103950410A (en)*2014-04-292014-07-30深圳前向启创数码技术有限公司Panoramic auxiliary driving method and system
CN205601700U (en)*2016-01-182016-09-28东风扬子江汽车(武汉)有限责任公司Vehicle system of looking around
CN106023070A (en)*2016-06-142016-10-12北京岚锋创视网络科技有限公司Real-time panoramic splicing method and device
CN107566738A (en)*2017-10-132018-01-09维沃移动通信有限公司A kind of panorama shooting method, mobile terminal and computer-readable recording medium
CN108099789A (en)*2017-11-102018-06-01北汽福田汽车股份有限公司Image synthesis method and device, peg model method for building up and device and vehicle

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103253194A (en)*2013-05-172013-08-21黄梅县云泰时代光学仪器有限公司Traveling vehicle auxiliary system
CN103950410A (en)*2014-04-292014-07-30深圳前向启创数码技术有限公司Panoramic auxiliary driving method and system
CN205601700U (en)*2016-01-182016-09-28东风扬子江汽车(武汉)有限责任公司Vehicle system of looking around
CN106023070A (en)*2016-06-142016-10-12北京岚锋创视网络科技有限公司Real-time panoramic splicing method and device
CN107566738A (en)*2017-10-132018-01-09维沃移动通信有限公司A kind of panorama shooting method, mobile terminal and computer-readable recording medium
CN108099789A (en)*2017-11-102018-06-01北汽福田汽车股份有限公司Image synthesis method and device, peg model method for building up and device and vehicle

Cited By (35)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN109285120A (en)*2018-11-212019-01-29北京汽车研究总院有限公司A kind of image mosaic, image calibration method, vehicle and calibration facility
CN109430984A (en)*2018-12-122019-03-08云南电网有限责任公司电力科学研究院A kind of image conversion intelligent and safe helmet suitable for electric power place
CN111461972A (en)*2019-01-192020-07-28北京初速度科技有限公司Automatic navigation driving map updating method and system for underground garage
CN111824019A (en)*2019-04-232020-10-27东莞潜星电子科技有限公司 A vehicle-mounted 3D panoramic surround view system
CN110276258A (en)*2019-05-212019-09-24智慧互通科技有限公司A kind of method and system identifying vehicle appearance
CN110239439A (en)*2019-06-212019-09-17上海大学 Vehicle Driving Panoramic Surround View Assist System
TWI735930B (en)*2019-08-122021-08-11曾威順Panoramic parking-assistance system, panoramic parking-assistance method and device using the same
CN110706282A (en)*2019-10-312020-01-17镁佳(北京)科技有限公司Automatic calibration method and device for panoramic system, readable storage medium and electronic equipment
CN111137210A (en)*2019-11-282020-05-12天津津航技术物理研究所Vehicle-mounted panoramic observation system
CN111582080A (en)*2020-04-242020-08-25杭州鸿泉物联网技术股份有限公司Method and device for realizing 360-degree all-round monitoring of vehicle
CN111582080B (en)*2020-04-242023-08-08杭州鸿泉物联网技术股份有限公司Method and device for realizing 360-degree looking-around monitoring of vehicle
CN111546986A (en)*2020-04-302020-08-18北京大椽科技有限公司Trailer panoramic looking-around method
CN111754390A (en)*2020-05-112020-10-09上海欧菲智能车联科技有限公司Ring view display method and device, computer equipment and storage medium
CN111757057A (en)*2020-06-172020-10-09广州市泰睿科技有限公司Panoramic all-around display method, device, equipment and storage medium
CN111757057B (en)*2020-06-172022-06-17广州市泰睿科技有限公司Panoramic all-around display method, device, equipment and storage medium
CN111931705A (en)*2020-09-152020-11-13徐工集团工程机械股份有限公司道路机械分公司Panoramic all-round looking system of articulated road roller, calibration method and articulated road roller
CN112184605A (en)*2020-09-242021-01-05华人运通(上海)自动驾驶科技有限公司Method, equipment and system for enhancing vehicle driving visual field
CN112422830A (en)*2020-11-192021-02-26湖北亿咖通科技有限公司Method and device for acquiring vehicle panoramic image and computer storage medium
CN112422830B (en)*2020-11-192022-04-19亿咖通(湖北)技术有限公司Method and device for acquiring vehicle panoramic image and computer storage medium
CN112550172A (en)*2020-12-092021-03-26上海浦喆信息技术有限公司Panoramic camera information acquisition device and angle adjusting method
CN112550172B (en)*2020-12-092022-03-29上海浦喆信息技术有限公司Panoramic camera information acquisition device and angle adjusting method
CN113002531A (en)*2021-02-082021-06-22深圳市海沃德科技有限公司Vehicle panoramic looking-around method, system, equipment and computer readable storage medium
CN113194309B (en)*2021-06-022022-11-08重庆渝微电子技术研究院有限公司Imaging quality evaluation method for 360-degree panoramic looking-around equipment
CN113194309A (en)*2021-06-022021-07-30重庆渝微电子技术研究院有限公司Imaging quality evaluation system of 360-degree panoramic looking-around equipment
CN113246862A (en)*2021-06-252021-08-13上海昶音通讯科技有限公司Data processing system and method for large automobile
CN113635834A (en)*2021-08-102021-11-12东风汽车集团股份有限公司Lane changing auxiliary method based on electronic outside rear-view mirror
CN113635834B (en)*2021-08-102023-09-05东风汽车集团股份有限公司Lane changing auxiliary method based on electronic exterior rearview mirror
CN113741844A (en)*2021-09-022021-12-03杭州车厘子智能科技有限公司Interaction system and interaction method based on intelligent mobile terminal
CN113741844B (en)*2021-09-022024-02-27杭州车厘子智能科技有限公司Interactive system and interactive method based on intelligent mobile terminal
CN113645395A (en)*2021-10-192021-11-12江苏日盈电子股份有限公司Vehicle-mounted 360-degree panoramic visual camera and application thereof
CN113923447A (en)*2021-10-292022-01-11中汽院(重庆)汽车检测有限公司 A Delay Test Method for Vehicle Panoramic Surround View Test
CN114162048A (en)*2021-12-082022-03-11上海寅家电子科技股份有限公司System and method for ensuring safe driving of vehicle
CN114274948A (en)*2021-12-152022-04-05武汉光庭信息技术股份有限公司Automatic parking method and device based on 360-degree panorama
CN116071234A (en)*2022-12-302023-05-05郑州森鹏电子技术股份有限公司 A method and device for surround view splicing correction based on body posture and vehicle
CN116071234B (en)*2022-12-302025-08-22郑州森鹏电子技术股份有限公司 Surround view stitching correction method and device based on vehicle body posture and vehicle

Similar Documents

PublicationPublication DateTitle
CN108621948A (en)Vehicle panoramic viewing system and panoramic looking-around image generating method
JP6819681B2 (en) Imaging control devices and methods, and vehicles
KR102344171B1 (en) Image generating apparatus, image generating method, and program
JP6819680B2 (en) Imaging control devices and methods, and vehicles
US8199975B2 (en)System and method for side vision detection of obstacles for vehicles
EP1961613B1 (en)Driving support method and driving support device
CN108263283A (en)More marshalling varied angle vehicle panoramic viewing system calibration and joining method
CN101763640B (en)Online calibration processing method for vehicle-mounted multi-view camera viewing system
JP7163748B2 (en) Vehicle display control device
CN103802725B (en)A kind of new vehicle carried driving assistant images generation method
WO2018105417A1 (en)Imaging device, image processing device, display system, and vehicle
US20170043720A1 (en)Camera system for displaying an area exterior to a vehicle
CN104859538A (en)Vision-based object sensing and highlighting in vehicle image display systems
CN103802728B (en)Automatically the drive assist system selecting scape to show based on Helmet Mounted Display and method
US20150296140A1 (en)Panoramic view blind spot eliminator system and method
CN104057882A (en)System For Viewing A Curb In A Front Region On The Basis Of Two Cameras
US11827148B2 (en)Display control device, display control method, moving body, and storage medium
US20220086400A1 (en)Vehicular display system
CN113320474A (en)Automatic parking method and device based on panoramic image and human-computer interaction
CN108528337B (en)Intelligent inner wheel difference early warning system and early warning method based on video projection
CN103377372B (en)One kind looks around composite diagram overlapping region division methods and looks around composite diagram method for expressing
CN208715087U (en)Vehicle panoramic viewing system
CN207059896U (en)AR optical projection systems for vehicle safety reversing
JP2009214831A (en)Display for vehicle
US10864856B2 (en)Mobile body surroundings display method and mobile body surroundings display apparatus

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication

Application publication date:20181009

RJ01Rejection of invention patent application after publication

[8]ページ先頭

©2009-2025 Movatter.jp