Summary of the invention
In consideration of it, to solve above-mentioned technical problem or partial technical problems, the embodiment of the invention provides a kind of targets pairDetection, barrier-avoiding method, electronic equipment and the storage medium of elephant.
In a first aspect, the embodiment of the present invention provides a kind of detection method of target object based on real-time ground detection, packetIt includes:
Depth image is obtained in real time；
Determine the floor in the depth image；
The target object is detected based on the floor.
In a possible embodiment, floor in the determination depth image, comprising:
The depth image that will acquire generates corresponding point cloud chart picture according to internal reference matrix；
The point cloud chart picture is converted according to calibrated outer ginseng matrix；
The floor in the point cloud chart picture after determining conversion.
In a possible embodiment, the floor in the point cloud chart picture after the determining conversion, comprising:
Based on the algorithm of setting from the point cloud chart picture selection and the highest layer data of the ground degree of approach after conversionDetermine floor；
Wherein, the algorithm includes at least following one:
RANSAC algorithm, discrete space enumeration or least-squares algorithm.
In a possible embodiment, the floor in the point cloud chart picture after the determining conversion, comprising:
The algorithm parallel processing is assisted to determine the floor using processor；
Wherein, the processor includes at least following one:
Graphics processor CPU, central processor CPU, field programmable gate array FGGA or digital signal processor DSP.
In a possible embodiment, the target object includes: barrier；
It is described that the target object is detected based on the floor, comprising:
Using the floor as the plane of reference, the mesh for being highly greater than first threshold in the floor part will exceedObject is marked, barrier is determined as；
And/or
It will be less than the target object that depth in the floor part is greater than second threshold, be determined as barrier.
In a possible embodiment, the calibrated outer ginseng matrix obtains in the following manner:
Under the Training scene of setting, by image acquisition device multiple groups depth image, and electronic equipment is determinedCorresponding mileage information；
Described image acquisition device and the electronic equipment center are determined based on the depth image and the mileage informationThe calibrated outer ginseng matrix of point.
In a possible embodiment, described that described image is determined based on the depth image and the mileage informationThe calibrated outer ginseng matrix of acquisition device and the electronic equipment central point, comprising:
The motion profile of described image acquisition device is determined according to two groups of adjacent depth images；
Calibrated outer ginseng matrix is determined according to the motion profile and the mileage information.
Second aspect, the embodiment of the present invention provide a kind of barrier-avoiding method, comprising:
Depth image is obtained in real time；
Determine the floor in the depth image；
Corresponding obstacle information in the depth image is determined based on the floor；
Determine the information of the barrier corresponding coordinate information in navigation map；
The mark of barrier in depth image is projected in the navigation map according to the coordinate information.
In a possible embodiment, the method, further includes:
According to the mark of the barrier in the navigation map, determine the current location of electronic equipment to target location mostShortest path；
The first control instruction to the electronic equipment is generated according to the optimal path；
First control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to instituteIt states the first control instruction and drives the electronic equipment to the target location according to the optimal path.
In a possible embodiment, the method, further includes:
Judge whether the floor meets setting condition；
When determining that the floor does not meet setting condition, the second control instruction is generated；
Second control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to instituteThe second control instruction is stated to control the electronic equipment deceleration or stop.
The third aspect, the embodiment of the present invention provide a kind of electronic equipment, comprising: memory, processor and are stored in storageOn device and the computer program that can run on a processor, wherein the processor realizes such as above-mentioned the when executing described programOn the one hand any barrier-avoiding method of detection method or above-mentioned second aspect of any target object.
Fourth aspect, the embodiment of the present invention provide a kind of storage medium, and the storage medium is stored with one or more journeysSequence, one or more of programs can be executed by one or more processors, to realize as described in above-mentioned first aspect is anyThe detection method of target object or any barrier-avoiding method of above-mentioned second aspect.
The detection method of target object provided in this embodiment based on real-time ground detection, by obtaining depth map in real timePicture；Determine the floor in the depth image；The target object is detected based on the floor, every group deepDegree image carries out real-time ground detection, guarantees that detection is powerful using processor using actual ground as reference frame every timeComputing capability aided algorithm parallel processing determines the floor in depth image, promotes computational efficiency, guarantees that robot is expert atInto the real-time of detected target object in the process.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present inventionIn attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment isA part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the artEvery other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In order to facilitate understanding of embodiments of the present invention, it is further explained below in conjunction with attached drawing with specific embodimentBright, embodiment does not constitute the restriction to the embodiment of the present invention.
The step of Fig. 1 is a kind of detection method of target object based on real-time ground detection provided in an embodiment of the present inventionFlow chart, as shown in Figure 1, this method comprises:
S101, depth image is obtained in real time.
The detection method for the target object based on real-time ground detection that the present embodiment is related to, is advancing applied to robotRoad conditions detection in the process, robot obtain the depth map of the front road conditions of robot in traveling by image capture device in real timePicture.
Wherein, image capture device may be, but not limited to: fisheye camera.
S102, floor in the depth image is determined.
The depth image got in real time is detected using processor, determines the floor in depth image, is joinedAccording to Fig. 2, following sub-step is specifically included:
S1021, the depth image that will acquire generate corresponding point cloud chart picture according to internal reference matrix.
Using processor to depth image carry out it is down-sampled, will be down-sampled according to the internal reference matrix of image capture device afterDepth image is converted into 3D point cloud figure.
S1022, the point cloud chart picture is converted according to calibrated outer ginseng matrix.
Calibrated outer ginseng matrix positional relationship between image capture device and robot, using calibrated outer ginseng squareBattle array converts 3D point cloud figure.
Specifically, calibrated outer ginseng matrix is used to switch to the 3D point cloud figure under image capture device coordinate system for correspondenceRobot coordinate under 3D point cloud figure.
After conversion 3D point cloud figure may there are certain angles with actual ground, therefore, in the present embodiment to obtaining every timeThe depth image got is detected, it is ensured that the detection of each target object is reference with real-time ground plane, executes S1023Determine the floor in every depth image.
The floor in the point cloud chart picture after S1023, determining conversion.
Specifically, it is chosen and highest one layer of the ground degree of approach based on the algorithm of setting from the point cloud chart picture after conversionFloor is determined in data, and assists the algorithm parallel processing to determine the floor using processor.
Wherein, the algorithm includes at least following one: RANSAC algorithm, discrete space enumeration or least squareAlgorithm.
The processor includes at least following one:
Graphics processor (Graphics Processing Unit, GPU), central processing unit (CentralProcessing Unit, CPU), field programmable gate array (Field-Programmable Gate Array, FPGA), orDigital signal processor (Digital Signal Processing, DSP).
Further, it when using RANSAC algorithm, is chosen based on RANSAC algorithm from the point cloud chart picture after conversionWith floor determining in the highest layer data of the ground degree of approach (that is, the floor under determining robot coordinate system is to z=0), every layer data of the 3D point cloud figure after conversion is analyzed, using in the highest layer data of the ground degree of approach definitelyFacial plane, RANSAC algorithm determine the principle of floor for using determining optimal solution is repeatedly calculated, therefore, it is necessary to carry out repeatedlySerial computing is in the present embodiment the real-time and accuracy that promote detection, is determined using processor boostrap algorithm parallel processingThe floor, by the way of parallel processing, the mode compared to serial process shortens processing time, guarantee in real timeProperty.GPU can be used in the above-mentioned processor referred to, determines floor, the powerful calculating energy of GPU using GPU auxiliary RANSAC algorithmPower can determine the multiple numerical procedure of floor by parallel processing RANSAC algorithm simultaneously, promoted and determined using RANSAC algorithmThe efficiency of floor.
Further, highest from the degree of approach using discrete space enumeration when using discrete space enumerationFloor is determined in one layer data, the variation of the running angle of robot and ground level is subjected to discretization, according to GPUThe result of discretization is handled, and then determines floor.
Further, when using least-squares algorithm, using least-squares algorithm from the highest layer data of the degree of approachMiddle determining floor, which is fitted, determines floor, is assisted being fitted determining floor according to high-speed CPU.
It is put down it should be noted that the ground that one or more of combination progress the present embodiment is related to can be used in above-mentioned processorThe correlation step that face determines can be according to reality such as only with GPU as executing subject, or using the combination etc. of GPU and FPGADemand is set, in this regard, the present embodiment is not especially limited.
Such as, the depth image that image capture device is got for the first time be denoted as A1, subsequent acquisition to depth image successively rememberThe An ... that makees A2, A3 ...；GPU auxiliary RANSAC algorithm is used to determine the floor in A1 for the floor in a1, A2 respectivelyFor the floor in a2, A3 be a3 ... the floor in An is an ....
S103, the target object is detected based on the floor.
In the present embodiment, target object may be, but not limited to: barrier.
When target object is barrier, the detection of barrier is specifically included based on floor:
Using the floor as the plane of reference, the mesh for being highly greater than first threshold in the floor part will exceedObject is marked, barrier is determined as；And/or will be less than the target object that depth in the floor part is greater than second threshold,It is determined as barrier.
Such as, first threshold and first threshold may be the same or different, and for example first threshold and first threshold are equal are as follows:5cm, using floor determining in real time as the plane of reference, the object that will be above floor 5cm is determined as ground barrier (asTable barrier), it will be less than object of the depth greater than 5cm in the floor part and be determined as lower ground barrier (such as pit).
The detection method of target object provided in this embodiment based on real-time ground detection, by obtaining depth map in real timePicture；Determine the floor in the depth image；The target object is detected based on the floor, every group deepDegree image carries out real-time ground detection, guarantees that detection is powerful using processor using actual ground as reference frame every timeComputing capability aided algorithm parallel processing determines the floor in depth image, promotes computational efficiency, guarantees that robot is expert atInto the real-time of detected target object in the process.
Referring to Fig. 3, the calibrated outer ginseng matrix between image capture device and robot can as follows reallyIt is fixed, it specifically includes:
S301, under the Training scene of setting, pass through image acquisition device multiple groups depth image, and determine electronicsThe corresponding mileage information of equipment.
The Training scene of setting may be, but not limited to: the vacant lot of about 10 square meter of area is distributed in the vacant lotMulitpath is travelled for robot, and barrier is respectively set in each path, and the interval for object of placing obstacles can be 2 meters, barrierThe type of object is hindered to can be the barrier that robot can be prevented to advance.
It should be noted that the type of the size in vacant lot of training, the interval of barrier and barrier can be according to realityBorder demand is set, in this regard, the present embodiment is not especially limited.
Image capture device and odometer are installed in robot, and robot is placed in the vacant lot, planning robotTravel path, when robot advances according to the path of planning, image capture device acquires multiple groups depth image, and is shootingThe mileage information that recorder people advances while depth image.
S302, described image acquisition device and the electronic equipment are determined based on the depth image and the mileage informationThe calibrated outer ginseng matrix of central point.
According to the multiple groups depth image got, determine the floor in every group of depth image (that is, first by depth imageIt is converted into 3D point cloud figure, and determines the corresponding floor equation of the 3D point cloud figure), it is determined according to multiple groups depth image multipleFloor determines the track of image capture device movement, and the mileage of the robot recorded according to the motion profile and odometer is believedBreath can determine the (conversion that the track of image capture device movement passes through outer ginseng matrix in a practical situation of calibrated outer ginseng matrixResult should in odometer record robot mileage information it is equal).
Specifically, determine that the position of the image collecting device in shooting picture interval becomes according to two adjacent groups depth imageChange, the motion profile of acquisition device is obtained by the location variation at each of shooting process interval of adding up.
Further, calibrated outer ginseng matrix are as follows:
Its, by a 4x4 matrix wherein have indicate rotate R matrix (3x3) and space three-dimensional translational movement t=[x,Y, z] ' composition.
It further, is the accuracy for promoting calibrated outer ginseng matrix, the present embodiment calculates machine in every group of depth imageThe pose of device people and the residual error of odometer, when residual values are less than given threshold, i.e., it is believed that image capture device and robotOuter ginseng matrix be calibrated.
Residual error may is that
Fig. 4 is a kind of flow diagram of barrier-avoiding method provided in an embodiment of the present invention, as shown in figure 4, this method is specificInclude:
S401, depth image is obtained in real time.
S402, floor in the depth image is determined.
S403, corresponding obstacle information in the depth image is determined based on the floor.
The step of in S401-S403 and S101-S103 to detection of obstacles, is substantially identical, can refer to the phase in above-mentioned Fig. 1Description is closed, for succinct description, therefore not to repeat here.
It should be noted that increasing the judgment step to floor, specifically in an optinal plan in the present embodimentInclude:
Judge whether the floor meets setting condition；When determining that the floor does not meet setting condition,Generate the second control instruction；Second control instruction is sent to the driving motor of the electronic equipment, so that the drivingMotor, which controls the electronic equipment according to second control instruction, to be slowed down or stops.
Judge whether the floor meets setting condition and specifically include: the depth image (An) that judgement is currently gotIn floor an and the floor an-1 in a upper depth image (An-1) similarity, or judgement is current obtainsThe similarity of the floor a1 in the floor an and first depth image (A1) in depth image (An) arrived.
When determining similarity is less than given threshold (such as 80%), i.e. machine is inferred in the floor failure of current detectionThere is serious jolt or there is huge inclination on ground or nearby higher barrier occurs and blocked view at this time in device peopleOpen country generates the second control instruction；Second control instruction is sent to the driving motor of the electronic equipment, so that the driveDynamic motor, which controls the electronic equipment according to second control instruction, to be slowed down or stops.
S404, the information of the barrier corresponding coordinate information in navigation map is determined.
The information of barrier may include: the distance of obstacle distance robot, type of barrier etc., according to barrierThe coordinate for the current robot that the GPS positioning module of distance and robot apart from robot determines, according to current robotCoordinate and the distance of obstacle distance robot determine that barrier is located at corresponding coordinate information in navigation map.
Referring to Fig. 5, e.g., robot needs to advance to the position B2 from the position B1, need at this time by path are as follows: b1-b2-B3 encounters barrier in the section robot b2.
S405, the mark of barrier in depth image is projected in the navigation map according to the coordinate information.
S406, according to the mark of the barrier in the navigation map, determine the current location of electronic equipment with arriving targetThe optimal path of point.
When determining that the section b2 encounters barrier, the road for advancing to the position B2 from the position B1 in addition to current path is planned againOutside diameter, such as path is revised as to eventually arrive at B2 by b2-c2-c3.
S407, the first control instruction to the electronic equipment is generated according to the optimal path.
S408, the driving motor that first control instruction is sent to the electronic equipment, so that the driving motorThe electronic equipment is driven according to the optimal path to the target location according to first control instruction.
Barrier-avoiding method provided in this embodiment based on real-time ground detection, by obtaining depth image in real time；Determine instituteState the floor in depth image；Corresponding obstacle information in the depth image is determined based on the floor；ReallyThe information of the fixed barrier corresponding coordinate information in navigation map；According to the coordinate information by obstacle in depth imageThe mark of object projects in the navigation map, according to the mark of the barrier in the navigation map, determines electronic equipmentOptimal path of the current location to target location；It is generated according to the optimal path and the first control of the electronic equipment is referred toIt enables；First control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to describedOne control instruction drives the electronic equipment to the target location according to the optimal path, guarantees that detection is with reality every timeThe ground on border is reference frame, determines the floor in depth image using GPU powerful calculating ability auxiliary RANSAC algorithm,Computational efficiency is promoted, guarantees the real-time of robot detection of obstacles during traveling, when encountering barrier, automatically againPlanning path, it is ensured that robot is moved to target position in time.
Fig. 6 is a kind of structure of the detection device of target object based on real-time ground detection provided in an embodiment of the present inventionSchematic diagram, as shown in fig. 6, the device specifically includes:
Module 601 is obtained, for obtaining depth image in real time；
Determining module 602, for determining the floor in the depth image；
Detection module 603, for being detected based on the floor to the target object.
Optionally, the determining module 602 is generated specifically for the depth image that will acquire according to internal reference matrixCorresponding point cloud chart picture；The point cloud chart picture is converted according to calibrated outer ginseng matrix；The point after determining conversionThe floor in cloud atlas picture.
Optionally, the determining module 602 is selected specifically for the algorithm based on setting from the point cloud chart picture after conversionIt takes and determines floor in the highest layer data of the ground degree of approach；Wherein, the algorithm includes at least following one:RANSAC algorithm, discrete space enumeration or least-squares algorithm.
Optionally, the determining module 602, described in being determined using the algorithm parallel processing of processor auxiliaryFloor；Wherein, the processor includes at least following one: graphics processor CPU, central processor CPU, scene can compileJourney gate array FGGA or digital signal processor DSP.
Optionally, the target object includes: barrier；
The detection module 603 is specifically used for will exceed the floor portion using the floor as the plane of referenceHeight is greater than the target object of first threshold in point, is determined as barrier；And/or it will be less than deep in the floor partDegree is greater than the target object of second threshold, is determined as barrier.
Optionally, described device further include: demarcating module 604, for passing through Image Acquisition under the Training scene of settingDevice acquires multiple groups depth image, and determines the corresponding mileage information of electronic equipment；Based on the depth image and it is described inJourney information determines the calibrated outer ginseng matrix of described image acquisition device Yu the electronic equipment central point.
Optionally, the demarcating module 604, specifically for determining that described image acquires according to two groups of adjacent depth imagesThe motion profile of device；Calibrated outer ginseng matrix is determined according to the motion profile and the mileage information.
The detection device of target object provided in this embodiment based on real-time ground detection can be as shown in Figure 8The target object as shown in figure 1 based on real-time ground detection can be performed in the detection device of target object based on real-time ground detectionDetection method all steps, and then realize Fig. 1 shown in based on real-time ground detection target object detection method skillArt effect specifically please refers to Fig. 1 associated description, and for succinct description, therefore not to repeat here.
Fig. 7 is a kind of structural schematic diagram of obstacle avoidance apparatus provided in an embodiment of the present invention, as shown in fig. 7, the device is specificInclude:
Module 701 is obtained, for obtaining depth image in real time；
Determining module 702, for determining the floor in the depth image；
The determining module 702 is also used to determine corresponding barrier in the depth image based on the floorInformation；
The determining module 702 is also used to determine the information of the barrier corresponding coordinate information in navigation map；
Projection module 703, for the mark of barrier in depth image to be projected to described lead according to the coordinate informationIt navigates in map.
Optionally, path planning module 704 determine electronics for the mark according to the barrier in the navigation mapOptimal path of the current location of equipment to target location；The first control to the electronic equipment is generated according to the optimal pathSystem instruction；First control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to instituteIt states the first control instruction and drives the electronic equipment to the target location according to the optimal path.
Optionally, judgment module 705, for judging whether the floor meets setting condition；When determining describedlyWhen facial plane does not meet setting condition, the second control instruction is generated；Second control instruction is sent to the electronic equipmentDriving motor slow down or stop so that the driving motor controls the electronic equipment according to second control instruction.
Obstacle avoidance apparatus provided in this embodiment can be obstacle avoidance apparatus as shown in Figure 7, can be performed such as avoidance side in Fig. 4All steps of method, and then realize the technical effect of barrier-avoiding method shown in Fig. 4, specific associated description referring to figure 4., succinctly to retouchIt states, therefore not to repeat here.
Fig. 8 is a kind of electronic equipment structural schematic diagram provided in an embodiment of the present invention, as shown in figure 8, the electronic equipment hasBody includes:
Processor 810, memory 820 and transceiver 830.
Processor 810 can be graphics processor GPU, central processing unit (central processing unit, CPU),Or the combination of CPU and hardware chip.Above-mentioned hardware chip can be specific integrated circuit (application-specificIntegrated circuit, ASIC), programmable logic device (programmable logic device, PLD) or its groupIt closes.Above-mentioned PLD can be Complex Programmable Logic Devices (complex programmable logic device, CPLD), existingField programmable gate array (field-programmable gate array, FPGA), Universal Array Logic (generic arrayLogic, GAL) or any combination thereof.
Memory 820 is for storing various applications, operating system and data.Memory 820 can pass the data of storageIt is defeated by processor 810.Memory 820 may include volatile memory, non-volatile dynamic random access memory(nonvolatile random access memory, NVRAM), phase change random access memory (phase change RAM,PRAM), magnetic-resistance random access memory (magetoresistive RAM, MRAM) etc., for example, at least a magnetic disk storagePart, Electrical Erasable programmable read only memory (electrically erasable programmable read-onlyMemory, EEPROM), flush memory device, such as anti-or flash memory (flash memory, NOR) or anti-and flash memory (flashMemory, NAND), semiconductor devices, such as solid state hard disk (solid state disk, SSD) etc..Memory 820 can be withThe combination of memory including mentioned kind.
Transceiver 830, for sending and/or receiving data, transceiver 830 can be antenna etc..
The course of work of each device is as follows:
Processor 810, for obtaining depth image in real time；
The processor 810, is also used to determine the floor in the depth image；
The processor 810 is also used to detect the target object based on the floor.
Optionally, the processor 810 generates pair specifically for the depth image that will acquire according to internal reference matrixThe point cloud chart picture answered；The point cloud chart picture is converted according to calibrated outer ginseng matrix；Described cloud after determining conversionThe floor in image.
Optionally, the processor 810 is chosen specifically for the algorithm based on setting from the point cloud chart picture after conversionWith floor determining in the highest layer data of the ground degree of approach；Wherein, the algorithm includes at least following one: RANSACAlgorithm, discrete space enumeration or least-squares algorithm.
Optionally, the processor 810, specifically for assisting the algorithm parallel processing to determine describedly using processorFacial plane；Wherein, the processor includes at least following one: graphics processor CPU, central processor CPU, field-programmableGate array FGGA or digital signal processor DSP.
Optionally, the target object includes: barrier；
The processor 810 is specifically used for will exceed the floor part using the floor as the plane of referenceMiddle height is greater than the target object of first threshold, is determined as barrier；And/or it will be less than depth in the floor partGreater than the target object of second threshold, it is determined as barrier.
Optionally, the processor 810, specifically for passing through image acquisition device under the Training scene of settingMultiple groups depth image, and determine the corresponding mileage information of electronic equipment；It is true based on the depth image and the mileage informationDetermine the calibrated outer ginseng matrix of described image acquisition device Yu the electronic equipment central point.
Optionally, the processor 810, specifically for determining described image acquisition dress according to two groups of adjacent depth imagesThe motion profile set；Calibrated outer ginseng matrix is determined according to the motion profile and the mileage information.
Electronic equipment provided in this embodiment can be electronic equipment as shown in Figure 8, can be performed as shown in figure 1 based on realWhen ground detection target object detection method all steps, and then realize Fig. 1 shown in based on real-time ground detection meshThe technical effect for marking the detection method of object, specifically please refers to Fig. 1 associated description, and for succinct description, therefore not to repeat here.
Fig. 9 is another electronic devices structure schematic diagram provided in an embodiment of the present invention, as shown in figure 9, the positioning deviceIt specifically includes:
Processor 910, memory 920 and transceiver 930.
Processor 910 and processor 810 shown in Fig. 8, memory 920 and memory 820 shown in Fig. 8, transceiver 930Similar with transceiver 830 shown in Fig. 8, for succinct description, therefore not to repeat here.
The course of work of each device is as follows:
Processor 910, for obtaining depth image in real time；
The processor 910, is also used to determine the floor in the depth image；
The processor 910 is also used to determine corresponding barrier letter in the depth image based on the floorBreath；
The processor 910 is also used to determine the information of the barrier corresponding coordinate information in navigation map；
The processor 910 is also used to that the mark of barrier in depth image is projected to institute according to the coordinate informationIt states in navigation map.
Optionally, the processor 910 is also used to determine electronics according to the mark of the barrier in the navigation mapOptimal path of the current location of equipment to target location；The first control to the electronic equipment is generated according to the optimal pathSystem instruction；
Transceiver 930, for first control instruction to be sent to the driving motor of the electronic equipment, so that describedDriving motor drives the electronic equipment to the target location according to the optimal path according to first control instruction.
Optionally, the processor 910, is also used to judge whether the floor meets setting condition；When determiningWhen stating floor and not meeting setting condition, the second control instruction is generated；
The transceiver 930 is also used to for second control instruction being sent to the driving motor of the electronic equipment, withMake the driving motor control the electronic equipment according to second control instruction to slow down or stop.
Electronic equipment provided in this embodiment can be electronic equipment as shown in Figure 9, can be performed such as avoidance side in Fig. 4All steps of method, and then realize the technical effect of barrier-avoiding method shown in Fig. 4, specific associated description referring to figure 4., succinctly to retouchIt states, therefore not to repeat here.
The embodiment of the invention also provides a kind of storage medium (computer readable storage mediums).Here storage medium is depositedContain one or more program.Wherein, storage medium may include volatile memory, such as random access memory；It depositsReservoir also may include nonvolatile memory, such as read-only memory, flash memory, hard disk or solid state hard disk；MemoryIt can also include the combination of the memory of mentioned kind.
It is above-mentioned in base to realize when one or more program can be executed by one or more processor in storage mediumIn the detection side for the target object based on real-time ground detection that the detection device side of the target object of real-time ground detection executesMethod.
The processor is used to execute the detection program of the target object based on real-time ground detection stored in memory,To realize the following mesh based on real-time ground detection in the execution of the detection device side of the target object detected based on real-time groundThe step of marking the detection method of object:
Depth image is obtained in real time；
Determine the floor in the depth image；
The target object is detected based on the floor.
Optionally, the depth image that will acquire generates corresponding point cloud chart picture according to internal reference matrix；
The point cloud chart picture is converted according to calibrated outer ginseng matrix；
The floor in the point cloud chart picture after determining conversion.
Optionally, it is chosen and highest one layer of the ground degree of approach based on the algorithm of setting from the point cloud chart picture after conversionFloor is determined in data；Wherein, the algorithm includes at least following one: RANSAC algorithm, discrete space enumeration,Or least-squares algorithm.
Optionally, the algorithm parallel processing is assisted to determine the floor using processor；Wherein, the processorIncluding at least following one:
Graphics processor CPU, central processor CPU, field programmable gate array FGGA or digital signal processor DSP.
Optionally, the target object includes: barrier；
Using the floor as the plane of reference, the mesh for being highly greater than first threshold in the floor part will exceedObject is marked, barrier is determined as；
And/or
It will be less than the target object that depth in the floor part is greater than second threshold, be determined as barrier.
Optionally, under the Training scene of setting, by image acquisition device multiple groups depth image, and electricity is determinedThe corresponding mileage information of sub- equipment；
Described image acquisition device and the electronic equipment center are determined based on the depth image and the mileage informationThe calibrated outer ginseng matrix of point.
Optionally, the motion profile of described image acquisition device is determined according to two groups of adjacent depth images；
Calibrated outer ginseng matrix is determined according to the motion profile and the mileage information.
The embodiment of the invention also provides another storage medium (computer readable storage mediums).Here storage mediumIt is stored with one or more program.Wherein, storage medium may include volatile memory, such as random access memory；Memory also may include nonvolatile memory, such as read-only memory, flash memory, hard disk or solid state hard disk；StorageDevice can also include the combination of the memory of mentioned kind.
When one or more program can be executed by one or more processor in storage medium, to realize above-mentioned keeping awayHinder the barrier-avoiding method that equipment side executes.
The processor is for executing the avoidance program stored in memory, with what is executed below realization in avoidance equipment sideThe step of barrier-avoiding method:
Depth image is obtained in real time；
Determine the floor in the depth image；
Corresponding obstacle information in the depth image is determined based on the floor；
Determine the information of the barrier corresponding coordinate information in navigation map；
The mark of barrier in depth image is projected in the navigation map according to the coordinate information.
Optionally, according to the mark of the barrier in the navigation map, determine the current location of electronic equipment to targetThe optimal path in place；
The first control instruction to the electronic equipment is generated according to the optimal path；
First control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to instituteIt states the first control instruction and drives the electronic equipment to the target location according to the optimal path.
Optionally, judge whether the floor meets setting condition；
When determining that the floor does not meet setting condition, the second control instruction is generated；
Second control instruction is sent to the driving motor of the electronic equipment, so that the driving motor is according to instituteThe second control instruction is stated to control the electronic equipment deceleration or stop.
Professional should further appreciate that, described in conjunction with the examples disclosed in the embodiments of the present disclosureUnit and algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, hard in order to clearly demonstrateThe interchangeability of part and software generally describes each exemplary composition and step according to function in the above description.These functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Professional technician can use different methods to achieve the described function each specific application, but this realizationIt should not be considered as beyond the scope of the present invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can be executed with hardware, processorThe combination of software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only memory(ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical fieldIn any other form of storage medium well known to interior.
Above-described specific embodiment has carried out further the purpose of the present invention, technical scheme and beneficial effectsIt is described in detail, it should be understood that being not intended to limit the present invention the foregoing is merely a specific embodiment of the inventionProtection scope, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should all includeWithin protection scope of the present invention.