Summary of the invention
The embodiment of the present invention provides a kind of virtual target scaling method and device applied to augmented reality, to improve enhancingThe precision of real effect.
The embodiment of the present invention provides a kind of virtual target scaling method applied to augmented reality, the virtual target calibrationMethod includes:
It obtains in expected augmented reality display effect, dummy model to be shown and virtual signage object are in real sceneThe first relative pose relationship；
According to the first relative pose relationship, the dummy model and virtual signage object are placed in Virtual Space；
It is adjusted, and generates adjusted by the virtual target of foundation of the dummy model in the Virtual SpaceThe second relative pose relationship between virtual target and the virtual signage object；
The virtual target, virtual signage object and the second relative pose relationship are transmitted to augmented reality terminal to setIt is standby, so that the augmented reality terminal device recognizes marker corresponding with the virtual signage object in real sceneWhen, the virtual target can be shown in the Virtual Space according to the second relative pose relationship in the Virtual Space.
Optionally, in augmented reality display effect expected from the acquisition, dummy model to be shown and virtual signage objectThe first relative pose relationship in real scene, comprising:
According to expected augmented reality display effect, object and marker are put in real scene, wherein the meshMark that object is corresponding with the dummy model, and the marker is corresponding with the virtual signage object, and the object is putPosition indicates that the display position of dummy model to be shown in augmented reality display effect, the placement position of the marker indicateThe display position of virtual signage object to be shown in augmented reality display effect；
Obtain the relative pose relationship of the object and the marker in real scene, and by the relative poseRelation record is the first relative pose relationship of dummy model to be shown and virtual signage object in real scene.
Optionally, the relative pose relationship for obtaining the object and the marker in real scene, comprising:
By space positioning apparatus, the relative pose relationship between the object and the marker is measured and recorded.
Optionally, described according to the first relative pose relationship, the dummy model and void are placed in Virtual SpaceQuasi- marker, comprising:
It will dummy model corresponding with the object and virtual signage object corresponding with marker importingThe dummy model and the virtual signage object are put into Virtual Space, and according to the first relative pose relationship.
The embodiment of the present invention also provides a kind of virtual target caliberating device applied to augmented reality, the virtual target markDetermining device includes:
Module is obtained, for obtaining in expected augmented reality display effect, dummy model to be shown and virtual signageFirst relative pose relationship of the object in real scene；
Placement module, for according to the first relative pose relationship, placed in Virtual Space the dummy model andVirtual signage object；
Generation module, for being adjusted in the Virtual Space by the virtual target of foundation of the dummy model,And generate the second relative pose relationship between virtual target adjusted and the virtual signage object；
Transmission module, for the virtual target, virtual signage object and the second relative pose relationship to be transmitted to increasingStrong non-real end equipment so that the augmented reality terminal device recognized in real scene it is opposite with the virtual signage objectWhen the marker answered, institute can be shown in the Virtual Space according to the second relative pose relationship in the Virtual SpaceState virtual target.
Optionally, the acquisition module includes:
Unit is put, for putting object and mark in real scene according to expected augmented reality display effectObject, wherein the object is corresponding with the dummy model, the marker and the virtual signage object are corresponding and describedThe placement position of object indicates the display position of dummy model to be shown in augmented reality display effect, the markerPlacement position indicates the display position of virtual signage object to be shown in augmented reality display effect；
Acquiring unit, for obtaining the relative pose relationship of the object and the marker in real scene, andIt is the first opposite position of dummy model to be shown and virtual signage object in real scene by the relative pose relation recordAppearance relationship.
Optionally, the acquiring unit is used for, and by space positioning apparatus, measures and records the object and the markRelative pose relationship between will object.
Optionally, the placement module is used for, will dummy model corresponding with the object and with the markThe corresponding virtual signage object of object is directed into Virtual Space, and puts the virtual mould according to the first relative pose relationshipType and the virtual signage object.
The embodiment of the present invention provides a kind of electronic equipment, including memory, processor and storage are on a memory and can beThe computer program run on processor, the processor realize the void applied to augmented reality when executing described programThe step of quasi- target designation method.
The embodiment of the present invention provides a kind of non-transient computer readable storage medium, is stored thereon with computer program, shouldThe step of virtual target scaling method applied to augmented reality is realized when computer program is executed by processor.
Virtual target scaling method and device provided in an embodiment of the present invention applied to augmented reality obtains be expected firstAugmented reality display effect in the first relative pose of dummy model and virtual signage object to be shown in real scene closeDummy model and virtual signage object are placed, and in Virtual Space then according to the first relative pose relationship in Virtual Space by systemIn to being adjusted using dummy model as the virtual target of foundation after, generate between virtual target adjusted and virtual signage objectThe second relative pose relationship, virtual target, virtual signage object and the second relative pose relationship are finally transmitted to augmented realityTerminal device, when so that augmented reality terminal device recognizing marker corresponding with virtual signage object in real scene,Virtual target can be shown in Virtual Space according to the second relative pose relationship, realize by existing according to expected enhancingReal display effect needs the relative pose between dummy model and virtual signage object to be shown to close being accurately arranged in real sceneSystem, and is transmitted to Virtual Space for the accurate relative pose relationship, to ensure that in Virtual Space dummy model and virtualPose accuracy between marker, and then ensure that the position using dummy model between the virtual target of foundation and virtual signage objectAppearance precision, improves the precision of augmented reality display effect, and reduces the manufacture difficulty of dummy model.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present inventionIn attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment isA part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the artEvery other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
As shown in Figure 1, to be applied to the step process of the virtual target scaling method of augmented reality in the embodiment of the present inventionFigure, this method comprises the following steps:
Step 101: obtaining in expected augmented reality display effect, dummy model to be shown and virtual signage object are trueThe first relative pose relationship in real field scape.
In this step, specifically, expected augmented reality display effect is user it is contemplated that in the display of augmented reality,Position orientation relation between the required dummy model shown and virtual signage object.
In addition, pose indicates the synthesis of position and posture；Dummy model and virtual signage object in real scene firstRelative pose relationship refers to, the posture and positional relationship of dummy model and virtual signage object in real scene.
In addition, dummy model and virtual signage object are object to be shown in Virtual Space.
This step is determining expected augmented reality display effect, that is, determines user it is contemplated that in the display of augmented reality,It, can be by dummy model and virtual signage when position orientation relation between the required dummy model shown and virtual signage objectObject material object obtains the first relative pose relationship of dummy model and virtual signage object to be shown in real scene, thusMake it possible to guarantee the accuracy of obtained first relative pose relationship based on real scene.
Step 102: according to the first relative pose relationship, dummy model and virtual signage object are placed in Virtual Space.
In this step, specifically, determining the first opposite position of dummy model and virtual signage object in real sceneAfter appearance relationship, dummy model and virtual signage object can be placed in Virtual Space according to the first relative pose relationship, thisWhen the accuracy based on the first relative pose relationship so that the dummy model placed according to the first relative pose relationship and virtualThe precision of position orientation relation between marker is equally higher, to ensure that the pose between dummy model and virtual signage objectPrecision.
Step 103: being adjusted, and generate adjusted by the virtual target of foundation of dummy model in Virtual SpaceThe second relative pose relationship between virtual target and virtual signage object.
In this step, specifically, according to the first relative pose relationship placement dummy model and virtually in Virtual SpaceAfter marker, it can be adjusted in Virtual Space by the virtual target of foundation of dummy model.
Specifically, virtual target is the virtual object shown based on dummy model, in Virtual Space with virtualModel be foundation virtual target be adjusted, then can for in Virtual Space using dummy model as the virtual target of foundationPosition and posture is adjusted.For example, it is assumed that dummy model is desk, then virtual target then can be to be to be placed in carrying out on deskThe teacup of display, in this position and posture of the adjustable teacup to be shown on desk；Furthermore, it is further assumed that dummy model is behavedBody Model, then virtual target then can be the hair of manikin, herein the position and posture of adjustable hair；In addition, false againIf dummy model is groups of building, then virtual target then can be to be placed in carrying out on groups of building street for based on groups of buildingBarrier, vehicles of display etc., in this pose of adjustable barrier and the vehicles to be shown in groups of buildingState.
In addition, specifically, it should be noted that being adjusted to by the virtual target of foundation of dummy modelWhen, keep the first relative pose state constant between dummy model and virtual signage object, to keep dummy model and virtual signagePose accuracy between object.
In addition, specifically, to using dummy model as foundation virtual target adjustment finish after, after adjustment can be generatedVirtual target and virtual signage object between the second relative pose relationship.In this way, based on dummy model and virtual signage object itBetween the first relative pose relationship high accurancy and precision so that using dummy model between the virtual target of foundation and virtual signage objectThe second relative pose relationship precision it is equally higher, improve the stated accuracy of virtual target, and then ensure that virtual meshTarget height accurately augmented reality display effect.
Step 104: virtual target, virtual signage object and the second relative pose relationship being transmitted to augmented reality terminal and setIt is standby.
It in this step, can be by virtual target, virtual signage specifically, after the second relative pose relationship of generationObject and the second relative pose relationship are transmitted to augmented reality terminal device, so that augmented reality terminal device is known in real sceneIt, can be according to the second relative pose relationship in Virtual Space, virtual when being clipped to marker corresponding with virtual signage objectVirtual target is shown in space, to realize high-precision augmented reality display effect.
Specifically, being set virtual target, virtual signage object and the second relative pose relationship are transmitted to augmented reality terminalAfter standby, the height based on the second relative pose relationship and the second relative pose relationship between virtual target and virtual signage objectPrecision can be with after augmented reality terminal device recognizes marker corresponding with virtual signage object in real sceneIt is virtual signage object virtual according to the second relative pose relationship, and based on marker position shown in real sceneShown position, shows virtual target in Virtual Space in space, to realize the stated accuracy of virtual target calibration.
In this way, the present embodiment is by the way that according to expected augmented reality display effect, accurately setting needs in real sceneRelative pose relationship between the dummy model and virtual signage object of display, and the accurate relative pose relationship is transmitted to voidQuasi- space, to ensure that the pose accuracy in Virtual Space between dummy model and virtual signage object, and then ensure that with voidAnalog model is the pose accuracy between the virtual target and virtual signage object of foundation, improves the stated accuracy of virtual target, intoAnd improve the precision of augmented reality display effect.
In addition, further, as shown in Fig. 2, the present embodiment is in obtaining expected augmented reality display effect, it is to be shownThe first relative pose relationship in real scene of dummy model and virtual signage object when, may include steps of:
Step 201: according to expected augmented reality display effect, object and marker are put in real scene.
In this step, specifically, object is corresponding with dummy model, marker is corresponding with virtual signage object, i.e.,At this as object can be seen to substitution goods of the dummy model under real scene, see marker as virtual signage objectSubstitution goods under real scene.
In addition, the marker in real scene is positioning target, so that the identification of augmented reality terminal device is empty to determineThe display position and posture of virtual target in quasi- space.
In addition, the placement position of object indicates the display position of dummy model to be shown in augmented reality display effectIt sets, the placement position of marker indicates the display position of virtual signage object to be shown in augmented reality display effect.
In this way, by real scene it is anticipated that augmented reality display effect, put corresponding with dummy modelObject and marker corresponding with virtual signage object, make it possible in real scene measure obtain object and markAccurate position and posture between object is enable to guarantee the position in Virtual Space between virtual target and virtual signage objectAppearance precision, and then realize accurately augmented reality effect.
Step 202: obtaining relative pose relationship in real scene of object and marker, and by relative pose relationshipIt is recorded as the first relative pose relationship of dummy model and virtual signage object to be shown in real scene.
In this step, specifically, putting object in real scene according to expected augmented reality display effectAfter marker, the relative pose relationship of available object and marker in real scene, and relative pose is closedSystem is recorded as the first relative pose relationship of dummy model and virtual signage object to be shown in real scene.
In addition, specifically, can pass through when obtaining the relative pose relationship of object and marker in real sceneSpace positioning apparatus measures and records the relative pose relationship between object and marker.
Specifically, space positioning apparatus can be optical positioning device, electromagnetic location instrument or other equipment that can be positioned,Herein without excessively illustrating.
In addition, placing the dummy model in Virtual Space according to the first relative pose relationship based on above-mentioned stepsIt, can will dummy model corresponding with the object and corresponding with the marker virtual when with virtual signage objectMarker is directed into Virtual Space, and puts the dummy model and the virtual mark according to the first relative pose relationshipWill object.
In this way, being accurately set in Virtual Space in real scene by according to expected augmented reality display effectPosition orientation relation between dummy model and virtual signage object to be shown, and closed the accurate pose by space orientation stateCoefficient evidence is directed into Virtual Space, thus ensure that the pose accuracy of dummy model and virtual signage object in Virtual Space, fromAnd make it possible for augmented reality terminal device and realize accurately augmented reality display effect, improve augmented reality display effectThe precision of fruit, and reduce the difficulty of dummy model production.
Virtual target scaling method provided in this embodiment applied to augmented reality, by obtaining expected augmented realityThe the first relative pose relationship of dummy model to be shown and virtual signage object in real scene in display effect, then according toFirst relative pose relationship places dummy model and virtual signage object in Virtual Space, and to virtual in Virtual SpaceModel be after the virtual target of foundation is adjusted generate it is second opposite between virtual target adjusted and virtual signage objectVirtual target, virtual signage object and the second relative pose relationship are finally transmitted to augmented reality terminal device by position orientation relation, withIt, can be according to second when augmented reality terminal device being made to recognize marker corresponding with virtual signage object in real sceneRelative pose relationship, shows virtual target in Virtual Space, realizes by according to expected augmented reality display effect,Accurately setting needs the relative pose relationship between dummy model and virtual signage object to be shown in real scene, and this is accurateRelative pose relationship be transmitted to Virtual Space, to ensure that the position in Virtual Space between dummy model and virtual signage objectAppearance precision, and then ensure that the pose accuracy using dummy model between the virtual target of foundation and virtual signage object, it improvesThe stated accuracy of virtual target, and then improve the precision of augmented reality display effect.
In addition, as shown in figure 3, to be applied to the virtual target caliberating device of augmented reality in the embodiment of the present invention, it is describedVirtual target caliberating device includes:
Module 301 is obtained, for obtaining in expected augmented reality display effect, dummy model to be shown and virtual markFirst relative pose relationship of the will object in real scene；
Placement module 302, for placing the dummy model in Virtual Space according to the first relative pose relationshipWith virtual signage object；
Generation module 303, for being adjusted in the Virtual Space by the virtual target of foundation of the dummy modelIt is whole, and generate the second relative pose relationship between virtual target adjusted and the virtual signage object；
Transmission module 304, for the virtual target, virtual signage object and the second relative pose relationship to be transmitted toAugmented reality terminal device, so that the augmented reality terminal device recognizes and the virtual signage object phase in real sceneWhen corresponding marker, it can be shown in the Virtual Space according to the second relative pose relationship in the Virtual SpaceThe virtual target.
Optionally, the acquisition module includes:
Unit is put, for putting object and mark in real scene according to expected augmented reality display effectObject, wherein the object is corresponding with the dummy model, the marker and the virtual signage object are corresponding and describedThe placement position of object indicates the display position of dummy model to be shown in augmented reality display effect, the markerPlacement position indicates the display position of virtual signage object to be shown in augmented reality display effect；
Acquiring unit, for obtaining the relative pose relationship of the object and the marker in real scene, andIt is the first opposite position of dummy model to be shown and virtual signage object in real scene by the relative pose relation recordAppearance relationship.
Optionally, the acquiring unit is used for, and by space positioning apparatus, measures and records the object and the markRelative pose relationship between will object.
Optionally, the placement module is used for, will dummy model corresponding with the object and with the markThe corresponding virtual signage object of object is directed into Virtual Space, and puts the virtual mould according to the first relative pose relationshipType and the virtual signage object.
Virtual target caliberating device provided in this embodiment obtains expected augmented reality display effect by obtaining moduleIn, the first relative pose relationship of dummy model to be shown and virtual signage object in real scene is pressed by placement moduleAccording to the first relative pose relationship, dummy model and virtual signage object are placed in Virtual Space, and by generation module to virtualIt is adjusted in space by the virtual target of foundation of dummy model, and generates virtual target adjusted and the virtual signageThe second relative pose relationship between object, finally by transmission module by virtual target, virtual signage object and the second relative poseRelationship is transmitted to augmented reality terminal device, so that augmented reality terminal device recognizes and virtual signage object in real sceneWhen corresponding marker, the void can be shown in Virtual Space according to the second relative pose relationship in Virtual SpaceQuasi- target is realized by the way that according to expected augmented reality display effect, accurately setting needs void to be shown in real sceneRelative pose relationship between analog model and virtual signage object, and the accurate relative pose relationship is transmitted to Virtual Space,To ensure that the pose accuracy in Virtual Space between dummy model and virtual signage object, and then it ensure that and be with dummy modelPose accuracy between the virtual target and virtual signage object of foundation, improves the stated accuracy of virtual target, and then improveThe precision of augmented reality display effect.
In addition, as shown in figure 4, being the entity structure schematic diagram of electronic equipment provided in an embodiment of the present invention, which setsStandby may include: processor (processor) 410,420, memory communication interface (Communications Interface)(memory) 430 and communication bus 440, wherein processor 410, communication interface 420, memory 430 pass through communication bus 440Complete mutual communication.Processor 410 can call the meter that is stored on memory 430 and can run on the processor 410Calculation machine program, the method to execute the various embodiments described above offer, for example, it obtains in expected augmented reality display effect,The the first relative pose relationship of dummy model and virtual signage object to be shown in real scene；According to the described first opposite positionAppearance relationship places the dummy model and virtual signage object in Virtual Space；To in the Virtual Space with the virtual mouldType is that the virtual target of foundation is adjusted, and generates the second phase between virtual target adjusted and the virtual signage objectTo position orientation relation；The virtual target, virtual signage object and the second relative pose relationship are transmitted to augmented reality terminalEquipment, so that the augmented reality terminal device recognizes marker corresponding with the virtual signage object in real sceneWhen, the virtual target can be shown in the Virtual Space according to the second relative pose relationship in the Virtual Space.
In addition, the logical order in above-mentioned memory 430 can be realized by way of SFU software functional unit and conductIndependent product when selling or using, can store in a computer readable storage medium.Based on this understanding, originallySubstantially the part of the part that contributes to existing technology or the technical solution can be in other words for the technical solution of inventionThe form of software product embodies, which is stored in a storage medium, including some instructions toSo that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation of the present inventionThe all or part of the steps of example the method.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (ROM,Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. it is variousIt can store the medium of program code.
The embodiment of the present invention also provides a kind of non-transient computer readable storage medium, is stored thereon with computer program,The computer program is implemented to carry out the various embodiments described above offer method when being executed by processor, for example, obtain and be expectedAugmented reality display effect in, the first relative pose in real scene of dummy model to be shown and virtual signage object closesSystem；According to the first relative pose relationship, the dummy model and virtual signage object are placed in Virtual Space；To the voidIt is adjusted in quasi- space by the virtual target of foundation of the dummy model, and generates virtual target adjusted and the voidThe second relative pose relationship between quasi- marker；The virtual target, virtual signage object and second relative pose are closedSystem is transmitted to augmented reality terminal device so that the augmented reality terminal device recognized in real scene with it is described virtualIt, can be according to the second relative pose relationship in the Virtual Space, in the virtual sky when the corresponding marker of markerBetween the middle display virtual target.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation memberIt is physically separated with being or may not be, component shown as a unit may or may not be physics listMember, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needsIn some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativenessLabour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment canIt realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, onStating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, shouldComputer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingersIt enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementationMethod described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；AlthoughPresent invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be usedTo modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit andRange.