The content of the invention
In view of the above problems, invention provides the side of a kind of virtual reality head-mounted display equipment and its processing informationMethod, the technical problem of external environment information can not be provided the user to solve or at least partly solve when VR glasses work.
The first aspect of the present invention is described there is provided a kind of method of virtual reality head-mounted display equipment processing informationMethod includes:
External environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, monitoring information is obtained;
Judge whether the virtual reality head-mounted display equipment meets trigger condition based on the monitoring information;
If meeting, trigger the virtual reality head-mounted display equipment and external object is shown on display interface.
It is preferred that, the monitoring information includes but is not limited to be one of the following:The virtual reality head-mounted display equipmentThe relative distance of the external object obtained with monitoring, the behavioural information of the external object monitors continuing for the external objectTime.
It is preferred that, it is described that external environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, supervisedInformation is controlled, including:
When the virtual reality head-mounted display equipment is run, using the first camera device, or range sensor, orWIFI modes, or bluetooth approach monitor the external object, obtain the virtual reality head-mounted display equipment and the outsideThe distance of object.
It is preferred that, it is described to monitor the external object using the first camera device, obtain the virtual reality and wear displayBefore the distance of device equipment and the external object, including:
The image for including the external object is shot using first camera device;
Described image is analyzed to obtain the relative distance of the virtual reality head-mounted display equipment and the external object.
It is preferred that, the relative distance for obtaining the virtual reality head-mounted display equipment and the external object itAfterwards, including:
Judge the virtual reality head-mounted display equipment and the external object relative distance whether be less than it is default away fromFrom threshold value, if, then it represents that the monitoring information judges that the virtual reality head-mounted display meets trigger condition.
It is preferred that, whether the distance for judging the virtual reality head-mounted display equipment and the external object is less thanAfter pre-determined distance threshold value, including:
If the distance of the virtual reality head-mounted display equipment and the external object is less than the pre-determined distance threshold value,Further detect whether the external object has the light sensation information for meeting preset area;
If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, whether the distance for judging the virtual reality head-mounted display equipment and the external object is less thanAfter pre-determined distance threshold value, including:
If the distance of the virtual reality head-mounted display equipment and the external object is less than the pre-determined distance threshold value,Further detect whether the external object have issued the decibel value for meeting predetermined threshold value;
If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, it is described that external environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, supervisedInformation is controlled, including:
The data message that external object described in real-time reception is sent;
The behavioural information of the external object is extracted in the data message sent from the external object, and then based on instituteThe behavioural information for stating external object judges whether the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, it is described that external environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, supervisedInformation is controlled, including:
When the virtual reality head-mounted display equipment is run, the external object is monitored using infrared ray sensor,The duration that the infrared ray sensor monitors the external object is obtained, and then institute is monitored based on the infrared ray sensorThe duration for stating external object judges whether the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, the triggering virtual reality head-mounted display equipment shows external object on display interface, wrapsInclude:
Receive the display information that the external object is sent;
The display information is included in the virtual reality head-mounted display equipment on display interface.
It is preferred that, the triggering virtual reality head-mounted display equipment shows external object on display interface, wrapsInclude:
Using the first camera device and or the second camera device the external object is shot;
The image or video that include the external object of acquisition are included in the virtual reality head-mounted displayOn the display interface of equipment.
It is preferred that, the image or video that include the external object by acquisition is included in the virtual realityOn the display interface of head-mounted display equipment, including:
The external object is extracted from the image or video that include the external object;
The external object is included into the virtual reality display interface in the virtual reality head-mounted display equipment.
It is preferred that, it is described that the external object, bag are extracted from the image of the display interface comprising the external objectInclude:
All display objects are extracted from the image comprising the external object;
Viewing area area in each comfortable image comprising the external object is obtained based on the display object;
The viewing area area of all display objects is compared, determines that area maximum display object in viewing area isThe external object.
It is preferred that, it is described that the external object, bag are extracted from the image of the display interface comprising the external objectInclude:
All display objects are extracted from the image comprising the external object;
Obtain the priority of all display objects;
The priority of all real-world objects is compared, determines that the display object of highest priority is right for the outsideAs.
It is preferred that, the image or video that include the external object by acquisition is included in the virtual realityAfter on the display interface of head-mounted display equipment, including:
Instruction based on user, the outside is extracted from the image or video for including the external objectObject is shown on the display interface of the virtual reality head-mounted display equipment.
It is preferred that, the triggering virtual reality head-mounted display equipment shown on display interface external object itBefore, including:
Whether virtual reality head-mounted display equipment owning user described in generation voice message prompting message confirms to trigger instituteState virtual reality head-mounted display equipment and the external object is shown on display interface.
It is preferred that, including:
Monitoring module, for carrying out external environment condition monitoring when the virtual reality head-mounted display equipment is run, is obtainedMonitoring information;
First judge module, for judging whether the virtual reality head-mounted display equipment is full based on the monitoring informationSufficient trigger condition;
First display module, if for meeting, triggering the virtual reality head-mounted display equipment and showing on display interfaceShow external object.
It is preferred that, the monitoring information includes but is not limited to be one of the following:The virtual reality head-mounted display equipmentThe relative distance of the external object obtained with monitoring, the behavioural information of the external object monitors continuing for the external objectTime.
It is preferred that, the monitoring module, for when the virtual reality head-mounted display equipment is run, being taken the photograph using firstAs device, or range sensor, or WIFI modes, or bluetooth approach monitor the external object, the virtual reality head is obtainedWear the distance of display apparatus and the external object.
It is preferred that, the equipment, in addition to:
First taking module, for monitoring the external object using the first camera device, obtains the virtual reality headBefore the distance for wearing display apparatus and the external object, include the outside using first camera device shooting rightThe image of elephant;
Analysis module is right to obtain the virtual reality head-mounted display equipment and the outside for analyzing described imageThe relative distance of elephant.
It is preferred that, the equipment, in addition to:
Second judge module, for obtain the virtual reality head-mounted display equipment and the external object it is relative away fromFrom after, judge whether the relative distance of the virtual reality head-mounted display equipment and the external object is less than pre-determined distanceThreshold value, if, then it represents that the monitoring information judges that the virtual reality head-mounted display meets trigger condition.
It is preferred that, the equipment also includes:
First detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object has the light sensation information for meeting preset area;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, the equipment also includes:
Second detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object have issued the decibel value for meeting predetermined threshold value;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
It is preferred that, the monitoring module, including:
First receiving module, the data message sent for external object described in real-time reception;
First extraction module, the row for extracting the external object in the data message that is sent from the external objectFor information, and then the behavioural information based on the external object judges whether the virtual reality head-mounted display equipment meets tactileClockwork spring part.
It is preferred that, the monitoring module, specifically for when the virtual reality head-mounted display equipment is run, using redExternal object described in outside line Sensor monitoring, obtains the duration that the infrared ray sensor monitors the external object, entersAnd judge that the virtual reality head-mounted display is set based on the duration that the infrared ray sensor monitors the external objectIt is standby whether to meet trigger condition.
It is preferred that, first display module, including:
Second receiving module, for receiving the display information that the external object is sent;
Second display module, for the display information to be included in the virtual reality head-mounted display equipment in displayOn interface.
It is preferred that, first display module, including:
Second taking module, for being carried out using the first camera device and or the second camera device to the external objectShoot;
3rd display module, for the image or video that include the external object of acquisition to be included in the voidOn the display interface for intending real head-mounted display equipment.
It is preferred that, the 3rd display module, including:
Second extraction module, it is right for extracting the outside from the image or video that include the external objectAs;
4th display module, for the external object to be included in the virtual of the virtual reality head-mounted display equipmentReal display interface.
It is preferred that, second extraction module, including:
3rd extraction module, for extracting all display objects from the image comprising the external object;
First obtains module, for obtaining the image for including the external object described in each leisure based on the display objectIn viewing area area;
Determining module, the viewing area area for being compared all display objects, determines viewing area area mostBig display object is the external object.
It is preferred that, the 3rd extraction module, including:
4th extraction module, for extracting all display objects from the image comprising the external object;
Second obtains module, the priority that shows object all for obtaining;
Contrast module, the priority for being compared all real-world objects determines the display object of highest priorityFor the external object.
It is preferred that, the equipment, in addition to:
5th extraction module, for the image or video that include the external object of acquisition to be included in the voidAfter intending on the display interface of real head-mounted display equipment, the instruction based on user includes the external object from describedImage or video in extract the display interface that the external object is shown in the virtual reality head-mounted display equipmentOn.
It is preferred that, the equipment, in addition to:
Generation module, for trigger the virtual reality head-mounted display equipment shown on display interface external object itBefore, whether virtual reality head-mounted display equipment owning user described in generation voice message prompting message confirms that triggering is described virtualReal head-mounted display equipment shows the external object on display interface.
The technical scheme provided in the embodiment of the present application, has at least the following technical effects or advantages:
The invention discloses a kind of method of virtual reality head-mounted display equipment processing information, in the virtual reality headExternal environment condition monitoring is carried out when wearing display apparatus operation, monitoring information is obtained;Judge described virtual based on the monitoring informationWhether real head-mounted display equipment meets trigger condition;If meeting the trigger condition, trigger the virtual reality and wear displayDevice equipment shows external object on display interface, and external object is presented to and uses virtual reality head-mounted display equipmentUser, allow users to be concerned about external object.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage canBecome apparent, below especially exemplified by the embodiment of the present invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawingExemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth hereLimited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosureComplete conveys to those skilled in the art.
Referring to Fig. 1, there is provided a kind of side of virtual reality head-mounted display equipment processing information in embodiments of the present inventionMethod, this method includes:
Step 11, external environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, monitoring letter is obtainedBreath.
Step 12, judge whether the virtual reality head-mounted display equipment meets triggering bar based on the monitoring informationPart.
Step 13, if meeting, trigger the virtual reality head-mounted display equipment and external object is shown on display interface.
Specifically, it is to immerse due to what is provided the user in the running of virtual reality head-mounted display equipmentThe experience of formula, so current virtual reality head-mounted display equipment can not provide the user with external environment condition.And it is of the inventionVirtual reality head-mounted display equipment need display external object when, then a series of trigger condition can be set to triggerVirtual reality head-mounted display equipment shows external object.
In specific implementation process, when showing external object, the content of VR equipment display originally can be suspended, thenExternal object is included on display interface.It is of course also possible to which translucent mode shows external object, while VR scripts is interiorHold also translucent display, it is ensured that while external object is shown, it can be seen that the content of VR displays originally;Then according to triggeringOperation, switching shows that VR contents still show outer scene content.
In actual applications, prepared by VR equipment single camera or dual camera.In the case of single camera, prisonThe operations such as control, shooting are all completed by the camera, and the present invention is named as the first filming apparatus.And in the situation of dual cameraUnder, it can be completed during monitoring using a camera, and shoot and can be completed by another camera, then utilize the aobvious of VR equipmentShow interface display.Now, the present invention adds the second filming apparatus on the basis of the first filming apparatus.
And based on the difference of TV object, the present invention is also different by the way of in display, the present invention is introduced whereinTwo kinds, it is certainly, any external object to be included display mode on the display interface of VR glasses and belong to the present inventionProtection domain within.
The present invention one way in which be:Show triggering the virtual reality head-mounted display equipment on display interfaceWhen showing external object, the filming apparatus that can trigger the virtual reality head-mounted display equipment is clapped the external objectTake the photograph;The image or video that include the external object of acquisition are included in the virtual reality head-mounted display equipmentOn display interface.When filming apparatus is shot to external object, an image comprising external object can be clapped and be shown inOn the display interface of VR glasses, the video projection comprising external object can also be directly generated using the camera function of camera deviceShown on the display interface of VR glasses.
The present invention another way be:Virtual reality head-mounted display equipment can directly receive the external object and sendDisplay information, and by the display information include in the virtual reality head-mounted display equipment on display interface.For example,VR glasses receive the temporal information of intelligent watch, and the temporal information is included on the display interface of VR glasses.Or VR glassesThe currently playing video that intelligent television is sent is received, the currently playing video of intelligent television is included into display circle in VR glassesOn face.
As a kind of optional embodiment, the virtual reality head-mounted display equipment is triggered in display interface in step 13Before upper display external object, use belonging to virtual reality head-mounted display equipment described in voice message prompting message can also be generatedFamily.Suggestion content can be:Whether confirmation triggers the virtual reality head-mounted display equipment shows described on display interfaceExternal object.If user agrees to, then external object is included on the display interface of virtual reality head-mounted display equipment.
It is then the specific implementation process of the present invention with upper type, enters when the virtual reality head-mounted display equipment is runRow external environment condition is monitored, and obtains monitoring information;Judge that the virtual reality head-mounted display equipment is based on the monitoring informationIt is no to meet trigger condition, if meeting the trigger condition, trigger the virtual reality head-mounted display equipment and show on display interfaceShow external object, external object is presented to the user for using virtual reality head-mounted display equipment, allow users to closeNote external object, it is to avoid user falls down tumble injury.
Above steps is specifically described below.
In the specific implementation process of step 11, virtual reality head-mounted display equipment (i.e. VR glasses) is in runningIn, the experience of a variety of immersions can be provided the user, such as VR glasses can run the VR videos of magnanimity, dazzle cruel VR tripsPlay, the panoramic video of shock etc..
External object, can be any object in the external environment residing for the virtual reality head-mounted display equipment.For example, external object is at least divided into following a few classes:
Device object, including each class of electronic devices, electrical equipment etc..Such as TV, mobile phone, wrist-watch etc..
Tiger, lion in living animal or plant in biological object, i.e. nature, such as kitten doggie, zooAll kinds of animals of son etc..Or trees, flowers and plants etc. plant.
Subject, is each type objects for being unable to Intelligent control, such as sofa, seat, wall etc..
Because the external object in external environment condition can be various, so the monitoring information obtained in monitoring can beVaried, monitoring information includes but is not limited to be one of the following:The virtual reality head-mounted display equipment and monitoring are obtainedExternal object relative distance, the behavioural information of the external object monitors the duration of the external object.
So when setting the trigger condition of VR equipment, a variety of conditions can be set.For example, can be by external object and VRThe distance of equipment is arranged to trigger condition, if the distance of external object and VR equipment is less than pre-determined distance threshold value (such as 2 meters),Represent that external object is likely to knock with VR equipment, so VR equipment shows external object on display interface.For another example canSo that when external object has some specific behavioural informations (such as lifting wrist information) to be transferred to VR equipment, triggering VR equipment is in displayExternal object is shown on interface.If for another example the duration of a certain external object of VR monitoring of tools is long, representing that the user canThe external object can be paid close attention to very much, then triggers VR equipment and shows the external object.Certainly, the present invention also has other trigger conditions,Following description is specifically refer to, is no longer enumerated herein.
In specific implementation process, if monitoring information is the outside that virtual reality head-mounted display equipment and monitoring are obtainedThe relative distance of object.Obtaining the specific implementation process of monitoring information includes:In virtual reality head-mounted display equipment fortuneDuring row, the external object is monitored using the first camera device, or range sensor, or WIFI modes, or bluetooth approach, is obtainedThe distance of the virtual reality head-mounted display equipment and the external object.Afterwards, then to judge that the virtual reality is worn aobviousShow whether the relative distance of device equipment and the external object is less than pre-determined distance threshold value, if, then it represents that the monitoring informationJudge that the virtual reality head-mounted display meets trigger condition.If the distance of external object and VR equipment is less than pre-determined distance thresholdIt is worth (such as 2 meters), then it represents that external object is likely to knock with VR equipment, and the triggering for meeting VR equipment shows that the outside is rightThe trigger condition of elephant.
Due to including the relative distance of a variety of acquisition virtual reality head-mounted display equipment and the external object thereonMode, below one one it is introduced.
As a kind of optional embodiment, judging whether the virtual reality head-mounted display equipment meets trigger conditionWhen, whether the distance for judging the virtual reality head-mounted display equipment and the external object using range sensor is less than in advanceIf distance threshold;If, then it represents that the virtual reality head-mounted display equipment meets trigger condition.Trigger the virtual realityHead-mounted display equipment shows external object on display interface.
External object herein can be any object, for example, can be in VR if external object is seat tables and chairsWhen glasses are run, the relative distance of the VR glasses and seat is detected using the range sensor inside VR glasses, is then judgedWhether both relative distance is less than pre-determined distance threshold value (such as 2 meters), if, then it represents that user may knock with seat, then then represent that VR glasses meet trigger condition.Tables and chairs are shown to the display of VR glasses using the camera device of VR glassesOn interface.Display mode can be projection, mode of taking pictures etc., not be limited herein.For another example external object is wall, ifDetected using range sensor and judge that VR glasses are close apart from wall, be, for example, less than 2 meters, then it represents that user may knockTables and chairs, then be shown on the display interface of VR glasses by wall using the camera device of VR glasses.
As a kind of optional embodiment, judge whether the virtual reality head-mounted display equipment meets triggering describedDuring condition, the outside can also be included using the first camera device shooting of the virtual reality head-mounted display equipment rightThe image of elephant;Analysis described image with obtain the virtual reality head-mounted display equipment and the external object it is relative away fromFrom;Judge whether the relative distance of the virtual reality head-mounted display equipment and the external object is less than pre-determined distance thresholdValue;If, then it represents that the virtual reality head-mounted display equipment meets trigger condition.So the virtual reality is triggered to wearDisplay apparatus shows external object on display interface.
In specific implementation process, the camera device of virtual reality head-mounted display equipment can be included with captured in real-timeThe image of the external object, and two images by priority shooting are mutually contrasted successively.So judge virtual realityThe distance change of head-mounted display equipment and external object.
External object of the invention signified not only one of which, may have multiple.If external object is relatively simple, exampleIf external object is intelligent television.Virtual reality head-mounted display equipment have taken one at the first moment and include intelligent televisionImage A, an image B for including intelligent television is have taken at the second moment, have taken one at the 3rd moment includesThe image C of intelligent television, then contrasts this three images, if in the case where the gross area is constant, intelligent television in imageRegion area is increasing, then it represents that virtual reality head-mounted display equipment is more and more nearer from intelligent television.Certainly, regardless of outsideObject is one or more, when VR glasses are more and more nearer apart from external object, and in its image shot, external object is occupiedRegion area will be increasing.For example external object is the display on computer desk, and has display below displaySupport frame, data, phone, pen container etc. external object.VR glasses meeting captured in real-time includes display, support frame, data, electricityWords, pen container etc. external object, shoot in each image, the region area of identical external object before and after then contrasting successively,If the region area of each external object is increasing, then it represents that VR glasses are more and more nearer from these external objects.
In this case, the gross area for the image that virtual reality head-mounted display equipment is shot is constant, judges outside rightAs the distance with virtual reality head-mounted display equipment, it can be counted according to the region area of external object in the pictureCalculate.Region area is bigger, then it represents that virtual reality head-mounted display equipment is more and more nearer from external object.So outside acquisitionAfter the region area of object, mapping relations that can be according to region area and between, and then determine that both is relativeDistance.If there are multiple external objects in image, the maximum external object of the region area occupied in the picture is regard as masterThe relative distance of the standard for the judging distance wanted, analysis image detection external object and VR glasses.
For example, external object is intelligent television, vase, small articles etc..The virtual reality head-mounted display is setStandby camera can in real time be monitored and shot and be analyzed in the image for including intelligent television.Intelligent television is analyzed to account forAccording to region area it is maximum, then analyze the region area of the intelligent television image in the image, then according to the region area fromThe distance between intelligent television and virtual reality head-mounted display equipment are obtained in region area and mapping relations between.Then judge whether the distance is less than pre-determined distance threshold value (such as 2 meters), if so, representing that VR glasses meet trigger condition.
It is described to judge whether the virtual reality head-mounted display equipment meets triggering bar as a kind of optional embodimentDuring part, it can also judge that the virtual reality head-mounted display equipment and the outside are right using wireless WIFI hot spot or bluetoothWhether the distance of elephant is less than pre-determined distance threshold value;If, then it represents that the virtual reality head-mounted display equipment meets triggering barPart.So trigger the virtual reality head-mounted display equipment shows external object on display interface.
In specific implementation process, either virtual reality head-mounted display equipment and the external object canIt is used as the main equipment of wireless WIFI hot spot or initiation bluetooth connection.The signal strength of wireless WIFI hot spot or bluetooth is then and emptyIntend the distance dependent of real head-mounted display equipment and the external object, signal is stronger, then it represents that virtual reality wears displayThe distance of device equipment and the external object is nearer.And the power of signal and apart from mapping relations, so it is wireless obtainingAfter the signal intensity of WIFI hot spot or bluetooth, can be determined from mapping relations virtual reality head-mounted display equipment andThe distance of the external object.For example, VR glasses are wireless WIFI hot spot, and intelligent watch is the mode using wireless WIFIThe equipment for accessing VR glasses.So according to the power of WIFI signal, it can be determined that go out the distance of VR glasses and intelligent watch, thenJudge whether the distance is less than pre-determined distance threshold value (such as 2 meters), if, then then represent that VR glasses meet trigger condition.
As a kind of optional embodiment, if the distance of the virtual reality head-mounted display equipment and the external objectLess than the pre-determined distance threshold value, it can also further detect whether the external object has the light sensation letter for meeting preset areaBreath;If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
In specific implementation process, the information that display interface is produced when light sensation information is external object operation, light sensation letterBreath includes monochrome information and chrominance information, and monochrome information represents that screen intensity is strong and weak, and chrominance information is made up of RGB three primary colors,Represent that the color in each region of screen is constituted.For example external object be intelligent television or smart mobile phone etc., intelligent television orScreen can have light sensation information to smart mobile phone in use, so virtual reality head-mounted display equipment can utilize itselfFilming apparatus detects this light sensation information.If the area of the light sensation information exceedes preset area, then then represent virtual realityHead-mounted display equipment meets trigger condition.
For example, the virtual reality head-mounted display equipment is being judged and described outer using wireless WIFI or bluetoothWhether the distance of portion's object is less than after pre-determined distance threshold value, if the virtual reality head-mounted display equipment and the outside are rightThe distance of elephant is less than pre-determined distance threshold value, can also further detect whether the external object has the light for meeting preset areaFeel information;If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
Certainly, using range sensor either virtual reality head-mounted display equipment filming apparatus shooting image comeDetect whether the distance of the virtual reality head-mounted display equipment and the external object is less than after pre-determined distance threshold value, ifThe distance of the virtual reality head-mounted display equipment and the external object is less than pre-determined distance threshold value, can also further examineSurvey whether the external object has the light sensation information for meeting preset area;If so, then representing that the virtual reality wears displayDevice equipment meets trigger condition.
As a kind of optional embodiment, if the distance of the virtual reality head-mounted display equipment and the external objectLess than the pre-determined distance threshold value, the decibel value for meeting predetermined threshold value whether can be have issued with external object described further;If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.For example, if external object is TVDistance has met requirement, and the decibel value that TV is produced also meets 35 decibels of predetermined threshold value, then can then successfully triggerVR equipment shows the TV.This is that user needs to watch the situation of TV, so can be triggered using the decibel value of TVThe condition of VR equipment.
Above-described embodiment describes the several embodiments using distance as trigger condition, and it can individually be implemented,It can mutually cooperate with and be implemented, to improve accuracy of detection.Such as sharp first camera device, range sensor, WIFI modes, indigo plantThe monitor mode of this several monitoring external object of tooth mode can be monitored individually, can also implement prison by cooperative cooperating simultaneouslyControl.
And in another case, can there are some behavioural informations (for example lifting wrist action message) to be transferred in external objectDuring virtual reality head-mounted display equipment, triggering virtual reality head-mounted display equipment shows external object on display interface.It is specifically described as follows.
As a kind of optional embodiment, external environment condition prison is carried out when the virtual reality head-mounted display equipment is runControl, obtains monitoring information, including:The data message that external object described in real-time reception is sent;Sent from the external objectThe behavioural information of the external object is extracted in data message, and then the behavioural information based on the external object judges describedWhether virtual reality head-mounted display equipment meets trigger condition.In specific implementation process, the external behavior can determine whetherWhether information belongs to presupposed information;If, then it represents that the virtual reality head-mounted display equipment meets trigger condition.
In specific implementation process, the behavioural information of external object is that the expression external object that external object is sent hasThe information of certain specific behavior.
External object can send data to virtual reality head-mounted display equipment in real time, and then virtual reality is worn displayDevice device real-time monitoring external object state in which.When external object detects specific behavior, such as vertical motion (lift wristAction), rotational action when, also this outside behavioural information can be sent to virtual reality head-mounted display equipment, so virtual existingReal head-mounted display equipment is received after the data message of external object transmission, can detect behavior information.Then judgeWhether the external behavior information is prior default behavioural information in virtual reality head-mounted display equipment, if, then it represents that instituteState virtual reality head-mounted display equipment and meet trigger condition.For example, external object is intelligent watch, and intelligent watch can be realWhen the status information of itself is sent to VR glasses.If intelligent watch passes through acceleration transducer (such as angle of itself in detectionVelocity sensor) or angular transducer (such as gyroscope) etc. when detecting with angulation change, represent that user has liftWrist is acted.So the lift wrist action message can be sent to VR glasses by intelligent watch.VR glasses are receiving lift wrist action letterThen represent to have met trigger condition after breath, VR glasses can be triggered and show intelligent watch on its display interface.
As a kind of optional embodiment, acceleration sensing can also be provided with virtual reality head-mounted display equipmentDevice (such as angular-rate sensor) or angular transducer (such as gyroscope) etc., to detect virtual reality head-mounted displayThe angle of equipment, such as user are bowed, then the angle of virtual reality head-mounted display equipment can change, if virtual realityThe angle of head-mounted display equipment reaches certain rotational angle, then what can be directed to virtual reality head-mounted display equipment is outerPortion's object is shown on its display interface using the form of projection or photo.
It should be noted that setting acceleration transducer in virtual reality head-mounted display equipment, (for example angular speed is passedSensor) or angular transducer (such as gyroscope) detect the embodiment of its angle change, can be receive it is outside rightAs transmission lift wrist action message after perform, can also individually perform.For example, if VR glasses have received intelligent watchLift wrist action message, then then further whether detection VR glasses have angle change and judge whether its angle change reachesCertain rotational angle, if its angle change reaches certain rotational angle, can utilize the form of projection or photo willIntelligent watch is shown on its display interface.
As a kind of optional embodiment, trigger the virtual reality head-mounted display equipment and show outer on display interfaceDuring portion's object, the virtual reality head-mounted display equipment can be triggered by the aobvious of the external object after the preset time of intervalShow that the information of interface display is projected on the display interface of the virtual reality head-mounted display equipment.For example, VR equipmentThe time of one or two second, which can be postponed, again includes intelligent watch on the display device of VR glasses.
During specific display, VR glasses can directly receive the display information of external object transmission, and will be describedDisplay information is shown in the virtual reality head-mounted display equipment on display interface.For example, VR glasses can be received directlyThe temporal information that intelligent watch is sent, then includes the temporal information on the display device of VR glasses.
In another case, the present invention can also regard the duration for monitoring the external object as trigger condition.
In specific implementation process, when the virtual reality head-mounted display equipment is run, infrared ray sensing is utilizedDevice monitors the external object, obtains the duration that the infrared ray sensor monitors the external object, and then based on instituteThe duration for stating the infrared ray sensor monitoring external object judges whether the virtual reality head-mounted display equipment is fullSufficient trigger condition.If the time that the infrared ray sensor monitors the external object exceedes preset time threshold, then it represents thatUser compares external object concern, then further indicates that the virtual reality head-mounted display equipment meets trigger condition.LiftFor example, external object is doggie., can be with rotary head if hearing has the cry of doggie during user uses VR glassesMake VR glasses against the direction of doggie, the infrared ray sensor of VR glasses is detected doggie.Certainly, the infrared ray of VR glasses is passedThe infrared image of sensor detection doggie can be shown in the subregion of the display interface of VR glasses in real time, inform that user's is sameWhen also avoid influence Consumer's Experience.Or, it is using the first camera device and/or the second camera device of VR glasses that the outside is rightAs the image of (such as doggie) is shown in the subregion of the display interface of VR glasses in real time, also avoided while user is informedInfluence Consumer's Experience.Further, if the infrared ray sensor of VR glasses monitors doggie and exceeded preset time threshold alwaysIt is worth (such as 30 seconds), then then represent that user compares concern doggie, so VR glasses can trigger VR as trigger conditionMirror shows doggie on display interface.
After doggie is included on the display interface of virtual reality head-mounted display equipment, the operation of user can be receivedInstruction makes doggie complete corresponding action, and then interactive with user's progress.
In specific implementation process, virtual reality head-mounted display equipment by doggie include on display interface itAfterwards, the sign information according to doggie is understood, such as configuration, ear, claw, glasses, tail etc. judge institute's species, soThe corresponding action of institute's species is recalled afterwards.Instruction further according to user obtains corresponding action message, and controls doggie to performCorresponding action message.It should be noted that the doggie that virtual reality head-mounted display equipment is shown is based on shooting or thrownThe doggie of shadow and the virtual doggie generated, and multiple sign points are inserted with virtual doggie, when the instruction according to userWhen getting corresponding action message, then the sign point that can be adjusted based on the action message with virtual doggie carries out corresponding becomeChange, so it is changed the action of virtual doggie.For example, the ear of virtual doggie, claw, tail, tongue etc. be allCorresponding sign point is inserted, if the instruction of user is to wag its tail, then corresponding action can be obtained according to the action command and believedBreath, controls the sign point on tail to be changed, such as 5 sign points is arranged in order on tail, each according to the action messageSign point is all unanimously moved left and right, but the amplitude that each sign point is moved left and right is different, close to virtual doggie bodyThe amplitude very little moved left and right of sign point on tail, and the left and right of the sign point on the tail away from virtual doggie body is movedDynamic amplitude is very big, then in user, virtual doggie is just in the action wagged its tail.
The trigger condition for describing virtual reality head-mounted display equipment of above-described embodiment in detail, in following embodimentIn, specific will introduce that the virtual reality head-mounted display equipment is triggered in step 13 is how right outside display on display interfaceThe implementation process of elephant, the present invention mainly introduces two kinds of display modes, certainly, any to include external object in VR glassesDisplay mode on display interface is belonged within protection scope of the present invention.
First way:
In specific implementation process, show outer on display interface triggering the virtual reality head-mounted display equipmentDuring portion's object, the first filming apparatus and/or the second filming apparatus of the virtual reality head-mounted display equipment are can trigger to instituteExternal object is stated to be shot and (take pictures or image);The image or video that include the external object of acquisition are shownOn the display interface of the virtual reality head-mounted display equipment.I.e.:The filming apparatus of virtual reality head-mounted display equipmentExternal object can be shown on display interface by way of taking pictures or imaging.In this case, when utilizing virtual realityWhen the first of head-mounted display equipment shoots assembly monitor, the display content of Consumer's Experience VR equipment scripts can also not influenceedIn the case of, will monitor the image shot or video is included in the aobvious of VR equipment in real time in translucent or opaque modeShow in the part viewing area at interface, user is concerned about extraneous circumstance in real time.
The mode of shooting, be virtual reality head-mounted display equipment filming apparatus directly open camera function will be outside rightAs being dynamically projected in display interface in real time.
Shooting style, then be virtual reality head-mounted display equipment filming apparatus directly open camera function shoot includeThe image of external object it is static be shown in display interface.
And during display, the image or video that include the external object of acquisition are included in the voidOn the display interface for intending real head-mounted display equipment, including:
Bag is obtained using the first filming apparatus in the virtual reality head-mounted display equipment and/or the second filming apparatusImage containing the external object.The external object is extracted from the image comprising the external object.By the outsideObject is shown in the virtual reality display interface of the virtual reality head-mounted display equipment.
Specifically, when extracting external object, there is two ways:
First way:The external object is extracted from the image of the display interface comprising the external object, is wrappedInclude:All display objects are extracted from the image comprising the external object;Obtain each based on the display objectViewing area area in the comfortable image comprising the external object;It is compared the viewing area of all display objectsDomain area, it is the external object to determine the maximum display object of viewing area area.For example, if had in image multipleExternal object, such as display, support frame, data, phone, pen container etc. external object, each external object is in the pictureWith respective viewing area area.Then when obtaining the image, based on display, support frame, data, phone, pen container etc.Extract respective viewing area area, be then compared, the viewing area area for contrasting display is maximum, then will displayDevice is used as external object.
The second way:It is described that the outside is extracted from the image of the display interface comprising the external object is rightAs, including:All display objects are extracted from the image comprising the external object;Obtain all display objectsPriority;The priority of all real-world objects is compared, determines that the display object of highest priority is right for the outsideAs.For example, if there is multiple external objects in image, such as display, support frame, data, phone, pen container etc. are outsideObject, then obtain the priority of these external objects, the priority of such as display is the 1st grade (superlative degree), support frame the 2ndLevel, data 3rd level, the 4th grade of phone, the 5th grade of pen container.After contrast, the highest priority of display, then using display as outerPortion's object.
As a kind of optional embodiment, include by the image or video that include the external object of acquisitionAfter on the display interface of the virtual reality head-mounted display equipment, can the instruction based on user, from described comprisingThe external object is extracted in the image or video of stating external object and is shown in the virtual reality head-mounted display equipmentDisplay interface on.For example, being shown display, support frame, data, phone, pen container etc. external object image will be includedOn the display interface of VR glasses, if user's is designated as display ' display ', then VR glasses can the instruction based on userDisplay is extracted from the image to be shown on display interface.
Certainly, after external object is determined, the entirety of external object can be shown, external object can also be only extractedPartial information be shown on the display interface of VR glasses.For example be when external object is intelligent watch, can be directly by intelligent handTable is shown on the display interface of VR glasses, can also only extract display interface of the time showing in VR glasses of intelligent watchOn.
As a kind of optional embodiment, no matter which kind of mode trigger condition be, regardless of being to be shown in which wayShow, when virtual reality head-mounted display equipment shows external object on display interface, can all be touched after the preset time of intervalSend out virtual reality head-mounted display equipment described and project to the information that the display interface of the external object is shown described virtualOn the display interface of real head-mounted display equipment.I.e.:Virtual reality head-mounted display equipment, can be with when showing external objectDisplay can also postpone display immediately, depending on the speed of display is according to actual conditions.For example, if using range sensor orPerson's other modes (wireless WIFI hot spot, bluetooth, filming apparatus take pictures etc. mode) detect virtual reality head-mounted display and setThe distance of standby and external object is less than after pre-determined distance threshold value, then can be aobvious including being worn in virtual reality by external object immediatelyOn the display interface for showing device equipment.If virtual reality head-mounted display equipment receives the lift wrist action message of external object transmissionAfterwards, then external object is included on its display interface in the way of projecting or taking pictures again after postponing 1-2 seconds.
The second way:Virtual reality head-mounted display equipment can directly receive the display letter that the external object is sentBreath, and the display information is included in the virtual reality head-mounted display equipment on display interface.For example, VR glasses connectThe temporal information of intelligent watch is received, the temporal information is included on the display interface of VR glasses.Or VR glasses receive intelligenceThe currently playing video that TV is sent, the currently playing video of intelligent television is included on the display interface of VR glasses.
Based on same inventive concept, the following examples introduce a kind of virtual reality head-mounted display equipment.
Referring to Fig. 2, the equipment includes:
Monitoring module 21, for carrying out external environment condition monitoring when the virtual reality head-mounted display equipment is run, is obtainedObtain monitoring information;
First judge module 22, for whether judging the virtual reality head-mounted display equipment based on the monitoring informationMeet trigger condition;
First display module 23, if for meeting, triggering the virtual reality head-mounted display equipment on display interfaceShow external object.
As a kind of optional embodiment, the monitoring information includes but is not limited to be one of the following:The virtual realityThe relative distance for the external object that head-mounted display equipment and monitoring are obtained, the behavioural information of the external object, monitoring is describedThe duration of external object.
It is used as a kind of optional embodiment, the monitoring module 21, in the virtual reality head-mounted display equipmentDuring operation, the external object is monitored using the first camera device, or range sensor, or WIFI modes, or bluetooth approach, is obtainedObtain the distance of the virtual reality head-mounted display equipment and the external object.
As a kind of optional embodiment, the equipment, in addition to:
First taking module, for monitoring the external object using the first camera device, obtains the virtual reality headBefore the distance for wearing display apparatus and the external object, include the outside using first camera device shooting rightThe image of elephant;
Analysis module is right to obtain the virtual reality head-mounted display equipment and the outside for analyzing described imageThe relative distance of elephant.
As a kind of optional embodiment, the equipment, in addition to:
Second judge module, for obtain the virtual reality head-mounted display equipment and the external object it is relative away fromFrom after, judge whether the relative distance of the virtual reality head-mounted display equipment and the external object is less than pre-determined distanceThreshold value, if, then it represents that the monitoring information judges that the virtual reality head-mounted display meets trigger condition.
As a kind of optional embodiment, the equipment also includes:
First detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object has the light sensation information for meeting preset area;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
As a kind of optional embodiment, the equipment also includes:
Second detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object have issued the decibel value for meeting predetermined threshold value;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
As a kind of optional embodiment, the monitoring module 21, including:
First receiving module, the data message sent for external object described in real-time reception;
First extraction module, the row for extracting the external object in the data message that is sent from the external objectFor information, and then the behavioural information based on the external object judges whether the virtual reality head-mounted display equipment meets tactileClockwork spring part.
It is used as a kind of optional embodiment, the monitoring module 21, specifically in the virtual reality head-mounted displayWhen equipment is run, the external object is monitored using infrared ray sensor, the infrared ray sensor is obtained and monitors the outsideThe duration of object, and then judge described virtual based on the duration that the infrared ray sensor monitors the external objectWhether real head-mounted display equipment meets trigger condition.
As a kind of optional embodiment, first display module 23, including:
Second receiving module, for receiving the display information that the external object is sent;
Second display module, for the display information to be included in the virtual reality head-mounted display equipment in displayOn interface.
As a kind of optional embodiment, first display module 23, including:
Second taking module, for being carried out using the first camera device and or the second camera device to the external objectShoot;
3rd display module, for the image or video that include the external object of acquisition to be included in the voidOn the display interface for intending real head-mounted display equipment.
As a kind of optional embodiment, the 3rd display module, including:
Second extraction module, it is right for extracting the outside from the image or video that include the external objectAs;
4th display module, for the external object to be included in the virtual of the virtual reality head-mounted display equipmentReal display interface.
As a kind of optional embodiment, second extraction module, including:
3rd extraction module, for extracting all display objects from the image comprising the external object;
First obtains module, for obtaining the image for including the external object described in each leisure based on the display objectIn viewing area area;
Determining module, the viewing area area for being compared all display objects, determines viewing area area mostBig display object is the external object.
As a kind of optional embodiment, the 3rd extraction module, including:
4th extraction module, for extracting all display objects from the image comprising the external object;
Second obtains module, the priority that shows object all for obtaining;
Contrast module, the priority for being compared all real-world objects determines the display object of highest priorityFor the external object.
As a kind of optional embodiment, the equipment, in addition to:
5th extraction module, for the image or video that include the external object of acquisition to be included in the voidAfter intending on the display interface of real head-mounted display equipment, the instruction based on user includes the external object from describedImage or video in extract the display interface that the external object is shown in the virtual reality head-mounted display equipmentOn.
As a kind of optional embodiment, the equipment, in addition to:
Generation module, for trigger the virtual reality head-mounted display equipment shown on display interface external object itBefore, whether virtual reality head-mounted display equipment owning user described in generation voice message prompting message confirms that triggering is described virtualReal head-mounted display equipment shows the external object on display interface.
The technical scheme provided in the embodiment of the present application, has at least the following technical effects or advantages:
The invention discloses a kind of method of virtual reality head-mounted display equipment processing information, in the virtual reality headExternal environment condition monitoring is carried out when wearing display apparatus operation, monitoring information is obtained;Judge described virtual based on the monitoring informationWhether real head-mounted display equipment meets trigger condition;If meeting the trigger condition, trigger the virtual reality and wear displayDevice equipment shows external object on display interface, and external object is presented to and uses virtual reality head-mounted display equipmentUser, allow users to be concerned about external object.Provided herein algorithm and show not with any certain computer, virtual systemSystem or miscellaneous equipment are inherently related.Various general-purpose systems can also be used together with based on teaching in this.According to aboveDescription, the structure constructed required by this kind of system is obvious.In addition, the present invention is not also directed to any certain programmed languageSpeech.It is understood that, it is possible to use various programming languages realize the content of invention described herein, and above to language-specificThe description done be in order to disclose the present invention preferred forms.
In the specification that this place is provided, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present inventionExample can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detailAnd technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect, existAbove in the description of the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimesIn example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention:It is i.e. required to protectThe application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as followingClaims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itselfAll as the separate embodiments of the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodimentChange and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodimentMember or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement orSub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use anyCombination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appointWhere all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint powerProfit is required, summary and accompanying drawing) disclosed in each feature can or similar purpose identical, equivalent by offer alternative features come generationReplace.
Although in addition, it will be appreciated by those of skill in the art that some embodiments in this include institute in other embodimentsIncluding some features rather than further feature, but not the combination of the feature of be the same as Example mean be in the scope of the present inventionWithin and form different embodiments.For example, in the following claims, embodiment claimed it is any itOne mode can use in any combination.
The present invention all parts embodiment can be realized with hardware, or with one or more processor runSoftware module realize, or realized with combinations thereof.It will be understood by those of skill in the art that can use in practiceMicroprocessor or digital signal processor (DSP) are realized in gateway according to embodiments of the present invention, proxy server, systemSome or all parts some or all functions.The present invention is also implemented as being used to perform side as described hereinThe some or all equipment or program of device (for example, computer program and computer program product) of method.It is suchRealizing the program of the present invention can store on a computer-readable medium, or can have the shape of one or more signalFormula.Such signal can be downloaded from internet website and obtained, and either be provided or with any other shape on carrier signalFormula is provided.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and abilityField technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" is not excluded the presence of notElement or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple suchElement.The present invention can be by means of including the hardware of some different elements and coming real by means of properly programmed computerIt is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branchTo embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fameClaim.
The invention discloses A1, a kind of method of virtual reality head-mounted display equipment processing information, methods described bagInclude:
External environment condition monitoring is carried out when the virtual reality head-mounted display equipment is run, monitoring information is obtained;
Judge whether the virtual reality head-mounted display equipment meets trigger condition based on the monitoring information;
If meeting, trigger the virtual reality head-mounted display equipment and external object is shown on display interface.
A2, the method as described in A1, the monitoring information include but is not limited to be one of the following:The virtual reality is wornThe relative distance for the external object that display apparatus and monitoring are obtained, the behavioural information of the external object monitors the outsideThe duration of object.
A3, the method as described in A2, it is described to carry out external environment condition when the virtual reality head-mounted display equipment is runMonitoring, obtains monitoring information, including:
When the virtual reality head-mounted display equipment is run, using the first camera device, or range sensor, orWIFI modes, or bluetooth approach monitor the external object, obtain the virtual reality head-mounted display equipment and the outsideThe distance of object.
A4, the method as described in A3, it is described to monitor the external object using the first camera device, obtain described virtual existingBefore the distance of real head-mounted display equipment and the external object, including:
The image for including the external object is shot using first camera device;
Described image is analyzed to obtain the relative distance of the virtual reality head-mounted display equipment and the external object.
A5, the method as described in A3, the acquisition virtual reality head-mounted display equipment and the external objectAfter relative distance, including:
Judge the virtual reality head-mounted display equipment and the external object relative distance whether be less than it is default away fromFrom threshold value, if, then it represents that the monitoring information judges that the virtual reality head-mounted display meets trigger condition.
A6, the method as described in A5, the judgement virtual reality head-mounted display equipment and the external objectWhether distance is less than after pre-determined distance threshold value, including:
If the distance of the virtual reality head-mounted display equipment and the external object is less than the pre-determined distance threshold value,Further detect whether the external object has the light sensation information for meeting preset area;
If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
A7, the method as described in A5, the judgement virtual reality head-mounted display equipment and the external objectWhether distance is less than after pre-determined distance threshold value, including:
If the distance of the virtual reality head-mounted display equipment and the external object is less than the pre-determined distance threshold value,Further detect whether the external object have issued the decibel value for meeting predetermined threshold value;
If so, then representing that the virtual reality head-mounted display equipment meets trigger condition.
A8, the method as described in A2, it is described to carry out external environment condition when the virtual reality head-mounted display equipment is runMonitoring, obtains monitoring information, including:
The data message that external object described in real-time reception is sent;
The behavioural information of the external object is extracted in the data message sent from the external object, and then based on instituteThe behavioural information for stating external object judges whether the virtual reality head-mounted display equipment meets trigger condition.
A9, the method as described in A1, it is described to carry out external environment condition when the virtual reality head-mounted display equipment is runMonitoring, obtains monitoring information, including:
When the virtual reality head-mounted display equipment is run, the external object is monitored using infrared ray sensor,The duration that the infrared ray sensor monitors the external object is obtained, and then institute is monitored based on the infrared ray sensorThe duration for stating external object judges whether the virtual reality head-mounted display equipment meets trigger condition.
A10, the method as described in A1, the triggering virtual reality head-mounted display equipment are shown on display interfaceExternal object, including:
Receive the display information that the external object is sent;
The display information is included in the virtual reality head-mounted display equipment on display interface.
A11, the method as described in A1, the triggering virtual reality head-mounted display equipment are shown on display interfaceExternal object, including:
Using the first camera device and or the second camera device the external object is shot;
The image or video that include the external object of acquisition are included in the virtual reality head-mounted displayOn the display interface of equipment.
A12, the method as described in A11, it is described to show the image or video that include the external object of acquisitionOn the display interface of the virtual reality head-mounted display equipment, including:
The external object is extracted from the image or video that include the external object;
The external object is included into the virtual reality display interface in the virtual reality head-mounted display equipment.
A13, the method as described in A12, it is described that institute is extracted from the image of the display interface comprising the external objectExternal object is stated, including:
All display objects are extracted from the image comprising the external object;
Viewing area area in each comfortable image comprising the external object is obtained based on the display object;
The viewing area area of all display objects is compared, determines that area maximum display object in viewing area isThe external object.
A14, the method as described in A12, it is described that institute is extracted from the image of the display interface comprising the external objectExternal object is stated, including:
All display objects are extracted from the image comprising the external object;
Obtain the priority of all display objects;
The priority of all real-world objects is compared, determines that the display object of highest priority is right for the outsideAs.
A15, the method as described in A11, it is described to show the image or video that include the external object of acquisitionAfter on the display interface of the virtual reality head-mounted display equipment, including:
Instruction based on user, the outside is extracted from the image or video for including the external objectObject is shown on the display interface of the virtual reality head-mounted display equipment.
A16, the method as described in A1, the triggering virtual reality head-mounted display equipment are shown on display interfaceBefore external object, including:
Whether virtual reality head-mounted display equipment owning user described in generation voice message prompting message confirms to trigger instituteState virtual reality head-mounted display equipment and the external object is shown on display interface.
The invention also discloses, B17, a kind of virtual reality head-mounted display equipment, including:
Monitoring module, for carrying out external environment condition monitoring when the virtual reality head-mounted display equipment is run, is obtainedMonitoring information;
First judge module, for judging whether the virtual reality head-mounted display equipment is full based on the monitoring informationSufficient trigger condition;
First display module, if for meeting, triggering the virtual reality head-mounted display equipment and showing on display interfaceShow external object.
B18, the equipment as described in B17, the monitoring information include but is not limited to be one of the following:The virtual reality headThe relative distance for the external object that display apparatus and monitoring are obtained is worn, the behavioural information of the external object monitors described outerThe duration of portion's object.
B19, the equipment as described in B18, the monitoring module, in virtual reality head-mounted display equipment operationWhen, the external object is monitored using the first camera device, or range sensor, or WIFI modes, or bluetooth approach, institute is obtainedState the distance of virtual reality head-mounted display equipment and the external object.
B20, the equipment as described in B19, the equipment, in addition to:
First taking module, for monitoring the external object using the first camera device, obtains the virtual reality headBefore the distance for wearing display apparatus and the external object, include the outside using first camera device shooting rightThe image of elephant;
Analysis module is right to obtain the virtual reality head-mounted display equipment and the outside for analyzing described imageThe relative distance of elephant.
B21, the equipment as described in B19, the equipment, in addition to:
Second judge module, for obtain the virtual reality head-mounted display equipment and the external object it is relative away fromFrom after, judge whether the relative distance of the virtual reality head-mounted display equipment and the external object is less than pre-determined distanceThreshold value, if, then it represents that the monitoring information judges that the virtual reality head-mounted display meets trigger condition.
B22, the equipment as described in B21, the equipment also include:
First detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object has the light sensation information for meeting preset area;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
B23, the equipment as described in B21, the equipment also include:
Second detection module, for judging that the distance of the virtual reality head-mounted display equipment and the external object isIt is no to be less than after pre-determined distance threshold value, if the distance of the virtual reality head-mounted display equipment and the external object is less than institutePre-determined distance threshold value is stated, further detects whether the external object have issued the decibel value for meeting predetermined threshold value;If so, then tableShow that the virtual reality head-mounted display equipment meets trigger condition.
B24, the equipment as described in B18, the monitoring module, including:
First receiving module, the data message sent for external object described in real-time reception;
First extraction module, the row for extracting the external object in the data message that is sent from the external objectFor information, and then the behavioural information based on the external object judges whether the virtual reality head-mounted display equipment meets tactileClockwork spring part.
B25, the equipment as described in B17, the monitoring module, specifically in the virtual reality head-mounted display equipmentDuring operation, the external object is monitored using infrared ray sensor, the infrared ray sensor is obtained and monitors the external objectDuration, and then the virtual reality is judged based on the duration that the infrared ray sensor monitors the external objectWhether head-mounted display equipment meets trigger condition.
B26, the equipment as described in B17, first display module, including:
Second receiving module, for receiving the display information that the external object is sent;
Second display module, for the display information to be included in the virtual reality head-mounted display equipment in displayOn interface.
B27, the equipment as described in B17, first display module, including:
Second taking module, for being carried out using the first camera device and or the second camera device to the external objectShoot;
3rd display module, for the image or video that include the external object of acquisition to be included in the voidOn the display interface for intending real head-mounted display equipment.
B28, the equipment as described in B27, the 3rd display module, including:
Second extraction module, it is right for extracting the outside from the image or video that include the external objectAs;
4th display module, for the external object to be included in the virtual of the virtual reality head-mounted display equipmentReal display interface.
B29, the equipment as described in B28, second extraction module, including:
3rd extraction module, for extracting all display objects from the image comprising the external object;
First obtains module, for obtaining the image for including the external object described in each leisure based on the display objectIn viewing area area;
Determining module, the viewing area area for being compared all display objects, determines viewing area area mostBig display object is the external object.
B30, the equipment as described in B28, the 3rd extraction module, including:
4th extraction module, for extracting all display objects from the image comprising the external object;
Second obtains module, the priority that shows object all for obtaining;
Contrast module, the priority for being compared all real-world objects determines the display object of highest priorityFor the external object.
B31, the equipment as described in B27, the equipment, in addition to:
5th extraction module, for the image or video that include the external object of acquisition to be included in the voidAfter intending on the display interface of real head-mounted display equipment, the instruction based on user includes the external object from describedImage or video in extract the display interface that the external object is shown in the virtual reality head-mounted display equipmentOn.
B32, the equipment as described in B17, the equipment, in addition to:
Generation module, for trigger the virtual reality head-mounted display equipment shown on display interface external object itBefore, whether virtual reality head-mounted display equipment owning user described in generation voice message prompting message confirms that triggering is described virtualReal head-mounted display equipment shows the external object on display interface.