The detection method and device of head-mounted display apparatus frame per secondTechnical field
The present invention relates to computer vision and field of artificial intelligence more particularly to a kind of head-mounted display apparatus frame per secondDetection method and device.
Background technique
Virtual reality technology (Virtual Reality, abbreviation VR), passes through computer graphics, machine vision technique, peopleThe technical constructions such as work intellectual technology go out the model of a simulation reality and realize human-computer interaction, generate identical in real worldFeedback information obtains user and sensory experience same in real world to achieve the effect that enter in virtual world.
Currently, frame per second (Frame rate) is one of the technical parameter that virtual reality system and equipment need emphasis to improve.It is not true enough that low frame per second causes what comes into a driver's to there is discontinuous or distortion phenomenon, the virtual environment for feeling user.In addition, low frame per secondPresence cause user that can generate the senses of discomfort such as nausea, dizziness for a long time.For the user's body of the virtual reality system of high qualityFor testing, it is most important that when refreshed image reaches the delay between eyes of user in real time on the movement of user's head physics and the helmetBetween.Therefore, accurately the frame per second of detection head-mounted display apparatus is to judge the quality of wear-type virtual reality device, and solve headOne of during wearing formula virtual reality device delay issue, need to solve the problems, such as first.
Summary of the invention
The object of the present invention is to provide a kind of detection method and device of head-mounted display apparatus frame per second, by will be to be detectedHead-mounted display apparatus be fixed on preset angular speed rotation equipment supporter, pass through head-mounted display apparatus internal sensorThe rotation angle of the head-mounted display apparatus is detected, and shows the angle mark for identifying the rotation angle in screen, is led toThe image that video camera acquires the angle mark in real time is crossed, identifies that the angle in preset period of time identifies image, calculates and determinesThe frame per second of the head-mounted display apparatus effectively improves the detection efficiency and detection accuracy of head-mounted display apparatus frame per second,It is particularly suitable for the frame per second detection of wear-type virtual reality device.
In view of this, one aspect of the present invention provides a kind of detection method of head-mounted display apparatus frame per second, including following stepIt is rapid: head-mounted display apparatus to be fixed on equipment supporter, the equipment supporter is with preset angular speed along axial-rotation；DescribedAngles of display identifies in the screen of head-mounted display apparatus, indicates the head of the sensor detection of the head-mounted display apparatusWear the rotation angle that formula shows equipment；The image for acquiring the angle mark in real time by video camera, determines that the wear-type is aobviousShow the frame per second of equipment.
Preferably, the Image Acquisition frame per second of the video camera is not less than 120fps.
Preferably, the image for acquiring the angle mark in real time by video camera, determines that the wear-type is shown and setsThe step of standby frame per second, specifically: the angle for extracting the video camera acquisition in preset period of time frame by frame identifies image；The angle mark in each picture frame is identified, according to the image frames numbers n and expression formula p=s/ (n- identified with equal angular1) frame per second of the head-mounted display apparatus, is determined, wherein p is frame per second, and s is the Image Acquisition frame per second of the video camera.
Preferably, the image for acquiring the angle mark in real time by video camera, determines that the wear-type is shown and setsThe step of standby frame per second, specifically: the angle for extracting the video camera acquisition in preset period of time frame by frame identifies image；It identifies the angle mark in each picture frame, same set of frames will be divided into the picture frame that equal angular identifies, obtainedMultiple images frame set；According to expression formula pi=s/ (Ni- 1) set of frames C is determinediThe corresponding head-mounted display apparatusFrame per second pi, s is the Image Acquisition frame per second of the video camera, NiFor described image frame set CiIn image frames numbers, i is positiveInteger；
The frame per second mean value for calculating the corresponding head-mounted display apparatus of described multiple images frame set determines that the wear-type is aobviousShow the frame per second of equipment.
Preferably, described according to described multiple images frame set, the step of determining the frame per second of the head-mounted display apparatus,Specifically: by calculating the frame per second mean value of the corresponding head-mounted display apparatus of described multiple images frame set, worn described in determinationFormula shows the frame per second of equipment.
Another aspect of the present invention provides a kind of detection device of head-mounted display apparatus frame per second, including equipment supporter, camera shootingMachine and frame per second computing module, it is characterised in that: the fixed head-mounted display apparatus of the equipment supporter, with preset angular speed along axisTo rotation；Angles of display identifies in the screen of the head-mounted display apparatus, and the angle mark indicates the wear-type and showsThe rotation angle of the head-mounted display apparatus of the sensor detection of equipment；The video camera acquires the angle mark in real timeImage；The frame per second computing module identifies image according to the angle of video camera acquisition, determines that the wear-type is aobviousShow the frame per second of equipment.
Preferably, in the detection device of the head-mounted display apparatus frame per second, the Image Acquisition frame per second of the video camera is notLess than 120fps.
Preferably, the frame per second computing module, is also used to: extracting the video camera acquisition in preset period of time frame by frameThe angle identifies image；The angle mark in each picture frame is identified, according to the image frames numbers n identified with equal angularWith expression formula p=s/ (n-1), the frame per second of the head-mounted display apparatus is determined, wherein p is frame per second, and s is the figure of the video cameraAs acquisition frame rate.
Preferably, the frame per second computing module, is also used to: extracting the video camera acquisition in preset period of time frame by frameThe angle identifies image；It identifies the angle mark in each frame image, will be divided into together with the picture frame that equal angular identifiesOne set of frames obtains multiple images frame set；According to expression formula pi=s/ (Ni- 1) set of frames C is determinediCorresponding instituteState the frame per second p of head-mounted display apparatusi, s is the Image Acquisition frame per second of the video camera, NiFor described image frame set CiInImage frames numbers, i are positive integer；It is equal by the frame per second for calculating the corresponding head-mounted display apparatus of described multiple images frame setValue, determines the frame per second of the head-mounted display apparatus.
The detection method and device of head-mounted display apparatus frame per second of the present invention, by by head-mounted display apparatus to be detectedIt is fixed on to preset the equipment supporter of angular speed rotation, it is aobvious to detect the wear-type by head-mounted display apparatus internal sensorShow the rotation angle of equipment, and show the angle mark for identifying the rotation angle in screen, is acquired in real time by video cameraThe image of the angle mark identifies that the angle in preset period of time identifies image, and calculating determines that the wear-type is shown and setsStandby frame per second.The detection method and device of the head-mounted display apparatus frame per second of the embodiment of the present invention, can effectively improve wear-typeThe detection efficiency and detection accuracy for showing equipment frame per second, the frame per second suitable for wear-type virtual reality device detect.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show belowThere is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only thisSome embodiments of invention without any creative labor, may be used also for those of ordinary skill in the artTo obtain other drawings based on these drawings:
Fig. 1 shows the flow diagram of the detection method of the head-mounted display apparatus frame per second of first embodiment of the invention；
Fig. 2 shows the structural schematic diagrams of the detection device of the head-mounted display apparatus frame per second of second embodiment of the invention.
Specific embodiment
In order to be more clearly understood that objects, features and advantages of the present invention, with reference to the accompanying drawing and specific embodiment partyFormula is described in further detail the present invention.It should be noted that in the absence of conflict, embodiments herein and realityApplying the feature in example can be combined with each other.
In the following description, numerous specific details are set forth in order to facilitate a full understanding of the present invention, still, this is only thisSome embodiments of invention, the invention may also be implemented in other ways than those described herein, therefore, this hairBright protection scope is not limited by the specific embodiments disclosed below.
Embodiment one
Fig. 1 shows the flow diagram of the detection method of the head-mounted display apparatus frame per second of first embodiment of the invention.
The detection method of head-mounted display apparatus frame per second according to an embodiment of the present invention, as shown in Figure 1, comprising: stepHead-mounted display apparatus is fixed on equipment supporter by S101, and the equipment supporter is with preset angular speed along axial-rotation；StepS102, angles of display identifies in the screen of head-mounted display apparatus, indicates the sensor detection of the head-mounted display apparatusThe head-mounted display apparatus rotation angle；Step S103 acquires the image of the angle mark by video camera in real time,Determine the frame per second of the head-mounted display apparatus.
The detection method of the head-mounted display apparatus frame per second of the embodiment of the present invention, head-mounted display apparatus is fixed on pre-If angular speed drives head-mounted display apparatus with preset angular speed along axis along the equipment supporter of axial 360 ° of rotations, equipment supporterTo being rotated, wears display equipment and detect the rotation angle of the head-mounted display apparatus by internal sensor, and shieldingThe angle mark for indicating the rotation angle is shown in curtain, acquires the image of the angle mark, identification in real time by video cameraAngle in preset period of time identifies image, calculates the frame per second for determining the head-mounted display apparatus.
In the above-mentioned technical solutions, it is preferable that the step S102, specifically: it is installed in advance in head-mounted display apparatusApplication program, by the application program, angles of display is identified in the screen of head-mounted display apparatus, according to the wear-typeShow that the rotation angle of the head-mounted display apparatus of device sensor real-time detection, the angle mark indicate that the wear-type is aobviousShow the rotation angle of equipment.The angle mark can be a digital angle marker disc, and the digital angle marker disc is with defaultAngle value carries out scale marker, for example, the digital angle marker disc is distributed 360 graduated scales with 1 ° for scale interval is evenKnow.According to the rotation angle for the head-mounted display apparatus that sensor detects, indicates and correspond in the digital angle marker discAngle value.
In the above-mentioned technical solutions, it is preferable that the step S103, specifically: institute in preset period of time is extracted frame by frameState the angle mark image of video camera acquisition；The angle mark in each picture frame is identified, according to same angularThe image frames numbers that scale is known, determine the frame per second of the head-mounted display apparatus.Specifically, video camera docking wear-type, which is shown, setsStandby eyepiece acquires the image of the digital angle marker disc shown in wear-type display device screen in real time.According to detectedEyes of user determines that the camera lens and the wear-type are aobvious at a distance from eyepiece in head-mounted display apparatus design specificationShow the distance of the eyepiece of equipment, for example, 25mm.The Image Acquisition frame per second s of video camera is not less than 120 frames/second.By the video cameraIt is connect with display equipment, the digital angle that the video camera acquires in preset period of time is shown in the display equipmentThe image for spending marker disc, extracts the picture frame in the digital angle marker disc image frame by frame.It identifies in each picture frameDigital angle marker disc, determine the angle value indicated in the digital angle marker disc in described image frame.Choose any numberThe angle value indicated in angle marker disc, statistics obtain the quantity n of the picture frame of the display same angular angle value.According to following tableThe frame per second p of the head-mounted display apparatus is determined up to formula:
P=s/ (n-1)
In above-mentioned technical proposal, similarly, the step S103, specifically: it extracts frame by frame described in preset period of timeThe angle of video camera acquisition identifies image；The angle mark in each picture frame is identified, according to equal angularThe image frames numbers of mark determine the frame per second of the head-mounted display apparatus.Specifically, video camera docks head-mounted display apparatusEyepiece, acquire the image of digital angle marker disc shown in wear-type display device screen in real time.According to detected headIt wears formula and shows that eyes of user is at a distance from eyepiece in equipment design specification, determine that the camera lens and the wear-type are shownThe distance of the eyepiece of equipment, for example, 25mm.The Image Acquisition frame per second s of video camera is not less than 120 frames/second.By the video camera withIt shows equipment connection, the digital angle that the video camera acquires in preset period of time is shown in the display equipmentThe image of marker disc extracts the picture frame in the digital angle marker disc image frame by frame.Identify the digital angle marker discFirst picture frame F of image1In digital angle marker disc, determine the angle value A indicated in the digital angle marker disc1.AfterIt is continuous to choose next image frame F2, identify described image frame F2The angle value A indicated in middle digital angle marker disc2, judge angle valueA2With the angle value A1It is whether identical, if so, subsequent image frames are successively chosen, until judging picture frame FnMiddle digital angleThe angle value and picture frame F of marker disc instructionn-1The angle value of middle digital angle marker disc instruction is different, then according to following expressionFormula determines the frame per second p of the head-mounted display apparatus:
P=s/ (n-1)
In the above-mentioned technical solutions, it is preferable that the step S103, specifically: institute in preset period of time is extracted frame by frameState the angle mark image of video camera acquisition；It identifies the angle mark in each picture frame, will have equal angularThe picture frame of mark divides same set of frames into, obtains multiple images frame set；According to described multiple images frame set, determineThe frame per second of the head-mounted display apparatus.Specifically, the eyepiece of video camera docking head-mounted display apparatus, acquires wear-type in real timeThe image of the digital angle marker disc shown in display device screen.According in detected head-mounted display apparatus design specificationEyes of user at a distance from eyepiece, determine the camera lens at a distance from the eyepiece of the head-mounted display apparatus, for example,25mm.The Image Acquisition frame per second s of video camera is not less than 120 frames/second.The video camera is connect with display equipment, described aobviousThe image for showing the digital angle marker disc for showing that the video camera acquires in preset period of time in equipment, is extracted frame by framePicture frame in the digital angle marker disc image.It identifies the digital angle marker disc in each picture frame, determines instituteState the angle value of the digital angle marker disc mark in picture frame.By the angle value of the digital angle marker disc mark in picture frameIdentical picture frame divides same set of frames C intoi, obtain multiple images frame set { C1,C2,…Cn}.In described multiple imagesIn frame set, the set of frames of preset quantity is chosen, according to the image frames numbers in each set of frames, determines instituteThe frame per second of the corresponding head-mounted display apparatus of set of frames is stated, for example, in described image frame set CiIn, described in determinationSet of frames CiIn image frames numbers Ni, described image frame set C is determined according to following formulaiIt is worn described in correspondingFormula shows the frame per second p of equipmenti:
pi=s/ (Ni-1)
According to the multiple images frame set of selection, the corresponding head-mounted display apparatus of described multiple images frame set is calculatedFrame per second mean value determines the frame per second of the head-mounted display apparatus.
The detection method of the head-mounted display apparatus frame per second of the embodiment of the present invention, is set by showing wear-type to be detectedIt is standby to be fixed on to preset the equipment supporter of angular speed rotation, the wear-type is detected by head-mounted display apparatus internal sensorIt shows the rotation angle of equipment, and shows the angle mark for identifying the rotation angle in screen, adopted in real time by video cameraThe image for collecting the angle mark identifies that the angle in preset period of time identifies image, calculates and determine that the wear-type is shownThe frame per second of equipment.The detection method of the head-mounted display apparatus frame per second of the embodiment of the present invention can effectively improve wear-type and showThe detection efficiency and detection accuracy of equipment frame per second, the frame per second suitable for wear-type virtual reality device detect.
Embodiment two
Fig. 2 shows the structural schematic diagrams of the detection device of the head-mounted display apparatus frame per second of second embodiment of the invention.
The detection device 100 of head-mounted display apparatus frame per second according to an embodiment of the present invention, as shown in Figure 2, comprising: equipmentBracket 101, video camera 102 and frame per second computing module 103, as shown in figure 3, equipment supporter 101 fixes head-mounted display apparatus,With preset angular speed along axial-rotation；Angles of display identifies in the screen of head-mounted display apparatus, the angle mark markThe rotation angle of the head-mounted display apparatus of the sensor detection of the head-mounted display apparatus；Video camera 102 is adopted in real timeCollect the image of the angle mark；Frame per second computing module 103 identifies image according to the angle of the video camera 102 acquisition,Determine the frame per second of the head-mounted display apparatus.
The detection device of the head-mounted display apparatus frame per second of the embodiment of the present invention, the fixed wear-type of equipment supporter, which is shown, to be setIt is standby, it drives head-mounted display apparatus to rotate 360 ° with preset angular speed along axial direction, wears display equipment and passed by internalSensor detects the rotation angle of the head-mounted display apparatus, and the angle mark for indicating the rotation angle is shown in screenKnow, acquire the image of the angle mark in real time by video camera, identifies that the angle in preset period of time identifies image, calculateDetermine the frame per second of the head-mounted display apparatus.
In the above-mentioned technical solutions, it is preferable that application program is installed in advance in head-mounted display apparatus, passes through the applicationProgram angles of display in the screen of head-mounted display apparatus identifies, according to the head-mounted display apparatus sensor real-time detectionHead-mounted display apparatus rotation angle, angle mark indicates the rotation angle of the head-mounted display apparatus.It is describedAngle mark can be a digital angle marker disc, and the digital angle marker disc carries out scale marker, example with preset angle angle valueSuch as, the digital angle marker disc is distributed 360 scale markers with 1 ° for scale interval is even.The head detected according to sensorThe rotation angle that formula shows equipment is worn, indicates corresponding angle value in the digital angle marker disc.
In the above-mentioned technical solutions, it is preferable that the frame per second computing module 103 is also used to: extracting preset time week frame by frameThe angle of the video camera acquisition identifies image in phase；The angle mark in each picture frame is identified, according to havingThe image frames numbers of equal angular mark, determine the frame per second of the head-mounted display apparatus.Specifically, 102 butt joint of video cameraThe eyepiece that formula shows equipment is worn, acquires the image of the digital angle marker disc shown in wear-type display device screen in real time.RootAccording to eyes of user in detected head-mounted display apparatus design specification at a distance from eyepiece, 102 camera lens of video camera is determinedAt a distance from the eyepiece of the head-mounted display apparatus, for example, 25mm.The Image Acquisition frame per second s of video camera 102 is not less than 120Frame/second.The video camera 102 is connect with display equipment, shows the video camera 102 when default in the display equipmentBetween the image of the digital angle marker disc that acquires in the period, extract the image in the digital angle marker disc image frame by frameFrame.It identifies the digital angle marker disc in each picture frame, determines the digital angle marker disc middle finger in described image frameThe angle value shown.The angle value indicated in any digital angle marker disc is chosen, statistics obtains the display same angular angle valueThe quantity n of picture frame.The frame per second p of the head-mounted display apparatus is determined according to following formula:
P=s/ (n-1)
In the above-mentioned technical solutions, it is preferable that the frame per second computing module 103 is also used to: extracting preset time week frame by frameThe angle of the video camera acquisition identifies image in phase；The angle mark in each picture frame is identified, according to havingThe image frames numbers of equal angular mark, determine the frame per second of the head-mounted display apparatus.Specifically, 102 butt joint of video cameraThe eyepiece that formula shows equipment is worn, acquires the image of the digital angle marker disc shown in wear-type display device screen in real time.RootAccording to eyes of user in detected head-mounted display apparatus design specification at a distance from eyepiece, 102 camera lens of video camera is determinedAt a distance from the eyepiece of the head-mounted display apparatus, for example, 25mm.The Image Acquisition frame per second s of video camera 102 is not less than 120Frame/second.The video camera 102 is connect with display equipment, shows the video camera 102 when default in the display equipmentBetween the image of the digital angle marker disc that acquires in the period, extract the image in the digital angle marker disc image frame by frameFrame.Identify the first picture frame F of the digital angle marker disc image1In digital angle marker disc, determine the digital angleThe angle value A indicated in degree marker disc1.Continue to choose next image frame F2, identify described image frame F2Middle digital angle marker discThe angle value A of middle instruction2, judge angle value A2With the angle value A1It is whether identical, if so, subsequent image frames are successively chosen,Until judging picture frame FnThe angle value and picture frame F of middle digital angle marker disc instructionn-1Middle digital angle marker disc instructionAngle value is different, then the frame per second p of the head-mounted display apparatus is determined according to following formula:
P=s/ (n-1)
In the above-mentioned technical solutions, it is preferable that the frame per second computing module 103 is also used to: extracting preset time week frame by frameThe angle of the video camera acquisition identifies image in phase；It identifies the angle mark in each picture frame, will have phasePicture frame with angle mark divides same set of frames into, obtains multiple images frame set；According to described multiple images frame collectionIt closes, determines the frame per second of the head-mounted display apparatus.Specifically, video camera 102 docks the eyepiece of head-mounted display apparatus, in real timeThe image of the digital angle marker disc shown in acquisition wear-type display device screen.According to detected head-mounted display apparatusEyes of user determines the mesh of video camera 102 camera lens and the head-mounted display apparatus at a distance from eyepiece in design specificationThe distance of mirror, for example, 25mm.The Image Acquisition frame per second s of video camera 102 is not less than 120 frames/second.By the video camera 102 and showShow that equipment connects, the digital angle that the video camera 102 acquires in preset period of time is shown in the display equipmentThe image for spending marker disc, extracts the picture frame in the digital angle marker disc image frame by frame.It identifies in each picture frameDigital angle marker disc, determine in described image frame digital angle marker disc mark angle value.By the number in picture frameThe identical picture frame of angle value of word angle marker disc mark divides same set of frames C intoi, obtain multiple images frame set{C1,C2,…Cn}.In described multiple images frame set, the set of frames of preset quantity is chosen, according to each imageImage frames numbers in frame set determine the frame per second of the corresponding head-mounted display apparatus of described image frame set, for example,Described image frame set CiIn, determine described image frame set CiIn image frames numbers Ni, according to following formula determinationSet of frames CiThe frame per second p of the corresponding head-mounted display apparatusi:
pi=s/ (Ni-1)
According to the multiple images frame set of selection, the corresponding head-mounted display apparatus of described multiple images frame set is calculatedFrame per second mean value determines the frame per second of the head-mounted display apparatus.
The detection device of the head-mounted display apparatus frame per second of the embodiment of the present invention, is set by showing wear-type to be detectedIt is standby to be fixed on to preset the equipment supporter of angular speed rotation, the wear-type is detected by head-mounted display apparatus internal sensorIt shows the rotation angle of equipment, and shows the angle mark for identifying the rotation angle in screen, adopted in real time by video cameraThe image for collecting the angle mark identifies that the angle in preset period of time identifies image, calculates and determine that the wear-type is shownThe frame per second of equipment.The detection device of the head-mounted display apparatus frame per second of the embodiment of the present invention can effectively improve wear-type and showThe detection efficiency and detection accuracy of equipment frame per second, the frame per second suitable for wear-type virtual reality device detect.
State again, all features disclosed in this specification or disclosed all methods or in the process the step of, in addition toOther than mutually exclusive feature and/or step, it can combine in any way.
Any feature disclosed in this specification (including any accessory claim, abstract and attached drawing), except non-specifically chattingIt states, can be replaced by other alternative features that are equivalent or have similar purpose.That is, unless specifically stated, each feature is onlyIt is an example in a series of equivalent or similar characteristics.
The invention is not limited to specific embodiments above-mentioned.The present invention can extend to any to drape over one's shoulders in the present specificationThe new feature of dew or any new combination, and disclose any new method or process the step of or any new combination.