A kind of wearable mobile intelligent terminal of fissionTechnical field
The present invention relates to a kind of intelligent terminal, specifically a kind of wearable mobile intelligent terminal of fission.
Background technique
As the mobile computing device based on smart phone is more more and more universal, people's lives convenience degree has been obtained veryBig raising.But above-mentioned mobile computing device is due to leading to content display area using the screen display content for being mounted on its surfaceDomain can only occupy user's whole visual field small part, can not show biggish object with true ratio.And it is above-mentionedEquipment generallys use the input units such as touch screen, key for user's operation, the tool that user can not be allowed intuitively to show with equipmentThere is the object of three dimensional depth to interact.When user, which bows, is absorbed in operation above equipment, all can to behaviors such as walking, drivingCause very big security risk.And due to the content that other people can watch user's screen to show, the privacy of user is also difficult toIt is guaranteed.If user watches the hypotelorism and overlong time of screen, it is easy to cause the optical disorders such as myopia.In addition, peaceThe battery of large capacity, large volume in fuselage, can allow fuselage to become thick and heavy, cause to hold inconvenient for use.Golf calorific valueProcessor can also make fuselage scald one's hand after long-time large load operation.
If showing content using helmet, current existing augmented reality helmet is long there are weight on head is bigTime, which wears, easily causes uncomfortable problem；And these equipment use the display mode of half transmitting, allow user to visually see existingThe virtual image that equipment is shown is observed while real field scape, technology realization rate is complicated, optical component is at high cost,Show that the visual field of virtual image is narrow, blocks power deficiency to real picture, can also be in many applications, such as full frame running gameWhen, user experience is influenced since cannot reality scene be shielded completely.
Therefore, these existing helmets are difficult to replace smart phone by simply improving, and popularizing becomes massesIntelligent movable equipment used in everyday, will solve the above problems, it is desirable to provide a kind of shifting with brand new and working principleDynamic intelligent terminal.
Summary of the invention
The purpose of the present invention is to provide a kind of wearable mobile intelligent terminals of fission, to solve to mention in above-mentioned background techniqueOut the problem of.
To achieve the above object, the invention provides the following technical scheme:
A kind of wearable mobile intelligent terminal of fission, including wear end and server-side, it is described wear end include pedestal, it is frame, outerShell, camera, display screen, eyepiece, shaft, connector, osteoacusis earpiece, two pieces of cameras are separated by a spacing in the horizontal directionFrom the front for being mounted on pedestal, two panels display screen is in the horizontal direction that spacing is mounted on base interior according to the interpupillary distance of human eye,The display location between camera and eyepiece, display screen towards rear portion eyepiece one side as display surface, two panels eyepiece peaceMounted in pedestal rear portion, the interval of horizontal direction is determined by the interpupillary distance of human eye, is determined at a distance from display screen interval by the focal length of eyepieceFixed, the shell is covered on base-plates surface, and the pedestal is connected by connector and shaft with frame, the osteoacusis earpiece peaceOn frame, it is connected by the conducting wire inside or outside frame with harness, the end of wearing by harness is connected to server-side,The server-side is equipped with data line jack, power line jack, there is the channel radio of Wi-Fi, bluetooth, cellular network inside server-sideBelieve module and antenna, there is mobile processor for running operation system of smart phone, storage facilities, battery in the server-sideWith peripheral device interface component.
Further scheme: the eyepiece is greater than 40mm using diameter, and focal length is less than the Fresnel Lenses of 35mm.
Further scheme: the shell is made of sunglasses eyeglass or decorative eyeglass or plastic shell.
Further scheme: the data input member of acceleration transducer, gyroscope and microphone is installed in the pedestalDevice, is equipped with the output equipment of loudspeaker, light, vibration motor on the pedestal, for carrying out for user on the pedestalThe operation button for opening and closing power supply, controlling volume, the pedestal are equipped with iris sensor or fingerprint sensor.
Further scheme: using mechanical contact or the perception of magnetoelectricity or photoelectric sensor between the pedestal and frameThe folding condition of pedestal.
Further scheme: the end of wearing is equipped with depth camera and range sensor, the outside for wearing endEquipped with the tracking ring for being worn in user's finger, tracks ring and include position sensor and be connected with the bluetooth of server-sideBluetooth module.
Further scheme: the surface of server-side is equipped with pressure sensitivity Trackpad, and pressure sensitivity Trackpad uses existing capacitorFormula touch panel and capacitance pressure transducer, element.
Compared with prior art, the beneficial effects of the present invention are:
1. shooting actual environment picture using eyes camera, shown again by eyes display screen after server-side is handled；
2. influencing the void that Software Create comes out with the object in Software of Computer Vision analysis picture when Coping with Reality environment pictureQuasi- three-dimension object；
3. the finger position and voice of user is analyzed, for intuitively interaction；
4. existing mobile application can be compatible with using two-dimensional analog device interface and three-dimensional primary two kinds of interface display modes in interfaceIt can guarantee the operational effect of proprietary application again；
5. wearing end and server-side separation, weight and fever is made all to concentrate on influencing lesser server-side, allows and wear end holding gentlyIt is thin；
Closed 6. the pedestal for wearing end can open, when not in use can locking device to save electricity；
7. close in the way of pedestal with biometric sensor be equipment unlock, to save unlocked time；
8. the mountable myopia of frame, presbyopic or without power lens, it is ensured that the crowd of different eyesight levels is able to use；
9. installing osteoacusis earpiece on frame, conducting wire is integrated together with frame, compact-sized；
10. use the Fresnel Lenses of major diameter, short focus keeps the user visual field wide as eyepiece, and display screen is with a distance from eyepieceClosely, end volume is worn to reduce；
11. the pressure sensitivity Trackpad of server-side installation can cooperate the pattern that visually indicates in the visual field to be inputted, input effect is improvedRate.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of seperated wearable mobile intelligent terminal.
Fig. 2 is the structural schematic diagram of seperated wearable mobile intelligent terminal rearview.
Fig. 3 is the schematic diagram of the system module relationship of seperated wearable mobile intelligent terminal.
Fig. 4 is the rendering background of camera building in seperated wearable mobile intelligent terminal.
Fig. 5 is the imaging schematic diagram of the virtual three-dimensional object of camera building in seperated wearable mobile intelligent terminal.
Fig. 6 is that virtual three-dimensional object shows with the imaging of actual environment model in seperated wearable mobile intelligent terminal displaying principleIt is intended to.
Fig. 7 is that the virtual three-dimensional object imaging of occlusion area is eliminated in seperated wearable mobile intelligent terminal displaying principleSchematic diagram.
Fig. 8 is the flow chart of the principle of seperated wearable mobile intelligent terminal.
Fig. 9 is the two-dimentional display interface of display screen in seperated wearable mobile intelligent terminal.
Figure 10 is the three-dimensional display interface of display screen in seperated wearable mobile intelligent terminal.
In figure: pedestal 1, frame 2, shell 3, camera 4, left Softcam 40, right Softcam 41, display screen 5,Left painting canvas 50, right painting canvas 51, eyepiece 6, shaft 7, connector 8, osteoacusis earpiece 9, service terminal box 10, harness 11, data lineJack 12, power line jack 13, virtual three-dimensional object 14, actual environment model 15, pressure sensitivity Trackpad 16.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, completeSite preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based onEmbodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every otherEmbodiment shall fall within the protection scope of the present invention.
Embodiment 1
Please refer to Fig. 1~2, in the embodiment of the present invention, a kind of wearable mobile intelligent terminal of fission, including wear end and server-side10, the end of wearing includes pedestal 1, frame 2, shell 3, camera 4, display screen 5, eyepiece 6, shaft 7, connector 8, osteoacusisEarpiece 9, two pieces of cameras 4 front separated by a distance in the horizontal direction for being mounted on pedestal 1, two panels display screen 5 is in levelOn direction according to the interpupillary distance of human eye be spacing be mounted on inside pedestal 1, the display screen 5 between camera 4 and eyepiece 6,Display screen 5 towards rear portion eyepiece 6 one side as display surface, two panels eyepiece 6 is mounted on 1 rear portion of pedestal, the interval of horizontal directionIt is determined by the interpupillary distance of human eye, is determined at a distance from the interval of display screen 5 by the focal length of eyepiece 6, so that human eye is seen clearly through eyepiece 6 aobviousPicture in display screen 5, the shell 3 are covered on 1 surface of pedestal, and the pedestal 1 passes through connector 8 and shaft 7 and 2 phase of frameEven, when user puts on frame 2, pedestal 17 can rotate upwardly and downwardly around the shaft.When pedestal 1 opens upwards, user can directly use meatEye observation reality scene, when pedestal 1 closes downwards, user will transmit through the content that eyepiece 6 sees display screen 5, the osteoacusisEarpiece 9 is mounted on frame 2, is connected by the conducting wire inside or outside frame 2 with harness 11, when user puts on frame 2, boneConduction earpiece 9 can be close to the skin of user's head two sides, described to wear end and be connected to server-side 10, the server-side by harness10 are equipped with data line jack 12, power line jack 13, there is the wireless communication of Wi-Fi, bluetooth, cellular network inside server-side 10Module and antenna have mobile processor for running operation system of smart phone, storage facilities, battery in the server-side 10With peripheral device interface component, server-side 10 can be connected by wired or wireless way with other peripheral equipments, the power supplyLine jack 13 can be used for connecting charge power supply or additional mobile power source, and data line jack 12 can connect earphone, PC etc.Wireline equipment, wireless communication module can be used for connecting the wireless devices such as various digital products, internet of things home appliance, the vehicles.
The eyepiece 6 is greater than 40mm using diameter, and focal length is less than the Fresnel Lenses of 35mm, and the eyepiece 6 of setting is big straightThe Fresnel Lenses of diameter, short focus, for keeping wider field-of-view angle, eyepiece 6 and the interval of display screen 5 shorter, to allow equipmentVolume is smaller, quality is lighter；
The shell 3 is made of sunglasses eyeglass or decorative eyeglass or plastic shell, and shell 3 plays protection camera 4 etc.Internal component and beautiful effect；
The data input component of acceleration transducer, gyroscope and microphone is installed in the pedestal 1, is pacified on the pedestal 1Equipped with loudspeaker, light, vibration motor output equipment, for carrying out opening and closing power supply, control for user on the pedestal 1The operation button of volume processed, the pedestal 1 are equipped with iris sensor or fingerprint sensor, and the biometric sensor of setting is used forPrevent the personnel of unauthorized from using equipment；
Using the folding condition of mechanical contact, magnetoelectricity or photoelectric sensor perception pedestal 1 between the pedestal 1 and frame 2, ifPedestal 1 is in the state opened upwards, and camera 4 and display screen 5 do not work, and system is in similar smart phone lock-screenState, to save electricity, if pedestal 1 closes downwards, camera 4 and display screen 5 are started to work, and biometric sensor identification is usedWhether family can be used equipment, be equivalent to smart phone solution lock screen.
The working principle of the invention is:
1, displaying principle:
When system is in running order, wearing the actual environment picture that two pieces of the left and right camera 4 that end is installed captures can pass throughHarness is transferred to server-side 10 and is handled；
As shown in figure 4, server-side 10 is drawn by running a set of figure write by three dimensional graphic interfaces such as Vulkan, Direct3DSoftware is held up, one is simulated and is placed with the three-dimensional space of left virtual camera 40 and right virtual camera 41, and virtually to take the photographEgative film the ratio of width to height of camera is consistent with display screen the ratio of width to height inside end is worn, software can also two virtual cameras just beforeTwo pieces of Fang Shengcheng ibid the ratio of width to height painting canvas (left painting canvas 50 and right painting canvas 51), so that the size of every piece of painting canvas is filled up a void justThe visual field of quasi- video camera, and left painting canvas is not rendered into the egative film of right virtual camera, right painting canvas is not rendered into left virtual cameraEgative film, the image that left virtual camera 40 and right virtual camera 41 capture is respectively as left painting canvas 50 and right painting canvas 51Three-dimensional material texture, the image of the camera 4 in left side will become the rendering background of left virtual camera 40 as a result, right sideThe image of camera 4 will become the rendering background of right virtual camera 41；
As shown in figure 5, the software of server-side can generate several virtual three-dimensional objects 14 in aforementioned three-dimensional space, these virtual threeDimension object 14 can be the element of operation interface, such as suspend skyborne picture, text, button, display screen, be also possible to useIt personage, the buildings model of purposes etc. such as plays games, navigate, can also be sound source, light source, particle effect with space coordinateThe physical object of equal computer simulations；
As shown in fig. 6, server-side 10 is by running a set of computer vision write by the computer vision algorithms makes such as OpenCV librarySoftware analyzes the parallax of 4 image of camera of left and right side, and carrying out positioning immediately with map structuring (can be used existing visionSLAM technology), real ring is created that according to left virtual camera 40 and 41 picture of right virtual camera in aforementioned three-dimensional spaceCorresponding object model in border, such as ground, table top, wall, vase, these models are only used as the three-dimensional space that data are present in softwareBetween in, can not render, i.e., be sightless for users；
As shown in fig. 7, software is rendering background, virtual three-dimensional object 14 and the actual environment model 15 created according to actual environmentIt, can be to the virtual three-dimensional object 14 in space according to actual environment model 15 when being rendered on projection to virtual camera egative filmGeneration is blocked, and the part that virtual three-dimensional object 14 is blocked can reject in rendered picture, manifests rendering background；By thisMeans, the image come is rendered on egative film can be observed the effect that virtual three-dimensional object 14 is sheltered from by the object in actual environmentFruit；If virtual three-dimensional object 14 is blocked without any part, it will completely rendered and；In addition, according to real ringBorder model 15 can also the physical characteristics such as sound source, light source to three-dimensional space have an impact, it is anti-thus can to build echo, illuminationPenetrate and other effects；The egative film of left virtual camera 40 renders the image come and will be displayed on the left display screen of display screen 5, can lead toIt crosses eyepiece 6 to be seen by left eye, the egative film of right virtual camera 41 renders the right display that the image come will be displayed on display screen 5On screen, it can be seen by eyepiece 6 by right eye；End user can see virtual three-dimensional object 14 and appear in the environment of reality,And the distance perception and three-dimensional sense generated with parallax, moreover it is possible to and the object in actual environment mutually blocks.
2, user's interaction concept
Similar to the object model in creation actual environment, if the finger of user appears in the picture of camera, server-sideThe three-dimensional space that the Software of Computer Vision of operation can go out finger according to the disparity computation of 4 image of camera of arranged on left and right sides is satMark, determines whether these fingers touch specific virtual three-dimensional object in three-dimensional space, and judge whether finger is made that spyFixed gesture, to generate the operations such as corresponding click, crawl.From the perspective of user, they directly can stretch out one's hand and regardThe virtual three-dimensional object that Yezhong is seen interacts；
As shown in Figure 9 and Figure 10, the user interface of operating system and application software can be divided into two kinds: for being compatible with traditional intelligence handThe two-dimensional analog device interface of machine application and the primary interface of three-dimensional designed and developed exclusively for this system.When needing to run traditional intelligenceThe operation system interface (such as existing Android starter) or traditional smart mobile phone application (such as existing Android of mobile phoneVersion mobile phone application) when, it will appear the virtual three-dimensional object 14 that one piece of appearance is rectangular screen, the virtual three-dimensional in the visual field of userSimulator window as traditional interface is shown the interface of legacy operating system and application by object 14 on its surface.WithFamily can carry out touch operation on this block screen with finger according to the use habit of conventional touch screen.When operation is exclusively for thisWhen the operating system software developed and the application software of uniting, three-dimensional primary interface will be used.In the interface, each interface element(such as text, figure, button, sound) is all a virtual three-dimensional object in the user visual field, and user can pass through finger, languageThe modes such as sound, head movement interact therewith.When needed, these elements can also be by from actual environment model 15 and real ringThe object interaction in border, such as frame selects some things in actual environment, and with a virtual three-dimensional object 14 it is carried out withTrack.In running game, if the game is designed for conventional screen, two-dimensional analog device interface will be used.If the gameIt is virtual reality (VR), augmented reality (AR) or mixed reality (MR) game, three-dimensional primary interface will be used, wherein operation is emptyWhen quasi- reality game, user will be allowed to can only see the virtual scene of game, increased without using 4 picture of camera as rendering backgroundStrong feeling of immersion；
The microphone for wearing end installation can acquire the voice of user, carry out speech recognition and semantic analysis by the software of server-side,Show that corresponding operation is instructed and executed, when user carries out voice communication, microphone will be used as transmitter；
The gyroscope and acceleration transducer for wearing end can be used for controlling virtual camera in the orientation angle of three-dimensional space, thusRealize the function that certain virtual three-dimensional objects 14 do not follow the visual field mobile.Specific rocking action can also be considered as operational orderIt executes, such as nods and represent determination, representative of shaking the head is cancelled etc.；
Osteoacusis earpiece 9 on frame 2 is mainly used for playing the audio of voice communication and various prompt tones, when needing to play Gao Pin, can also be by 10 peripheral earphone of server-side, sound equipment when the contents such as music, video display, the sound effect of game of matter, and shield osteoacusis and listenCylinder 9, in addition, the outgoing loudspeaker for wearing end such as can be used for playing ring tone, play music outside at the audio for needing to be heard by the external world；
Vibrational feedback can be provided in the occasion in need such as incoming call, game by wearing the vibration motor inside end；
The fingerprint sensor at end is worn according to the specific moulding of product, finger when user closes downwards pedestal is mounted on and touches naturallyThe position arrived, so as to can quick release in the way closed；
The occasions such as the light for wearing end can be used for taking pictures, night illumination；
Wearing end has several keys, still needs to use when screen does not show content for operation power master switch, volume adjustment etc.Function.
Embodiment 2
The present embodiment the difference from embodiment 1 is that:
The end of wearing is equipped with depth camera and range sensor, and the outside for wearing end is equipped with for being worn on user handTracking ring on finger tracks the bluetooth module that ring includes position sensor and is connected with the bluetooth of server-side 10；
The surface of server-side 10 is equipped with pressure sensitivity Trackpad 16, and pressure sensitivity Trackpad 16 uses existing capacitance type touch-control panel and electricityAppearance formula pressure sensor component, the surface of server-side 10 can regard demand installation muti-piece pressure sensitivity Trackpad 16, rocking bar, physical buttonOr the display screen for showing electricity or two dimensional code.
The working principle of the invention: the depth camera and range sensor of setting can be improved more accurate instant fixedThe interference free performance and accuracy of identification of identification finger position can be improved in position data, the tracking ring of setting；
When user is in its surface touch, pressure sensitivity Trackpad 16 can enter position coordinates and the dynamics etc. of touch to 10 axis of server-sideGrade can be used for the functions such as keyboard input, cursor movement.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er QieIn the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matterFrom the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended powerBenefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claimsVariation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrappedContaining an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art shouldIt considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the artThe other embodiments being understood that.