Summary of the invention
The embodiment of the invention provides a kind of learning method and terminal based on augmented reality, by augmented reality data and veryReal contextual data, which carries out synthesis display, can be improved the interest of study, transfer the subjective enthusiasm of learner.
First aspect of the embodiment of the present invention discloses a kind of learning method based on augmented reality, comprising:
Start the scenery in camera scanning reality scene, obtains the image and three-dimensional feature of the scenery；
Determine target mode of learning, wherein the target mode of learning be and the matched study of target user's agesMode；
Request instruction is sent to augmented reality server, request and the target mode of learning and the sceneryThe matched augmented reality data model of three-dimensional feature；
Receive that the augmented reality server finds out with the matched augmented reality data mould of the request instructionType；
The image of the augmented reality data model and the scenery is synthesized, and by the information after synthesis in terminalDisplay screen on shown.
As an alternative embodiment, described carry out the image of the augmented reality data model and the scenerySynthesis, and before the information after synthesis is shown on the display screen of terminal, the method also includes:
Obtain the location of object information in the image of the scenery；
The image by the augmented reality data model and the scenery synthesizes, and the information after synthesis is existedIt is shown on the display screen of terminal, comprising:
The augmented reality data model, and the figure with the scenery are placed according to the location of object informationAs being synthesized, the information after synthesis is shown on the display screen of terminal.
As an alternative embodiment, described carry out the image of the augmented reality data model and the scenerySynthesis, and after the information after synthesis is shown on the display screen of terminal, the method also includes:
Downloading and the matched scene plot of the augmented reality data model from the augmented reality server；
Into the scene plot, to be interacted with the target user.
As an alternative embodiment, the method also includes:
Detect whether to receive the correction instruction of extraneous input, wherein the correction instruction include error message and withThe matched correct information of error message；
If receiving the correction instruction of extraneous input, the correction instruction is sent to the augmented reality server, withIt backs up the augmented reality server according to the correction instruction, and obtains the correct information, and to the endEnd sends the correct information；
The correct information that the augmented reality server is sent is received, the enhancing is updated according to the correct informationReal data model.
As an alternative embodiment, the method also includes:
Detect whether the location of object information in the image of the scenery changes；
If the location of object information changes in the image of the scenery, after object variationLocation information place the augmented reality data model, the display picture on display screen to update the terminal.
Second aspect of the embodiment of the present invention discloses a kind of terminal, comprising:
Camera unit obtains the image and three-dimensional of the scenery for starting the scenery in camera scanning reality sceneFeature；
Determination unit, for determining target mode of learning, wherein the target mode of learning be and target user's age levelSecondary matched mode of learning；
First transmission unit, for sending request instruction to augmented reality server, request and the target learnThe matched augmented reality data model of the three-dimensional feature of mode and the scenery；
First receiving unit, for receiving that the augmented reality server finds out and the matched institute of the request instructionState augmented reality data model；
Display unit is synthesized, for the image of the augmented reality data model and the scenery to be synthesized, and willInformation after synthesis is shown on the display screen of terminal.
As an alternative embodiment, the terminal further include:
Acquiring unit, the location of object information in the image for obtaining the scenery, and drive the synthesisDisplay unit spatial positional information according to locating for the object places the augmented reality data model, and with the sceneryImage synthesized, the information after synthesis is shown on the display screen of terminal.
As an alternative embodiment, the terminal further include:
Download unit, for the downloading from the augmented reality server and the matched field of augmented reality data modelScape plot；
Interactive unit, for entering the scene plot, to be interacted with the target user.
As an alternative embodiment, the terminal further include:
First detection unit, for detecting whether receiving the correction instruction of extraneous input, wherein the correction instruction packetInclude error message and with the matched correct information of the error message；
Second transmission unit, for when receiving the correction instruction of extraneous input, Xiang Suoshu augmented reality server to be sent outThe correction instruction is sent, so that the augmented reality server is backed up according to the correction instruction, and is obtained described correctInformation, and the correct information is sent to the terminal；
Second receiving unit, the correct information sent for receiving the augmented reality server；
First updating unit, for updating the augmented reality data model according to the correct information.
As an alternative embodiment, the terminal further include:
Second detection unit, whether the location of object information becomes in the image for detecting the sceneryChange；
Second updating unit, for when the location of object information changes in the image of the scenery, rootAccording to the location information placement augmented reality data model after object variation, on the display screen to update the terminalDisplay picture.
As can be seen from the above technical solutions, the embodiment of the present invention, which has the advantage that, scans real field by cameraScenery in scape obtains the image and three-dimensional feature of scenery；The determining and matched target mode of learning of target user's ages；The three-dimensional feature of request instruction, request and above-mentioned target mode of learning and above-mentioned scenery is sent to augmented reality serverMatched augmented reality data model；And receive that augmented reality server finds out it is existing with the matched enhancing of above-mentioned request instructionReal data model；The image of the augmented reality data model and scenery is synthesized, and by the information after synthesis in terminalIt is shown on display screen.Implement the embodiment of the present invention, augmented reality data and real scene data are carried out synthesis display canTo improve the interest of study, the subjective enthusiasm of learner is transferred.
Description and claims of this specification and term " first " in above-mentioned attached drawing, " second " and " third " are to useIn distinguishing different objects, not for description particular order.In addition, term " includes " and their any deformations, it is intended thatIt covers and non-exclusive includes.Such as it contains the process, method, system, product or equipment of a series of steps or units and does not limitDue to listed step or unit, but optionally further comprising the step of not listing or unit, or optionally further comprising it is rightIn the intrinsic other step or units of these process, methods, product or equipment.
Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information" seamless " integrated new technology, is the entity information that script is difficult to experience in the certain time spatial dimension of real world(visual information, sound, taste, tactile etc.) is superimposed after analog simulation again by science and technology such as computers, by virtual informationIt is applied to real world, is perceived by human sensory, thus reach the sensory experience of exceeding reality, abbreviation AR technology.It is oneKind completely new human-computer interaction technology can simulate true live landscape using a kind of such technology, it be with interactivity andIt is contemplated that the computer advanced man-machine interface of essential characteristic.In the environment of augmented reality, user can be true around seeingWhile real environment, it is seen that the enhancement information that computer generates.The information of this enhancing can be in true environment and trueThe dummy object of environmental coexistence is also possible to certain information about existing real-world object.
The embodiment of the invention provides a kind of learning method and terminal based on augmented reality, by augmented reality data and veryReal contextual data, which carries out synthesis display, can be improved the interest of study, transfer learner subjective enthusiasm and family it is mutualDynamic property of participation.
In the embodiment of the present invention, terminal includes operation Android operation system, iOS operating system, Windows operation systemThe terminal of system or other operating systems, such as mobile phone, removable computer, tablet computer, desktop computer, personal digital assistantThe terminals such as (Personal Digital Assistant, PDA), smartwatch, Intelligent bracelet, the embodiment of the present invention is subsequent not to be madeIt repeats.
Referring to Fig. 1, Fig. 1 is a kind of process signal of learning method based on augmented reality disclosed by the embodiments of the present inventionFigure.Wherein, the learning method of augmented reality shown in FIG. 1 may comprise steps of:
101: the scenery in starting camera scanning reality scene obtains the image and three-dimensional feature of scenery；
In the embodiment of the present invention, when using augmented reality, it is necessary first to start the camera in terminal to realityScenery in scene is scanned, and obtains the image of scenery, then can carry out necessary processing operation to the image of the scenery,Unwanted data are rejected as far as possible, may include that the operations such as image grayscale processing, binaryzation, feature extraction and contours extract obtainIt finds a view the three-dimensional feature of object.
102: determining target mode of learning, wherein above-mentioned target mode of learning is matched with target user's agesMode of learning；
In the embodiment of the present invention, a variety of modes of learning can be prestored in terminal, such as be suitble to the mode of studying medicine of child, be suitble toThe mode of learning of pupil is suitble to the mode of learning of junior school student, is suitble to the mode of learning of high school student, is suitble to the study mould of university studentFormula is suitble to the mode of learning etc. of the elderly, and user can select the mode of learning for being suitble to target user's ages in the terminal,Such as be suitble to the mode of learning of child to can be with the form of picture, animation etc. and replace text, it is suitble to the study mould of the elderlyFormula can be shown etc. with bigger font.
103: sending request instruction, request and above-mentioned target mode of learning and above-mentioned scape to augmented reality serverThe matched augmented reality data model of the three-dimensional feature of object；
In the embodiment of the present invention, the image and three-dimensional feature of the scenery in reality scene are obtained by step 101, passes through stepAfter rapid 102 have determined target mode of learning, can to augmented reality server request and above-mentioned target mode of learning withAnd the matched augmented reality data model of three-dimensional feature of above-mentioned scenery.
Wherein, augmented reality server judges augmented reality server after the request instruction for receiving terminal transmissionIn default feature database in whether there is and the matched default feature of the three-dimensional feature of above-mentioned scenery, and if it exists, then obtain and shouldThe default corresponding preset augmented reality data model for meeting above-mentioned target mode of learning of feature, specifically, default feature withPreset augmented reality data model is one-to-one relationship, and a default feature is corresponding with suitable all ages and classes levelUser augmented reality data model, augmented reality server by the feature in the three-dimensional feature of scenery and default feature database intoRow compares, and judges to whether there is and the matched default feature of the three-dimensional feature of scenery in default feature database.
Optionally, if in augmented reality server there is no with the matched default feature of the three-dimensional feature of scenery, by increasingStrong reality server is unsuccessfully prompted to terminal transmission, and prompting user, upload request instructs again.
104: receive that above-mentioned augmented reality server finds out with the matched above-mentioned augmented reality number of above-mentioned request instructionAccording to model；
In the embodiment of the present invention, augmented reality server is found out and the matched augmented reality data mould of above-mentioned request instructionAfter type, the augmented reality data model matched is sent to terminal.
Wherein, the augmented reality data model in augmented reality server can be preset completion by server quotient.
105: the image of above-mentioned augmented reality data model and above-mentioned scenery being synthesized, and the information after synthesis is existedIt is shown on the display screen of terminal.
It, will after terminal receives the augmented reality data model of augmented reality server transmission in the embodiment of the present inventionThe scene image in reality scene that the augmented reality data model is scanned with camera is synthesized, by augmented reality data mouldType projects in true scene, and the information after synthesis is shown on the display screen of terminal.Wherein, the mode of display canTo include superposition display mode, rendering display mode etc..
In the method depicted in fig. 1, the scenery in reality scene is scanned by camera, obtains the image and three of sceneryDimensional feature；The determining and matched target mode of learning of target user's ages；Request instruction is sent to augmented reality server,The matched augmented reality data model of three-dimensional feature of request and above-mentioned target mode of learning and above-mentioned scenery；And it receivesAugmented reality server find out with the matched augmented reality data model of above-mentioned request instruction；By the augmented reality data mouldThe image of type and scenery is synthesized, and the information after synthesis is shown on the display screen of terminal.It is real to implement the present inventionExample is applied, augmented reality data and real scene data, which are carried out synthesis display, can be improved the interest of study, transfer learnerSubjective enthusiasm.
Further, referring to Fig. 2, Fig. 2 is another study side based on augmented reality disclosed by the embodiments of the present inventionThe flow diagram of method.Wherein, the learning method of augmented reality shown in Fig. 2 may comprise steps of:
201: the scenery in starting camera scanning reality scene obtains the image and three-dimensional feature of scenery；
202: determining target mode of learning, wherein above-mentioned target mode of learning is matched with target user's agesMode of learning；
203: sending request instruction, request and above-mentioned target mode of learning and above-mentioned scape to augmented reality serverThe matched augmented reality data model of the three-dimensional feature of object；
204: receive that above-mentioned augmented reality server finds out with the matched above-mentioned augmented reality number of above-mentioned request instructionAccording to model；
205: obtaining the location of object information in the image of above-mentioned scenery；
206: above-mentioned augmented reality data model, and the figure with scenery are placed according to the location of above-mentioned object informationAs being synthesized, the information after synthesis is shown on the display screen of terminal；
It is alternatively possible to carry out the profile diagram that image procossing extracts object to the image of scenery, may thereby determine thatObject information the location of in scene image, and then can be according to above-mentioned location information by above-mentioned augmented reality data mouldType is placed in correct position, avoids augmented reality data model and target object location from mismatching and generate deviation, influences userUsage experience.
207: downloading and the matched scene plot of above-mentioned augmented reality data model from augmented reality server；
208: entering the scene plot, interacted with target user；
In the embodiment of the present invention, the scene image in augmented reality data model and real scene is subjected to synthesis displayIt afterwards, can downloading and the matched scene play of above-mentioned augmented reality data model from augmented reality server under the trigger of the userFeelings are interacted with entering the scene plot with user, may include that the form of dialogue, animation, music etc. is interacted, exampleOnline knowledge question, such as " this is clover, you know that it there are several leaves " can be such as carried out, is answered after user's observation" three pieces ", terminal receive the voice messaging of user, and after speech processes extraction characteristic information, determine that answer is correct, then" good clever, it is right to answer " is answered, it, can be by way of voice or video to this if user clicks interested objectObject makes detailed introduction, transfers the learning initiative of user.
209: detecting whether to receive the correction instruction of extraneous input, wherein above-mentioned correction instruction include error message withAnd with the matched correct information of the wrong data；
In the embodiment of the present invention, if user can pass through boundary there are error message in the augmented reality data model of loadFeedback button in face inputs correction instruction, can also input correction instruction by voice, or click directly on the module of mistakeCorrection instruction etc. is inputted, which kind of mode is specifically used, the embodiment of the present invention does not make uniqueness restriction.
210: if receiving the correction instruction of extraneous input, above-mentioned correction instruction is sent to augmented reality server, withIt backs up augmented reality server according to above-mentioned correction instruction, and obtains above-mentioned correct information, and sending to terminal shouldCorrect information；
211: receiving the correct information that augmented reality server is sent, above-mentioned augmented reality number is updated according to the correct informationAccording to model；
After terminal receives the correction instruction of extraneous input, the correction instruction is sent to augmented reality server, wherein entangleMistake instruction in carry error message and with the matched correct information of the error message, meanwhile, augmented reality server receiveTo after correction instruction, above-mentioned correction instruction is backed up, similar situation is avoided to occur again, and correct data model is sent outTerminal is given, so that terminal updates the error section in above-mentioned augmented reality data model according to the correct data model.
212: detecting whether the location of object information in the image of scenery changes；
213: if the location of object information changes in the image of scenery, the position after being changed according to objectConfidence breath places above-mentioned augmented reality data model, with the display picture on the display screen of more new terminal.
In the embodiment of the present invention, the location information of object in the picture may result in due to shake of user etc.Variation is sent, the display picture on display screen can be updated by obtaining the new location information of object in the picture at this time.
As an alternative embodiment, scene can be obtained through the above steps if photographed changesAugmented reality data model after variation realizes that scene is synchronous with augmented reality data model.
As an alternative embodiment, after obtaining augmented reality data model, it can also be to the augmented realityData model is stored, to realize augmented reality experience of the terminal under off-line state.
It can be seen from the description of above-described embodiment in practical applications, the embodiment of the present invention can be completed following completelyEnhancing content information shows: it is possible, firstly, to (for example, spending, be moved by the camera of terminal in kind using augmented realityObject etc.) picture sampling acquisition three-dimensional feature information is carried out, and the study mould of suitable target user's ages is determined in terminalFormula (for example, picture, animation form etc.), then the three-dimensional feature information for the scenery that is taken is automatically uploaded to augmented reality by terminalServer.Then, knowledge can be compared with the characteristic information in system features library in obtained three-dimensional feature information by server(it is not related to image recognition algorithm), if successful match, the three-dimensional feature pair with the scenery can be found in systemsThe augmented reality data model of the mode of learning for the suitable target user's ages answered simultaneously returns to terminal, and terminal is receivingAfter augmented reality data model, synthesis is carried out on the display screen of terminal with the scene image shot in reality scene and is shown.Finally, being interacted by the speech interface in terminal with user.
Referring to Fig. 3, Fig. 3 is a kind of structural schematic diagram of terminal disclosed by the embodiments of the present invention, as shown in figure 3, the endEnd may include:
Camera unit 301, for starting the scenery in camera scanning reality scene, image and the three-dimensional for obtaining scenery are specialSign；
Determination unit 302, for determining target mode of learning, wherein above-mentioned target mode of learning is and target user yearThe mode of learning of age multilevel matching；
First transmission unit 303, for sending request instruction, request and above-mentioned determining list to augmented reality serverThe matched augmented reality of three-dimensional feature for the scenery that the target mode of learning and above-mentioned camera unit 301 that member 302 determines obtainData model；
First receiving unit 304 is sent out for receive that augmented reality server finds out with above-mentioned first transmission unit 303The matched augmented reality data model of the request instruction sent；
Synthesize display unit 305, for by the received augmented reality data model of above-mentioned first receiving unit 304 with it is above-mentionedThe image for the scenery that camera unit 301 obtains is synthesized, and the information after synthesis is shown on the display screen of terminal.
Referring to Figure 4 together, Fig. 4 is the structural schematic diagram of another terminal disclosed by the embodiments of the present invention.Wherein, Fig. 4Shown in terminal be that terminal as shown in Figure 3 optimizes, compared with terminal shown in Fig. 3, above-mentioned terminal further include:
Acquiring unit 306, the location of object information in the image for obtaining scenery, and drive above-mentioned synthesis aobviousShow that unit 305 is placed according to the location of above-mentioned object information by the received augmented reality of above-mentioned first receiving unit 304Data model, and the image of the scenery obtained with above-mentioned camera unit 301 is synthesized, by the information after synthesis in the aobvious of terminalIt is shown in display screen.
It wherein, can be to avoid augmented reality data model and the unmatched situation of reality scene by acquiring unit 306.
Optionally, in terminal shown in Fig. 4, which can also include:
Download unit 307, for the downloading from augmented reality server and the above-mentioned matched field of augmented reality data modelScape plot；
Interactive unit 308, for entering above-mentioned scene plot, to be interacted with target user.
Wherein, the purpose interacted with target user may be implemented by download unit 307 and interactive unit 308,Enhance the interest of study.
Optionally, in terminal shown in Fig. 4, which can also include:
First detection unit 309, for detecting whether receiving the correction instruction of extraneous input, wherein above-mentioned error correction refers toEnable include error message and with the matched correct information of the error message；
Second transmission unit 310, for being to receive entangling for extraneous input in above-mentioned 309 testing result of first detection unitWhen mistake instruction, the correction instruction is sent to augmented reality server, so that augmented reality server is carried out according to the correction instructionBackup, and above-mentioned correct information is obtained, and send the correct information to terminal；
Second receiving unit 311, for receiving the true according to above-mentioned second transmission unit 310 of augmented reality server transmissionFixed correct information；
First with new unit 312, and the correct information for being sent according to above-mentioned second receiving unit 311 updates augmented realityData model.
Wherein, pass through first detection unit 309, the second transmission unit 310, the second receiving unit 311 and with new unit312 can be in the augmented reality data model of load there are carrying out error correction when error message, while server is to error messageIt is backed up, avoids next sounding similar situation.
Optionally, in terminal shown in Fig. 4, which can also include:
Whether second detection unit 313 occurs for the location of object in the image for detecting scenery informationVariation；
Second updating unit 314, for when the location of object information changes in the image of scenery, according toLocation information after object variation places above-mentioned augmented reality data model, with the display picture on the display screen of more new terminalFace.
Wherein, it can be changed in the position of object by second detection unit 313 and the second updating unit 314When, the display picture on real-time update terminal display screen.
Referring to Fig. 5, Fig. 5 is the structural schematic diagram of another terminal disclosed by the embodiments of the present invention, as shown in figure 5, shouldTerminal may include:
Input unit 501, processor unit 502, output unit 503, storage unit 504, communication unit 505, cameraThe components such as 506 and power supply 507.These components are communicated by one or more bus 508.Those skilled in the art can be withUnderstand, the structure of terminal shown in fig. 5 does not constitute a limitation of the invention simultaneously, it is also possible to either bus topologyHub-and-spoke configuration can also include component more more or fewer than structure shown in fig. 5, perhaps combine certain components or differenceComponent layout.In embodiments of the present invention, terminal shown in fig. 5 includes but is not limited to mobile phone, removable computer, plateThe various terminals such as computer, personal digital assistant (Personal Digital Assistant, PDA).
Input unit 501 is for realizing the interaction of user and terminal and/or information input into terminal.Of the invention specificIn embodiment, input unit 501 can be touch panel, and touch panel is also referred to as touch screen or touch screen, collect userTouch or close operational motion on it.For example user uses any suitable objects or attachment such as finger, stylus in touch-controlOperational motion on panel or close to touch panel position, and corresponding attachment device is driven according to preset formula.It canChoosing, touch panel may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detects userTouch operation, and the touch operation that will test is converted to electric signal, and sends electric signal to touch controller；It touchesController receives electric signal from touch detecting apparatus, and is converted into contact coordinate, then gives processor unit 502.TouchingThe order and execution that processor unit 502 is sent can also be received by touching controller.Furthermore, it is possible to using resistance-type, condenser type, redThe multiple types such as outside line (Infrared) and surface acoustic wave realize touch panel.
Processor unit 502 is the control centre of terminal, utilizes each portion of various interfaces and the entire terminal of connectionPoint, by running or execute the program code being stored in storage unit 504 and/or module, and call that be stored in storage singleData in member 504, to execute the various functions and/or processing data of terminal.Processor unit 502 can be by integrated circuit(Integrated Circuit, abbreviation IC) composition, such as the IC that can be encapsulated by single are formed, can also be by more of connectionThe encapsulation IC of identical function or different function and form.For example, processor unit 502 can only include central processing unit(Central ProcessingUnit, abbreviation CPU) is also possible to CPU, digital signal processor (digital signalProcessor, abbreviation DSP), in graphics processor (Graphic Processing Unit, abbreviation GPU) and communication unitControl the combination of chip (such as baseband chip).In embodiments of the present invention, CPU can be single operation core, also can wrapInclude multioperation core.
Output unit 503 can include but is not limited to image output unit, sound output and sense of touch output unit.Image is defeatedUnit is used for output character, picture and/or video out.Image output unit may include display panel, for example, by using liquid crystal displayDevice (Liquid Crystal Display, LCD), Organic Light Emitting Diode (Organic Light-Emitting Diode,OLED), the forms such as Field Emission Display (field emission display, abbreviation FED) are come the display panel that configures.OrImage output unit may include reflected displaying device, such as electrophoresis-type (electrophoretic) display, or dry using lightRelate to the display of modulation tech (Interferometric Modulation of Light).Image output unit may includeIndividual monitor or various sizes of multiple displays.In a specific embodiment of the invention, above-mentioned input unit 501 is adoptedThe touch panel used also can be simultaneously as the display panel of output unit 503.Although input unit 501 and output are single in Fig. 5Member 503 is the function that outputs and inputs of realizing terminal as two independent components, but in some embodiments it is possible to willTouch panel and display panel are integrated and that realizes terminal output and input function.
Storage unit 504 can be used for storing program code and module, and processor unit 502 is stored in storage by operationThe program code and module of unit 504, thereby executing the various function application and realization data processing of terminal.Storage unit504 mainly include program storage area and data storage area, wherein program storage area can storage program area, at least one functionRequired program code；Data storage area, which can be stored, uses created data (such as audio data, phone directory according to terminalDeng) etc..In the specific embodiment of the invention, storage unit 504 may include volatile memory, such as non-volatile dynamicRandom access memory (Nonvolatile RandomAccess Memory, abbreviation NVRAM), phase change random access memory(Phase Change RAM, abbreviation PRAM), magnetic-resistance random access memory (Magetoresistive RAM, abbreviation MRAM)Deng can also include nonvolatile memory, a for example, at least disk memory, electronics can erase can plan read-only storageDevice (Electrically Erasable ProgrammableRead-OnlyMemory, abbreviation EEPROM), flush memory device, exampleSuch as anti-or flash memory (NOR flash memory) or anti-and flash memory (NAND flash memory).Nonvolatile storage storageOperating system performed by processor unit 502 and program code.Processor unit 502 is from nonvolatile storage load operating journeySequence and data are stored in mass storage to memory and by digital content.Operating system includes for controlling and managing routineSystem task, such as memory management, storage equipment control, power management etc., and help to communicate between various software and hardwaresVarious assemblies and/or driver.In embodiments of the present invention, operating system can be Google company android system,The iOS system of Apple company exploitation or Windows operating system etc. or Vxworks of Microsoft Corporation exploitation thisThe embedded OS of class.
Communication unit 505 makes terminal be connected to remote server by communication channel for establishing communication channel, and from remoteJourney server downloads of media data.Communication unit 505 may include WLAN (Wireless Local AreaNetwork, abbreviation wireless LAN) module, bluetooth module, wireless near field communication (Near FieldCommunication, abbreviation NFC), wireless communication modules and the Ethernet, universal serial bus such as base band (Base Band) module(Lightning, Apple is set for iPhone6/6s etc. at present for (Universal Serial Bus, abbreviation USB), lightning interfaceIt is standby) etc. wire communication modules.
Camera 506 is for shooting reality scene.Camera can be divided into digital camera and simulation camera twoMajor class.The analog video signal of acquisition can be converted into digital signal by digital camera, and then is stored in terminal.MouldThe vision signal that quasi- camera captures has to pass through specific capure card and converts analog signals into figure pattern, and addsIt is used with just may switch in terminal after compression.Digital camera can directly capture image, and camera is substantially with number at presentBased on word camera.Camera generally has the basic functions such as video camera/propagation and still image capture, it is by camera lensAfter acquiring image, by camera photosensory assembly circuit and control assembly image is carried out being processed and converted to terminal to knowThen other digital signal carries out image restoring by terminal.
Power supply 507 is used to be powered to the different components of terminal to maintain its operation.Understand as generality, power supply507 can be built-in battery, such as common lithium ion battery, nickel-metal hydride battery etc., also include directly to the outer of terminal power supplyConnect power supply, such as AC adapter etc..In certain embodiments of the present invention, power supply 507 can also be made more widely to define,It such as can also include power-supply management system, charging system, power failure detection circuit, power adapter or inverter, power supplyPositioning indicator (such as light emitting diode), and generate with the electric energy of terminal, manage and be distributed other associated any components.
In terminal device shown in Fig. 5, processor unit 502 can call the program generation stored in storage unit 504Code, for performing the following operations: starting camera 506 scans the scenery in reality scene, and image and the three-dimensional for obtaining scenery are specialSign；Determine target mode of learning, wherein above-mentioned target mode of learning be and the matched mode of learning of target user's ages；Send request instruction to augmented reality server by communication unit 505, request and above-mentioned target mode of learning and onState the matched augmented reality data model of three-dimensional feature of scenery；Augmented reality server is received by communication unit 505 to searchOut with the matched augmented reality data model of above-mentioned request instruction；By the figure of above-mentioned augmented reality data model and above-mentioned sceneryAs being synthesized, and the information after synthesis is shown on the display screen of terminal.
As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504Code, synthesizes by the natural image of above-mentioned augmented reality data model and above-mentioned scenery, and by the information after synthesis at endBefore being shown on the display screen at end, it is also used to execute following steps:
Obtain the location of object information in the image of scenery；To according to the location of above-mentioned object informationAbove-mentioned augmented reality data model is placed, and is synthesized with the image of above-mentioned scenery, by the information after synthesis in the aobvious of terminalIt is shown in display screen.
As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504Code, synthesizes by the image image of above-mentioned augmented reality data model and above-mentioned scenery, and by the information after synthesis at endAfter being shown on the display screen at end, it is also used to execute following steps:
Downloading and the matched scene plot of above-mentioned augmented reality data model from augmented reality server；
Into scene plot, to be interacted with target user.
As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504Code, is also used to execute following steps:
Detect whether to receive the correction instruction of extraneous input, wherein above-mentioned correction instruction include error message and withThe matched correct information of error message；If receiving the correction instruction of extraneous input, pass through communication unit 505 to enhancingReal server sends the correction instruction so that augmented reality server is backed up according to correction instruction, and obtain it is above-mentioned justIt firmly believes breath, and sends above-mentioned correct information to terminal；The above-mentioned of augmented reality server transmission is received by communication unit 505Correct information updates augmented reality data model according to above-mentioned correct information.
As another optional embodiment, processor unit 502 calls the program generation stored in storage unit 504Code, is also used to execute following steps:
Detect whether the location of object information in the image of above-mentioned scenery changes；If the image of above-mentioned sceneryThe location of middle object information changes, then it is existing to place above-mentioned enhancing according to the location information after the variation of above-mentioned objectReal data model, with the display picture on the display screen of more new terminal.
In the terminal depicted in fig. 5, augmented reality data are carried out synthesis display with real scene data can be improvedThe interest of study transfers the subjective enthusiasm of learner.
Referring to Fig. 6, Fig. 6 is a kind of system structure of learning method based on augmented reality disclosed by the embodiments of the present inventionSchematic diagram, as shown in fig. 6, including augmented reality server 601, terminal 602；
Terminal 602 obtains the image and three-dimensional feature of scenery for starting the scenery in camera scanning reality scene；Determine target mode of learning, wherein above-mentioned target mode of learning be and the matched mode of learning of target user's ages；Xiang ZengStrong reality server 601 sends the three-dimensional feature of request instruction, request and above-mentioned target mode of learning and above-mentioned sceneryMatched augmented reality data model；Receive augmented reality server 601 find out with the matched enhancing of above-mentioned request instructionReal data model；Obtain the location of object information in the image of scenery；Believed according to the location of above-mentioned objectBreath places above-mentioned augmented reality data model, and is synthesized with the image image of above-mentioned scenery, by the information after synthesis at endIt is shown on the display screen at end；Downloading and the matched scene of above-mentioned augmented reality data model are acute from augmented reality serverFeelings；Into scene plot, to be interacted with target user；It detects whether to receive the extraneous correction instruction inputted, wherein onState correction instruction include error message and with the matched correct information of the error message；If receiving the error correction of extraneous inputInstruction, then to augmented reality server 601 send the correction instruction so that augmented reality server 601 according to correction instruction intoRow backup, and above-mentioned correct information is obtained, and send above-mentioned correct information to terminal 602；Augmented reality server 601 is received to send outThe above-mentioned correct information sent updates augmented reality data model according to above-mentioned correct information；Detect mesh in the image of above-mentioned sceneryWhether the location of mark object information changes；If the location of object information becomes in the image of above-mentioned sceneryChange, then above-mentioned augmented reality data model is placed according to the location information after the variation of above-mentioned object, with the display of more new terminalDisplay picture on screen.
Augmented reality server 601, for receiving the request instruction of the transmission of terminal 602；It searches and above-mentioned request instructionThe augmented reality data model matched；Above-mentioned augmented reality data model is sent to terminal 602；Receive the error correction that terminal 602 is sentInstruction；Backed up according to above-mentioned correction instruction, and obtain with the matched correct information of above-mentioned error message, and to terminal 602Send the correct information.
It is worth noting that, included each unit is only carried out according to function logic in the embodiment of above-mentioned terminalIt divides, but is not limited to the above division, as long as corresponding functions can be realized；In addition, the tool of each functional unitBody title is also only for convenience of distinguishing each other, the protection scope being not intended to restrict the invention.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodimentPoint, reference can be made to the related descriptions of other embodiments.
In addition, those of ordinary skill in the art will appreciate that realizing all or part of the steps in above-mentioned each method embodimentIt is that relevant hardware can be instructed to complete by program, corresponding program can store in a kind of computer readable storage mediumIn, storage medium mentioned above can be read-only memory, disk or CD etc..
The above is only the preferable specific embodiments of the present invention, but scope of protection of the present invention is not limited thereto, anyThose familiar with the art the variation that can readily occur in or replaces in the technical scope that the embodiment of the present invention disclosesIt changes, should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claimSubject to enclosing.