Invention content
In view of this, it is an object of the present invention to provide a kind of reading method based on augmented reality, behaviourMake simplicity, user can be given and have more the sense of reality, and interactive good experience.
To achieve the goals above, technical solution provided by the invention is as follows：
A kind of reading method based on augmented reality, including：
Image, and at least selected frame images above being ingested in image are taken in image acquisition units,
And more than one visual marker is loaded on chosen image, it allows users to touch by selected and pointOne of those above visual marker, to which output is at least obtaining the clothes of resource corresponding with chosen visual markerIt is engaged in asking and/or at least executes the selected control instruction acted to make to select functional unit.
Further, this method may also include：One of those above visual marker is touched by selected and point, to obtainTake and/or play multimedia resource corresponding with chosen visual marker.
Further, this method may also include：One of those above visual marker is touched by selected and point, to defeatedGo out control instruction corresponding with chosen visual marker, selected equipment is made to execute selected action, and/or, receive to select equipmentOutput, corresponding with chosen visual marker feedback signal.
Further, this method may also include：
Examination is ingested image, and the selected image for wherein include specific identification information, and adds on chosen imageCarry more than one visual marker.
As one of wherein optional embodiment, this method may also include：
According to the specific identification information, multimedia resource corresponding with chosen image is obtained, and the multimedia providesThere is also correspondences between the visual marker of source and load on chosen image.
Further, this method may include：
It is shot with image acquisition units and/or scans true or dummy object, to take in image；
Alternatively, the image data of computer-reader form is received with image acquisition units, to take in image.
As more one of preferred embodiment, this method further includes：Load is corresponding on chosen image increasesStrong reality view.
Further, this method may also include：At least by chosen image and/or more matchmakers corresponding with chosen imageBody resource is stored in local and/or high in the clouds storage unit.
As the typical embodiment case of one of which, it is somebody's turn to do the reading method based on augmented reality and may include walking as followsSuddenly：
S1. more than one printed articles and more than one multimedia resources are provided, and in selected printed article and selected multimediaCorrespondence is established between resource；
S2. a printed article is selected, and obtains multimedia resource corresponding with the printed article；
S3. the image for selecting the page in the printed article is taken in image acquisition units, and is loaded on the image of the pageMore than one visual marker；
S4. it selectes and puts and touch one of those above visual marker, it is corresponding to chosen visual marker to playMultimedia resource.
Another object of the present invention is to provide a kind of point-of-reading systems based on augmented reality comprising：
Image acquisition units, at least taking in image；
Point reads unit, at least to screen and select the frame images above being ingested in image, and in chosen imageUpper more than one visual marker of load allows users to touch one of those above visual marker by selected and point, fromAnd it exports at least to the service request that obtains resource corresponding with chosen visual marker and/or at least making selected work(It can the selected control instruction acted of unit execution.
Functions described herein unit can be selected from certain physical machines by electric drive, hydraulic-driven or air stream drivesTool etc. also can be certain virtual units, and without being limited thereto.
Further, described image collecting unit includes：
Can captured in real-time and/or scanning is true and/or dummy object, and obtain the element of image,
Alternatively, the image data of computed readable form can be received, to obtain the element of image.
Further, it is integrally disposed in a terminal to read unit for described image collecting unit and point,
Alternatively, described image collecting unit and point read discrete units setting, and connected through communication module.
As one of optional embodiment, the point-of-reading system may also include：
Storage unit is at least deposited to store the image being ingested and/or multimedia resource corresponding with chosen imageIt is stored in local and/or high in the clouds.
Further, the point reading unit includes：
Display unit, at least to show the image being ingested,
Data processing unit, at least to from screening and selected be ingested more than the frame in image in the image being ingestedImage, and more than one visual marker is loaded on chosen image, and the tactile operational order of point of user is received and handles,To realize multimedia acquisition and/or broadcasting,
And touch control operation unit, at least with allowing the user to touch more than one visual marker by selected and pointAnd send out a little tactile operational order.
As more one of preferred embodiment, the display unit and touch control operation unit are integrally disposed in a touch-controlIn display unit.
Further, it includes finger touching operation, gesture identification operation, mouse touching behaviour that the point in this method, which touches mode,Make, pen operation or the touching operation of class object can be touched, but not limited to this.
Further, the multimedia resource is at least selected from character, document, figure, audio, video, dummy model or superGrade link, but not limited to this.
Further, the multimedia resource may also include augmented reality view.
Further, described image collecting unit includes image camera-shooting and recording device（Such as camera, video camera, camera）OrScanner.
Compared with prior art, the present invention at least has the advantages that：By using the enhancing based on image recognitionReality technology, can by arbitrary books, object or scene combination diversified forms multimedia messages and show, to give userMore good and interactive experience.
Specific implementation mode
In order to make those skilled in the art more fully understand the technical solution in the present invention, below in conjunction with of the invention realThe attached drawing in example is applied, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described implementationExample is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is commonThe every other embodiment that technical staff is obtained without making creative work, should all belong to protection of the present inventionRange.
One aspect of the present invention provides a kind of reading method based on augmented reality, including：
Image, and at least selected frame images above being ingested in image are taken in image acquisition units,
And more than one visual marker is loaded on chosen image, it allows users to touch by selected and pointOne of those above visual marker, to which output is at least obtaining the clothes of resource corresponding with chosen visual markerIt is engaged in asking and/or at least executes the selected control instruction acted to make to select functional unit.
Another aspect provides a kind of point-of-reading systems based on augmented reality comprising：
Image acquisition units, at least taking in image；
Point reads unit, at least to screen and select the frame images above being ingested in image, and in chosen imageUpper more than one visual marker of load allows users to touch one of those above visual marker by selected and point, fromAnd it exports at least to the service request that obtains resource corresponding with chosen visual marker and/or at least making selected work(It can the selected control instruction acted of unit execution.
Wherein, as a kind of feasible embodiment, the present invention can be by being shot with image acquisition units and/or being scannedTrue or dummy object, to take in image.
It more specifically says, process may include：With with entity image camera-shooting and recording device or scanning device shooting orTrue or dummy object is scanned, for example, picture, books, model or certain scenes, to take in image；
Alternatively, shot with virtual image camera-shooting and recording device or scanning device or scan dummy object, to take in image, thisKind mode can be applied in the virtual environments such as online game.
Wherein, typical described image collecting unit may include image camera-shooting and recording device（Such as camera, video camera, photographMachine etc.）, scanner etc., but not limited to this.
And as another feasible embodiment, the present invention also can be computer-readable by being received with image acquisition unitsThe image data of form, to take in image.
In other words, the present invention can also belong to or the non-true or virtual image for belonging to point-of-reading system of the present invention takes in equipmentOr after scanning device obtains image, the image acquisition units of the present invention are transmitted further to, to complete the intake of image.
This embodiment is particularly suitable to need to obtain image from distal end, and needs to read in the point for locally completing point read operationSystem needs to carry out particular device, place for example, in the special occasions operation such as mine, construction site, sea or spaceTelesecurity monitors or the situation of operation.
Obvious, to reach such purpose, it usually needs read that communication is arranged between unit in image acquisition units and pointModule enables the rwo to realize interaction of data etc..
Further, the selection standard of particular picture can be pre-established in the present invention, for example, can prespecified instituteThe specific identification information that should include in the picture to be chosen, for example, specific word or code（Such as bar code, Quick Response Code）, it is specialWhether fixed graphic structure etc. then, can be by differentiating in image comprising above-mentioned after image acquisition units take in imageSpecific identification information therefrom selectes required image.
Further, after selecting out required image, visual marker can be directly loaded on this image, whereinAccording to the difference of image, the quantity of visual marker, form and distributing position on the image can respective changes.
It, can also be after selecting out required image, according to the image and as more one of preferred embodimentIncluding specific identification information, corresponding augmented reality view is loaded on the image first, for example, threedimensional model, video, dynamicDraw etc., visual marker is then reloaded, it is of course also possible to load the augmented reality approach and visual marker simultaneously.
Wherein, visual marker can be word, figure（Such as, circle, rectangle, polygon or other arbitrary irregular shapesThe figure of state）, three-dimensional model or dynamic marks, and it is without being limited thereto.
As wherein more one of preferred embodiment, aforementioned visual marker can also be with it is contained on selected digital imageThe same or similar figure such as some figures, label, label etc..For example, when taking in a certain authentic item in real time with camera etc.（For example, a certain books）Specific image（For example, the image of certain one page or the image at a certain visual angle, and exist in the pictureOne or more label, for example, the video markers such as the audio indicias such as toy trumpet, video camera）When, then it can add on the specific imageCarry visual marker identical as the mark position on the specific image, homomorphosis（For example, toy trumpet shape, video camera shape canIt is marked depending on changing）, in this way, user extremely convenient can differentiate, choose and play the multimedia resource etc. corresponding to visual marker.
Further, method of the invention may also include：One of those above visual marker is touched by selected and point,To obtain and/or play multimedia resource corresponding with chosen visual marker.
Further, it can in advance be obtained corresponding to specific image according to specific identification information above-mentioned in the present inventionMultimedia resource, and make between the visual marker of the multimedia resource and load on chosen image that there is also correspondingRelationship.
The link information for obtaining corresponding multimedia resource or request are used alternatively, can also be loaded in visual marker,And when point touches visual marker, activate the link information or request, to from local and/or high in the clouds storage unit obtain withPlay multimedia resource.
Therefore, as a more preferred embodiment, it may also include local and/or high in the clouds in point-of-reading system of the inventionStorage unit, or also can be local server and/or cloud server.
Also, it is further, in the present invention, can also at least by chosen image and/or with chosen image phaseThe multimedia resource answered is stored in local and/or high in the clouds storage unit.
By previous designs so that point-of-reading system of the invention at least has there are two types of operating mode, including：
1, work online pattern：Image is taken in real time by image acquisition units, and is loaded on image selected whereinVisable indicia, user touch visable indicia by point, obtain in real time, play multimedia resource；
2, work offline pattern：It has access to and is stored in local chosen image, and load visable indicia on selected digital image,User touches visable indicia by point, plays be stored in local multimedia resource in real time.
Further, it is aforementioned work offline pattern on the basis of, can also derive sleep operation mode etc., that is, useFamily is stored in local specific image having access to, and puts the visable indicia for touching and loading on the specific image, you can makes a little to touch and isSystem voluntarily plays and is stored in local a certain type or the multimedia resource of certain several types.
As more one of preferred embodiment, described image collecting unit and point reading unit can be integrally disposed whole in oneIn end.
As one of optional embodiment, the point reads unit and may include：
Display unit, at least to show the image being ingested,
Data processing unit, at least to from screening and selected be ingested more than the frame in image in the image being ingestedImage, and more than one visual marker is loaded on chosen image, and the tactile operational order of point of user is received and handles,To realize multimedia acquisition and/or broadcasting,
And touch control operation unit, at least with allowing the user to touch more than one visual marker by selected and pointAnd send out a little tactile operational order.
As more one of preferred embodiment, the display unit and touch control operation unit are integrally disposed in a touch-controlIn display unit.
Further, in one embodiment of the invention, which may also include：It is touched by selected and pointIn more than one visual marker make to select equipment and hold to export corresponding with chosen visual marker control instructionThe selected action of row, and/or, equipment output, corresponding with chosen visual marker feedback signal is selected in receiving.
For example, for certain mechanical equipments for needing remote control, the design being related to by foregoing embodiments, then,The image of corresponding mechanical equipment can be taken in real time by certain image camera-shooting and recording devices in local, and controllers pass through remote controlEquipment（Such as, computer system）It is especially corresponding by specific position of the remote control equipment on image after obtaining corresponding imageVisable indicia is loaded in the position of specific position or one or more buttons on the control panel of corresponding mechanical equipment, controls peopleWorking condition of the member according to shown mechanical equipment in image, can accordingly select and put it is tactile wherein some or it is several can sighting targetNote to send out control instruction, and adjusts the working condition of mechanical equipment in distal end.
The point-of-reading system of the present invention can be realized on each Terminal Type that those skilled in the art note, for example, can be usualSmart mobile phone, the tablet computer used, PC, the equipment that smart television, Google glasses etc. have multimedia function, but it is unlimitedIn this.
Further, it includes finger touching operation, gesture identification operation, mouse touching behaviour that the point in this method, which touches mode,Make, pen operation or the touching operation of class object can be touched, but not limited to this.
Further, the multimedia resource is at least selected from character, document, figure, audio, video, dummy model or superGrade link, but not limited to this.
Further, the multimedia resource may also include augmented reality view.
Technical scheme of the present invention is more specifically illustrated below in conjunction with attached drawing and exemplary embodiments.
Refering to fig. 1, in the exemplary embodiments of the present invention, the reading method being related to may include steps of：
（1）User chooses books, and shoots with video-corder the selected page in books in real time with image camera-shooting and recording device, makes the selected pageImage（It can be single-frame images, can also be that the multiple image continuously displayed forms dynamic image or video）Real-time display is in oneOn display screen；
（2）Emerge more than one visual marker automatically on the image of the selected page（That is, touch point）；
（3）User touches one of those above visual marker by putting successively, realizes corresponding to each visual marker moreThe broadcasting of media information, including word, figure, three-dimensional model, video, audio etc..
Further, in another embodiment of the invention, as shown in fig.2, a kind of its point-of-reading system for being related to can be withIncluding：
Camera 10 is taken in the teaching material by the intelligent point-reading system camera and is appointed for obtaining image informationOne or more anticipate to obtain image information, which includes arbitrary one page and/or character and/or any one illustrationAnd/or multiple illustrations and/or one-dimension code and/or Quick Response Code and/or one or more in kind；
Point reads unit, including：
Image processing unit 20 for handling image information, and is transferred to local storage unit and is stored,
Image processing unit 20 is specifically used for：Intake and analysis described image information go forward side by side row matrixization processing, the squareArray processing is specially the image information at standard by the correction of the image information of distortion or deformation；
Multi-media processing unit 30, for handling multimedia resource, processing it is various for learn and/or display and demonstration and/Or interactive and/or amusement multimedia resource, multimedia resource include 3D models and resource and/or 2D models and resource and/orPicture and/or button and/or video and/or audio and/or character；
Touch-control processing unit 40, every interactive operation for receiving and handling outer bound pair multimedia resource, interactive operationIt touches and operates including finger, gesture identification operation, mouse touching operation can touch pen operation, the touching operation of class type objects etc.Other external operations；
Local storage unit 50, for image information, multimedia resource, interactive operation to be locally stored；
Local processing unit 60 carries out logical operation for the information to local storage unit, and logical operation includes localChange logical operation and online logical operation, specially：
Logical operation is localized, local processing unit is combined according to image processing unit treated image information to be originally located inUnit searches are managed to corresponding multimedia resource, and a reading logical analysis is carried out to multimedia resource, it will further according to a reading logicInteractive operation corresponding to touch-control processing unit is associated with corresponding multimedia resource, is finally completed a read operation；
Online logical operation, local processing unit according to image processing unit treated image information request server atReason unit carries out the down operation of corresponding multimedia resource, and carries out storage operation by local storage unit, by localProcessing unit carries out a reading logical analysis to the multimedia resource downloaded, further according to reading logic that touch-control processing unit institute is rightThe interactive operation answered is associated with corresponding multimedia resource, is finally completed a read operation.
Local processing unit 60 can be additionally used in：
Augmented reality real-time tracing overlap-add operation is carried out to multimedia resource by image processing unit, and at combination of touch controlReason unit carries out 360 degree of touch control operations to the multimedia resource that augmented reality real-time tracing is superimposed.
Server processing unit 70, the respective services request for responding local processing unit transmission.
Server storage unit 80, for storing image information and multimedia resource.
Further, the number that the sampling of local processing unit 60 and processing local storage unit 50 are stored in present embodimentAccording to, and the server processing unit 70 and server storage unit 80 are uploaded, for intelligent point-reading system to popular and/or warpThe push of allusion quotation and/or other the targetedly teaching materials and multimedia resource such as interesting and/or beneficial.
Correspondingly, a kind of reading method realized based on image recognition augmented reality provided in this embodiment can wrapInclude following steps：
S1, camera obtain image information, and image processing unit and multi-media processing unit handle image information,It obtains multimedia resource and is stored in server storage unit, user downloads the multimedia resource of required point reading extremely as neededLocal storage unit；
There are the pages of intelligent point-reading resource in S2, local processing unit scanning multimedia resource, if including on the pageDo the touch points for interactive operation；
Touch points position on S3, the touching page, local processing unit carry out logical analysis, are touched in touch-control processing unitTouch event is sent out, shows corresponding multimedia messages.
Further, step S1 includes：
The existing multimedia resource list of automatic refresh requests, is all listed in systems；
The specified multimedia resource of user's selection, with obtaining the download of the corresponding intelligent point-reading resource of the multimedia resourceLocation, and resource is downloaded automatically；
Intelligent point-reading resource downloading finishes, automatically use the built-in camera based on image recognition augmented reality intoRow outdoor scene scans.
Further, step S2 includes：
The multimedia resource is turned to the page for possessing intelligent point-reading function by user, which is positioned under camera；
The page of the making intelligent point-reading resource of the multimedia resource is loaded, the current outdoor scene of real time parsing judges current realWhether scape is the page for making intelligent point-reading resource；
When the page for the making intelligent point-reading resource for tracking the multimedia resource, the page is prompted in camera outdoor sceneThe position of the touch points made.
Further, step S3 includes：
Detection touches touch points, obtains the identification marking information of touch points；
It is analyzed and acquired by the corresponding touch event of touch points according to the identification marking information retrieval of touch points；
According to touch event, corresponding multimedia resource is read, executes touch event.
The flow chart of reading method in one embodiment of the invention is shown refering to Fig. 3, including：
The startup of intelligent point-reading system finishes, and refreshes automatically to server and asks existing books the Resources list, in systemsAll list；
The specified books of user's selection, system is with asking the download of the corresponding intelligent point-reading resource of the books to serverLocation, and resource is downloaded automatically；
The intelligent point-reading resource downloading of the books finishes, built in automatic start up system based on image recognition augmented reality skillThe camera outdoor scene scanning function of art；
The books are turned to the page for possessing intelligent point-reading function by user, which is positioned over the camera shooting of intelligent point-reading systemUnder head；
The page of the making intelligent point-reading resource of the intelligent point-reading system loads books, the current outdoor scene of real time parsing judgeWhether current outdoor scene is the page for making intelligent point-reading resource；
When the page for the making intelligent point-reading resource for tracking the books, software has prompted the page in camera outdoor sceneThe position of the touch points of making；
Prompt of the user according to point-of-reading system about the position of touch points, using on the tools such as finger or pen touching booksTouch points, trigger touch event, show multimedia messages.
As shown in fig.4, intelligent point-reading system touch event execution flow specifically includes in present embodiment：
Intelligent point-reading system detectio touches touch points, obtains the identification marking information of touch points；
It is analyzed and acquired by the corresponding touch event of touch points according to the identification marking information retrieval of touch points；
According to touch event, corresponding multimedia resource is read, executes touch event.
Touch event includes in present embodiment：It plays audio, display picture, display word, play video, playing modelAnimation etc..Whether different events has different event actions, such as play audio, audio volume can be arranged, recycle, intelligenceCan point-of-reading system parse touch event, according to the execution logic of touch event, show and specifies in the specified region of book pageMultimedia messages become textual books teaching material to need the multimedia of arbitrary displaying multimedia messages mutual by study to reachThe purpose of dynamic study course.
As can be seen from the above technical solutions, the present invention is based on the intelligent point-reading systems that image recognition augmented reality is realizedSystem and method can be realized by using the augmented reality based on image recognition by arbitrary word, patterned books teaching materialBecome to need the arbitrary multimedia interaction study course for showing multimedia messages by study.
Compared with prior art, any existing books can be become at once using augmented reality can point by the present inventionThe books of reading, do not need special books and point reads equipment（For example point is read and talking pen）, the intelligent hand that commonly usesMachine, tablet computer, PC, smart television etc. may act as reading equipment, easy to use, be widely used.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er QieIn the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matterFrom the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended powerProfit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent requirements of the claimsVariation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrappedContaining an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art shouldIt considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the artThe other embodiment being appreciated that.