Learning calligraphy system and method based on augmented realityTechnical field
The application that the present invention relates to augmented realities on learning calligraphy, more particularly to complete learning calligraphy systemSystem, specifically a kind of augmented reality learning method towards calligraphy beginner.
Background technique
Calligraphy art is of long standing and well established, of extensive knowledge and profound scholarship, and writing creation is a kind of motor skill, also contains advanced examineBeauty and motion of thinking.Modern Chinese character is although largely use hard-tipped writing instrument, and the aesthetic and temperament and interest of calligraphy is constant, the structure of an essay knot of wordStructure and luck tendency turnover are without the slightest difference with writing brush, so hard-tipped pen calligraphical works is the special case of Writing brush calligraphy.Beginner is learningWhen calligraphy, grasping the application method of tool and copying practice is essential process.Traditional calligraphy tool have pen, ink,Paper, inkstone, imitation tool have copybook.With the progress of science and technology, drills to improve one's handwriting tool has also obtained promotion functionally, thanSuch as: digitized exercising pen, reusable copybook, ink.The now existing implementation closest with the present inventionIt is to acquire education end data in real time by the equipment of a set of complexity to be transferred to the side that study end carries out virtual reality and augmented realityMethod.
The shortcomings that prior art is to need just to be able to achieve teaching purpose by complicated equipment, and this kind of technology is only applicable inIn one-to-many real-time calligraphy teaching mode, the process once taught can not effectively be saved, and repeatedly in augmented reality ringIt is reappeared under border.
Summary of the invention
In view of the defect of the prior art, the present invention provide a kind of augmented reality learning calligraphy system towards beginner andMethod.By the pen of calligraphy, ink, five quasi-tradition tool of paper, inkstone and copybook, carried out in the form of rich media file under actual environment virtualTeaching demonstration.It proposes and realizes to use augmented reality learning book on portable stage device such as mobile phone, tablet computerThe method of method, and error correction and guidance can be carried out to process of the beginner when practicing calligraphy by augmented reality.
In order to achieve the above objectives, one aspect of the present invention provides a kind of learning calligraphy system based on augmented reality,Including video camera, communication unit, display unit, storage element, threedimensional model component, threedimensional model, arithmetic element and VuforiaAR unit；The threedimensional model includes the threedimensional model of the threedimensional model of hand, the threedimensional model of pen and writing；Video camera is used forObtain actual environment and calligraphy word mark；Storage element is for storing threedimensional model component and threedimensional model；Vuforia AR is mono-First calligraphy word mark for identification, and calligraphy word mark is judged in actual environment with the relative position of video camera；It is aobviousShow that writing laminated thereto of the unit in calligraphy word mark shows threedimensional model and threedimensional model component.
Preferably, threedimensional model component includes video module, special efficacy component, language audio and animation.
In addition the present invention provides a kind of methods of learning calligraphy based on augmented reality, the specific steps of which are as follows:
Step 1: Vuforia AR unit starting video camera obtains actual environment and calligraphy word mark；
Step 2: Vuforia AR identification calligraphy word mark simultaneously extracts the three of corresponding hand, pen and writing from storage unitDimension module and threedimensional model component, and then calligraphy word mark is sentenced in actual environment with the relative position of video cameraIt is disconnected；
Step 3: display unit shows the actual environment situation of camera acquisition, calligraphy word mark, and in calligraphy word markWriting laminated thereto show step 2 in threedimensional model and threedimensional model component content.
Preferably, specific steps further include the relative position for changing video camera and calligraphy label in actual environment, displayThe corresponding angle content of 360 degree of unit displays threedimensional models and threedimensional model component.
Preferably, specific steps further include obtaining user's imitation in actual environment by video camera to copy on copying labelThe standard calligraphy digital data of storage unit and the imitation marked image data are passed through Vuforia by imitation tag image outAR unit and arithmetic element carry out the comparing of calligraphy characteristic, calligraphy font, judge.And the judgement is countedIt is converted according to visualization result, display unit shows similar value compared with lower part, carries out repeating demonstration.
User using imitation label when carrying out copying practice, described in device video camera and the identification of Vuforia AR unitLabel is copied, determine video camera and copies the relative position of label, and then identifies the label on calligraphy tool, is marked by copyingChange with the label relative position on calligraphy tool, to judge whether calligraphy tool application method is correct.
Preferably, specific steps further include that pen, ink, paper, inkstone and copybook five biographies are identified by Vuforia AR unitSystem toolmark, the threedimensional model and threedimensional model component of corresponding conventional tool are extracted from storage unit, show traditional workThe application method of tool.
Preferably, further include copyright authentication step before step 1: the identifying code on identification calligraphy word mark is tested describedCard code is compared, matches and binds in database with device sequence number, is proved to be successful, and activates the data packet on device.
User started by controller, suspended, the interactive operation of animation acceleration or deceleration, controls the threedimensional modelThe Dynamically Announce of component, static status display, acceleration or deceleration are shown.
Beneficial effects of the present invention: first consisting in and provide more easily mode of learning, and user only needs using portableStage apparatus such as mobile phone, tablet computer, so that it may be learnt anywhere or anytime.Also, it is provided by augmented realityAcademic environment experience with immersion, promotes learning effect.Realize 360 degree of display threedimensional models and group in actual environmentThe corresponding angle content of part, multi-angle, multi-angle of view view and emulate the scheme structure and luck tendency of correct writing posture, writing strength, wordTurnover.
Key point of the invention is: innovation has been invented under augmented reality environment from the use of calligraphy tool, calligraphyPractice, a whole set of learning system of remedial teaching and method are copied in teaching；And the system and implementation method are applied portableOn stage apparatus such as mobile phone, tablet computer, the learning cost of user is reduced, improves the convenience and efficiency of study；It willPower is verified in conjunction with the learning calligraphy system based on augmented reality, and copyright side and the equity of user is effectively protected；InnovationPractice result will be copied, error correction guidance is carried out by augmented reality.It provides actual environment and virtual teaching environment for userThe immersion learning calligraphy method of fusion.Also, the present invention is effectively recorded the process once taught, and by portableDevice repetition learning in actual environment uses.And then establish on the basis of traditional writing implement, allow in writing cultureExperience is practised completely to be retained and developed.
Part explanation of nouns in the present invention: augmented reality: being a kind of position for calculating video camera image in real timeAnd angle and add respective image technology, the target of this technology is virtual world to be covered to go forward side by side in actual environment on the screenRow interaction.Actual environment: it is derived from the continuous image of real world environments, for example uses the feelings in the camera record physical reality worldCondition.Calligraphy word mark: it combines single writing brush word to form calligraphy word mark with corresponding pattern.It copies label: reducing writing brush word portionDivide the calligraphy word mark of contrast.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of present system；
Fig. 2 is that the present invention copies practice flow chart；
Fig. 3 is the flow chart of the method for the present invention.
Specific embodiment
A kind of learning calligraphy system based on augmented reality comprising video camera, communication unit, display unit, storageMemory cell, threedimensional model component, threedimensional model, arithmetic element and Vuforia AR unit；The threedimensional model includes the three of handThe threedimensional model of dimension module, the threedimensional model of pen and writing；Video camera is for obtaining actual environment and calligraphy word mark；Storage is singleMember is for storing three-dimensional micromodule, threedimensional model；Vuforia AR unit calligraphy word mark for identification, and to calligraphy word markJudged in actual environment with the relative position of video camera；Display unit is used for the writing laminated thereto in calligraphy word markShow threedimensional model and threedimensional model component.Threedimensional model component includes video module, special efficacy component, language audio and animation mouldBlock.
It is preferred that learning calligraphy system further includes controller and interactive unit, the two is for starting, suspending, animation accelerates or subtractsThe interactive operation of speed, the Dynamically Announce, static status display, acceleration or deceleration for controlling the threedimensional model component are shown.
A kind of learning calligraphy system and method based on augmented reality is the religion of the use of calligraphy tool, calligraphyLearn, copy a whole set of learning system and method for practice, remedial teaching.
It realizes that steps are as follows: the teaching process of calligraphy: the video camera on opening device, reads the verifying on calligraphy word markCode, above-mentioned identifying code by communication unit, be compared, matched and bound in database with device sequence number, to realizeCopyright authentication.It is proved to be successful, activates the data packet on device, by Vuforia AR unit starting video camera, obtain realityEnvironment and calligraphy word mark.Identify that calligraphy word mark extracts the threedimensional models such as corresponding hand, pen, writing from storage unit, andThe threedimensional models component such as animation, audio, video and special efficacy, according to Vuforia AR unit to calligraphy word mark in actual environmentSpatial relationship carries out position judgement.Then, show that camera obtains actual environment situation, writing brush word mark in the display unit of deviceNote, and threedimensional model and component content are shown in the writing laminated thereto of calligraphy word mark.User by the interactive unit of device,The interactive operations such as the controllers such as physical button are started, suspended, animation acceleration or deceleration control the dynamic of threedimensional model componentIt has been shown that, static status display, acceleration or deceleration are shown, and then realize that the user on different level of learning carries out corresponding skill learningPurpose.Also, user can mark the positional relationship in actual environment by changing camera and calligraphy, realize in real ringThe corresponding angle content of 360 degree of displays threedimensional models and component in border.
In addition, the use of learning calligraphy tool: Vuforia AR unit starting video camera, identification pen, ink, paper, inkstone andFive conventional tool labels of copybook learn the application method of basic tool using the above method under augmented reality environment.It needsIllustrate be above-mentioned conventional tool label be not space physical identification its be pictorial symbolization.For example, one has writing brush patternCard, three-dimensional writing brush is presented in identification icon, and under augmented reality environment demonstration hold a pen, the using skills such as pen manipulating method,The augmented reality for watching threedimensional model is demonstrated to learn.
Secondly, carrying out imitation practice, remedial teaching: user can use and fill when carrying out copying practice using imitation labelIt sets video camera and the positional relationship for marking and determining video camera and copying label is copied in the identification of Vuforia AR unit, and then identifyLabel on writing brush, by copying label and the mark position relationship change on writing brush, to judge that user is copying when practicingWhether posture of wieling the pen is correct.During copying practice, real-time error correction guidance can be realized by this method.It is copyingIt on label, completes after copying study, is obtained by Vuforia AR unit and video camera and copy word mark image, and will copyTag image is adjusted to equally proportionate size with the standard writing brush word in storage unit.The two is overlapped, the writing of imitation is completely overlappedStandard writing part is correct imitation, and the writing of imitation does not cover standard writing part to be copied for mistake, and the writing of imitation is superThe extra covering part of standard writing part is that mistake is copied out.In turn, when the edge trace of writing is more smooth, flash and bendingIt is fewer, that is, show user write when it is more smooth, copy result it is better.Then, the conversion of data visualization result is carried out to the judgement,It is shown using above-mentioned augmented reality writing brush word display methods in display unit.In turn, user can pass through above-mentioned interactionSimilar value is carried out demonstration compared with lower part and repeats to demonstrate by operation, realizes learning guide effect.
Calligraphy word mark: calligraphy writing (100% is black)+specific markers pattern copies label: calligraphy writing (45% is black)+spyDetermine indicia patterns, copying label is the label that user uses in practical writing practising, this is marked with shallower writing, user'sOriginal writing will be covered by copying writing.It is unrecognized when imitation label is not carried out copying practice again.Copy meeting after practicingCarry out remedial teaching.
The present embodiment provides more easily mode of learning the utility model has the advantages that first consisting in, and user only needs using portableStage apparatus such as mobile phone, tablet computer, so that it may learnt anywhere or anytime.Also, it is mentioned by augmented realityIt has supplied the academic environment with immersion to experience, has promoted learning effect.Secondly, the present invention from basis calligraphy tool, calligraphyPractise, copy practice and remedial teaching many aspects provide complete learning calligraphy system, effective solution beginner fromThe imperfect problem of the method encountered in.In addition, the present invention alsos for improving learning interest in copying practice and remedial teachingIt introduces visual copy and practices evaluation mechanism.Finally, the present invention also provides the rights verifications under augmented reality environmentMethod protects the equity legitimate of copyright side and user.