Movatterモバイル変換


[0]ホーム

URL:


CN104575132A - Interaction education method and system based on natural image recognition and reality augmentation technology - Google Patents

Interaction education method and system based on natural image recognition and reality augmentation technology
Download PDF

Info

Publication number
CN104575132A
CN104575132ACN201510018083.1ACN201510018083ACN104575132ACN 104575132 ACN104575132 ACN 104575132ACN 201510018083 ACN201510018083 ACN 201510018083ACN 104575132 ACN104575132 ACN 104575132A
Authority
CN
China
Prior art keywords
augmented reality
education
module
natural image
natural
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510018083.1A
Other languages
Chinese (zh)
Inventor
范俊宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Flowers Animation (tianjin) Co Ltd
Original Assignee
Flowers Animation (tianjin) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Flowers Animation (tianjin) Co LtdfiledCriticalFlowers Animation (tianjin) Co Ltd
Priority to CN201510018083.1ApriorityCriticalpatent/CN104575132A/en
Publication of CN104575132ApublicationCriticalpatent/CN104575132A/en
Pendinglegal-statusCriticalCurrent

Links

Classifications

Landscapes

Abstract

The invention provides an interaction education method and system based on the natural image recognition and reality augmentation technology. Natural image recognition objects in reality are scanned through a camera of an intelligent mobile terminal, the camera transmits images into a pre-school education system, the pre-school education system calls 3D animation matched with the recognized objects from a database after recognizing codes of the natural recognition objects, the animation is output from a screen of the intelligent mobile terminal, learners can see images obtained by combining scenes shot in real time with virtual 3D animation, and the animation in the images can interact with the learners through various games. By means of natural image recognition, the recognition speed is higher, recognition is more stable, and learning is more interesting; the interaction education method and system have the advantages that the natural image recognition is adopted, the interaction property is achieved, and the intelligent mobile terminal can be more conveniently used.

Description

Based on the mutual education method and system of natural image identification and augmented reality
Technical field
The invention belongs to augmented reality and natural image identification and processing technology field, relate to and a kind ofly use above two kinds of technology to realize the system and method for mutual education on mobile terminals.
Background technology
The existing system or equipment for educating is the educational electronic product that children's early education promotes child learning interest specially, such as children education machine, can comprehensive training learning ability of children, promotes have very great help to aspects such as child's notice, thinking abilities.But also coming with some shortcomings in prior art, is first all unidirectional study, and student can not from main separation learning content; Secondly, effectively do not utilize new technology to educate, such as image identifying and processing technology, applied only for Quick Response Code identification now, more rudimentary; Also have AR augmented reality, be also not yet applied.
Above-mentioned image identifying and processing technology, refers to and utilizes computing machine to process image, analyze and understand, to identify the target of various different mode and the technology to picture.The identification having bar code, Quick Response Code of image recognition technology common at present, the identification for natural image also develops with process.
Virtual information by computer technology, combines with real world by above-mentioned AR augmented reality, and be added in real time same picture or space of real environment and virtual object exists simultaneously.It by the dummy object of Practical computer teaching or about the non-geometry information of real-world object be added to real world scene on, achieve the enhancing to real world.The principal feature of augmented reality is that actual situation combines and man-machine interaction.The main application vector of early stage augmented reality is portable computer or head mounted display, abnormal heavy.Along with extensively popularizing of mobile intelligent terminal, augmented reality is widely used in mobile intelligent terminal.
What need solution at present badly is exactly in the education product that image recognition technology and augmented reality are applied, and realizes high-tech mutual education.
Summary of the invention
The object of this invention is to provide a kind of system and method realizing mutual education based on natural image recognition technology and augmented reality on mobile intelligent terminal, solve problems of the prior art.
In order to achieve the above object, the technical scheme that the present invention takes is: a kind of mutual education method based on natural image identification and augmented reality, is characterized in that, comprise the steps:
(1) camera of mobile intelligent terminal scans Quick Response Code or natural image acquisition download link;
(2) augmented reality AR manager is downloaded;
(3) education APK is downloaded by augmented reality AR manager;
(4) the education APK of download is opened, the natural picture in camera identification reality scene, and the educational system of natural picture transfer to server;
(5) by AR image recognition, the educational system of server is from the data base call augmented reality education content corresponding with the natural picture of identification;
(6) augmented reality education content is transferred to mobile intelligent terminal screen;
(7) learner is in conjunction with the scene of captured in real-time and augmented reality education content, viewing interactive, study.
Preferably, in step (4), choose the unique point of some fixed position in nature picture, by the educational system of the information transmission entrained by these unique points to server;
Preferably, the AR image recognition described in step (5), its method is:
A. make recognition image material, according to color contrast, the correlation means such as lines change produce recognition image;
B. recognition image material is changed into the discernible image of program by high pass algorithm;
C. recognition image is nature picture;
D. import unity3d AR framework and build programming system;
E. interaction is carried out by corresponding image card and book.
Preferably, the described augmented reality education content of step (5) comprises augmented reality education video, augmented reality education audio frequency, augmented reality teaching picture.
Another aspect of the present invention, a kind of interactive education system based on natural image identification and augmented reality, is characterized in that: the server comprising system place, and mobile intelligent terminal; Described mobile intelligent terminal connects described server by mobile network; Described mobile intelligent terminal comprises mobile terminal camera module, natural image identification module, data processing module, augmented reality education content output module and augmented reality interactive module.
Further, described server comprises augmented reality AR manager module, education APK module and download module, described real AR manager module, education APK model calling download module.
Further, described augmented reality education content output module comprises augmented reality education video module, augmented reality education audio-frequency module, augmented reality teaching picture module.
Beneficial effect of the present invention is: natural image recognition technology combines with augmented reality by the present invention, is applied on mobile intelligent terminal, to realize aims of education; Mostly intelligent education machine in the market, learning machine are simply enumerating of course and pile up, and the technology of the interaction really can accomplished between intelligent education machine and learner does not almost have; Used the present invention of augmented reality really to achieve this interaction, learner can unrestricted choice learning content simultaneously.Current most augmented reality is all use planar bar code technology to identify recognizate, and the present invention adopts natural image identification, and recognition speed is rapider, more stable, learns also more interesting.Advantage of the present invention: 1. natural image identification; 2. possesses interactive attribute; 3. the use of mobile intelligent terminal is convenient.
Accompanying drawing explanation
Fig. 1 is schematic flow sheet of the present invention.
Fig. 2 is principle of work schematic diagram of the present invention.
Fig. 3 is module diagram of the present invention.
Embodiment
Below in conjunction with specific embodiment, the invention will be further described.
Education terminal in the market all presents unidirectional mode of learning, the passive content of accepting the education of learner, and native system solves this problem, native system application augmented reality, makes study and education present two-way interaction pattern.This educational system and method can make learner feel more vivid, more on the spot in person.
Step of the present invention as shown in Figure 1.
(1) camera of mobile intelligent terminal scans Quick Response Code or natural image acquisition download link;
(2) augmented reality AR manager is downloaded;
(3) education APK is downloaded by augmented reality AR manager;
(4) the education APK of download is opened, natural picture in camera identification reality scene, and the educational system of natural picture transfer to server, its process is the unique point of some fixed position chosen in nature picture, by the educational system of the information transmission entrained by these unique points to server;
(5) by AR image recognition, the educational system of server is from the data base call augmented reality education content corresponding with the natural picture of identification;
Wherein AR knowledge method for distinguishing is:
A. make recognition image material, according to color contrast, the correlation means such as lines change produce recognition image;
B. recognition image material is changed into the discernible image of program by high pass algorithm;
C. recognition image is nature picture;
D. import unity3d AR framework and build programming system;
E. interaction is carried out by corresponding image card and book;
In addition, described augmented reality education content comprises augmented reality education video, augmented reality education audio frequency, augmented reality teaching picture, as shown in Figure 2.
(6) augmented reality education content is transferred to mobile intelligent terminal screen;
(7) learner is in conjunction with the scene of captured in real-time and augmented reality education content, viewing interactive, study.
In order to realize said method, system of the present invention as shown in Figure 3, comprises the server at system place, and mobile intelligent terminal; Described mobile intelligent terminal connects described server by mobile network; Described mobile intelligent terminal comprises mobile terminal camera module, natural image identification module, data processing module, augmented reality education content output module and augmented reality interactive module.
Described server comprises augmented reality AR manager module, education APK module and download module, described real AR manager module, education APK model calling download module.
Described augmented reality education content output module comprises augmented reality education video module, augmented reality education audio-frequency module, augmented reality teaching picture module.
The foregoing is only specific embodiments of the invention, the protection domain be not intended to limit the present invention, within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (7)

CN201510018083.1A2015-01-142015-01-14Interaction education method and system based on natural image recognition and reality augmentation technologyPendingCN104575132A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201510018083.1ACN104575132A (en)2015-01-142015-01-14Interaction education method and system based on natural image recognition and reality augmentation technology

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201510018083.1ACN104575132A (en)2015-01-142015-01-14Interaction education method and system based on natural image recognition and reality augmentation technology

Publications (1)

Publication NumberPublication Date
CN104575132Atrue CN104575132A (en)2015-04-29

Family

ID=53091070

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201510018083.1APendingCN104575132A (en)2015-01-142015-01-14Interaction education method and system based on natural image recognition and reality augmentation technology

Country Status (1)

CountryLink
CN (1)CN104575132A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105320282A (en)*2015-12-022016-02-10广州经信纬通信息科技有限公司Image recognition solution based on augmented reality
CN105323252A (en)*2015-11-162016-02-10上海璟世数字科技有限公司Method and system for realizing interaction based on augmented reality technology and terminal
CN105573592A (en)*2016-01-292016-05-11北京宝贝星球科技有限公司Preschool education smart interaction system and method
CN105719522A (en)*2016-01-252016-06-29成都趣动力教育科技有限公司Dual-client-terminal speech communication method, device and system
CN105807916A (en)*2016-02-292016-07-27深圳前海勇艺达机器人有限公司Method for making robot play AR game
CN105844979A (en)*2015-12-152016-08-10齐建明Augmented reality book, and education system and method based on augmented reality book
CN106057002A (en)*2016-08-042016-10-26杭州欢度科技有限公司Interaction system of classroom teaching
CN106056992A (en)*2016-07-202016-10-26广东沃赛科技有限公司Ar augmented reality teaching system
CN107705645A (en)*2017-09-012018-02-16合肥迅大信息技术有限公司Teaching auxiliary system based on augmented reality
CN107749199A (en)*2017-10-272018-03-02北京闪慧东方数字科技有限公司A kind of preschool education interaction systems based on intelligent image identification
CN107798932A (en)*2017-12-082018-03-13快创科技(大连)有限公司 An early education training system based on AR technology
CN107861976A (en)*2017-09-212018-03-30四川长虹电器股份有限公司Realize the method and system of static picture album association customization scene service
CN109446929A (en)*2018-10-112019-03-08浙江清华长三角研究院 A stick figure recognition system based on augmented reality technology
CN109543072A (en)*2018-12-052019-03-29深圳Tcl新技术有限公司AR educational method, smart television, readable storage medium storing program for executing and system based on video
CN109886283A (en)*2017-12-062019-06-14江西科骏实业有限公司A kind of plant image intelligent identifying system based on AR
CN110178168A (en)*2017-01-172019-08-27惠普发展公司,有限责任合伙企业 Simulate Enhanced Content
CN111147433A (en)*2018-11-052020-05-12自然萌(上海)教育科技有限公司Natural education sharing system and method
CN111564064A (en)*2020-05-272020-08-21上海乂学教育科技有限公司Intelligent education system and method based on game interaction
CN112987929A (en)*2021-03-162021-06-18南京新知艺测科技有限公司AR visual scene learning method and system based on labor skill teaching materials

Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102521859A (en)*2011-10-192012-06-27中兴通讯股份有限公司Reality augmenting method and device on basis of artificial targets
CN103530594A (en)*2013-11-052014-01-22深圳市幻实科技有限公司Method, system and terminal for providing augmented reality
CN103606310A (en)*2013-10-292014-02-26中兴通讯股份有限公司Teaching method and system
US20140162220A1 (en)*2012-12-112014-06-12Quest 2 Excel, Inc.System, method and computer program product for gamification of business processes
KR20140073155A (en)*2012-12-062014-06-16주식회사 에스제이더블유인터내셔널System and method of learning language using augmented reality marker
CN104269079A (en)*2014-09-302015-01-07张启熙Mobile terminal preschool education system and method based on mirror reflection and augmented reality technology

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102521859A (en)*2011-10-192012-06-27中兴通讯股份有限公司Reality augmenting method and device on basis of artificial targets
KR20140073155A (en)*2012-12-062014-06-16주식회사 에스제이더블유인터내셔널System and method of learning language using augmented reality marker
US20140162220A1 (en)*2012-12-112014-06-12Quest 2 Excel, Inc.System, method and computer program product for gamification of business processes
CN103606310A (en)*2013-10-292014-02-26中兴通讯股份有限公司Teaching method and system
CN103530594A (en)*2013-11-052014-01-22深圳市幻实科技有限公司Method, system and terminal for providing augmented reality
CN104269079A (en)*2014-09-302015-01-07张启熙Mobile terminal preschool education system and method based on mirror reflection and augmented reality technology

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
周大镕: ""基于增强现实的体验式教学演示软件的设计与实现"", 《中国优秀硕士学位论文全文数据库 社会科学II辑》*

Cited By (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105323252A (en)*2015-11-162016-02-10上海璟世数字科技有限公司Method and system for realizing interaction based on augmented reality technology and terminal
CN105320282A (en)*2015-12-022016-02-10广州经信纬通信息科技有限公司Image recognition solution based on augmented reality
CN105320282B (en)*2015-12-022018-12-25广州经信纬通信息科技有限公司A kind of image recognition solution based on augmented reality
CN105844979A (en)*2015-12-152016-08-10齐建明Augmented reality book, and education system and method based on augmented reality book
CN105719522A (en)*2016-01-252016-06-29成都趣动力教育科技有限公司Dual-client-terminal speech communication method, device and system
CN105573592A (en)*2016-01-292016-05-11北京宝贝星球科技有限公司Preschool education smart interaction system and method
CN105807916A (en)*2016-02-292016-07-27深圳前海勇艺达机器人有限公司Method for making robot play AR game
CN106056992A (en)*2016-07-202016-10-26广东沃赛科技有限公司Ar augmented reality teaching system
CN106057002A (en)*2016-08-042016-10-26杭州欢度科技有限公司Interaction system of classroom teaching
CN106057002B (en)*2016-08-042019-03-29杭州欢度科技有限公司A kind of classroom instruction interaction systems
CN110178168A (en)*2017-01-172019-08-27惠普发展公司,有限责任合伙企业 Simulate Enhanced Content
CN107705645A (en)*2017-09-012018-02-16合肥迅大信息技术有限公司Teaching auxiliary system based on augmented reality
CN107861976A (en)*2017-09-212018-03-30四川长虹电器股份有限公司Realize the method and system of static picture album association customization scene service
CN107749199A (en)*2017-10-272018-03-02北京闪慧东方数字科技有限公司A kind of preschool education interaction systems based on intelligent image identification
CN109886283A (en)*2017-12-062019-06-14江西科骏实业有限公司A kind of plant image intelligent identifying system based on AR
CN107798932A (en)*2017-12-082018-03-13快创科技(大连)有限公司 An early education training system based on AR technology
CN109446929A (en)*2018-10-112019-03-08浙江清华长三角研究院 A stick figure recognition system based on augmented reality technology
CN111147433A (en)*2018-11-052020-05-12自然萌(上海)教育科技有限公司Natural education sharing system and method
CN109543072A (en)*2018-12-052019-03-29深圳Tcl新技术有限公司AR educational method, smart television, readable storage medium storing program for executing and system based on video
CN109543072B (en)*2018-12-052022-04-22深圳Tcl新技术有限公司Video-based AR education method, smart television, readable storage medium and system
CN111564064A (en)*2020-05-272020-08-21上海乂学教育科技有限公司Intelligent education system and method based on game interaction
CN112987929A (en)*2021-03-162021-06-18南京新知艺测科技有限公司AR visual scene learning method and system based on labor skill teaching materials

Similar Documents

PublicationPublication DateTitle
CN104575132A (en)Interaction education method and system based on natural image recognition and reality augmentation technology
CN104102412B (en)A kind of hand-held reading device and method thereof based on augmented reality
Cheng et al.Construction of interactive teaching system for course of mechanical drawing based on mobile augmented reality technology
CN107798932A (en) An early education training system based on AR technology
CN109815776B (en)Action prompting method and device, storage medium and electronic device
CN105320282B (en)A kind of image recognition solution based on augmented reality
CN102411854A (en)Classroom teaching mixing technology application system based on enhanced reality and method thereof
CN104778654A (en)Intangible cultural heritage digital display system and method thereof
CN103916621A (en)Method and device for video communication
CN102945637A (en)Augmented reality based embedded teaching model and method
CN107705636A (en)A kind of ship experiment teaching system based on augmented reality
CN105931506A (en) A children's coloring system and its display method based on augmented reality
KR20170064026A (en)The way of a smart education services for 3D astronomical educational services, using virtual reality, augmented reality-based immersive interface
KR101998037B1 (en)Method and Smart device for matching character type with user based augmented reality
CN206249634U (en)A kind of art teaching system
CN204028887U (en)A kind of reading of the hand-held based on augmented reality equipment
CN102509502A (en)Virtual experiment making method for convex lens
CN104464389A (en)Virtual teaching system based on augmented reality
CN108847057A (en)A kind of the actual situation combination display systems and method of photoelectric effect experiment
CN106600669A (en)Device based on variable-color fluorescent drawing board and augmented reality, and operation method
CN117115917A (en)Teacher behavior recognition method, device and medium based on multi-modal feature fusion
CN114373050A (en)Chemistry experiment teaching system and method based on HoloLens
CN109034167A (en)Visual indicia method, system, electric terminal and computer readable storage medium
CN205287569U (en)Children's picture arragement based on augmented reality
Hou et al.Mobile augmented reality system for preschool education

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20150429


[8]ページ先頭

©2009-2025 Movatter.jp