Show the augmented reality devices and methods therefor for formulating combination marker virtual informationTechnical field
The present invention relates to augmented reality field, more particularly to a kind of displaying formulation combination marker virtual informationAugmented reality device.
Background technology
Augmented reality (Augmented Reality, abbreviation AR), is a kind of position for calculating camera image in real timeAnd angle and plus the technology of respective image, it is therefore an objective to virtual world is enclosed within real world on screen and interaction is carried out.ThisThe technology of kind is most proposed earlier than nineteen ninety.The essence of augmented reality is that the virtual information that computer is generated is illustrated in into actual environmentIn, so as to reach the enhancing to actual environment.Its advantage and effect be, the letter that people can not be directly read in real worldBreath, by computer related device, allows people to directly read the virtual information.
Effect and advantage based on augmented reality, and choose specifically asking for food materials for people in everyday reality lifeTopic, it is desirable to find a kind of based on augmented reality, solves people to the determination of food materials needed for established recipe, in numerous foodsThe food materials needed for oneself are found in material, food materials amount is determined according to different numbers of meals and corresponding food is formulated according to own health situationThe problems such as spectrum.
The content of the invention
Goal of the invention：During the present invention is solved for everyday reality life, people are being chosen according to established recipeWhen, how clearly needed for food materials, how the food materials needed for how finding oneself in numerous food materials to determine according to different numbers and eatMaterial amount, the problems such as how to formulate the recipe for meeting own health situation.
Technical scheme：It is a kind of to show the augmented reality device for formulating combination marker virtual information, including：Image acquisition mouldBlock, for gathering real world images using photographic head；Data obtaining module, for obtaining at least one formulation recipe letter of user inputBreath；Information splits module, for formulation recipe information to be combined the fractionation of food, generates the combination composition after splitting and formulatesThe food information as AR markers of recipe information；Picture recognition module, for according to the food information actual form pairThe real world images of described image acquisition module collection are identified, and have in real world images are identified and meet the food information realityDuring the segment of border form, segment present position in real world images is obtained；Visual render module, for generating virtual tag simultaneouslyVirtual tag is illustrated in into the top of segment present position in real world images, and will show that result is incident upon in OLED screen is carried outShow.
Used as a kind of optimal way of the present invention, a kind of described displaying is formulated the enhancing of combination marker virtual information and is showedActual load is put, and is also included：Mapping relations set up module, for setting up several AR markers with tie element, the mapping of nutrientRelation is simultaneously stored in data base；Virtual information transfers module, for transferring from the data base and food letterCease corresponding composition, nutrient；The visual render module be additionally operable to using the corresponding composition of the food information, nutrient asVirtual information is illustrated in the top of segment present position in real world images.
Used as a kind of optimal way of the present invention, described information acquisition module is additionally operable to obtain the dining people of user inputNumber；The augmented reality device also includes：Amount computing module, formulates after recipe information fractionation for being calculated according to number of mealsThe corresponding demand weight of food information；The visual render module is additionally operable to the corresponding demand weight of food information as virtualInformation is illustrated in the top of segment present position in real world images.
Used as a kind of optimal way of the present invention, a kind of described displaying is formulated the enhancing of combination marker virtual information and is showedActual load is put, and is also included：The User profile acquisition module communicated with sign monitor device, the health for obtaining user is believedBreath；Recipe formulates module, for formulating the recipe of beneficial user's body health according to the physical condition information of user；Recipe informationJudge module, for judging whether the formulation recipe information of user input is covered by the recipe that recipe formulates module formulation；FoodSpectrum information processing module, for when formulation recipe information is not covered by the recipe that recipe formulates module formulation, obtaining notThe recipe information being included；The recipe information that described information fractionation module is additionally operable to not to not being included is combined tearing open for foodPoint.
Used as a kind of optimal way of the present invention, the recipe information judge module is additionally operable to judge the formulation of user inputWhether recipe information covers composition, the nutrient of beneficial user's body health；The recipe information processing module is additionally operable in systemWhen determining recipe information and not covering composition, the nutrient of beneficial user's body health, acquisition is not covered by beneficial user's body healthComposition, the recipe information of nutrient；Described information split module be additionally operable to not to be not covered by beneficial user's body health intoPoint, the recipe information of nutrient be combined the fractionation of food.
A kind of to show the augmented reality method for formulating combination marker virtual information, usage right requires the enhancing described in 1Real device, the method comprising the steps of：
Step1, obtains at least one formulation recipe information of user input；
Step2, by formulation recipe information the fractionation of food is combined, and is generated the combination after splitting and is constituted formulation recipe informationAs the food information of AR markers；
Step3, using photographic head real world images are gathered；
The real world images that described image acquisition module is gathered are identified by Step4 according to the food information actual form,Identify when having the segment for meeting the food information actual form in real world images, obtain the segment residing in real world imagesPosition；
Step5, generates virtual tag and virtual tag is illustrated in into the top of segment present position in real world images, and by exhibitionShow result to be incident upon in OLED screen to be shown.
As a kind of optimal way of the present invention, after step4, also include：
Several AR markers are set up with tie element, the mapping relations of nutrient and is stored in data base；
Composition corresponding with the food information, nutrient are transferred from the data base；
The food information tie element, nutrient are illustrated in into segment present position in real world images as virtual informationTop.
As a kind of optimal way of the present invention, after step2, also include：
Obtain the number of meals of user input；
Calculated according to number of meals and formulate the corresponding demand weight of food information after recipe information splits；
After step4, also include：
The corresponding demand weight of the food information is illustrated in into segment present position in real world images as virtual informationTop.
As a kind of optimal way of the present invention, before step2, also include：
Communicate with obtaining the physical condition information of user with sign monitor device；
The recipe of beneficial user's body health is formulated according to the physical condition information of user；
Judge user input formulates whether recipe information is covered by the recipe that recipe formulates module formulation；
When formulation recipe information is not covered by the recipe that recipe formulates module formulation, the recipe letter not being included is obtainedBreath；
The recipe information to not being included is not combined the fractionation of food.
Used as a kind of optimal way of the present invention, a kind of described displaying is formulated the enhancing of combination marker virtual information and is showedReal method, also includes：
Judge composition, the nutrient that whether recipe information covers beneficial user's body health formulated of user input；
When formulation recipe information does not cover composition, the nutrient of beneficial user's body health, acquisition is not covered by beneficial userHealthy composition, the recipe information of nutrient；
The fractionation of food is not combined to being not covered by the beneficial composition of user's body health, the recipe information of nutrient.
The present invention realizes following beneficial effect：User in data obtaining module input by formulating recipe and its number of mealsInformation, information splits module and its amount computing module determines respectively the food materials formulated needed for recipe, and its required foodMaterial amount.When people carry out choosing food materials using described device, by picture recognition module and visual render module, in numerous foodsIdentify required food materials in material, and by its virtual tag.It is therefore seen that, this invention addresses the determination for formulating food materials needed for recipeProblem, and help user to be quickly found out required food materials in numerous food materials when choosing, and determined not according to different numbers of mealsWith food materials amount.In addition, the mapping relations of the present invention set up module, formulation recipe correspondence food materials are also set up with its nutritional labeling, battalionThe mapping relations of element are supported, there is using the formulated recipe of user's understanding whether nutrition arrangement is reasonable.
Description of the drawings
Accompanying drawing herein is merged in description and constitutes the part of this specification, shows the enforcement for meeting the disclosureExample, and be used to together explain the principle of the disclosure in description.It is virtual that Fig. 1 formulates combination marker for the displaying that the present invention is providedThe intensifier framework schematic diagram of information；
The reality collection image schematic diagram that Fig. 2 is provided for the present invention；
The displaying result schematic diagram that Fig. 3 is provided for the present invention；
Fig. 4 formulates the flow process of the augmented reality method of the virtual nutritional information of combination marker for the displaying that the present invention is provided and illustratesFigure.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, completeSite preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than the embodiment of whole.
Embodiment one
Fig. 1 is refer to, Fig. 1 formulates the augmented reality dress of the virtual nutritional information of combination marker for a kind of displaying that the present invention is providedPut framework map.
Specifically, the present embodiment provides a kind of augmented reality device for showing and formulating the virtual nutritional information of combination marker,Including：Image capture module 1, for gathering real world images using photographic head；Data obtaining module 2, for obtaining user inputAt least one formulation recipe information；Information splits module 3, for formulation recipe information to be combined the fractionation of food, generatesCombination after fractionation constitutes the food information as AR markers for formulating recipe information；Picture recognition module 4, for according to instituteState food information actual form to be identified the real world images that described image acquisition module is gathered, in real world images are identifiedWhen having the segment for meeting the food information actual form, segment present position in real world images is obtained；Mapping relations are builtFormwork erection block 5, for setting up several AR markers with tie element, the mapping relations of nutrient and being stored in data base12；Virtual information transfers module 6, for transferring composition corresponding with the food information, nutrient from the data base；AmountComputing module 7, for calculating according to number of meals the corresponding demand weight of food information after recipe information splits is formulated；VisionRendering module 8, for generating virtual tag and virtual tag being illustrated in into the top of segment present position in real world images, andTo show that result is incident upon in OLED screen 13 to be shown.
Additionally, the present embodiment provides a kind of augmented reality device for showing and formulating the virtual nutritional information of combination marker, alsoIncluding：The User profile acquisition module 9 communicated with sign monitor device, for obtaining the physical condition information of user；Recipe systemCover half block 10, for formulating the recipe of beneficial user's body health according to the physical condition information of user；Recipe information judges mouldBlock 11, for judging whether the formulation recipe information of user input is covered by the recipe that recipe formulates module formulation；Recipe is believedBreath processing module 14, for formulate recipe information not by recipe formulate module formulate recipe cover when, obtain not byThe recipe information covered；The recipe information that described information fractionation module is additionally operable to not to not being included is combined tearing open for foodPoint.
Wherein what deserves to be explained is of the present invention show that the enhancing for formulating the virtual nutritional information of compositionss marker showsActual load is put, and specific device pattern can be mobile terminal of glasses, the helmet, scanning device or similar mobile phone etc..
Further specific, the User profile acquisition module 9 for communicating with sign detector first gets sign testerDetection information.Information such as sign monitor detection is to lack vitamin C and ferrum in user's body.Now when recipe customized module10 receive after the information, and the recipe for being beneficial to user's body health is formulated according to the detection information, such as tomato egg, blackAuricularia fried pork livers, Fructus Cucumidis sativi egg, shredded pork with green pepper, and the recipe for being beneficial to user's body health of customization is stored in into data base12.When user uses described device, the recipe information formulated according to oneself hobby first, the food that such as user's lunch today is formulatedCompose and be：Fructus Cucumidis sativi egg, the Fish with Chinese Sauerkraut, stirfried bean curd in hot sauce, Auricularia fried pork livers.The present that user is formulated by data obtaining module 9The recipe information input of its lunch.Additionally, data obtaining module 9, is additionally operable to the information of user input number of meals.
Further, when recipe information judge module 11 obtains the formulation recipe information that user is input into, it is carried outJudge.I.e. recipe information judge module 11 by data base retrieval contrast, for formulate recipe information in not by recipeThe recipe that the recipe of the formulation of module 10 is covered is formulated, the recipe letter not being included is obtained by recipe information processing module 14Breath, does not process to it；For the recipe covered by the recipe that recipe formulation module 10 is formulated in formulation recipe information, pass throughRecipe information processing module 14 is obtained and covers the information of recipe, and sends it to information fractionation module 3.For example, this enforcementStoring the recipe of the recipe formulation formulation of module 10 in example in data base includes：Tomato egg, Auricularia fried pork livers, Fructus Cucumidis sativiEgg, shredded pork with green pepper；User input lunch today formulate recipe be：Fructus Cucumidis sativi egg, the Fish with Chinese Sauerkraut, stirfried bean curd in hot sauce, Auricularia are friedHepar Sus domestica.Recipe information judge module 11 is contrasted both information, is then obtained by recipe information processing module 14 and is containedThe information of lid recipe, and send it to information fractionation module 3.Such as the recipe being included in the present embodiment：Fructus Cucumidis sativi egg, black woodEar fried pork livers.
It is further specific, after information splits module 3 receives the information of the transmission of recipe information processing module 14, will connectThe recipe information for receiving is combined the fractionation of food, and the combination after generation splits constitutes identifying as AR for formulation recipe informationThe food information of thing.As the recipe information that recipe information processing module 14 in the present embodiment is sent to information fractionation module 3 is：It is yellowMelon egg, Auricularia fried pork livers.Information is split after module 3 is split：Fructus Cucumidis sativi, egg, Auricularia, Hepar Sus domestica, and by theseFood materials are used as AR markers.Wherein for the method for splitting of recipe information can compare method of formation.Store i.e. in data base 12Recipe formulates the fractionation information contrast table of the recipe that module 10 is formulated, shown in table specific as follows：
Information split module 3 by the recipe name in the recipe information for receiving and data base 12 storage with fractionation informationRecipe name contrasted, and extract the fractionation information of the contrast consistent recipe of recipe name.
Further, mapping relations foundation will be sent respectively to as the food materials information of AR markers when information splits module 3Module 5 and amount computing module 7, mapping relations set up module 5 upon receiving this information, set up the AR marks included in described informationThing is known with tie element, the mapping relations of nutrient and be stored in data base 12.Specific mapping relations are set up can be withIt is that method is set up in contrast, such as storage in data base includes the actual form of food materials needed for the recipe for constituting recipe formulation module and reflectsRelation information synopsis is penetrated, shown in table specific as follows：
Mapping relations set up module 5 by comparing the food materials title of the food materials title received in above- mentioned information and data base, set upThe consistent AR markers of food materials title and tie element, the mapping relations of nutrient.The above-mentioned AR markers of such as the present embodimentAnd correspondence nutritional labeling.Nutrient mapping relations：
When the mapping relations of the AR markers set up must after, the mapping relations are stored in data base 12.
Amount computing module 7 receive information is split after the information that module 3 sends, according to the number of meals information of user input,The weight required for described each AR marker is made, and is stored in data base 12.Specific demand weight can basisMultidigit is engaged in the synopsis of the method foundation correspondence food materials that the empirical value of worker's offer of food and drink is averaging, as shown in the table：
If the present embodiment user input is 3 people, then the required weight of above-mentioned AR markers is：Fructus Cucumidis sativi, 0.6Kg, egg,0.5Kg,
Auricularia, 0.3Kg, Hepar Sus domestica, 0.7Kg.
Further, when user carries out choosing food materials using described device, first image capture module 1 is to actual environmentIt is acquired, for example, gathers real world images as shown in Figure 2.After having gathered, picture recognition module 4 is according to the real world images for collectingContrasted with AR marker actual forms, there is the segment of the actual form for meeting AR markers in real world images are identifiedWhen, obtain segment location in real world images.
It is further when the segment is got in position in real world images, virtual information extraction module 6 is extracted shouldThe corresponding AR markers of segment corresponding information, i.e. nutritional labeling, nutrient, required weight information in data base.Vision wash with watercoloursDye module 8, by the segment virtual tag is carried out, and the information that virtual information extraction module 6 is extracted is illustrated in into segment in existingThe top of present position in real image, and will show that result is incident upon in OLED screen 13 and is shown.For example in the present embodimentShow that result is as shown in Figure 3.
Embodiment two
Fig. 1 is refer to, Fig. 1 formulates the augmented reality of the virtual nutritional information of combination marker for a kind of displaying that the present invention is providedDevice framework map.With reference to the content of above-mentioned first embodiment, in second embodiment of the invention, in above-mentioned first embodimentAppearance is essentially identical, and difference is that recipe formulates module 10, for formulating beneficial user according to the physical condition information of userHealthy nutritional labeling, nutrient.Recipe information judge module 11 is additionally operable to judge the formulation recipe information of user inputWhether composition, the nutrient of beneficial user's body health are covered；The recipe information processing module 13 is additionally operable to formulating recipeWhen information does not cover composition, the nutrient of beneficial user's body health, acquisition be not covered by beneficial user's body health composition,The recipe information of nutrient；Described information splits module 3 and is additionally operable to unhealthy to being not covered by beneficial user's body composition, nutritionThe recipe information of element is combined the fractionation of food.
Embodiment three
Fig. 4 is refer to, Fig. 4 formulates the augmented reality method of the virtual nutritional information of combination marker for the displaying that the present invention is providedSchematic flow sheet.Specifically, the present embodiment provides a kind of augmented reality method for showing and formulating combination marker virtual information, makesWith the augmented reality device described in claim 1, the method comprising the steps of：
Step1, obtains at least one formulation recipe information of user input；
Step2, by formulation recipe information the fractionation of food is combined, and is generated the combination after splitting and is constituted formulation recipe informationAs the food information of AR markers；
Step3, using photographic head real world images are gathered；
The real world images that described image acquisition module is gathered are identified by Step4 according to the food information actual form,Identify when having the segment for meeting the food information actual form in real world images, obtain the segment residing in real world imagesPosition；
Step5, generates virtual tag and virtual tag is illustrated in into the top of segment present position in real world images, and by exhibitionShow result to be incident upon in OLED screen to be shown.
As a kind of optimal way of the present invention, after step4, also include：
Several AR markers are set up with tie element, the mapping relations of nutrient and is stored in data base；
Composition corresponding with the food information, nutrient are transferred from the data base；
The food information tie element, nutrient are illustrated in into segment present position in real world images as virtual informationTop.
As a kind of optimal way of the present invention, after step2, also include：
Obtain the number of meals of user input；
Calculated according to number of meals and formulate the corresponding demand weight of food information after recipe information splits；
After step4, also include：
The corresponding demand weight of the food information is illustrated in into segment present position in real world images as virtual informationTop.
As a kind of optimal way of the present invention, before step2, also include：
Communicate with obtaining the physical condition information of user with sign monitor device；
The recipe of beneficial user's body health is formulated according to the physical condition information of user；
Judge user input formulates whether recipe information is covered by the recipe that recipe formulates module formulation；
When formulation recipe information is not covered by the recipe that recipe formulates module formulation, the recipe letter not being included is obtainedBreath；
The recipe information to not being included is not combined the fractionation of food.
Used as a kind of optimal way of the present invention, a kind of described displaying is formulated the enhancing of combination marker virtual information and is showedReal method, also includes：
Judge composition, the nutrient that whether recipe information covers beneficial user's body health formulated of user input；
When formulation recipe information does not cover composition, the nutrient of beneficial user's body health, acquisition is not covered by beneficial userHealthy composition, the recipe information of nutrient；
The fractionation of food is not combined to being not covered by the beneficial composition of user's body health, the recipe information of nutrient.
It should be understood that the process that embodiment two is implemented can be corresponding with the description of embodiment one, no longer retouch in detail hereinState.
The augmented reality device that embodiment one is provided, is only illustrated with the division of above-mentioned each functional module, realIn the application of border, above-mentioned functions distribution can be completed by different functional modules as desired, will augmented reality deviceInternal structure is divided into different functional modules, to complete all or part of function described above.
Above-described embodiment technology design only to illustrate the invention and feature, its objective is to allow the skill for being familiar with the technical fieldArt personnel will appreciate that present disclosure and implement according to this, can not be limited the scope of the invention with this.All basesEquivalents or modification done by spirit of the invention, all should be included within the scope of the present invention.