Invention content
The present invention provides a kind of method and system of information recommendation, to solve existing in the prior art be userThe technical issues of recommendation meets the product information of user's use condition.
In a first aspect, in order to solve the above technical problems, a kind of technology of information recommendation method provided in an embodiment of the present inventionScheme is as follows：
Panoramic scanning is carried out to target environment by image acquisition device, obtains the panoramic picture of the target environment；
The panoramic picture is identified by 3D object recognition techniques, generates the three-dimensional corresponding to the target environmentInformation；Wherein, included at least in the three-dimensional information in the target environment and the target environment space structure of article andDimension information；
Information and the three-dimensional information according to the demand of user, the target ring can be placed in by being screened from product databaseProduct in border obtains effective product；
The information of effective product is pushed to user.
Three-dimensional information is carried out to the panoramic picture of the collected target environment of image acquisition device by 3D object recognition techniquesIdentification, and then demand information further according to user and three-dimensional information can be placed in target environment from screening in product databaseEffective product, the effective product filtered out is finally pushed to user.So as to which the product of user's use condition will be metInformation recommendation is to user.
Optionally, information and the three-dimensional information according to the demand of user, from product database screening can be placed in instituteThe product in target environment is stated, effective product is obtained, including：
Screening meets the product collection of the demand information from the product database；
From the three-dimensional information, the three-dimensional dimension of effective use space of designated position is determined；It is described effective using emptyBetween for not no barrier space；
Judge the product concentrate each product three-dimensional dimension whether effective use space three-dimensional dimensionIn range, judging result is obtained；By three-dimensional dimension in the judging result in the three-dimensional dimension of effective use spaceProduct, as effective product.
Information carries out primary screening to the product in product database according to the demand of user, selects and meets user's needsProduct collection carries out postsearch screening to the product that product is concentrated further according to the three-dimensional dimension of the useful space of designated position later, makesThe effective product selected can meet user demand but also meet the use condition of designated position in target environment.
Optionally, after the acquisition judging result, further comprise：
If the judging result shows that the product concentrates the three-dimensional dimension of none of product effectively to make describedWith in the three-dimensional dimension in space, then the placement position of article in the target environment is adjusted, the product is made to be concentrated toIt is few to be placed in the designated position there are one product；
Placement position information after adjustment is pushed to the user.
It is adjusted by the placement position to article in target environment, enables product that at least one product to be concentrated to be putIt is placed on designated position, and the placement position information after adjustment is pushed to user so that when carrying out postsearch screening to product collectionBoth the product for not meeting use condition had been made, and can also provide other solution to the user, so as to better meet userDemand promotes user experience.
Optionally, before obtaining effective product, further comprise：
The first operation based on user in the corresponding virtual environment image of the target environment, determines the specific bitIt sets；Wherein, the virtual environment image is generated based on the three-dimensional information.
Optionally, before obtaining effective product, further comprise：
Product information and common placement position are concentrated based on the product, predicts the product of the product concentration in the meshThe position that may be put in mark environment, obtains the designated position.
Optionally, after the information of effective product being pushed to user, further comprise：
By in the image superposition of effective product to the corresponding virtual environment image of the target environment, and superposition is presentedVirtual environment image afterwards；Wherein, the virtual environment image is generated based on the three-dimensional information.
Second aspect, an embodiment of the present invention provides a kind of systems for information recommendation, including：
Scanning element obtains the target environment for carrying out panoramic scanning to target environment by image acquisition devicePanoramic picture；
Recognition unit is identified the panoramic picture for passing through 3D object recognition techniques, generates the target ringThree-dimensional information corresponding to border；Wherein, object in the target environment and the target environment is included at least in the three-dimensional informationThe space structure and dimension information of product；
Screening unit, for information and the three-dimensional information according to the demand of user, being screened from product database can holdThe product being placed in the target environment obtains effective product；
Push unit, for the information of effective product to be pushed to user.
Optionally, the screening unit, is specifically used for：
Screening meets the product collection of the demand information from the product database；
From the three-dimensional information, the three-dimensional dimension of effective use space of designated position is determined；It is described effective using emptyBetween for not no barrier space；
Judge the product concentrate each product three-dimensional dimension whether effective use space three-dimensional dimensionIn range, judging result is obtained；By three-dimensional dimension in the judging result in the three-dimensional dimension of effective use spaceProduct, as effective product.
Optionally, the screening unit, is further used for：
If the judging result shows that the product concentrates the three-dimensional dimension of none of product effectively to make describedWith in the three-dimensional dimension in space, then the placement position of article in the target environment is adjusted, the product is made to be concentrated toIt is few to be placed in the designated position there are one product；
Placement position information after adjustment is pushed to the user.
Optionally, the screening unit, is further used for：
The first operation based on user in the corresponding virtual environment image of the target environment, determines the specific bitIt sets；Wherein, the virtual environment image is generated based on the three-dimensional information.
Optionally, the screening unit, is further used for：
Product information and common placement position are concentrated based on the product, predicts the product of the product concentration in the meshThe position that may be put in mark environment, obtains the designated position.
Optionally, the push unit, is further used for：
By in the image superposition of effective product to the corresponding virtual environment image of the target environment, and superposition is presentedVirtual environment image afterwards；Wherein, the virtual environment image is generated based on the three-dimensional information.
The third aspect, the embodiment of the present invention also provide a kind of device for information recommendation, including：
At least one processor, and
The memory being connect at least one processor；
Wherein, the memory is stored with the instruction that can be executed by least one processor, at least one placeThe instruction that device is stored by executing the memory is managed, the method as described in above-mentioned first aspect is executed.
Fourth aspect, the embodiment of the present invention also provide a kind of computer readable storage medium, including：
The computer-readable recording medium storage has computer instruction, when the computer instruction is run on computersWhen so that computer executes the method as described in above-mentioned first aspect.
The technical solution in said one or multiple embodiments through the embodiment of the present invention, the embodiment of the present invention at least haveThere is following technique effect：
In embodiment provided by the invention, by 3D object recognition techniques to the collected target environment of image acquisition devicePanoramic picture carry out the identification of three-dimensional information, and then further according to the demand information and three-dimensional information of user from product databaseScreening can be placed in effective product in target environment, and the effective product filtered out is finally pushed to user.So as to incite somebody to actionThe product information for meeting user's use condition recommends user.
Specific implementation mode
Implementation column of the present invention provides a kind of method and system of information recommendation, to solve existing in the prior art cannot beUser recommends the technical issues of meeting the product information of user's use condition.
In order to solve the above technical problems, general thought is as follows for technical solution in the embodiment of the present application：
A kind of method of information recommendation is provided, including：Panoramic scanning is carried out to target environment by image acquisition device, is obtainedThe panoramic picture of target environment；Panoramic picture is identified by 3D object recognition techniques, is generated corresponding to target environmentThree-dimensional information；Wherein, the space structure and dimension information of article in target environment and target environment are included at least in three-dimensional information；Information and three-dimensional information according to the demand of user can be placed in the product in target environment from screening in product database, obtainEffective product；The information of effective product is pushed to user.
Due in the above scheme, being by 3D object recognition techniques to the complete of the collected target environment of image acquisition deviceScape image carries out the identification of three-dimensional information, and then demand information further according to user and three-dimensional information are screened from product databaseThe effective product filtered out is finally pushed to user by the effective product that can be placed in target environment.So as to meetThe product information of user's use condition recommends user.
In order to better understand the above technical scheme, below by attached drawing and specific embodiment to technical solution of the present inventionIt is described in detail, it should be understood that the specific features in the embodiment of the present invention and embodiment are to the detailed of technical solution of the present inventionThin explanation, rather than to the restriction of technical solution of the present invention, in the absence of conflict, the embodiment of the present invention and embodimentIn technical characteristic can be combined with each other.
Referring to FIG. 1, the embodiment of the present invention provides a kind of method of information recommendation, the processing procedure of this method is as follows.
Step 101：Panoramic scanning is carried out to target environment by image acquisition device, obtains the panoramic picture of target environment.
Wherein, image acquisition device can be the camera on user terminal such as smart mobile phone that user uses, can also beWhich kind of type the monitoring camera being installed in user family, specific image acquisition device are, are not limited herein.
For example, user can carry out panoramic scanning by mobile phone to parlor, the panoramic picture in parlor is obtained；If the visitor of userMonitoring camera or computer camera are mounted in the Room, can also by monitoring camera or computer camera to parlor intoRow panoramic scanning obtains the panoramic picture in parlor.
Target environment can be some room in user family, can also be certain office of company etc., objectivesEnvironment is what is not limited herein.
After the panoramic picture for obtaining target environment, step 102 can be executed.
Step 102：Panoramic picture is identified by 3D object recognition techniques, generates the three-dimensional corresponding to target environmentInformation；Wherein, the space structure and dimension information of article in target environment and target environment are included at least in three-dimensional information.
For example, it is assumed that user is the panoramic picture in the parlor scanned by user terminal mobile phone, then first, user opens handSpecific APP in machine, selects panoramic scanning to obtain the panoramic picture in parlor in APP, which is sent to APP by APPCorresponding background server, server are identified panoramic scanning image by 3D object recognition techniques, generate the three of parlorTie up information.And the profile in parlor and wherein article is labeled in panoramic picture according to the three-dimensional information, by the panorama after markImage is sent in the cell phone application of user and shows, it is (other similar to no longer if the width in mark parlor is 4.8m to refer to Fig. 2It repeats).In fig. 2, it can not only show the parlor panorama sketch after being identified, and can also show the vertical view in parlor simultaneously,And North and South direction (N represents the north, S represents south) is indicated in a top view, the entirety in parlor can be more accurately reacted in this wayStructure.
If it is to be appreciated that being equipped in the parlor of user, monitoring camera is logical, and user can also pass through mobile phone and monitoringCamera be connected, by monitoring camera scan parlor panoramic picture, even if so that user see in market it is desiredThe panoramic picture in parlor can be remotely obtained when the family product of purchase；If the user terminal that user uses is computer, openingWhen specified application software or webpage, the monitoring camera that can be connected by computer camera or with computer carries out full parlorScape scans, and obtains panoramic picture, and panoramic picture is sent to server and is identified, obtains the three-dimensional information in parlor.Certainly,If the performance of user terminal is good enough, above-mentioned identification function can also be put and be handled in the user terminal, it is specific above-mentionedIdentification function is handled in user terminal processes or by back-end server, is not limited.Wherein, user terminal is not onlyIncluding mobile phone, computer further including tablet computer etc. itself has camera, or can connect the electronics of external camera and setIt is standby.
After the three-dimensional information for generating target environment, step 103 can be executed.
Step 103：The three-dimensional information of information and target environment according to the demand of user, being screened from product database can holdThe product being placed in target environment obtains effective product.
Specifically, effective product can be obtained in the following manner：
First, the product collection of meet demand information is screened from product database.Wherein, product database is that storage providesVarious products information database, every product information may include the title of product, three-dimensional dimension, floor space, whetherNeed power supply, power consumption, usual placement position etc..Demand information is specially the name of product of user demand, specification requirement etc., is such as usedFamily needs the refrigerator of a 200-300L.
Secondly, from the three-dimensional information of target environment, the three-dimensional dimension of effective use space of designated position is determined；ItsIn, effective use space is the space of not barrier.
Specifically, designated position is the first operation determination in the corresponding virtual environment image of target environment based on user's；Wherein, virtual environment image is generated based on three-dimensional information.
As soon as example, user in fig. 2 be located at air-conditioning side south corner to place a refrigerator, the virtual ring in parlorClicking operation has been carried out at the corner during border image is corresponding, naturally it is also possible to is other operations, such as be drawn a circle, then the quiltThe position clicked or drawn a circle is designated position.
If there is no the placement positions for indicating refrigerator in the corresponding virtual environment image of target environment image by user, thenDesignated position can also be to concentrate product information and common placement position based on product, and the product that prediction product is concentrated is in target ringThe position that may be put in border.
For example, the common placement position of refrigerator is in parlor or kitchen, and it is typically necessary near wall, wall and needs stateMark three plug-and-sockets, and at this time scanning input be parlor panoramic picture, then can find out has three plug-and-sockets in parlor Kao QiangPosition, and then determine each position the useful space three-dimensional dimension compared with the three-dimensional dimension of refrigerator, will houseCompared with the refrigerator of multiple types the corresponding position of the useful space as designated position, can also be by the corresponding position of all useful spacesIt is all set out and is selected for user, the position that user is selected is as designated position.
Again, judge product concentrate each product three-dimensional dimension whether effective use space three-dimensional dimension rangeIt is interior, obtain judging result.
Finally, product of the three-dimensional dimension in the three-dimensional dimension of effective use space in result is will determine that, as effective productionProduct.
For example, still by taking Fig. 2 as an example, it is assumed that user needs to purchase a refrigerator for being placed in parlor, it is desirable that250-300L, it is desirable that specific placement position (i.e. designated position) be at the corner in air-conditioning side south.
First, the refrigerator of 250-300L is filtered out from product database, it is assumed that the refrigerator screened there are 3, successivelyFor：The three-dimensional dimension of 258L is 590 × 645 × 1804 (wide × deep × high), and the three-dimensional dimension of 274L is 612 × 662 × 1754The three-dimensional dimension of (wide × deep × high), 288L is 630 × 607 × 1770 (wide × deep × high), these three refrigerators are to meet needSeek the product collection of information.
Secondly, from the three-dimensional information in parlor, it may be determined that the three-dimensional dimension of effective use space of designated position is1100 × 610 × 2000 (wide × deep × high).Pay attention to：Here the useful space is mainly by the extension elongation of the load bearing wall in corner(610), nearby by the limitation of the built-in wardrobe and decoration painting of upper end, they can be considered as barrier.
Again, according to the three-dimensional of the product collection for the meet demand information selected (i.e. these three refrigerators of 258L, 274L, 288L)Size and the useful space, it can be determined that go out two refrigerators of 258L, 274L not within the scope of the useful space, and the refrigerator of 288LWithin the scope of effective use space.
Finally, according to above-mentioned judging result, using the refrigerator of 288L as effective product.
Further, if judging result shows that product concentrates the three-dimensional dimension of none of product to use sky effectiveBetween three-dimensional dimension in, then the placement position of article in target environment is adjusted, product is made to concentrate at least one productDesignated position can be placed in；And the placement position information after adjustment is pushed to the user.
Still by taking the example above as an example, if the three-dimensional dimension of the useful space be 610 × 610 × 2000 (it is wide × deep ×It is high), then the placement position of the decoration painting in parlor is adjusted, such as can be whole to the movement of the direction of sofa by decoration painting30mm, in this way, the useful space just becomes 640 × 610 × 2000 (wide × deep × high), this just makes product concentrate at least oneProduct (i.e. the refrigerator of 288L) can be placed in the position that user specifies.
After obtaining effective product through the above way, step 104 can be executed.
Step 104：The information of effective product is pushed to user.
Further, after the information of effective product is pushed to user, by the image superposition of effective product to targetIn the corresponding virtual environment image of environment, and the virtual environment image after superposition is presented；Wherein, virtual environment image is to be based on threeTie up what information generated.
Present superposition after virtual environment image mode, can be specifically：
If user uses AR equipment, the corresponding 3-D view of effective product in virtual environment image is added to meshIt is presented to the user in mark environment.
For example, user uses AR equipment at home, (at this time by the corresponding 3-D view of effective product in virtual environment image3-D view be interpreted as the threedimensional model of effective product, and the appearance in kind, size of the threedimensional model and effective product areIt is consistent) be placed into the designated position in parlor (i.e. display environment), allow user can by AR technologies come augmented reality sense, fromAnd virtual reality experience on the spot in person is brought to user, correctly to select suitable product.
If user uses the electronic equipment of non-AR equipment, by virtual environment image with the shape of tri-dimensional picture or animationFormula is presented to the user.
For example, user uses mobile phone, then the threedimensional model of effective product (such as air purifier) can will be superimposedVirtual environment image be presented to the user in the form of picture or animation, as shown in Figure 3.
Further, if effectively product is multiple, the threedimensional model of each product in effective product can be folded respectivelyIt is added in the virtual environment image of target environment, obtains the design sketch of putting of each product, it later, can be by the pendulum of each productIt puts design sketch to be presented to the user, the design sketch of putting for allowing user therefrom to select to need, and then determines the product of actual selection.
Obtain each product put design sketch after, can also allow user pass through AR equipment watch it is every in effective productA product simulates using effect in display environment, and can also be added to the superposition effect of each product in display environment through the stackFruit is analyzed, and analysis result is pushed to user.
By image acquisition device scan target environment panoramic picture, and using 3D object recognition techniques to panoramic picture intoRow identification, obtains the three-dimensional information of target environment, and then demand information further according to user and three-dimensional information are from product databaseMiddle screening can be placed in effective product in target environment, and the effective product filtered out is finally pushed to user.Will be effectiveIt when product is pushed to user, can be presented to the user by way of virtual reality or picture or animation, so as to will be effectiveUsing effect of the product in target environment is presented in a manner of virtual reality, 3-D view, animation, and user is allowed to have intuitive senseBy.
Based on same inventive concept, a kind of system for information recommendation is provided in one embodiment of the invention, the systemThe specific implementation mode of information recommendation method can be found in the description of embodiment of the method part, and overlaps will not be repeated, refer toFig. 4, the system include：
Scanning element 401 obtains the target environment for carrying out panoramic scanning to target environment by image acquisition devicePanoramic picture；
Recognition unit 402 is identified the panoramic picture for passing through 3D object recognition techniques, generates the targetThree-dimensional information corresponding to environment；Wherein, it is included at least in the target environment and the target environment in the three-dimensional informationThe space structure and dimension information of article；
Screening unit 403 screens energy for information and the three-dimensional information according to the demand of user from product databaseThe product being placed in the target environment obtains effective product；
Push unit 404, for the information of effective product to be pushed to user.
Optionally, the screening unit 403, is specifically used for：
Screening meets the product collection of the demand information from the product database；
From the three-dimensional information, the three-dimensional dimension of effective use space of designated position is determined；It is described effective using emptyBetween for not no barrier space；
Judge the product concentrate each product three-dimensional dimension whether effective use space three-dimensional dimensionIn range, judging result is obtained；By three-dimensional dimension in the judging result in the three-dimensional dimension of effective use spaceProduct, as effective product.
Optionally, the screening unit 403, is further used for：
If the judging result shows that the product concentrates the three-dimensional dimension of none of product effectively to make describedWith in the three-dimensional dimension in space, then the placement position of article in the target environment is adjusted, the product is made to be concentrated toIt is few to be placed in the designated position there are one product；
Placement position information after adjustment is pushed to the user.
Optionally, the screening unit 403, is further used for：
The first operation based on user in the corresponding virtual environment image of the target environment, determines the specific bitIt sets；Wherein, the virtual environment image is generated based on the three-dimensional information.
Optionally, the screening unit 403, is further used for：
Product information and common placement position are concentrated based on the product, predicts the product of the product concentration in the meshThe position that may be put in mark environment, obtains the designated position.
Optionally, the push unit 404, is further used for：
By in the image superposition of effective product to the corresponding virtual environment image of the target environment, and superposition is presentedVirtual environment image afterwards；Wherein, the virtual environment image is generated based on the three-dimensional information.
Fig. 5 is referred to, same inventive concept is based on, the embodiment of the present invention provides a kind of device for information recommendation, shouldIncluding at least one processor 501, at least one processor 501 is connect by bus with memory 502, for executing memoryThe step of information recommendation method that embodiment shown in FIG. 1 provides is realized when the computer program stored in 502.
Optionally, at least one processor 501 can specifically include central processing unit (CPU), application-specific integrated circuit(application specific integrated circuit, ASIC) can be that one or more is held for controlling programCapable integrated circuit can be that use site programmable gate array (field programmable gate array, FPGA) is openedThe hardware circuit of hair can be baseband processor.
Optionally, at least one processor 501 may include at least one processing core.
Optionally, which further includes memory 502, and memory 502 may include read-only memory (read onlyMemory, ROM), random access memory (random access memory, RAM) and magnetic disk storage.Memory 502 is usedRequired data when storing at least one processor 501 and running.The quantity of memory 502 is one or more.Wherein, it storesDevice 502 shows together in Figure 5, but it is understood that memory 502 is not essential function module, thus in Figure 5 withDotted line is shown.
Based on same inventive concept, the embodiment of the present invention provides a kind of computer readable storage medium, and the computer canIt reads storage medium and is stored with computer instruction, when the computer instruction is run on computers so that computer executes such asMethod shown in FIG. 1.
In embodiment provided by the invention, by 3D object recognition techniques to the collected target environment of image acquisition devicePanoramic picture carry out the identification of three-dimensional information, and then further according to the demand information and three-dimensional information of user from product databaseScreening can be placed in effective product in target environment, and the effective product filtered out is finally pushed to user.So as to incite somebody to actionThe product information for meeting user's use condition recommends user.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program productionProduct.Therefore, in terms of the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and hardwareEmbodiment form.Moreover, it wherein includes computer available programs generation that the embodiment of the present invention, which can be used in one or more,The meter implemented in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of codeThe form of calculation machine program product.
The embodiment of the present invention be with reference to according to the method for the embodiment of the present invention, equipment (system) and computer program productFlowchart and/or the block diagram describe.It should be understood that can be realized by computer program instructions in flowchart and/or the block diagramThe combination of flow and/or box in each flow and/or block and flowchart and/or the block diagram.These calculating can be providedProcessing of the machine program instruction to all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devicesDevice is to generate a machine so that the instruction executed by computer or the processor of other programmable data processing devices generatesFor realizing the function of being specified in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxesDevice.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spyDetermine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring toEnable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram orThe function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that countSeries of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer orThe instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram oneThe step of function of being specified in a box or multiple boxes.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the artGod and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologiesWithin, then the present invention is also intended to include these modifications and variations.