One realizes 3D graphical virtual managing and control system and its implementation to intelligent applianceTechnical field
The present invention relates to a kind of 3D graphical virtual managing and control system, particularly intelligent appliance is realized to intelligent domestic system and its implementation of the management and control of 3D graphical virtual.The present invention to the obtain manner of the 3D data model of intelligent appliance, how household electrical appliances information and real-time running state are represented by 3D rendering, and carry out fully open eventually through the technical scheme of 3D figure how operative intelligence household electrical appliances.
Background technology
At present, some methods of carrying out management and control to intelligent appliance that market occurs are generally carry out managing based on 2-d plane graph and control, such as, will there will be following problem when utilizing current 2-d plane graph to carry out management and control to the smart jack of family: bedroom 1 socket 1, bedroom 1 socket 2, bedroom 2 socket 1, bedroom 2 socket 2 ... these sockets all carry out arrangement with tabular form and represent, general one family has tens sockets, at most up to a hundred sockets at least, and the socket that such exhibition method is shown is difficult to carry out one_to_one corresponding with the socket in kind in family.Especially such Smart Home management-control method is used for new guest, be at a loss especially, be even easy to occur maloperation.Smart Home original intention is the life be convenient for people to, but but brings extra burden to the life of people based on 2-d plane graph to the system that intelligent appliance carries out management and control, causes Smart Home to be promoted.
When prior art development, part manufacturer has come to realise the development prospect using 3D figure Smart Home to be carried out to virtual management and control, and payes attention to the research and development to above-mentioned technical field, such as:
The application number Chinese patent application that is 200910042078.9 is disclosed to a kind of construction method of intelligent home control device user interface, comprising: user searches for the house tomograph consistent with residence general layout and the two-dimentional icon of controlled plant from picture library; According to the fitting structure in residence, the icon of corresponding controlled plant is placed on the relevant position in house tomograph; The icon setting up corresponding controlled plant links with the control of the controlled plant of reality in residence.Still there is following several deficiency in the method: (1) described method only describes the loading how house being realized to three-dimensional picture, and still use two-dimentional icon to manipulate to intelligent appliance, especially the real-time running state for household electrical appliances cannot be played up, cause user's checking or manipulating still not intuitively intelligent appliance, conveniently can not realize the management and control to intelligent appliance; (2) described method needs manually to participate in search in the search three-dimensional picture in house and the X-Y scheme timestamp of intelligent appliance, so not only bring the running cost of great number to user and search three-dimensional picture out or two-dimentional icon also often not precisely, cause the follow-up management and control to household electrical appliances to there is great number of issues; (3) described method how household electrical appliances information or real-time running state are shown and technical scheme that how intelligent appliance is manipulated by two-dimentional icon open; (4) described method does not carry out local cache to the three-dimensional house graphic after download or two-dimentional household electrical appliances icon, so that system relies on by force picture library on line, cannot accomplish offline operation.
The Chinese patent application being 201310307107.6 for application number discloses a kind of Smart Home method for supervising, client and related device, described scheme comprises: use 3D panoramic camera to take to carry out three-dimensional modeling to house and intelligent appliance etc. to house, and gone out the relative coordinate of controlled household electrical appliances by the focal length of video camera and each intelligent appliance position calculation, with to control household electrical appliances position; The method needs user to use 3D panoramic camera to take, therefore, the method not only needs the high cost outside user's amount paid to buy corresponding 3D equipment, and user needs the technique for taking possessing 3D panoramic camera, such cost is very high, so that the method cannot well be promoted.
Summary of the invention
1. invent the technical matters that will solve
Based on 2-d plane graph intelligent appliance to be managed and control brings difficult management for mentioned in prior art, the problem of complicated operation, and existing 3D graphical virtual managing and control system, its cost is higher, use the problems such as extremely inconvenient, the invention provides a kind of intelligent domestic system and its implementation of intelligent appliance being realized to the management and control of 3D graphical virtual, namely by the model and instruction modular converter in 3D graphical virtual managing and control system, property value corresponding to its 3D data model is set according to the information of intelligent appliance or real-time running state, carry out 3D rendering for 3D graphics rendering engine to it to play up, can be installed in existing 3D building model by the 3D rendering after playing up, user just can see in real time with real world same or analogous 3D dummy model, on the other hand, user operation, by carrying out management and control to playing up rear 3D dummy model, is converted to the operational order of intelligent appliance by user by model and instruction modular converter, and is handed down to corresponding intelligent appliance.Based on 3D graphical virtual managing and control system, user can realize carrying out managing to the intelligent appliance of real world and controlling by management and control 3D dummy model.
2. technical scheme
The present invention has carried out disclosing fully to the technic relization scheme that intelligent appliance realizes 3D graphical virtual managing and control system, and it is as follows that system comprises module:
Model and instruction modular converter, on the one hand, the information of the intelligent appliance obtained from family's electrical communication interface or real-time running state are set to the property value of 3D data model by model and instruction modular converter in real time, carry out 3D rendering for 3D graphics rendering engine to play up, user just can see the 3D dummy model of the same or analogous intelligent appliance with real world in real time; On the other hand, it is the steering order of intelligent appliance that model and instruction modular converter realizes the operation transformation of user to the 3D figure of intelligent appliance, and is handed down to corresponding intelligent appliance by family's electrical communication interface.
The local memory module of data model, the local memory module of described data model is responsible for from 3D model cloud service system, downloading 3D initial data model and being stored in this locality, to realize " once download, offline operation "; This module belongs to the optional module in overall plan, if there is no this module, do not affect the feasibility of overall technical architecture, but 3D initial data model all needs to obtain from 3D model cloud service system at every turn, so just cannot accomplish " once download, offline operation ";
Module is monitored in operation, and module in charge is monitored in described operation provides 3D figure can action-item data to user, to point out user can carry out which operation to this 3D figure, and catches the concrete operations of user to 3D figure from operation interface;
3D graphics rendering engine, described 3D graphics rendering engine is responsible for that the 3D data model that model and instruction modular converter exports is carried out 3D rendering and is played up, to form the same or analogous 3D rendering model with real world.
Family's electrical communication interface, described family's electrical communication interface is responsible for setting up communication port with intelligent appliance, and by this communication port, 3D graphical virtual managing and control system can carry out message intercommunication with intelligent appliance;
Cloud service communication interface, described cloud service communication interface is responsible for setting up communication port with 3D model cloud service system, and by this communication port, 3D graphical virtual managing and control system can carry out message intercommunication with 3D model cloud service system;
External system involved by 3D graphical virtual managing and control system has: intelligent appliance, can receive instruction or parameter that outside issues and carry out the household electrical appliances of action according to these instructions or parameter; 3D model cloud service system, can provide the service system of the remote download of 3D initial data model.
Intelligent appliance realizes the implementation method of 3D graphical virtual managing and control system, and its step comprises:
The first step: intelligent appliance reports household electrical appliances information or real-time running state
Intelligent appliance reports home wiring control mark, household electrical appliances 3D model identification, household electrical appliances information or real-time running state message by family's electrical communication interface of 3D graphical virtual managing and control system to model and instruction modular converter.Described home wiring control mark is each intelligent appliance of management and control and the unique identification that distributes in family lan, can from a certain intelligent appliance of family lan inner position by this mark; 3D model identification is generally that intelligent appliance writes when dispatching from the factory, and e.g., XXX producer XXX product type XXX model etc., can search corresponding 3D initial data model from 3D model cloud service system by this mark; Household electrical appliances information or real-time running state, the essential information of mark intelligent appliance or current running status, as: the date of production, on off state, air-conditioner temperature etc.
After model and instruction modular converter receives home wiring control mark, household electrical appliances 3D model identification, household electrical appliances information or real-time running state message from family's electrical communication interface, then can action-item information according to 3D Real-time Data Model corresponding to home wiring control identifier lookup and 3D figure from one-level mapping table; Namely store in one-level mapping table home wiring control mark and corresponding 3D Real-time Data Model and 3D figure can the mapping relations of action-item information (so-called 3D data model is exactly to be resolved by 3D graphics rendering engine and the data message played up; So-called 3D figure can action-item information be exactly which operation identifying user can carry out, as intelligent air condition 3D figure can have by action-item to the intelligent appliance corresponding to this 3D figure: power supply opens or closes, temperature is arranged, wind-force arranges).
Can action-item information if (1-1) there is corresponding 3D Real-time Data Model and 3D figure in one-level mapping table, then directly upgrade the property value of this 3D Real-time Data Model according to received home wiring control mark, household electrical appliances 3D model identification, household electrical appliances information or real-time running state message and be stored in one-level mapping table; Finally being exported via model and instruction modular converter by the 3D Real-time Data Model after renewal in one-level mapping table sends to 3D graphics rendering engine to carry out 3D graph rendering; Now, the 3D model identification of the intelligent appliance of its correspondence and household electrical appliances information and real-time running state can be shown in real time by the 3D figure after playing up.
Can action-item information if (1-2) there is not corresponding 3D Real-time Data Model and 3D figure in one-level mapping table, then first needing to obtain corresponding 3D initial data model and 3D figure can action-item information (obtain corresponding 3D initial data model concrete scheme can see " obtaining the technical scheme of 3D initial data model "), and home wiring control mark can action-item information be stored in one-level mapping table with the 3D initial data model got and 3D figure, and the property value of the 3D initial data model that home wiring control mark is corresponding in one-level mapping table is upgraded according to household electrical appliances information or real-time running state, now, 3D initial data model after upgrading in one-level mapping table is 3D Real-time Data Model.Finally being exported via model and instruction modular converter by the 3D Real-time Data Model after renewal in one-level mapping table sends to 3D graphics rendering engine to carry out 3D graph rendering.Now, the 3D model identification of the intelligent appliance of its correspondence and household electrical appliances information and real-time running state can be shown in real time by the 3D figure after playing up.
The technical method obtaining 3D initial data model according to 3D model identification has two schemes, optional one:
Technical scheme one, need the local memory module of data model, its detailed step is:
By model and instruction modular converter to the local memory module of data model send search corresponding 3D initial data model and 3D figure according to household electrical appliances 3D model identification can the request message of action-item information, the local memory module of data model from the secondary mapping table oneself stored, searches corresponding 3D initial data model according to received 3D model identification and 3D figure can action-item information.
Can action-item information if (1-1) there is corresponding 3D initial data model and 3D figure in secondary mapping table, then direct the 3D initial data model found and 3D figure action-item information can be returned to model and instruction modular converter;
Can action-item information if (1-2) there is not corresponding 3D initial data model and 3D figure in secondary mapping table, then by the local memory module of data model by cloud service communication interface to 3D model cloud service system send search corresponding 3D initial data model and 3D figure according to household electrical appliances 3D model identification can the request message of action-item information, searching corresponding 3D initial data model and 3D figure by 3D model cloud service system according to received household electrical appliances 3D model identification can action-item information, and found 3D initial data model is returned to the local memory module of data model by cloud service communication interface, by data model local memory module, 3D model identification and received 3D initial data model and 3D figure can action-item information be stored in secondary mapping table again, and received 3D initial data model and 3D figure action-item information can be returned to model and instruction modular converter in the lump,
Technical scheme two: do not need the local memory module of data model, its detailed step is:
By model and instruction modular converter directly by cloud service communication interface to 3D model cloud service system send search corresponding 3D initial data model and 3D figure according to household electrical appliances 3D model identification can the request message of action-item information, searching corresponding 3D initial data model and 3D figure by 3D model cloud service system according to received household electrical appliances 3D model identification can action-item information, and found 3D initial data model and 3D figure action-item information can be returned to model and instruction modular converter by cloud service communication interface;
Second step: user is manipulated intelligent appliance by 3D figure
When user opens 3D graphical interfaces, 3D graphics rendering engine can be triggered all by the request message of the intelligent appliance of management and control to model and instruction modular converter transmission inquiry, it is all by after the request message of the intelligent appliance of management and control that model and instruction modular converter receives inquiry, in the one-level mapping table stored, all 3D Real-time Data Model records return to 3D graphics rendering engine, are played up one by one all 3D Real-time Data Models received by 3D graphics rendering engine;
When user operates a certain 3D figure, can trigger action monitor module to model and instruction modular converter send corresponding to this 3D figure of inquiry can the request message of action-item information, can action-item information according to home wiring control identified query 3D figure in request message from one-level mapping table by model and instruction modular converter, and found 3D figure action-item information can be returned to operation and monitor module;
The operation of user by monitored by operation module 3D figure can action-item information guide, and user to the operation of 3D figure can by operation monitor module catch, module is monitored in operation can send operation requests message to intelligent appliance by captured operation to model and instruction modular converter;
Model and instruction modular converter is resolved request message, namely the home wiring control mark in request message and household electrical appliances operation information is parsed, the 3D Real-time Data Model corresponding according to home wiring control identifier lookup, and the property value of the manipulation state of corresponding 3D Real-time Data Model is upgraded according to household electrical appliances operation information; Again home wiring control mark and household electrical appliances operation information are re-encoded as household appliance control instruction information, finally by family's electrical communication interface, the household appliance control instruction information after coding are handed down to corresponding intelligent appliance, perform this household appliance control instruction by intelligent appliance.
3. beneficial effect
At present, some methods of carrying out management and control to intelligent appliance that market occurs are generally carry out managing based on 2-d plane graph and control, but based on 2-d plane graph, management and control is carried out to intelligent appliance and cause operation not directly perceived, complex management, extra living management burden is brought to the management and control of people to household electrical appliances, therefore, the present invention is directed to above problem and invent 3D graphical virtual managing and control system, user can realize by this 3D graphical virtual managing and control system the virtual display intelligent appliance of real world being carried out to 3D figure, and by carrying out direct management and control to these 3D figures with realization to the management of the intelligent appliance of real world and control.The novelty of 3D graphical virtual managing and control system of the present invention is embodied in:
(1) the invention provides model and instruction modular converter, with solve 3D data model in prior art cannot automatic search and loading, the problem of the real-time running state of intelligent appliance cannot be shown;
(2) the invention provides operation and monitor module, cannot guide user operation to solve 3D figure in prior art and catch the problem of user to 3D graphic operation in real time;
(3) the invention provides the local memory module of data model, the problem of " once download, offline operation " cannot be accomplished to solve in prior art.
To sum up, based on 3D graphical virtual managing and control system model and instruction modular converter, module is monitored in operation, the local memory module of data model can realize 3D data model automatic search and loading, real-time exhibition household electrical appliances running state information, correctly to quote and catch in real time, once download offline operation etc. user operation, final utilization family by the easy manipulation of 3D virtual pattern to obtain the experience consistent with real world, greatly reduce the living management cost of user.
Accompanying drawing explanation
Fig. 1 is modular structure schematic diagram intelligent appliance being realized to 3D graphical virtual managing and control system.
Fig. 2 is the sequence chart that intelligent appliance reports the crucial reciprocal process of household electrical appliances information or real-time running state.
Fig. 3 is that user is by the sequence chart of 3D figure to the crucial reciprocal process that intelligent appliance manipulates.
Embodiment
The present invention has carried out disclosing fully to the technic relization scheme that intelligent appliance realizes 3D graphical virtual managing and control system, and as shown in Figure 1, it is as follows that it comprises module:
Model and instruction modular converter, on the one hand, the essential information of the intelligent appliance obtained from family's electrical communication interface or real-time running state are set to property value corresponding to 3D data model in real time, carry out 3D rendering for 3D graphics rendering engine to play up, user just can see in real time with real world same or analogous 3D dummy model; On the other hand, be the steering order of intelligent appliance by user to the operation transformation of 3D figure, and be handed down to corresponding intelligent appliance by family's electrical communication interface.
The local memory module of data model, is responsible for the 3D data model downloaded from 3D model cloud service system and is stored in this locality, to realize " once download, offline operation "; This module belongs to the optional module in overall plan, if do not have this module, 3D initial data model needs to obtain from 3D model cloud service system, so just cannot accomplish " once download, offline operation ", but not affect the feasibility of overall plan.This module can be installed on various intelligent terminal, also can be installed on various intelligent home gateway;
Module is monitored in operation, is responsible for 3D figure and provides user-operable item number certificate, to guide user to carry out proper operation to 3D figure, and catch the concrete operations of user to 3D figure from operation interface;
3D graphics rendering engine, be responsible for that the 3D Real-time Data Model that model and instruction modular converter exports is carried out 3D rendering to play up, to be formed and the same or analogous 3D rendering model in the Zhi Shi world, generally can directly use some middlewares, as: java3D, OpenGL, DirectX3D etc.;
Family's electrical communication interface, be responsible for setting up communication port with intelligent appliance, by this communication port, 3D graphical virtual managing and control system can carry out message intercommunication with intelligent appliance;
Cloud service communication interface, be responsible for setting up communication port with 3D model cloud service system, by this communication port, 3D graphical virtual managing and control system can carry out message intercommunication with 3D model cloud service system;
3D graphical virtual managing and control system deployment way has various, include but not limited to: model and instruction modular converter, the local memory module of data model, operation monitoring module, 3D graphics rendering engine, family's electrical communication interface, cloud service communication interface all can be arranged on intelligent terminal, form 3D graphical virtual managing and control system; Also can model and instruction modular converter, the local memory module of data model, family's electrical communication interface, cloud service communication interface be arranged on intelligent home gateway, operation monitoring module, 3D graphics rendering engine are arranged on intelligent terminal, form 3D graphical virtual managing and control system by intelligent home gateway and intelligent terminal common combination; Note: man-machine interaction is responsible for by intelligent terminal, as: smart mobile phone, PAD, PC, handheld terminal etc., intelligent home gateway is responsible for carrying out networking to each intelligent appliance and mutually communicating;
External system involved by 3D graphical virtual managing and control system has: intelligent appliance, can receive instruction or parameter that outside issues and carry out the household electrical appliances of action according to these instructions or parameter; 3D model cloud service system, can provide the service system of the remote download of 3D initial data model.
To realize the implementation method of 3D graphical virtual managing and control system to intelligent air condition, its step comprises:
The first step: intelligent air condition reports household electrical appliances information or real-time running state, as shown in Figure 2:
Intelligent air condition reports home wiring control to identify and household electrical appliances 3D model identification and household electrical appliances information or real-time running state message by family's electrical communication interface of 3D graphical virtual managing and control system to model and instruction modular converter, and the home wiring control mark that intelligent air condition is assigned with is as id-12345; 3D model identification is as A producer intelligent air condition A model; Household electrical appliances information as: the date of production is on February 6th, 2015, quality guarantee 3 years etc.; Real-time running state as: Current Temperatures is 15 degrees Celsius, wind-force is gentle breeze.
After model and instruction modular converter receives intelligent air condition home wiring control mark from family's electrical communication interface and household electrical appliances 3D model identification and household electrical appliances information or real-time running state message, then from one-level mapping table according to 3D Real-time Data Model corresponding to the home wiring control identifier lookup of intelligent air condition and 3D figure can action-item information (3D Real-time Data Model can be created by 3D graphics engines such as java3D or be loaded, and can arrange according to the running status of intelligent air condition to its attribute such as color, shape; The action-item of intelligent air condition: power supply opens or closes, temperature is arranged, wind-force arranges).Can action-item information if there is the 3D Real-time Data Model of intelligent air condition and 3D figure in one-level mapping table, then direct from according to received household electrical appliances information or real-time running state, the corresponding property value to this 3D Real-time Data Model upgrades and is stored into one-level mapping table by the 3D Real-time Data Model after this renewal, finally send to 3D graphics rendering engine to carry out 3D graph rendering the 3D Real-time Data Model after renewal in one-level mapping table, can action-item information if there is not the 3D Real-time Data Model of this intelligent air condition and 3D figure in one-level mapping table, then first needing to obtain corresponding 3D initial data model and 3D figure can action-item information (obtain corresponding 3D initial data model concrete scheme can see " obtaining the technical scheme of 3D initial data model "), and home wiring control mark can action-item information be stored in one-level mapping table with the 3D initial data model got and 3D figure, according to household electrical appliances information or real-time running state, the property value of the 3D initial data model of home wiring control mark correspondence in one-level mapping table is upgraded again, now, 3D initial data model after upgrading in one-level mapping table is 3D Real-time Data Model.Finally 3D graphics rendering engine is sent to carry out 3D graph rendering the 3D Real-time Data Model after renewal in one-level mapping table, now, this 3D figure can show the 3D model identification of its corresponding intelligent air condition and household electrical appliances information and real-time running state in real time, as: 3D model identification, A producer intelligent air condition A model; Household electrical appliances information, the date of production is on February 6th, 2015, quality guarantee 3 years etc.; Real-time running state: Current Temperatures is 15 degrees Celsius, wind-force is gentle breeze.
The technical scheme obtaining 3D initial data model according to 3D model identification has two schemes, optional one:
Technical scheme one: by model and instruction modular converter to the local memory module of data model send search corresponding 3D initial data model and 3D figure according to the household electrical appliances 3D model identification of intelligent air condition can the request message of action-item information, the local memory module of data model searches corresponding 3D initial data model and 3D figure according to received 3D model identification from secondary mapping table can action-item information, can action-item information if there is corresponding 3D initial data model and 3D figure in secondary mapping table, then direct the 3D initial data model found and 3D figure action-item information can be returned to model and instruction modular converter, can action-item information if there is not corresponding 3D initial data model and 3D figure in secondary mapping table, then by the local memory module of data model by cloud service communication interface to 3D model cloud service system send search corresponding 3D initial data model and 3D figure according to household electrical appliances 3D model identification can the request message of action-item information, can action-item information according to searching corresponding 3D initial data model and 3D figure according to received household electrical appliances 3D model identification by 3D model cloud service system, and found 3D initial data model is returned to the local memory module of data model by cloud service communication interface, by data model local memory module, 3D model identification and received 3D initial data model and 3D figure can action-item information be stored in secondary mapping table again, now just storing 3D initial data model corresponding to intelligent air condition and 3D figure in secondary mapping table can action-item, and received 3D initial data model and 3D figure action-item information can be returned to model and instruction modular converter,
Technical scheme two: by model and instruction modular converter directly by cloud service communication interface to 3D model cloud service system send search corresponding 3D initial data model and 3D figure according to the household electrical appliances 3D model identification of intelligent air condition can the message of action-item information, searching corresponding 3D initial data model and 3D figure by 3D model cloud service system according to received household electrical appliances 3D model identification can action-item information, and found 3D initial data model and 3D figure action-item information can be returned to model and instruction modular converter by cloud service communication interface;
Second step: user is manipulated intelligent air condition by 3D figure, as shown in Figure 3:
When user opens 3D graphical interfaces, 3D graphics rendering engine can be triggered all by the request message of the intelligent appliance of management and control to model and instruction modular converter transmission inquiry, it is all by after the request message of the intelligent appliance of management and control that model and instruction modular converter receives inquiry, in the one-level mapping table stored, all 3D Real-time Data Model records return to 3D graphics rendering engine, are played up one by one all 3D Real-time Data Models received by 3D graphics rendering engine;
When user operates intelligent air condition 3D figure, can trigger action monitor module to model and instruction modular converter send corresponding to this 3D figure of inquiry can the request message of action-item information, can action-item information according to home wiring control identified query 3D figure in request message from one-level mapping table by model and instruction modular converter, action-item information as: operation can be opened or closed to power supply, temperature is arranged, wind-force is arranged etc., and by this can action-item information return to operation monitor module.The operation of user by monitored by operation module 3D figure can action-item information guide, as, user is 20 degrees Celsius to intelligent air condition set temperature, this operation can by operation monitor module catch, module is monitored in operation can send request message to the operation that intelligent air condition set temperature is 20 degrees Celsius to model and instruction modular converter according to captured, model and instruction modular converter is resolved request message, namely home wiring control mark corresponding to the intelligent air condition in request message is parsed and set temperature is the operation information of 20 degrees Celsius, according to the 3D Real-time Data Model of the corresponding intelligent air condition of this home wiring control identifier lookup, and the manipulation state of corresponding 3D Real-time Data Model is upgraded according to household electrical appliances operation information, again home wiring control mark and household electrical appliances operation information are re-encoded as household appliance control instruction information, finally by family's electrical communication interface, the household appliance control instruction information after coding is handed down to intelligent air condition, finally according to received household appliance control instruction, temperature is set to 20 degrees Celsius by intelligent air condition.