The content of the invention
The present invention provides a kind of 3D instant communicating systems based on WebGL and VR technologies, in instant communication processThree-dimensional display effect is presented.
A kind of 3D instant communicating systems based on WebGL and VR technologies that the present invention is provided, include the user of interconnectionEnd, including：
User terminal, including input equipment, output equipment, model creation module, model memory module, control module, communicationModule；
Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression seizure equipment, which is used to catch, to be usedThe expression at family, real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling；Output equipmentIncluding earphone, immersion VR output equipments；Model creation module is the 3D model creation modules based on WebGL technologies, for usingFamily creates 3D models；Model memory module, has the 3D models by model creation module creation；Control module is used to control userHold to the information and the display content of immersion VR output equipments sent with other users end；Communication module be used for user terminal withOther users end is communicated；
User is by model creation module creation 3D models and is stored in model memory module；Communication module sets up user terminalBetween communication；Microphone, expression catch sound, expression and the real-time 3D head portraits that equipment, real-time 3D modeling module catch userAnd send its data to control module；Control module receives the data from input equipment and read from model memory module and usedThe 3D models that family is created, and by default rule processing data, treated data are sent to other by communication module and usedFamily end；The data that other users end is transmitted by communication module are sent to control module, and control module, which is received, comes from communication moduleData and after model memory module reads the 3D models that user creates, will be treated and by default rule processing dataData send to output equipment, corresponding content output is carried out by earphone and immersion VR output equipments.
It is preferred that, the immersion VR output equipments, to wear mobile phone box.
It is preferred that, the model creation module：
For creating 3D head portraits, 3D virtual portraits and 3D backgrounds, and by the 3D head portraits created, 3D virtual portraits and3D backgrounds are according to head portrait class, visual human's species, background classes classification deposit model memory module.
It is preferred that, the input module, in addition to：
Gesture identification equipment, for recognizing the gesture of user, and sends it to control module, for according to default handThe display of gesture rule control output end, including switching 3D backgrounds, switch 3D virtual portraits, switch 3D head portraits；
Motion capture equipment, the action for catching user, and send to control module, action is carried out by control moduleSimplify after processing, sent by communication module to other users end.
It is preferred that, the control module receives the data from communication module and reads user from model memory module and creates3D models after, and by default rule processing data, treated data are sent to output equipment, including：
Control module receives the data from communication module；
Control module finds the special value in the data from communication module, when finding special value, according toThe default rule of correspondence switches corresponding 3D backgrounds, 3D virtual portraits, 3D head portraits；
Control module sends the 3D backgrounds switched, 3D virtual portraits, 3D head portraits to output equipment.
It is preferred that, the 3D head portraits, in addition to 3D expressions.
It is preferred that, the 3D backgrounds, in addition to 3D stage properties.
It is preferred that, the control module is used to control user terminal to the information and immersion VR sent with other users endThe display content of output equipment, including：
Control module is then forwarded to output equipment after being deformed 3D head portraits, 3D stage properties and exported.
A kind of 3D instant communicating systems based on WebGL and VR technologies that the present invention is provided, can be in instant communication processIt is middle that three-dimensional display effect is presented.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specificationObtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by the explanations writeSpecifically noted structure is realized and obtained in book, claims and accompanying drawing.
Below by drawings and examples, technical scheme is described in further detail.
Embodiment
The preferred embodiments of the present invention are illustrated below in conjunction with accompanying drawing, it will be appreciated that preferred reality described hereinApply example to be merely to illustrate and explain the present invention, be not intended to limit the present invention.
As shown in figure 1, being a kind of signal of the 3D instant communicating systems based on WebGL and VR technologies in the embodiment of the present inventionFigure, includes the user terminal of interconnection, including：
User terminal, including input equipment, output equipment, model creation module, model memory module, control module, communicationModule；
Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression seizure equipment, which is used to catch, to be usedThe expression at family, real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling；Output equipmentIncluding earphone, immersion VR output equipments；Model creation module is the 3D model creation modules based on WebGL technologies, for usingFamily creates 3D models；Model memory module, has the 3D models by model creation module creation；Control module is used to control userHold to the information and the display content of immersion VR output equipments sent with other users end；Communication module be used for user terminal withOther users end is communicated；
User is by model creation module creation 3D models and is stored in model memory module；Communication module sets up user terminalBetween communication；Microphone, expression catch sound, expression and the real-time 3D head portraits that equipment, real-time 3D modeling module catch userAnd send its data to control module；Control module receives the data from input equipment and read from model memory module and usedThe 3D models that family is created, and by default rule processing data, treated data are sent to other by communication module and usedFamily end；The data that other users end is transmitted by communication module are sent to control module, and control module, which is received, comes from communication moduleData and after model memory module reads the 3D models that user creates, will be treated and by default rule processing dataData send to output equipment, corresponding content output is carried out by earphone and immersion VR output equipments.
The system provided by the present invention, can be presented the display effect of three-dimensional in instant communication process.
In one embodiment of the invention, immersion VR output equipments, to wear mobile phone box.Head-wearing mobile phone boxCompared with circumscribed head-mounted display and integral type head-mounted display, it is only cheap, and more flexibly pass through mobile phone3G, 4G, wifi, bluetooth etc. are connected with control module, are realized more convenient.
In one embodiment of the invention, model creation module：
For creating 3D head portraits, 3D virtual portraits and 3D backgrounds, and by the 3D head portraits created, 3D virtual portraits and3D backgrounds are according to head portrait class, visual human's species, background classes classification deposit model memory module, by by 3D head portraits, 3D visual humansThing and the storage of 3D background class, for same storage, when classification storage is controlled control module, are patrolled from realizationCollect upper easily realization transferring and after-treatment to 3D models.
In one embodiment of the invention, input module, in addition to：
Gesture identification equipment, for recognizing the gesture of user, and sends it to control module, for according to default handThe display of gesture rule control output end, including switching 3D backgrounds, switch 3D virtual portraits, switch 3D head portraits；
Motion capture equipment, the action for catching user, and send to control module, action is carried out by control moduleSimplify after processing, sent by communication module to other users end.
By the use of gesture identification equipment and motion capture equipment, the flexibility to display control is added, but alsoThe output equipment of communication other side can be further set to show action interaction.
In one embodiment of the invention, control module receives the data from communication module and from model memory moduleRead after the 3D models that user creates, and by default rule processing data, treated data are sent to output equipment, bagInclude：
Control module receives the data from communication module；
Control module finds the special value in the data from communication module, when finding special value, according toThe default rule of correspondence switches corresponding 3D backgrounds, 3D virtual portraits, 3D head portraits；
Control module sends the 3D backgrounds switched, 3D virtual portraits, 3D head portraits to output equipment.
By 3D backgrounds, 3D virtual portraits, 3D head portraits switching, more suitably display effect, drop can be realized localThe identification difficulty expressed one's feelings to other side etc. during low communication.
In one embodiment of the invention, 3D head portraits, in addition to 3D expressions.The display expressed one's feelings by 3D strengthens communicationDuring the change expressed one's feelings, input equipment is caught excessively trickle expression shape change, so as to reduce the technology of input equipmentDifficulty, it is easier to realization expression communication.
In one embodiment of the invention, 3D backgrounds, in addition to 3D stage properties.By the use of 3D stage properties, there is provided realityIn the stage property that does not have, add the interactive of system.
In one embodiment of the invention, control module is used to control user terminal to the information sent with other users endAnd the display content of immersion VR output equipments, including：
Control module is then forwarded to output equipment after being deformed 3D head portraits, 3D stage properties and exported.By to 3D headsPicture, 3D stage properties carry out deformation and used, and reduce the size for the data that storage is needed in model memory module, a 3D model dataDifferent display shapes can be realized by modes such as stretching, rotation, distortions, and can by by stretching, rotation, distortionOperation is transferred to another user terminal by communication module, without transmitting the data after whole 3D model deformations, reducesRequirement to data transfer, and then the delay (because the data volume to be transmitted diminishes) of data transfer is reduced, add friendshipMutual property.
A kind of 3D instant communicating systems based on WebGL and VR technologies provided in an embodiment of the present invention, can not only be in sightWhen communication process in present three-dimensional display effect, moreover it is possible to increase the interactivity of communication two party, reduce the cost of whole systemAnd technical difficulty.
The present invention is on conventional " system+user " instant messaging framework, in figure image, personage's interaction, stage property tableDrill, 3D elements are added in terms of chatting facial expression.User can be individual by using or changing between this immediate communication platform and good friendPeople virtual 3D images, using or change 3D stage properties, using or change 3D expressions etc. carry out more lively interaction, be instant messagingPlatform adds interactive and recreational.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer programProduct.Therefore, the present invention can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardwareApply the form of example.Moreover, the present invention can be used in one or more computers for wherein including computer usable program codeThe shape for the computer program product that usable storage medium is implemented on (including but is not limited to magnetic disk storage and optical memory etc.)Formula.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program productFigure and/or block diagram are described.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagramJourney and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be providedThe processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produceA raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for realThe device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spyDetermine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which is produced, to be included referring toMake the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram orThe function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meterSeries of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer orThe instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram oneThe step of function of being specified in individual square frame or multiple square frames.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the present invention to the present inventionGod and scope.So, if these modifications and variations of the present invention belong to the scope of the claims in the present invention and its equivalent technologiesWithin, then the present invention is also intended to comprising including these changes and modification.