CN106296781B - Special effect image generation method and electronic equipment - Google Patents
Special effect image generation method and electronic equipmentDownload PDFInfo
- Publication number
- CN106296781B CN106296781BCN201510282916.5ACN201510282916ACN106296781BCN 106296781 BCN106296781 BCN 106296781BCN 201510282916 ACN201510282916 ACN 201510282916ACN 106296781 BCN106296781 BCN 106296781B
- Authority
- CN
- China
- Prior art keywords
- view
- special effect
- frame
- processed
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000000694effectsEffects0.000titleclaimsabstractdescription287
- 238000000034methodMethods0.000titleclaimsabstractdescription43
- 230000008859changeEffects0.000claimsdescription17
- 230000002194synthesizing effectEffects0.000claimsdescription13
- 230000015572biosynthetic processEffects0.000claimsdescription12
- 238000003786synthesis reactionMethods0.000claimsdescription12
- 238000012545processingMethods0.000claimsdescription11
- 230000004048modificationEffects0.000claimsdescription6
- 238000012986modificationMethods0.000claimsdescription6
- 230000004927fusionEffects0.000claimsdescription4
- 230000005540biological transmissionEffects0.000description11
- 241000533950LeucojumSpecies0.000description10
- 238000010586diagramMethods0.000description10
- 230000008569processEffects0.000description5
- 230000003993interactionEffects0.000description3
- 230000001419dependent effectEffects0.000description2
- 238000004519manufacturing processMethods0.000description2
- 238000003672processing methodMethods0.000description2
- 238000005034decorationMethods0.000description1
- 238000013461designMethods0.000description1
- 238000005516engineering processMethods0.000description1
- 210000003746featherAnatomy0.000description1
- 230000006870functionEffects0.000description1
- 238000012856packingMethods0.000description1
- 238000006467substitution reactionMethods0.000description1
- 230000000007visual effectEffects0.000description1
Images
Landscapes
- Processing Or Creating Images (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
Technical Field
The invention relates to the technical field of stereoscopic display, in particular to a special-effect image generation method and electronic equipment.
Background
In the stereoscopic display technology, human-computer interaction is not limited to two-dimensional planes, and is expanded to three-dimensional space at present. To pursue realism, interactions in three-dimensional space must be closely coupled with visual effects. With the popularization of portable electronic devices such as smartphones and tablet computers, users can take photos or videos through cameras and the like and process the taken photos or videos through software, such as beautification, decoration and the like. However, processing of photos or videos in the prior art is still limited to increasing a plane effect, but cannot increase a stereoscopic dynamic effect, and with the pursuit of people for higher and higher stereoscopic display effects, how to increase a stereoscopic dynamic modification effect in image data shot by a user or stored in a portable electronic device is a problem to be solved urgently at present.
Disclosure of Invention
The invention aims to provide a special effect image generation method, which is used for realizing dynamic effect addition of data received from external equipment, reducing transmission power consumption and reducing the data volume needing to be transmitted.
To achieve the above object, a first aspect of the present invention provides a special effect image generation method, including:
firstly, receiving special effect image generation data sent by second equipment by first equipment, wherein the special effect image generation data comprises at least one view to be processed, special effect material data and special effect attribute information, and the special effect attribute information comprises position information of the special effect material in a special effect image;
and step two, the first equipment fuses the special effect material data with the first view and the second view corresponding to the at least one view to be processed according to the special effect attribute information to generate a view with a 3D special effect, wherein the same material corresponding to the special effect material data has parallax error in a horizontal position after being fused with the first view and the second view.
According to the method of the preferred embodiment of the present invention, the special effect image generation data includes a 2D view to be processed, and the special effect attribute information includes the number of frames of the view with 3D special effect that needs to be generated, and the second step further includes:
step 2.1, copying the 2D view to be processed into two same views which are used as a first view and a second view;
and 2.2, synthesizing the special effect material with the size corresponding to each frame view and the first view and the second view corresponding to the frame view at corresponding positions according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesis comprises pixel data change, and the pixel data change specifically comprises the step of replacing the pixel data at the corresponding position in each view with the pixel of the special effect material data.
According to the method of the preferred embodiment of the present invention, the special effect image generation data further includes frame data, and before the step 2.2, the method further includes:
and adding a frame for the fused first view or second view according to the frame data.
According to the method of the preferred embodiment of the present invention, the special effect image generation data includes a 2D video sequence, the 2D video sequence includes a plurality of frames of images to be processed, and the images to be processed are 2D images; the second step further comprises:
step 2.1, sequentially intercepting each frame of image to be processed in the 2D video sequence, and processing each frame of image to be processed into a first view and a second view which are the same;
and 2.2, fusing the special effect material data with the first view and the second view corresponding to each frame of image to be processed according to the special effect attribute information to obtain a view which corresponds to each frame of image to be processed in the 2D video sequence and has a 3D special effect.
According to the method of the preferred embodiment of the present invention, the step 2.2 further comprises:
and synthesizing the special effect material with the corresponding size of each frame view and each view at the corresponding position according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesis comprises pixel data modification.
In the method according to the preferred embodiment of the present invention, the step 2.2, before, further includes:
and adding a frame for the first view or the second view corresponding to each frame of the image to be processed before fusion.
According to the method of the preferred embodiment of the present invention, the special effect image generation data includes a 3D to-be-processed image, the 3D to-be-processed image further includes a first view and a second view with parallax, the special effect attribute information further includes the number of frames of the view with 3D special effect to be generated, and the second step further includes:
and synthesizing the special effect material and the first view and the second view at corresponding positions respectively according to the position information, wherein the synthesis comprises the change of pixel data of a corresponding position area, the positions of the special effect material in the first view and the second view correspond to the parallax of the first view and the second view, and the change of the pixel data specifically comprises the replacement of the pixel data of the corresponding position in each view into the pixel of the special effect material data.
According to the method of the preferred embodiment of the present invention, before the second step, the method further includes:
and adding a frame to the first view or the second view before being fused with the special effect material in each frame of the 3D image.
According to the method of the preferred embodiment of the present invention, the special effect image generation data includes a 3D video sequence, the 3D video sequence includes a plurality of frames of 3D images to be processed, each frame of 3D image to be processed further includes a first view and a second view with parallax, the position information included in the special effect attribute includes special effect material and a corresponding position in each sub-view in each frame of 3D image to be processed, and the second step further includes:
and according to the position information, respectively synthesizing the special effect material with a first view and a second view in each frame of 3D image to be processed at corresponding positions, wherein the synthesis comprises pixel data change of corresponding position areas, the positions of the special effect material in the first view and the second view correspond to the parallax of the first view and the second view, and the pixel data change specifically comprises replacing the pixel data of the corresponding position in each view with the pixel of the special effect material data.
According to the method of the preferred embodiment of the present invention, before the second step, the method further includes:
and adding a frame to the first view or the second view before being fused with the special effect material in each frame of the 3D image.
In a second aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes:
the receiving unit is used for receiving special effect image generation data sent by second equipment, wherein the special effect image generation data comprises at least one view to be processed, special effect material data and special effect attribute information, and the special effect attribute information comprises position information of the special effect material in a special effect image;
and the processing unit is used for fusing the special effect material data with the first view and the second view corresponding to the at least one view to be processed according to the special effect attribute information to generate a view with a 3D special effect, wherein the same material corresponding to the special effect material data has parallax error in a horizontal position after being fused with the first view and the second view.
According to the special effect image generation method and the electronic equipment provided by the embodiment of the invention, the special effect image which can be generated by other equipment can be restored in time according to the special effect image generation data transmitted by other equipment, and the transmission of the complete image file with the 3D special effect generated by other equipment is not required, so that the transmission power consumption can be greatly reduced, the transmission bandwidth can be saved, a user can obtain a better 3D viewing effect, and the user requirements can be met.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is an effect diagram of a special effect image generation processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of a special effect image generation method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating adding dynamic effects to a 2D image according to another embodiment of the present invention;
FIG. 4 is a diagram illustrating the addition of borders and dynamic effects to a 2D image according to another embodiment of the present invention;
FIG. 5 is a diagram illustrating adding dynamic special effects to 2D video according to another embodiment of the invention;
FIG. 6 is a diagram illustrating adding borders and dynamic special effects to a 2D video according to another embodiment of the invention;
FIG. 7 is a diagram illustrating adding dynamic effects to a 3D image according to another embodiment of the invention;
FIG. 8 is a diagram illustrating adding dynamic special effects to 3D video according to another embodiment of the invention;
fig. 9 is a block diagram of an embodiment of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to clearly understand the above objects, features and advantages of the present invention, the following detailed description of the technical solution of the present invention is provided by the accompanying drawings and embodiments. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without causing any conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below. In the embodiments of the present invention, for convenience of distinction, terms such as "first" and "second" are used to distinguish different technical features, and such terms may be replaced as necessary, and should not be construed as limiting the present invention.
The method for generating a special effect image provided by the embodiment of the present invention may be applied to the field of stereo photography or other image processing, for example, to a smart phone, a tablet computer, and the like having a photographing function, and preferably may be applied to a portable electronic device, such as a 3D phone, a tablet computer, and the like, which has a light splitting device, such as a grating, and the like, but is not limited thereto, and the method for generating a special effect image may also be applied to a general 2D phone. To obtain a view with 3D dynamic effects that can be viewed in a smartphone like that shown in fig. 1. For example, after a user shoots a 2D video through a smart phone, the user wants to beautify the image and increase a dynamic 3D effect, for example, increase dynamic effects such as floating feathers, snowflakes, bubbles, raindrops, and the like, and then the effect that the user wants to obtain can be obtained through the video processing method provided by this embodiment.
More specifically, after a first device, for example, the device a in fig. 1, obtains an image obtained by itself, for example, by shooting or downloading, and adds a dynamic 3D special effect to the image, and stores the produced image with the dynamic 3D special effect, it is desirable to share the image with a second device, for example, the device B, so that the device B can also view the image with the same 3D dynamic special effect, for example, a 2D picture with the 3D special effect, a 2D video with the 3D special effect, a 3D image with the 3D special effect, or a 3D video with the 3D special effect, at this time, the device a may select to transmit a generated complete file to the device B, so that the device B may directly play the received file. In addition, after the device a creates an image with 3D dynamic special effects, it can choose a storage mode, for example, only store the original image, the used special effects materials, and special effects attribute data, such as the position, size change information, frame number, etc. of the special effects materials, so that, during transmission, it can only transmit these useful data without transmitting the whole file, and after receiving, the device B restores the image according to these information.
For example, after the device a completes the production of the 2D image with the 3D dynamic special effect, only the 2D image to be processed is stored, and the special effect attribute information and the material information are packaged and then stored. The electronic equipment receiving the information can directly process the image according to the information in the received information to obtain the view with the same 3D dynamic effect as the sender, and the transmission data volume can be greatly saved because only the image to be processed and the corresponding dynamic special effect attribute information are transmitted.
For example, after the device a finishes producing a 2D video with a 3D dynamic special effect, only the video to be processed is stored, and after packing the special effect attribute information and the material information, the video is stored. The electronic device B receiving the information can directly process the image according to the information in the received information to obtain the view with the same 3D dynamic effect as the sender, and the transmission data volume can be greatly saved because only the 2D video to be processed and the corresponding dynamic special effect attribute information are transmitted.
Similarly, for example, after the device a completes the production of the 3D image with the 3D dynamic special effect, only the 3D image to be processed is stored, and the special effect attribute information and the material information are packaged and then stored. The electronic device B receiving the information can directly process the image according to the information in the received information to obtain the 3D view which has the same 3D dynamic effect as the sender, and the transmission data volume can be greatly saved because only the 3D image to be processed and the corresponding special effect attribute information are transmitted.
Similarly, for example, after the device a finishes making a 3D video with a 3D dynamic special effect, only the image to be processed is stored, and the dynamic special effect attribute information and the material information are stored after being packed. The electronic equipment receiving the information can directly process the image according to the information in the received information to obtain the 3D video with the same 3D dynamic effect as the sender, and the transmission data volume can be greatly saved because only the 3D video to be processed and the corresponding special effect attribute information are transmitted.
In view of this, a first aspect of the embodiment of the present invention provides a method for generating a special effect image, fig. 2 is a flowchart of the method provided in the embodiment, and as can be seen from fig. 2, the embodiment may include:
201, a first device receives special effect image generation data sent by a second device, wherein the special effect image generation data comprises at least one view to be processed, special effect material data and special effect attribute information, and the special effect attribute information comprises position information of the special effect material in a special effect image;
specifically, the first device may be the electronic device B in the application scene, and the view to be processed received by the first device may be an image only including one 2D view, a 2D video sequence including multiple 2D images, a frame of 3D image including two left and right images, or a 3D video including multiple 3D images, where the image files may be used as a background for increasing a 3D dynamic special effect.
For example, in an embodiment where the background image source is a single 2D picture or a 3D picture, the special effect attribute data needs to include position information of a material and also needs to include a frame number to be generated, and in an embodiment where the background image source is a 2D video or a 3D video, the special effect attribute data does not need to include the frame number to be generated, because the video sequence itself includes a certain number of image frame numbers, which is not described in detail.
202, the first device fuses the special effect material data with the first view and the second view corresponding to the at least one view to be processed according to the special effect attribute information to generate a view with a 3D special effect, wherein the same material corresponding to the special effect material data has parallax in a horizontal position after being fused with the first view and the second view.
And after receiving the data transmitted by the electronic equipment A, the electronic equipment B analyzes the data and respectively reads the image part to be processed, the special effect material part and the special effect attribute information part. Then, the image is restored based on the information, and the same image as the image with the 3D dynamic special effect created by the electronic device a is generated and played.
In an embodiment, if a background image source for adding a 3D dynamic special effect is a single 2D picture, the special effect image generation data includes a 2D view to be processed, the special effect attribute information includes a frame number of views with a 3D special effect that need to be generated, and the special effect image generation data may have a structure as in table 1 below:
| to-be-processed 2D picture | Material | Special effect properties |
TABLE 1
The second step further comprises:
step 2.1, copying the 2D view to be processed into two same views which are used as a first view and a second view;
for example, the B device copies the 2D pending picture into two identical views, namely a first view and a second view.
And 2.2, synthesizing the special effect material with the size corresponding to each frame view and the first view and the second view corresponding to the frame view at corresponding positions according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesis comprises pixel data change, and the pixel data change specifically comprises the step of replacing the pixel data at the corresponding position in each view with the pixel of the special effect material data.
Referring to fig. 3, it is a to-be-processed 2D view acquired by the electronic device in the embodiment of the present invention, the special effect material is snowflakes, and the electronic device B may increase a dynamic effect of 3D floating snowflakes for the view.
When the special effect material is fused with the view to be processed, a variety of ways can be implemented, for example, in an embodiment where a butterfly is selected as the special effect material, pixels in a certain position region of the picture can be replaced with pixel data corresponding to the butterfly material, and a desired synthesized view can be obtained. It should be noted that in a frame of 3D effect view, two views are usually included, namely the view with the first view added with the special effect material and the view with the second view added with the special effect material, and the same material when fused with the first view and the second view respectively usually has a parallax, which can be determined by position information, for example, the position row and column coordinates on the first view are (100), wherein the row coordinates and the column coordinates are both 100, and the position row and column coordinates on the second view are (102,100).
The synthesis position of the special effect material in each view in different frames can be random, can also be determined according to interaction with a user, or can be determined by a certain rule, such as a motion trajectory algorithm, and is not repeated.
Referring to fig. 3, the position of each of the snowflake special effect materials in each frame of image is different, but the positions of the snowflake special effect materials on the two views in each frame are offset, and the positions of snowflakes on the different frames are different, so that when the multi-frame views are played continuously, a dynamic effect can be observed, and particularly when the multi-frame views including two views added with special effect materials are played on a 3D device, a 3D effect can be observed due to the parallax of the special effect materials in the transverse direction, and although the background is a non-stereoscopic 2D image, a 3D special effect can still be observed, for example, as shown in fig. 1.
Through the above scheme, the 3D effect can be viewed on the 3D device, but for the 2D device, the 3D effect cannot be viewed, and only two continuous dynamic images with snowflakes can be viewed, similar to GIF dynamic images, for this reason, in order to enable the user to view the similar 3D effect on the 2D device, after step S203, that is, according to the special effect attribute information, the special effect material data is fused with the first view and the second view to obtain the view with the 3D special effect, before, the electronic device may further add a frame to the first view or the second view before fusion, more specifically, add a frame to one of the two views in each frame, and refer to fig. 4. When a plurality of frames of 2D views with frames are played continuously, a user can feel similar 3D dynamic effect, and therefore 2D and 3D compatible effect is achieved.
The frame information may also be packaged in the special-effect image generation data by the second electronic device a and transmitted to the first electronic device B, as shown in the following table, which is not described in detail.
| To be processed 2D | Picture frame | Material | Special effect properties | Rims |
TABLE 2
Correspondingly, in another embodiment, a 3D special effect background image source in the special effect image generation data received by the electronic device B is a 2D video sequence, that is, the special effect image generation data includes a 2D video sequence, the special effect image generation data may be shown in table 3, the 2D video sequence includes multiple frames of images to be processed, and the images to be processed are 2D images;
| 2D video | Material | Special effect properties |
TABLE 3
The second step further comprises:
step 3.1, sequentially intercepting each frame of image to be processed in the 2D video sequence, and processing each frame of image to be processed into a first view and a second view which are the same;
and 3.2, fusing the special effect material data with the first view and the second view corresponding to each frame of image to be processed according to the special effect attribute information to obtain a view which corresponds to each frame of image to be processed in the 2D video sequence and has a 3D special effect.
Still further, the step 3.2 may further include: and synthesizing the special effect material with the corresponding size of each frame view and each view at the corresponding position according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesis comprises pixel data modification.
In this embodiment, the processing manner of each frame of the to-be-processed image is the same as that of the foregoing embodiment, and therefore, the description thereof is omitted. For example, fig. 5 is a schematic diagram of generating a 3D effect from a 2D video sequence, where snowflakes are the material and joists and trains are the background in the 2D video.
Similar to the foregoing embodiment, in order to enable the user to view the 3D effect on the 2D device, after step 3.2, the electronic device B may further add a frame to the first view or the second view corresponding to each frame of the to-be-processed image before merging. Of course, the frame information is also carried in the special effect image generation data sent by the electronic device a, as shown in table 4, so that when multiple frames of 2D views with frames are played continuously, the user can feel a similar 3D dynamic effect, thereby achieving a 2D and 3D compatible effect. For example, as shown in a view of fig. 5, the effect of adding a frame can be as shown in fig. 6.
| 2D video | Material | Special effect properties | Rims |
TABLE 4
In still another embodiment, when the 3D special effect background image source in the special effect image generation data received by the electronic device B is a 3D image, that is, the special effect image generation data received by the first device includes a 3D to-be-processed image, the 3D to-be-processed image further includes a first view and a second view with parallax, and the special effect attribute information further includes the number of frames of views with 3D special effect to be generated, as shown in table 5, it is of course possible that the first view and the second view are separately stored:
| 3D image (first view + second view) | Material | Special effect properties |
TABLE 5
The second step further comprises:
and according to the position information, synthesizing the special effect material with a first view and a second view at corresponding positions respectively, wherein the synthesis comprises pixel data change of corresponding position areas, and the positions of the special effect material in the first view and the second view correspond to the parallax of the first view and the second view.
In this embodiment, the way each view is merged with the special effects material is similar to the previous embodiment, but the difference is that the position information is disparity dependent. Taking fig. 7 as an example, the upper diagram in fig. 7 is a 3D image received by the electronic device B, which includes two views with parallax, and the received material data is snowflakes, and after processing, a lower 3D playable image with a stereoscopic floating effect in fig. 7 can be generated, which is not described in detail.
Similarly, in order to enable the user to view the 3D effect on the 2D device, after step 3.2, the electronic device B may further add a frame to the first view or the second view of each frame of the 3D image before being fused with the special effect material. Certainly, the frame information is also carried in the special-effect image generation data sent by the electronic device a, and the table 6 may be referred to, so that when multiple frames of 2D views with frames are continuously played, the user can also feel a similar 3D dynamic effect, thereby achieving a 2D and 3D compatible effect. The effect is similar to that shown in fig. 4 in the foregoing embodiment, and is not repeated.
| 3D images | Material | Special effect properties | Rims |
TABLE 6
In yet another possible embodiment, when the 3D special effect background image source in the special effect image generation data received by the electronic device B is a 3D video, that is, the first device receives a 3D video sequence contained in the special effect image generation data, as shown in table 7, the 3D video sequence contains a plurality of frames of 3D images to be processed, each frame of 3D image to be processed further includes a first view and a second view with parallax, and the position information contained in the special effect attribute includes a special effect material and a corresponding position in each sub-view in each frame of 3D image to be processed.
| 3D video | Material | Special effect properties |
TABLE 7
The second step further comprises:
and according to the position information, respectively synthesizing the special effect materials with a first view and a second view in each frame of 3D image to be processed at corresponding positions, wherein the synthesis comprises pixel data change of corresponding position areas, and the positions of the special effect materials in the first view and the second view correspond to the parallax of the first view and the second view.
It should be noted that in this embodiment, the first view and the second view in each frame of the 3D video may be stored separately, that is, the 3D video sequence may include two sequences, one sequence stores the first view in each frame, the other sequence stores the second view in each frame, and the two sequences may be transmitted separately or selectively.
In this embodiment, the way in which each view in each frame of a 3D image in a 3D video sequence is fused with special effects material is similar to the previous embodiment, but the difference is that the position information is disparity dependent. Taking fig. 8 as an example, the material data received by the electronic device B is snowflakes, the background in the received 3D video is a running train, the train moves forward relative to the rail, and the object has parallax in two views in each frame, and after processing, a 3D playable video with a stereoscopic floating effect below fig. 8 can be generated, which is not repeated.
Similarly, in order to enable the user to view the 3D effect on the 2D device, after step 3.2, the electronic device B may further add a frame to the first view or the second view of each frame of the 3D image before being fused with the special effect material. Of course, the frame information is also carried in the special effect image generation data sent by the electronic device a, as shown in table 8, so that when multiple frames of 2D views with frames are played continuously, the user can feel a similar 3D dynamic effect, thereby achieving a 2D and 3D compatible effect. The effect can be seen in fig. 6, which is similar to that of fig. 6 and will not be described in detail.
| 3D images | Material | Special effect properties | Rims |
TABLE 8
Accordingly, as shown in fig. 9, an embodiment of the present invention provides an electronic device, which may be device B in fig. 1, where the electronic device includes:
a receivingunit 901, configured to receive special effect image generation data sent by a second device, where the special effect image generation data includes at least one view to be processed, special effect material data, and special effect attribute information, and the special effect attribute information includes position information of the special effect material in a special effect image;
aprocessing unit 902, configured to fuse, according to the special effect attribute information, the special effect material data with the first view and the second view corresponding to the at least one view to be processed, and generate a view with a 3D special effect, where a same material corresponding to the special effect material data has a parallax in a horizontal position after being fused with the first view and the second view.
This embodiment is an embodiment of an apparatus corresponding to the aforementioned embodiment of the method, and therefore will not be described in detail.
The electronic equipment provided by the embodiment of the invention can timely restore the special effect image which can be generated by other equipment according to the special effect image generation data transmitted by other equipment, does not need to transmit the complete image file with the 3D special effect generated by other equipment, can greatly reduce transmission power consumption and save transmission bandwidth, enables a user to obtain a better 3D viewing effect, and meets the user requirements.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (11)
1. A special effect image generation method, characterized by comprising:
firstly, receiving special effect image generation data sent by second equipment by first equipment, wherein the special effect image generation data comprises at least one view to be processed, special effect material data and special effect attribute information, and the special effect attribute information comprises position information of the special effect material in a special effect image; the at least one view to be processed is an image comprising one 2D view, a 2D video sequence comprising a plurality of frames of 2D images, a frame of 3D image comprising two left and right images or a 3D video comprising a plurality of frames of 3D images;
step two, the first equipment fuses the special effect material data with a first view and a second view corresponding to the at least one view to be processed according to the special effect attribute information to generate a view which is the same as the view with the 3D special effect generated by the second equipment according to the special effect image generation data; and the same material corresponding to the special effect material data has parallax error in a horizontal position after being fused with the first view and the second view.
2. The method of claim 1, wherein the special effect image generation data includes a 2D view to be processed, and the special effect attribute information includes a frame number of views to be generated with 3D special effect, and the second step further includes:
step 2.1, copying the 2D view to be processed into two same views which are used as a first view and a second view;
and 2.2, synthesizing the special effect material with the size corresponding to each frame view and the first view and the second view corresponding to the frame view at corresponding positions according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesis comprises pixel data change, and the pixel data change specifically comprises the step of replacing the pixel data at the corresponding position in each view with the pixel of the special effect material data.
3. The method according to claim 2, wherein the special effect image generation data further includes frame data, and before step 2.2, the method further includes:
and adding a frame for the first view or the second view before fusion according to the frame data.
4. The method according to claim 1, wherein the special effect image generation data includes a 2D video sequence, the 2D video sequence includes a plurality of frames of to-be-processed images, and the to-be-processed images are 2D images, and the second step further includes:
step 2.1, sequentially intercepting each frame of image to be processed in the 2D video sequence, and processing each frame of image to be processed into a first view and a second view which are the same;
and 2.2, fusing the special effect material data with the first view and the second view corresponding to each frame of image to be processed according to the special effect attribute information to obtain a view which corresponds to each frame of image to be processed in the 2D video sequence and has a 3D special effect.
5. The method of claim 4, wherein the step 2.2 further comprises:
and synthesizing the special effect material with the corresponding size of each frame view and each view at the corresponding position according to the position information corresponding to each frame view in the special effect attribute information, wherein the synthesizing comprises pixel data modification, and the pixel data modification specifically comprises replacing the pixel data at the corresponding position in each view with the pixel of the special effect material data.
6. The method of claim 4, wherein step 2.2, previously, further comprises:
and adding a frame for the first view or the second view corresponding to each frame of the image to be processed before fusion.
7. The method of claim 1, wherein the special effect image generation data includes a 3D to-be-processed image, the 3D to-be-processed image further includes a first view and a second view with parallax, the special effect attribute information further includes a frame number of the view with the 3D special effect to be generated, and the second step further includes:
and synthesizing the special effect material and the first view and the second view at corresponding positions respectively according to the position information, wherein the synthesis comprises the change of pixel data of a corresponding position area, the positions of the special effect material in the first view and the second view correspond to the parallax of the first view and the second view, and the change of the pixel data specifically comprises the replacement of the pixel data of the corresponding position in each view into the pixel of the special effect material data.
8. The method of claim 7, wherein before step two, further comprising:
and adding a frame to the first view or the second view before being fused with the special effect material in each frame of the 3D image.
9. The method according to claim 1, wherein the special effect image generation data includes a 3D video sequence, the 3D video sequence includes a plurality of frames of 3D images to be processed, each frame of 3D images to be processed further includes a first view and a second view with disparity, the position information included in the special effect attribute includes special effect material and a corresponding position in each sub-view in each frame of 3D images to be processed, and the second step further includes:
and according to the position information, respectively synthesizing the special effect material with a first view and a second view in each frame of 3D image to be processed at corresponding positions, wherein the synthesis comprises pixel data change of corresponding position areas, the positions of the special effect material in the first view and the second view correspond to the parallax of the first view and the second view, and the pixel data change specifically comprises replacing the pixel data of the corresponding position in each view with the pixel of the special effect material data.
10. The method of claim 9, wherein before step two, further comprising:
adding a border to the first view or the second view in each frame of the 3D image before being fused with the special effect material.
11. An electronic device, characterized in that the electronic device comprises:
the receiving unit is used for receiving special effect image generation data sent by second equipment, wherein the special effect image generation data comprises at least one view to be processed, special effect material data and special effect attribute information, and the special effect attribute information comprises position information of a special effect material in a special effect image; the at least one view to be processed is an image comprising one 2D view, a 2D video sequence comprising a plurality of frames of 2D images, a frame of 3D image comprising two left and right images or a 3D video comprising a plurality of frames of 3D images;
and the processing unit is used for fusing the special effect material data with the first view and the second view corresponding to the at least one view to be processed according to the special effect attribute information, and generating a view which is the same as the view with the 3D special effect generated by the second equipment according to the special effect image generation data, wherein the same material corresponding to the special effect material data has parallax error in the horizontal position after being fused with the first view and the second view.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510282916.5ACN106296781B (en) | 2015-05-27 | 2015-05-27 | Special effect image generation method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510282916.5ACN106296781B (en) | 2015-05-27 | 2015-05-27 | Special effect image generation method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106296781A CN106296781A (en) | 2017-01-04 |
| CN106296781Btrue CN106296781B (en) | 2020-09-22 |
Family
ID=57634972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510282916.5AExpired - Fee RelatedCN106296781B (en) | 2015-05-27 | 2015-05-27 | Special effect image generation method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106296781B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197341B (en)* | 2017-06-02 | 2020-12-25 | 福建星网视易信息系统有限公司 | Dazzle screen display method and device based on GPU and storage equipment |
| CN107391771A (en)* | 2017-09-14 | 2017-11-24 | 光锐恒宇（北京）科技有限公司 | The generation method and device of a kind of image special effect |
| CN107633541B (en)* | 2017-09-14 | 2021-05-18 | 光锐恒宇（北京）科技有限公司 | Method and device for generating image special effect |
| CN108259496B (en) | 2018-01-19 | 2021-06-04 | 北京市商汤科技开发有限公司 | Method and device for generating special-effect program file package and special effect, and electronic equipment |
| CN112860168B (en) | 2018-02-08 | 2022-08-02 | 北京市商汤科技开发有限公司 | Method and device for generating special-effect program file package and special effect, and electronic equipment |
| CN113658298B (en)* | 2018-05-02 | 2024-09-17 | 北京市商汤科技开发有限公司 | Special effect program file package generation method and device |
| CN109089150B (en)* | 2018-09-26 | 2021-07-16 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN110602563A (en)* | 2019-10-11 | 2019-12-20 | 重庆杰夫与友文化创意有限公司 | Picture and video editing processing method capable of realizing real-time preview |
| CN112702353A (en)* | 2020-12-28 | 2021-04-23 | 咪咕文化科技有限公司 | Streaming media transmission method, electronic device and storage medium |
| CN114363519B (en)* | 2022-01-10 | 2025-03-14 | 北京字跳网络技术有限公司 | Image processing method, device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137270A (en)* | 2008-07-25 | 2011-07-27 | 皇家飞利浦电子股份有限公司 | 3D display handling of subtitles |
| CN102196277A (en)* | 2010-03-11 | 2011-09-21 | 株式会社东芝 | Three-dimensional image display apparatus and image process apparatus |
| CN102790902A (en)* | 2009-02-19 | 2012-11-21 | 松下电器产业株式会社 | Receiving device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2485140A (en)* | 2010-10-26 | 2012-05-09 | Sony Corp | A Method and Apparatus For Inserting Object Data into a Stereoscopic Image |
- 2015
- 2015-05-27CNCN201510282916.5Apatent/CN106296781B/ennot_activeExpired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137270A (en)* | 2008-07-25 | 2011-07-27 | 皇家飞利浦电子股份有限公司 | 3D display handling of subtitles |
| CN102790902A (en)* | 2009-02-19 | 2012-11-21 | 松下电器产业株式会社 | Receiving device |
| CN102196277A (en)* | 2010-03-11 | 2011-09-21 | 株式会社东芝 | Three-dimensional image display apparatus and image process apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106296781A (en) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106296781B (en) | Special effect image generation method and electronic equipment | |
| CN112425177B (en) | Method and apparatus for volumetric video transmission | |
| EP2648414B1 (en) | 3d display apparatus and method for processing image using the same | |
| KR101863767B1 (en) | Pseudo-3d forced perspective methods and devices | |
| CN106210861A (en) | The method and system of display barrage | |
| KR20170132098A (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| WO2017113681A1 (en) | Video image processing method and apparatus based on virtual reality technology | |
| CN108693970B (en) | Method and apparatus for adapting video images of a wearable device | |
| CN107343206B (en) | Video generation method, device, medium and electronic equipment supporting multi-view viewing | |
| JP2023506832A (en) | Volumetric video with auxiliary patches | |
| CN113906761A (en) | Method and apparatus for encoding and rendering 3D scenes using patch patches | |
| CN106797462B (en) | Multi-view image display device and control method thereof | |
| CN104104938B (en) | Deformed graphs for signaling transport using the high-efficiency video coding extension for 3D video coding | |
| CN106598250B (en) | A VR display method, device and electronic equipment | |
| KR20200095408A (en) | Method and apparatus for immersive video formatting | |
| CN112752085A (en) | Naked eye 3D video playing system and method based on human eye tracking | |
| KR101754976B1 (en) | Contents convert method for layered hologram and apparatu | |
| JP2022549431A (en) | Method and Apparatus for Encoding, Transmitting, and Decoding Volumetric Video | |
| CN106303494A (en) | Method for processing video frequency and device | |
| CN114208201B (en) | Method for rendering 3D scene on terminal, method for generating 3D scene at server and terminal | |
| CN114450939B (en) | Apparatus and method for generating and rendering immersive video | |
| KR20210027918A (en) | Method of making 3D image FOR HMD from 2D image | |
| US20130002817A1 (en) | Image processing apparatus and image processing method thereof | |
| CN102780895A (en) | Implementation method of 3D (three-dimensional) video file from single video file | |
| KR20130112679A (en) | 3d display apparatus and method for image processing thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | Effective date of registration:20180719 Address after:518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Applicant after:SUPERD Co.,Ltd. Address before:518053 East Guangdong H-1 East 101, overseas Chinese town, Nanshan District, Shenzhen. Applicant before:SHENZHEN SUPER PERFECT OPTICS Ltd. | |
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20200922 |