Embodiment
The embodiment of the invention proposes a kind of image processing method, image processing apparatus and receiving terminal for digital television, can realize the function of cursor layer, avoids the processing burden of graph mixing module simultaneously.
Fig. 1 is the first pass figure of image processing method in the embodiment of the invention, and image processing method comprises in the embodiment of the invention:
Step 101 to the decoding video signal of input, generates video image;
, when specifically implementing, realize the function of video layer herein, to the decoding video signal of input, generate video image, this video image is buffered in the video layer buffering area.
Step 102, the prompting request that issues according to application generates information, and described information is added on the described video image, generates composite video image, and described composite video image is buffered in the image layer buffering area;
Herein, realize the function of image layer, promptly from the video layer buffering area, obtain this video image, information superposes on this video image, generate composite video image, make screen provide more additional information for the user, this prompting message can only be formed, also can be combined by literal and picture by literal or picture, and prompting message can be the rendition list that for example has programm name and background image.Composite video image after image layer is handled is buffered in the image layer buffering area.During concrete enforcement, can receive application layer and issue the prompting request, the prompting request is the operation of application program at the user, a series of graphic operation sequences that are intended to change the active user interface of sending to the graphics engine module.At the operation of drawing, graphics engine receives picture data and operating parameter, according to operating parameter the driving relevant parameter is set, and the picture stacked data is added on the video image; At the request of the element figure sequence of operation, graphics engine calls and drives relevant interface, draws out element figure and this element figure is added on the video image.
Step 103, the display element that issues according to application shows request, obtains the area information of the image-region that display element and described display element take in described composite video image;
Herein, some application can require to hang display element on video image, for example TV station's icon, platform number or operation indicating icon etc.During concrete enforcement, can preset the information chained list of all display elements on the cursor layer, the display element that stores each element in this information chained list identifies, shows component information such as original position, display size parameter, the display element that issues according to application shows that the display element in the request identifies, in this information chained list, search corresponding display element, the area information of the image-region that in described composite video image, takies according to the original position and the display size calculation of parameter display element of this display element.An example of above-mentioned information chained list can see Table 1, in table 1, suppose that the image-region that display element takies is the rectangular area in described composite video image, the picture size of composite video image is width 1280 pixels, height 720 pixels (brief note is 1280 * 720), the origin of coordinates is the summit of composite video image lower left, and original position is the coordinate of display element on the summit of the lower left in the rectangular image zone that composite video image takies
Table 1
Herein, when showing the display element in the request, display element is designated ID001, then search corresponding display element according to this display element sign, while is according to the original position (5 of this display element, 660) and display size 30 * 20 width coordinate scope of calculating the image-region that these display elements take at composite video image be [5,35], the height coordinate scope is [660,680], after this can be with aforesaid width coordinate scope and height coordinate scope area information as this image-region, also can use four apex coordinates (5,660) of image-region, (35,660), (5,680) and (35,680) as the area information of this image-region.
Step 104, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element;
Herein, during concrete enforcement, can be according to width coordinate scope that calculates in thestep 103 and height coordinate scope, with the be added to respective image zone of composite video image in the described image layer buffering area of described display element, for example according to above-mentioned example, can be according to width coordinate scope [5,35], the height coordinate scope [660,680], with element identifier is the be added to width coordinate scope [5 of composite video image in the described image layer buffering area of the display element of ID001,35], the image-region of height coordinate scope [660,680].In addition, also can be according to four apex coordinates that calculate in thestep 103, with described display element be added to composite video image in the described image layer buffering area by these four image-regions that apex coordinate limits, for example according to above-mentioned example, can be according to four apex coordinates (5,660), (35,660), (5,680) and (35,680), with element identifier be the display element of ID001 be added to composite video image in the described image layer buffering area by these four apex coordinates (5,660), (35,660), on the rectangular image zone that (5,680) and (35,680)limit.Step 103 is after image layer generates the composite video image of the information that superposeed, with the be added to respective image zone of composite video image in the image layer buffering area of display element, thereby when realizing the image layer function, also the function of cursor layer is simulated, therefore need not to increase corresponding cursor layer driving and memory cost with extra realization cursor layer, avoid the processing burden of graph mixing module.
Step 105 is synchronized to the composite video image of the described display element that superposeed in the described image layer buffering area in the display buffer and shows.
, copy on the video memory herein, promptly carry out the simultaneous operation that is cached to video memory data cached.Owing to cursor layer needs data presented to append on the image layer, call to be cached to after the video memory simultaneous operation, the image that has mixed cursor layer and image layer two layer data has just shown.
Fig. 2 is second flow chart of image processing method in the embodiment of the invention, image processing method is on the basis of the described method of Fig. 1 in the embodiment of the invention, increased the treatment step that the display element in the composite video image of the display element that will superpose is hidden, image processing method specifically comprises in the embodiment of the invention:
Step 201 to the decoding video signal of input, generates video image;
, when specifically implementing, realize the function of video layer herein, to the decoding video signal of input, generate video image, this video image is buffered in the video layer buffering area.
Step 202, the prompting request that issues according to application generates information, and described information is added on the described video image, generates composite video image, and described composite video image is buffered in the image layer buffering area;
Herein, realize the function of image layer, promptly from the video layer buffering area, obtain this video image, information superposes on this video image, generate composite video image, make screen provide more additional information for the user, this prompting message can only be formed, also can be combined by literal and picture by literal or picture, and prompting message can be the rendition list that for example has programm name and background image.Composite video image after image layer is handled is buffered in the image layer buffering area.During concrete enforcement, can receive application layer and issue the prompting request, the prompting request is the operation of application program at the user, a series of graphic operation sequences that are intended to change the active user interface of sending to the graphics engine module.At the operation of drawing, graphics engine receives picture data and operating parameter, according to operating parameter the driving relevant parameter is set, and the picture stacked data is added on the video image; At the request of the element figure sequence of operation, graphics engine calls and drives relevant interface, draws out element figure and this element figure is added on the video image.
Step 203, the display element that issues according to application shows request, obtains the area information of the image-region that display element and described display element take in described composite video image;
Herein, some application can require to hang display element on video image, for example TV station's icon, platform number or operation indicating icon etc.During concrete enforcement, can preset the information chained list of all display elements on the cursor layer, the display element that stores each element in this information chained list identifies, shows component information such as original position, display size parameter, the display element that issues according to application shows that the display element in the request identifies, in this information chained list, search and think corresponding display element, the area information of the image-region that in described composite video image, takies according to the original position and the display size calculation of parameter display element of this display element.An example of above-mentioned information chained list can see Table 1, in table 1, suppose that the image-region that display element takies is the rectangular area in described composite video image, the picture size of composite video image is width 1280 pixels, height 720 pixels (brief note is 1280 * 720), the origin of coordinates is the summit of composite video image lower left, and original position is the coordinate of display element on the summit of the lower left in the rectangular image zone that composite video image takies
Herein, when showing the display element in the request, display element is designated ID001, then search corresponding display element according to this display element sign, while is according to the original position (5 of this display element, 660) and display size 30 * 20 width coordinate scope of calculating the image-region that these display elements take at composite video image be [5,35], the height coordinate scope is [660,680], after this can be with aforesaid width coordinate scope and height coordinate scope area information as this image-region, also can use four apex coordinates (5,660) of image-region, (35,660), (5,680) and (35,680) as the area information of this image-region.
Step 204 backs up the video image in the respective image zone of described composite video image according to described area information;
Herein, during concrete enforcement, can be cached in the extra buffer according to the video image of described area information, thereby the video image of the image-region that display element on the composite video image will be taken backs up the respective image zone of described composite video image.For example according to above-mentioned example, the width coordinate scope of the image-region that takies at composite video image according to display element is [5,35], the height coordinate scope is [660,680], with width coordinate scope in the composite video image is [5,35], the height coordinate scope is that the video image of [660,680] image-region is cached in the extra buffer, that is to say that the video image of the image-region that display element on the composite video image will be taken is cached in the extra buffer.Four apex coordinates (5 of the image-region that takies at composite video image according to display element and for example, 660), (35,660), (5,680) and (35,680), with composite video image in the image layer buffering area by these four apex coordinates (5,660), (35,660), (5,680) and (35,680) video image in the rectangular image zone of Xian Dinging is cached in the extra buffer, that is to say that the video image of the image-region that display element on the composite video image will be taken is cached in the extra buffer.
Step 205, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element;
Herein, during concrete enforcement, can be according to width coordinate scope that calculates in thestep 103 and height coordinate scope, with the be added to respective image zone of composite video image in the described image layer buffering area of described display element, for example according to above-mentioned example, can be according to width coordinate scope [5,35], the height coordinate scope [660,680], with element identifier is the be added to width coordinate scope [5 of composite video image in the described image layer buffering area of the display element of ID001,35], the image-region of height coordinate scope [660,680].In addition, also can be according to four apex coordinates that calculate in thestep 103, with described display element be added to composite video image in the described image layer buffering area by these four image-regions that apex coordinate limits, for example according to above-mentioned example, can be according to four apex coordinates (5,660), (35,660), (5,680) and (35,680), with element identifier be the display element of ID001 be added to composite video image in the described image layer buffering area by these four apex coordinates (5,660), (35,660), on the rectangular image zone that (5,680) and (35,680)limit.Step 103 is after image layer generates the composite video image of the information that superposeed, with the be added to respective image zone of composite video image in the image layer buffering area of display element, thereby when realizing the image layer function, also the function of cursor layer is simulated, therefore need not to increase corresponding cursor layer driving and memory cost with extra realization cursor layer, avoid the processing burden of graph mixing module.
Step 206 is synchronized to the composite video image of the described display element that superposeed in the described image layer buffering area in the display buffer and shows;
, copy on the video memory herein, promptly carry out the simultaneous operation that is cached to video memory data cached.Owing to cursor layer needs data presented to append on the image layer, call to be cached to after the video memory simultaneous operation, the image that has mixed cursor layer and image layer two layer data has just shown.
Step 207 receive to be used the display element that issues and is hidden request, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of the video image of backup;
Herein, some uses the demonstration time requirement to some extent to display element, and when the demonstration that reaches application specifies during the time, application can issue display element and hide request, carries out display element with indication and hides operation.During concrete enforcement, with the be added to image-region at the display element place on the composite video image in the described image layer buffering area of the video image of backup in thestep 104, thereby display element is removed from composite video image, composite video image in the image layer buffering area is returned to state before the display element that do not superpose.Herein, according to above-mentioned example, can be according to width coordinate scope [5,35], the height coordinate scope [660,680], the video image of backup is added to width coordinate scope [5,35], the height coordinate scope [660 of composite video image in the described image layer buffering area, 680] image-region that is to say the image-region at display element place.In addition, also can be according to four apex coordinates that calculate in thestep 103, with described display element be added to composite video image in the described image layer buffering area by these four image-regions that apex coordinate limits, for example according to above-mentioned example, can be according to four apex coordinates (5,660), (35,660), (5,680) and (35,680), with the video image of backup be added to composite video image in the described image layer buffering area by these four apex coordinates (5,660), (35,660), (5,680) and (35,680) on the rectangular image zone of Xian Dinging, that is to say the image-region at display element place.
Step 208 is synchronized to the composite video image in the described image layer buffering area in the display buffer once more and shows.
Herein, the video image of the backup on the image layer buffering area with use consistent image layer buffering area and the display buffer of calling of exercisable video image when synchronous, the video image of the backup on the image layer buffering area can cover display element region video image on the display buffer, thereby hides display element.
Fig. 3 is the schematic diagram of image processing apparatus in the embodiment of the invention, and image processing apparatus comprises video image generation module 31, image processing module 32 and synchronization module 33 in the embodiment of the invention, wherein:
Video image generation module 31 is used for the decoding video signal to input, generates video image;
, when specifically implementing, realize the function of video layer herein, to the decoding video signal of input, generate video image, this video image is buffered in the video layer buffering area.
Image processing module 32, the prompting request that is used for issuing according to application generates information, described information is added on the video image that described video image generation module 31 generates, generate composite video image, and described composite video image is buffered in the image layer buffering area, the display element that issues according to application shows request, obtain the area information of the image-region that display element and described display element take in described composite video image, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element;
Can comprise during image processing module 32 concrete enforcements:
Composite video image generation unit 321, the prompting request that is used for issuing according to application generates information, described information is added on the video image that described video image generation module 31 generates, generate composite video image, and described composite video image is buffered in the image layer buffering area;
Herein, realize the function of image layer, promptly from the video layer buffering area, obtain this video image, information superposes on this video image, generate composite video image, make screen provide more additional information for the user, this prompting message can only be formed, also can be combined by literal and picture by literal or picture, and prompting message can be the rendition list that for example has programm name and background image.Composite video image after image layer is handled is buffered in the image layer buffering area.During concrete enforcement, can receive application layer and issue the prompting request, the prompting request is the operation of application program at the user, a series of graphic operation sequences that are intended to change the active user interface of sending to the graphics engine module.At the operation of drawing, graphics engine receives picture data and operating parameter, according to operating parameter the driving relevant parameter is set, and the picture stacked data is added on the video image; At the request of the element figure sequence of operation, graphics engine calls and drives relevant interface, draws out element figure and this element figure is added on the video image.
Display element superpositing unit 322, the display element that is used for issuing according to application shows request, obtain the area information of the image-region that display element and described display element take in described composite video image, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element.
Herein, some application can require to hang display element on video image, for example TV station's icon, platform number or operation indicating icon etc.During concrete enforcement, can preset the information chained list of all display elements on the cursor layer, the display element that stores each element in this information chained list identifies, shows component information such as original position, display size parameter, the display element that issues according to application shows that the display element in the request identifies, in this information chained list, search and think corresponding display element, the area information of the image-region that in described composite video image, takies according to the original position and the display size calculation of parameter display element of this display element.An example of above-mentioned information chained list can see Table 1, in the table 1, herein, when showing the display element in the request, display element is designated ID001, then search corresponding display element according to this display element sign, while is according to the original position (5 of this display element, 660) and display size 30 * 20 width coordinate scope of calculating the image-region that these display elements take at composite video image be [5,35], the height coordinate scope is [660,680], after this can be with aforesaid width coordinate scope and height coordinate scope area information as this image-region, also can use four apex coordinates (5,660) of image-region, (35,660), (5,680) and (35,680) as the area information of this image-region.
Synchronization module 33, the composite video image that is used for the described display element that superposes that will be in the described image layer buffering area be generated by described image processing module 32 is synchronized to the display buffer and shows.
, copy on the video memory herein, promptly carry out the simultaneous operation that is cached to video memory data cached.Owing to cursor layer needs data presented to append on the image layer, call to be cached to after the video memory simultaneous operation, the image that has mixed cursor layer and image layer two layer data has just shown.
In addition, some uses the demonstration time requirement to some extent to display element, when the demonstration that reaches application specifies during the time, application can issue display element and hide request, carry out display element with indication and hide operation, will hide processing to the display element in the composite video image of the display element that superposes this moment, so image processing module 32 can also comprise:
Backup units 323 is used for backing up according to described area information the video image in the respective image zone of described composite video image;
Herein, during concrete enforcement, can be cached in the extra buffer according to the video image of described area information, thereby the video image of the image-region that display element on the composite video image will be taken backs up the respective image zone of described composite video image.For example according to above-mentioned example, the width coordinate scope of the image-region that takies at composite video image according to display element is [5,35], the height coordinate scope is [660,680], with width coordinate scope in the composite video image is [5,35], the height coordinate scope is that the video image of [660,680] image-region is cached in the extra buffer, that is to say that the video image of the image-region that display element on the composite video image will be taken is cached in the extra buffer.Four apex coordinates (5 of the image-region that takies at composite video image according to display element and for example, 660), (35,660), (5,680) and (35,680), with composite video image in the image layer buffering area by these four apex coordinates (5,660), (35,660), (5,680) and (35,680) video image in the rectangular image zone of Xian Dinging is cached in the extra buffer, that is to say that the video image of the image-region that display element on the composite video image will be taken is cached in the extra buffer.Image restoration unit 324 is used to receive and uses the display element that issues and hide request, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of the video image of described backup units 323 backups;
During concrete enforcement, with the be added to image-region at the display element place on the composite video image in the described image layer buffering area of the video image of backup units 323 backup, thereby display element is removed from composite video image, composite video image in the image layer buffering area is returned to state before the display element that do not superpose.Herein, according to above-mentioned example, can be according to width coordinate scope [5,35], the height coordinate scope [660,680], the video image of backup is added to width coordinate scope [5,35], the height coordinate scope [660 of composite video image in the described image layer buffering area, 680] image-region that is to say the image-region at display element place.In addition, also can be according to four apex coordinates that calculate in the step 103, with described display element be added to composite video image in the described image layer buffering area by these four image-regions that apex coordinate limits, for example according to above-mentioned example, can be according to four apex coordinates (5,660), (35,660), (5,680) and (35,680), with the video image of backup be added to composite video image in the described image layer buffering area by these four apex coordinates (5,660), (35,660), (5,680) and (35,680) on the rectangular image zone of Xian Dinging, that is to say the image-region at display element place.
Indicating member 325 is used for indicating described synchronization module that the composite video image that is recovered by image restoration unit 324 in the described image layer buffering area is synchronized to the display buffer once more and shows synchronously.
Herein, the video image of the backup on the image layer buffering area with use consistent image layer buffering area and the display buffer of calling of exercisable video image when synchronous, the video image of the backup on the image layer buffering area can cover display element region video image on the display buffer, thereby hides display element.
The embodiment of the invention also proposes a kind of receiving terminal for digital television, and described receiving terminal for digital television comprises image processing apparatus shown in Figure 3, and this image processing apparatus comprises video image generation module 31, image processing module 32 and synchronization module 33, wherein:
Video image generation module 31 is used for the decoding video signal to input, generates video image;
Image processing module 32, the prompting request that is used for issuing according to application generates information, described information is added on the video image that described video image generation module 31 generates, generate composite video image, and described composite video image is buffered in the image layer buffering area, the display element that issues according to application shows request, obtain the area information of the image-region that display element and described display element take in described composite video image, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element;
Can comprise during image processing module 32 concrete enforcements:
Composite video image generation unit 321, the prompting request that is used for issuing according to application generates information, described information is added on the video image that described video image generation module 31 generates, generate composite video image, and described composite video image is buffered in the image layer buffering area;
Display element superpositing unit 322, the display element that is used for issuing according to application shows request, obtain the area information of the image-region that display element and described display element take in described composite video image, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element.
Synchronization module 33, the composite video image that is used for the described display element that superposes that will be in the described image layer buffering area be generated by described image processing module 32 is synchronized to the display buffer and shows.
In addition, some uses the demonstration time requirement to some extent to display element, when the demonstration that reaches application specifies during the time, application can issue display element and hide request, carry out display element with indication and hide operation, will hide processing to the display element in the composite video image of the display element that superposes this moment, so image processing module 32 can also comprise:
Backup units 323 is used for backing up according to described area information the video image in the respective image zone of described composite video image;
Image restoration unit 324 is used to receive and uses the display element that issues and hide request, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of the video image of described backup units 323 backups;
Indicating member 325 is used for indicating described synchronization module that the composite video image that is recovered by image restoration unit 324 in the described image layer buffering area is synchronized to the display buffer once more and shows synchronously.
Need to prove that the module of each module that image processing apparatus comprises in the embodiment of the invention receiving terminal for digital television and the concrete working method of unit and image processing apparatus shown in Figure 3 is identical with the working method of unit, is not described in detail in this.
Receiving terminal for digital television of the present invention includes but not limited to: and set-top box, network protocol television (InternetProtocol Television, IPTV), digital TV integrated machine etc. has the terminal of receiving digital television function.
To sum up, implement the embodiment of the invention, generate information by the prompting request that issues according to application, described information is added on the described video image, generate composite video image, and described composite video image is buffered in the image layer buffering area, the display element that issues according to application shows request, obtain the area information of the image-region that display element and described display element take in described composite video image, according to described area information with the be added to respective image zone of composite video image in the described image layer buffering area of described display element, thereby when realizing the image layer function, also the function of cursor layer is simulated, therefore need not to increase corresponding cursor layer driving and memory cost with extra realization cursor layer, avoid the processing burden of graph mixing module.
Above disclosed is preferred embodiment of the present invention only, can not limit the present invention's interest field certainly with this, and therefore the equivalent variations of doing according to claim of the present invention still belongs to the scope that the present invention is contained.