Embodiment
See also Fig. 1, Fig. 1 is the schematic flow sheet of combination control method of the present invention.
Said combination is driven by plural multi-screen processor subregion, and said combination control method may further comprise the steps:
S101 receives the instruction that the user opens window;
Wherein, comprise the positional information of said window on said combination desktop at least in the said instruction of opening window.
As an embodiment, in this step, serve as that female coordinate system is set up in reference with said combination desktop, detect user's operation information, the position of window coordinate that recording user is opened in said combination desktop is as said position of window information.
S102 calculates the positional information of said window counterpart in each multi-screen processor desktop respectively;
In combination control method of the present invention, the desktop of each each self-generating of said multi-screen processor self, each said multi-screen processor table combination becomes the demonstration desktop of said combination.As an embodiment; At first calculate the position coordinates in said female coordinate system that each said multi-screen processor desktop creates in step S101; According to the position coordinates of said window in said female coordinate system, calculate the overlapping coordinate of counterpart in said female coordinate system of said window and each said multi-screen processor desktop;
Then; With each said multi-screen processor desktop serves as with reference to setting up subcoordinate system; With the coordinate conversion of counterpart in said female coordinate system of said window is the coordinate in said subcoordinate is, promptly obtains the positional information of said window counterpart in each said multi-screen processor desktop.
S103, the counterpart of the said window of establishment in each said multi-screen processor desktop;
As an embodiment; In this step; Can be according to the positional information of the counterpart of said window in each said multi-screen processor; On the correspondence position of each said multi-screen processor desktop, create the subwindow on a no frame, no title hurdle, said subwindow is the counterpart of said window in each said multi-screen processor desktop, then on each said combination, will show complete said window.
S104, the positional information of each counterpart images displayed of calculating said window respectively in the original image that said window shows;
Because each said multi-screen processor is created the part of said window respectively, therefore, images displayed will be divided into several parts in identical ratio in the said window, and in each said multi-screen processor desktop, show respectively.As an embodiment, in this step,, calculate each counterpart and the said position of window ratio of said window at first according to each counterpart and the position coordinates of said window in said female coordinate system of said window; And then obtain the image size information of the original image that shows in the said window, can calculate the positional information of each counterpart images displayed in said original image of said window.
The image size information of said original image can be specified by the user, also can be provided by the signal source that said original image is provided.Therefore, before execution in step S104, can judge whether to receive the image size information of original image of the signal source of user's appointment earlier;
If; Then, calculate the positional information of each counterpart images displayed in the original image that said window shows of said window according to the image size information of said original image and each counterpart and the said position of window ratio of said window;
Otherwise,, calculate according to the image size information of the said original image that obtains then to the image size information of the said original image of signal source acquisition request of user's appointment.
S105 obtains corresponding parts of images data;
In one embodiment, several said multi-screen processors that drive said combination all are connected to the individual signals source, and said combination only shows the image of said signal source, and the view data that said signal source provides is said raw image data.Therefore can from said original image, obtain corresponding parts of images data directly according to the positional information of each counterpart images displayed in the original image that said window shows of said window.
In another embodiment; Drive the signal source that said combination has two or more; Each said signal source connects each said multi-screen processor through network; Said combination can show the wherein image of some signal sources, also can show the image of two the above signal sources simultaneously, and the image of therefore concrete which signal source of demonstration needs the user to provide the network address of signal source to specify.
When obtaining corresponding parts of images data; Two kinds of methods of obtaining can be arranged; Wherein a kind of method is: the network address that receives the signal source of user's appointment; According to the positional information of each counterpart images displayed in the original image that said window shows of said window, directly ask corresponding parts of images data then to the said signal source of correspondence.The method is because directly to each said parts of images data of said signal source request; Then will be divided into a plurality of parts from the parts of images data of said signal source output and transmit, each said multi-screen processor can be respectively receives corresponding parts of images data from said signal source through image transmission thread independently concurrently.Because each said parts of images data can parallel transmission, so each image transmission thread image transmitted data volume is less, and transmission speed is very fast, can improve the speed of Flame Image Process.
The another kind of method of obtaining corresponding parts of images data is: receive the complete raw image data of a frame that signal source is sent; According to the positional information of each counterpart images displayed in the original image that said window shows of said window, from said raw image data, extract corresponding parts of images data then.Wherein, said signal source can be sent said raw image data to network through the mode of multicast or broadcasting, and each said multi-screen processor is according to the raw image data of the corresponding said signal source of user's command reception.The method is accomplished operating in each said multi-screen processor of intercepting various piece view data separately, therefore need not said signal source is sent the said parts of images data of request, realizes more convenient.
During various image data transmission, can encode to view data at the image transmit leg earlier, the take over party decodes to image again at image.
S106 shows corresponding parts of images in each said multi-screen processor desktop.
The said parts of images data that obtain among the step S105 are shown in the counterpart of the said window that step S103 creates, during demonstration, show according to the image zoom ratio of said original image in said window.
As a kind of preferred implementation; The demonstration of the parts of images data on each said multi-screen processor desktop is adopted the method for image incremental refreshment; Only vicissitudinous parts of images data are repainted when being image refreshing; Parts of images for not having to change then shows according to the view data of former frame; So can improve the plotting speed of each said multi-screen processor, also can call the hardware driving layer of each said multi-screen processor and accomplish the into drafting of image, further improve plotting speed.
In combination control method of the present invention; If further receive the instruction that the user moves said window after the completing steps S106; Positional information after then said window being moved is as the new position of window information of on said combination desktop, opening; From new execution in step S102 to S106, on the new position coordinates of each multi-screen processor desktop, create the counterpart of said window, and obtain corresponding parts of images and show.If receive the instruction that the user closes said window, then close the counterpart of the said window in each said multi-screen processor desktop simultaneously, and stop to obtain and showing of image.
Compared with prior art; In the combination control method of the present invention; The window of the desktop of each multi-screen processor and image are by each self-generating of each multi-screen processor; Void screen processor or the primary processor that need not to be provided with high throughput goes to generate behind the complete big resolution combination desktop bitmap partitioned image again, and simultaneously, combination control method of the present invention can be accelerated the coordinate computation speed in the image segmentation process; Accelerate image processing speed, be particularly useful for the situation of the more large-scale display splicing wall of split screen number of a plurality of multi-screen processor driven in synchronism.
See also Fig. 2, Fig. 2 is the structural representation of combination control system of the present invention.
In the said combination control system;Combination 21 is driven by pluralmulti-screen processor 22 subregions; Self desktop bitmap of each saidmulti-screen processor 22 each self-generatings; In the subregion of the said combination of being responsible for separately 21, show respectively then, form the demonstration desktop of a complete combination.
Said combination control system comprisescontrol system client 23, controlsystem service end 24 anddesktop client end 25, wherein, all moves a controlsystem service end 24 and a desktop client end 25 in each saidmulti-screen processor 22.
Saidcontrol system client 23 is used for through detecting monitoring technique; Receive user's operational order; User's operational order comprises the instruction of opening window, the instruction of moving window and the instruction that closes window; Wherein, comprise the positional information of said window on the combination desktop at least in the said instruction of opening window.
In one embodiment; Saidcontrol system client 23 serves as with reference to setting up female coordinate system with the desktop of whole said combination; Detect user's operation information, calculate the position of window coordinate that the user opens in said combination desktop, as said position of window information.In one embodiment, saidcontrol system client 23 is said position of window information, and the image size information packing of the address of the signal source of user's appointment, original image, is sent to said controlsystem service end 23 with the form of instruction.
Said controlsystem service end 24 receives the instruction of saidcontrol system client 23; According to the positional information of said window on said combination desktop; Calculate the positional information of said window counterpart in each said multi-screen processor desktop respectively, in each said multi-screen processor desktop, create the counterpart of said window;
Please consult Fig. 3 in the lump, Fig. 3 is the structural representation of control system service end in the combination control system of the present invention.
Said controlsystem service end 24 comprises coordinatecomputation module 241 and window creation module 242.Said coordinatecomputation module 241 is at first calculated the position coordinates of each said multi-screen processor desktop in said female coordinate system; According to the position coordinates of said window in said female coordinate system, calculate the overlapping coordinate of counterpart in said female coordinate system of said window and each said multi-screen processor desktop; Then; With each said multi-screen processor desktop serves as with reference to setting up subcoordinate system; With the coordinate conversion of the counterpart of said window is the coordinate in said subcoordinate system, promptly obtains the positional information of the counterpart that said window shows in each said multi-screen processor.
Saidwindow creation module 242 is used for according to the positional information of said window at each said multi-screen processor desktop counterpart, in the desktop that each said multi-screen processor generates, creates the counterpart of said window.
As an embodiment; Saidwindow creation module 242 is created the subwindow on a no frame, no title hurdle on the correspondence position of each said multi-screen processor desktop; Said subwindow is the counterpart of said window in each said multi-screen processor desktop, then on each saidcombination 21, will show complete said window.
Saiddesktop client end 25 is used for calculating respectively the positional information of each counterpart images displayed of said window at the original image of said window demonstration; Obtain corresponding parts of images data, and in each said multi-screen processor desktop, show corresponding parts of images.
Please consult Fig. 4 in the lump, Fig. 4 is the structural representation of desktop client end in the combination control system of the present invention.
Saiddesktop client end 25 comprisesimage division module 251,image collection module 252 and image display.
Because said window is a corresponding part that shows wherein in each said multi-screen processor desktop, therefore, images displayed should be divided into several portions in identical ratio equally in the said window, and in each said multi-screen processor desktop, shows respectively.Therefore saidimage division module 251 is calculated each counterpart and the said position of window ratio of said window at first according to each counterpart and the position coordinates of said window in said female coordinate system of said window; And then obtain the image size information of said original image, according to the image size information and the said position proportional of said original image, can calculate the positional information of each counterpart images displayed in said original image of said window.
The image size information of said original image can be specified by the user, also can be provided by the signal source that said original image is provided.Therefore, can further comprise judge module (figure do not show) in the saiddesktop client end 25, said judge module is used to judge whether to receive the image size information of original image of the signal source of user's appointment; If then saidimage division module 251 is calculated the positional information of each counterpart images displayed of said window according to the image size information of said original image and each counterpart and the said position of window ratio of said window; Otherwise saidimage division module 251 is calculated according to the image size information of said original image to the image size information of the said original image of signal source acquisition request of user's appointment again.
In one embodiment; Several saidmulti-screen processors 22 that drive saidcombination 21 all are connected toindividual signals source 26; 21 images that show saidsignal source 26 of said combination, the view data that saidsignal source 26 provides is said raw image data.Therefore saidimage collection module 252 can be obtained corresponding parts of images data directly according to the positional information of each counterpart images displayed in the original image that said window shows of said window from said original image.
In another embodiment, several saidmulti-screen processors 22 that drive saidcombination 21 connectplural signal source 26 through network, and are as shown in Figure 5.Saidcombination 21 can show the image of wherein somesignal sources 26, also can show the image of two theabove signal sources 26 simultaneously, shows that specifically the image of which signal source then needs the user to provide the network address information of signal source to specify.
Saidimage collection module 252 is when obtaining corresponding parts of images data; Can select to adopt the method for two kinds of Image Acquisition; Wherein a kind of method is: saidimage collection module 252 receives the network address of thesignal source 26 of user's appointment; According to the positional information of each counterpart images displayed in the original image that said window shows of said window, directly ask corresponding parts of images data then to the saidsignal source 26 of correspondence.
Because saidimage collection module 252 is directly to saidsignal source 26 each said parts of images data of request; Then will be divided into a plurality of parts from the parts of images data of saidsignal source 26 outputs and transmit, each saidmulti-screen processor 22 can be respectively receives corresponding parts of images data from saidsignal source 26 through image transmission thread independently concurrently.Because each said parts of images data can parallel transmission, so each image transmission thread image transmitted data volume is less, and transmission speed is very fast, can improve the speed of Flame Image Process.As a preferred embodiment, the view data between saidsignal source 26 and the saidmulti-screen processor 22 is used TCP or the transmission of UDP host-host protocol, and web socket adopts non-resistance pattern.
The another kind of method that saidimage collection module 252 is obtained corresponding parts of images data is: saidimage collection module 252 receives the complete raw image data of a frame that signalsource 26 is sent; According to the positional information of each counterpart images displayed of said window, from said raw image data, extract corresponding parts of images data.Wherein, saidsignal source 26 can be sent said raw image data to network through the mode of multicast or broadcasting, and each saiddesktop client end 25 is according to the raw image data of the corresponding saidsignal source 26 of user's command reception.The method is accomplished operating in each saidmulti-screen processor 22 of intercepting various piece view data separately, therefore need not saidsignal source 26 is sent the said parts of images data of request, realizes more convenient.
When saidsignal source 26 whole raw image datas of transmission or hop view data, can encode to view data earlier, after each saiddesktop client end 25 receives corresponding view data, decode again.
Said image display 253 is used for showing corresponding parts of images at each said multi-screen processor desktop.
Said image display 253 shows according to the image zoom ratio of said original image in said window when showing corresponding parts of images data.In order to accelerate the image speed of displaying;Said image display 253 can adopt the method for image incremental refreshment, promptly only vicissitudinous parts of images data is repainted during image refreshing, then shows according to the view data of former frame for the parts of images that not have variation; So can improve plotting speed; Especially, saidimage display 253 also can be called the hardware driving layer of each saidmulti-screen processor 22 and accomplish the into drafting of image, further improves plotting speed.
In combination control system of the present invention; If saidcontrol system client 23 receives the instruction that the user moves said window; Positional information after then said window being moved is as on said combination desktop, opening position of window information and being sent to said controlsystem service end 24; By the counterpart of creating said window on the new position coordinates of said controlsystem service end 24 in each said multi-screen processor desktop, and obtain new parts of images data and show by said desktop client end 25.If saidcontrol system client 23 receives the instruction that the user closes said window; Then send the counterpart that order notifies said controlsystem service end 24 to close the said window in each said multi-screen processor desktop, saiddesktop client end 25 stops corresponding parts of images Data Acquisition and demonstration.
If through after the coordinate Calculation; After moving, said window in original multi-screen processor desktop, do not show; Then corresponding said controlsystem service end 24 is closed the counterpart of the said window in the said multi-screen processor desktop, and saiddesktop client end 25 stops to obtain corresponding parts of images data.And if said window shows in newmulti-screen processor 22 desktops after moving; Then corresponding said controlsystem service end 24 is created the counterpart of the said window in the said multi-screen processor desktop, and saiddesktop client end 25 obtains corresponding parts of images data and shows.
Compared with prior art; In the combination control system of the present invention; The window of the desktop of each multi-screen processor and image are by the said control system service end in eachmulti-screen processor 24 and saiddesktop client end 25 each self-generating; Divide again after need not to generate a complete big resolution combination desktop bitmap, therefore, the void screen processor or the primary processor of high throughput need be set.Again since the coordinate computation of window and image division all carry out separately by eachmulti-screen processor 22 respectively; Therefore; Combination control system of the present invention can be accelerated the coordinate computation speed in the image segmentation process; Accelerate image processing speed, be particularly useful for the situation of the more large-scale display splicing wall of split screen number of a plurality of multi-screen processor driven in synchronism.
See also Fig. 6, Fig. 6 is the hardware configuration synoptic diagram of a kind of embodiment of combination control system of the present invention.
Said combination control system comprisescombination controller 61; A plurality ofmulti-screen processors 62; Each saidmulti-screen processor 62 is responsible for driving one of them subregion of combination; A plurality of saidmulti-screen processors 62 connect saidcombination controller 61 and a plurality ofsignal servers 63 respectively through network, and saidsignal server 63 is used to provide raw image data.
Move said control system client-side program of the present invention in the saidcombination controller 61, be used to receive user's operational order, control the display operation of said combination.Operation said control system serve end program of the present invention and said desktop client in each saidmulti-screen processor 62 are used for carrying out desktop generation, window creation and image according to the instruction of saidcombination controller 61 and show.
Because the desktop bitmap of each subregion of said combination is created respectively by each saidmulti-screen processor 62; Carrying out coordinate computation and image in each saidmulti-screen processor 62 respectively shows; So need not to be provided with the void screen processor of high throughput or desktop bitmap and then the partitioned image that primary processor is created whole combination; Save hardware resource, and improved the speed of Flame Image Process.
Above-described embodiment of the present invention does not constitute the qualification to protection domain of the present invention.Any modification of within spirit of the present invention and principle, being done, be equal to replacement and improvement etc., all should be included within the claim protection domain of the present invention.