Embodiment
First embodiment
Describe the first embodiment of the present invention in detail below with reference to accompanying drawing.
In the present embodiment, multidisplay system comprises: many display servers provide the picture material data; And a plurality of display units, utilize all display units to show all images content, and each display unit show a part of picture material.The picture material data are divided into a plurality of zones, and the picture material data are offered display unit from many display servers with the form of integrated data (packet data).Whether each display unit is judged from integrated data that many display servers provided corresponding to himself allocated display area.Display unit is only accepted the integrated data of allocated display area, and recovers image and demonstration based on the integrated data of being accepted.Present embodiment will illustrate a kind of like this multidisplay system.
The explanation of the illustrative arrangement of multidisplay system (Fig. 1)
Fig. 1 is the schematic block diagram that the example of arranging substantially of multidisplay system is shown.
With reference to figure 1, the picture material data that multidisplaysystem 61 is imported fromcontent server 60, and show the picture material data of being imported.At display unit (Disp11~Disp33) show on 71~79 formed screens bycombination 3 row * 3 row.
Content server 60 is sent the picture material data in response to the request fromclient terminal 65 by flowing to multidisplay system 61.For example,content server 60 codings are with the picture material data of paying, thus the reduction communication bandwidth.That is to say, by MPEG2 or H.264 wait encoding scheme compression original image content data.Picture material data-switching after the compression is become the transport stream of forms such as MPEG2TS, and send this transport stream.Can use any encoding scheme and stream format.
Multidisplay system 61 receives the picture material data of being sent fromcontent server 60 by stream, and based on the picture material data presentation image that is received.Communication line 62 is used to send the picture material data that will send bystream.As communication line 62, can use the medium of network (for example, the Internet etc.) and device interface various schemes such as (IEEE1394 etc.).
Inmultidisplay system 61,many display servers 63 provide the picture material data to eachdisplay unit 71~79.Communication path 64 is used for the picture material data are offered eachdisplay unit 71~79.Communication path 64 comprises for example network such as LAN (LAN (Local Area Network)), WAN (wide area network) or the Internet.Note, can generally usecommunication path 64 andcommunication line 62.
The picture material data that provided frommany display servers 63 are provideddisplay unit 71~79.At this moment, eachdisplay unit 71~79 only accepts to belong to that part of data of the allocated display area of himself.Eachdisplay unit 71~79 shows a part of picture material based on the picture material data of the allocated display area that belongs to himself.Display unit 71~79 comprises LCD (LCD) or plasma display) etc. the display panel of various systems.Notice that one of them displayunit 71~79 can comprise the display panel of the system that is different from all the other display units.By display screen size that increasesdisplay unit 71~79 or the quantity that increases the display unit that will be combined, can realize the more demonstration of giant-screen size.
The whole bag of tricks of the allocated display area that displayunit 71~79 is set can be utilized, and any means can be used.As the simplest method, can utilize by the user these regional methods clearly are set.When user's operation setting was given the switch etc. ofdisplay unit 71~79, the user can be provided with the allocated display area of the display unit with respective switch.Alternatively, for example,client terminal 65 can send the information of the allocated display area that is used fordirection display unit 71~79 tomany display servers 63, andmany display servers 63 can be provided with the allocated display area ofdisplay unit 71~79.
Display unit 71~79 can be assembled to frame shape guide member (frame-likeguide member).The user is installed intodisplay unit 71~79 in the guide member that can support thedisplay unit 71~79 arranged with 3 * 3 matrixes (3 row * 3 row).And the user is connected to thesedisplay units 71~79 with electric power cable and signal cable.Like this,display unit 71~79 forms giant-screen.Distribute unique identifier by rigging position to them, can carry out the identification ofdisplay unit 71~79 and the appointment of its position according todisplay unit 71~79.Sensor can be arranged on the coupling surface (coupled surface) ofdisplay unit 71~79, and can be sensor-based testing result specify the position ofdisplay unit 71~79.For example, (for example, end face, bottom surface and two sides) are provided with sensor on the four direction ofdisplay unit 71~79 that can be coupled.Behind thedisplay unit 71~79 that has been coupled, they use sensor and coupling the other side exchange id.Like this, by the ID thatarrangement display unit 71~79 is kept, can specify their position.
The demonstration example of multidisplay system (Fig. 2 A and 2B)
Fig. 2 A and 2B illustrate the demonstration example in the multidisplay system 61 (display unit 71~79).
Fig. 2 A illustrates the example of picture material.In Fig. 2 A, by house object and who object composingimages content 50.
Fig. 2 B is illustrated in the demonstration example when usingdisplay unit 71~79 display image content 50.Display screen 51~59 is respectively the display screen ofdisplay unit 71~79.In Fig. 2 B,, constitute the display screen of single 3 * 3 matrixes (3 row * 3 row) by making up this 9display units 71~79.
Like this, Fig. 2 B is illustrated in wherein by making up the example of thepicture material 50 shown in the displayed map 2A on the display screen that these 9display units 71~79 are constituted.Eachdisplay unit 71~79 shows a part oforiginal image content 50 according to its allocated display area.For example,display unit 71 shows the image of the upper left on roof ondisplay screen 51, anddisplay unit 76 shows the image of people's upper body part on display screen 56.Display screen 51~59 o'clock atcombination display unit 71~79 shown in Fig. 2 B, can show wholeoriginal image content 50 on a screen.
The structure of image data packets (Fig. 3 A~4C)
The structure of employed image data packets when sending inmultidisplay system 61 below will be described.In the present embodiment, the picture material data are divided into little rectangular sheet zone.With the picture material data storage that respectively is divided in image data packets.And, the additional ID that the coordinate position of each rectangular sheet of expression is arranged of image data packets.
Fig. 3 A and 3B illustrate the example that is used for the picture material data are divided into the method in little rectangular sheet zone.
Fig. 3 A illustrates the example of the state of the picture material data that are divided into little rectangular sheet zone.
Suppose in level and vertical direction m (m is a natural number) * individual grid of n (n is a natural number) is set on picture material 50.In addition, each grid comprises for example 16 * 16 pixels.By boundarysegmentation picture material 50, generate m * n rectangular sheet zone along these grids.The position coordinates ID of the position by representing interested grid discerns each rectangular sheet zone.
Fig. 3 B illustrates the example of a part of picture material that is sheared into the rectangular sheet shape.Theimage 80 of rectangular sheet shape is the image in the zone of shearing by the grid of the coordinate (5,7) that is positioned at picture material 50.This regional position coordinates ID is (5,7).
Fig. 4 A~4C illustrates the example of structure of image data packets.
Fig. 4 A illustrates image data packets 90.Fig. 4 B illustrates the structure of image data packets 90.Shown in Fig. 4 B,image data packets 90 haspacket header 91 and payload 92.Payload 92 storages are sheared into the picture material data of rectangular sheet shape.
Fig. 4 C illustrates the structure in packet header 91.The type of bag identifyinginformation field 93 expression bags.As mentioned above, bag identifyinginformation field 93 storage id informations and version information etc., wherein, whether id information is to discern to use interestedimage data packets 90 to show necessary ondisplay unit 71~79.And bag identifyinginformation field 93 can also the storage package length, inspection and etc. bag handle required information.
The required id information ofcontent id field 94 storage recognition image contents.Desired position, the position coordinate ID in sheet coordinateid field 95 storage identification rectangular sheet zones.Other id field 96 storage identification rectangular sheet other required ID of zone.For example,other id field 96 is stored frame numbers etc.The various timestamps ofsynchrodata field 97 storage representation temporal informations, for example: processing start time of the picture material of discerning by the id information that is stored in thecontent id field 94 and handling the concluding time etc.The required various types of attribute informations of picture material data of property data fields 98 stores processor rectangular sheets.
As described below, eachdisplay unit 71~79 of present embodiment judges that according to sheet coordinateid field 95 eachimage data packets 90 is whether corresponding to himself allocated display area.
The internal placement of many display servers and operation (Fig. 5 A and 6)
Fig. 5 A and 5B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Fig. 5 A.
With reference to figure 5A, 63 pairs of data that received fromcontent server 60 of many display servers are decoded, and decoded data are packed with generationimage data packets 90, and these bags are sent to displayunit 71~79.
Thewhole multidisplay system 61 of manyindicative control unit 1 controls.Manyindicative control units 1 comprise storeies such as CPU, ROM and RAM, bus and various interface etc.When using executions such as RAM to be stored in program among the ROM as CPU, manyindicative control units 1 are controlled total systems.Each element of themany display servers 63 of serveroverhead control unit 2 controls formation.
LAN interface (LAN I/F) 3 is via the picture material data ofcommunication line 62 inputs from content server 60.The picture material data thatmemory buffer 4 interim storages are imported from LAN interface 3.As mentioned above, the picture material data that sent fromcontent server 60 are encoded.Therefore, 5 pairs of coded picture material data of demoder are decoded to recover original image content.
Demoder 5 is from bufferingstorer 4 reading images content-datas, and it is decoded, and from decoded portion these data outputed to subsequent stage successively.The timestamp information thatdemoder 5 will add to (included in the stream) picture material data offerssynchronous control unit 12, and the picture material data are offeredbag transmitting element 6.
6 pairs of picture material data of bag transmitting element are cut apart and are packed with generationimage data packets 90, and these bags are outputed to transmission interface (sending I/F) 7.The back will describebag transmitting element 6 in detail.
Transmission interface (send I/F) 7 sends to displayunit 71~79 with image data packets 90.Image data packets 90 is broadcast to thedisplay unit 71~79 that is connected to many display servers 63.Thetransmission interface 7 independent various control datas that manyindicative control units 1 are generated send to displayunit 71~79.
Inbag transmitting element 6, data partitioning unit (data division unit) 10 split image content-datas are so that each divided data has eachdisplay unit 71~79 manageable size (data volume) as the destination of picture material data.Notice that for example,many display servers 63 can obtain eachdisplay unit 71~79 manageable size (data volume) by communicating withdisplay unit 71~79.In addition,many display servers 63 can obtain eachdisplay unit 71~79 manageable size (data volume) from forexample content server 60 orclient terminal 65 etc.
In the present embodiment,data partitioning unit 10 is divided into a plurality of rectangular sheets zone with the picture material data, so that each divided data has the tentation data size.More specifically,data partitioning unit 10 is divided into the picture material data as example rectangular sheet as shown in Figure 3A.Synchronous control unit 12 generates inner synchro control data based on additional date stamp information to the original image content data.This synchro control comprises to the demonstration time of the processing start time of the transmitting time ofdisplay unit 71~79,display unit 71~79 anddisplay unit 71~79 equal time information.The synchro control data that synchronouscontrol unit 12 is generated are stored in thesynchrodata field 97 shown in Figure 4 as timestamp.Notice that the synchro control data are not limited to above-mentioned, but the information that can use any other type is as the synchro control data, as long as this information is can specify processing in thedisplay unit 71~79 to begin regularly and the temporal information of Displaying timer etc.
Bag generation unit 11 generates theimage data packets 90 with the structure shown in Fig. 4 A~4C.More specifically,bag generation unit 11 generates bag by withpacket header 91 additional picture material data to each rectangular sheet.The position coordinates ID ofpacket header 91 storage rectangle panel region and timestamp etc.
Utilize the layout of above-mentionedmany display servers 63, the original image content data that received fromcontent server 60 are packed, to generate theimage data packets 90 that can send to displayunit 71~79.
Example below with reference to the operation of themany display servers 63 of flowchart text of Fig. 6.
At step S1, serveroverhead control unit 2 is waited for, till the picture material data thatLAN interface 3 inputs are sent from content server 60.IfLAN interface 3 Input Image Content data are then handled and are entered step S2.After processing entered step S2, the picture material data that serveroverhead control unit 2 will be input toLAN interface 3 were stored in thememory buffer 4 temporarily.
At step S3,5 pairs of coded picture material data of demoder are decoded, to recover original image content.
At step S4,data partitioning unit 10 is divided into a plurality of rectangular sheets with the picture material data.
At step S5,synchronous control unit 12 stabs for cut apart each the picture material data rise time that obtains at step S4 based on additional timestamp information to the original image content data.
At step S6,bag generation unit 11 is cut apart the position coordinates ID of each the picture material data (that is the divided area of picture material) that obtain in step S4.
At step S7, additional giving such as the header thatbag generation unit 11 will be generated in step S5 and S6 etc. cut apart each the picture material data that obtains in step S4, to generate image data packets 90.As mentioned above, will in step S4, cut apart each picture material data storage of obtaining in payload 92.The timestamp that will be generated in step S5 is stored in the synchrodata field 97.The positional information ID that will be generated in step S6 is stored in the sheet coordinateid field 95.
At step S8, theimage data packets 90 that serveroverhead control unit 2indication transmission interfaces 7 are sent among the step S7 to be generated etc.Like this,image data packets 90 grades are sent to displayunit 71~79.Notice that as mentioned above, also the control data that serveroverhead control unit 2 is generated sends to displayunit 71~79 fromtransmission interface 7.
The internal placement of display unit and operation (Fig. 5 B and 7)
The layout that shows eachunit 71~79 below with reference to Fig. 5 B explanation.Notice that displayunit 71~79 has identical set.Therefore, the layout ofdisplay unit 71 only is described, and does not provide explanation for the layout of all theother display units 72~79.
With reference to figure 5B,display unit 71 judges that the image data packets that sent fromdisplay server 63 90 is whether corresponding to himself allocated displayarea.Display unit 71 is only accepted (reception) himselfimage data packets 90 of allocated display area, and recovers and show a part of picture material.
The assembly of display unitoverhead control unit 20 controls formation display unit 71.Display unitoverhead control unit 20 comprises for example storer such as CPU, ROM and RAM and various interface etc.When using the program of executive logging such as RAM in ROM as CPU, thewhole display unit 71 of display unitoverhead control unit 20 controls.
Theimage data packets 90 that receiving interface (receiving I/F) 21 inputs are sent from many display servers 63.Receiving interface (receive I/F) 21 is inputimage data bag 90 not only also, and input is by control data that manyindicative control units 1 generated etc.
Bag receiving element 22 is judgedimage data packets 90 whether corresponding to himself allocated display area, and only accepts (reception) and the correspondingimage data packets 90 of allocated display area of himself.The back will describebag receiving element 22 in detail.
Theimage data packets 90 thatmemory buffer 23 interim storages are received by bag receiving element 22.Packet analysis unit 24 extracts the picture material data (data each payload 92) that are divided into rectangular sheet from image data packets 90.Packet analysis unit 24 is according to the information in eachpacket header 91, and the processing of the picture material data that are divided into rectangular sheet is put in order.
Image reconstruction unit 25 is divided into the picture material data of rectangular sheet by combination, recovers a part of original image content.
Indicative control unit 26 carries out the drive controlling of display panel 28.Indicative control unit 26 will be divided into the picture material data of rectangular sheet and output to displaypanel 28 synchronously with for example drive signals such as horizontal-drive signal, vertical synchronizing signal and data transmission clock.Note, will be divided into picture material data storage (not shown) in storeies such as VRAM of rectangular sheet, regularly read this picture material data synchronously with drive signal, and it outputs to displaypanel 28.
Synchronous control unit 27 is controlledindicative control unit 26 based on the timestamp in thesynchrodata field 97 that is stored in eachimage data packets 90, thereby at the appointed time shows the corresponding a part of picture material of allocated display area with this view dataself.Display panel 28 shows the corresponding a part of picture material of allocated display area with this view data self.As mentioned above, asdisplay panel 28, for example, can use the display device of system arbitrarily such as LCD, plasma display and projection type display.
Below will describe the structure ofbag receiving element 22 in detail.As mentioned above,bag receiving element 22 is judgedimage data packets 90 whether corresponding to himself allocated display area, and only accepts (reception) and the correspondingimage data packets 90 of allocated display area based on this judged result.
The coordinate ID scope of allocated displayarea storage unit 31 storage rectangle sheets is to discern the allocated display area of himself.As mentioned above, can allocated display area be set by any means.
IDanalytic unit 30 extracts the id information inpacket header 91 from theimage data packets 90 that respectively enters.IDanalytic unit 30 confirm (verification) be stored in the bag identifyinginformation field 93 and be stored in id information in thecontent id field 94, extract the position coordinates ID that is stored in the sheet coordinateid field 95 then.
Allocated displayarea comparing unit 32 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that respectively enters is included in the coordinate ID scope that is stored in the allocated display area storage unit 31.If the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then 32 indications of allocated display area comparing unit are taken outcontrol modules 33 and are taken out these image data packets 90.On the other hand, if the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then allocated displayarea comparing unit 32 abandonsimage data packets 90 and does not accept.
Notice that the border of the allocated display area ofdisplay unit 71~79 usually is different from the border in rectangular sheet zone.In this case, two of boundaries on either side display units both all receive theimage data packets 90 of boundary member of their allocated display area.In this case, it is after 90s to receive image data packets at these two display units, and they only extract allocated display area, and abandon unnecessary portions.
Take outcontrol module 33 and receive (taking-up) specifiedimage data packets 90 of taking-up instruction, and they are stored in thememory buffer 23 from allocated displayarea comparing unit 32.
The simplified example of the control in thedisplay unit 71 below is described.For example, as shown in Figure 1,use 9display units 71~79 to constitute multidisplay system 61.So, shown in Fig. 2 B, suppose with high-definition picture (1920 * 1080 pixel) resolutiondisplay image content 50 on 3 * 3 display screens 51~59.
If the size in each rectangular sheet zone is 16 * 16 pixels, then picture material data (frame) are divided into 120 * 68 rectangular sheet zones.Eachdisplay unit 71~79 shows 40 * 23 rectangular sheet zones of distributing to each display unit.In this case, the allocated display area ofdisplay unit 71~79 is as follows.
The allocated display area ofdisplay unit 71 is defined as zone (0,0)~(39,22), and the allocated display area ofdisplay unit 72 is (40,0)~(79,22), and the allocated display area ofdisplay unit 75 is (40,23)~(79,45).Allocated displayarea storage unit 31 storage (40,23)~(79,45) ofdisplay unit 75 are as the coordinate ID scope of rectangular sheet.Therefore, the allocated displayarea comparing unit 32 ofdisplay unit 75 can compare this coordinate ID and the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that respectively enters.For example, if be stored in position coordinates ID in the sheet coordinateid field 95 for (45,30), then allocated displayarea comparing unit 32 is judged as theimage data packets 90 that enters corresponding to this allocated display area; If the position coordinates ID that is stored in the sheet coordinateid field 95 is (10,40), thenunit 32 is judged as the outside thatimage data packets 90 has dropped on this allocated display area.
By disposingdisplay unit 71~79 as mentioned above, display unit is only accepted (reception) and their the correspondingimage data packets 90 of allocated display area, and can recover and display image content.
Example below with reference to the operation of the flowcharttext display unit 71 of Fig. 7.
At step S11, display unitoverhead control unit 20 is waited for, imports theimage data packets 90 that is sent frommany display servers 63 up to receiving interface 21.If receivinginterface 21 inputimage data bags 90 are then handled and are entered step S12.Allocated displayarea comparing unit 32 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that is judged as input in step S11 is included in the coordinate ID scope that is stored in the allocated display area storage unit 31.In other words, allocated displayarea comparing unit 32 judge inputimage data packets 90 whether corresponding to himself allocated display area.
As judged result,, then handle and entering step S19 (back explanation) if the position coordinates ID that is stored in the sheet coordinateid field 95 ofimage data packets 90 is not included in the coordinate ID scope that is stored in the allocated display area storage unit 31.If the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then handles and entering step S13.
After processing entered step S13,32 indications of allocated display area comparing unit were taken outcontrol module 33 and are taken out image data packets 90.In response to this instruction, take outcontrol module 33 and take out theimage data packets 90 that in step S11, is judged as input.
Taking outcontrol module 33 then checks in step S14: the border that whether comprises the allocated display area of himself from the viewing area (rectangular sheet zone) that theimage data packets 90 that is judged as input among step S11 is obtained.As judged result,, then handle and enter step S20 (back explanation) if comprise the border of the allocated display area of himself from the viewing area (rectangular sheet zone) thatimage data packets 90 is obtained.On the other hand, if do not comprise any border of the allocated display area of himself from the viewing area (rectangular sheet zone) thatimage data packets 90 is obtained, then handle and enter step S15.
After processing entered step S15, taking outcontrol module 33 will be stored in thememory buffer 23 in theimage data packets 90 that step S13 takes out temporarily.
Then, display unitoverhead control unit 20 judges in step S16 whether take outcontrol module 33 has taken out allimages packet 90 of the allocated display area that belongs to himself.As judged result, does not take out allimages packet 90 of the allocated display area that belongs to himself yet if take outcontrol module 33, then handle turning back to step S11 and wait for, till importing nextimage data packets 90.
On the other hand, taken out allimages packet 90 of the allocated display area that belongs to himself, then handled entering step S17 if take out control module 33.After processing entered step S17,image reconstruction unit 25 was combined in the picture material data of rectangular sheet included in a plurality ofimage data packets 90 of being taken out among the step S13.
At step S18,indicative control unit 26 is presented at the picture material that is made up among the step S17 under the control of the Displaying timer ofsynchronous control unit 27.
If be judged as in step S12: the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then handles entering step S19.After processing entered step S19, allocated displayarea comparing unit 32 was discarded in theimage data packets 90 that is judged as input among the step S11 and does not accept (reception).
On the other hand, if in step S14, be judged as the border that comprises the allocated display area of himself from the viewing area thatimage data packets 90 is obtained, then handle and enter step S20.After processing enters step S20, take out the data incontrol module 33 the zones except that himself allocated display area of deletion from the viewing area that theimage data packets 90 of being taken out at step S13 is obtained.
As mentioned above, according to present embodiment,many display servers 63 are divided into a plurality of rectangular sheets zone with the original image content data, and generate the position coordinates ID of the position in the rectangular sheet zone after cutting apart in the presentation video content.Theimage data packets 90 that the image thatmany display servers 63 generate the rectangular sheet zone after will cutting apart is associated with their position coordinates ID, and they are sent to displayunit 71~79.Only when position coordinates ID included in theimage data packets 90 was included in the coordinate ID scope of allocated display area of each display unit ofexpression 71~79 self, eachdisplay unit 71~79 was accepted (reception) interested image data packets 90.Theimage data packets 90 of (reception) is accepted in eachdisplay unit 71~79 use, shows the corresponding image of allocated display area with picture material.
As mentioned above, according to present embodiment, eachdisplay unit 71~79 only receives theimage data packets 90 of the allocated display area that belongs to himself, and uses the bag display image that is received.Therefore, needn't carry out any particular topology processing corresponding etc. asmany display servers 63 of dispensing device with receiving displaydevice.Display unit 71~79 as receiving trap needn't be carried out any image cut processing etc.As a result, can realize large screen display by than legacy system hardware resource still less.Because dispensing device needn't distribute to the destination of picture material data, thereby can easily change the layout (quantity and layout etc.) ofdisplay unit 71~79.
In the described example of present embodiment, thecommunication path 64 that interconnectsdisplay unit 71~79 includes spider lines.Alternatively,communication path 64 can interconnectdisplay unit 71~79 with bus format.In addition,communication path 64 can adopt any transmission system.And as long as can guarantee the bandwidth that display image content is essential,communication path 64 can comprise wireless communications path.
In the described example of present embodiment,display unit 71~79 is carried out physical coupling.Yet, be not to carry out physical coupling to displayunit 71~79.Display unit 71~79 can be assemblied in the adjacent position, anddisplay unit 71~79 can send data via radio communication.
Second embodiment
Below describe the second embodiment of the present invention in detail.
In first embodiment, the situation ofdisplay image content 50 on bydisplay screen 51~59 formed whole screens ofdisplay unit 71~79 has been described.By contrast, present embodiment explanation is in thedisplay screen 51~59 ofdisplay unit 71~79 situation ofdisplay image content 50 on some wherein.More specifically, in the present embodiment, the layout ofmany display server 63 specify image contents.Eachdisplay unit 71~79 uses specified layout, calculates the allocated display area of himself, and judges whetherimage data packets 90 belongs to the allocated display area that is calculated.Like this, in the present embodiment, some step that is used for the software processes of display image content is different from first embodiment.Therefore, identical Reference numeral is represented identical assembly and the processing in Fig. 1~7 with first embodiment, and does not repeat detailed description thereof.
The demonstration example of multidisplay system (Fig. 8 A~8C)
Fig. 8 A~8C illustrates the demonstration example in the multidisplay system 61 (display unit 71~79).In the present embodiment, based on user's instruction, inmany display server 63 specified position layout and display image content.
Fig. 8 A illustrates the example of picture material.As Fig. 2 A, by house object and who object composingimages content 50.
Fig. 8 B illustrates the topology example of picture material 50.Fig. 8 B illustration such a case: will be near the lower right corner ofdisplay screen 100 withproperties window 101 layouts of scale downdisplay image content 50.
Fig. 8 C is illustrated in the demonstration example when usingdisplay unit 71~79 display image content 50.Display screen 51~59 is respectively the display screen ofdisplay unit 71~79.As among first embodiment, in Fig. 8 C,, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row) by thedisplay screen 51~59 that makes up 9display units 71~79.Fig. 8 C illustrates such example, in this example, in the mode according to the topology example shown in Fig. 8 B, by making updisplay image content 50 on the display screen that 9display units 71~79 are constituted.Eachdisplay unit 71~79 shows a part oforiginal image content 50 according to their allocated display area.In this case, the allocated display area ofdisplay unit 71~79 changes according tomany display server 63 specified layouts.For example, in Fig. 8 C, only the upper left ofproperties window 101 is allocated display area of display unit 71.Like this, by thedisplay screen 51~59 ofcombination display unit 71~79 shown in Fig. 8 C, and come layout anddisplay image content 50, thereby show wholeoriginal image content 50 according to this layout.
The internal placement of many display servers and operation (Fig. 9 A)
Fig. 9 A and 9B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Fig. 9 A.
With reference to figure 9A, 63 pairs of data that received fromcontent server 60 of many display servers are decoded, and decoded data are packed, and the bag that is generated is sent to displayunit 71~79.
Manyindicative control units 1 of controllingwhole multidisplay system 61 also compriselayout control module 110 except that the serveroverhead control unit 2 shown in Fig. 5 A.110 inputs of layout control module and storage are from the layout command information (layout directive command) of user's's (for example,client terminal 65 or content server 60) picture material.Layout control module 110 usestransmission interface 7 that the layout command information of picture material is sent to displayunit 71~79.The layout command information of picture material comprises for example position coordinates in the zone of placement of images content.In this case,layout control module 110 can will be presented at the top-left coordinates (Xmix of the scale down image of theproperties window 101 on thedisplay screen 100 shown in Fig. 8 B and the 8C, Ymix) and the bottom right coordinate (Xmax Ymax) is set to the layout command information of picture material.In addition,layout control module 110 can be presented at the top-left coordinates of theproperties window 101 on thedisplay screen 100 shown in Fig. 8 B and the 8C and the layout command information that the screen scale down is set to picture material.
When in rotation or distortion back laying outimages content 50,layout control module 110 will be realized such rotation or be out of shape essential parameter sending to displayunit 71~79, as the layout command information of picture material.Whenimage rotating content 50, for example,layout control module 110 can the anglec of rotation be set to the layout command information of picture material.Whendeformation pattern content 50, for example,layout control module 110 can be the layout command information ofpicture material 50 with the arranged in matrix of vertical and horizontal scale down or affined transformation (Affine transformation).
For the operation ofmany display servers 63, in process flow diagram shown in Figure 6,layout control module 110 is (for example, before the processing of step S1) before the processing of step S8, the layout command information of input and memory image content.Layout control module 110 (for example, before the step S1) before the processing of step S8 then sends to displayunit 71~79 with the layout command information of the picture material of being stored.The example of other operation ofmany display servers 63 is with shown in Figure 6 identical, and avoids the repeat specification to it.
In the following description, as required, the command information of the layout of picture material is called the layout command information.
The inner structure ofdisplay unit 71~79 and operation (Fig. 9 B)
The layout of eachdisplay unit 71~79 is described below with reference to Fig. 9 B.Notice thatdisplay unit 71~79 has same structure.Therefore, the structure ofdisplay unit 71 only is described, and does not provide the explanation of the structure of all theother display units 72~79.
With reference to figure 9B,display unit 71 calculates the allocated display area of himself based on the layout command information that is sent from many display servers 63.Whetherdisplay unit 71 judgements drop in the allocated display area that is calculated from the display-object zone of theimage data packets 90 thatmany display servers 63 aresent.Display unit 71 is only accepted theimage data packets 90 that (reception) belongs to the allocated display area of himself, and recovers and show a part ofpicture material 50.
The assembly of display unitoverhead control unit 20 controls formation display unit 71.In the present embodiment, display unitoverhead control unit 20 compriseslayout storage unit 111 and allocated displayarea computing unit 112.
Layout storage unit 111 is stored the layout command information that is sent from thelayout control module 110 of many display servers 63.Allocated displayarea computing unit 112 calculates the allocated display area of himself based on being stored in layout command information in thelayout storage unit 111, and result of calculation is stored in the allocated displayarea storage unit 31 to upgrade the allocated display area of himself.Like this, by proofread and correct the allocated display area that is stored among first embodiment in the allocated displayarea storage unit 31 according to the content of layout command information, obtain the allocated display area that is calculated by allocated display area computing unit 112.More specifically, allocated displayarea storage unit 31 storage belongs to the coordinate ID scope of rectangular sheet of the allocated display area of himself.
IDanalytic unit 30 extracts the id information inpacket header 91 from theimage data packets 90 that respectively enters.
Allocated displayarea comparing unit 32 judges whether the position coordinates ID in the sheet coordinateid field 95 that is stored in theimage data packets 90 that respectively enters is included in the coordinate ID scope that is stored in the allocated display area storage unit 31.If the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then 32 indications of allocated display area comparing unit are taken outcontrol modules 33 and are taken out these image data packets 90.On the other hand, if the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 31, then allocated displayarea comparing unit 32 abandons thisimage data packets 90 and does not accept.When the border of the allocated display area ofdisplay unit 71~79 was different from the border in rectangular sheet zone, as in first embodiment, both all only extracted allocated display area two display units of boundaries on either side, and abandon unnecessary portions.
Theimage data packets 90 thatmemory buffer 23 interim storages are received by bag receiving element 22.Packet analysis unit 24 extracts the picture material data (each payload 92) that are divided into rectangular sheet from image data packets 90.Packet analysis unit 24 is according to information in eachpacket header 91, and the processing of the picture material data that are divided into rectangular sheet is put in order.
Amplify/dwindleunit 113 according to the layout command information that is stored in thelayout storage unit 111, the picture material data of rectangular sheet are used processing and amplifying or dwindled processing.Image reconstruction unit 25 is recovered a part of original image content by the picture material data of combination rectangular sheet.Screen layout unit 114 generates video datas, thereby makes the image content layout that will be made up byimage reconstruction unit 25 according to the position that is stored in the layout command information in the layout storage unit 111.Indicative control unit 26 is presented at screen layout unit 114 video data that generates on thedisplay panel 28 under the control ofsynchronous control unit 27.
The simplified example of the control in thedisplay unit 71 below is described.For example, suppose as shown in Figure 1,use 9display units 71~79 to formmultidisplay system 61, and at 3 * 3 display screens, 51~59 display of high resolution images (1920 * 1080 pixel), shown in Fig. 8 C.
If the size in each rectangular sheet zone is 16 * 16 pixels, then picture material data (frame) are divided into 120 * 68 rectangular sheet zones.Eachdisplay unit 71~79 shows 40 * 23 rectangular sheet zones distributing to each display unit.In this case, the allocated display area ofdisplay unit 71~79 is as follows.
The allocated display area ofdisplay unit 71 is defined as zone (0,0)~(39,22), and the allocated display area ofdisplay unit 72 is defined as (40,0)~(79,22), and the allocated display area ofdisplay unit 75 is defined as (40,23)~(79,45).The allocated displayarea storage unit 31 ofdisplay unit 75 is stored as (40,23)~(79,45) the coordinate ID scope of rectangular sheet.Therefore, the allocated displayarea comparing unit 32 ofdisplay unit 75 can compare this coordinate ID and the position coordinates ID that is stored in the sheet coordinateid field 95 of theimage data packets 90 that respectively enters.For example, if be stored in position coordinates ID in the sheet coordinateid field 95 for (45,30), then allocated displayarea comparing unit 32 is judged as theimage data packets 90 that enters corresponding to this allocated display area; If be stored in position coordinates ID in the sheet coordinateid field 95 for (10,40), then allocated displayarea comparing unit 32 is judged as thisimage data packets 90 and drops on outside this allocated display area.
For the operation ofdisplay unit 71~79, in process flow diagram shown in Figure 7,layout storage unit 111 is stored the layout command information that is sent from thelayout control module 110 ofmany display servers 63 before step S14.And allocated displayarea computing unit 112 based on the layout command information that is stored in thelayout storage unit 111, calculates the coordinate ID scope of the allocated display area of representing himself before step S14.Allocated displayarea computing unit 112 upgrades the allocated display area of himself by this result of calculation is stored in the allocated display area storage unit 31.Allocated displayarea comparing unit 32 is judged in step S14: whether the position coordinates ID that is stored in the sheet coordinateid field 95 ofimage data packets 90 of the input that is judged as in step S11 is included in the coordinate ID scope that is calculated by allocated displayarea computing unit 112.
Between step S16 and S17, amplify/dwindleunit 113 according to the layout command information that is stored in thelayout storage unit 111, the picture material data of rectangular sheet are used amplification or dwindled processing.
Between step S17 and S18, the processing that is used to generate video data is carried out in screen layout unit 114, thereby makes the image content layout that will be made up byimage reconstruction unit 25 according to the position that is stored in the layout command information in thelayout storage unit 111.
At step S18,indicative control unit 26 shows the video data that is generated by screen layout unit 114 ondisplay panel 28 under the control ofsynchronous control unit 27.
Other operation ofdisplay unit 71~79 is identical with operation shown in Figure 7, and avoids the repeat specification to it.
By constitutingdisplay unit 71~79 as mentioned above, eachdisplay unit 71~79 can only be accepted theimage data packets 90 in (reception) its allocated display area according to specified layout, and can recover and display image content according to specified layout.
As mentioned above, in the present embodiment,many display servers 63 generate the layout command information of the layout of indicating image content, and the information that is generated is sent to displayunit 71~79.Eachdisplay unit 71~79 calculates the coordinate ID scope of the allocated display area of presentation video content based on the layout command information.Only whenimage data packets 90 included position coordinates ID were included in the coordinate ID scope that is calculated, eachdisplay unit 71~79 was accepted (reception) interested image data packets 90.Theimage data packets 90 of (reception) is accepted in eachdisplay unit 71~79 use, shows the corresponding image of allocated display area with picture material.
Therefore, except that the described effect of first embodiment, the layout in the time of can freely display image content being set.
In the described example of present embodiment, the picture material data that sent fromcontent server 60 are single image stream.Alternatively, a plurality of image stream can be sent, and a plurality of picture materials can be onsingle display screen 100, shown.In this case, the second~the n picture material (n is equal to or greater than 2 natural number) layout (can be able to be realized that picture-in-picture shows) in first picture material.Alternatively, can center on first image content layout the second~the n picture material (can realize showing side by side).
Present embodiment can also adopt the various modifications described in first embodiment.
The 3rd embodiment
Below describe the third embodiment of the present invention in detail.Second embodiment is the such situation of illustration: according to the layout command information (layout order) that is sent frommany display servers 63, the picture material afterdisplay unit 71~79 display layouts.By contrast, the situation that the present embodiment illustration is such: order is packed equally to layout, and will comprise that the bag of layout order sends to displayunit 71~79 frommany display servers 63.
Notice that the layout order bag that the layout command information is packed with the layout demanded storage of each coordinates regional (rectangular sheet zone) together.The packet header of layout order bag comprises the field of the scope in the zone of representing the application layout order.
Eachdisplay unit 71~79 judges whether the zone that will be applied to from the layout order bag thatmany display servers 63 are sent is included in the allocated display area of himself.Eachdisplay unit 71~79 is accepted the layout order bag that (reception) is applied to the allocated display area of himself, and based on the layout order packet layout picture material of being accepted.
As mentioned above, in the present embodiment, some step of the software processes that the laying out images content is required is different from first and second embodiment substantially.Therefore, same reference numerals is represented identical assembly and the processing in Fig. 1~9 with first and second embodiment, and will not repeat detailed description thereof.
Figure 10 A~10D illustrates the demonstration example in the multidisplay system 61 (display unit 71~79).In the present embodiment, in the assigned address layout and show a plurality of picture materials.
Figure 10 A and 10B illustrate the example of picture material.The same at Fig. 2 A and 8A, by thepicture material 50 shown in house object and the who object pie graph 10A, andpicture material 50 has file name " house_and_man.mpg ".On the other hand, by thepicture material 120 shown in automotive subjects, road object and the moon object pie graph 10B, andpicture material 120 has file name " car_at_night.mpg ".
Figure 10 C illustrates the topology example ofpicture material 50 and 120.The situation that Figure 10 C illustration is such: ondisplay screen 121, show respectivelyproperties window 122 and 123 with scale downdisplay image content 50 and 120.
Figure 10 D is illustrated in the demonstration example that usesdisplay unit 71~79display image content 50 and at 120o'clock.Display screen 51~59 is respectively the display screen ofdisplay unit 71~79.As among first and second embodiment, in Figure 10 D,, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row) by making up 9display units 71~79.
In this case, the allocated display area ofdisplay unit 71~79 is according to being changed bymany display server 63 specified layouts.For example, in Figure 10 D, only the upper left ofproperties window 122 is allocated display area ofdisplay unit 71.
The structure of many demonstration bags (Figure 11 A~11E)
Figure 11 A~11E illustrates the example of structure that show bag more.Structure below with reference to employed bag in Figure 11 A~transmission of 11E explanation in multidisplay system 61.Many demonstrations bag of present embodiment is made of two types bag, i.e. image data packets and layout order bag.Layout order bag is stored the layout order in each coordinates regional (rectangular sheet zone).The packet header of this bag comprises that expression is based on the layout order and through the field of the scope in the rectangular sheet zone of layout.
Figure 11 A illustrates thebags 130 that show more.Figure 11 B is used to explain the figure that show the structure ofbag 130 more.Shown in Figure 11 B, thebags 130 that show havepacket header 131 andpayload 132 more.The picture material data or the layout order ofpayload 132 storage rectangle sheets.
Figure 11 C illustrates the example of the header structure of image data packets.In this header structure, the content of bag identifying information field is different from theimage data packets 90 described in first and second embodiment.With reference to figure 11C, whether 133 storages of bag identifying information field are show to wrap required id information and version information etc. in order to discern interested bag more.And it is image data packets or the required id information of layout order bag that bag identifyinginformation field 133 is also stored in order to discern interested bag.Because Figure 11 C illustrates the header structure of image data packets, so bag identifyinginformation field 133 storages shown in Figure 11 C are used to discern the id information that interested bag is an image data packets.
Figure 11 D illustrates the example of the header structure of layout order bag.Bag identifyinginformation field 133 storages shown in Figure 11 D are used to discern the id information that interested bag is a layout order bag.
94 storages of content id field are used for the id information ofrecognition image content 50 or 120.Coordinaterange id field 134 storage is used to discern the required id information of scope of the target rectangle panel region of layout order.Other id field 135 storages are used to discern other required ID of scope in rectangular sheet zone.For example,other id field 135 is stored frame numbers etc.Picture material 50 that synchrodatafield 136 storage representations are discerned by the id information that is stored in thecontent id field 94 or 120 processing start time and handle the various timestamps of the temporal information of concluding time etc.The required various types of attribute informations of scope inproperty data fields 137 stores processor rectangular sheet zones.
Figure 11 E illustrates the example of structure of coordinate range id field 134.Shown in Figure 11 E, coordinaterange id field 134 is made of 4 fields: Xmin coordinateid field 138, Ymin coordinateid field 139, Xmax coordinateid field 140 and Ymax coordinateid field 141, they store the ID of respective rectangular panel region respectively.Like this, can specify a plurality of rectangular sheets zone.
The simplified example of layout order bag below will be described.For example, shown in Figure 10 D,use 9display units 71~79 to constitute multidisplay system 61.Then, shown in Figure 10 D, suppose resolution (1920 * 1080 pixel)display image content 50 and 120 on 3 * 3 display screens 51~59 with high-definition picture.And, suppose as the layout order, send the instruction of going uplayout properties window 122 and going uplayout properties window 123 in pixel (1000,500)~(1919,900) in order in pixel (50,100)~(1250,800).
Layout order package closes the order at each rectangular sheet zone, and layout order bag is divided into for example two bags.Cut apart the first layout order bag that obtains and be generated as the layout instruction that comprisesproperties window 122, and the second layout order bag is generated as the layout instruction that comprisesproperties window 123.
Determine coordinate range ID in such a way.If the size in each rectangular sheet zone is 16 * 16 pixels, then picture material data (frame) are divided into 120 * 68 rectangular sheet zones.Properties window 122 comprises the scope of rectangular sheet zone (3,6)~(78,50), andproperties window 123 comprises the scope of rectangular sheet zone (62,31)~(119,56).Therefore, as the id information value in the coordinaterange id field 134 that will be stored in the first layout order bag, 138 storages " 3 " of Xmin coordinate id field, 139 storages " 6 " of Ymin coordinate id field, 140 storages " 78 " of Xmax coordinate id field, and 141 storages " 50 " of Ymax coordinate id field.
As a result, can generate the parameter of layout order bag in such a way.
The first layout order bag:
Packet header:
Coordinate range ID:
Xmin coordinate ID:3
Ymin coordinate ID:6
Xmax coordinate ID:78
Ymax coordinate ID:50
Payload:
<video x =″50″ y=″100″width=″1200″height=″700″xlink:href=″house_and_man.mpg″/>
The second layout order bag:
Packet header:
Coordinate range ID:
Xmin coordinate ID:62
Ymin coordinate ID:31
Xmax coordinate ID:119
Ymax coordinate ID:56
Payload:
<video x =″1000″?y=″500″width=″920″height=″400″xlink:href=″car_at_night.mpg″/>
By constituting layout order bag as mentioned above, eachdisplay unit 71~79 is by reference coordinate scope ID only, just can judge that layout order bag is whether corresponding to himself allocated display area.That is to say that eachdisplay unit 71~79 only needs to receive the layout order bag of allocated display area, and carry out layout processing.
The inner structure of many display servers and operation (Figure 12 A)
Figure 12 A and 12B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Figure 12 A.
With reference to figure 12A,many display servers 63 are divided into layout instruction at each coordinates regional (rectangular sheet zone) with layout instruction, and they are packed and send.Inmany display servers 63 of present embodiment, to compare with themany display servers 63 of second embodiment shown in Fig. 9 A,layout control module 150 is different with the operation of bag generation unit 151.The layout oflayout control module 150 each coordinates regional of combination (rectangular sheet zone) is instructed, and they are outputed to bag generation unit 151.Coordinates regional (rectangular sheet zone) is configured to any size.
Bag generation unit 151 generates themany demonstrations bag 130 with the structure shown in Figure 11 A~11E.Bag generation unit 151 generates image data packets under the picture material data conditions, and generates layout order bag under the situation oflayout order.Demoder 5 andbag transmitting element 6 are configured to a plurality of picture materials of parallel processing.In this case,demoder 5 andbag transmitting element 6 can be handled each picture material the time-division (time-divisionally), perhaps can assemble a plurality ofdemoders 5 andbag transmitting element 6 to carry out parallel processing.
To show thatbag 130 sends to displayunit 71~79 o'clock frommany display servers 63,bag generation unit 151 at first generates themany demonstrations bag 130 that is associated with the layout order, and they are sent to displayunit 71~79 more.Thereafter, after finishing layout be provided with indisplay unit 71~79,bag generation unit 151 begins to send themany demonstrations bag 130 that is associated with the data of picture material.
For the operation ofmany display servers 63, before the processing of the step S8 of process flow diagram shown in Figure 6 (for example, before the processing of step S1), the processing below carrying out.The layout command information oflayout control module 150 Input Image Content, and make up them at each coordinates regional (rectangular sheet zone).151 pairs oflayout control modules 150 of bag generation unit are packed at the layout order that each coordinates regional (rectangular sheet zone) is made up, to generate themany demonstrations bag 130 that is associated with the layout order.Then,transmission interface 7many demonstrations bag 130 that will be associated with the layout order sends to displayunit 71~79.Then, the processing among the step S1 in theexecution graph 6~S8 sends to displayunit 71~79 withmany demonstrations bag 130 that will be associated with the data of picture material.
The internal placement of display unit and operation (Figure 12 B)
The structure of eachdisplay unit 71~79 is described below with reference to Figure 12 B.Notice thatdisplay unit 71~79 has identical set.Therefore, will the layout ofdisplay unit 71 only be described, and will can not provide the explanation of the layout of all theother display units 72~79.
With reference to figure 12B,display unit 71 input layouts are instructed as layout order bag, and based on the layout order bag of importing, carry out the layout processing of display screen.When input layout order bag,display unit 71 judges whether the target area of each layout order bag is dropped in the allocated display area of himself, and only accepts (reception) himself interior layout order bag of allocated display area.
In Figure 12 B, in thedisplay unit 71 of present embodiment, to compare with thedisplay unit 71 of second embodiment shown in Fig. 9 B, allocated displayarea comparing unit 152,packet analysis unit 153 are different with the operation ofscreen layout unit 154.
Allocated displayarea comparing unit 152 judges whether each layout order bag and image data packets belong to the allocated display area of himself.For layout order bag, allocated displayarea comparing unit 152 judges whether the application target zone of layout order bag is dropped in the allocated display area of the unit of distributing to himself.Described in first embodiment, that is to say allocated displayarea comparing unit 152 judges whether the value of the coordinaterange id field 134 in the layout order bag is included in the coordinate ID scope set in the allocated display area storage unit 31.For image data packets, allocated displayarea comparing unit 152 judges whether the position coordinates ID in the sheet coordinateid field 95 that is stored in image data packets is included in allocated displayarea computing unit 112 and calculates in the coordinate ID scope of (correction) based on layout order bag.
Packet analysis unit 153 extracts the data that showbag 130 from bufferingstorer 23 more.Packet analysis unit 153 is according to the information in thepacket header 131, and arrangement is to the processing of the data ofmany demonstrations bag 130 of being extracted.Ifmany demonstration bags 130 are layout order bags, thenpacket analysis unit 153 will show that the data ofbag 130 output tolayout storage unit 111 more.Layout storage unit 111 is based on layout order bag storage layout command information.
On the other hand, if show thatbag 130 is image data packets, thenpacket analysis unit 153 will show that the data ofbag 130 output to more and amplify/dwindleunit 113 more.
Screen layout unit 154 generatesproperties window 122 and 123 layouts according to the video data that is stored in the position of the layout command information in the layout storage unit 111.In this case, whenproperties window 122 and 123 when overlapped,screen layout unit 154 is according to the layout command information that is stored in thelayout storage unit 111, waits with transparent (transparency) and carries out overlapping or the overwrite processing.
Amplify/dwindleunit 113,image reconstruction unit 25, display unitoverhead control unit 20 and wrap the processing that receivingelement 22 is configured to a plurality ofproperties windows 122 of executed in parallel and 123.In this case, amplifying/dwindleunit 113,image reconstruction unit 25, display unitoverhead control unit 20 andbag receiving element 22 can time-divisioncontents processing window 122 and 123.And, can assemble a plurality of amplifications/dwindleunit 113,image reconstruction unit 25, display unitoverhead control unit 20 andbag receiving element 22 and carry out parallel processing.
Utilize above-mentioned layout, eachdisplay unit 71~79 only receives the interior layout order bag of allocated display area of himself, and can come layout and display frame based on the layout order bag that is received.
For the operation ofdisplay unit 71~79, before the step S14 of receivinginterface 21 in process flow diagram shown in Figure 7, receive layout order bag.Allocated displayarea comparing unit 152 judges whether the application target zone of the layout order bag of each input is included in the allocated display area of himself.Value and the coordinate ID scope that is stored in the allocated displayarea storage unit 31 based on the coordinaterange id field 134 in the layout order bag realize this judgment processing.
Take outcontrol module 33 and only accept the layout order bag that (reception) will be applied to the allocated display area of himself, and abandon other layout order bag.Thereafter,packet analysis unit 153 is analyzed the layout order bag of (reception) accepted, and based on analysis result with the layout demanded storage in layout storage unit 111.And allocated displayarea computing unit 112 calculates the allocated display area of himself based on the layout order that is stored in thelayout storage unit 111, and rewrites the coordinate ID that is stored in the rectangular sheet in the allocated displayarea storage unit 31.
Allocated displayarea comparing unit 152 is judged at step S14: be stored among the coordinate ID after whether position coordinates ID in the sheet coordinateid field 95 of the image data packets that is judged as input among the step S11 is included in the rewriting of rectangular sheet.
Between step S16 and S17, amplify/dwindleunit 113 according to the layout command information that is stored in thelayout storage unit 111, the picture material data of rectangular sheet are used processing and amplifying or dwindled processing.
And between step S17 and S18, the processing of the video data that is used for being created on the picture material that is made up byimage reconstruction unit 25 according to the position layout of the layout command information that is stored inlayout storage unit 111 is carried out inscreen layout unit 154.
At step S18,indicative control unit 26 will be presented on thedisplay panel 28 by the video data that screenlayout unit 154 is generated under the control ofsynchronous control unit 27.
Other operation ofdisplay unit 71~79 is with shown in Figure 7 identical, and will avoid the repeat specification to it.
In the present embodiment,many display servers 63 generate layout order bag by the layout command information (layout order) of the layout of indicating image content is packed, and they are sent to displayunit 71~79.Eachdisplay unit 71~79 comes the allocated display area of computed image content based on layout order bag.Only when position coordinates ID included in this image data packets be included in calculate the allocated display area of picture material in the time, eachdisplay unit 71~79 is accepted (reception) given image data packets.Eachdisplay unit 71~79 uses the image data packets demonstration of (reception) of accepting and the corresponding image of allocated display area of picture material.
As mentioned above, owing to use the packet communication of same communication scheme to send picture material data and layout order, thereby can handle picture material data and layout order by identical bag disposal system.Therefore, except that the effect described in second embodiment, can simplify interface.
In the present embodiment, separately generate layout order bag at each content.Yet, can be under indiscrete situation to layout order pack.Under these circumstances, eachdisplay unit 71~79 can be accepted (reception) all layout order bags, and can only extract and handle and the corresponding order of the allocated display area of himself.
In addition, each image data packets can comprise the layout order.For example, can inother id field 96 in image data packets the layout order be described.Like this, when with many demonstrations packet delay that the layout order is associated, can prevent taking defeat of image data packets.
Present embodiment can also adopt the various modifications described in first and second embodiment.
The 4th embodiment
Below will describe the fourth embodiment of the present invention in detail.
Themultidisplay system 61 of present embodiment has the identical layout with multidisplay system shown in Figure 1.In the present embodiment, the picture material data are divided into a plurality of integrated datas, these integrated datas are offered display unit from many display servers.Whether each display unit judgement belongs to the allocated display area of himself from each integrated data that many display servers provided.Each display unit is accepted the integrated data (image data packets and Flame Image Process instruction bag) of the allocated display area of himself based on this judged result, and recovers on screen and show through the image based on the Flame Image Process of the integrated data of being accepted.Present embodiment will illustrate such multidisplay system.In the explanation of present embodiment, with the identical Reference numeral in Fig. 1~12 represent with first~the 3rd embodiment in identical assembly and processing, and will not repeat detailed description thereof.
Inmultidisplay system 61,display server 63offers display unit 71~79 with picture material data and Flame Image Process directordata.Communication path 64 is used to picture material data and Flame Image Process director data are offereddisplay unit 71~79.
The demonstration example of multidisplay system (Figure 13 A and 13B)
Figure 13 A and 13B illustrate the demonstration example in the multidisplay system 61 (display unit 71~79).
Figure 13 A illustrates the example of picture material.With reference to figure 13A, by weather chart object and the text data object composingimages content 1050 that is used for weather chart.
Figure 13 B illustrates the demonstration example when usingdisplay unit 71~79 to come display image content 1050.Display screen 51~59 is respectively the display screen ofdisplay unit 71~79.In Figure 13 B,, constitute the single display screen of 3 * 3 (3 row * 3 row) matrix by making up 9display units 71~79.
Like this, Figure 13 B illustrates such example: by making updisplay image content 1050 on the display screen that 9display units 71~79 are constituted.Eachdisplay unit 71~79 shows a part oforiginal image content 1050 according to the allocated display area of himself.For example,display unit 73 is part to the east of the center, Hokkaido that shows weather chart on thedisplay screen 53, and the right side half image ofdisplay unit 79 videotex data on display screen 59.By thedisplay screen 51~59 ofcombination display unit 71~79, shown in Figure 13 B, on a screen, show wholeoriginal image content 1050.
The structure of image data packets (Figure 14 A~15C)
The structure of employed image data packets in the transmission inmultidisplay system 61 below will be described.In the present embodiment, the picture material data are divided into little rectangular sheet zone.To cut apart each picture material data storage of obtaining in image data packets.And, the additional ID that the position of each rectangular sheet of expression is arranged of image data packets.
Figure 14 A and 14B illustrate the example that is used for the picture material data are divided into the method in little rectangular sheet zone.
Figure 14 A illustrates the example of the state of the picture material data that are divided into little rectangular sheet zone.
Suppose m (m is a natural number) * individual grid of n (n is a natural number) is set onpicture material 1050 in the horizontal and vertical directions.In addition, each grid comprises for example 16 * 16 pixels.By boundarysegmentation picture material 1050, generate m * n rectangular sheet zone along these grids.The position coordinates ID of the position by representing interested grid discerns each independent rectangular sheet zone.
Figure 14 B illustrates the example of a part of picture material that is sheared into the rectangular sheet shape.The image 1080 of rectangular sheet shape is the image in the zone of shearing by the grid that the coordinate that is positioned at picture material 1050 (n-1,3) is located.This regional position coordinates ID is (n-1,3).
Figure 15 A~15C illustrates the example of structure of image data packets and Flame Image Process instruction bag.In Figure 15 A~15C, below the situation that illustration is such: image data packets and Flame Image Process instruction bag storage same data item.
Figure 15 A illustratesimage data packets 1090a or Flame Image Process instruction bag 1090b.Figure 15 B illustrates the structure ofimage data packets 1090a or Flame Image Process instruction bag 1090b.Shown in Figure 15 B,image data packets 1090a or Flame ImageProcess instruction bag 1090b havepacket header 1091 and payload 1092.Under the situation ofimage data packets 1090a,payload 1092 storages are sheared into the picture material data of rectangular sheet shape.On the other hand, under the situation of Flame ImageProcess instruction bag 1090b, the Flame Image Process designated command inpayload 1092 each rectangular sheet zone of storage.The Flame Image Process designated command can be that indication is used the Flame Image Process designated command of edge sharpening or the saturation degree enhancement process is used in Flame Image Process designated command from indication to graphic image data to text data.
Figure 15 C illustrates the structure in packet header 1091.The type of bag identifyinginformation field 1093 expression bags.Whether 1093 storages of bag identifying information field are required id information of image data packets, Flame Image Process instruction bag or other bag and version information etc. in order to discern self bag.And bag identifyinginformation field 1093 can also storage package length and inspection and is waited the required information of bag processing.
1094 storages of content id field are in order to the required id information of recognition image content.For example,content id field 1094 is at the content stores " 1 " of weather chart, and at the text data store " 2 " of weather chart.
1095 storages of sheet coordinate id field are in order to desired position, the position coordinate ID in identification rectangular sheet zone.Other id field 1096 storages are in order to identification rectangular sheet other required ID of zone.For example,other id field 1096 is stored frame numbers etc.Processing start time of the picture material that synchrodatafield 1097 storage representations are discerned by the id information that is stored in thecontent id field 1094 and handle the various timestamps of concluding time equal time information.Property data fields 1098 storages are in order to handle the required various types of attribute informations of picture material data of rectangular sheet.
As described below, eachdisplay unit 71~79 reference plate coordinateid field 1095 judges that eachimage data packets 1090a or Flame ImageProcess instruction bag 1090b is whether corresponding to himself allocated display area.
The internal placement of many display servers and operation (Figure 16 A and 17)
Figure 16 A and 16B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Figure 16 A.
With reference to figure 16A, 63 pairs of view data that received fromcontent server 60 of many display servers are decoded, and decoded data are packed with generationimage data packets 1090a, and these bags are sent to displayunit 71~79.In addition, 63 pairs of Flame Image Process director datas of many display servers are packed and are wrapped 1090b to generate the Flame Image Process instruction, and send it to displayunit 71~79.
Thewhole multidisplay system 61 of manyindicative control unit 1001 controls.Manyindicative control units 1001 comprise storeies such as CPU, ROM and RAM, bus and various interface etc.When using executions such as RAM to be stored in program among the ROM as CPU, manyindicative control units 1001 are controlled total systems.Each element of themany display servers 63 of serveroverhead control unit 1002 controls formation.
LAN interface (LAN I/F) 1003 is by the picture material data ofcommunication line 62 inputs from content server 60.Memory buffer 1004 interim storages are from the picture material data ofLAN interface 1003 inputs.As mentioned above, the picture material data that sent fromcontent server 60 are encoded.Therefore, 1005 pairs of demoders the image encoded content-data decode to recover original image content.
Demoder 1005 is read the picture material data from bufferingstorer 1004, and it is decoded, and will begin successively data to be outputed to follow-up phase from decoded portion.The timestamp information that demoder 1005 will add to picture material data (included in the stream) offers synchronous control unit 1012.Flame Image Processinstruction generation unit 1116 generates the Flame Image Process designated command according to the content of the stream of just being decoded by demoder 1005.Flame Image Processinstruction generation unit 1116 generates indication the saturation degree enhancement process is applied to the Flame Image Process designated command of the content of weather chart, and generates the Flame Image Process designated command of content that indication is applied to edge sharpening the text data of weather chart.
Bag 1006 pairs of picture material data of transmitting element or Flame Image Process designated command are cut apart and are packed, and wrap 1090b to generate the instruction ofimage data packets 1090a or Flame Image Process, and these bags are outputed to transmission interface (sending I/F) 1007.The back will illustrate the details ofbag transmitting element 1006.
Transmission interface (sending I/F) 1007 sends to displayunit 71~79 withimage data packets 1090a or Flame Image Process instruction bag1090b.To display unit 71~79broadcast image packet 1090a that are connected tomany display servers 63 or Flame Image Process instruction bag1090b.Transmission interface 1007 independently will send to displayunit 71~79 by the various control datas that manyindicative control units 1001 are generated.
Inbag transmitting element 1006,data partitioning unit 1010 split image content-datas and Flame Image Process designated command data make that cut apart each data that obtains has eachdisplay unit 71~79 manageable size (data volume) as the destination of picture material data.Notice thatmany display servers 63 can obtain eachdisplay unit 71~79 manageable size (data volume) by for example communicating withdisplay unit 71~79.In addition,many display servers 63 can obtain eachdisplay unit 71~79 manageable size (data volume) from forexample content server 60 orclient terminal 65 etc.
In the present embodiment,data partitioning unit 1010 is divided into a plurality of rectangular sheets zone with picture material data and Flame Image Process designated command data, makes that cutting apart each data that obtains has the tentation data size.By picture material data and Flame Image Process designated command data are divided into a plurality of rectangular sheets zone, can reduce that the back is described, the size of RAM in eachdisplay unit 71~79, that Flame Image Process is required.More specifically, shown in for example Figure 14 A,data partitioning unit 1010 is divided into rectangular sheet with the picture material data.When split image processing instruction order data, generate the data of the command content that comprises the Flame Image Process that is used for the included content-data in each rectangular sheet zone at each rectangular sheet zone.For example, the image 1080 of rectangular sheet is the part of weather chart.Therefore, the Flame Image Process designated command thatdata partitioning unit 1010 will be used for the content of weather chart outputs tobag generation unit 1011, as the Flame Image Process designated command data of the image 1080 that is used for this rectangular sheet.
Synchronous control unit 1012 generates inner synchro control data based on additional timestamp to the original image content data.These synchro control data are included in the temporal information of the transmitting time ofdisplay unit 71~79, the processing start time ofdisplay unit 71~79 and the demonstration time ofdisplay unit 71~79 etc.The synchro control data storage thatsynchronous control unit 1012 generated is the timestamp in thesynchrodata field 1097 shown in Figure 15 C.Notice that the synchro control data are not limited to above-mentioned data, but the information that can use other any kind is as the synchro control data, so long as it is can specify processing in thedisplay unit 71~79 to begin regularly and the temporal information of Displaying timer etc.
Bag generation unit 1011 generatesimage data packets 1090a or the Flame ImageProcess instruction bag 1090b with the structure shown in Figure 15 A~15C.Bag generation unit 1011 is by generating bag withpacket header 1091 additional picture material data or Flame Image Process designated command data to each rectangular sheet.The position coordinates ID ofpacket header 1091 storage rectangle panel region and timestamp (synchronizing information) etc.
Utilize the above-mentioned layout ofmany display servers 63, the original image content data are packedwrap 1090b to generate theimage data packets 1090a and the Flame Image Process instruction that can send to displayunit 71~79.
Notice thatdemoder 1005 andbag transmitting element 1006 are configured to a plurality of picture materials of parallel processing.In this case, demoder 1005 andbag transmitting element 1006 can the time divisional processing each picture material, perhaps can assemble a plurality ofdemoders 1005 andbag transmitting element 1006 to carry out parallel processing.
Example below with reference to the operation of themany display servers 63 of flowchart text of Figure 17.
At step S1001, serveroverhead control unit 1002 is waited for, till the picture material data thatLAN interface 1003 inputs are sent from content server 60.IfLAN interface 1003 Input Image Content data are then handled and are entered step S1002.After processing entered step S1002, the picture material data that serveroverhead control unit 1002 will input toLAN interface 1003 were stored in thememory buffer 1004 temporarily.
At step S1003,1005 pairs of demoders image encoded content-data are decoded, to recover original image content.
Flame Image Processinstruction generation unit 1116 according to the content of the stream of just being decoded bydemoder 1005, judges whether to generate the Flame Image Process designated command in step S1004.As judged result,, then handle and enter following step S1012 if do not generate the Flame Image Process designated command.On the other hand, if will generate the Flame Image Process designated command, then handle and enter step S1005.
After processing entered step S1005, Flame Image Processinstruction generation unit 1116 generated the Flame Image Process designated command according to the content of the stream of being decoded bydemoder 1005 among the step S1003.
At step S1006,data partitioning unit 1010 is divided into the rectangular sheet zone with Flame Image Process designated command data.That is to say thatdata partitioning unit 1010 generates the Flame Image Process designated command at each rectangular sheet zone.
At step S1007,synchronous control unit 1012 stabs at cut apart the image processing command data rise time that obtains in step S1006 based on additional timestamp information to the original image content data.
At step S1008,bag generation unit 1011 is created on the position coordinates ID of cutting apart the Flame Image Process designated command data (that is the divided area of Flame Image Process designated command) that obtain among the step S1006.
At step S1009, additional giving such as the header thatbag generation unit 1011 will be generated in step S1007 and S1008 etc. cut apart the Flame Image Process designated command data that obtain in step S1006, to generate Flame Image Process instruction bag 1090b.As mentioned above, will in step S1006, cut apart the Flame Image Process designated command data storage that obtains in payload 1092.The timestamp that will be generated in step S1007 is stored in the synchrodata field 1097.The positional information ID that will be generated in step S1008 is stored in the sheet coordinateid field 1095.
At step S1010, serveroverhead control unit 1002indication transmission interfaces 1007 are sent in the Flame ImageProcess instruction bag 1090b that is generated among the step S1009.Like this, Flame ImageProcess instruction bag 1090b is sent to displayunit 71~79.
Bag generation unit 1011 judges in step S1011 whether the Flame Image Process bag of the entire image content of being imported generates in step S1001.As judged result,, then handle and turn back to step S1004 if do not generate the Flame ImageProcess instruction bag 1090b of entire image content yet.On the other hand, if generated the Flame ImageProcess instruction bag 1090b of entire image content, then finish this processing.
Do not generate the Flame Image Process designated command if in step S1004, be judged as, then handle entering step S1012.After processing entered step S1012,data partitioning unit 1010 was divided into a plurality of rectangular sheets with the picture material data.
At step S1013,synchronous control unit 1012 stabs at cut apart each picture material data rise time that obtains in step S1012 based on additional timestamp information to the original image content data.
At step S1014,bag generation unit 1011 is created on the position coordinates ID of cutting apart each picture material data (that is the divided area of picture material) that obtain among the step S1012.
At step S1015, additional the giving of the header thatbag generation unit 1011 will be generated in step S1013 and S1014 cut apart each picture material data that obtain in step S1012, to generate image data packets 1090a.As mentioned above, will in step S1012, cut apart each picture material data storage of obtaining in payload 1092.The timestamp that will be generated in step S1013 is stored in the synchrodata field 1097.The positional information ID that will be generated in step S1014 is stored in the sheet coordinateid field 1095.
At step S1016, theimage data packets 1090a that serveroverhead control unit 1002indication transmission interfaces 1007 are sent among the step S1015 to be generated etc.Like this,image data packets 1090a is sent to displayunit 71~79.Then, processing enters step S1011.Note, also will send to displayunit 71~79 fromtransmission interface 1007 by the control data that serveroverhead control unit 1002 is generated.
The internal placement ofdisplay unit 71~79 and operation (Figure 16 B, 18A and 18B)
The layout of eachdisplay unit 71~79 is described below with reference to Figure 16 B.Notice thatdisplay unit 71~79 has identical layout.Therefore, will the layout ofdisplay unit 71 only be described, and can not provide explanation for the layout of all theother display units 72~79.
With reference to figure 16B,display unit 71 judges that theimage data packets 1090a that sent fromdisplay server 63 is whether corresponding to himself allocated displayarea.Display unit 71 is based on this judged result, and Flame Image Process only is applied to theimage data packets 1090a of the allocated display area of himself, and recovers and show a part of picture material.
The assembly of display unitoverhead control unit 1020 controls formation display unit 71.Display unitoverhead control unit 1020 comprises for example storer such as CPU, ROM and RAM and various interface etc.When CPU uses RAM to wait the program of executive logging on ROM, thewhole display unit 71 of display unitoverhead control unit 1020 controls.
The data that receiving interface (receiving I/F) 1021 inputs send from many display servers 63.More specifically, receivinginterface 1021 inputimage data bag 1090a and Flame Image Process instruction bag 1090b.Receiving interface (receive I/F) 1021 is inputimage data bag 1090a and Flame ImageProcess instruction bag 1090b not only, but also imports control data that manyindicative control units 1001 generate etc.
Bag receiving element 1022 judges thatimage data packets 1090a is whether corresponding to himself allocated display area.Ifimage data packets 1090a, then wraps receivingelement 1022 corresponding to the allocated display area of himself thisimage data packets 1090a is write in the image buffer memory 1023.Bag receiving element 1022 judges that Flame Image Process instruction wraps 1090b whether corresponding to himself allocated display area.If Flame ImageProcess instruction bag 1090b, then wraps receivingelement 1022 corresponding to the allocated display area of himself this Flame ImageProcess instruction bag 1090b is write in the Flame Image Process instruction buffer storer 1117.The back will illustrate the details ofbag receiving element 1022.
Theimage data packets 1090a thatimage buffer memory 1023 interim storagepackage receiving elements 1022 are received.The Flame ImageProcess instruction bag 1090b that Flame Image Processinstruction buffer storer 1117 interim storagepackage receiving elements 1022 are received.Packet analysis unit 1024 extracts the picture material data (data each payload 1092) that are divided into rectangular sheet from image data packets 1090a.Packet analysis unit 1024 is according to the information in eachpacket header 1091, and arrangement is divided into the processing of the picture material data of rectangular sheet.
Graphics processing unit 1115 receive from Flame Image Processinstruction buffer storer 1117, with the corresponding Flame Image Process designated command of picture material data that is divided into rectangular sheet.Graphics processing unit 1115 will be applied to be divided into the picture material data of rectangular sheet according to the Flame Image Process of Flame Image Process designated command.When entire frame being divided into rectangle and coming application image to handle, compare with the situation of under the situation of not cutting apart entire frame, carrying out Flame Image Process, can reduce Flame Image Process required and be used for size with reference to the storer of neighbor.
The picture material data thatimage reconstruction unit 1025 has been passed through the rectangular sheet of Flame Image Process by combination are recovered a part of original image content.
Indicative control unit 1026 carries out the drive controlling of display panel 1028.Indicative control unit 1026 with for example synchronous mode of drive signal of horizontal-drive signal, vertical synchronizing signal and data transmission clock etc., the picture material data that will be divided into rectangular sheet output to display panel 1028.Notice that the picture material data that are divided into rectangular sheet are stored in the storer (not shown) such as VRAM, being read out, and be output to displaypanel 1028 with the regularly synchronous mode of drive signal.
Synchronous control unit 1027 is based on the timestamp in thesynchrodata field 1097 that is stored in eachimage data packets 1090a, controlindicative control unit 1026, thus at the appointed time show and himself the corresponding part of allocated displayarea.Display panel 1028 shows the corresponding a part of picture material of allocated display area withhimself.As display panel 1028, as mentioned above, for example, can use the display device of system arbitrarily such as LCD, plasma display and projection type demonstration.
Below will describe the layout ofbag receiving element 1022 in detail.As mentioned above,bag receiving element 1022 judges that the instruction ofimage data packets 1090a or Flame Image Process wraps 1090b whether corresponding to himself allocated display area.Bag receiving element 1022 is only accepted (reception) and the corresponding bag of allocated display area, andimage data packets 1090a is stored in theimage buffer memory 1023, and 1090b is stored in the Flame Image Processinstruction buffer storer 1117 with Flame Image Process instruction bag.
The coordinate ID scope of allocated displayarea storage unit 1031 storage rectangle sheets, thus himself allocated display area discerned.As mentioned above, can allocated display area be set by any means.
IDanalytic unit 1030 extracts the id information inpacket header 1091 from eachimage data packets 1090a or the Flame ImageProcess instruction bag 1090b that enters.IDanalytic unit 1030 confirm (verification) be stored in the bag identifyinginformation field 1093 and be stored in id information in thecontent id field 1094, extract the position coordinates ID that is stored in the sheet coordinateid field 1095 then.
Allocated displayarea comparing unit 1032 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 1095 of each theimage data packets 1090a that enters or Flame ImageProcess instruction bag 1090b is included in the coordinate ID scope that is stored in the allocated display area storage unit 1031.If the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that enters is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, the processing below then allocated displayarea comparing unit 1032 is carried out.That is to say that 1032 indications of allocated display area comparing unit are taken outcontrol module 1033 thisimage data packets 1090a is write image buffer memory 1023.On the other hand, if the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then allocated displayarea comparing unit 1032 abandons thisimage data packets 1090a and does not accept it.
If the position coordinates ID that is stored in the sheet coordinateid field 1095 of the Flame ImageProcess instruction bag 1090b that enters is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031 processing below then allocated displayarea comparing unit 1032 is carried out.That is to say that 1032 indications of allocated display area comparing unit are taken outcontrol module 1033 this Flame ImageProcess instruction bag 1090b is write in the Flame Image Process instruction buffer storer 1117.On the other hand, if the position coordinates ID that is stored in the sheet coordinateid field 1095 of the Flame ImageProcess instruction bag 1090b that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then allocated displayarea comparing unit 1032 abandons this Flame ImageProcess instruction bag 1090b and does not accept it.
Notice that the border of the allocated display area ofdisplay unit 71~79 is different from the border in rectangular sheet zone usually.In this case, two of boundaries on either side display units both all receive theimage data packets 1090a or the Flame ImageProcess instruction bag 1090b of boundary member of their allocated display area.In this case, after these two display units receivedimage data packets 1090a or Flame ImageProcess instruction bag 1090b, they only extracted allocated display area, and abandon unnecessary portions.
Take outcontrol module 1033 and receive (taking-up), and they are stored in theimage buffer memory 1023 by the specifiedimage data packets 1090a of taking-up instruction from allocated display area comparing unit 1032.In addition, take outcontrol module 1033 receptions (taking-up) and wrap 1090b, and they are stored in the Flame Image Processinstruction buffer storer 1117 by instructing from the specified Flame Image Process of the taking-up instruction of allocated displayarea comparing unit 1032.
The simplified example of the control in thedisplay unit 71 below will be described.For example, as shown in Figure 1,use 9display units 71~79 to constitute multidisplay system 61.Then, shown in Figure 13 B, suppose resolution (1920 * 1080 pixel)display image content 1050 on 3 * 3 display screens 51~59 with high-definition picture.
If the size in each rectangular sheet zone is 16 * 16 pixels, then picture material data (frame) are divided into 120 * 68 rectangular sheet zones.Eachdisplay unit 71~79 shows 40 * 23 rectangular sheet zones distributing to each display unit.In this case, the allocated display area ofdisplay unit 71~79 is as follows.
The allocated display area ofdisplay unit 71 is defined as zone (0,0)~(39,22), and the allocated display area ofdisplay unit 72 is defined as (40,0)~(79,22), and the allocated display area ofdisplay unit 75 is defined as (40,23)~(79,45).The allocated displayarea storage unit 1032 ofdisplay unit 75 is stored as (40,23)~(79,45) the coordinate ID scope of rectangular sheet.Therefore, the allocated displayarea comparing unit 1032 ofdisplay unit 75 can compare this coordinate ID and position coordinates ID in the sheet coordinateid field 1095 of eachimage data packets 1090a that is stored in input.For example, if be stored in position coordinates ID in the sheet coordinateid field 1095 for (45,30), then allocated displayarea comparing unit 1032 is judged as theimage data packets 1090a that enters corresponding to allocated display area; If be (10,40), thenunit 1032 is judged asimage data packets 1090a and drops on outside the allocated display area.
By disposingdisplay unit 71~79 as mentioned above, display unit is only accepted (reception) and their the corresponding bag of allocated display area (image data packets 1090a and Flame ImageProcess instruction bag 1090b), and can recover and display image content.
Example below with reference to the operation of the flowcharttext display unit 71 of Figure 18 A and 18B.
Display unitoverhead control unit 1020 judges in step S1021 whether receivinginterface 1021 imports the Flame ImageProcess instruction bag 1090b that is sent from many display servers 63.As judged result,, then handle the step S1031 that enters among Figure 18 B that illustrates later if receivinginterface 1021 is not imported any Flame ImageProcess instruction bag 1090b.
On the other hand, if receivinginterface 1021 input pictureprocessing instruction bag 1090b then handle and enter step S1022.Allocated displayarea comparing unit 1032 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 1095 of the Flame ImageProcess instruction bag 1090b that is judged as input among the step S1021 is included in the coordinate ID scope that is stored in the allocated display area storage unit 1031.In other words, allocated displayarea comparing unit 1032 judge input Flame ImageProcess instruction bag 1090b whether corresponding to himself allocated display area.
As judged result, if the position coordinates ID that is stored in the sheet coordinateid field 1095 of Flame ImageProcess instruction bag 1090b is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handle entering step S1039 (back explanation).If the position coordinates ID that is stored in the sheet coordinateid field 1095 of Flame ImageProcess instruction bag 1090b is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handle entering step S1023.
After processing entered step S1023,1032 indications of allocated display area comparing unit were taken outcontrol module 1033 and are taken out this Flame Image Process instruction bag 1090b.In response to this instruction, take outcontrol module 1033 and take out the Flame ImageProcess instruction bag 1090b that in step S1021, is judged as input.Taking outcontrol module 1033 then judges in step S1024: the Flame ImageProcess instruction bag 1090b indication that in step S1021, is judged as input to the viewing area (rectangular sheet zone) of its carries out image processing whether corresponding to a plurality of viewing areas of the allocated display area that comprises himself.That is to say, take outcontrol module 1033 and judge: whether the Flame ImageProcess instruction bag 1090b indication that is judged as input in step S1021 comprises the border of the allocated display area of himself to the viewing area (rectangular sheet zone) of its carries out image processing.
As judged result, if the Flame ImageProcess instruction bag 1090b indication that is judged as input in step S1021 is then handled and is entered step S1040 (back explanation) a plurality of viewing areas corresponding to the allocated display area that comprises himself, the viewing area of its carries out image processing.On the other hand, if the Flame ImageProcess instruction bag 1090b indication that is judged as input in step S1021 does not correspond to a plurality of viewing areas of the allocated display area that comprises himself to the viewing area of its carries out image processing, but, then handle and enter step S1025 only corresponding to the allocated display area of himself.
After processing entered step S1025, the Flame ImageProcess instruction bag 1090b that taking-upcontrol module 1033 will take out in step S1023 was stored in the Flame Image Processinstruction buffer storer 1117 temporarily.
Then, display unitoverhead control unit 1020 judges in step S1026 whether take outcontrol module 1033 has taken out all images processinginstruction bag 1090b of the allocated display area that belongs to himself.As judged result, if take out all images processinginstruction bag 1090b that controlmodule 1033 does not also take out the allocated display area that belongs to himself, then handle and turn back to step S1021, whether import to judge next Flame ImageProcess instruction bag 1090b.
On the other hand, taken out all images processinginstruction bag 1090b of the allocated display area that belongs to himself, then handled entering step S1027 if take out control module 1033.After processing entered step S1027, display unitoverhead control unit 1020 judged whether take outcontrol module 1033 has taken out allimages packet 1090a of the allocated display area that belongs to himself.As judged result,, then handle and enter the step S1031 that illustrates later if take out allimages packet 1090a thatcontrol module 1033 does not also take out the allocated display area that belongs to himself.
On the other hand, taken out allimages packet 1090a of the allocated display area that belongs to himself if take outcontrol module 1033, owing to taken out allimages packet 1090a and the Flame ImageProcess instruction bag 1090b of the allocated display area that belongs to himself, thereby processing enters step S1028.
After processing entered step S1028, the picture material data of included rectangular sheet were carried out the Flame Image Process according to Flame Image Process designated command included among the Flame ImageProcess instruction bag 1090b among 1115 couples ofimage data packets 1090a of graphics processing unit.
At step S1029, the picture material data that the rectangular sheet of the Flame Image Process among the step S1028 has been passed through inimage reconstruction unit 1025 combinations.
At step S1030,indicative control unit 1026 is presented at the picture material after the combination among the step S1029 ondisplay panel 1028 under the control of the Displaying timer ofsynchronous control unit 1027.
Do not import any Flame ImageProcess instruction bag 1090b if be judged as receivinginterface 1021 among the step S1021 in Figure 18 A, then handle the step S1031 that enters among Figure 18 B.After processing entered step S1031, display unitoverhead control unit 1020 judged whether receivinginterface 1021 imports theimage data packets 1090a that is sent from many display servers 63.As judged result,, then handle the step S1021 that turns back among above-mentioned Figure 18 A if receivinginterface 1021 is not imported anyimage data packets 1090a that is sent frommany display servers 63.
On the other hand, if receivinginterface 1021 inputs are then handled and are entered step S1032 from theimage data packets 1090a of many display servers 63.Allocated displayarea comparing unit 1032 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that is judged as input among the step S1031 is included in the coordinate ID scope that is stored in the allocated display area storage unit 1031.In other words, allocated displayarea comparing unit 1032 judge inputimage data packets 1090a whether corresponding to himself allocated display area.
As judged result, if the position coordinates ID that is stored in the sheet coordinateid field 1095 ofimage data packets 1090a is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handles and entering step S1037 (back explanation).On the other hand, if the position coordinates ID that is stored in the sheet coordinateid field 1095 ofimage data packets 1090a is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handles and entering step S1033.
After processing entered step S1033,1032 indications of allocated display area comparing unit were taken outcontrol module 1033 and are taken out this image data packets 1090a.In response to this instruction, take outcontrol module 1033 and take out theimage data packets 1090a that in step S1031, is judged as input.
Then, taking outcontrol module 1033 judges in step S1034: the border that whether comprises the allocated display area of himself from the viewing area thatimage data packets 1090a obtained (rectangular sheet zone) that is judged as input among step S1031.As judged result,, then handle and enter step S1038 (back explanation) if comprise the border of the allocated display area of himself from the viewing area (rectangular sheet zone) that thisimage data packets 1090a is obtained.On the other hand, if do not comprise arbitrary border of the allocated display area of himself from the viewing area (rectangular sheet zone) that thisimage data packets 1090a is obtained, then handle and enter step S1035.
After processing entered step S1035, theimage data packets 1090a that taking-upcontrol module 1033 will take out in step S1033 was stored in theimage buffer memory 1023 temporarily.
Then, display unitoverhead control unit 1020 judges in step S1036 whether take outcontrol module 1033 has taken out all images processinginstruction bag 1090b of the allocated display area that belongs to himself.As judged result, do not take out all images processinginstruction bag 1090b of the allocated display area that belongs to himself yet if take outcontrol module 1033, then handle the step S1021 that turns back among Figure 18 A, to judge whether to import nextimage data packets 1090a.
On the other hand, taken out all images processinginstruction bag 1090b of the allocated display area that belongs to himself, then handled entering above-mentioned step S1027 if take out control module 1033.Display unitoverhead control unit 1020 judges whether take outcontrol module 1033 has taken out allimages packet 1090a of the allocated display area that belongs to himself then.
If be judged as in step S1032: the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handles entering step S1037.After processing entered step S1037, allocated displayarea comparing unit 1032 was discarded in and is judged as theimage data packets 1090a of input among the step S1031 and does not accept (reception).
If in step S1034, be judged as the border that comprises the allocated display area of himself from the viewing area (rectangular sheet zone) thatimage data packets 1090a is obtained, then handle and enter step S1038.After processing enters step S1038, take out the data incontrol module 1033 the zones except that himself allocated display area of deletion from the viewing area thatimage data packets 1090a obtained of among step S1033, being taken out.
If be judged as in step S1022: the position coordinates ID that is stored in the sheet coordinateid field 1095 of the Flame ImageProcess instruction bag 1090b that enters is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then handles entering step S1039.After processing entered step S1039, allocated displayarea comparing unit 1032 was discarded in the Flame ImageProcess instruction bag 1090b that is judged as input among the step S1021 and does not accept (reception).
If in step S1024, be judged as: to a plurality of viewing areas, the viewing area of its carries out image processing, then handle and enter step S1040 corresponding to the allocated display area that comprises himself by Flame ImageProcess instruction bag 1090b indication.After processing enters step S1040, take outcontrol module 1033 deletions remove the zone himself the allocated display area of data that the Flame Image Process instruction of taking out wraps the Flame Image Process designated command among the 1090b in step S1023 data.
In the present embodiment,many display servers 63 are divided into a plurality of rectangular sheets zone with the original image content data, and generate the position coordinates ID of the position in the rectangular sheet zone after cutting apart in the presentation video content.Many display servers 63 generate the image in the rectangular sheet zone after will cutting apart and theimage data packets 1090a that their position coordinates ID is associated, and they are sent to displayunit 71~79.In addition,many display servers 63 generate the Flame Image Process designated command at a plurality of rectangular sheets zone, and generate the position coordinates ID in the zone that expression is applied to these Flame Image Process designated commands.Many display servers 63 generate the Flame ImageProcess instruction bag 1090b that the position coordinates ID with Flame Image Process designated command and Flame Image Process designated command is associated, and they are sent to displayunit 71~79.
Only when included position coordinates ID among theseimage data packets 1090a and the Flame ImageProcess instruction bag 1090b was included in the coordinate ID scope of the allocated display area of representing himself, eachdisplay unit 71~79 was just accepted (reception)image data packets 1090a and Flame Image Process instruction bag 1090b.Eachdisplay unit 71~79 is applied to the picture material data included among theimage data packets 1090a of (reception) of accepting based on included image processing command among the Flame ImageProcess instruction bag 1090b with Flame Image Process.Then, eachdisplay unit 71~79 shows the picture material of this Flame Image Process of process.
As mentioned above, eachdisplay unit 71~79 only receives theimage data packets 1090a and the Flame ImageProcess instruction bag 1090b of the allocated display area that belongs to himself, at each rectangular sheet area applications Flame Image Process, and the data of display image content.Therefore, dispensing device needn't be carried out any specified arrangement processing etc. corresponding to receiving display device.Receiving trap needn't be carried out any image cut processing etc.As a result, can be by realizing large screen display than legacy system hardware resource still less.Because dispensing device does not need the destination of picture material data is distributed, thereby can easily change the layout (quantity and layout etc.) ofdisplay unit 71~79.In addition, with therein under the situation of not cutting apart entire frame the situation of carries out image processing compare, can reduce Flame Image Process required and be used for size with reference to the storer of neighbor.
The 5th embodiment
Below describe the fifth embodiment of the present invention in detail.
In the 4th embodiment, the situation ofdisplay image content 1050 on bydisplay screen 51~59 formed whole screens ofdisplay unit 71~79 has been described.By contrast,display image content 1050 on present embodiment explanation some in thedisplay screen 51~50 ofdisplay unit 71~79.More specifically, in the present embodiment, the layout ofmany display server 63 specify image contents.Eachdisplay unit 71~79 uses specified layout to calculate the allocated display area of himself, and judges whetherimage data packets 1090a belongs to the allocated display area that is calculated.Like this, in the present embodiment, be different from the 4th embodiment in order to some step of the required software processes of display image content.Therefore, same reference numerals is represented identical assembly and the processing in Figure 13~18 with the 4th embodiment, and does not repeat detailed description thereof.
The demonstration example of multidisplay system (Figure 19 A~19C)
Figure 19 A~19C illustrates the demonstration example in the multidisplay system 61 (display unit 71~79).In the present embodiment, picture material is arranged and is presented at the specified position ofmany display server 63 based on user's instruction.
Figure 19 A illustrates the example of picture material.As among Figure 13 A, by the text data object composingimages content 1050 of weather chart object and weather chart.
Figure 19 B illustrates the topology example of picture material 1050.Near the situation that Figure 19 B illustration is such: will be arranged in the lower right corner ofdisplay screen 1100 with theproperties window 1101 of scale downdisplay image content 1050.
Figure 19 C is illustrated in the demonstration example when usingdisplay unit 71~79 display image content 1050.Display screen 51~50 is respectively the display screen ofdisplay unit 71~79.As among the 4th embodiment, in Figure 19 C,, form the single display screen of 3 * 3 matrixes (3 row * 3 row) by making up 9display units 71~79.Figure 19 C illustrates following example: making up on 9 display units, 71~79 formed display screens displayimage content 1050 by the mode according to the topology example shown in Figure 19 B.Eachdisplay unit 71~79 shows a part oforiginal image content 1050 according to its allocated display area.In this case, the allocated display area ofdisplay unit 71~79 changes according tomany display server 63 specified layouts.For example, in Figure 19 C, only the upper left ofproperties window 1101 is allocated display area of display unit 71.Like this, shown in Figure 19 C, by thedisplay screen 51~59 ofcombination display unit 71~79, and according to this layoutdisplay image content 1050, thereby show wholeoriginal image content 1050.
The internal placement of many display servers and operation (Figure 20)
Figure 20 A and 20B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Figure 20 A.
With reference to figure 20A, 63 pairs of data that received fromcontent server 60 of many display servers are decoded, and decoded data are packed, and the bag that is generated is sent to displayunit 71~79.
Manyindicative control units 1001 of controllingwhole multidisplay system 61 also compriselayout control module 1110 except that the serveroverhead control unit 1002 shown in Figure 16 A.1110 inputs of layout control module and storage are from the layout command information (layout directive command) of user's's (for example,client terminal 65 or content server 60) picture material.Layout control module 1110 usestransmission interface 1007 that the layout command information is sent to displayunit 71~79.The layout command information of picture material comprises for example position coordinates in the zone of laying out images content.In this case,layout control module 1110 can will be presented at the top-left coordinates (Xmin of the scaled down image of theproperties window 1101 on thedisplay screen 1100 shown in Figure 19 B and the 19C, Ymin) and the bottom right coordinate (Xmax Ymax) is set to the layout command information of picture material.In addition,layout control module 1110 size that can be presented at the top-left coordinates of theproperties window 1101 on thedisplay screen 1100 among Figure 19 B and the 19C andproperties window 1101 is set to the layout command information of picture material.
For the operation ofmany display servers 63, in process flow diagram shown in Figure 17,layout control module 1110 is (for example, before the processing of step S1001) before the processing of step S1010 or S1016, the layout command information of input and memory image content.Layout control module 1110 is before the processing of step S1010 or S1016 (for example, before the step S1001) then, and the layout command information of the picture material of being stored is sent to displayunit 71~79.The example of other operation ofmany display servers 63 identical with shown in Figure 17, and avoid repeat specification to it.
In the following description, as required, the command information of the layout of picture material is called the layout command information.
The internal placement of display unit and operation (Figure 20 B)
The layout of eachdisplay unit 71~79 is described below with reference to Figure 20 B.Notice thatdisplay unit 71~79 has identical set.Therefore, the layout ofdisplay unit 71 only is described, and does not provide the explanation of the layout of all theother display units 72~79.
With reference to figure 20B,display unit 71 calculates the allocated display area of himself based on the layout command information that is sent from many display servers 63.Display unit 71 judges whether theimage data packets 1090a that is sent frommany display servers 63 belongs to the allocated display area that iscalculated.Display unit 71 only is applied to belong to theimage data packets 1090a of the allocated display area of himself with Flame Image Process, and recovers and show a part of picture material.
The assembly of display unitoverhead control unit 1020 controls formation display unit 71.In the present embodiment, display unitoverhead control unit 1020 has newly comprisedlayout storage unit 1111 and allocated displayarea computing unit 1112.
Layout storage unit 1111 is stored the layout command information that is sent from thelayout control module 1110 of many display servers 63.Allocated displayarea computing unit 1112 calculates the allocated display area of himself based on the layout command information that is stored in thelayout storage unit 1111, and this result of calculation is stored in the allocated display area storage unit 1031.Like this,, be stored in allocated display area in the allocated displayarea storage unit 1031, obtain the allocated display area that allocated displayarea computing unit 1112 is calculated by correction according to the content of layout command information.More specifically, allocated displayarea storage unit 1031 storage belongs to the coordinate ID scope of rectangular sheet of the allocated display area of himself.
Allocated displayarea comparing unit 1032 is judged: whether the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that respectively enters and Flame ImageProcess instruction bag 1090b is included in the coordinate ID scope that is stored in the allocated display area storage unit 1031.If the position coordinates ID in the sheet coordinate id field ofbag 1090a that enters and 1090b is included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then takes outcontrol module 1033 and take out thesebag 1090a and 1090b that enter.Take outcontrol module 1033image data packets 1090a is writeimage buffer memory 1023, and Flame ImageProcess instruction bag 1090b is write in the Flame Image Processinstruction buffer storer 1117.
On the other hand, if the position coordinates ID in the sheet coordinate id field ofbag 1090a that enters and 1090b is not included in the coordinate ID scope that is stored in the allocated displayarea storage unit 1031, then allocated displayarea comparing unit 1032 abandons thebag 1090a that enters and 1090b and does not accept them.
As among the 4th embodiment, when the border of the allocated display area ofdisplay unit 71~79 was different from the border in rectangular sheet zone, both all only extracted allocated display area two display units of boundaries on either side, and abandon unnecessary portions.
Packet analysis unit 1024 extracts the picture material data (each payload 1092) of rectangular sheet from image data packets 1090a.Packet analysis unit 1024 is put the processing of the picture material data of the rectangular sheet that is extracted in order according to the information in thepacket header 1091.
Graphics processing unit 1115 receives and the corresponding Flame Image Process designated command of picture material data that is divided into rectangular sheet from Flame Image Process instruction buffer storer 1117.Graphics processing unit 1115 is applied to Flame Image Process to be divided into the picture material data of rectangular sheet according to the Flame Image Process designated command.
Amplify/dwindleunit 1113 according to the layout command information that is stored in thelayout storage unit 1111, with processing and amplifying or dwindle and handle the picture material data that are applied to rectangular sheet.Image reconstruction unit 1025 is recovered a part of original image content by the picture material data of combination rectangular sheet.Screen layout unit 1114 generates video datas, with image content layout thatimage reconstruction unit 1025 is made up according to the position that is stored in the layout command information in the layout storage unit 1111.Indicative control unit 1026 is under the control ofsynchronous control unit 1027, and the video data that screenlayout unit 1114 is generated is presented on thedisplay panel 1028.
For the operation ofdisplay unit 71~79, in the process flow diagram shown in Figure 18 A and the 18B,layout storage unit 1111 is stored the layout command information that is sent from thelayout control module 1110 ofmany display servers 63 before step S1032.And, before step S1032, allocated displayarea computing unit 1112 calculates himself the coordinate ID scope of allocated display area of expression based on being stored in layout command information in thelayout storage unit 1111, and result of calculation is stored in the allocated display area storage unit 1031.Allocated displayarea comparing unit 1032 is judged in step S1032: whether the position coordinates ID that is stored in the sheet coordinateid field 1095 of theimage data packets 1090a that is judged as input in step S1031 is included in the coordinate ID scope that is calculated by allocated displayarea computing unit 1112.
Between step S1028 and 1029, amplify/dwindleunit 1113 and will amplify or dwindle and handle the picture material data be applied to pass through according to the rectangular sheet of the Flame Image Process that is stored in the layout command information in thelayout storage unit 1111.
And, between step S1029 and S1030, the processing that is used to generate video data is carried out inscreen layout unit 1114, with image content layout thatimage reconstruction unit 1025 is made up according to the position that is stored in the layout command information in thelayout storage unit 1111.
At step S1030,indicative control unit 1026 is under the control ofsynchronous control unit 1027, and the video data that screenlayout unit 1114 is generated is presented on thedisplay panel 1028.
Other operation ofdisplay unit 71~79 identical with shown in Figure 18 A and the 18B, and avoid repeat specification to it.
By disposingdisplay unit 71~79 as mentioned above, eachdisplay unit 71~79 is according to specified layout, can only accept interiorimage data packets 1090a and the Flame ImageProcess instruction bag 1090b of allocated display area of himself, and can recover and display image content.
In the present embodiment,many display servers 63 generate the layout command information of the layout of indicating image content, and the information that is generated is sent to displayunit 71~79.Eachdisplay unit 71~79 calculates the coordinate ID scope of the allocated display area of presentation video content based on the layout command information.Only when included position coordinates ID was included in the coordinate ID scope that is calculated amongimage data packets 1090a and the Flame ImageProcess instruction bag 1090b, eachdisplay unit 71~79 was just accepted (reception) thesebag 1090a and 1090b.Theimage data packets 1090a and the Flame ImageProcess instruction bag 1090b of (reception) accepted in eachdisplay unit 71~79 use, shows the corresponding image of allocated display area with picture material.
Therefore, except that the effect described in the 4th embodiment, the layout when display image content can be set freely.
In the described example of present embodiment, the picture material data that sent fromcontent server 60 are single image stream.Alternatively, a plurality of image stream can be sent, and a plurality of picture materials can be onsingle display screen 1100, shown.In this case, the 2nd~a n picture material (n is equal to or greater than 2 natural number) layout (can be able to be realized that picture-in-picture shows) in first picture material.Alternatively, the 2nd~a n image content layout (can be able to be realized showing side by side) around first picture material.
Present embodiment can also adopt the various modifications described in the 4th embodiment.
The 6th embodiment
Below will describe the sixth embodiment of the present invention in detail.The 5th embodiment illustration such situation:display unit 71~79 is according to the layout command information that is sent frommany display servers 63, the picture material after the display layout.By contrast, the situation that the present embodiment illustration is such: also layout command information (layout directive command) is packed, and should wrap frommany display servers 63 and send to displayunit 71~79.
Notice that the layout directive command bag that the layout directive command is packed is stored together the layout directive command of each coordinates regional (rectangular sheet zone).The packet header of layout directive command bag comprises the field of the scope in the zone that expression is applied to the layout order.
Eachdisplay unit 71~79 is judged: whether the zone that will be applied to from the layout directive command bag thatmany display servers 63 are sent is included in the allocated display area of himself.Eachdisplay unit 71~79 is only accepted the layout directive command bag that (reception) will be applied to the allocated display area of himself, and comes the laying out images content based on the layout directive command bag of being accepted.
As mentioned above, in the present embodiment, be different from the 4th and the 5th embodiment substantially in order to some step of the software processes of laying out images content.Therefore, same reference numerals is represented identical assembly and the processing in Figure 13 A~20 with the 4th and the 5th embodiment, and does not repeat detailed description thereof.
The demonstration example of multidisplay system (Figure 21 A~21D)
Figure 21 A~21D illustrates the demonstration example in the multidisplay system 61 (display unit 71~79).In the present embodiment, with a plurality of image content layout be presented at assigned address.
Figure 21 A and 21B illustrate the example of picture material.The same at Figure 13 A and 19A, by thepicture material 1050 shown in the text data object pie graph 21A of weather chart object and weather chart, andpicture material data 1050 have file name " weather_chart.mpg ".On the other hand, by the picture material 1120 shown in automotive subjects, road object and the moon object pie graph 21B, and picture material 1120 has file name " car_at_night.mpg ".
Figure 21 C illustrates the topology example ofpicture material 1050 and 1120.The situation that Figure 21 C illustration is such: will show that the properties window 1122 and 1123 ofdisplay image content 1050 respectively and 1120 is presented on the display screen 1121 with scale down.
Figure 21 D is illustrated in the demonstration example that usesdisplay unit 71~79display image content 1050 and at 1120o'clock.Display screen 51~59 is respectively the display screen ofdisplay unit 71~79.As the 4th with the 5th embodiment in the same, in Figure 21 D, by making up 9display units 71~79, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row).
In this case, the allocated display area ofdisplay unit 71~79 changes according tomany display server 63 specified layouts.For example, in Figure 21 D, only the upper left of properties window 1122 is allocated display area ofdisplay unit 71.
The structure of many demonstration bags (Figure 22 A~22E)
Figure 22 A~22E illustrates the example of structure that show bag more.Structure below with reference to employed bag in Figure 22 A~transmission of 22E explanation in multidisplay system 61.Constitute many demonstrations bag of present embodiment by three types bags, that is, and image data packets, Flame Image Process instruction bag and layout directive command bag.Layout directive command bag is stored the layout command information in each coordinates regional (rectangular sheet zone).The packet header of this bag comprises that expression is based on the field of layout command information through the scope in the rectangular sheet zone of layout.
Figure 22 A illustrates thebags 1130 that show more.Figure 22 B is used to illustrate the figure that show the structure ofbag 1130 more.Shown in Figure 22 B, thebags 1130 that show havepacket header 1131 andpayload 1132 more.The view data ofpayload 1132 storage rectangle sheets or layout order.
Figure 22 C illustrates the example of the header structure of image data packets.In this header structure, the content of bag identifying information field is different from theimage data packets 1090a described in the 4th and the 5th embodiment.With reference to figure 22C, whether 1133 storages of bag identifying information field are show to wrap required id information and version information etc. in order to discern interested bag more.And it is image data packets, or Flame Image Process instruction bag, or the required id information of layout directive command bag that bag identifyinginformation field 1133 is also stored in order to discern interested bag.Because Figure 22 C illustrates the header structure of image data packets, thereby 1133 storages of the bag identifying information field shown in Figure 22 C are in order to discern the id information that interested bag is an image data packets.Notice that Flame Image Process instruction bag also has the header identical with Figure 22.
Figure 22 D illustrates the example of the header structure of layout directive command bag.Bag identifyinginformation field 1133 storages shown in Figure 22 D are in order to discern the id information that interested bag is a layout directive command bag.
1094 storages of content id field are in order to the required id information of recognition image content.1134 storages of coordinate range id field are in order to the required id information of scope of the target rectangle panel region of identification layout command information.Other id field 1135 storages are in order to other required ID of scope in identification rectangular sheet zone.For example,other id field 1135 is stored frame numbers etc.Picture material 1050 that synchrodatafield 1136 storage representations are discerned by the id information that is stored in thecontent id field 1094 or 1120 processing start time and handle the various timestamps of concluding time equal time information.Property data fields 1137 storages are in order to handle the required various types of attribute informations of scope in rectangular sheet zone.
Figure 22 E illustrates the example of structure of coordinate range id field 1134.Shown in Figure 22 E, constitute coordinate range id field 1134:Xmin coordinateid field 1138, Ymin coordinateid field 1139, Xmax coordinateid field 1140 and Ymax coordinateid field 1141 by four fields, they store the ID of respective rectangular panel region respectively.Like this, can specify a plurality of rectangular sheets zone.
The simple example of layout directive command bag below is described.For example, shown in Figure 21 D,use 9display units 71~79 to constitute multidisplay system 61.Then, shown in Figure 21 D, suppose (1920 * 1080 pixel) resolutiondisplay image content 1050 or 1020 on 3 * 3 display screens 51~59 with high-definition picture.And, suppose and send in order to the instruction of going up layout properties window 1122 in pixel (50,100)~(1250,800) and going up layout properties window 1123 in pixel (1000,500)~(1919,900) as the layout directive command.
Layout directive command package closes the order in each rectangular sheet zone, and is divided into for example two bags.The first layout directive command bag after generation is cut apart instructs with the layout that comprises properties window 1123 and generate the second layout directive command bag to comprise the layout instruction of properties window 1122.
Following definite coordinate range ID.If the size in each rectangular sheet zone is 16 * 16 pixels, then picture material data (frame) are divided into 120 * 68 rectangular sheet zones.Properties window 1122 comprises the scope in rectangular sheet zone, (3,6)~(78,50), and properties window 1123 comprises the scope in rectangular sheet zone, (62,31)~(119,56).Therefore, as the id information value in the coordinaterange id field 1134 that will be stored in the first layout directive command bag, 1138 storages " 3 " of Xmin coordinate id field, 1139 storages " 6 " of Ymin coordinate id field, 1140 storages " 78 " of Xmax coordinate id field, and 1141 storages " 50 " of Ymax coordinate id field.
As a result, can generate the parameter of following layout directive command bag.
The first layout directive command bag:
Packet header:
Coordinate range ID:
Xmin coordinate ID:3
Ymin coordinate ID:6
Xmax coordinate ID:78
Ymax coordinate ID:50
Payload:
<video x =″50″ y=″100″width=″1200″height=″700″xlink:href=″weather_chart.mpg″/>
The second layout directive command bag:
Packet header:
Coordinate range ID:
Xmin coordinate ID:62
Ymin coordinate ID:31
Xmax coordinate ID:119
Ymax coordinate ID:56
Payload:
<video x =″1000″y=″500″width=″920″height=″400″xlink:href=″car_at_night.mpg″/>
By disposing layout directive command bag as mentioned above, eachdisplay unit 71~79 is by reference coordinate scope ID only, just can judge that layout directive command bag is whether corresponding to himself allocated display area.That is to say that eachdisplay unit 71~79 only needs to receive the layout directive command bag of allocated display area, and carry out layout processing.
The internal placement of many display servers and operation (Figure 23 A)
Figure 23 A and 23B are the block diagrams of example that the detailed arrangement ofmultidisplay system 61 is shown.The layout ofmany display servers 63 is described below with reference to Figure 23 A.
With reference to figure 23A,many display servers 63 are divided into the layout command information in each coordinates regional (rectangular sheet zone) with the layout command information, and they are packed and send.In the present embodiment, the operation oflayout control module 1150 andbag generation unit 1151 is different from the 5th embodiment shown in Figure 20 A.The layout command information oflayout control module 1150 each coordinates regionals of combination (rectangular sheet zone), and the information after will making up outputs to bag generation unit 1151.Coordinates regional (rectangular sheet zone) is arranged to any size.
Bag generation unit 1151 generates themany demonstrations bag 1130 with the structure shown in Figure 22 A~22E.Bag generation unit 1151 generates image data packets under the picture material data conditions, and generates layout directive command bag under the situation of layout order.
To show thatbag 1130 sends to displayunit 71~79 o'clock frommany display servers 63,bag generation unit 1151 at first generates themany demonstrations bag 1130 that is associated with the layout order, and they are sent to displayunit 71~79 more.Thereafter, after the execution layout was provided with indisplay unit 71~79,bag generation unit 1151 began to send themany demonstrations bag 1130 that is associated with the data of picture material.
For the operation ofmany display servers 63, before step S1010 in process flow diagram shown in Figure 17 or the processing of S1016 (for example, before the processing of step S1001), the processing below carrying out.The layout command information oflayout control module 1150 Input Image Content (layout directive command), and make up the layout command information in each coordinates regional (rectangular sheet zone).1151 pairs oflayout control modules 1150 of bag generation unit are packed at the layout command information that each coordinates regional (rectangular sheet zone) is made up, to generate themany demonstrations bag 1130 that is associated with the layout command information.Many demonstrations bag 1130 thattransmission interface 1007 will be associated with the layout command information then sends to displayunit 71~79.Then, carry out the processing among the step S1001~S1011 among Figure 17, send to displayunit 71~79 withmany demonstrations bag 1130 that will be associated with the data of picture material.
The internal placement of display unit and operation (Figure 23 B)
The layout of eachdisplay unit 71~79 is described below with reference to Figure 23 B.Notice thatdisplay unit 71~79 has identical set.Therefore, the layout ofdisplay unit 71 only is described, and does not provide the explanation of the layout of all theother display units 72~79.
With reference to figure 23B,display unit 71 is imported layout command informations (layout directive command) as layout directive command bag, and based on the layout directive command bag of being imported, carries out the layout processing of display screen.When input layout directive command bag,display unit 71 judges whether the target area of each layout directive command bag is dropped in the allocated display area of himself, and only accepts (reception) himself interior layout directive command bag of allocated display area.
In Figure 23 B, in thedisplay unit 71 of present embodiment, to compare with thedisplay unit 71 of the 5th embodiment, allocated displayarea comparing unit 1152,packet analysis unit 1153 are different with the operation ofscreen layout unit 1154.
Allocated displayarea comparing unit 1152 judges whether each layout directive command bag, image data packets and Flame Image Process instruction bag belong to the allocated display area of himself.For layout directive command bag, allocated displayarea comparing unit 1152 judges whether the application target zone of layout directive command bag is included in the allocated display area of distributing to himself unit.That is to say described in the 4th embodiment, allocated displayarea comparing unit 1152 judges whether the value of the coordinaterange id field 1134 in the layout directive command bag is included in coordinate ID scope set in allocated display area storage unit 1031.On the other hand, whether for image data packets and Flame Image Process instruction bag, allocated displayarea comparing unit 1152 is judged based on layout directive command bag: be stored in position coordinates ID in wherein each the sheet coordinateid field 1095 of these bags and be included in by allocated displayarea computing unit 1112 and calculated in the coordinate ID scope of (correction).
Packet analysis unit 1153 extracts the data that showbag 1130 fromimage buffer memory 1023 more.Packet analysis unit 1153 is put the processing of the data of themany demonstrations bag 1130 that is extracted in order according to the information in the packet header 1131.Ifmany demonstration bags 1130 are layout directive command bags, thenpacket analysis unit 1153 will show that the data ofbag 1130 output tolayout storage unit 1111 more.Layout storage unit 1111 is based on layout directive command bag storage layout command information.
On the other hand, ifmany demonstration bags 1130 are image data packets, thenpacket analysis unit 1153 will show that the data ofbag 1130 output tographics processing unit 1115 more.
Screen layout unit 1154 generates properties window 1122 and 1123 layouts according to the video data that is stored in the position of the layout command information in the layout storage unit 1111.In this case, when properties window 1122 and 1123 when overlapped,screen layout unit 1154 is according to the layout directive command that is stored in thelayout storage unit 1111, utilizes transparent execution overlapping or rewrite and handle.
Configurationimage processing unit 1115, amplify/dwindle the processing ofunit 1113,image reconstruction unit 1025, display unitoverhead control unit 1020 andbag receiving element 1022 with a plurality of properties windows 1122 of executed in parallel and 1123.In this case,graphics processing unit 1115, amplify/dwindleunit 1113,image reconstruction unit 1025, display unitoverhead control unit 1020 andbag receiving element 1022 can time-division contents processing window 1122 and 1123.And, can assemble a plurality ofgraphics processing units 1115, amplify/dwindleunit 1113,image reconstruction unit 1025, display unitoverhead control unit 1020 andbag receiving element 1022 to be to carry out parallel processing.
Utilize above-mentioned layout, eachdisplay unit 71~79 only receives the interior layout directive command bag of allocated display area of himself, and can be based on the layout directive command packet layout and the display frame that are received.
For the operation ofdisplay unit 71~79, before the step S1032 in the process flow diagram shown in Figure 18 A and the 18B, receivinginterface 1021 receives layout directive command bag.Allocated displayarea comparing unit 1152 judges whether the application target zone of the layout directive command bag of each input is included in the allocated display area of himself.Value and the coordinate ID scope that is stored in the allocated displayarea storage unit 1031 based on the coordinaterange id field 1134 in the layout directive command bag realize this judgment processing.
Take outcontrol module 1033 and only accept the layout directive command bag that (reception) will be applied to the allocated display area of himself, and abandon other layout directive command bag.Thereafter, the layout directive command bag of (reception) is accepted inpacket analysis unit 1153 analyses, and based on this analysis result the layout directive command is stored in the layout storage unit 1111.And allocated displayarea computing unit 1112 calculates the allocated display area of himself based on the layout directive command that is stored in thelayout storage unit 1111, and rewrites the coordinate ID that is stored in the rectangular sheet in the allocated displayarea storage unit 1031.
Allocated displayarea comparing unit 1152 is judged in step S1032: be stored among the coordinate ID of the rectangular sheet after whether position coordinates ID in the sheet coordinateid field 1095 of the image data packets that is judged as input in step S1031 is included in rewriting.
Between step S1028 and S1029, amplify/dwindleunit 1113 according to the layout command information that is stored in thelayout storage unit 1111, with processing and amplifying or dwindle and handle the picture material data that are applied to rectangular sheet.
And, between step S1029 and S1030,screen layout unit 1154 is carried out and is used for generating the image content layout that will be made up byimage reconstruction unit 1025 in the processing according to the video data of the position of the layout directive command that be stored inlayout storage unit 1111.
At step S1030,indicative control unit 1026 is under the control ofsynchronous control unit 1027, and the video data that screenlayout unit 1154 is generated is presented on thedisplay panel 1028.
Other operation ofdisplay unit 71~79 identical with shown in Figure 18 A and the 18B, and avoid repeat specification to it.
In the present embodiment,many display servers 63 are packed by the layout command information to the layout of indicating image content, generate layout directive command bag, and they are sent to displayunit 71~79.Eachdisplay unit 71~79 is based on the allocated display area of layout directive command bag computed image content.Only when position coordinates ID included in the image data packets was included in the allocated display area of the picture material that is calculated, eachdisplay unit 71~79 was accepted (reception) given image data packets.The image data packets of (reception) is accepted in eachdisplay unit 71~79 use, shows the corresponding image of allocated display area with picture material.
As mentioned above, owing to use the packet communication of same communication scheme to send picture material data and layout command information (layout directive command), thereby can handle picture material data and layout directive command by identical bag disposal system.Therefore, except that the described effect of the 5th embodiment, can simplify interface.
In the present embodiment, generate layout directive command bag for each content segmentation ground.Yet, can under ameristic situation, pack to the layout directive command.In this case, eachdisplay unit 71~79 can be accepted (reception) all layout directive command bags, and can only extract and handle and the corresponding order of the allocated display area of himself.
In addition, each image data packets can comprise the layout directive command.For example, can inother id field 1096 in image data packets the layout directive command be described.Like this, when with many demonstrations packet delay that the layout directive command is associated, can prevent the acceptance failure of image data packets.
Present embodiment can also adopt the various modifications described in the 4th and the 5th embodiment.
The 7th embodiment
Below describe the seventh embodiment of the present invention in detail.
In the present embodiment, multidisplay system comprises many display servers and a plurality of display unit of the rendering order that picture material is provided, wherein, the part of each display unit display image content, and they show whole contents as a whole.Rendering order is divided into a plurality of orders, and rendering order is offered display unit from many display servers with the integrated data form.Each display unit judges that rendering order included in the integrated data is whether corresponding to himself allocated display area.Each display unit is only accepted the rendering order of the allocated display area of himself, draws according to the rendering order of being accepted, and show the image of the allocated display area of himself on screen.Present embodiment will illustrate such multidisplay system.
The explanation of the illustrative arrangement of multidisplay system (Figure 24)
Figure 24 is the schematic block diagram that the example of arranging substantially of multidisplay system is shown.
With reference to Figure 24, the picture material data that multidisplaysystem 2061 is imported from the exterior content server, and show the picture material data of being imported.At display unit (Disp11~Disp33) show on 2071~2079 formed screens bycombination 3 row * 3 row.
Inmultidisplay system 2061,many display servers 2063 generate the rendering order of picture material, the rendering order that is generated is packed, and will comprise that the image data packets of the rendering order after the packing offers eachdisplay unit 2071~2079.Communication path 2064 is used for image data packets is offered eachdisplay unit 2071~2079.Communication path 2064 comprises for example network such as LAN (LAN (Local Area Network)), WAN (wide area network) or the Internet.
The image data packets that comprises the rendering order after the packing that is provided frommany display servers 2063 is provided fordisplay unit 2071~2079.At this moment, eachdisplay unit 2071~2079 is only accepted to comprise and himself the image data packets of the corresponding rendering order of allocated display area.Eachdisplay unit 2071~2079 shows a part of picture material by carrying out drafting according to the rendering order that is included in the image data packets of beingaccepted.Display unit 2071~2079 comprises the display panel of various systems such as LCD (LCD) or plasma display.Notice that one of themdisplay unit 2071~2079 can comprise the display panel of the system that is different from all the other display units.Display screen size by increasingdisplay unit 2071~2079 or increase the quantity of display unit that will combination can be implemented in the demonstration on the giant-screen size more.
The whole bag of tricks of the allocated display area that is used to be provided withdisplay unit 2071~2079 can be utilized, and any means can be used.As the simplest method, can utilize by the user these regional methods clearly are set.When user's operation setting was given the switch etc. ofdisplay unit 2071~2079, the user can be provided with the allocated display area of the display unit with respective switch.Alternatively, for example, external client's terminal can send to the information in order to the allocated display area ofdirection display unit 2071~2079many display servers 2063 of the allocated display area that displayunit 2071~2079 can be set.
Display unit 2071~2079 can be assembled to frame shape guide member.The user is installed intodisplay unit 2071~2079 in the guide member that can support thedisplay unit 2071~2079 arranged with 3 * 3 matrixes (3 row * 3 row).And the user is connected to thesedisplay units 2071~2079 with electric power cable and signal cable.Like this,display unit 2071~2079 constitutes giant-screen.Distribute unique identifier by rigging position to them, can make the identification ofdisplay unit 2071~2079 and the appointment of its position according todisplay unit 2071~2079.Sensor can be arranged on the coupling surface ofdisplay unit 2071~2079, and can be sensor-based testing result specify the position ofdisplay unit 2071~2079.For example, (for example, end face, bottom surface and two sides) are provided with sensor on the four direction that can be coupled todisplay unit 2071~2079.Afterdisplay unit 2071~2079 was coupled, they used sensor and coupling the other side exchange id.Like this, by the ID thatarrangement display unit 2071~2079 is kept, can specify their position.
The demonstration example of multidisplay system (Figure 25 A and 25B)
Figure 25 A and 25B illustrate the demonstration example in the multidisplay system 2061 (display unit 2071~2079).
Figure 25 A illustrates by drawing the example of the picture material that rendering order obtained.By draw to draw the required rendering order of rectangle with draw the required rendering order of triangle, obtain picture material 2050.That is to say, by rectangular object and triangle object composingimages content 2050.
Figure 25 B is illustrated in the demonstration example when usingdisplay unit 2071~2079 display image content 2050.Display screen 2051~2059 is respectively the display screen ofdisplay unit 2071~2079.In Figure 25 B,, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row) by making up 9display units 2071~2079.
Like this, Figure 25 B illustrates such example: thepicture material 2050 shown in Figure 25 A is presented at by making up on the display screen that 9display units 2071~2079 are constituted.Eachdisplay unit 2071~2079 is drawn rendering order according to the allocated display area of himself, and shows a part oforiginal image content 2050 according to drawing result.For example,display unit 2079 shows the lower right-most portion of rectangular object ondisplay screen 2059, and because the allocated display area ofdisplay unit 2073 self does not comprise any rendering order, therebydisplay unit 2073 does not show any figure on display screen2053.In display screen 2051~2059 o'clock ofcombination display unit 2071~2079 shown in Figure 23 B, can draw the whole rendering order oforiginal image content 2050, and can on a screen, show wholeoriginal image content 2050.
The structure of image data packets (Figure 26 A~26C)
The structure of employed image data packets in the transmission inmultidisplay system 2061 below is described.Figure 26 A~26C illustrates the example of structure of image data packets.
Figure 26 A illustrates image data packets 2090.Figure 26 B illustrates the structure of image data packets 2090.Shown in Figure 26 B, image data packets 2090 has packet header 2091 and rendering order 2092.
Figure 26 C illustrates the structure of packet header 2091 and rendering order 2092.The type of bag identifying information field 2093 expression bags.Whether 2093 storages of bag identifying information field have obtained required id information of interested image data packets 2090 and version information etc. in order to identification by rendering order is packed.And bag identifying information field 2093 can also storage package length and inspection and is waited the required information of bag processing.
The various timestamps of the demonstration time of the drawing result ofsynchrodata field 2094 storage representation rendering orders 2092 etc.
2095 storages of graphing field are with the type of the figure of drafting.The type of one figure ingraphing field 2095 storage straight lines, triangle, rectangle and the ellipse.The profilecolor data field 2096 storages data relevant with the profile color.The profile color is the color of graph outline.2096 storages of profile color data field are 24 bit data altogether by being obtained with each R of 8 bit representations, G and B color for example.
Show (paint)color data field 2097 storages data relevant with picture color.Show Color is the color of the closed region in the closed figures such as triangle, rectangle or ellipse for example.2097 storages of Show Color data field are 24 bit data altogether by being obtained with each R of 8 bit representations, G and B color for example.The coordinate data of the position of coordinatedata field 2098 storage representation figures.For example, if figure is straight line, triangle or rectangle, the coordinate on the summit as much as possible on the summit of the appropriate section of coordinatedata field 2098 graphics (X coordinate, Y coordinate) then.If figure is oval, then 2098 storages of coordinate data field are around the coordinate (X coordinate, Y coordinate) of the appropriate section of oval-shaped rectangular area (bounding box).
Data bitmap field 2099 is stored in the rectangular area the data bitmap that shows.In the present embodiment, for example non-compress bitmap data ofdata bitmap field 2099 storages.Yet data bitmap can be packed data or non-packed pixel data.
The internal placement of many display servers and operation (Figure 27 A and 28)
Figure 27 A and 27B are the block diagrams of example that the detailed arrangement ofmultidisplay system 2061 is shown.The layout ofmany display servers 2063 is described below with reference to Figure 27 A.
With reference to figure 27A,many display servers 2063 generate rendering order.Many display servers 2063 are packed to the rendering order that is generated then.Andmany display servers 2063 send to displayunit 2071~2079 with the rendering order bag.
Thewhole multidisplay system 2061 of manyindicative control unit 2001 controls.Manyindicative control units 2001 comprise storeies such as CPU, ROM and RAM, bus and various interface etc.When using executions such as RAM to be stored in program among the ROM as CPU, manyindicative control units 2001 are controlled total systems.Each assembly of themany display servers 2063 of serveroverhead control unit 2002 controls formation.
Renderingorder generation unit 2005 generate will be ondisplay unit 2071~2079 content displayed as rendering order.With the generation rendering order while, perhaps generating the rendering order front and back, renderingorder generation unit 2005 generates the timestamp information of the Displaying timer of presentation graphic based on rendering order.Renderingorder generation unit 2005 offerssynchronous control unit 2012 with the timestamp information that is generated.
Bag transmitting element 2006 is cut apart rendering order according to the size of data (data volume) of himself, and the rendering order after cutting apart is packed to generate image data packets 2090.The back will describebag transmitting element 2006 in detail.Transmission interface (send I/F) 2007 sends to displayunit 2071~2079 with image data packets2090.To display unit 2071~2079 broadcast image packets 2090 that are connected with many display servers 2063.Transmission interface 2007 sends to displayunit 2071~2079 with the various control datas that manyindicative control units 2001 are generated independently.
Inbag transmitting element 2006,data partitioning unit 2010 is divided into a plurality of orders according to its size of data (data volume) with rendering order.Synchronous control unit 2012 generates inner synchro control data based on the timestamp information that is generated by rendering order generation unit 2005.These synchro control data comprise the transmitting time to displayunit 2071~2079, the processing start time ofdisplay unit 2071~2079 and the demonstration time equal time information ofdisplay unit 2071~2079.The synchro control data that synchronouscontrol unit 2012 is generated are stored in thesynchrodata field 2094 shown in Figure 26 C as timestamp.Note, as long as the synchro control data are the temporal informations that can specify processing start time in thedisplay unit 2071~2079 and Displaying timer etc., the synchro control data are not limited to above-mentionedly so, but can use any other kinds of information as the synchro control data.
Each rendering order that the timestamp thatbag generation unit 2011 usessynchronous control unit 2012 to be generated fordata partitioning unit 2010 is divided into generates the image data packets 2090 with the structure shown in Figure 26 A~26C.
Utilize the layout of above-mentionedmany display servers 2063, generate and cut apart rendering order, the order after cutting apart is packed, and the rendering order bag can be sent todisplay unit 2071~2079.
Example below with reference to the operation of themany display servers 2063 of flowchart text of Figure 28.
At step S2001, renderingorder generation unit 2005 waits for, up to via network till the graphical content data that for example input of exterior content server will show.When the tablet pattern content-data, handle entering step S2002.After processing entered step S2002, renderingorder generation unit 2005 generated rendering order based on the graphical content data of input, and generated the timestamp information of rendering order.
At step S2003,data partitioning unit 2010 is divided into a plurality of orders according to its size of data (data volume) with rendering order.
At step S2004,synchronous control unit 2012 generates inner synchro control data based on the timestamp information that renderingorder generation unit 2005 is generated in step S2002.
At step S2005, each rendering order thatbag generation unit 2011 is divided into fordata partitioning unit 2010 generates the image data packets 2090 with the structure shown in Figure 26 A~26C.In this step,bag generation unit 2011 is based on the content of the rendering order that is generated at step S2002, and generation will be stored in the data ingraphing field 2095, profilecolor data field 2096, ShowColor data field 2097, coordinatedata field 2098, the data bitmap field 2099.Andbag generation unit 2011 is based on the synchro control data that generated in step S2004, and generation will be stored in the data in thesynchrodata field 2094.
At step S2006, serveroverhead control unit 2002indication transmission interfaces 2007 are sent in the image data packets 2090 that is generated among the step S2005.Like this, image data packets 2090 is sent to displayunit 2071~2079.
The internal placement of display unit and operation (Figure 27 B and 29)
The layout of eachdisplay unit 2071~2079 is described below with reference to Figure 27 B.Notice thatdisplay unit 2071~2079 has identical set.Therefore, the layout ofdisplay unit 2071 only is described, and does not provide the explanation of the layout of all theother display units 2072~2079.
With reference to figure 27B,display unit 2071 judges that the image data packets that sent from display server 2,063 2090 is whether corresponding to himself allocated displayarea.Display unit 2071 is accepted the image data packets 2090 of the allocated display area of himself, and comes display image by drawing himself the rendering order of allocated display area accepted.
The assembly of display unitoverhead control unit 2020 controls formation display unit 2071.Display unitoverhead control unit 2020 comprises for example storer such as CPU, ROM and RAM and various interface etc.When using the program of executive logging such as RAM in ROM as CPU, thewhole display unit 2071 of display unitoverhead control unit 2020 controls.
The image data packets 2090 that receiving interface (receiving I/F) 2021 inputs are sent from many display servers 2063.Receiving interface (receive I/F) 2021 is input image data bag 2090 not only, but also input is by control data that manyindicative control units 2001 generated etc.
Bag receiving element 2022 judges whether image data packets 2090 may belong to the allocated display area of himself.If image data packets 2090 may belong to the allocated display area of himself, then wrap receivingelement 2022 these bags are stored in the memory buffer 2023.The back will describebag receiving element 2022 in detail.
The image data packets 2090 (rendering order bag) thatmemory buffer 2023 interim storages are received by bag receiving element 2022.Packet analysis unit 2024 is put processing in order according to the information in the packet header 2091 included in each image data packets 2090 that is received bybag receiving element 2022.
Renderer 2115 generates display image data according to included rendering order 2092 in each image data packets 2090 of being received ofbag receiving element 2022 by carrying out to draw.Attention, renderer 2115 bases are stored in the modification parameter of revising in theparameter storage unit 2116, the figure that will draw is carried out amplify/dwindle/translation etc.Display unitoverhead control unit 2020 allocated display area according to himself are provided with these and revise parameter.
Notice that the border of the allocated display area ofdisplay unit 2071~2079 often is different from the border of the display image data that included rendering order 2092 is drawn in the image data packets 2090 that is received according to bag receiving element 2022.That is to say thatrenderer 2115 is often drawn the part except that the allocated display area of eachdisplay unit 2071~2079.In this case, two of boundaries on either side display units both all receive the image data packets 2090 of boundary member of their allocated display area.In this case, therenderer 2115 of these two display units abandons the part except that their allocated display area in the display image data after the drafting.
Indicative control unit 2026 carries out the drive controlling of display panel 2028.Indicative control unit 2026 is synchronous with for example drive signals such as horizontal-drive signal, vertical synchronizing signal and data transmission clock, and the display image data that renderer 2115 is generated outputs to display panel 2028.Notice that display image data is stored in the VRAM (not shown), and with drive signal reading displayed view data synchronously regularly, and it is outputed to displaypanel 2028.
Synchronous control unit 2027 is controlledindicative control unit 2026 based on the synchro control data (timestamp) in thesynchrodata field 2094 that is stored in each image data packets 2090, at the appointed time to show the display image data that is generated by renderer2115.As display panel 2028, as mentioned above, for example, can use the display device of system arbitrarily such as LCD, plasma display and projection type display.The display image data that displaypanel 2028 is generated based on renderer 2115 (that is, with the corresponding part of the allocated display area of picture material self) comes display image.As mentioned above,display panel 2028 can be the display device of scheme arbitrarily such as LCD, plasma display or projection type display.
Below describe the layout ofbag receiving element 2022 in detail.As mentioned above,bag receiving element 2022 judges whether image data packets 2090 may belong to the allocated display area of himself.Bag receiving element 2022 is only accepted the image data packets 2090 that (reception) may belong to allocated display area, and they are stored in thememory buffer 2023.
2031 storages of allocated display area storage unit belong to the coordinate range of the allocated display area of himself, to discern the allocated display area of himself.As mentioned above, can allocated display area be set by any means.
The id information that IDanalytic unit 2030 extracts in the packet header 2091 that is stored in the image data packets 2090 that respectively enters to confirm the information in packet header 2091, extracts the coordinate data that is stored in the coordinatedata field 2098 then.
Whether allocated displayarea comparing unit 2032 is judged: be stored in coordinate data in the coordinatedata field 2098 of the image data packets 2090 that respectively enters and may be included in himself the allocated display area (being stored in the coordinate range in the allocated displayarea storage unit 2031).If the coordinate data that is stored in the coordinatedata field 2098 of the image data packets 2090 that enters may be included in the allocated display area, then 2032 indications of allocated display area comparing unit are taken outcontrol modules 2033 and are taken out image data packets 2090.On the other hand, if the coordinate data that is stored in the coordinatedata field 2098 of the image data packets 2090 that enters can not be included in the allocated display area, allocated displayarea comparing unit 2032 abandons image data packets 2090 and does not accept.
Take outcontrol module 2033 and receive (taking-up) specified image data packets 2090 of taking-up instruction from allocated displayarea comparing unit 2033, and with theirwrite buffering memories 2023.
The simple example of the control in thedisplay unit 2071 below is described.For example, as shown in figure 24,use 9display units 2071~2079 to constitute multidisplay system 2061.Then, shown in Figure 25 B, suppose (1920 * 1080 pixel) resolutiondisplay image content 2050 on 3 * 3display screens 2051~2050 with high-definition picture.That is to say, suppose thatdisplay unit 2071~2079 can display of high resolution images (1920 * 1080 pixel).
In this case,display unit 2071~2079 shows that respectively each all has 9 zones of (640 * 360) pixel.
The allocated display area ofdisplay unit 2071 is corresponding to being equal to or greater than (0,0) and less than the zone of the location of pixels of (640,360).The allocated display area ofdisplay unit 2072 is corresponding to being equal to or greater than (640,0) and less than the zone of the location of pixels of (1280,360).The allocated display area ofdisplay unit 2075 is corresponding to being equal to or greater than (640,360) and less than the zone of the location of pixels of (1280,720).Therenderer 2115 ofdisplay unit 2071~2079 is drawn the rendering order 2092 after cutting apart of these allocated display area.For example, the allocated displayarea storage unit 2031 ofdisplay unit 2072 storage: the allocated display area of himself is corresponding to being equal to or greater than (640,0) and less than the zone of the location of pixels of (1280,360).The modificationparameter storage unit 2116 memory modify parameters ofdisplay unit 2072, these are revised parameters indication and deduct-640 from the x coordinate, and x and y coordinate all multiply by 3.
Allocated displayarea storage unit 2031 storage of display unit 2075: the allocated display area of himself is corresponding to being equal to or greater than (640,360) and less than the zone of the location of pixels of (1280,720).The modificationparameter storage unit 2116 memory modify parameters ofdisplay unit 2075, these are revised parameters indication and deduct-640 from the x coordinate, deduct-360 from the y coordinate, and x and y coordinate all multiply by 3.
Allocated displayarea comparing unit 2032 is judged: whether the coordinate of the bounding box that calculates according to the coordinate data in the coordinatedata field 2098 that is stored in rendering order 2092 is overlapping with the allocated display area that is stored in the allocated display area storage unit 2031.Note following acquisition bounding box.That is to say, calculate X and the minimum on the Y-axis and the maximal value of the figure that will draw.From by such X that calculates and the specified specified defined rectangular area of coordinate (that is, the maximal value on X and the Y-axis) of the maximal value of coordinate (that is, the minimum value on X and the Y-axis) on X and Y-axis of the minimum value on the Y-axis, corresponding to bounding box.
For example, if the coordinate of included vertex of a triangle is respectively (600,300), (200,700) and (1000,600) in thepicture material 2050, then bounding box is the rectangular area of from (200,300) to (1000,700).Therefore,display unit 2072 and 2075 allocated displayarea comparing unit 2032 allocated display area that is judged as himself comprises this triangle.
For example, if the upper left and coordinate summit, bottom right of included triangle object is respectively (800,500) and (1600,900) in thepicture material 2050, then bounding box is the rectangular area of from (800,500) to (1600,900).Therefore, thismoment display unit 2072 allocated displayarea comparing unit 2032 allocated display area that is judged as himself do not comprise this triangle object.On the other hand, the allocated displayarea comparing unit 2032 ofdisplay unit 2075 allocated display area that is judged as himself comprises this triangle object.
By disposingdisplay unit 2071~2079 as mentioned above, they can recover anddisplay image content 2050 by selecting and drawing and their allocated display area is corresponding after cutting apart accordingly rendering order 2092.
Example below with reference to the operation of the flowcharttext display unit 2071 of Figure 29.
At step S2011, display unitoverhead control unit 2020 is waited for, imports from image data packets 2090 positions thatmany display servers 2063 are sent up to receiving interface 2021.If receivinginterface 2021 input image data bags 2090 are then handled and are entered step S2012.After processing enters step S2012, the coordinate data that allocated displayarea comparing unit 2032 uses in the coordinatedata field 2098 that is stored in the image data packets 2090 that is judged as input in step S2011, computation bound frame.
Allocated displayarea comparing unit 2032 is judged in step S2013: whether the coordinate of the bounding box that is calculated in step S2012 is overlapping with the coordinate range that is stored in the allocated display area storage unit 2031.In other words, allocated displayarea comparing unit 2032 judges whether the image data packets 2090 of input belongs to the allocated display area of himself.As judged result, if the coordinate of the bounding box that is calculated in step S2012 is not overlapping with the coordinate range that is stored in the allocated displayarea storage unit 2031, and the image data packets 2090 of input does not belong to the allocated display area of himself, then handles entering step S2019 (back explanation).On the other hand, if the coordinate of the bounding box that is calculated in step S2012 is overlapping with the coordinate range that is stored in the allocated displayarea storage unit 2031, and the image data packets 2090 of input belongs to the allocated display area of himself, then handles entering step S2014.
After processing entered step S2014,2032 indications of allocated display area comparing unit were taken outcontrol module 2033 and are taken out image data packets 2090.In response to this instruction, take outcontrol module 2033 and take out the image data packets 2090 that in step S2011, is judged as input.
At step S2015, taking outcontrol module 2033 will be stored in thememory buffer 2023 in the image data packets 2090 that step S2014 is taken out temporarily.
Then, display unitoverhead control unit 2020 judges in step S2016 whether take outcontrol module 2033 has taken out all images packet 2090 of the allocated display area that belongs to himself.As judged result, does not take out all images packet 2090 of the allocated display area that belongs to himself yet if take outcontrol module 2033, then handle turning back to step S2011 and wait for, till importing next image data packets 2090.
On the other hand, taken out all images packet 2090 of the allocated display area that belongs to himself, then handled entering step S2017 if take out control module 2033.Renderer 2115 is according to being stored in the modification parameter of revising in theparameter storage unit 2116, based on the rendering order 2092 after included cutting apart in the image data packets 2090 that is stored in step S2015 in thememory buffer 2023, carries out and draws.Like this, generate display image data.As mentioned above, when the part of drawing except that the allocated display area of eachdisplay unit 2071~2079,renderer 2115 abandons the part except that the allocated display area of himself.
At step S2018,indicative control unit 2026 is presented at the display image data that is generated among the step S2017 ondisplay panel 2028 under the control of the Displaying timer ofsynchronous control unit 2027.
If be judged as in step S2013: the coordinate of the bounding box that is calculated in step S2012 is not overlapping with the coordinate range that is stored in the allocated displayarea storage unit 2031, and the image data packets 2090 of input does not belong to the allocated display area of himself, then handles entering step S2019.After processing entered step S2019, allocated displayarea comparing unit 2032 was discarded in the image data packets 2090 that is judged as input among the step S2011 and does not accept (reception).
In the present embodiment,many display servers 2063 are divided into a plurality of rendering orders according to its size of data with rendering order, for these rendering orders after cutting apart generate image data packets 2090, and this bag are sent to displayunit 2071~2079.Many display servers 2063 will be represented to be stored in the image data packets 2090 separately by the coordinate data of the indicated position with the object drawn of the rendering order after cutting apart in the picture material.Only when coordinate data included in the image data packets 2090 was included in himself the coordinate range of allocated display area of expression, eachdisplay unit 2071~2079 was accepted (reception) image data packets 2090.The rendering order of eachdisplay unit 2071~2079 after according to included cutting apart in the receive image data packets 2090 of (acceptance) drawn, and shows and himself the image of thecorresponding picture material 2050 of allocated display area.
As mentioned above, according to present embodiment, eachdisplay unit 2071~2079 selection belongs to the rendering order 2092 of the allocated display area of himself, and carries out and draw.Therefore, needn't carry out any processing of the layout of consideringdisplay unit 2071~2079 etc. asmany display servers 2063 of dispensing device.And eachdisplay unit 2071~2079 needn't be sheared the image of the allocated display area of himself from the entire image content, does not need to receive the high capacity rendering order.As a result, can realize large screen display by than legacy system hardware resource still less.Because dispensing device does not need to put in order the destination of rendering order, thereby can easily change the layout (quantity and layout etc.) ofdisplay unit 2071~2079.
In the described example of present embodiment, thecommunication path 2064 that interconnectsdisplay unit 2071~2079 includes spider lines.Alternatively,communication path 2064 can interconnectdisplay unit 2071~2079 with bus form.In addition,communication path 2064 can adopt any transmission system.And as long as can guarantee the bandwidth that display image content is essential,communication path 2064 can comprise wireless communications path.
In the described example of present embodiment,display unit 2071~2079 has been carried out physical coupling.Yet, be not to carry out physical coupling to displayunit 2071~2079.Display unit 2071~2079 can be assemblied in the adjacent position, and can be via the wireless communication transmissions data.
And, in the present embodiment,many display server 2063 inner rendering orders that generate.Alternatively, rendering order can be inputed tomany display servers 2063 from external unit.When from external unit input rendering order,many display servers 2063 can convert the rendering order of input indisplay unit 2071~2079 manageable rendering order.
The 8th embodiment
Below describe the eighth embodiment of the present invention in detail.
In the 7th embodiment, such a case has been described: will be presented at according to thepicture material 2050 that rendering order is drawn ondisplay screen 2051~2059 formed whole screens bydisplay unit 2071~2079.By contrast, present embodiment explanation such a case:picture material 2050 is presented on some in thedisplay screen 2051~2059 ofdisplay unit 2071~2079.More specifically, in the present embodiment, the layout ofmany display server 2063 specify image contents.Eachdisplay unit 2071~2079 uses specified layout to calculate the allocated display area of himself, and judges whether image data packets 2090 belongs to the allocated display area that is calculated.Like this, in the present embodiment, be different from the 7th embodiment in order to some step of the required software processes of display image content.Therefore, same reference numerals is represented identical assembly and the processing in Figure 24~29 with the 7th embodiment, and does not repeat detailed description thereof.
The demonstration example of multidisplay system (Figure 30 A~30C)
Figure 30 A~30C illustrates the demonstration example in the multidisplay system 2061 (display unit 2071~2079).In the present embodiment, based on user instruction, with image content layout be presented at by the specified position ofmany display server 2063.
Figure 30 A illustrates the example of picture material.As Figure 25 A,picture material 2050 is made of rectangular object and triangle object.
Figure 30 B illustrates the topology example of picture material 2050.Figure 30 B illustration such a case: will be near the lower right corner ofdisplay screen 2100 withproperties window 2101 layouts of scale downdisplay image content 2050.
Figure 30 C is illustrated in the demonstration example when usingdisplay unit 2071~2079 display image content 2050.Display screen 2051~2059 is respectively the display screen ofdisplay unit 2071~2079.As among the 7th embodiment, in Figure 30 C,, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row) by thedisplay screen 2051~2059 that makes up 9display units 2071~2079.Eachdisplay unit 2071~2079 shows a part oforiginal image content 2050 according to the allocated display area of himself.In this case, the allocated display area ofdisplay unit 2071~2079 is according to being changed bymany display server 2063 specified layouts.For example, in Figure 30 C, only the upper left ofproperties window 2101 is allocated display area of display unit 2071.Like this, by thedisplay screen 2051~2059 ofcombination display unit 2071~2079 shown in Figure 30 C, and come layout anddisplay image content 2050, thereby show wholeoriginal image content 2050 according to layout.
The internal placement of many display servers and operation (Figure 31 A)
Figure 31 A and 31B are the block diagrams of example that the detailed arrangement ofmultidisplay system 2061 is shown.The layout ofmany display servers 2063 is described below with reference to Figure 31 A.
Manyindicative control units 2001 of controllingwhole multidisplay system 2061 also compriselayout control module 2110 except that the serveroverhead control unit 2002 shown in Figure 27 A.2110 inputs of layout control module and storage are from the layout command information (layout order) of user's's (for example, external client's terminal or content server) picture material.Layout control module 2110 usestransmission interface 2007 that the layout command information is sent to displayunit 2071~2079.The layout command information of picture material comprises for example position coordinates in the zone of laying out images content.In this case,layout control module 2110 can will be presented at the top-left coordinates (Xmix of the scale down image of theproperties window 2101 on thedisplay screen 2100 shown in Figure 30 B and the 30C, Ymix) and the bottom right coordinate (Xmax Ymax) is set to the layout command information of picture material.In addition,layout control module 2110 can be presented at the top-left coordinates of theproperties window 2101 on thedisplay screen 2100 among Figure 30 B and the 30C and the layout command information that size is set to picture material.
When in rotation or distortion back laying outimages content 2050,layout control module 2110 will be realized such rotation or be out of shape essential parameter sending to displayunit 2071~2079, as the layout command information of picture material.Whenimage rotating content 2050, for example,layout control module 2110 can the anglec of rotation be set to the layout command information of picture material.Whendeformation pattern content 2050, for example,layout control module 2110 can be the layout command information ofpicture material 2050 with the arranged in matrix of vertical and horizontal scale down or affined transformation.
For the operation ofmany display servers 2063, in process flow diagram shown in Figure 28,layout control module 2110 is (for example, before the processing of step S2001) before the processing of step S2006, the layout command information of input and memory image content.Layout control module 2110 (for example, before the step S2001) before the processing of step S2006 then sends to displayunit 2071~2079 with the layout command information of the picture material of being stored.The example of other operation ofmany display servers 2063 is with shown in Figure 28 identical, and avoids the repeat specification to it.
In the following description, as required, the command information of the layout of picture material is called the layout command information.
The internal placement of display unit and operation (Figure 31 B)
The layout of eachdisplay unit 2071~2079 is described below with reference to Figure 31 B.Notice thatdisplay unit 2071~2079 has same structure.Therefore, the layout ofdisplay unit 2071 only is described, and does not provide the explanation of the layout of all theother display units 2072~2079.
With reference to figure 31B,display unit 2071 calculates the coordinate range of the rendering order of the allocated display area that is used as himself based on the layout command information that is sent from many display servers 2063.Thereafter,display unit 2071 judges whether the coordinate data the coordinatedata field 2098 that is stored in the image data packets 2090 that is sent frommany display servers 2063 is overlapping with the coordinate range that is calculated.Based on this judged result,display unit 2071 is only accepted the image data packets 2090 that (reception) may belong to the allocated display area ofhimself.Display unit 2071 is then according to the rendering order 2092 that is included in after cutting apart in the image data packets of being accepted 2090, recovers and shows a part of picture material by carrying out to draw.
Display unitoverhead control unit 2020 newly compriseslayout storage unit 2111 and allocated displayarea computing unit 2112.
Layout storage unit 2111 is stored the layout command information that is sent from thelayout control module 2110 of many display servers 2063.Allocated displayarea computing unit 2112 is based on the layout command information that is stored in thelayout storage unit 2111, calculate the coordinate range of the allocated display area of representing himself, and the coordinate range that is calculated is stored in the allocated display area storage unit 2031.Like this, by proofread and correct the allocated display area in the allocated displayarea storage unit 2031 that is stored in the 7th embodiment according to the content of layout command information, obtain the allocated display area that is calculated by allocated displayarea computing unit 2112.
Bag receiving element 2022 uses himself the coordinate range of allocated display area of expression to judge whether the image data packets 2090 that is sent frommany display servers 2063 may belong to the allocated display area of himself.As among the 7th embodiment, use bounding box to carry out this judgment processing.More specifically, allocated displayarea comparing unit 2032 uses the coordinate data the coordinatedata field 2098 that is stored in the image data packets 2090 that is sent frommany display servers 2063, computation bound frame.Allocated displayarea comparing unit 2032 judges that whether the coordinate of the bounding box that is calculated is with overlapping by allocated displayarea computing unit 2112 coordinate ranges that calculated and that be stored in the allocated displayarea storage unit 2031.
If the coordinate of bounding box is overlapping with the coordinate range that is stored in the allocated displayarea storage unit 2031, and may belong to himself allocated display area from the image data packets 2090 thatmany display servers 2063 are sent, then accept image data packets 2090.On the other hand, if the coordinate of bounding box is not overlapping with the coordinate range that is stored in the allocated displayarea storage unit 2031, and can not belong to himself allocated display area from the image data packets 2090 thatmany display servers 2063 are sent, then abandon image data packets 2090.
The image data packets 2090 thatmemory buffer 2023 interim storages are received by bag receiving element 2022.Packet analysis unit 2024 extracts rendering order (rendering order 2092) from image data packets 2090.Packet analysis unit 2024 is put the processing of rendering order in order according to the information in the packet header 2091.
Renderer 2115 generates display image data according to included rendering order 2092 in each image data packets 2090 of being received ofbag receiving element 2022 by carrying out to draw.Notice that renderer 2115 bases are stored in the modification parameter of revising in theparameter storage unit 2116, amplify/dwindle carrying out with the corresponding figure with drafting of the allocated display area of himself/translation etc.Display unitoverhead control unit 2020 allocated display area according to himself are provided with these and revise parameter.Especially in the present embodiment, will be stored in and revise in theparameter storage unit 2116 based on the modification parameter of the content that is stored in the layout command information reflection layout in thelayout storage unit 2111.
Indicative control unit 2026 outputs to displaypanel 2028 with synchronous from the synchronizing signal ofsynchronous control unit 2027 outputs with display image data.Like this, come layout and show the image of drawing according to rendering order based on the layout command information.
For the operation ofdisplay unit 2071~2079, in the process flow diagram shown in Figure 29,layout storage unit 2111 is stored the layout command information that is sent frommany display servers 2063 before step S2013.And, allocated displayarea computing unit 2112 calculates the coordinate range of the allocated display area of representing himself based on the layout command information that is stored in thelayout storage unit 2111, and before step S2013 result of calculation is stored in the allocated display area storage unit 2031.Allocated displayarea comparing unit 2032 is judged in step S2013: whether the coordinate of the bounding box that is calculated in step S2012 is overlapping with the coordinate range that is calculated by allocated displayarea computing unit 2112.
In step S2017,renderer 2115 is according to being stored in the modification parameter of revising in theparameter storage unit 2116, based on comprised in the image data packets 2090 that is stored in thememory buffer 2023 cut apart after rendering order 2092, carry out and draw.In the present embodiment, owing to the modification parameter is set based on the layout information that is stored in thelayout storage unit 2111, thereby draw to have the layout based on the layout command information.
Other operation ofdisplay unit 2071~2079 identical with shown in Figure 29, and avoid repeat specification to it.
By disposingdisplay unit 2071~2079 as mentioned above, eachdisplay unit 2071~2079 can only accept to be positioned at the image data packets 2090 of allocated display area according to specified layout, and can recover and display image content according to specified layout.
In the present embodiment,many display servers 2063 generate the layout command information of the layout of indicating image content, and the information that is generated is sent to displayunit 2071~2079.Eachdisplay unit 2071~2079 calculates the coordinate range of expression allocated display area based on the layout command information.Only the bounding box of included coordinate data is with the coordinate data that is calculated when overlapping in based on image data packets 2090, and eachdisplay unit 2071~2079 is accepted (reception) interested image data packets 2090.Eachdisplay unit 2071~2090 according to accept rendering order included in the image data packets 2090 of (reception) and the layout command information is drawn.As a result, display unit shows the corresponding image of allocated display area with picture material with the layout based on the layout command information.
Therefore, except that the effect described in the 7th embodiment, the layout in the time of can freely display image content being set.
In the described in the present embodiment example, show a picture material 2050.Alternatively, can show a plurality of picture materials simultaneously.
Present embodiment can also adopt the various modifications described in the 7th embodiment.
The 9th embodiment
Below describe the ninth embodiment of the present invention in detail.The 8th embodiment illustration such situation:display unit 2071~2079 is according to the layout command information that is sent frommany display servers 2063, the picture material after the display layout.By contrast, the situation that the present embodiment illustration is such: also the layout command information is packed, and will comprise that the bag of layout command information sends to displayunit 2071~2079 frommany display servers 2063.
Note the payload storage layout order of the layout order bag that the layout command information is packed.The packet header of layout order bag comprises the field of the regional extent that expression is applied to the layout order.
Eachdisplay unit 2071~2079 checks whether the zone that will be applied to from the layout order bag thatmany display servers 2063 are sent is included in the allocated display area of himself.Eachdisplay unit 2071~2079 is only accepted the layout order bag that (reception) will be applied to the allocated display area of himself, and based on the layout order packet layout picture material of being accepted.
As mentioned above, in the present embodiment, some step of the software processes that the laying out images content is essential is different from the 7th and the 8th embodiment substantially.Therefore, same reference numerals is represented identical assembly and the processing in Figure 24~31 with the 7th and the 8th embodiment, and does not repeat detailed description thereof.
The demonstration example of multidisplay system (Figure 32 A~32D)
Figure 32 A~32D illustrates the demonstration example in the multidisplay system 2061 (display unit 2071~2079).In the present embodiment, in specified location layout and a plurality of picture materials of demonstration.
Figure 32 A and 32B illustrate the example of picture material.The same at Figure 25 A and 30A, by thepicture material 2050 shown in rectangular object and the triangle object pie graph 32A, andpicture material 2050 has file name " triangle_and_rectangle.mpg ".On the other hand, by thepicture material 2120 shown in the circular object pie graph 32B, and has file name " circle.mpg ".
Figure 32 C illustrates the topology example ofpicture material 2050 and 2120.The situation that Figure 32 C illustration is such:display image content 2050 and 2120properties window 2122 and 2123 are presented on thedisplay screen 2121 respectively with scale down.
Figure 32 D is illustrated in the demonstration example that usesdisplay unit 2071~2079 to comedisplay image content 2050 and at 2120 o'clock.Display screen 205l~2059 are respectively the display screens ofdisplay unit 2071~2079.As the 7th with the 8th embodiment in the same, in Figure 32 D, by making up 9display units 2071~2079, constitute the single display screen of 3 * 3 matrixes (3 row * 3 row).
In this case, the allocated display area ofdisplay unit 2071~2079 is according to being changed bymany display server 2063 specified layouts.For example, in Figure 32 D, only the upper left ofproperties window 2122 is the allocated display area ofdisplay unit 2071.
The structure of many demonstration bags (Figure 33 A~33E)
Figure 33 A~33E illustrates the example of structure that show bag more.Structure below with reference to employed bag in Figure 33 A~transmission of 33E explanation in multidisplay system 2061.Constitute many demonstrations bag of present embodiment by two types bags, that is, and image data packets and layout order bag.Thepayload 2132 storage layouts order of layout order bag.Thepacket header 2131 of this bag comprises that expression is based on the field of layout order through the coordinate range of layout.
Figure 33 A illustrates thebags 2130 that show more.Figure 33 B is used to explain the figure that show the structure ofbag 2130 more.As shown in Figure 33 B, thebags 2130 that show havepacket header 2131 andpayload 2132more.Payload 2132stores graphing field 2095 intodata bitmap field 2099, as rendering order orlayout order 2136.
Figure 33 C illustrates the example of the header structure of image data packets.The content of bag identifying information field is different from the image data packets 2090 described in the 7th and the 8th embodiment.With reference to figure 33C, whether 2133 storages of bag identifying information field are show to wrap essential id information and version information etc. in order to discern interested bag more.And it is image data packets or the essential id information of layout order bag that bag identifyinginformation field 2133 is also stored in order to discern interested bag.Because Figure 33 C illustrates the header structure of image data packets, thereby 2133 storages of the bag identifying information field shown in Figure 33 C are used to discern the id information that interested bag is an image data packets.
Figure 33 D illustrates the example of the header structure of layout order bag.Bag identifyinginformation field 2133 storages shown in Figure 33 D are used to discern the id information that interested bag is a layout order bag.
The various timestamps of the processing start time ofsynchrodata field 2134 storage representation rendering orders and processing concluding time equal time information.
Figure 33 E illustrates the example of structure of coordinate range field 2135.Shown in Figure 33 E, constitute coordinate range field 2135:Xmin coordinatefields 2138, Ymin coordinatefields 2139, Xmax coordinatefields 2140 and Ymax coordinatefields 2141 by four fields, they store corresponding coordinate respectively.In the present embodiment, layout order bag is divided into the first layout order bag and the second layout order bag that comprises the layout order ofproperties window 2123 of the layout order that comprisesproperties window 2122.
Therefore, the minimum value on the X-direction of the Xmin coordinatefields 2138memory contents windows 2122 of the first layout order bag, and the minimum value on the Y direction of Ymin coordinatefields 2139 memory contents windows 2122.In addition, the maximal value on the X-direction of the Xmax coordinatefields 2140memory contents windows 2122 of the first layout order bag, and the maximal value on the Y direction of Ymax coordinatefields 2141memory contents windows 2122.
Equally, the minimum value on the X-direction of the Xmin coordinatefields 2138memory contents windows 2123 of the second layout order bag, and the minimum value on the Y direction of Ymin coordinatefields 2139 memory contents windows 2123.In addition, the maximal value on the X-direction of the Xmax coordinatefields 2140memory contents windows 2123 of the second layout order bag, and the maximal value on the Y direction of Ymax coordinatefields 2141memory contents windows 2123.
By constituting layout order bag as mentioned above, eachdisplay unit 2071~2079 is by reference coordinaterange field 2135 only, just can judge that layout order bag is whether corresponding to himself allocated display area.That is to say that eachdisplay unit 2071~2079 only needs to receive the layout order bag of allocated display area, and carry out layout processing.
The internal placement of many display servers and operation (Figure 34 A)
Figure 34 A and 34B are the block diagrams of example that the detailed arrangement ofmultidisplay system 2061 is shown.The layout ofmany display servers 2063 is described below with reference to Figure 34 A.
With reference to figure 34A, 2063 pairs of layout command informations of many display servers (layout order) are packed and are sent.In the present embodiment, the operation oflayout control module 2150 andbag generation unit 2151 is different from the 8th embodiment.Layout control module 2150 outputs tobag generation unit 2151 with the layout order.
Bag generation unit 2151 generates themany demonstrations bag 2130 with structure shown in Figure 33 A~33E.Bag generation unit 2151 generates image data packets under the picture material data conditions, and generates layout order bag under the situation of layout order.Configurationpacket transmitting element 2006 is with a plurality of picture materials of parallel processing.In this case, each picture material of divisional processing duringbag transmitting element 2006 perhaps can be assembled a plurality ofbag transmitting elements 2006 to carry out parallel processing.
To send to displayunit 2071~2079 o'clock frommany demonstrations bag 2130 ofmany display servers 2063,bag generation unit 2151 at first generates themany demonstrations bag 2130 that is associated with the layout order, and they are sent to displayunit 2071~2079.Thereafter, after having carried out layout be provided with indisplay unit 2071~2079,bag generation unit 2151 begins to send themany demonstrations bag 2130 that is associated with picture material.
For the operation ofmany display servers 2063, before the processing of the step S2006 in process flow diagram shown in Figure 28 (for example, before the processing of step S2001), the processing below carrying out.The layout order oflayout control module 2150 Input Image Content.Many demonstrations bag 2130 that 2151 pairs of layout orders of bag generation unit are packed and are associated with the layout order to generate.Many demonstrations bag 2130 thattransmission interface 2007 will be associated with the layout order then sends to displayunit 2071~2079.Then, carry out the processing among the step S2001~S2006 among Figure 28, send to displayunit 2071~2079 withmany demonstrations bag 2130 that will be associated with the data of picture material.
The internal placement of display unit and operation (Figure 34 B)
The layout of eachdisplay unit 2071~2079 is described below with reference to Figure 34 B.Notice thatdisplay unit 2071~2079 has identical set.Therefore, the layout ofdisplay unit 2071 only is described, and does not provide the explanation of the layout of all theother display units 2072~2079.
With reference to figure 34B,display unit 2071 input layouts are instructed as layout order bag, and carry out the layout processing of display screen based on the layout order bag of input.When input layout order bag,display unit 2071 judges whether the target area of each layout order bag is dropped in the allocated display area of himself, and only accepts (reception) himself interior layout order bag of allocated display area.
At figure S34B, in thedisplay unit 2071 of present embodiment, the operation of allocated displayarea comparing unit 2152 andpacket analysis unit 2153 is compared different with thedisplay unit 2071 of the 8th embodiment.
Allocated displayarea comparing unit 2152 judges whether each layout order bag and image data packets belong to the allocated display area of himself.For layout order bag, allocated displayarea comparing unit 2152 judges whether the application target zone of layout order bag drops on the allocated display area of the unit of distributing to himself.That is to say described in the 7th embodiment, allocated displayarea comparing unit 2152 is judged: whether the value of the coordinaterange field 2135 in the layout order bag is overlapping with the coordinate range that is arranged in the allocated displayarea storage unit 2031.
On the other hand, allocated displayarea comparing unit 2152 is judged: whether the coordinate based on the bounding box that coordinate data calculated in the coordinatedata field 2098 that is stored in image data packets is overlapping based on the coordinate range that layout order bag calculates (correction) with allocated display area computing unit 2112.Note, can with the 7th and the 8th embodiment in the coordinate of same way as computation bound frame.
Packet analysis unit 2153 extracts the data that showbag 2130 from bufferingstorer 2023 more.Packet analysis unit 2153 is according to the information in thepacket header 2131, shows that the processing of the data ofbag 2130 puts in order to extracting more.Ifmany demonstration bags 2130 are layout order bags, thenpacket analysis unit 2153 will show that the data ofbag 2130 output tolayout storage unit 2111 more.Layout storage unit 2111 is based on the order of layout order bag storage layout.
On the other hand, ifmany demonstration bags 2130 are image data packets, thenpacket analysis unit 2153 will show that the data ofbag 2130 output to renderer 2115 more.
Configuration renderer 2115, display unitoverhead control unit 2020 andbag receiving element 2022 are with the processing of a plurality ofproperties windows 2122 of executed in parallel and 2123.In this case,renderer 2115, display unitoverhead control unit 2020 andbag receiving element 2022 can time-divisioncontents processing windows 2122 and 2123.And, can assemble a plurality ofrenderers 2115, display unitoverhead control unit 2020 andbag receiving element 2022 to carry out parallel processing.
Utilize above-mentioned layout, eachdisplay unit 2071~2079 only receives the interior layout order bag of allocated display area of himself, and can be based on layout order packet layout that is received anddisplay image content 2050.
For the operation ofdisplay unit 2071~2079, input layout order bag before the step S2034 of receivinginterface 2021 in process flow diagram shown in Figure 29.Allocated displayarea comparing unit 2152 judges whether the application target zone of the layout order bag of each input is included in the allocated display area of himself.By relatively being stored in the value and the coordinate range that is stored in the allocated displayarea storage unit 2031 in the coordinaterange field 2135 in the layout order bag, realize this judgment processing.
Take outcontrol module 2033 and only accept the layout order bag that (reception) will be applied to the allocated display area of himself, and abandon other layout order bag.Thereafter, the layout order bag of (reception) is accepted inpacket analysis unit 2153 analyses, and based on analysis result layout command information (layout order) is stored in the layout storage unit 2111.And allocated displayarea computing unit 2112 calculates the allocated display area of himself based on the layout order that is stored in thelayout storage unit 2111, and rewrites the coordinate range that is stored in the allocated displayarea storage unit 2031.
Allocated displayarea comparing unit 2032 judges that in step S2013 the coordinate of the bounding box that is calculated is whether overlapping with the coordinate range that allocated displayarea computing unit 2112 is calculated in step S2012.
At step S2017,renderer 2115 is according to being stored in the modification parameter of revising in theparameter storage unit 2116, based on the rendering order 2092 that is stored in after cutting apart in thememory buffer 2023, carries out and draws.In the present embodiment, owing to the modification parameter is set based on the layout information that is stored in thelayout storage unit 2111, thereby carry out and draw to have the layout based on the layout command information.
Other operation ofdisplay unit 2071~2079 is with shown in Figure 29 identical, and avoids the repeat specification to it.
In the present embodiment, the layout order bag thatmany display servers 2063 generate packing in order to the required layout command information of the layout of indicating image content (layout order), and the bag that is generated sent todisplay unit 2071~2079.Eachdisplay unit 2071~2079 calculates the coordinate range of expression allocated display area based on layout order bag.Only when based on bounding box that is included in the coordinate data in the image data packets 2090 and the coordinate data that calculates when overlapping, eachdisplay unit 2071~2079 is accepted (reception) interested image data packets 2090.Eachdisplay unit 2071~2079 is carried out drafting according to accept rendering order included in the image data packets 2090 of (reception) and layout command information.As a result, display unit shows the corresponding image of allocated display area with picture material with the layout based on the layout order.
As mentioned above, owing to use the packet communication of same communication scheme to send picture material data and layout order, thereby can handle picture material data and layout order by identical bag disposal system.Therefore, except that the described effect of the 8th embodiment, can simplify interface.
In the present embodiment, generate layout order bag for each content segmentation.Yet, can be under ameristic situation to layout order pack.In this case, eachdisplay unit 2071~2079 can be accepted (reception) all layout order bags, and only extracts and handle and the corresponding order of the allocated display area of himself.
In addition, each image data packets can comprise the layout order.For example, can in other id field (not shown) of image data packets, the layout order be described.Like this, when with many demonstrations packet delay that the layout order is associated, can prevent the acceptance failure of image data packets.
Present embodiment can also adopt the various modifications described in the 7th and the 8th embodiment.
Other embodiments of the invention
Equipment or the computing machine in the system that the program code of software that can the function that realize the foregoing description is required is applied to be connected with various devices install to move these, thereby realize the function of the foregoing description.Scope of the present invention comprises the invention of being put into practice by according to this class device of program run in the computing machine (or CPU or MPU) that is stored in this system or equipment.
In this case, the program code of software itself is realized the function of the foregoing description.Program code itself provides the parts (for example, storing the recording medium of this program code) of this program code to constitute the present invention with being used for to computing machine.As the recording medium that is used to store this program code, for example, can use floppy disk, hard disk, CD, magneto-optic disk, CD-ROM, tape, Nonvolatile memory card and ROM etc.
The present invention is not limited to the situation that realizes the function of the foregoing description when computing machine is provided by the program code that is provided.For example, can and operate in operating system on this computing machine or the cooperation of additional application program, realize the function of the foregoing description by this program code.In this case, program code is included in the embodiments of the invention.
And, the program code that is provided can be stored in the storer on the expansion board that is assemblied in the computing machine that is connected with this computing machine, be assemblied in CPU on this expansion board etc. then and carry out some or all actual treatment based on the instruction of this program code.Be included among the present invention equally by these situations of handling the function that realizes the foregoing description.
And, the program code that is provided can be stored in the storer that is assembled on the functional expansion unit that computing machine connected that is connected with this computing machine, CPU that is assembled on this functional expansion unit etc. carries out some or all actual treatment based on the instruction of this program code then.Be included among the present invention equally by these situations of handling the function that realizes the foregoing description.
Notice that the foregoing description only represents to put into practice the practical example when of the present invention, should not limit to based on these embodiment and explain technical scope of the present invention.That is to say, under the situation that does not break away from technical scope of the present invention or principal character, can put into practice the present invention with various patterns.
Although the present invention has been described, should be appreciated that the present invention is not limited to disclosed exemplary embodiments with reference to exemplary embodiments.The scope of following claims meets the wideest explanation, to comprise all this class modification and equivalent structure and functions.