CN1394441A - Method and system for active modification of video content responsively to processes and data embedded in video stream - Google Patents

Abstract

Video, or other media data, are synchronized with procedure data streams that modify the video stream. When the video is played, reproduced, or rebroadcast, the video is modified by the procedures defined in the procedure data stream. In a stateless embodiment, the procedure stream includes commands that are executed immediately upon receipt by an interpreter. In a particular embodiment, the procedure data stream is incorporated directly in the media data stream and separated out by a demultiplexer. In a still more particular embodiment, the combined media/procedure data stream may be fractured into portions while still carrying code appropriate to the portion removed from the whole.

Description

Initiatively revise method and system corresponding to the video content of the data of handling and embed video data stream

Background of invention

Invention field

The present invention relates to dynamically revise the video system of its video content, relate in particular to the handling procedure that wherein control revises and be embedded in this frequency data stream or the system synchronous with this video data stream according to the condition of transmitting website, user's selection or other condition etc.

Technical background

The other parts that some part of picture material may be considered to adopt then may be considered to acceptable.This will enlighten people's suggestion mark will be combined in the video data, be the parts that can not adopt so that indication may be considered to for some spectators.Run on the mark in this video data stream of an application identification of this transmission position and respond this mark selectively and quiet or delete some fragment.For example, the PCT application WO98/21891 that on May 22nd, 1998 disclosed being entitled as " shows according to the content blocking TV programme " has described being labeled as the technology that part is eliminated that defines of a video data stream comprising the subject matter that can not adopt.

The application GB2284 914 that is entitled as " can freely select watch control " that submitted on December 18th, 1993 has described a system, send the condition of site definition according to this, based on the grade of one day the moment, program identification, program etc. and setting limits for TV programme.Equally, the result then deletes when some situation occurring or forbids this picture signal.

The application WO83/02208 of on June 12 nineteen eighty-three disclosed being entitled as " method and the device of the output of a television set of editor ", described a system, it is according to mark in this image and run on the application program of a television set top box and the filtering content.Be inserted in mark in this signal by according to this content classification.The Britain application GB2315175 that is entitled as " restriction to image document inserts " that on July 10th, 1997 submitted to has described a system, wherein allows to send or its picture material of regenerating according to the qualitative of content.Transmission and record or watch between link predetermined the filtering application program arranged.

The United States Patent (USP) 5,751,335 that is entitled as " watch method for limiting and watch restraint device " that on February 23rd, 1996 submitted to has been described a system, if wherein TV programme exceeds the level identification of a permission, and then quiet this TV programme.

The United States Patent (USP) 5,778,135 that is entitled as " the real-time edition control of video program material " has been described a system, and image is wherein done grade separation by segmentation and each section.An application program editor deletes its grade and exceeds those segmentations of selecting grade.This comes down to have used and the identical technology of PCT application WO96/41438 that is entitled as " encoder apparatus and the decoder device that are used for TV signal ".

Responding the content indicator in this video data stream and deleting video content is technique known.In the prior art system, just by forbidding that with the interval that limits the demonstration of this image blocks the part of image.And, the application program of carrying out this blocking-up be scheduled to and respond mark in this video data stream implement (i.e. " private code "-note in standard and prior art should " sign indicating number " can expressive notation or designator, still should make it to distinguish mutually according to content with " sign indicating number " that be used to relate to program or processing).And, there is the software of computer game and other kind, according to playback of image sequences from execution route of the reciprocation generation of user and software and selectively.For example, according to the selection that the user makes, in the implementation of a recreation, can play the image sequence of some selections.

Need a kind of mechanism, make the creator of picture material be controlled to a greater extent on the feature of the selection demonstration that relates to video content.Present technology is restricted to this control the complexity that is provided at an intermediate controlled or delivery sites.

Summary of the present invention

The various technology that are used to allow the real time modifying of video data stream are arranged.According to the present invention, this alter mode of realization has increased at last can getable modification scope.Also on the feature that receiving terminal provides, increased the control that video data stream creator has spreading all over.These advantages are by each video data stream or file is relevant with one or more software programs provides, software program by display or for example duplication station (for example storage sites, precedingly see off, recording station, broadcasting station etc.) other generator carry out.This generator promptly receives this original video data stream and receives the sign indicating number that defines the one or more programs that will carry out again, for example revises this video data stream in some aspects.For example, this generator is a television receiver in one embodiment.According to present embodiment, this television reception has embedded the vision signal of procedure code.This television receiver has an internal controller, separates this software data and original video data, and carries out this software data, can revise this video data immediately.For example, this software data can be included in the picture blanking phase (" VBI ") of analog video signal, or only was included in the heading file that appends to this image file.Internal controller can be utilized application programming interfaces (" API ") programming in the present embodiment, and one group of function that it provides program to insert is so that produce various effects.This program can be the system or the Java  enhanced system of Java  type.This software data defines the program of an execution, to revise this video data.This program can keying time or segmentation markers in the video data so that some part of this video data that allows this program to identify will to revise.

API can provide the setting of feature more or less.And can write with high-level or low level.For example, this API can provide a kind of function, only in some time intervals of image, draws on the regulation zone of display and for example specifies a colored planar rectangular or a target of classification ellipse.This function start-stop time of coordinate, size and dimension, colour and the segmentation of this target according to the rules produces independent variable.Another example is the regulation screening of an application program do to(for) the part of screen.This screening mask can be used as an argument and provides.

By provide can be in a large amount of distinct methods a large amount of function setting or the basic function setting of access and execution, the invention enables the video content generator to be provided for distributing many features and the option that uses with picture material.The result is that available feature is not limited to and resembles delivery apparatus predetermined in the prior art or some setting of output equipment (for example television receiver).The setting that is noted that extensive setting that characteristic functions is more comprehensive or basic function can provide the flexibility of identical degree.Not only can provide the extensive setting of composite characteristic function but also the setting of basic function can be provided.

Put it briefly, it is related with image itself to the invention provides the executable program that is used for revising this video data.This association can realize by the program that is provided for handling this image with image on display processing device with showing actual synchronization, and this display processing device finally is transformed into video data stream to multiplexed or compression or encoded signals.This procedure code is packaged in the same or relevant file can provide this association.Other embodiment can be by setting up this association in the video data stream that this yard is embedded in analog or digital with interlace mode.

Be noted that use " program " and " sign indicating number " and other term are represented to handle or the definition of potential processing, broadly comprise the definition of explanation and the definition on the program.Therefore, do not plan to limit the invention to algorithm with this word.The present invention comprises language, object oriented language of event-driven type etc.

Utilization is at the processing procedure of each image definition, and the possibility of the scope of possible modification, situation, rule, criterion and all selections obviously is greatly to the degree of an exhaustive list can't be provided.This is a very big advantage.And in this demonstration of exploitation (record, broadcasting etc.) device, needn't know these possibilities.Therefore, picture material can have the upgrading of feature and provides along with image.Realization does not require the software change in this demonstration (or other) device for the enhancing of content, though improved number and type are continuous.Be the several examples that are used for illustration purpose below.

Image can send along with the multilingual circuit, selects a kind of language according to the user profiles of handling procedure access.

This handling procedure uses the password of profile data and user's input to decipher this image.

In the process of film scene, this program is added to some part of a frame to the blurring filter, so that shield positive exposed part.

This handling procedure provides a control desk, allows the user to select and the demonstration of accelerogram picture according to the user who imports on the control desk that produces at this handling procedure.

This handling procedure provides a low-resolution image and receives the data of indication payment authorization, realizes the demonstration of full resolution image with its payment authorization.

This handling procedure is discerned some part of this vision signal according to pattern recognition, and these parts comprise checked content, and omits those parts by frame-skipping, so that realize very fast playback speed.

This handling procedure omits the sound track part, for example the track part of the unnecessary sound of expression of being indicated by mark in this vision signal.

The for example a kind of handling procedure of technology that sends a kind of previous the unknown along with image is with certain ad hoc fashion response user's profile or to some selection of user.

This handling procedure provides one to be superimposed upon the text on the image or to be provided at flash (Flash ) animation above the image.

This handling procedure is searched commercial break from a website and is separated by with certain hour this image process and shows this commercial break.

This handling procedure further reduces the number and the duration of commercial break, by a media that is used to pay advertising programme is provided for the user, by accepting a payment so that watch this image, be similar to shareware, show that a Banner is till it is deposited.

This handling procedure control regeneration power is controlled by a profile on this machine so that the various permissions that allow to be exercised by the user are franchise.

The common feature of all above-mentioned examples is that a program relevant with this document provides this feature of enjoying, and do not require that these features are present in demonstration or regenerating unit, or can obtain alternatively showing or regenerating unit.The invention enables demonstration or other use of the creator of image or retail trader with big flexibility control chart picture.

In one embodiment, this handling procedure comprises the operational order for the removable part of this video data stream.Execution environment is stateless, makes that any a limited number of this part will always be duplicated with the handling procedure that may be used on this part.Therefore, but on the portions of crossing over this media data stream, will there be unalterable information (" unalterable " is the new connotation of " realizing adhering to "), unless find that not this information just self produces the ability of this information if the handling procedure that should add has.For guaranteeing that these separable parts self do not cut apart, the environment that duplicates that is used to realize the various piece of this program must be considered the inseparability of these parts.A kind of method of guaranteeing this inseparability is not in violation of rules and regulations, to each impartible partial data block encoding, makes this data block can not read under the condition of its each bit not having.Example that can not partitioning portion is an image segmentation, and the wherein mode filtering of the part of video image to determine for example shields the part of a bare scene.A handling procedure can be performed so that open the application program of this shielding and many frames, and a handling procedure can be performed the generation of turn-offing this shielding.Necessarily can not be cut apart at the image section that switches on and off between the instruction, gone code in order to avoid before responsive subject matter, be not activated this.

Carry out an optional mode of the present invention and be each frame of guaranteeing image and all comprise its oneself state-generation handling procedure sign indicating number.This environment also will be stateless.Therefore, the frame of the arbitrary number that is replicated all will comprise suitable sign indicating number, so that correct attribute is applied to this frame.In above-mentioned example, be used to the occasion of a part of each frame of a sequence at filter, the definition of using the instruction of this filter and filter will be before each frame.In the present embodiment, between the frame be stateless environment.Present embodiment can be used by a broadcast module.Except handling procedure, can utilize this handling procedure digital coding about the information of this image.For example, title, author, description etc. can be bonded in the image information, make any image sequence that duplicates can comprise the overall information about the image file that produces image segmentation.This data needn't still can be distributed on multiframe at each frame storage.

With reference to accompanying drawing subsequently, can understand the present invention in more detail in conjunction with the description of the most preferred embodiment of determining.With reference to the accompanying drawings, pointing out emphatically this specific displaying only is the purpose that illustrates and be used for the discussion of most preferred embodiment of the present invention, and the situation of the description that is considered to the most effective and easy understanding principle of the present invention and notion is provided.In this, do not attempt showing the description that utilizes accompanying drawing to carry out makes how those skilled in the art are obvious can realize several form of the present invention in practice than the particulars for the structure of the present invention of understanding the needed more details of basic principle of the present invention.

Brief description of the drawings

Fig. 1 explanation can be used a user environment of the present invention.

Fig. 2 illustrates one embodiment of the present of invention, wherein will be from the video data demultiplexing of an information source, extract the data of a handling procedure of definition, and decode then and carry out this program, so that respond this image of profile modification.

Fig. 3 illustrates one embodiment of the present of invention, wherein will be from the video data demultiplexing of an information source, extract the data of a handling procedure of definition, revise the file of this compression by the handling procedure that profile of response is carried out, and the compressed file of this modification of decoding.

Fig. 4 illustrates one embodiment of the present of invention, wherein will be from the video data demultiplexing of an information source, obtain the data that define a handling procedure from independent source, wherein this image file is decoded, and carries out this handling procedure so that respond this image of profile modification.

Fig. 5 is the diagrammatic representation of an image file, and the feature of the embodiment that the present invention determines is shown.

The detailed description of most preferred embodiment

With reference to figure 1, can support the example of a physical basis structure of the basic feature of the present invention to comprise copic viewing system 100, have computer 140 and various types of input and/or storage device.The latter comprises removable medium 120, Fei Lipu keypad (Philips Pronto ), programmable controller, voice recognition/excitation controller, mouse, gesture recognition controller of keyboard 112, remote controller 110, for example floppy disk, CD, storage card etc. etc.Data can be stored on the hard disk drive 135 partly.Output equipment can comprise monitor or television 130, loud speaker 131 and/or other output device.Computer 140 (the same device that computing capability is arranged arbitrarily as discussing in the invention part summary) receives data 160 and/or image 170 from an external source, and this external source can be broadcast transmitted, storage, the Internet, network, satellite transmission, switched circuit transmission or any other data source or other signals.Be noted that term " computer " is meant set-top box, an embedded system, has storage device or any digital device that can carry out herein the functional requirement of discussing of controller.Computer 140 is carried out handling procedures, can be stored on its data storage 135 or is embedded in from data 160 and/or image 170 that external source receives, or be embedded in the file that is transferred to this computer with the shape of data file.This handling procedure is revised this image with the form of compression or decompression.After the modification, this image can be stored on the VTR 133 or as a broadcast image and be sent by a transmitting set 137, or shows on TV or monitor 130.The input and output that illustrate only are examples.

In another embodiment of the present invention, data 160 can be sent by two different transmitters with image 170.And in a further embodiment, data 160 can be distributed by a plurality of transmitters, and corresponding image 170 is sent by single transmitter.In the present embodiment, image is for example propagated nationally, and data are propagated partly.This makes can provide different handling procedures with image in different zones.In the present embodiment, send the scope of transmitter of this image 170 greater than the transmitting boundary of a plurality of transmitter parts that send data 160.

Among two embodiment in front, must be concerned about the synchronous of data 160 and image 170, be used to the correct counterpart of video data stream so that guarantee the handling procedure that limits in the data.

With reference to figure 2, in an illustrative embodiment, computer 140 receives an image file from some information sources, and this information source can be the information source ofnetwork 190, data storage 195 or any other simulation and/or numerical data of computer, for example the Internet of cable, microwave, satellite or other broadcast transmitted 180, for example notebook computer 185.These information sources can also comprise an intelligent mobile phone, PDA etc.In current embodiment, the data of reception are video data streams.This video data stream that is received by demultiplexer 205 is separated into an active video processing program data flow and an original video data stream.The handling procedure data flow is added to an active data flow engine 225, and original video data stream is added to a decoder 210 (compressed video format of decoding in case of necessity).The output of decoder 210 is used to a processing procedure 215, checks the profile that is stored on this computer 140.This profile has been stored qualitative these spectators' data.If between profile and current images, mate, then respond profile data and this handler application is being handled in 225, produce the video data stream of a modification.If this profile is the modification that for example disapproves this video data stream, then export original decompressing image.It can be any one output device of multiple different receivers that this output stream is added to.For example, this output can be a broadcast transmitted 180, computer 185, TV or monitor 131 or data storage 195.Output device can also comprise a VTR shown in Fig. 1, and example shown in Figure 2 is illustrative example.

Demultiplexer can receive an analog or digital signal.An example of analog signal is the NTSC signal that comes from television broadcasting.In this case, the something in common of placing data is in VBI, and this demultiplexer can extract the data that are present among this VBI and these data are added to active data flow engine 225 from original video data stream in this case.This active data flow engine only moves this handling procedure that is added on it.This has the source traffic video processing program can comprise than being packaged in more sign indicating number among the single VBI, in this case, this active data flow engine 225 is programmed to obtain a handling procedure completely, its end can be indicated with a normal mode, for example by the indication of end-of-file mark or other delimiter, show the handling procedure that the data representation of this delimiter front will be carried out.Before the image sections that must apply arrives, can define any suitable communication protocol, so that in the memory of this computer, accumulate a handling procedure.If this video data file is a digital document, then these handling procedure data can be packed as a title or staggered with data file or any other suitable mode.If data flow, then this handling procedure can send or send along with image is buffered with parcel with a heading file, make it possible to begin immediately to reset and do not wait for packing into of entire process program or program groups, this one or several handling procedure is accumulated in time.The scheme that the adds up hypothesis of this one or several handling procedure is no earlier than packing into of one or several handling procedure with the packing into of image that is employed.In addition, the data of this handling procedure can run through that this image file is assigned with and be carried out by an interpreter that runs on this computer 140.(interpreter is a program, and direct execution command and do not need to compile in advance when receiving for example resembles the order line of text based operating system housing, MSDOS for example, or resemble the database program instruction mode of dbase III.)

In case accumulated this handling procedure in memory, the designator that then can respond in profile data and this image file is carried out this handling procedure.With reference to figure 5, the designator in image file or the data flow can adopt various forms.Several different instances shown in Fig. 5, its Fig. 5 illustrates the file or the data flow media data 501 of promoting along with time of direction indication.Tonic train Aud₁Can be used as a mark, the sound classification symbol can move on audio track in this case, till detecting some feature.Similarly, can recognition image Img₁, Img₂Or other signal section, so that identify the part of this video data stream.Even a number of sub images SI of the two field picture 510 of can classifying starts a process.

Can be for example M₁, M₂And M₃Mark write this document.In the simulation files of for example NTSC, mark can be to be positioned among this VBI.From time that data origination begins can be tracked and be used to indicate the each several part of this video data stream, for example time delimiter T₁And T₂Equally, handling procedure 500 is embedded in this video data stream before can occurring in the part of this data flow that will apply.For example, handling procedure 500 can be used to by T₁And T₂The sequence that limits, but be not used to M₃The sequence (note this time is just being followed this page and on) of indication.

Be noted that if this instruction is the instruction that can carry out immediately when receiving, then do not need this designator.A form of designator only is a position mark.In an analog data flow, this mark can adopt the form of watermark or icon, in the part of video image or be multiplexed in the data among the VBI and discern.In a digital data stream, this mark can be any suitable symbol and the indication of temporary position.In digital embodiment, this mark needn't occupy a position in the application consistent flow of data with this handling procedure certainly, but it can occupy a position in this data flow.

This decoder 210 can be a processor, and it decompresses, deciphers, opens bag, subitem or carries out the processing procedure that is used to insert needed any other qualification of this video data.Concerning putting into practice the present invention, this concrete processing is unessential.

Profile can comprise information or any several data of the selection of user's sign, relevant user or user's group (such as one family) simply.For example, profile can show that this user's group is the one family with very little child.This active handling procedure can be inquired about this user before the content that shows high violence or property subject matter, under unresponsive situation, shield or delete potential offending subject matter.Profiles database can comprise the subject matter selection, and this processing process uses this subject matter to select to screen one group of selectable attribute.For example, suppose that this image file comprises many different images files that all gather, and makes that a concrete file can be in sight.This profile can be screened these image files and only represent one or more selections and is used to watch.

As above-mentioned discussion, in one embodiment, this one or several handling procedure comprises the operational order for the removable part of this video data stream.Execution environment is stateless, makes that any a limited number of this part will always be duplicated with one or several handling procedure that may be used on this part.Unless this appended handling procedure can be controlled at the information between the divisible part of execution environment, if or this handling procedure can self produce this information, then between the divisible part of execution environment, do not have information to continue to exist.Sum up in the above among this embodiment of stateless frame by frame that describes in the part, this demultiplexer produces instruction continuously along with the reception of instruction.This instruction will be carried out at once with this demultiplexer, or keying in this video data stream mark or intrinsic designator.

With reference to figure 3, in an optional embodiment, this active handling procedure is added to the video data stream of a compression.Only after being added to this original video data stream, this active handling procedure just decodes 310.In this example, image is described to compressed image, but it can be to encrypt, divide into groups or other image encoded.In addition, though do not illustrate, profile data can be provided to this active data flow engine, makes this handle the data in this profile of program response.In Fig. 4, active handling procedure sends or is provided in addition this active data flow engine 425 in the mode of parallel transmission.For example in a broadcast environment, can produce a parallel transmission, and can revise image according to this parallel transmission.In addition, carry out, can guarantee synchronously by keying for the mark in the video data stream or other sign.In this example, this keying advantage useful life that is the weak point of handling procedure sign indicating number.This image is always according to being upgraded by the up-to-date handling procedure that provides of the information source of this active handling procedure.

Require in the unessential environment at this ill-mannered state property, these active handling procedure data can be placed in and the irrelevant position of the part of its image that will apply.Yet a requirement is that for a data flow information source of for example television broadcasting or internet data stream file, this handling procedure must be packed into before it needs.This handling procedure can be decomposed, but the whole of its program must accumulate in memory before it needs.Immediately, this handling procedure sign indicating number can be eliminated.The incident of sign indicating number and this removing of triggering preferably can be coded within this handling procedure itself.

This yard definition process program is not to comprise the high-level of the composition (elemeut) that limits complicated predefine handling procedure, or is comprising that qualification must make up the low level with the composition that increases progressively program for a short time of carrying out effective efficiency.Be the illustrative example of instruction kind subsequently, can carry out so that revise a media data stream by a suitable API.

Played data block b0-b1: play a series of image block to data block b1 from data block b0.Drawing line x1, y1, x2, y2, W, C: utilize the weighted sum colour of indication to draw a stack line from the coordinate of this indication.

Paint rectangle x1, y1, x2, y2, W, C, F: utilize the edge weighted sum colour and the filler of indication, draw a superimpose rectangles from the coordinate of this indication.

Filter application (c11, c12, c13, c21, c22, c23, c31, c32, c33), x1, y1, x2, y2: on the zone of regulation, a filter applies is arrived a zone by the defined matrix of a regulation.

Be included in path: //image sections of filename.vid: define a replacement data stream and stop image and insert this replacement data stream.

Those skilled in the art are with obvious, and the present invention is not limited to the above illustrative examples of explanation, and the present invention can realize with other concrete form under the condition that does not deviate from spirit of the present invention or inner characteristic.Therefore present embodiment is considered to illustrative and infinite in every respect, scope of the present invention is in the scope of appending claims appointment rather than above-described scope, and therefore the equivalent connotation and all changes within the scope that appear at this claim all are included among the appending claims.

Claims (23)

1. revise a kind of method of medium information data flow, comprise step:

In said medium information data flow (500) in conjunction with the definition of a kind of handling procedure (500) of a part that will be used to revise said medium information data flow;

Point (140,133,130,137,135) in playback, record or the relay of said medium information data flow is carried out said handling procedure.

2. a kind of method in the claim 1, wherein said handling procedure comprises a plurality of steps, each step is included in the said medium information data flow of the part of said each step said medium information data flow applicatory.

3. a kind of method in the claim 1, wherein said execution in step comprises partly makes amendment to the medium information of said medium information data flow.

4. a kind of method in the claim 1, wherein said execution in step is included in the said point of said playback, record or relay, and an order is provided to an interpreter on the computer.

5. a kind of method in the claim 1, wherein said execution in step comprises the step that an instruction is input to an interpreter, said interpreter is programmed, so that said instruction is carried out when said input immediately, at the said point of resetting, writing down or relay, on a computer, carry out said interpreter continuously.

6. a kind of method in the claim 5, wherein said interpreter execution environment is stateless execution environment, does not wherein have variable to instruct the next instruction to be unalterable from one.

7. a kind of method in the claim 5, wherein said interpreter execution environment is the stateless execution environment, wherein do not have variable from instruct next group instruction to be unalterable a group of an image sections front, said one group of instruction is used to revise this image sections.

8. revise a kind of method of medium information data flow, comprise step:

At least one order and a medium information synchronization of data streams, its order is pointed to a handling procedure and is present among the data flow;

Respond said instruction, a playback point in said medium information data flow calls said handling procedure, makes said handling procedure revise said medium information data flow;

Saidly guarantee effectively that synchronously this said handling procedure operates on a specified portions of said medium information data flow.

9. medium information data flow, comprise data flow video data with the mark (500) that is positioned at each point in the data flow video data, said mark is indicated each instruction, make when said medium information data flow is added to an interpreter, said interpreter is activated, so that respond the said data flow video data of said instruction modification.

10. a kind of medium information data flow as claimed in claim 9, wherein said interpreter is stateless, makes each continuous command group begin to carry out with the virtual machine state identical with every other continuous command group.

11. a kind of medium information data flow as claimed in claim 9, a modification of the wherein said modification of carrying out comprises at least one frame that a filter is added to said data flow video data.

12. a kind of medium information data flow as claimed in claim 9, wherein said data flow video data also comprises mark, and said instruction is a response said mark and carrying out.

13. a kind of medium information data flow as claimed in claim 9, the feature of wherein said commanded response in said data flow video data.

14. a broadcast system comprises:

First transmitter (137) is exported a kind of medium information data flow effectively;

Second transmitter (137) is exported a handling procedure data flow with said medium information synchronization of data streams effectively;

Said handling procedure data flow comprises the data of indicating at least one handling procedure, and when carrying out, these data are revised said medium information data flow effectively;

Said medium information data flow and said handling procedure data flow be to belong to guarantee that the handling procedure that defines is used to the specified portions of said medium information data flow in said handling procedure data flow synchronously.

15. a kind of system in the claim 14, wherein this second transmitter comprises a transmitter matrix; Each transmitter of this matrix has the scope of scope less than this first transmitter.

16. a kind of system in the claim 15, wherein each transmitter of this matrix sends different data.

17. a kind of system in the claim 14, wherein corresponding to the initial condition of the state machine of the arbitrary instruction series in said handling procedure data flow and definition be used to one of said medium information data flow continuously the initial condition of the state machine of a handling procedure of part be identical state.

18. be used to receive and revise a kind of device of a medium information data flow, comprise:

Have the demultiplexer (205,305,405) of an input, be used to receive the data flow of a combination, and be used to export a medium information data flow and a handling procedure data flow;

Controller (225,325,425) with an input and an output;

Said controller is programmed, so that receive said medium information data flow and said handling procedure data flow, and responds said handling procedure data flow and revises said medium information data flow.

19. a kind of method in the claim 18, wherein said handling procedure data flow comprises a plurality of instructions, and each instruction is included in the said data splitting stream part, it is adjacent to a part of said each step of expression said medium information data flow applicatory, thus said handling procedure data flow and said medium information synchronization of data streams.

20. a kind of method in the claim 18, wherein said controller is programmed, to be created in an interpreter processing procedure that executes instruction in the said handling procedure data flow, so that realize a state machine, structure of the said data splitting of its periodic response stream and by synchronously.

21. a kind of method in the claim 18, wherein said controller is programmed, so that realize an interpreter processing procedure of execution continuously, makes that the instruction in said handling procedure data flow is carried out immediately when being received by said controller.

22. a kind of method in the claim 21, wherein said interpreter execution environment is stateless execution environment, does not wherein have variable to instruct the next instruction to be unalterable from one.

23. a kind of method in the claim 21, wherein said interpreter execution environment is the stateless execution environment, wherein do not have variable from instruct next group instruction to be unalterable a group of an image sections front, said one group of instruction is used to revise this image sections.

Images