CN101180887B - Apparatus for audio video processing system - Google Patents
Apparatus for audio video processing systemDownload PDFInfo
- Publication number
- CN101180887B CN101180887BCN2006800177217ACN200680017721ACN101180887BCN 101180887 BCN101180887 BCN 101180887BCN 2006800177217 ACN2006800177217 ACN 2006800177217ACN 200680017721 ACN200680017721 ACN 200680017721ACN 101180887 BCN101180887 BCN 101180887B
- Authority
- CN
- China
- Prior art keywords
- signal processing
- video signal
- delay
- audio
- processing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/06—Generation of synchronising signals
- H04N5/067—Arrangements or circuits at the transmitter end
- H04N5/073—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
- H04N5/0736—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations using digital storage buffer techniques
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
- H04N5/602—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Receiver Circuits (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Studio Circuits (AREA)
- Television Signal Processing For Recording (AREA)
- Picture Signal Circuits (AREA)
Abstract
Description
Technical field
The present invention relates to be used for the equipment of audio-video processing system.
Background technology
US 5,202,761 have disclosed a kind of audio sync equipment, it has a delay detector that is used for accurately measuring the delay of video-unit, described delay detector and the controlled variable audio frequency delay circuit of delay couple, described audio frequency delay circuit is used to make audio signal accurately to postpone, and its retardation is substantially the same with described video signal delay.The typical case who shows a kind of and described audio sync device is connected, and wherein imports from an external video processing unit input delay alternately by an optional interface.
Summary of the invention
One of purpose of the present invention provides a kind of improving equipment of audio-video processing system that be used for.The present invention is limited by independent claims.In the dependent claims preferred embodiment is limited.
One aspect of the present invention is based on following understanding, promptly, if the institute that the audio-frequency unit of AV system can not mate in the video section of described AV system might postpone, if and/or from the feasible Video processing delay unacceptable (because it will destroy described recreation) that surpasses a certain maximum delay of the content of a game console, then prior art can not provide a kind of applicable solution.Take into account in this, the invention provides a kind of slowed-down video control that is used for coming the control of video signal processing according to the maximum permissible value of vision signal processing delay.Based on these maximum allowable delay, can be with the vision signal treatment limits in the pattern that does not need to bear above the Video processing delay of maximum allowable delay.
Therefore the invention provides a kind of treatment system, comprising: be used to handle the video signal processing unit of vision signal, described vision signal is handled and is born a vision signal processing delay; And the slowed-down video control device, be used for controlling described video signal processing unit according to the maximum permissible value of described vision signal processing delay.The present invention also provides a kind of audio-video signal source, comprise being used for sending the output of vision signal and being used for transmitting the output of the maximum permissible value of vision signal processing delay that described vision signal processing delay is to handle institute by the vision signal in the described video signal processing unit to bear to described video signal processing unit to video signal processing unit.The present invention also provides a kind of audio signal processing unit, comprising: an audio signal processing unit, described Audio Signal Processing are born one and are no more than the Audio Signal Processing delay that maximal audio postpones; And output that is used for transmitting the maximum permissible value of vision signal processing delay to described video signal processing unit, described vision signal processing delay is to handle institute by the vision signal in the described video signal processing unit to bear, and the described maximum permissible value that is used for the vision signal processing delay depends on that described maximal audio postpones.
These and other aspect of the present invention by after described embodiment will be conspicuous and be described with reference to these embodiment.
Description of drawings
In the accompanying drawings:
Fig. 1 represents an embodiment according to system of the present invention;
Fig. 2 represents an embodiment according to video processing unit of the present invention; With
Fig. 3 represents an embodiment according to audio-video signal source of the present invention.
Embodiment
An embodiment according to system operation of the present invention is as follows.An audio-video signal source AVSS (for example content system) will decode and/or generate Voice ﹠ Video.This can be DVD player, home theater machine, can also be set-top box or game console.So content can derive from DVD, network or local the generation.The user will listen to audio signal AS by the loud speaker LS with optional amplifier AMP.This amplifier is optionally, because household audio and video system can directly be connected with described loud speaker.
Described vision signal directly reaches the video signal processing unit VSPU that is formed by television set or monitor by an analog or digital interface.Except video channel VC, also has communication port CC, for example DDC among CEC, DVI and the HDMI or the AV link in some simulated television systems.Described video signal processing unit VSPU will handle vision signal, and associated, can be on display introduce in the process of display video to postpone.The processing among the video signal processing unit VSPU (for example television system) is depended in this delay, this processing can be depended on video content (film, video, interlacing, line by line or the like), can also depend on user's preferential selection (this user can force handle to a kind of mode designated/preferential selection).Select among the information capacity of the being stored in/state information piece VSSIB of relevant relevant delay with a certain pattern/user priority, it can be visited from content system by communication port.The Audio Processing that such information can be used for changing in the content system postpones.
Can carry out following operation:
Force the content system pattern:
When beginning the content of outputting video signal, described audio-video signal source AVSS can read the retardation of indicating under the AD HOC from video signal processing unit VSPU.If described audio-video signal source AVSS is a game console, then its (by a control position is write) can force described video signal processing unit VSPU to become (it is required to play) lowest latency pattern.If audio-video signal source AVSS is DVD player or set-top box (STB), then can forces video signal processing unit VSPU to become on display the pattern that produces best in quality or depend on the pattern that maximal audio that this audio-video signal source AVSS (STB/DVD) can compensate postpones.
Adaptive model:
Described video signal processing unit VSPU receiver, video content also will dynamically change described tupe (being provided with according to content and user), so it will upgrade can be from the capacity/state information the memory AVSIB that described audio-video signal source AVSS visits.Selectively, video signal processing unit VSPU can generate an interruption so that indicate described change to described audio-video signal source AVSS (use communication port).Described audio-video signal source AVSS can periodically detect described status register or selectively described interruption is reacted and change meet described state with the immediate audio frequency delay of relevant delay.If described video signal processing unit VSPU is not last unit (having the additional system of same-interface if exist after it) in a handle link, then described video signal processing unit VSPU will need its postponement is added in the delay of other device, or described content system must read all delays in the described link and superpose them.
Force TV system mode:
Also may be described video signal processing unit VSPU reads described (about postponing possibility) capacity and will force described audio-video signal source AVSS to postpone to postpone extraly audio frequency according to its oneself Video processing from described audio-video signal source AVSS.
Fig. 2 represents an embodiment according to video processing unit of the present invention.An incoming video signal is applied in to a video input buffer device VIB.The output of described video input buffer device VIB is connected to a memory MEM that is used to handle with extra delay, and is connected to a processing unit PROC who for example is used for deinterleave and convergent-divergent.Control described processing unit PROC by a processing control signals PROCCONT.The output of memory MEM and processing unit PROC is connected to a video output buffer VOB.In the present embodiment, following tupe is available:
| Tupe | Postpone | Video quality |
| Line copy (deinterleave) | 2 lines (128 μ s) | --- |
| 2 | 1 (20ms) | 0 |
| 3 | 2 (40ms) | + |
| 4 | 3 (60ms) | ++ |
| Motion compensation | 2.5 (50ms) | ++ |
| Motion compensation (high-quality) | 3.5 (70ms) | +++ |
Clearly, the example in the above-mentioned table depends on video standard; The time of indication relates to the PAL standard.According to the amount of free storage, extra delay all is possible in all patterns.
Fig. 3 represents an embodiment according to audio-video signal source AVSS of the present invention.Wherein,
TS=transport stream input (being used for set-top box)
PS=program stream input (being used for DVD or set-top box)
ES=flows (only being video or audio-frequency information) substantially
PTS=represents timestamp (when indication must represent described image or audio samples on screen or loud speaker)
DTS=decoded time stamp (when indication needs decoded picture/sound, is used for rearrangement)
The PCR=program clock recovers (be used to make described receiver clock and encoder clock synchronous).
Signal TS and PS are applied in and are used to produce audio frequency to a demultiplexer DEMUX and flow A-ES, video-frequency basic flow V-ES and signal PTS, DTS and PCR substantially.In compression domain CD, there is the audio frequency of reception to flow the audio buffer A-buff of A-ES and the video buffer V-buff that receiver, video flows V-ES substantially substantially.Voice ﹠ Video buffer A-buff and V-buff are handled by a PLL/sync and the delay control unit CTRL of received signal PTS, DTS and PCR controls.Signal from Voice ﹠ Video buffer A-buff and V-buff is imposed on audio decoder A-dec and the Video Decoder V-dec that is controlled by described PLL/sync processing and delay control unit CTRL respectively.Signal from Voice ﹠ Video decoder A-dec and V-dec is not being imposed on audio output buffer device A-outbuf and video output buffer V-outbuf respectively among the compression domain UCD.Described Voice ﹠ Video output buffer A-outbuf and V-outbuf are also handled by described PLL/sync and delay control unit CTRL control.
Can in compression domain CD, postpone (after Signal Separation), thereby not need big buffer video and audio frequency.If PTS etc. are known, then clock control CTRL can postpone according to the output delay of being asked.Described control CTRL also controls decoder (using described decoded time stamp) and control output (using the described timestamp that represents), and can also use buffer A-outbuf and V-outbuf to postpone this video and audio signal at output before video and audio signal is presented to display unit.Described control unit CTRL also is used for communicating with regard to its setting with described display unit, and described display unit can use a volume controlled memory MEM to read the capacity of player.Described control unit CTRL can also have one and connect C, is used to read the TV capacity and writes control.
Should notice that the foregoing description only is to explain and unrestricted the present invention, under the situation that does not break away from institute's claim scope, those skilled in the art can design various alternative embodiments.Word " comprises " and is not precluded within the claim element outside cited those or the existence of step.Word before an element " one " or " one " do not get rid of and a plurality of this elements occur.The present invention can carry out by means of the hardware that comprises some different elements and/or by means of the processor of suitably programming.In having enumerated the device claim of some members, several of these members can be realized by the hardware of one and identical entry.In mutually different dependent claims, enumerate some measure and do not represented advantageously to use the combination of these measures.
Claims (6)
Translated fromChineseApplications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP05104377.6 | 2005-05-24 | ||
| EP05104377 | 2005-05-24 | ||
| PCT/IB2006/051433WO2006126113A2 (en) | 2005-05-24 | 2006-05-08 | Equipment for audio-video processing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101180887A CN101180887A (en) | 2008-05-14 |
| CN101180887Btrue CN101180887B (en) | 2010-09-29 |
Family
ID=37188964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006800177217AExpired - Fee RelatedCN101180887B (en) | 2005-05-24 | 2006-05-08 | Apparatus for audio video processing system |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20080211963A1 (en) |
| EP (1) | EP1889488B1 (en) |
| JP (1) | JP2008543149A (en) |
| CN (1) | CN101180887B (en) |
| WO (1) | WO2006126113A2 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100684999B1 (en)* | 2005-05-27 | 2007-02-20 | 삼성전자주식회사 | Display device and control method |
| JP4360400B2 (en)* | 2006-12-05 | 2009-11-11 | セイコーエプソン株式会社 | Content reproduction system, reproduction apparatus used therefor, and content reproduction method |
| TWI395476B (en)* | 2006-12-20 | 2013-05-01 | Princeton Technology Corp | Method and related device for determining timing sequence of video and audio data for high density multimedia interface |
| US20110164182A1 (en)* | 2010-01-06 | 2011-07-07 | Takashi Wada | Video Processing Apparatus and Video Processing Method |
| CN117795965A (en) | 2021-10-05 | 2024-03-29 | 三星电子株式会社 | Electronic device and method for controlling the same |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4703355A (en)* | 1985-09-16 | 1987-10-27 | Cooper J Carl | Audio to video timing equalizer method and apparatus |
| US5623483A (en)* | 1995-05-11 | 1997-04-22 | Lucent Technologies Inc. | Synchronization system for networked multimedia streams |
| CN1318947A (en)* | 2000-03-29 | 2001-10-24 | 德国汤姆森-布兰特有限公司 | Method and device for changing output delay of voice data code or video data code |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5202761A (en) | 1984-11-26 | 1993-04-13 | Cooper J Carl | Audio synchronization apparatus |
| US5387943A (en)* | 1992-12-21 | 1995-02-07 | Tektronix, Inc. | Semiautomatic lip sync recovery system |
| JPH0787080A (en)* | 1993-06-30 | 1995-03-31 | Sony Corp | Decoder and satellite broadcast reception system |
| US5530483A (en)* | 1994-10-11 | 1996-06-25 | Pixel Instruments Corp. | Delay detector apparatus and method for plural image sequences |
| US6285405B1 (en)* | 1998-10-14 | 2001-09-04 | Vtel Corporation | System and method for synchronizing data signals |
| US6906755B2 (en)* | 2002-01-04 | 2005-06-14 | Microsoft Corporation | Method and apparatus for synchronizing audio and video data |
| EP1439712A1 (en) | 2002-12-17 | 2004-07-21 | Visiowave S.A. | Method of selecting among "Spatial Video CODEC's" the optimum CODEC for a same input signal |
| JP2005338605A (en)* | 2004-05-28 | 2005-12-08 | Toshiba Corp | Display device and display method |
| KR100694060B1 (en)* | 2004-10-12 | 2007-03-12 | 삼성전자주식회사 | Audio video synchronization device and method |
| US7636126B2 (en)* | 2005-06-22 | 2009-12-22 | Sony Computer Entertainment Inc. | Delay matching in audio/video systems |
- 2006
- 2006-05-08JPJP2008512962Apatent/JP2008543149A/enactivePending
- 2006-05-08EPEP06765672Apatent/EP1889488B1/ennot_activeNot-in-force
- 2006-05-08USUS11/915,401patent/US20080211963A1/ennot_activeAbandoned
- 2006-05-08WOPCT/IB2006/051433patent/WO2006126113A2/ennot_activeApplication Discontinuation
- 2006-05-08CNCN2006800177217Apatent/CN101180887B/ennot_activeExpired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4703355A (en)* | 1985-09-16 | 1987-10-27 | Cooper J Carl | Audio to video timing equalizer method and apparatus |
| US5623483A (en)* | 1995-05-11 | 1997-04-22 | Lucent Technologies Inc. | Synchronization system for networked multimedia streams |
| CN1318947A (en)* | 2000-03-29 | 2001-10-24 | 德国汤姆森-布兰特有限公司 | Method and device for changing output delay of voice data code or video data code |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1889488B1 (en) | 2012-10-31 |
| EP1889488A2 (en) | 2008-02-20 |
| CN101180887A (en) | 2008-05-14 |
| WO2006126113A3 (en) | 2007-02-15 |
| US20080211963A1 (en) | 2008-09-04 |
| WO2006126113A2 (en) | 2006-11-30 |
| JP2008543149A (en) | 2008-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101204081B (en) | Automatic audio and video synchronization | |
| US8208069B2 (en) | Audio processing apparatus, video processing apparatus, and method for controlling the same | |
| JP5660895B2 (en) | Apparatus and method for synchronizing user observable signals | |
| US8925003B2 (en) | Mechanism for facilitating synchronization of audio and video between multiple media devices | |
| JP2009130821A5 (en) | ||
| CN101180887B (en) | Apparatus for audio video processing system | |
| JPWO2006025441A1 (en) | Image processing apparatus, audio processing apparatus, image / audio supply apparatus, image / audio processing system, and image / audio synchronization method | |
| JP6720566B2 (en) | Audio equipment | |
| JP2012134943A (en) | Content reproduction apparatus and content processing method | |
| JP2009049919A (en) | Video sound reproduction method and video sound reproducing system | |
| CN105791937A (en) | A kind of audio and video processing method and related equipment | |
| JP2007221421A (en) | Video / audio reproduction system and AV center and monitor constituting the same | |
| KR100688981B1 (en) | Media playback apparatus and control method thereof, and media playback system including the same | |
| JP2011130236A (en) | Audio amplifier | |
| JP5381507B2 (en) | Content transceiver | |
| JP5506239B2 (en) | Video processing apparatus, control method, and program | |
| JP2007235519A (en) | Video / audio synchronization method and video / audio synchronization system | |
| US20100166382A1 (en) | Video and audio reproduction system, distribution device, and synchronization adjustment method | |
| KR100677971B1 (en) | Television Receivers and Methods for Delay Control of Audio Signals | |
| KR100863696B1 (en) | Transport stream processing method and apparatus | |
| KR102709016B1 (en) | Multimedia device for processing audio/video data and method thereof | |
| JP2007221422A (en) | Video / audio reproduction system and AV center and monitor constituting the same | |
| KR100527427B1 (en) | Moving Image Reproduction Device with High Power and Sound Quality, and The Reproduction Method | |
| KR100730263B1 (en) | Voice signal processing device | |
| JP2007060207A (en) | Voice signal processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right | Owner name:TRIADIUS MICROSYSTEMS (FAR EAST) CO., LTD Free format text:FORMER OWNER: KONINKL PHILIPS ELECTRONICS NV Effective date:20100919 | |
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data | Free format text:CORRECT: ADDRESS; FROM: EINDHOVEN, NETHERLANDS TO: GRAND CAYMAN ISLAND, KAMAN ISLANDS | |
| TA01 | Transfer of patent application right | Effective date of registration:20100919 Address after:Grand Cayman, Cayman Islands Applicant after:Trident Microsystems (Far East) Ltd. Address before:Eindhoven Applicant before:Koninkl Philips Electronics NV | |
| ASS | Succession or assignment of patent right | Owner name:ENTROPY COMMUNICATION CO., LTD. Free format text:FORMER OWNER: TRIDENT MICROSYSTEMS (FAR EAST) LTD. Effective date:20130221 | |
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right | Effective date of registration:20130221 Address after:American California Patentee after:Entropic Communications, Inc. Address before:Grand Cayman, Cayman Islands Patentee before:Trident Microsystems (Far East) Ltd. | |
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20100929 Termination date:20130508 |