US20030093800A1 - Command packets for personal video recorder - Google Patents

Abstract

Command packets for personal video recorder. The invention provides for transport stream (TS) that contains data and also includes a transport packet (TP)/TS formatted command packets. The TP/TS formatted command packet may be communicated between any number of devices, including multiple chips, multiple boards, and multiple processors. A decoder is able to decode the TP/TS formatted command packet and to perform the appropriate operation on data portions of the TS. When a TS is provided to a device not having the capability to perform the proper decoding of the TP/TS formatted command packet, that particular packet may be deemed as being unidentified (or unknown) adaptation field data. Alternatively, the packet may be identified as being corrupted data and/or irrelevant data. The invention is operable to encode command packets into the transport stream in such a way that it is backward compatible with previous systems.

Description

BACKGROUND
• 1. Technical Field[0001]
• The invention relates generally to video recorder and playback systems; and, more particularly, it relates to command packets that may be inserted into a data transport stream.[0002]
• 2. Related Art[0003]
• Many previous systems that deal with digital video data, including the normal playback and trick play playback of that video data are intrinsically tied to the proprietary system and platform on which they are operating. There have also been many standards developed in this particular area of technology concerning data types. In addition, there have been several standards into which data is formatted for transport. One such transport standard is the motion picture expert group, MPEG-2 transport stream format (MPEG-2 TS). Many of the various data types are formatted into this MPEG-2 TS format for communication between various components in a system. The MPEG-2 TS will generically be referred to as MPEG TS in various remaining portions of this disclosure.[0004]
• In addition, although there has been some uniformity in the development of TS formats, there has nevertheless been a dependence on dedicated communication and control between components that control the playback (including trick play playback) of the data and the device that performs the decoding of the data for playback. The control device and the decoding device may actually be in the same device, but there is nevertheless a great deal of dedicated interfacing that is required to perform the proper control of the data playback.[0005]
• FIG. 1 shows a prior art conventional personal[0006]video recorder system100. Ahost processor110 is operable to control and/or provide data in a MPEG TS115. The host processor provides and/or controls this data to a proprietary/conventional decoder120. Again, thehost processor110 and the proprietary/conventional decoder120 may also be included within a single device. The proprietary/conventional decoder120 includes a host processor-specific dedicated,local intelligence122 for decoding of trick play functions of the MPEG TS115. Any other devices may also be used, besides ahost processor110, to control the decoding of the MPEG TS115 and also to control any desired trick play functionality to be performed on the MPEG TS115. To enable proper communication between thehost processor110 and the proprietary/conventional decoder120, a great deal of interfacing is typically needed. In this situation, a dedicated communication/control interface130 is required between thehost processor110 and the proprietary/conventional decoder120. The host processor-specific dedicated,local intelligence122 is operable to perform extraction of the commands, that may include some trick play functionality, and to perform modification of the MPEG TS115. The proprietary/conventional decoder120 is operable to performMPEG data manipulation124 that is required to enable trick play operations. The MPEG data manipulation modifiesinput MPEG data125 and transforms it into modifiedMPEG data126. This transformation is typically entirely proprietary and specific to the particular device used to perform this functionality.
• Prior art systems are inoperable to perform direct trick play playback of MPEG data without performing proprietary modification of the[0007]input MPEG data125 to transform it into the modifiedMPEG data126 that includes the proper commands and controls to perform trick play playback of theinput MPEG data125. The modifiedMPEG data126, within the proprietary system, is a data form that does not fall within the MPEG standard any longer. The data has been modified, as uniquely required, within the proprietary system to enable playback of the data in the proper manner. Other proprietary systems also perform similar modification of the data, as required within their respective systems. Typically, no two proprietary systems perform this modification of the data to enable playback in a similar manner.
• This great deal of dedicated communication/[0008]control interfacing130 is required to enable trick play operation, given that there the manipulation of the received MPEG TS115, in transforming theinput MPEG data125 into the modifiedMPEG data126, must be performed to enable trick play operations. Again, this inherently requires a great deal of interfacing, by communicating a great deal of command and control information, between thehost processor110 and the proprietary/conventional decoder120. This great deal of interfacing between the devices requires a very large dedication of real estate in previous systems. Even in situations where thehost processor110 and the proprietary/conventional decoder120 are contained within a single device, there must nevertheless be a great deal of interfacing between those two devices in the single device, again requiring a great deal of interfacing and also consuming much real estate in the single device system; the two components (even within a single device), one for command and control and one for decoding, must nevertheless be included within a single device. The output from the proprietary/conventional decoder120 provides the now-modifiedMPEG data126 to adisplay140.
• In the conventional situation, the data processing and data transfer requirements for MPEG data manipulation and modification, within the conventional personal[0009]video recorder system100, requires a great deal of communication and processing requirements. From certain perspectives, conventional personal video recorder systems, that are capable to do trick play playback, inherently require dedicated communication and control within the self-contained system. This communication and control must all be tailored to the specific, proprietary system in which the data is to be played using trick play functionality.
• Further limitations and disadvantages of conventional and traditional systems will become apparent to one of skill in the art through comparison of such systems with the invention as set forth in the remainder of the present application with reference to the drawings.[0010]
SUMMARY OF THE INVENTION
• Various aspects of the invention can be found in a transport stream that includes both data packets and command packets. The novel implementation of command packets within the transport stream allows the elimination of the great deal of interfacing required between a control device and a decoding and/or display device that is required in previous systems. The command packet includes one or more commands that are to be performed on data packets within the transport stream. The command packets may be inserted at any place within a system up to and before an output device that plays back the data packets of the transport stream. The commands within a command packet may be input by a user, it may be initiated by a detection of the type of content of transport stream, and any number of other inputs. The command packet includes the ability to perform trick play operations on the data packet portions within the transport stream.[0011]
• In addition, a transport stream may include only command packets in certain embodiments; the command packets, formatted in transport stream format, are used to perform control operations between various devices. This particular embodiment provides the opportunity to perform control without a great deal of control-based interfacing by using the exiting communication lines that are operable to support the transport stream.[0012]
• In certain embodiments, the transport stream is a motion picture expert group, MPEG-2 transport stream. The command packets are formatted with headers having syntax that is compatible with the MPEG-2 transport stream format, so that the command packet may be transmitted along with the data packets within the transport stream without affecting the communication of the transport stream between any number of devices.[0013]
• The transport stream is also operable within systems that do not have the decoding capability to extract the command information from a command packet contained within the transport stream. When a decoder tries to decode the MPEG-2 formatted command packet, and when the decoder does not have the ability to decode and extract the command information from the command packet, that particular command packet is merely treated as being unidentified (or unknown) adaptation data within the transport stream. From other perspectives, this data may be viewed as being corrupted data; alternatively, the data is identified as being irrelevant data. Then, that packet (either identified as being irrelevant or corrupted data) is discarded and the remainder of the transport stream, having the data packets, is played back normally, just as data packets of an ordinary transport stream may be played back.[0014]
• The above-referenced description of the summary of the invention captures some, but not all, of the various aspects of the present invention. The claims are directed to some other of the various other embodiments of the subject matter towards which the present invention is directed. In addition, other aspects, advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings.[0015]
BRIEF DESCRIPTION OF THE DRAWINGS
• A better understanding of the invention can be obtained when the following detailed description of various exemplary embodiments is considered in conjunction with the following drawings.[0016]
• FIG. 1 is a system diagram illustrating an embodiment of a prior art conventional personal video recorder system.[0017]
• FIG. 2 is a system diagram illustrating an embodiment of a personal video recorder system that is built in accordance with certain aspects of the present invention.[0018]
• FIG. 3 is a system diagram illustrating another embodiment of a personal video recorder system that is built in accordance with certain aspects of the present invention.[0019]
• FIG. 4 is a system diagram illustrating an embodiment of motion picture expert group (MPEG) transport stream (TS) content that is configured in accordance with certain aspects of the present invention.[0020]
• FIG. 5 is a system diagram illustrating an embodiment of a simplified digital channel recording process that is performed in accordance with certain aspects of the present invention.[0021]
• FIG. 6 is a system diagram illustrating an embodiment of an analog channel recording process that is performed in accordance with certain aspects of the present invention.[0022]
• FIG. 7 is a system diagram illustrating an embodiment of a video playback process that is performed in accordance with certain aspects of the present invention.[0023]
• FIG. 8 is a functional block diagram illustrating an embodiment of a command packet method that is performed in accordance with certain aspects of the present invention.[0024]
• FIG. 9 is a functional block diagram illustrating an embodiment of a transport stream (TS) decoding method that is performed in accordance with certain aspects of the present invention.[0025]
• FIG. 10 is a functional block diagram illustrating an embodiment of a transport stream (TS) transport/parse method that is performed in accordance with certain aspects of the present invention.[0026]
• FIG. 11 is a functional block diagram illustrating an embodiment of playback method options that may be performed in accordance with certain aspects of the present invention.[0027]
• FIG. 12 is a functional block diagram illustrating an embodiment of a playback method that is performed in accordance with certain aspects of the present invention.[0028]
• FIG. 13 is a functional block diagram illustrating an embodiment of a video transport processing method that is performed in accordance with certain aspects of the present invention.[0029]
• FIG. 14 is a functional block diagram illustrating an embodiment of a normal playback method that is performed in accordance with certain aspects of the present invention.[0030]
• FIG. 15 is a functional block diagram illustrating an embodiment of a fast forward playback method that is performed in accordance with certain aspects of the present invention.[0031]
• FIG. 16 is a functional block diagram illustrating an embodiment of a rewind playback data flow method that is performed in accordance with certain aspects of the present invention.[0032]
• FIG. 17 is a functional block diagram illustrating an embodiment of a rewind playback control flow method that is performed in accordance with certain aspects of the present invention.[0033]
• FIG. 18 is a system diagram illustrating an embodiment of an MPEG-2 coded bit stream that is configured in accordance with certain aspects of the present invention.[0034]
DETAILED DESCRIPTION OF THE INVENTION
• The present invention is able to insert command packets directly into a motion picture expert group, MPEG-2 transport stream (TS). For simplicity, MPEG-2 TS will commonly be referred to as MPEG TS using a convention commonly used by those persons having skill in the art. The command packets may be formatted in a similar way in which data is also formatted to comply with the MPEG TS format. The present invention is also operable, generically, to perform formatting of command packets into a TS format, so that they may be inserted within the TS, without affecting the ability of the TS to be received and decoded.[0035]
• The location in which the command packet may be inserted into the TS may vary, as desired in the particular application. Certain embodiments of the present invention envision content management that may be performed by system up-stream from where the TS is generated. For example, a device may receive a TS, and based on analysis of the content of the TS, certain portions of the TS may be skipped, passed over, or otherwise handled differently based on the content of the data. For example, in some situations, content unsuitable for children may be detected and skipped over as desired by a user of certain aspects of the present invention. A parent could program their decoder to detect the data type in the TS and then to insert certain command packets into the TS so that the TS will be accommodated according to that parent's desires. If the parent wished to skip adult content completely, TS formatted command packets could be inserted to skip over adult-oriented content at all times. Conversely, other content based management could similarly be performed as will be understood by those persons having skill in the art.[0036]
• For systems that are operable to decoded the TS formatted command packet, the control functionality of the command packet will readily be made available for use. The present invention obviates the need for the communication and control intensive interfacing between a control device and a decoding device that is prevalent in previous systems. Any number of commands may be included within a TS formatted command packet. The present invention obviates the need to implement trick play of data using proprietary techniques within previous systems. For example, rather than requiring the physical manipulation of the data into a form other than the ordinary form in which the data is received to enable trick play playback (as in previous systems), the present invention is operable to perform this functionality using the TS formatted command packets.[0037]
• The TS formatted command packets are decoded in similar manner as the way an actual TS formatted data is decoded. For a regular MPEG-2 video bit stream, an EP picture usually is an Intra-coded picture (I-picture). The difference is that the system that performs the decoding uses the encoded command packets (extracted from within the TS formatted command packet) to perform the trick play functionality. The present invention is also backward compatible to systems that are not operable to perform trick play functionality. For example, when a TS formatted command packet is received, as part of the TS formatted data, the receiver of the trick play incapable system simply rejects, or discards, the TS formatted command packet as if it were corrupted data. Those persons having skill in the art will appreciate that the data may alternatively be identified as being irrelevant data, and not necessarily corrupted. The present invention is able to do this without deleteriously affecting the performance of normal and ordinary playback of the data. No substantial jitter is introduced by the detection and discarding of this data.[0038]
• The present invention provides for a great decrease in the interfacing required between the device that provides the data, and may also provide control commands of how the data is to be played back, and the device that actually decodes the data and provides it to an output device. Within many of the various exemplary embodiments, the use of video data is used for illustration. Those persons having skill in the art will recognize that any form of digital data may be included in various embodiments. Audio data, video data, and other digital data may be handled using various aspects of the present invention to format command packets into a format compatible with the manner in which actual data is formatted for transport. The transport of data, and TS formatted command packets, may be between two embedded components within a single device, between multiple devices, and generically between any two elements that data may be transported. The command packets may be inserted into the TS at virtually any point without corrupting the TS. From an overview perspective, the command packets appear similar to an ordinary data packet in form. However, when that packet is decoded, it will contain command information that may include how other packets within the TS are to be handled. For a decoding system that is incapable to recognize or perform the proper functionality, the command packet will simply appear to be corrupted data. Again, those persons having skill in the art will appreciate that the command packet may alternatively be identified as being an irrelevant command packet, and not necessarily corrupted. In such situations, the command packet will be ignored and discarded without affecting the playback of the other data portions of the TS.[0039]
• In certain embodiments, the present invention is implemented in a personal video recorder (PVR) system. A personal video recorder system may offer consumers a hard disk-based VCR that is operable to receive and record a live TV program while offering the versatility of select playback and associated special features. The personal video recorder is also operable to receive data from any number of other sources as well.[0040]
• One of the most important features is providing the ability to the consumer to pause viewing of a live broadcast, for a variable length of time while the unit continues to record, and then resume continuous view from the point of departure. This is often referred to as “time-shifting.” In addition, since the programs are recorded digitally, the viewer can also take advantage of trick play features such as pause, fast forward, slow forward, rewind, slow reverse, skip, etc. Certain of these aspects, among others, are disclosed below in various embodiments of the present invention.[0041]
• FIG. 2 is a system diagram illustrating an embodiment of a personal video recorder system[0042]200 that is built in accordance with certain aspects of the present invention. The personal video recorder system200 includes adecoder220 that receives a data transport stream (TS)215 from some source. TheTS215 may be received by thedecoder220 from ahost processor215, . . . , or anyother source205 without departing from the scope and spirit of the invention. TheTS215 contains embedded TS formatted command packets. From certain perspectives, the TS formatted command packets may be viewed as being command packets, having a form of an ordinary TS data packet in terms of configuration and arrangement, that are inserted within theTS215. In certain embodiments, anMPEG TS217, having embedded MPEG TS formatted command packets, is provided by either one or both of thehost processor215, . . . , or the anyother source205 to thedecoder220.
• The[0043]decoder220 is operable to perform decoding of theTS215, as shown in afunctional block222 within thedecoder220. Similarly, thedecoder220 is operable to perform decoding of theMPEG TS217, as shown in afunctional block224 within thedecoder220. The now decodedTS235, is passed to an output device shown as adisplay240. Again, other output devices may be employed to accommodate various data types, including audio data types. The use of adisplay240 is used to show the exemplary situation of video data TSs. Thedisplay240 is operable to perform playback of the now decodedTS235. The decodedTS235 may be of various data types, including audio and video data types.
• The decoded[0044]TS235 is now operable for playback, trick play, and other operations within the output device. In one particular situation, the decoded TS may be a decodedMPEG TS237 that is operable for playback, trick play, and other operations. The command packets, that were formatted into the appropriate TS format within theTS215, are decoded to direct the manner in which portion of theTS215 are to be handled. The TS formatted command packets do not interfere with the remaining portions of the TS, in that, they appear simply to be other packets within the TS in terms of format.
• When the[0045]TS215 is decoded, a system that is operable to perform trick play and that is operable to decode and extract the commands within the command packets, will implement the commands to direct the appropriate handling of the other portions of the TS. However, if the system is incapable to provide the trick play functionality, then the command packets will simply be identified as corrupted data and/or irrelevant data and discarded, as understood by those persons having skill in the art. Even conventional systems are operable to detect a corrupted data packet and/or irrelevant data packet. For systems incapable to perform the decoding and performance of the command contained within the TS formatted command packets, the TS formatted command packets do not substantially interfere with the normal playback of the TS. That is to say, in the context of video playback, there is not substantial interference with the playback of the video data such that a viewer will perceive a substantial reduction in perceptual quality. Analogously, in the in the context of audio playback, there will not be a substantial interference with the playback of the audio data such that a listener will perceive a substantial reduction in perceptual quality.
• FIG. 3 is a system diagram illustrating another embodiment of a personal[0046]video recorder system300 that is built in accordance with certain aspects of the present invention. The personalvideo recorder system300 includes a proprietary/conventional decoder320 that receives a data transport stream (TS)315 from some source. TheTS315 may be received by the proprietary/conventional decoder320 from ahost processor315, . . . , or anyother source305 without departing from the scope and spirit of the invention. TheTS315 contains embedded TS formatted command packets. From certain perspectives, the TS formatted command packets may be viewed as being command packets, having a form of an ordinary TS data packet in terms of configuration and arrangement, that are inserted within theTS315. In certain embodiments, anMPEG TS317, having embedded MPEG TS formatted command packets, is provided by either one or both of thehost processor315, . . . , or the anyother source305 to the proprietary/conventional decoder320.
• The proprietary/[0047]conventional decoder320 is operable to perform decoding of theTS315, as shown in afunctional block322 within the proprietary/conventional decoder320. Similarly, the proprietary/conventional decoder320 is operable to perform decoding of theMPEG TS317, as shown in afunctional block324 within the proprietary/conventional decoder320. The now decodedTS335, is passed to an output device shown as adisplay340. Again, other output devices may be employed to accommodate various data types, including audio data types. The use of adisplay340 is used to show the exemplary situation of video data TSs. Thedisplay340 is operable to perform playback of the now decodedTS335. The decodedTS335 may be of various data types, including audio and video data types.
• In this particular embodiment, the proprietary/[0048]conventional decoder320 is inoperable to perform any trick play as directed by the commands within the TS formatted command packets. Alternatively, the proprietary/conventional decoder320 is inoperable to perform decoding of the commands within the TS formatted command packets. In this situation, the now decodedTS335 will be operable for normal playback. Those TS formatted command packets, that were contained within theTS315, will be ignored and discarded. This ignoring and discarding will not interfere with the playback of the other portions of the decodedTS335.
• When the[0049]TS315 is decoded, and given that the proprietary/conventional decoder320 is inoperable to perform trick play and is operable to decode and to extract the commands within the TS formatted command packets, then the proprietary/conventional decoder320 simply perceives that the TS formatted command packets are corrupted data and/or irrelevant data. The proprietary/conventional decoder320 then discards the TS formatted command packets. This embodiment of the present invention, as shown in the FIG. 3, shows that even the proprietary/conventional decoder320 is operable to receive and decoded, and even to playback, aTS315 that is encoded using certain aspects of the present invention including embedding TS formatted command packets into theTS315. The TS formatted command packets do not substantially interfere with the normal playback of the TS. That is to say, in the context of video playback, there is not substantial interference with the playback of the video data such that a viewer will perceive a substantial reduction in perceptual quality. Analogously, in the in the context of audio playback, there will not be a substantial interference with the playback of the audio data such that a listener will perceive a substantial reduction in perceptual quality.
• This embodiment shows the backward compatibility of a TS that is encoded in accordance with certain aspects of the present invention. A system capable to perform decoding of the command packets, and also a system incapable to do so, may both receive a TS that is encoded using the present invention. Certain aspects of the present invention may be implemented in new and older systems without introducing any deleterious reduction in performance.[0050]
• FIG. 4 is a system diagram illustrating an embodiment of motion picture expert group (MPEG) transport stream (TS)[0051]content400 that is configured in accordance with certain aspects of the present invention. TheMPEG TS content400 includes anMPEG TS410. TheMPEG TS410 includesdata420 and TS formatted trick play commands430. Thedata410 may include any one or combination ofvideo data422,audio data424, . . . , and anyother data type429 as understood by those persons having skill in the art. The TS formatted trick play commands430 may include any one or combination of commands that direct functions of pause/still431,fast forward432, rewind433,slow forward434,slow rewind436, skip436, . . . , and anyother commands439 as understood by those persons having skill in the art. There may also be subsets of each of the command included within the TS formatted trick play commands430. For example, thefast forward432 may also include options to perform FF at varying rates, such as ½×, 2×, 3×, etc. Similarly, therewind432 may also include options to perform REW at varying rates, such as ½×, 2×, 3×, etc. The other command may also include other variations as well.
• Those persons having skill in the art will recognize that the[0052]data420 within theMPEG TS410 is formatted in a particular manner to enable and comply with MPEG TS formatting requirements. In addition, a command packet including any one or more of the TS formatted trick play commands430 within theMPEG TS410 are formatted in a particular manner to enable and comply with MPEG TS formatting requirements.
• Moreover, certain aspects of the present invention are extendible to other variations as well. For example, other TS data formats may similarly benefit from the present invention. In other contexts, command packets may be formatted into a proper TS format and inserted within the TS as well. Certain embodiments of the present invention are geared specifically to accommodate MPEG TSs, but those persons having skill in the art will recognize that the principle of embedding command packets, the command packets being formatted in similar manner that the data is formatted within the TS format, may be employed in other application contexts as well. The implementation of these aspects will assist in the ability to eliminate a great deal of communication, command, and control interfacing between various components within personal video recorders and other systems that seek to perform decoding and presentation of data that is received via a TS.[0053]
• FIG. 5 is a system diagram illustrating an embodiment of a simplified digital[0054]channel recording process500 that is performed in accordance with certain aspects of the present invention. The FIG. 5 shows one embodiment where digital channel recording may be performed, in a simplified manner when compared to previous systems, using certain aspects of the present invention. The recording process of digital video stream is given in the FIG. 1. In this embodiment, a personal video recorder (PVR) digital-channel-recording process can be described as shown below.
• The selected video service will be contained in a transport stream (TS) that is received as shown in a radio frequency (RF) signal that is received by a[0055]tuner510. Thetuner510 is operable to down-convert the channel that contains the transport stream, from RF to intermediate frequency (IF). The Demodulation block, shown as ademodulator515, demodulates the IF to base-band digital data and outputs the transport stream (shown as an MPEG TS) and sends the data to thedecryption block520.
• The[0056]decryption block520 decrypt the packets of the TS into clear data if the service is authorized. This output TS stream goes to theData Transport Processor525. The Data Transport Processor selects only the requested service and then re-multiplexes it into a new TS and stores the new TS data in aTS FIFO buffer532 in synchronous dynamic random access memory (SDRAM)530.
• This new TS is then transferred to a[0057]hard disk550. The data within theTS FIFO buffer532 is operable to be communicates to thehard disk550. TheCPU540 controls the storing of the data from theTS FIFO532 to the hard drive (hard disk550). This is done using DMA engines which sends the data over thePCI bus541 to the super I/O controller chip545 containing the IDE interface to the hard drive (hard disk550) itself. If desired, the IDE ATA-3 Advanced Technology Attachment Interface with Extensions—ATAttachment 3 Interface protocol is employed between the super I/O controller chip545 and thehard disk550. A Start Code Index Table (SCIT)551 is also generated and stored in the hard disk550 (see the next section for detailed description). A TS file552 is then stored within the hard disk552. This TS file552 may include exclusively data portions and also command packet portions in various embodiments.
• The embodiment of the present invention shown in the FIG. 5 shows how a TS may be generated and stored in a[0058]hard disk550 as will be understood by those persons having skill in the art. When the TS file552 may then be read from thehard disk550, TS formatted command packets may then also be inserted within the TS stream that is extracted from the TS file552. Those persons having skill in the art will recognize that TS formatted command packets may be inserted into a TS at any time without compromising the quality of the data contained within the TS.
• FIG. 6 is a system diagram illustrating an embodiment of an analog[0059]channel recording process600 that is performed in accordance with certain aspects of the present invention. A personal video recorder can accept an analog channel from either the tuner or from the baseband line inputs on the back panel of its device.
• The analog channel record path for each of these two cases may be described as shown below. A[0060]tuner610 receives a radio frequency (RF) signal and down-convert the selected channel to an intermediate frequency (IF) signal. The IF signal is then passed to the analog descramble block616. The analog descramble block616 will then demodulate the IF to base-band analog video and audio. If the channel is encrypted, the analog descramble block616 will also decrypt the signals (provided that it is authorized to do so). The video component from the analog descramble block616 is passed to avideo switcher block618 from which an analog video signal is passed to avideo decoder620. Thevideo switcher block620 also receives a line in video signal as well. The analog audio signal, from the analog descramble block616, is passed to an audio analog to digital converter (ADC)672. Anotheraudio ADC671 is placed in parallel with theaudio ADC672; theaudio ADC671 receives a lien in audio signal. The outputs from the outputs from both theaudio ADCs671 and672 are provided as serial I²S data streams and compresses them and multiplexes them (using MUX675) into a serial I²S data stream that is provided to an MPEGaudio encoder block681 within theMPEG encoder chip680.
• After the video component is then passed to the[0061]video decoder620, thevideo decoder620 converts it to an 8 bit parallel data stream that is then sent to an MPEGvideo encoder block682 within anMPEG encoder chip680. TheMPEG encoder chip680 accepts the digitized video (in CCIR656 format, if desired) and digitized audio (from the MUX675) and compresses them and then multiplexes them (using a MUX675) to an MPEG TS. The MPEG TS is a MPEG 2 Transport Stream in one particular embodiment. If desired, this now digitized MPEG TS may be communicated to other devices via aPCI bus641. The MPEG TS is then passed to adata transport processor626. The TS processing in thedata transport processor626 stores the data in aTS FIFO buffer632 in aSDRAM630. ACPU640 controls storing the data from theTS FIFO632 to the hard drive/hard drive660. This may be performed using any one or more of various DMA engines that send the data over a PCI bus641 (after having passed through a PCI I/F636) to a super I/O controller chip646 containing the IDE interface to the hard drive/hard disk660 itself. Again, the interfacing between the super I/O controller chip646 and thehard disk660 may be performed using the IDE ATA-3 protocol. The start code index table (SCIT) is also generated and stored in the hard drive/hard disk660. Ultimately, aTS file662 is stored on thehard disk660. TheTS file662 may then be retrieved for playback or for transmission to other components or devices.
• The embodiment of the present invention shown in the FIG. 5 shows how a TS may be generated and stored in a[0062]hard disk660 as will be understood by those persons having skill in the art. When the TS file662 may then be read from thehard disk660, TS formatted command packets may then also be inserted within the TS stream that is extracted from theTS file662. Those persons having skill in the art will recognize that TS formatted command packets may be inserted into a TS at any time without compromising the quality of the data contained within the TS.
• FIG. 7 is a system diagram illustrating an embodiment of a[0063]video playback process700 that is performed in accordance with certain aspects of the present invention. The particular example of video data retrieval and playback is shown in the FIG. 7, but those persons having skill in the art will appreciate that these aspects of the present invention are also extendible to retrieval and playback of other types of data, including audio data and other digital data types.
• For a program recorded on the hard drive/[0064]hard disk710, a personal video recorder, or other operable system, can play back that program using the steps described below in the system diagram of the FIG. 7. A processor, that may include aCPU790, reads the TS data (shown as the TS file712) from the hard drive/hard disk710 based on the user selected playback mode. The correct TS data (from the TS file712 within the hard drive/hard disk710) is read intoTS presentation buffer732 within a SDRAM730 using DMA engines.
• Data may be read from the hard drive/[0065]hard disk710 in a similar to the manner in which data is written into the hard drive/hard disk710, a super I/O controller chip720 may communicatively couple with thehard disk710 and perform data transfer using the IDE ATA-3 protocol. The super I/O controller chip720 then communicatively couples to theTS presentation buffer732 within the SDRAM730 via a PCI bus723 and a PCI I/F725. The data is output from theTS presentation buffer732 and is then passed to adata transport processor735. The data transport processor then de-multiplex the TS into its PES constituents and passes the audio TS to anaudio decoder760 and the video TS to a video transport processor740 and then to aMPEG video decoder745 that is operable to decode and extract embedded, TS formatted command packets, that may include instructions to perform trick play functionality. The audio data is then sent to the output blocks, and the video is sent to adisplay engine750. Thedisplay engine750 is responsible for and operable to perform scaling the video picture, rendering the graphics, and constructing the complete display among other functions. Once the display is ready to be presented, it is passed to avideo encoder755 where it is converted to analog video using an internal digital to analog converter (DAC). The digital audio is converted to analog in the audio digital to analog converter (DAC)765 while a Sony Philips Digital Inter-Face (SPDIF) output stream is also generated and transmitted.
• The FIG. 7 shows just one embodiment where a digital signal may be retrieved from a hard disk and transformed for playback. Those persons having skill in the art will also appreciate that any number of TS formatted command packets, contained within the TS file[0066]712 as it is stored in thehard disk710, or that are inserted into the TS during its transport throughout a personal video recorder or a video playback system. An MPEG video decoder, such as theMPEG video decoder745, that is operable to decode, interpret, and perform the commands included within the TS may perform the directed functions without necessitating the large degree of command and control interfacing that is required in previous systems. The ability to include commands, within TS formatted command packets within a TS, eliminates a great deal of interfacing and also greatly reduces the real estate consumption within a system that performs such functions. Again, if the decoder is inoperable to decode these TS formatted command packets, then they will simply be identified as corrupted data within the TS and ignored and discarded. Clearly, the these TS formatted command packets may alternatively be identified as being irrelevant data within the TS and ignored and may also be discarded.
• FIG. 8 is a functional block diagram illustrating an embodiment of a[0067]command packet method800 that is performed in accordance with certain aspects of the present invention. In ablock810, a command is formatted into a packet having a TS format. Then, the TS formatted command packet is encoded/inserted into the TS in ablock820. Various decisions may be used to determine where particularly the TS formatted command packet(s) is/are to be inserted within the TS. Then, in ablock830, the TS (having the TS formatted command packets) is decoded where the commands within the TS formatted command packets are extracted. In a block840, the appropriate playback is performed using the commands that were retrieved from the TS formatted command packets.
• Very generically, the embodiment of the present invention shown in the FIG. 8 shows how commands may be formatted into TS format, then inserted or encoded into a TS. Then, during the decoding of the TS, those previously encoded commands may be extracted during the decoding of the various packets of the TS. The present invention is adaptable to encoding commands, including trick play commands, into MPEG TS format and then inserting those TS formatted command packets commands into an MPEG TS. The TS formatted command packets may include how to handle the entirety of the data within the TS, or portions of data within the TS. Those persons having skill in the art will appreciate that a number of TS formatted command packets may be included within a given TS and various portions of data within the TS may be handled differently. For example, normal playback may be performed on one portion, fast forward (FF) may be performed on another portion, rewind (REW) may be performed on yet another portion, and so on. By embedding commands within the TS itself, using certain aspects of the present invention, the great deal of interfacing between various components may be greatly reduced.[0068]
• FIG. 9 is a functional block diagram illustrating an embodiment of a transport stream (TS)[0069]decoding method900 that is performed in accordance with certain aspects of the present invention. In ablock910, points within an MPEG TS are marked to allow for efficient decoding of the TS. The TS has one or more TS formatted command packets contained within it. Then, in a block920, an entry point (EP) picture of the TS is calculated based on certain parameters of the TS. As shown in ablock925, certain of theparameters925 may include parameters indicating atrick play mode926, acurrent location927, a number of possible entry points928, . . . , and anyother parameter929 that may be desired in a particular application.
• Then, in a[0070]block930, the selected operation, as provided within a TS formatted command packet contained within the TS, is performed on the MPEG TS at the EP picture of the TS. Thevarious operations935 may include any number of operations as described here and in other embodiments of the present invention. For example, theoperations935 may include operations such astrick play936,playback937, . . . , and anyother operation939 that may be desired in a particular application.
• As shown in this particular embodiment, a command may be included within a TS, as a TS formatted command packet, and the then decoded command packet may be used to govern the handling of portions of the TS. In addition, those persons having skill in the art will appreciate that the EP picture may be calculated at any desired point within the TS, as governed by the use and consideration of one or more of the[0071]parameters925.
• From other perspectives, in order to support trick-play modes on playback, a decoder needs a way to randomly access the recorded TS that has been stored on a hard drive. The decoder also needs to be able to maintain its real time display by limiting the data transferred to only those data that are required for building the pictures corresponding to the selected trick-play mode. One way to achieve this is to mark certain entry points in the stream that would efficiently allow a complete picture to be decoded (as shown in the block[0072]910). The CPU could then compute the next entry point of the stream based on the current trick-play mode, its current location, and the set of possible entry points (as shown in the block920). Then, the appropriate operation may be performed on portions of the TS (as shown in the block930).
• Also, it will be appreciated that various command operations may be associated with various portions of the TS. As mentioned above in various embodiments, normal playback may be performed on one portion, fast forward (FF) may be performed on another portion, rewind (REW) may be performed on yet another portion, and so on.[0073]
• The structure of the TS formatted command packets may take on various forms without departing from the scope and spirit of the invention. Any format where the command packets may be formatted so that they may be inserted within the TS and transported in the similar manner in which the TS is communicated. The present invention is adaptable to MPEG-2 TS formats as well other TS formats where command packets are encoded into TS formatted command packets so that the command may be extracted when the TS formatted command packet is decoded.[0074]
• One embodiment of the structure and organization of a MPEG-2 TS formatted command packet (as included within an MPEG-2 TS) that may be employed in a personal video recorder or other system, is described below as follows:[0075]
• The collection of data points that include entry points for a video stream forms a Start Code Index Table (SCIT), and the SCIT is stored in the hard drive in a recording processes (see FIGS. 5 and 6 for two possible embodiments). The SCIT provides important information about the location of all the non-slice start codes (including the PES Start codes), and only the first slice code following a non-slice start code in a record buffer. More specifically, the SCIT contains the following fields:[0076]
• 1. The start code value (SCV)[0077]
• 2. Two bytes following the start code value (SCV): The two bytes following the slice start code can be used to check the intra_slice and intra_slice_flag fields to determine the entry point picture. In a Progressive Refresh MPEG-2 bit stream (see Appendix for definition), pictures that have the first row (slice) as Intra are deemed to be the Entry Point (EP) pictures. The CPU uses the pointer of the first slice of every picture and inspects the data in the Elementary Stream. The format of the elementary stream is as follows:[0078]

  	{

  	slice_start_code	32 bits
  	quantiser_scale_code	5 bits
  	if(nextbits() == '1'){

  	intra_slice_flag	1bit
  	intra_slice
  	1 bit
  	reserved_bits	7 bits
  	while(nextbits() == '1') {

  	extra_bit_slice /* value of 1 */	1 bit
  	extra_information_slice	8 bits

  }

  }

  	extra_bit_slice /* value of 0 */	1 bit
  	...

• The CPU then has to inspect the field intra_slice_flag. If it is found to be set, the next field intra slice is inspected. If that is found to be a ‘1’, then the slice is deemed to be an intra slice. If the first slice is found to be an intra Slice, this picture is marked as an Entry point picture. If the intra_slice_flag is zero, or intra_slice is zero, then this slice is not an intra slice and hence this picture is not an Entry Point picture.[0079]
• 3. Packet offset: This gives the offset in bytes of the first zero byte of a start code pattern 00 00 01 SCV from the start of that packet.[0080]
• 4. Record count: Record count gives the number of bytes from the start of this record session to the start of the transport packet containing the start code for this entry. A count of zero indicates the first byte in this session.[0081]
• 5. Flag to indicate if any packets were dropped[0082]
• 6. Flag to indicate if any continuity counter error was detected[0083]
• 7. Flag to indicate if the transport error indicator was set in one of the recorded packets (MPEG)[0084]
• 8. Flag to indicate if a start code index entry was dropped due to internal buffer overflow[0085]
• 9. Flag to indicate if the previous PES packet had an error in its length[0086]
• Note: If the SCV reads a value of 0xFE, then the rest of the fields give the PTS values and not the ones mentioned above.[0087]
• An SCIT can be described in the following table. The range of values M[0088]1, M2 . . . can be between 0 and 187 corresponding to size of the TS packet.

  	Packet	Record	Entry
  SCV	Offset	Count	Picture	. . .	. . .	. . .	. . .	. . .
  E0	M1	N1	NO	. . .	. . .	. . .	. . .	. . .
  B3	M2	N2	NO	. . .	. . .	. . .	. . .	. . .
  B8	M3	N3	NO	. . .	. . .	. . .	. . .	. . .
  00	M4	N4	NO	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  01	M6	N6	YES	. . .	. . .	. . .	. . .	. . .
  00	M7	N7	NO	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  01	M10	N10	NO	. . .	. . .	. . .	. . .	. . .
  00	M11	N11	NO	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  01	M14	N14	NO	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  00	M48	N48	NO	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  01	M50	N50	YES	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .
  . . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .	. . .

• It is also noted that the CPU picks the SCIT and linearizes the addresses as it writes to the hard disk. The packet offset and the record count points to the start code in the record life.[0089]
• FIG. 10 is a functional block diagram illustrating an embodiment of a transport stream (TS) transport/parse method[0090]1000 that is performed in accordance with certain aspects of the present invention. In ablock1010, a TS is received. This may include receipt of multiple packets within a TS or a single packet within a TS. Alternatively, the entirety of the TS may be received in theblock1010. From certain perspectives, a Data Transport driver (DTD), built in accordance with certain aspects of the present invention, is responsible for data flow of the stream to be played back through a Data Transport (and/or Video Transport) Processor. In ablock1020, the DTD will also insert a “Transport Packet” (TP) into the actual TRANSPORT STREAM; the TP may be viewed as being Transport Command Packet(s)—containing various commands. The TP may be referred to as another terminology for a TS formatted command packet as described in other of the various embodiments of the present invention. The terminology of a TP and a TS formatted command packet may be used interchangeably. Then, in ablock1030, the TS (that now contains the TS formatted command packet) is transmitted to a Video Transport Processor (VTP) and a Video decoder. Thereafter, in ablock1040, that TP (or TS formatted command packet) is then identified. There exist several options understood by those persons having skill in the art for uniquely identifying a type of packet from among a group of packets. Here, the TP/TS formatted command packet is identified using any of a number of methods. The “Transport Packet”/TS formatted command packet that contains the command fields.
• There exist a number of options in which to parse the command structure of a TP/TS formatted command packet. Two particular embodiments are described in the FIG. 10.[0091]
• A first option:[0092]
• In a[0093]block1050, the process identification (PID) number of the TP/TS formatted command packet is identified. If desired, a CPU indicates the PID number of the TP. Then, in ablock1060, this detected PID number is provided to a Video Transport Processor (VTP). Then, in a block1070, a command structure is parsed accordingly. This may be performed using the VTP. It is also noted that this option means that firmware flow must then be disturbed to accommodate handling of such PID numbers.
• A second option:[0094]
• In this option, the PID number of the TP/TS formatted command packet is the same as the video PID number, as shown in a functional block[0095]1055. If desired in this situation, the command packet contains an Adaptation Field only and no payload, as shown in afunctional block1057. Then, in a block1065, the command structure is placed in a private field of the adaptation field. Then, a signature uniquely identifies this packet as a TP/TS formatted command packet in a block1075. A 32-bit signature may be used in certain embodiments. In addition, a continuity_counter of the TP/TS formatted command packet is ignored as shown in ablock1077 within the functional block1075.
• Some other considerations may be implemented to perform this second option as well. The field structure of the TP/TS formatted command packet is shown in the table below. All the Video related command/parameter fields are explained in the next section.[0096]

  FIELD	NO OF BITS	VALUE

  SYNC_BYTE	8	47H
  TRANSPORT_ERROR_INDICATOR
  	1	0
  PAYLOAD_UNIT_START_INDICATOR	1	0
  TRANSPORT_PRIORITY	1	0
  PID	13	VIDEO_PID in Hex
  TRANSPORT_SCRAMBLING_CONTROL	2	00B
  ADAPTATION_FIELD_CONTROL	2	10B
  CONTINUITY_COUNTER	4	X
  ADAPTATION_FIELD_LENGTH	8	183D
  ADAPTATION_FLAG	8	02H or 82H
  TRANSPORT_PRIVATE_DATA_LENGTH	8	15D
  ALIGN_BYTE	8	0
  SIGNATURE_32BITS	32	4252434DH
  MODE	32	MODE
  SKIP_COUNT	32	SKIP_COUNT
  DISPLAY_COUNT	32	DISPLAY_COUNT
  PICTURE_START_PACKET	32	PICTURE_START_PACKET
  PICTURE_START_BYTE	32	PICTURE_START_BYTE
  PICTURE_END_PACKET	32	PICTURE_END_PACKET
  PICTURE_END_BYTE	32	PICTURE_END_BYTE
  DISCARD_HEADEND	32	DISCARD_HEADEND
  DISCARD_TAILEND	32	DISCARD_TAILEND
  DXPORT_VALUE	32	DXPORT_VALUE
  STUFFING_BYTE	132 bytes	XX

• A TP/TS formatted command packet shall come prior to the packet containing the corresponding PICTURE_START. The command in a TP/TS formatted command packet is valid over all the pictures given by the command and all the packets given by the PICTURE_START and PICTURE_END fields. This means that a TP/TS formatted command packet can be encountered by the Video Transport before the count provided by the previous TP/TS formatted command packet.[0097]
• FIG. 11 is a functional block diagram illustrating an embodiment of[0098]playback method options1100 that may be performed in accordance with certain aspects of the present invention. The playback that may be performed using aspects of the present invention essentially fall into three different modes, Normal playback1110,Fast Forward1120, andRewind1130. A user should be able to switch between these modes with minimal distortions at changeovers. During Playback, a CPU reads the data from the hard disk and places it in Playback buffers in the DRAM belonging to the chip. The CPU operates on segments of the elementary stream (ES) from one Entry Point (EP) picture to the other. It determines the EP picture by inspecting the two bytes following the start code value (SCV).
• FIG. 12 is a functional block diagram illustrating an embodiment of a[0099]playback method1200 that is performed in accordance with certain aspects of the present invention. During Playback, data is read from memory in ablock1210. This reading of data is from the hard disk in certain embodiments. Then, in ablock1220, the data is placed in a playback buffer. These playback buffers are in the DRAM belonging to the chip, as shown in ablock1225 in certain embodiments. Then, in ablock1230, the data segments of the elementary stream (ES) from one entry point (EP) picture to the other EP picture of the data segment. Moreover, the determination of the EP picture is made by inspecting the two bytes following the start code value (SCV) as shown in ablock1235.
• FIG. 13 is a functional block diagram illustrating an embodiment of a video[0100]transport processing method1300 that is performed in accordance with certain aspects of the present invention. In the Transport based PROGRESSIVE REFRESH STREAM, the VIDEO TRANSPORT PROCESSOR is responsible for sending the elementary stream (ES) with proper boundaries to the VBV (compressed data buffer). This may be described as shown in ablock1310 where an elementary stream (ES) with the proper boundaries is sent to the VBV (compressed data buffer). It also passes some of the command parameters in the TP/TS formatted command packet to the MPEG VIDEO DECODER through a start code table (SCT) Buffer. This may be described as shown in afunctional block1320. It is also noted that this SCT buffer should not be confused with the SCIT generated in the data transport.
• The data flow of the Playback stream is described below in the following Figures and disclosure during the different modes of operation. The following notations are presented to assist in explaining the data flow of a TS in accordance with certain aspects of the present invention.[0101]
• EP[0102]_mdenotes the m^thEntry Point Picture, where m is an integer, that represents an arbitrary entry point.
• P[0103]_m.ndenotes n^thPicture after m^thEntry Point Picture, where m and n are integers. This means that P_m.0are the pictures with intra-slice fields set.
• EP[0104]_mto EP_m+1form segment m, EP_m+1to EP_m+2form segment m+1 and so on
• TPB[0105]_i,jmeans the Transport Packet Byte at an offset j from byte zero in the transport packet ii from the current packet. This will be used extensively for pointing to a start code and the packet containing it from the TP/TS formatted command packet.
• The following commands need to be given by the Data Transport to the VIDEO TRANSPORT PROCESSOR through the TP/TS formatted command packet. The command is applicable for all the pictures following this TP/TS formatted command packet till the picture pointed by the next TP/TS formatted command packet. Here, a “command” means the concatenation of all the following fields.[0106]
• MODE: This field gives the following commands to the Video Transport and the Decoder[0107]
• 00 PLAY[0108]
• 01 DISPLAY[0109]
• 02 BUILD_REFERENCE[0110]
• 03 PROCESS[0111]
• 04 DISCARD_TILL_BTP[0112]
• PLAY: This command puts the Video Decoder in the normal mode. The pictures following this command are treated as any normal stream by the decoder.[0113]
• DISPLAY: This command puts the Video Decoder in the display mode. For a given picture sequence, the Video Decoder decodes all the pictures but displays only the last of the “displayable” picture[0114]
• BUILD_REFERENCE: This command puts the Video Decoder in the decode mode. For a given segment, the Video Decoder builds a reference picture.[0115]
• PROCESS: This command causes the Video Transport to process DISCARD_HEADEND and DISCARD_TAILEND only. The SKIP_COUNT and DISPLAY_COUNT fields are not sent to the Video Decoder. This command is meant for Video Transport.[0116]
• But note that the DISCARD_HEADEND and DISCARD_TAILEND fields are processed for all the above commands.[0117]
• DISCARD_TILL_BTP: This causes the Video Transport to discard only the video ES data bytes starting from the transport packet that follows till the next BTP for that PID. When this field is zero, the Video Transport will not discard ES till the next BTP.[0118]
• SKIP_COUNT: This field specifies the number of pictures to be skipped before sending a picture to display. Using the Play command with a skip count of 1 achieves a fast forward (FF) of ×2. If the picture to be skipped is a B picture, it is also skipped from processing.[0119]
• DISPLAY_COUNT: This field specifies the number of displayable pictures starting from the picture that follows the TP/TS formatted command packet for which the corresponding command has to be used.[0120]
• Typically,[0121]
• this field will be “0” for BUILD_REFERENCE mode[0122]
• this field will be “1” for Rewind mode[0123]
• this field will be equal to number of pictures in an EP segment in the normal playback mode[0124]
• this field will be equal to (int) ((number of pictures in an EP segment)/(skip_count+1))[0125]
• PICTURE_START: This field informs the location of the start of the first picture following a TP for which the command has to be applied, by pointing to the first byte of the start code sequence from the start of the packet in which it is present. This is represented by TPB[0126]_i,j.
• PICTURE_END: This field informs the location of the start of a picture following a TP/TS formatted command packet over which the command has to be applied. This means the command is valid for all the pictures starting from the PICTURE_START till the picture preceding the one indicated by this field. This is represented by TPB[0127]_i,jand gives first byte of the start code sequence from the start of that packet.
• DISCARD_HEADEND: This enables the Video Transport to discard all the bytes from the start of the payload till the offset mentioned in this field. A value of 0 means no byte has to be discarded.[0128]
• This field is useful in case of Fast Forward and for decoding the sequence header[0129]
• DISCARD_TAILEND: This enables the Video Transport to discard all the bytes from the offset mentioned in this field till the end of the packet. A value of 0 means no byte has to be discarded.[0130]
• This field is useful in case of Fast Forward and for decoding the sequence header.[0131]
• DXPORT_VALUE: The value in this field is used for piggybacking in the one of the non-slice entry in the SCV table. During the trick mode changes, the Video Decoder returns this value whenever the data transport driver calls a get(DXPORT_VALUE) function. This value could be a PTS value or an offset in the SCIT table. This ensures a quick response during the trick mode changes.[0132]
• It is also noted that a “command” is applicable over all the pictures present between PICTURE_START and PICTURE_END. Again, the command may be extracted from a TP/TS formatted command packet.[0133]
• FIG. 14 is a functional block diagram illustrating an embodiment of a[0134]normal playback method1400 that is performed in accordance with certain aspects of the present invention. Now, using the general mechanism and the commands listed above, thenormal playback method1400 may be achieved in the following manner. In ablock1405, a CPU refers to the start code index table (SCIT) that it had picked during the record function. Then, in ablock1410, the CPU finds a Sequence Header (SH) in the SCIT and begins to feed the data from that Sequence Header until the beginning of the picture following the Sequence Header.
• If the next picture is an entry point (EP) picture, then it continues to feed the data from that picture as shown in a[0135]block1415. However there is an exception. If the first picture after the Sequence header and the corresponding extensions is not an EP picture, then the CPU searches the SCIT for the first EP picture and begins feeding data from that point till the beginning of the next EP picture as shown in ablock1417 within thefunctional block1415.
• In a[0136]block1420, the CPU also inserts a TP/TS formatted command packet (containing the command) for the VIDEO TRANSPORT PROCESSOR and the video decoder. The MODE is set for PLAY in ablock1425, and the SKIP_COUNT is programmed to zero in a block1435. Then, in ablock1440, the DISPLAY_COUNT field informs the number of pictures to be displayed. Typically, this value is the number of pictures in an EP segment as shown in a block1442. Then, the VIDEO TRANSPORT PROCESSOR is placed in the Transport Mode in ablock1445. The VIDEO TRANSPORT PROCESSOR transfers the commands to the video decoder through the start code table (SCT) in a block1450. The Video decoder then picks a command from the Start Code Table (SCT) buffer1460. The command is then decode in ablock1470, and the command tells the video decoder that it is Normal Playback, and then this would also give the number of pictures that command has been issued for. Ultimately, the Compressed Data Buffer (VBV) Manager is kicked off to read data from the VBV and feed it to the Parser and the Row Decoders as shown in ablock1475.
• It is also noted that wherever a mention is made of the CPU sending the pictures, it is assumed that it starts from the transport packet starting with the PES that contains the picture. Using the PICTURE_START and PICTURE_END fields, the Video Transport will get to the right byte of the elementary stream in the transport packets.[0137]
• The VIDEO TRANSPORT PROCESSOR is responsible for extracting from the Transport packets and sending the ES with proper boundaries to the VBV (compressed data buffer). It also passes the Video related commands/parameters in the TP to the MPEG VIDEO DECODER through SCT Buffer (this should not be confused with the SCIT generated in the data transport)for the video decoder. The VIDEO TRANSPORT PROCESSOR gets to the start and end of a picture by looking at the PICTURE_START and PICTURE_END fields, both of which, are represented by TPB[0138]_i,j.
• FIG. 15 is a functional block diagram illustrating an embodiment of a fast forward playback method[0139]1500 that is performed in accordance with certain aspects of the present invention. There are many modes in which fast forward (FF) may be performed in accordance with the present invention. Two potential cases will be described below in the FIG. 15.
• A first option is a mode in which the fast forward rate is such that there is a minimum of one frame to display over two segments as shown in a[0140]block1505. In this case as shown in ablock1510, the CPU does not do anything different compared to the normal playback as far as feeding the data is concerned. One change, however, is that the SKIP_COUNT is a non-zero value as shown in ablock1515. A value of 1 would cause the Video Decoder to drop every other picture from the display process, achieving a Fast Forward rate of ×2.
• A second option is a mode in which the fast forward rate is such that the adjacent pictures are placed over a minimum of three segments as shown in a[0141]block1525. In this case, the CPU needs to do some scheduling of the data as shown in ablock1530.
• For example, if a picture P[0142]_m.nis to be displayed, a reference picture is built by feeding the segment between EP_m−1to EP_m. The CPU needs to configure video in BUILD_REFERENCE mode. The SKIP_COUNT needs to be programmed to x-1 and DISPLAY_COUNT needs to be 0, where x is the total number of pictures in the segment.
• The CPU then feeds the pictures P[0143]_m,0to P_m,nin the segment from EP_mto EP_m+1, which is to be used for the actual decode and display. The video has to be configured in PLAY mode. The CPU programs the DISPLAY_COUNT to 1 and the SKIP_COUNT with n−1 to display the picture P_m.n.
• This second mode or case of fast forward is similar to the rewind, which is described in detail in the next section.[0144]
• FIG. 16 is a functional block diagram illustrating an embodiment of a rewind playback data flow method[0145]1600 that is performed in accordance with certain aspects of the present invention. During rewind, the CPU plays a major role in scheduling the data in the correct order. In order to correctly decode and display a particular frame, it is important that all the pictures before it were indeed created using “good” data. Since PROGRESSIVE REFRESH streams have no I pictures, but are progressively refreshed, the CPU first feeds an EP-EP segment into the Playback Buffers to build a good reference picture as shown in ablock1605. Then, the CPU needs to configure the video in BUILD_REFERENCE mode as shown in a block1610.
• In a[0146]block1615, the SKIP_COUNT needs to be programmed to x-1 and DISPLAY_COUNT needs to be 0, where x is the total number of pictures in the segment. The CPU then feeds the next EP-EP segment, which is to be used for the actual decode and display, as shown in a block1620. The CPU configures the video in REWIND mode s shown in a block1625. Then, in ablock1630, the picture P_m,nis displayed. The DISPLAY_COUNT is set to 1 in ablock1632 and the SKIP_COUNT is set to n−1 in ablock1634 to display the picture P_m.n.
• Then, in a[0147]block1640, the backward rate of the rewind data flow is determined. If the CPU desires to go backwards at a ×1 rate (in a block1642), then it resends the same segment that it supplied for the n^thpicture, every time reducing the SKIP_COUNT fields value by one (1). The CPU also inserts a TP/TS formatted command packet (containing the command) for the VIDEO TRANSPORT PROCESSOR and the video decoder.
• FIG. 17 is a functional block diagram illustrating an embodiment of a rewind playback control flow method that is performed in accordance with certain aspects of the present invention. In a block[0148]1705, the VIDEO TRANSPORT PROCESSOR transfers the commands from the TP/TS formatted command packet and places it in the Start Code Table (SCT) for use by video decoder. Then, in ablock1710, the Video decoder picks the command from the SCT and decides what to do with the data in the compressed data buffer (VBV). The command tells the video decoder that it is Rewind Build (using BUILD_REFERENCE, for example). The command also gives the number of pictures that it has been issued for in theblock1710.
• Then, in a[0149]block1715, the VBV Manager is kicked off to read data from the VBV. In ablock1720, the data is fed to a Parser. Since this is a REFERENCE_BUILD, the Buffer manager does not push any picture into the Display Queue. In ablock1725, if a B picture is encountered, the Buffer Manager sets a flag to indicate to the VBV manager to drop that picture from Decode. The VBV manager begins to start feeding the compressed data to the Row Decoders in ablock1730. The buffer manager uses all the three/four buffers in the BUILD_REFERENCE mode.
• Then, in a[0150]block1735, the Video decoder decodes the SKIP_COUNT number of pictures from the VBV. Once the SKIP_COUNT runs out, the last buffer that was used for decode is marked as “LockedReferenceBuffer” for future references in ablock1740. This Special lock is over and above the common “locked for decode” that exists in the design today. When the Video Decoder is configured in the REWIND command, the video decoder reads compressed data from the VBV to generate one displayable picture.
• Then, in a[0151]block1745, the command specifies the number of pictures that need to be decoded in order to display the desired picture. The Buffer Manager uses the “Locked” buffer as the buffer for Forward Prediction if it finds the ‘UseReferenceBuffer’ SET in a block1750. It also clears the Flag so that it does not get used again for that Command session.
• In a[0152]block1755, all subsequent pictures are decoded normally, constantly updating the buffers that are used for Forward and Backward predictions. The buffer manager is careful not to overwrite the Locked Reference Buffer. In the Three buffers mode, since one of the buffers is Locked, the other two are used for the decoding of the I/P pictures and the B pictures are discarded. In the four buffer mode, the B pictures that are intended for Display are only decoded.
• In a[0153]block1760, the skip count is reduced for every picture that the Buffer Manager encounters. If a B picture is encountered, then the skip count is reduced and a flag is set to indicate the VBV manager to skip that picture. If the skip count becomes zero on a picture, then it is intended that, that picture has to be displayed. In the four buffer scheme, if that picture is a B picture, then we decode and display that picture. However, if we are working in the three buffer mode, then we will not even have a buffer to decode that B picture into as one of the buffers would be the Locked Reference frame and the other two would be carrying the current I/P Forward and Backward prediction reference frames. In such a scenario, the previously decoded picture, (the current Backward prediction buffer) is pushed for display queue.
• Below an example is described to illustrate the operation of certain aspects of the present invention that are described above in the various embodiments of the present invention.[0154]
• For example, if the pictures to be displayed are P[0155]_m,n, P_m,n−1, P_m,n−2, P_m,n−3and so on, following sequence needs to be followed:
• A reference picture is built by feeding the segment between EP[0156]_m−1to EP_m. To achieve this, the CPU needs to configure video in BUILD_REFERENCE command. The DISPLAY_COUNT needs to be programmed to 0 and SKIP_COUNT to x-1, where x is the total number of pictures in the segment.
• The CPU then feeds the pictures from P[0157]_m,0to P_m,nin the segment from EP_mto EP_m+1, which is to be used for the actual decode and display. The CPU has to configure video in the REWIND mode. The DISPLAY_COUNT should be programmed to 1 and SKIP_COUNT to n−1 to display the picture P_m.n.
• Similarly, the CPU again feeds the pictures from P[0158]_m,0to P_m,n−1in the segment from EP_mto EP_m+1, which is to be used for the actual decode and display time. Again, the CPU needs to configure video in REWIND mode. But, this time, the DISPLAY_COUNT should be programmed to 1 and SKIP_COUNT to n−2 to display the picture display the picture P_m.n−1. The above process is repeated, decreasing the SKIP_COUNT, till the picture P_m.0is displayed.
• The decoding of the sequence headers is described below. From the SCIT, the CPU knows the packet that contains the sequence header. The CPU can send only the sequence header data to the video by sending a TP before the packet containing the sequence header. This TP could contain the command that instructs the VIDEO TRANSPORT PROCESSOR to discard the bytes between Transport Header and the PICTURE_START and/or to discard the bytes starting from the start code following the Sequence header till the end of the packet. The DISCARD_HEADEND and the DISCARD_TAILEND field have to be programmed accordingly.[0159]
• For example, if a packet contains sequence header starts from byte offset[0160]10 and the start code following it (and if this start code is not of interest at this point) starts at byte offset150, the DISCARD_HEADEND and DISCARD_TAILEND should be programmed to 10 and 150 respectively. As long as the TP that follows next contains valid values, the other fields in this TP can have any value. The video is put in PROCESS mode.
• In view of the above detailed description of the invention and associated drawings, other modifications and variations will now become apparent to those skilled in the art. It should also be apparent that such other modifications and variations may be effected without departing from the spirit and scope of the invention.[0161]
APPENDIXMPEG-2 Video in the Progressive-Refresh Mode
• In an MPEG-2 coded bit stream, the coded picture following a group of pictures (GOP) header shall be a coded I-picture. However, if there is no GOP header in the bit stream, I-pictures are not mandated in the bit stream. One of “no I-picture” bit streams is called the progressive refresh bit stream by Motorola (DigiCipher II).[0162]
• When the (DigiCipher II) encoder is configured for progressive refresh, the refresh depth is specified. This depth is ranged from 1 to 9 slices per P-picture to be refreshed. The default value is three slices per P-picture while B-pictures are enabled and one slice per P-picture while B-pictures are disabled. One typical configuration is six slices per P-picture while “two B-picture mode” is enabled. In the progressive refresh mode, both intra_slice_flag and intra_slice are set to “1” for the refreshed intra slices.[0163]
• When the (DigiCipher II) encoder is configured for progressive refresh, the vertical search range for motion vectors in a P-picture is restricted. The motion vectors for the macro-blocks located above the refreshed slices in the current P-picture can only point to the region above the refreshed slices in the previous P-picture (as shown in FIG. 18).[0164]
• The sequence header and extensions can be inserted before any P-picture, e.g. before second P-picture shown in FIG. 18. From certain perspectives, the FIG. 18 shows the motion vector search range for the progressive-refresh mode.[0165]

Claims (50)

What is claimed is:

1. A transport stream, comprising:

a data packet having a transport stream format; and

a command packet having a format that substantially complies with the transport stream format; and

wherein the command packet directs an operation to be performed on the packet.

2. The transport stream ofclaim 1, wherein the transport stream comprises a motion picture expert group, MPEG-2 transport stream.

3. The transport stream ofclaim 1, wherein the command packet comprises a header syntax that substantially follows an MPEG-2 transport header syntax.

4. The transport stream ofclaim 1, wherein a decoder decodes the command packet of the transport stream;

the decoder identifies a command within the command packet; and

the decoder executes the command on the data packet.

5. The transport stream ofclaim 1, wherein a decoder decodes the command packet of the transport stream;

the decoder identifies the command packet as an irrelevant data packet; and

the decoder discards the irrelevant data packet.

6. The transport stream ofclaim 1, wherein the command packet comprises at least one trick play operation.

7. The transport stream ofclaim 6, wherein the at least one trick play operation comprises at least one of pause/still, fast forward, rewind, slow forward, slow rewind, and skip.

8. The transport stream ofclaim 1, wherein the command packet is inserted into the transport stream.

9. The transport stream ofclaim 1, wherein the command packet precedes the data packet within the transport stream.

10. The transport stream ofclaim 1, wherein the transport stream is written to a hard disk.

11. The transport stream ofclaim 1, wherein the transport stream is read from a hard disk.

12. The transport stream ofclaim 1, wherein the command packet comprises a plurality of fields.

13. The transport stream ofclaim 12, wherein the plurality of fields comprises information related to a start picture and an end picture.

14. A transport stream decoding method, the method comprising:

receiving a motion picture expert group, MPEG-2 transport stream, the MPEG-2 transport stream comprises an MPEG-2 transport stream formatted command packet;

calculating an entry point picture within the MPEG-2 transport stream based on a parameter;

decoding the MPEG-2 transport stream formatted command packet, thereby identifying an operation; and

executing at least a portion of the operation at the entry point picture.

15. The method ofclaim 14, wherein the operation comprises at least one of playback and trick play.

16. The method ofclaim 15, wherein the trick play comprises at least one of pause/still, fast forward, rewind, slow forward, slow rewind, and skip.

17. The method ofclaim 14, wherein the parameter comprises at least one of a trick play mode, a current location within the MPEG-2 transport stream, and a plurality of possible entry point pictures within the MPEG-2 transport stream.

18. The method ofclaim 14, further comprising calculating at least one additional entry point picture within the MPEG-2 transport stream based on at least one additional parameter.

19. The method ofclaim 18, wherein the parameter and the at least one additional parameter each comprise a common parameter.

20. The method ofclaim 18, wherein the entry point picture comprises a start picture and the at least one additional entry point picture comprises an end picture.

21. The method ofclaim 14, wherein the MPEG-2 transport stream is read from a hard disk.

22. The method ofclaim 14, further comprising:

identifying the MPEG-2 transport stream formatted command packet as a corrupted data packet; and

discarding the corrupted data packet; and

wherein the MPEG-2 transport stream comprises a remaining MPEG-2 transport stream.

23. The method ofclaim 22, further comprising playing back the remaining MPEG-2 transport stream.

24. The method ofclaim 14, further comprising inserting at least one additional MPEG-2 transport stream formatted command packet into the MPEG-2 transport stream.

25. The method ofclaim 14, further comprising executing at least one additional portion of the operation on a plurality of data packets that come after the entry point picture within the MPEG-2 transport stream.

26. The method ofclaim 14, wherein the MPEG-2 transport stream is received from a host processor.

27. The method ofclaim 14, further comprising identifying at least one additional operation by decoding the MPEG-2 transport stream formatted command packet.

28. The method ofclaim 27, wherein the operation corresponds to a data packet within the MPEG-2 transport stream; and

the at least one additional operation corresponds to at least one additional data packet within the MPEG-2 transport stream.

29. The method ofclaim 14, wherein the MPEG-2 transport stream comprises at least one of video data and audio data.

30. A method to perform encoding and decoding of a motion picture expert group, MPEG-2 transport stream, the method comprising:

encoding data into a plurality of data packets having an MPEG-2 transport stream format;

encoding a command into a command packet having an MPEG-2 transport stream format;

generating an MPEG-2 transport stream, the MPEG-2 transport stream comprising the plurality of data packets and the command packet;

communicating the transport stream from a first device to a second device;

decoding the MPEG-2 transport stream, thereby extracting a portion of the data from the plurality of data packets and extracting the command from the command packet; and

performing the command on the portion of the data.

31. The method ofclaim 30, wherein at least one of the first device and the second device comprises a hard disk.

32. The method ofclaim 30, at least one of the first device and the second device comprises a host processor.

33. The method ofclaim 30, wherein command packet precedes a data packet within the plurality of data packets from which the portion of the data is extracted.

34. The method ofclaim 30, wherein the data is received via at least one of a digital channel and an analog channel.

35. The method ofclaim 30, further comprising displaying the portion of the data on a display.

36. The method ofclaim 30, wherein the encoding of the command into the command packet having the MPEG-2 transport stream format is performed substantially immediately before decoding the MPEG-2 transport stream.

37. The method ofclaim 30, further comprising identifying the command packet within the MPEG-2 transport stream.

38. The method ofclaim 37, wherein the command packet is identified during the decoding of the MPEG-2 transport stream.

39. The method ofclaim 30, wherein an MPEG video decoder performs the decoding of the MPEG-2 transport stream.

40. A motion picture expert group, MPEG-2 transport stream having command packets, comprising:

a plurality of data packets having MPEG-2 transport stream format; and

a command packet having MPEG-2 transport stream format; and

wherein the command packet directs an operation to be performed on a data packet within the plurality of data packets; and

the operation comprises trick play.

41. The MPEG-2 transport stream ofclaim 40, wherein the transport stream is communicated from a host processor to a display.

42. The MPEG-2 transport stream ofclaim 40, wherein a decoder decodes the command packet of the transport stream;

the decoder identifies the operation within the command packet; and

the decoder executes the operation on the data packet.

43. The MPEG-2 transport stream ofclaim 40, wherein a decoder decodes the command packet of the MPEG-2 transport stream;

the decoder identifies the command packet as an irrelevant data packet; and

the decoder discards the irrelevant data packet.

44. The MPEG-2 transport stream ofclaim 40, wherein the trick play operation comprises at least one of pause/still, fast forward, rewind, slow forward, slow rewind, and skip.

45. The MPEG-2 transport stream ofclaim 40, wherein the command packet is inserted into the MPEG-2 transport stream.

46. The MPEG-2 transport stream ofclaim 40, wherein the command packet precedes the data packet within the MPEG-2 transport stream.

47. The MPEG-2 transport stream ofclaim 40, wherein the MPEG-2 transport stream is written to a hard disk.

48. The MPEG-2 transport stream ofclaim 40, wherein the MPEG-2 transport stream is read from a hard disk.

49. The MPEG-2 transport stream ofclaim 40, wherein the command packet comprises a plurality of fields.

50. The MPEG-2 transport stream ofclaim 49, wherein the plurality of fields comprises information related to a start picture and an end picture.

Images