BACKGROUND1. Field of the Invention[0001]
This invention relates generally to the field of multimedia systems. More particularly, the invention relates to a multimedia system capable of intelligently processing and storing several independent broadcast multimedia streams (e.g., broadcast cable or satellite streams).[0002]
2. Description of the Related Art[0003]
A prior art system for receiving broadcast multimedia signals is illustrated in FIG. 1. The system includes one or[0004]more tuners120,121 configured to lock on tomultimedia signals100,101 transmitted at a carrier frequency and down-convert the signals to baseband signals. Quadrature Amplitude Modulation (“QAM”)demodulators130,131 demodulate the baseband signals to extract the underlying digital content. As is known in the art, QAM is a modulation technique employed by cable and satellite providers that generates four bits out of one baud. For example, a 600 baud line (600 shifts in the signal per second) can effectively transmit 2,400 bps using this method. Both phase and amplitude are shaped with each baud, resulting in four possible patterns. As indicated in FIG. 1, certain multimedia systems (primarily satellite systems) use a different modulation technique known as Differential Phase Shift Keying (“DPSK”) rather than QAM to demodulate the multimedia signals100-101.
The video signal demodulated by the QAM/[0005]DPSK demodulators130,131 contains a plurality of statistically multiplexed multimedia streams, each containing content for a single cable or satellite “channel” (e.g., HBO). Satellite systems employ a series of transponders for receiving the multiplexed streams and cable systems typically receive the multiplexed streams over 6 Mhz channels. In either case, the multiplexed streams are transmitted at a combined data rate of approximately 40 Mbits/second, as indicated in FIG. 1.
Referring to FIG. 2, each stream/channel may be identified by a predetermined group of packet identification (“PID”) codes.[0006]PID filter modules140,141 extract all packets from the set of multiplexed streams having PID codes associated with a specified stream (e.g., the stream which a user is currently watching). For example, in FIG. 2,PID7 identifies the specified stream's video content andPIDs5 and6 identify the stream's audio left and audio right, respectively. Various additional PIDs may be associated with a stream and used to transmit channel-specific data/content (e.g., dolby digital content, . . . etc).
The multimedia content contained in the stream is then stored on a[0007]mass storage device160, which may be used for temporary storage and/or long term storage of the content. Temporary storage features include pause and rewind functions for live television broadcasts and the ability to begin watching a program after the designated start time for the program. Long term storage functions include the ability to record entire programs for later viewing (similar to the functions provided by standard VCR). The multimedia content is then decompressed/decoded by one or more MPEG-2decoder modules170 before being rendered on atelevision display135.
As illustrated in FIG. 1, prior art systems may also utilize a[0008]main memory126 for storing instructions and data and a central processing unit (“CPU”)125 for executing the instructions and data. For example, the CPU may provide a graphical user interface displayed on the television, allowing the user to select certain television or audio programs for playback and/or storage on themass storage device120. In addition, prior art system also include one or more conditional access modules (not shown) for preventing users from viewing programs which they do not have the right to view (e.g., subscription-based channels such as HBO and pay-per-view events).
SUMMARY OF THE INVENTIONA computer-implemented method is disclosed comprising: storing a first encrypted multimedia stream on a storage device as the stream is broadcast by a content provider; storing a stream of conditional access data on the storage device, the stream of conditional access data associated with the multimedia stream; and decrypting the first encrypted multimedia stream from a specified point within the encrypted multimedia stream using the stream of conditional access data, responsive to a user request to play back the encrypted multimedia stream from the specified point.[0009]
BRIEF DESCRIPTION OF THE DRAWINGSA better understanding of the present invention can be obtained from the following detailed description in conjunction with the following drawings, in which:[0010]
FIG. 1 illustrates a prior art multimedia receiver, storage and playback system.[0011]
FIG. 2 illustrates packetized, statistically multiplexed multimedia content as processed by a prior art system.[0012]
FIG. 3 illustrates one embodiment of a system for storing and processing multiple broadcast multimedia streams.[0013]
FIG. 4 illustrates an embodiment of a system for storing and processing multiple broadcast multimedia streams wherein the streams are demultiplexed before being stored.[0014]
FIG. 5 illustrates more detail of an embodiment of a system for storing and processing multiple broadcast multimedia streams wherein the streams are demultiplexed before being stored.[0015]
FIG. 6 illustrates operation of one embodiment which employs a buffer of a specified duration.[0016]
FIG. 7 illustrates an embodiment in which a user may watch any program currently being broadcast from the beginning.[0017]
FIG. 8 illustrates a graphical user interface for selecting programs from a program guide and/or acquiring additional program-related information according to one embodiment of the invention.[0018]
FIG. 9 illustrates a wideband implementation according to one embodiment of the invention.[0019]
FIG. 10 illustrates operation of a conditional access module and a secure micro unit.[0020]
FIG. 11 illustrates a system for processing multiple multimedia streams and associated conditional access data.[0021]
FIG. 12 illustrates a timestamp index employed in one embodiment of the invention.[0022]
FIG. 13 illustrates techniques for identifying I-frames within a multimedia stream.[0023]
FIG. 14 illustrates operation of a fast forward function according to one embodiment of the invention.[0024]
FIG. 15 illustrates an embodiment witch includes one or more remote nodes for processing multimedia content.[0025]
DETAILED DESCRIPTIONIn the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form to avoid obscuring the underlying principles of the invention.[0026]
Embodiments of a System and Method for Processing Multiple Broadcast Multimedia StreamsAs illustrated in FIG. 3, one embodiment of the invention includes one or[0027]more tuners320,321 for receiving numerous statistically multiplexed streams within a specified frequency range and corresponding QAM and/orDPSK modules330,331 for demodulating the multiplexed streams. Unlike prior art systems, however, the system illustrated in FIG. 3 transfers all of the statistically multiplexed multimedia content (or a subset thereof) directly tomulti-stream buffers361,362 on themass storage device360. The buffers may be configured to store a specified duration of content (e.g., two hours) and/or a specified amount of content (e.g., 80 Gbytes). When a user selects a particular cable or satellite channel, thePID filter modules340 and341 (also referred to herein as a “PID depacketizer”) extract the multimedia packets for that channel (i.e., identified by the channel's PID codes) and reconstruct the underlying audio/video content by combining the packets in the proper order (i.e., the PID filter modules demultiplex and/or depacketize the content). One ormore decoder modules170 then decode the multimedia content using the appropriate decode/decompression algorithm (e.g., MPEG-2 , MPEG-4 , RealVideo® 8, Windows Media Technologies (“WMT”), . . . etc) and transmit the decoded multimedia content to a display135 (e.g., a computer monitor or a television).
As mentioned above, if MPEG-2 is used as the compression algorithm, one set of multiplexed streams may have a combined bitrate approaching 40 Mbits/sec (or 16 Gbytes/hr); two sets, a combined bitrate of 80 Mbits/sec (or 32 Gbytes/hr) as indicated in FIG. 3. Accordingly, the[0028]mass storage device360 of this embodiment is equipped with sufficient storage capacity and read-write bandwidth to store and process the multiplexed signal(s). More specifically, themass storage device360 in one embodiment is coupled to the system via an Ultra DMA-66/Ultra ATA-66 or faster interface (capable of supporting a throughput of at least 528 Mbits/sec), and has a storage capacity of 80 Mbytes or greater. It should be noted, however, that the particular interface type/speed and drive storage capacity is not pertinent to the underlying principles of the invention. For example, various different interfaces such as Small Computer System Interface (“SCSI”) may be used instead of the Ultra-ATA/Ultra DMA interface mentioned above, and various different drive capacities may be employed for storing the incoming digital content.
Storing content from multiple channels/streams on the[0029]mass storage device360 in the foregoing manner provides numerous advantages over prior systems. More specifically, one embodiment of the invention uses the content stored in themulti-stream buffers360,361 to provide trick modes and other short term storage functions for all channels within the statistically-multiplexed group. For example, if a two-hourmulti-stream buffer361 is established, as indicated in theprogram guide600 shown in FIG. 6, a user may pause any channel for up to two hours or rewind any channel back two hours (e.g., at 11:15 PM the user can rewind any channel back to 9:15 PM). Accordingly, if the user watching Program B on HBO East (PIDs1-5 in the example) at 11:15, and decides to watch Program F from the beginning on the HBO Family channel (PIDs11-15 in the example), and indicates so by choosing Program F via a remote control device or cursor control device,selection logic350 will direct thePID filter module340 to extract Program F from themulti-stream buffer361. In this manner, the user will be able to view Program F in its entirety even though the broadcast of Program F started approximately 1{fraction (1/2 )} hours earlier. Similarly, users may select programs on any of the other channels (e.g., Program L on Cinemax® East) broadcast up to two hours earlier. It should be noted that a two-hour buffer is described above merely for the purpose of illustration. Various alternate buffer sizes may be employed while still complying with the underlying principles of the invention.
One embodiment of the invention demultiplexes the incoming multimedia streams before storing them to a multi-stream buffer on the[0030]mass storage device460. As illustrated in FIG. 4, this embodiment includes one or more multistreamPID filter modules440,441 which extract the multimedia streams from the multiplexed signal and store them on themass storage device460 separated from one another. Thus, as illustrated in greater detail in FIG. 5, if the input toPID filter module441 is a set of ‘n’ multiplexed streams, then the output will be ‘n’ independent, demultiplexed streams stored in a demultiplexedmulti-stream buffer502. Storage buffers445,446 may be used by each of the multi-stream PID filters440,441, respectively, to construct a portion of each stream (e.g., several Kbytes) before storing the portion to themass storage device460. This will avoid excessive seeking of the mass storage device460 (e.g., which would result if thestorage device460 were configured to write a small amount of data such as a single PID packet for each stream at a time).
[0031]Selection logic550, responsive to a user request to view a particular program (e.g., via remote control and/or cursor control device), will direct thedecoder module171 to read and decode one of the streams (i.e., the streams associated with PIDs2-3 and101-102 in the example) for rendering on a television orother display device136. The same operations may be performed on a separate group of ‘m’ multiplexed streams extracted by multi-streamPID filter module440.
As indicated in FIG. 5, each of the embodiments described herein may also employ a long[0032]term storage buffer500 for recording programs specified by a user (e.g., similar to the long-term recording functionality of a VCR). In one embodiment, if a user selects a program for recording while the program is already in progress, the program content already stored in one of the demultiplexed multi-stream buffers will be transferred to the longterm storage buffer500 as well as any new program content. Alternatively, or in addition, the program content may simply be reclassified as long term storage content by changing the classification of its directory entry on the storage device rather than moving the content itself.
One benefit of separating the streams before storing them in the foregoing manner is that, in one embodiment, a user will be able to watch any program currently being broadcast from the beginning (i.e., the system will record back on each channel to the last complete program). Thus, as illustrated in the[0033]program guide500 of FIG. 7, at 11:15 a user may watch program N on HBO Signature (PIDs31-35 in the example) from the beginning even though the program started at 8:30. Similarly, the user may watch each of programs B, D, F, G, J and F from start to finish.
In one embodiment, a user may configure different buffer sizes for different channels. For example, a user who regularly watches a number of shows on HBO may decide to establish a large (e.g., 6 hour) buffer for that channel (e.g., by programming the system using a remote control, mouse or other cursor control device), whereas the same user may configure smaller buffers for channels which the user does not watch regularly (e.g., CSPAN). In one embodiment, the system will actively monitor the user's preferences and set larger buffer sizes based on which channels the user views the most frequently and/or the times/days during which the user views the channels. Various other buffer configuration schemes may be employed while still complying with the underlying principles of the invention.[0034]
It should be noted that various system functions described herein (e.g., the[0035]selection logic350,450,550 used to select a particular multimedia stream; the PID filtering; the buffer settings; . . . etc) may be embodied in software executed by theCPU125. Alternatively, or in addition, these functions may be embodied in any combination of hardware (e.g., an application-specific integrated circuit (“ASIC”)), software and/or firmware while still complying with the underlying principles of the invention.
Using the improved buffering techniques described above, one embodiment of the invention provides users with a listing of all currently available programs from which they may select (e.g., those programs which may be viewed in their entirety). As illustrated in FIG. 8, one embodiment of the program listing is provided in the form of an interactive graphical user interface (“GUI”). The user may select a particular program listing by moving a[0036]highlight bar803 through the listings using a cursor control device such as a remote control, keyboard or mouse. When thehighlight bar803 is highlighting the program entry which the user wishes to view, the user may select the program entry by clicking the enter key on the keyboard/remote or the select button on a mouse.
Each program entry in the particular embodiment illustrated in FIG. 8 includes a[0037]video portion800 and aninformational portion801. The video portion in one embodiment is a thumbnail of the actual video content provided over the cable/satellite channel. For example, if the first entry in the program list shown in FIG. 8 is HBO, then thevideo portion800 of the entry will contain actual HBO video content. As a user moves through the various program entries, in one embodiment, the audio associated with that entry will also be generated. Moreover, in one embodiment, the system will display various types of user-specified broadcast content including, for example, live content (i.e., the program as it is currently being broadcast by HBO), recorded content (e.g., the first few minutes of the movie), or previews of the program (e.g., movie trailers). The underlying principles of the invention remain the same regardless of the type of content transmitted to thevideo portion800 of the program entry.
Rendering audio/video content from each of the cable/satellite channels is simplified using embodiments of the present invention because the full set of multiplexed streams/channels are transmitted to the mass storage device and are accessible by the[0038]decoder modules170,171. Such a configuration was not possible in prior systems which only transmit one or two de-multiplexed streams to the mass storage device and decoder modules.
In one embodiment, a[0039]selection region805 will be provided for each program entry. If a user decides that he/she would like the program entry associated with theselection region805 to be saved, the user may simply place a check mark (or other mark) in the selection region corresponding to that entry using a remote control or other cursor control device. The system will then store the program in long term storage and/or reclassify the content as long term content as described herein. If the embodiment shown in FIG. 3 is employed, one embodiment of the invention will depacketize/demultiplex the selected program and save the program back to the mass storage device360 (e.g., in either a packetized or a depacketized format). If the user does not wish to view the program immediately, this operation may be accomplished as a background task using the PID filters340,341 or other extraction software executed on theCPU125.
The[0040]information portion801 of the program entry may include various types of program-related data including, for example, the title and year of the movie (if the program is a movie), program reviews, and/or actors in the program, to name a few. In one embodiment, the program-related data includes links to additional information. For example, the links may be network addresses such as uniform resource locators (“URLs”) which point to additional data stored on a network (e.g., the Internet). In response to a user selecting a URL (e.g., via a cursor control device), additional data addressed by the URL may be downloaded to the system and displayed to the user. Accordingly, this embodiment of the system is equipped with a modem or other device for providing two-way communication over the Internet or other network (e.g., the cable/satellite provider's network). Various types of modems may be employed including digital subscriber line (“DSL”) modems, cable modems, and plain old telephone system (“POTS”) dial up modems (i.e., depending on the particular type of communication channel used by the system). Of course, the type of modem used to support interactive communication is not pertinent to the underlying principles of the invention.
Wideband ImplementationsIn one embodiment of the invention, illustrated in FIG. 9, a[0041]wideband tuner910 is configured in to lock on to several groups of multiplexed streams at once as opposed to just a single group. In the illustrated embodiment, thewideband tuner910 is comprised of an analog-to-digital (“A/D”)converter920 for receiving and digitizing numerous incoming streams—potentially all streams transmitted by a particular cable/satellite provider (e.g., over a 1 GHz frequency range); amulti-pass filter930 which divides the digitized wideband signal into a plurality of discrete frequency bands (e.g., bands of 100 MHz); and a wideband QAM/DPSK module935 which individually demodulates the content from each of the discrete frequency bands to reproduce all of the multiplexed multimedia streams. In one embodiment, the QAM/DPSK module935 is comprised of a series of digital signal processors (“DSPs”) (e.g., one DSP per frequency band), each programmed with a QAM function for performing QAM demodulation and/or a DPSK function for performing DSPK demodulation. In addition, the DSPs may perform other functions such as signal equalization and noise filtering. In one embodiment, the DSPs operate under the control of the system's CPU125 (e.g., the CPD executes software comprising the QAM/DPSK functions).
All of the groups of multiplexed streams (which, as indicated in FIG. 9, may include[0042]500 or more PIDs), are transmitted through awideband PID selector940 which, in response toselection logic450, selects a subset of all the multiplexed PIDs for storage on themass storage device460. The particular number of PIDs selected by thePID selector940 may vary depending on the preferences of the user and/or the capabilities of the mass storage device460 (e.g., the device's bandwidth and storage capacity). For example, in one embodiment, users may be prompted to select a set of “favorite” channels to be continually buffered on the mass storage device460 (whereas the user's non-“favorite” channels will not be buffered, or will only be buffered for a limited time period). To support the increased storage and bandwidth requirements of the several sets of additional streams, one embodiment of the invention includes one or more additional mass storage devices (e.g., connected through a multi-drive high speed communication interface such as UDMA or SCSI).
In one embodiment, a[0043]PID demultiplexer945 demultiplexes/depacketizes the streams selected by the wideband PID selector before storing them on themass storage device460. Alternatively, or in addition, the streams may initially be stored in a multiplexed format on the mass storage device and the PID depacketizer945 may extract PID packets only when a user decides to watch/record a particular program (e.g., as described above with respect to the embodiment shown in FIG. 3). Once selected by a user, the stream is then transmitted through adecoder module170 for MPEG-2 decoding (or other type of decoding, depending on how the stream was initially encoded) and to adisplay135. Although illustrated above as two separate modules, it will be appreciated that the functionality of thePID demultiplexer945 andwideband PID selector940 may be combined within a single module.
In one embodiment, a separate set of[0044]analog modules911 may be included in the system to process and store legacy analog broadcasts. The analog components may include ananalog tuners902 for receiving the analog broadcast at a particular frequency, a decoder/digitizer module904 for decoding and performing A/D conversion on the analog signal, and acompression module906 for compressing the signal before storing it to themass storage device460.
In one embodiment, the digital components may be configured to provide the analog functionality just described. For example, the DSPs within the QAM/[0045]DPSK module935 may be programmed with an NTSC or PAL demodulation function for demodulating the incoming analog signal901 (i.e., after the signal is digitized via the A/D converter).
Conditional Access EmbodimentsIn order to prevent users from viewing multimedia content which they do not have the right to view (e.g., subscription based channels, pay-per-view channels, . . . etc) the multimedia content is frequently encrypted using a series of encryption keys before being transmitted. Accordingly, multimedia systems are generally equipped with conditional access (“CA”) subsystems for decrypting the incoming multimedia content.[0046]
FIG. 10 illustrates a[0047]CA module1010 decrypting anincoming multimedia stream1030 to produce a decryptedmultimedia stream1035, which is then decoded by decoder170 (e.g., using an MPEG-2 decoder) and rendered on atelevision display135. Thedecryption keys1025 used to decrypt the multimedia content are transmitted to theCA module1010 from a securemicro unit1020. Because the keys used to encrypt the multimedia stream typically change every few seconds, these key changes must be synchronized at the secure micro1020 andCA modules1010. Accordingly a key selection data stream1040 (also referred to herein as the “PID:CA” stream or “conditional access data”) is provided to the securemicro unit1020 so that it knows precisely which key to transmit to theCA module1010 at a given point in time.
As a result of the CA subsystem, if the incoming multimedia stream is stored in an encrypted format on a mass storage device, the decryption key changes associated with that multimedia stream must also be stored (i.e., so that when a user selects the stream, the secure micro will provide CA module with the decryption keys required to decrypt the stream). Prior systems deal with this problem simply by decrypting the multimedia stream before it is stored. However, storing decrypted content on a long term storage device in this manner leaves the copyright holder of the content exposed to unauthorized copying. In addition, because CA subsystems are typically only capable of decrypting one stream at a time, this configuration only provides for storage of only a single stream per CA module.[0048]
One embodiment of a system for concurrently processing decryption keys for multiple streams is illustrated in FIG. 11. Like prior embodiments, this embodiment includes one or[0049]more tuners1020,1021 for locking on to multimedia stream within a specified carrier frequency and one or more QAM and/orDPSK demodulators1030,1031 for demodulating the multimedia stream.
Unlike prior systems, however, the illustrated embodiment stores the PID:CA[0050]key selection data1145 identifying thekeys1146 to be supplied by the secure micro1160 to theCA modules1170,1171 for each multimedia stream, as well as timing data indicating the points in time at which each portion of the multimedia stream and associatedkey selection data1145 were received/stored on the system (or alternatively, the points in time at which the stream/content was transmitted). When a user subsequently chooses a particular multimedia stream for playback, the secure micro1160 uses the key selection data PID:CA1145 for that stream to provide the correct series of keys to theCA modules1170,1171 for decryption of the selected stream. As in the embodiments described above, the user may be able to watch any program stored on the mass storage device for a predetermined buffer period or from the beginning (e.g., as described above with respect to FIGS. 6 and 7, respectively). In one embodiment, stream selection logic1155 (embodied in hardware or software executed by the CPU1185) will select the correct multimedia stream and PID:CA stream at the correct point in time (e.g., using techniques described in greater detail below) responsive to the user's selection (e.g., via a remote control or a cursor control device). Once the multimedia stream is decrypted by one of theCA modules1170,1171, one ormore decoder modules1180 then decode the stream using an appropriate codec (e.g., MPEG-2) and transmit the decoded stream to adisplay135.
Identifying the correct points in time within the multimedia stream to begin playback is complicated by the fact that MPEG-2 data (as well as other types of encoded multimedia content) is not typically received by the system at a steady rate. For example, a portion of an MPEG-2 stream which contains significant movement between each of the image frames (e.g., a video of an explosion) will typically consume significantly more bandwidth than a portion of an MPEG-2 stream that contains little or no movement. Thus, as illustrated in FIG. 12, four 1-second portions ([0051]1211,1212,1213,1214) of theincoming multimedia stream1210 may occupy different amounts of space on the mass storage device. As such, in one embodiment of the system, an index oftiming data1200 is provided so that thestream selection logic1155 can accurately locate where on the hard drive to start decrypting/rendering the multimedia stream in response to a user request to play back a particular program. Included within theindex1200 is a series of address pointers1201-1204, each associated with a timestamp (labeled 8:00:00 through 8:00:03). In operation, if a user selects a stored program which started at 8:00, for example, thestream selection logic1155 will identify the 8:00:00 timestamp within theindex1200 and will start decrypting/playing the program stream back from the address identified bypointer1201.
In one embodiment, the[0052]stream selection logic1155 will also identify the appropriate point within the PID:CA stream from which to read the necessary key changes. In one embodiment, a separate set of pointers to the PID:CA stream may be included within thetimestamp index1200 or, alternatively, within a separate PID:CA index (not shown). Alternatively, the conditional access data PID:CA may be stored directly within theindex1200. However, in an embodiment in which the PID:CA stream is not encrypted and/or is transmitted at a steady rate (e.g., 1 Mbit/sec), address pointer entries to the PID:CA stream may not be required (i.e., the selection logic will be able to accurately identify where to read from the PID:CA stream without the need for an index).
In one embodiment, the[0053]timing index1200 is transmitted along with the multiplexed multimedia streams in the form of an additional PID stream (e.g., a PID:INDEX stream transmitted from the head-end or uplink satellite that feeds the head-end). In other words, in this embodiment, the organization providing the source material (e.g., the cable or satellite provider) will generate and transmit the index to the end user's system.
However, if the content provider does not transmit the index, one embodiment of the system will construct the[0054]index1200 as the multimedia streams are received and written to the mass storage device. For example, index/timestamp generation logic executed by the CPU1185 (or embodied in hardware) may be configured to generate a new timestamp entry every 1/100 of a second and continuously store the results to themass storage device1140. However, it should be noted that the particular frequency with which timestamp entries are generated is not pertinent to the underlying principles of the invention.
As illustrated in FIG. 13, an MPEG-2 stream[0055]1310 is comprised of a series of I-frames separated by B-frames and P-frames. MPEG-2 uses similar DCT-based intraframe coding as the JPEG standard for each of the I-frames, but compresses the intervening video content by encoding only the differences between periodic I-frames within the B-frames and P-frames. Accordingly, it would be preferable if the pointers1201-1204 contained in thetimestamp index1200 pointed to I-frames within the MPEG-2 stream rather than B or P frames (i.e., because the B and P frames are meaningless outside of the context of the two I-frames they connect). Accordingly, if the timestamp index is generated by the organization providing the source material, each of the pointers1201-1204 should be selected to point to I-frames within the MPEG-2 stream.
If, however, the[0056]timestamp index1200 is generated by the system, as described above, then the pointers1201-1204 may not necessarily point to an I-frame. Accordingly, in one embodiment of the invention, if a stream is played back from an address pointer which does not point to an I-frame (e.g., such aspointer1201 in FIG. 13) then it will decrypt/decode the stream up until it reaches an I-frame and will begin playback from that point. For example, in FIG. 13, the system will begin decrypting the stream at the point identified by pointer1201 (in the middle of B & P frames1302) but playback would not start until the decryption process reached I-frame1303. In one embodiment, the system identifies the I-frame1303 by decrypting its I-frame header.
Similar techniques may also be employed to allow users to fast-forward through the multimedia content. More specifically, in response to a fast forward command, one embodiment of the system will display a series of I-frames in succession. Depending on the speed at which the fast forward is set to, this embodiment may jump several I-frames at once (as described in greater detail below). If the timestamp index described above contains pointers which point directly I-frames, then the I-frames will be identified directly via the index.[0057]
If, however, the index is constructed as the multimedia stream is received, then jumping from one I-frame to the next may not be entirely accurate because the number of B and P frames between each I-frame and the data contained within each B and P frame is not consistent. Accordingly, as illustrated in FIG. 14, when a user selects fast forward, one embodiment of the system will estimate the jump from the current I-[0058]frame1301 to the next I-frame1303 based on the speed of fast forward request and/or the estimated time between each I-frame. In one embodiment, the system will perform a lookup in thetimestamp index1200 to make the jump. Alternatively, or in addition, the jump may be based on the assumption that during standard playback, a new I-frame is decided approximately every 1/2 second. The underlying principles of the invention remain the same regardless of how the jump to the next I-frame is estimated.
Regardless of how the jump is estimated, once it occurs, one embodiment will then begin decrypting the stream using the decryption key data PID:[0059]CA1145 associated with that point in time, until the decryption process reaches the desired I-frame1303. Once the I-frame1303 is reached, it is decrypted, decoded and rendered on the display. The same techniques may then be employed for the estimated jump to the next I-frame1305. The system may identify each of the I-frames by decrypting their respective I-frame headers.
If one embodiment, if the jump lands in the middle of the next I-frame as illustrated in FIG. 14 (as the jump from I-frame[0060]1305 to1307, then one embodiment of the invention will decrypt the stream backwards until it reaches the beginning of I-frame1307. The system may identify the middle of an I-frame by the presence of I-frame data rather than B or P frame data (e.g., DCT intra-frame data rather than inter-frame motion data).
If the speed of the fast forward request is set high enough the secure[0061]micro unit1160 may be required to provide a new decryption key with each jump. Accordingly, one problem which may result is that the secure micro1160 may not be capable of providing decryption keys to theCA module1170 quickly enough (e.g., the secure micro may only be capable of supplying a new key every 1/3 second). If this is the case, then one embodiment of the invention will continue to display the current I-frame until a new key can be generated as it jumps over several I-frames at a time. In this manner, decryption will take place as quickly as the securemicro unit1160 can generate new keys.
As the multimedia stream is decrypted during playback, one embodiment of the invention will store the decrypted stream back to the[0062]mass storage device1140, thereby replacing the encrypted multimedia data. At this time an I-frame index can be written to thestorage device1140 as well. Accordingly, if a user subsequently decides to rewind to a particular point within the multimedia stream, or decides to watch the program a second time, the foregoing I-frame identification techniques may no longer be required (i.e., because the stream will have been decrypted and an I-frame index may be available). In addition, in one embodiment, as soon as the user begins watching a particular multimedia stream, the system will run ahead of stream playback, decrypting the stream as quickly as it can (generally dictated by how quickly the securemicro unit1160 can supply keys) and storing the decrypted stream back to the mass storage device. Using this technique an entire movie may be completely decrypted during the first several minutes of playback. Accordingly, if the user subsequently chooses to fast-forward through the movie, the I-frame identification techniques described above will not be required.
In one embodiment, any multimedia programs which the user designates for long term storage (e.g., by checking the[0063]selection region805 corresponding to the program as illustrated in FIG. 8), will be decrypted in the background by software executed on theCPU1185 and/or using dedicated decryption hardware. This embodiment may be required in cases where the decryption keys provided by the cable/satellite provider expire after a predetermined period of time (i.e., and therefore could not be used to decrypt the multimedia programs after a predetermined time has elapsed).
In order to protect the copyright holders' rights in the multimedia content stored on the[0064]mass storage device1140, one embodiment of the invention will employ additional encryption techniques once the multimedia content has been decrypted. For example, one embodiment of the system delivers a unique key to themass storage device1140 as soon as the system is powered up. This technique is available today on many current Ultra-ATA hard drives. If the wrong key is transmitted a predetermined number of times, the hard drive will render the data stored thereon inaccessible (e.g., in one embodiment the hard drive will format itself). Accordingly, an individual who steals themass storage device1140 will be unable to access the multimedia content.
In addition, in one embodiment, after the multimedia content is decrypted using keys supplied by the secure micro[0065]1160, one embodiment will re-encrypt the content using one or more known encryption algorithms. For example, in one embodiment, Data Encryption Standard (“DES”) encryption will be applied to the multimedia content before storing it back to themass storage device1141. As is known in the art, DES is a NIST-standard secret key cryptography method that uses a 56-bit key. It will be appreciated, however, that various other encryption algorithms may be employed while still complying with the underlying principles of the invention. However, one benefit of using DES encryption is that many MPEG-2 decoder chips have the DES encryption function built in (e.g., such as the AViA-9600 from C-Cube Microsystems, Inc). As such, if the system is equipped with an MPEG-2 decoder, no additional hardware will be required, thereby reducing system costs.
In one embodiment, illustrated in FIG. 15, a[0066]network interface1500 is configured in the system to provide communication to a remote multimedia node1510 (also equipped with a network interface1505). Various different networking protocols/standards, both wired (e.g., Ethernet) and wireless (e.g., 802.11b), be employed to support the communication between the various nodes.
The format in which multimedia content is transmitted to the[0067]multimedia node1510 may depend on the node's capabilities. For example, in one embodiment, thenode1510 is equipped with its own conditional access module and secure micro unit (not shown). Accordingly, in this embodiment, multimedia streams requested by theremote node1510 may be transmitted in an encrypted format along with the associated key selection data PID:CA. By contrast, in one embodiment theremote node1510 may not be equipped with conditional access functionality. As such, in this embodiment, the multimedia content will be decrypted before being transmitted. In order to protect unauthorized access to the multimedia content (e.g., by an unauthorized user listening on the network), one embodiment will re-encrypt the stream before transmitting it to theremote node1510 using an encryption format which the remote node can employ in real time (e.g., DES encryption). Various other techniques may be used to provide secure communication with theremote node1510 while still complying with the underlying principles of the invention (e.g., communication may be encrypted using Secure Sockets Layer (“SSL”) encryption).
Embodiments of the invention may include various steps, which have been described above. The steps may be embodied in machine-executable instructions which may be used to cause a general-purpose or special-purpose processor to perform the steps. Alternatively, these steps may be performed by specific hardware components that contain hardwired logic for performing the steps, or by any combination of programmed computer components and custom hardware components.[0068]
Elements of the present invention may also be provided as a computer program product which may include a machine-readable medium having stored thereon instructions which may be used to program a computer (or other electronic device) to perform a process. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnet or optical cards, propagation media or other type of media/machine-readable medium suitable for storing electronic instructions. For example, the present invention may be downloaded as a computer program product, wherein the program may be transferred from a remote computer (e.g., a server) to a requesting computer (e.g., a client) by way of data signals embodied in a carrier wave or other propagation medium via a communication link (e.g., a modem or network connection).[0069]
Throughout this detailed description, for the purposes of explanation, numerous specific details were set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the system and method may be practiced without some of these specific details. For example, although the description above focuses on MPEG-2 as the preferred compression algorithm, various other compression algorithms may be employed to compress/decompress multimedia content while still complying with the underlying principles of the invention (e.g., MPEG-4 ,[0070]RealVideo® 8, . . . etc).
In other instances, well known structures and functions were not described in elaborate detail in order to avoid obscuring the subject matter of the present invention. For example, although not illustrated, it will be appreciated that various levels of buffering may be included in the embodiments described herein. For example, in the embodiment illustrated in FIG. 11, buffers (e.g., SDRAM, RDRAM, . . . etc) may be configured between the QAM/[0071]DPSK modules1130,1131 and themass storage device1140 and/or between themass storage device1140 and the PID filters1150,1151. In fact, buffers may be provided in this manner between any of the system modules in order to improve system performance. The buffers may be separate, independent modules and/or may be assigned blocks of addressable space within a single unified memory (e.g., a RAM module shared between theCPU1185 and other system components). The underlying principles of the invention remain the same regardless of which types of buffers are used.
Accordingly, the scope and spirit of the invention should be judged in terms of the claims which follow.[0072]