The present application is a divisional application of an invention patent application having an application date of 2004-2/13, application No. 200480008201.0, entitled "recording medium having a data structure for managing reproduction of data streams recorded thereon and recording and reproducing methods and apparatuses".
Background
Standards for new high-density read-only and rewritable optical discs capable of recording large amounts of high-quality video and audio data are rapidly being developed, and new optical disc-related products are expected to be available on the market in the near future. The blu-ray disc rewritable (BD-RE) is one example of these new optical discs.
Fig. 1 shows a file structure of a BD-RE. The file structure or data structure provides for managing reproduction of video and audio data recorded on the BD-RE. As shown, the data structure includes a root directory that contains at least one BDAV directory. BDAV directories include files such as "info*Rpls and*vpls) PLAYLIST subdirectory, clip information file (v) storing*Clpi) and an MPEG 2-formatted a/V stream clip file storing a corresponding clip information file(s) ((ii)*M2 ts). In addition to illustrating the data structure of an optical disc, fig. 1 also represents areas of the optical disc. Bdav is stored in one or more general information areas on the optical disc, for example.
Since the BD-RE data structure and disc format shown in fig. 1 are well known and readily available, the present disclosure provides only a brief overview of the file structure.
As alluded to above, the STREAM directory includes MPEG 2-formatted a/V STREAM files called clip files. The STREAM directory also includes a special type of clip called a bridge-clip (bridge-clip) a/V STREAM file. The span clip file is used for seamless connection between two or more display image sections selected in the clip file, and generally has a smaller data size than the clip file. The a/V stream includes source packets of video and audio data. For example, a source packet of video data includes a header and a transport packet. The source packet includes a source packet number, which is typically a sequentially assigned number used as an address to access the source packet. The transport packets include a Packet Identifier (PID). The PID identifies the sequence of transport packets to which the transport packet belongs. Each transport packet in the sequence has the same PID.
The CLIPINF directory includes a clip information file associated with each a/V stream file. The clip information file indicates, among other things, the type of a/V stream associated therewith, sequence information, program information, and timing information. The sequence information describes time-of-arrival basis (ATC) and system time basis (STC) sequences. For example, the sequence information indicates, among other things, the number of sequences, the start and end time information for each sequence, the address of the first source packet in each sequence, and the PID of the transport packets in each sequence. A sequence of source packets in which the program content is constant is called a program sequence. The program information indicates, among other things, the number of program sequences, the starting address of each program sequence, and the PID of the transport packets in the program sequences.
The timing information is called Characteristic Point Information (CPI). One form of CPI is an Entry Point (EP) map. The EP map maps a display image timestamp (e.g., on an arrival time basis (ATC) and/or a system time basis (STC)) to a source packet address (i.e., source packet number). A presentation Picture Time Stamp (PTS) and a Source Packet Number (SPN) are associated with an entry point in the AV stream; that is, the PTS and its related SPN point to an entry point on the AV stream. The packet pointed to is often referred to as an entry point packet.
The PLAYLIST directory includes one or more PLAYLIST files. The concept of a playlist is introduced to promote the convenience of editing/assembling clips for playback. A playlist file is a collection of playing intervals in a clip. Each playing interval is called a playitem. The playlist file, among other things, identifies each playitem forming the playlist, and each playitem, among other things, is a pair of IN-point and OUT-point that point to positions on a time axis of the clip file (e.g., ATC or STC based presentation image time stamps). Expressed another way, the playlist file identifies playitems, each playitem points to a clip file or portion thereof and identifies the clip information file associated with the clip file. The clip information file is used, inter alia, to map playitems to clips of the source packets.
The playlist directory may include a real playlist (*Rpls) and virtual broadcastPut list (*Vpls). A real playlist can only use clips and cannot use cross-over clips. That is, the real playlist is considered as a reference part of the clip, and thus conceptually considered equivalent to the reference part of the clip in the disc space. The virtual playlist may use both clips and cross-over clips, so there is no conceptual consideration of a real playlist in the virtual playlist.
Bdav files are general information files that provide general information for managing reproduction of a/V streams recorded on an optical disc. BDAV file includes, among other things, a table of PLAYLISTs that identifies the filenames of PLAYLISTs in the PLAYLIST directory of the same BDAV directory.
menu. tidx, menu. tdt1, and menu. tdt2 files store information related to menu thumbnails. mark.tidx, mark.tdt1 and mark.tdt2 files store information about the mark thumbnail. Since these documents are not particularly relevant to the present invention, they will not be discussed further.
The standard for high-density read-only optical discs such as blu-ray ROM (BD-ROM) is still in progress. An effective data structure for managing data streams, which may represent one or more reproduction paths and is recorded on a high-density read-only optical disc such as a BD-ROM, is not yet available.
Detailed Description
For a more complete understanding of the present invention, exemplary embodiments thereof will now be described with reference to the accompanying drawings.
A high-density recording medium such as a high-density optical disc (e.g., blu-ray ROM (BD-ROM), BD-RE, etc.) according to the present invention may have a file or data structure for managing reproduction of video and audio data as shown in fig. 2. Certain aspects of the data structure according to the present invention shown in fig. 2 are the same as the well-known BD-RE standard and will be reviewed but not described in detail.
As shown in fig. 2, the root directory contains at least one BD directory. The BD directory includes general files (not shown), stores playlist files (e.g.,*mpls) PLAYLIST directory, clip information file(s) stored therein*Clpi) and an MPEG 2-formatted a/V stream clip file storing a corresponding clip information file: (a/V stream clip file storing an MPEG 2-formatted clip information file: (clpi)*M2 ts).
The STREAM directory includes MPEG 2-formatted a/V STREAM files called clip STREAM files or just clip files. The a/V stream includes source packets of video and audio data. For example, a source packet of video data includes a header and a transport packet. The source packet includes a source packet number, which is typically a sequentially assigned number used as an address to access the source packet. The transport packets include a Packet Identifier (PID). The PID identifies the sequence of transport packets to which the transport packet belongs. Each transport packet in the sequence will have the same PID.
The CLIPINF directory includes a clip information file associated with each a/V stream file. The clip information file indicates, among other things, the type of a/V stream, sequence information, program information, and timing information associated therewith. The sequence information describes time-of-arrival basis (ATC) and system time basis (STC) sequences. For example, the sequence information indicates, among other things, the number of sequences, the start and end time information for each sequence, the address of the first source packet in each sequence, and the PID of the transport packets in each sequence. A sequence of source packets in which the program content is constant is called a program sequence. The program information indicates, among other things, the number of program sequences, the starting address of each program sequence, and the PID of the transport packets in the program sequences.
The timing information is called Characteristic Point Information (CPI). One form of CPI is an Entry Point (EP) map. The EP map maps a display image timestamp (e.g., on an arrival time basis (ATC) and/or a system time basis (STC)) to a source packet address (i.e., source packet number). A presentation Picture Time Stamp (PTS) and a Source Packet Number (SPN) are associated with an entry point in the AV stream; i.e. PTS and its related SPN point to an entry point on the AV stream. The packet pointed to is often referred to as an entry point packet.
The PLAYLIST directory includes one or more PLAYLIST files. The concept of a playlist is introduced to promote the convenience of editing/assembling clips (clip files and associated clip information files) for playback. A playlist file is a collection of playing intervals in a clip file. Each playing interval is called a playitem. The playlist file, among other things, identifies each playitem forming the playlist, and each playitem, among other things, is a pair of IN-point and OUT-point that point to positions on a time axis of the clip file (e.g., ATC or STC based presentation image time stamps). The playlist file may also include a subplayltem, which also provides a pair of IN and OUT points that point to positions on the time axis of the clip file. Expressed another way, the playlist file identifies playitems and subplayitems, each playitem or subplayitem points to a clip file or portion thereof and identifies the clip information file associated with the clip file. The clip information file is used, inter alia, to map playitems to clip files of source packets. The playlist may also include a playlist mark that points to a particular location (e.g., a particular address) in the clip file.
A general information file (not shown) provides general information for managing reproduction of a/V streams recorded on the optical disc.
In addition to illustrating the data structure of the recording medium according to an embodiment of the present invention, fig. 2 also illustrates areas of the recording medium. For example, the general information files are recorded in one or more general information areas, the playlist directory is recorded in one or more playlist directory areas, each playlist in the playlist directory is recorded in one or more playlist areas of the recording medium, and so on. Fig. 3 illustrates an example of a recording medium on which the data structure of fig. 2 is stored. As shown, the recording medium includes a file system information area, a database area, and an a/V stream area. The database area includes a general information file and playlist information area and a clip information area. The general information file and PLAYLIST information area have the general information files recorded in the general information file area thereof, and the PLAYLIST directory and PLAYLIST files recorded in the PLAYLIST information area thereof. The clip information area has a CLIPINFO directory and associated clip information files recorded therein. The a/V stream area has a/V streams for various titles recorded therein.
Video and audio data are typically organized into individual titles; for example, different movies represented by the video and audio data are organized by different titles. Further, the titles may be organized into individual chapters in the same manner that books are organized into chapters.
Due to the large storage capacity of new high-density recording media, such as BD-ROM and BD-RE optical discs, various versions of a title or portions of a title may be recorded and reproduced from the recording media. For example, video data representing different camera angles may be recorded on the recording medium. As another example, versions of titles, or portions thereof, associated with different languages may be recorded on the recording medium. As still another example, a director's version or a theatrical version of a title may be recorded on the recording medium. Alternatively, an adult version, a young adult version, and a young child version (i.e., different parental control versions) of the title or portions of the title may be recorded on the recording medium. Each version, camera angle, etc. represents a different reproduction path, and the video data in these instances is referred to as multi-reproduction-path video data.
In the first embodiment of the present invention, the data streams are managed in clip files, each clip file being associated with a portion of a title. When a portion of a title has multiple reproduction paths, clip files associated with the multiple reproduction path portions of the title are recorded on the recording medium in an interleaved manner. Fig. 4 illustrates an example of a data structure and method for managing data streams of a high-density recording medium such as a BD-ROM according to the first embodiment. FIG. 4 illustrates a title having three portions; it is understood, however, that the invention is not limited to having these numbers of portions. The first part is a single first reproduction Path # 1. The second portion having a plurality of reproduction paths; namely, a first reproduction Path #1, a second reproduction Path #2, and a third reproduction Path # 3. The third section has a single reproduction Path, the first reproduction Path # 1. The first reproduction Path #1 exists in all three sections and can be regarded as a main reproduction Path.
As further shown in fig. 4, a data stream representing the first part of the title and having a first reproduction Path #1 is managed as a first Clip File # 1. Data streams of first, second and third reproduction paths Path #1, #2 and #3 representing a second portion of the title are managed as second, third and fourth clip files #2, #3 and #4, respectively. A data stream representing the third part of the title and having the first reproduction Path #1 is managed as a fifth Clip File # 5.
Fig. 4 further shows the allocation of clip files on the data area of the BD-ROM. As shown, a first Clip File #1 is recorded. Subsequently, second, third and fourth Clip files #2, #3 and #4 representing a plurality of reproduction path sections of a title are recorded on the recording medium in an interleaved manner to allow seamless playback of any one reproduction path. Next, a fifth Clip File #5 is recorded.
When seamless reproduction of a multi-reproduction path data stream is not necessary, data streams of the second, third and fourth clip files #2, #3 and #4 may be sequentially recorded clip file by clip file in a non-interleaved manner.
During reproduction, when a reproduction operation is performed on the first reproduction Path #1, the first, second, and fifth Clip files Clip File #1, #2, and #5 are selectively reproduced. When the second reproduction path is reproduced, the first, third and fifth Clip files Clip File #1, #3 and #5 are selectively reproduced. When the third reproduction path is reproduced, the first, fourth and fifth Clip files Clip File #1, #4 and #5 are selectively reproduced.
To facilitate seamless reproduction of multiple reproduction path data streams, as described above, a data stream corresponding to the trailing end of the first Clip File #1 and data streams corresponding to the leading ends of the interleaved second, third, and fourth Clip files #2, #3, and #4 are recorded adjacent to each other. Also, a data stream corresponding to the trailing end of the interleaved second, third and fourth Clip files #2, #3 and #4 and a data stream corresponding to the leading end of the fifth Clip File #5 are recorded adjacent to each other.
The second embodiment of the present invention is substantially the same as the first embodiment described above, except that: each reproduction path of a title is managed as a single clip file. Fig. 5 shows an example of this embodiment for the same header structure discussed above with respect to fig. 4. As shown, a first reproduction Path #1 exists in each of the three sections of the title, and the data stream of the reproduction Path is managed as a single first Clip File # 1. Further, the first reproduction Path #1 may be regarded as a main reproduction Path. The second portion of the title includes a second reproduction Path #2 and a third reproduction Path # 3. The data stream of each of these reproduction paths can be managed as individual Clip files, respectively, a second Clip File #2 and a third Clip File # 3.
In this embodiment, the clip file is recorded on the BD-ROM such that, in the case where the reproduction path and at least some portions of the clip file represent the same portion of the title, the portions of the clip file representing the plurality of reproduction path portions are recorded in an interleaved manner. Thus, as shown in FIG. 5, a portion of the first Clip File Clip Files #1 associated with a second plurality of reproduction path portions of the title is recorded in an interleaved manner with second and third Clip Files #2 and #3 that also represent a second portion of the title.
According to other embodiments of the present invention, navigation data associated with a data stream representing each portion of a title may be recorded on a recording medium. The navigation data indicating whether the associated data stream for the title-related part is an interleaved clip file; and thus indicates whether the data stream represents multiple reproduction path portions of a title. The navigation data may also indicate the number of reproduction paths represented by the associated data stream. Fig. 6 shows an example of this navigation data of the data structure illustrated and described above with reference to fig. 5.
As shown in fig. 6, the Clip information File of the Clip File #1 for the main reproduction path includes the navigation data. Specifically, the clip information file includes interleaving Sequence information ILV _ Sequence for representing a data stream of each section of the title. The Interleaving sequence information includes identification information Interleaving _ Flag, which identifies an Interleaving status of the associated data stream. That is, the interleave flag indicates whether a data stream representing a relevant portion of a title is an interleaved clip file. The interleaved sequence information further includes Path Number information Number _ of _ Path, which indicates the Number of reproduction paths represented by the associated data stream.
As shown in fig. 6, first, second, and third interleaving sequences ILV sequences #1, #2, and #3 associated with data streams representing first, second, and third portions of a title, respectively, are included in a first clip information file. The first interleaved Sequence ILV _ Sequence #1 is recorded with "Interleaving _ Flag ═ 0" indicating the non-interleaved state of the data stream (and thus, a single reproduction Path of data) and "Number _ of _ Path ═ 1" explicitly indicating that the data stream of the first part of the title represents one reproduction Path.
The second Interleaving Sequence ILV _ Sequence #2 is recorded with "Interleaving _ Flag 1" indicating the Interleaving status of the data streams (and thus, a plurality of reproduction paths) and "Number _ of _ Path 3" indicating that the data stream of the second part of the title represents three reproduction paths. The third interleaved Sequence ILV _ Sequence #3 is recorded with "Interleaving _ Flag ═ 0" indicating the non-interleaved state of the data stream (and thus, a single reproduction Path of data) and "Number _ of _ Path ═ 1" explicitly indicating that the data stream of the third part of the title represents one reproduction Path.
Fig. 7 illustrates an embodiment of an optical disc reproducing apparatus according to the present invention. As shown, the optical disc reproducing apparatus includes an optical disc pickup 111, a drive 112, a source depacketizer 113, a demultiplexer 114, a controller 115, an a/V decoder 116, and a memory 117. The drive 112 drives an optical pickup to reproduce data from the optical disc 110. The driver 112 is controlled by a controller 115. During reproduction, the controller 115 controls the drive 112 to reproduce the data structure of one of the above-described embodiments. Based on the information contained therein and user input received on the user interface (e.g., control buttons on the rendering device or a remote associated with the device), controller 115 controls drive 112 to render data from the optical disk.
The reproduced source packets are received by a source depacketizer 113 and converted into a data stream (e.g., an MPEG-2 transport packet stream). The demultiplexer 115 demultiplexes the data stream into navigation/management and encoded AV data. The navigation/management data is sent to the controller 115 and stored in the memory 117. An AV decoder 116 decodes the encoded AV data to produce the originally recorded data. During reproduction, the controller 115 controls the operations of the source depacketizer 113, demultiplexer 114 and AV decoder 116.
An operation example of the optical disc reproducing apparatus will be described with respect to the data structure shown in fig. 6. It is assumed that the user requests reproduction of the data stream of the first Path #1 via the user interface. In response, the controller 115 controls the operations of the driver 112, the source depacketizer 113, the demultiplexer 114 and the a/V decoder 116 based on the data structure.
Specifically, the controller 115 obtains ILV sequence information for the first portion of the title. Here, "Interleaving _ Flag is 0" and "Number _ of _ Path is 1", and the controller 115 determines that the associated data streams represent a single reproduction Path of non-interleaved data. Thus, the controller 115 knows that the data stream represents the first or main reproduction Path # 1. Accordingly, the controller 115 reads out and reproduces the data stream of the first (main) reproduction Path #1 recorded in the area associated with the first interleaving sequence information. Thereafter, the controller 115 obtains ILV sequence information for the second part of the title. Here, the controller 115 obtains "Interleaving _ Flag 1" and "Number _ of _ Path 3", and determines that the data stream for the second part of the title represents three reproduction paths and the clip files associated therewith are interleaved as shown in fig. 6. That is, the controller 115 knows that the first block of interleaved data is for the first reproduction Path #1, the second block is for the second reproduction Path #2, the third block is for the third reproduction Path #3, the fourth block is for the first reproduction Path #1, and so on. Accordingly, the controller 115 selectively reproduces only the block associated with the first reproduction Path # 1. Alternatively or additionally, the clip information file may indicate a file range or a physical location for each block of each reproduction path on the recording medium, and the block for the selected reproduction path is reproduced based on the file range information.
Subsequently, the controller 115 obtains ILV sequence information for the third part of the title. Here, "Interleaving _ Flag is 0" and "Number _ of _ Path is 1", and the controller 115 determines that the associated data streams represent a single reproduction Path of non-interleaved data. Thus, the controller 115 knows that the data stream represents the first or main reproduction Path # 1. Accordingly, the controller 115 reads out and reproduces the data stream of the first (main) reproduction Path #1 recorded in the area associated with the third interleaving sequence information.
Another example of the operation of the optical disc reproducing apparatus will be described with respect to the data structure shown in fig. 6. It is assumed that the user requests reproduction of the data stream of the second Path #2 via the user interface. In response, the controller 115 controls the operations of the driver 112, the source depacketizer 113, the demultiplexer 114 and the a/V decoder 116 based on the data structure.
Specifically, the controller 115 obtains ILV sequence information for the first portion of the title. Here, "Interleaving _ Flag is 0" and "Number _ of _ Path is 1", and the controller 115 determines that the associated data streams represent a single reproduction Path of non-interleaved data. Thus, the controller 115 knows that the data stream represents the first or main reproduction Path # 1. Accordingly, the controller 115 reads out and reproduces the data stream of the first (main) reproduction Path #1 recorded in the area associated with the first interleaving sequence information because the data stream associated with the second reproduction Path #2 is presumed to be absent. Thereafter, the controller 115 obtains ILV sequence information for the second part of the title. Here, the controller 115 obtains "Interleaving _ Flag 1" and "Number _ of _ Path 3", determines that the data stream for the second part of the title represents three reproduction paths, and determines that the clip files associated therewith are interleaved as shown in fig. 6. That is, the controller 115 knows that the first block of interleaved data is for the first reproduction Path #1, the second block is for the second reproduction Path #2, the third block is for the third reproduction Path #3, the fourth block is for the first reproduction Path #1, and so on. Accordingly, the controller 115 selectively reproduces only the block associated with the second reproduction Path # 2. Alternatively or additionally, the clip information file may indicate a file range or a physical location for each block of each reproduction path on the recording medium, and the block for the selected reproduction path is reproduced based on the file range information.
Subsequently, the controller 115 obtains ILV sequence information for the third part of the title. Here, "Interleaving _ Flag is 0" and "Number _ of _ Path is 1", and the controller 115 determines that the associated data streams represent a single reproduction Path of non-interleaved data. Thus, the controller 115 knows that the data stream represents the first or main reproduction Path # 1. Accordingly, the controller 115 reads out and reproduces the data stream of the first (main) reproduction Path #1 recorded in the area associated with the third interleaving sequence information because the data stream associated with the second reproduction Path #2 is presumed to be absent.
Fig. 8 illustrates a schematic diagram of an embodiment of an optical disc recording and reproducing apparatus according to the present invention. As shown, an AV encoder 9 receives and encodes data (e.g., still image data, audio data, etc.). The AV encoder 9 outputs encoded data together with encoding information and stream attribute information. The multiplexer 8 multiplexes these encoded data based on the coding information and stream attribute information to create, for example, an MPEG-2 transport stream. The source packetizer 7 packetizes the transport packets from the multiplexer 8 into source packets in accordance with the audio/video format of the optical disk. As shown in fig. 8, the operations of the AV encoder 9, the multiplexer 8 and the source packetizer 7 are controlled by a controller 10. The controller 10 receives user input regarding the recording operation and provides control information to the AV encoder 9, the multiplexer 8 and the source packetizer 7. For example, the controller 10 indicates the type of encoding performed to the AV encoder 9, indicates the transport stream to be created to the multiplexer 8, and indicates the source packet format to the source packetizer 7. The controller 10 further controls the drive 3 to record the output from the source packetizer 7 on the optical disk.
The controller 10 also creates navigation and management information for managing reproduction of data recorded on the optical disk. For example, based on information received via the user interface (e.g., instruction set saved on disk, provided over an intranet or the internet by a computer system, etc.) the controller 10 controls the drive 3 to record one or more of the data structures of fig. 2-6 on the optical disk.
During reproduction, the controller 10 controls the drive 3 to reproduce the data structure. Based on the information obtained here and user input received via a user interface (e.g., control buttons on the recording and reproducing apparatus or a remote associated with the apparatus), the controller 10 controls the drive 3 to reproduce the data from the optical disc.
The reproduced source packets are received by a source depacketizer 4 and converted into a data stream (e.g., an MPEG-2 transport packet stream). A demultiplexer 5 demultiplexes the data stream into encoded data. An AV decoder 6 decodes the encoded data to generate the original data that was previously fed to the AV encoder 9. During reproduction, the controller 10 controls the operations of the source depacketizer 4, demultiplexer 5 and AV decoder 6. The controller 10 receives a user input regarding a reproducing operation and provides control information to the AV decoder 6, the demultiplexer 5 and the source packetizer 4. For example, the controller 10 indicates the type of decoding performed to the AV decoder 9, indicates the transport stream to be demultiplexed to the demultiplexer 5, and indicates the source packet format to the source depacketizer 4.
Although fig. 8 is described as a recording and reproducing apparatus, it is understood that a recording-only or reproducing-only apparatus may be provided using those portions of fig. 8 that provide the recording or reproducing function.
The method and data structure for managing data streams on a high-density optical disc according to an embodiment of the present invention allow for efficient selection and reproduction of data streams recorded on a high-density recording medium such as a BD-ROM.
As apparent from the provision of the above description, the present invention provides a method and apparatus for reproducing a data structure on a high-density recording medium and for managing a data stream recorded on the recording medium.
The above description further provides methods and apparatuses for reproducing a data stream recorded on a high-density recording medium based on a data structure recorded on the high-density recording medium, and for managing reproduction of the data stream.
While the present invention has been disclosed with respect to a limited number of embodiments, those skilled in the art, having the benefit of this disclosure, will appreciate numerous modifications and variations therefrom. For example, although described with respect to a blu-ray ROM optical disc in several instances, the present invention is not limited to such standards for optical discs or to such optical discs. All such modifications and variations are intended to be included herein within the spirit and scope of this disclosure.