US20080163294A1 - Storage medium having interactive graphic stream and apparatus for reproducing the same - Google Patents

Abstract

A storage medium including an interactive graphic stream providing menus using various transition effects regardless of reproducing modes of multimedia data and an apparatus for reproducing the same. The storage medium in which multimedia information is recorded includes: video data; and graphic data to provide a menu screen overlaid on an image based on the video data, wherein the graphic data provides a plurality of menu pages. Accordingly, a plurality of menu pages may be provided regardless of application types of a main stream, and various transition effects may be applied when transitions between menu pages are performed.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application is a continuation application of U.S. Ser. No. 11/033,761 filed Jan. 13, 2005, now pending, which claims the benefit of Korean Application No. 2004-2412, filed Jan. 13, 2004, in the Korean Intellectual Property Office, and 2004-35078, filed on May 18, 2004 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entirety by reference.
BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• The present invention relates to reproduction of multimedia data, and, more particularly, to a storage medium including an interactive graphic stream providing menus using various transition effects regardless of reproducing modes of multimedia data. The present invention also relates to an apparatus to reproduce multimedia data.
• 2. Description of the Related Art
• In order to reproduce multimedia data, AV data, navigation data to control reproduction of the AV data, and system data are recorded in the storage medium. The system data includes introduction information of a title of AV data to be first reproduced when a storage medium is inserted in a reproducing apparatus. Besides this data, additional data may be included in the storage medium. In particular, various kinds of information required to reproduce video, audio, subtitles, and menus are multiplexed into one main stream and recorded in the AV data.
• FIG.1 is a configuration of AV data in which various elemental streams are multiplexed. Referring toFIG. 1, avideo stream102, anaudio stream104, a presentationgraphic stream106 to provide subtitles, and an interactivegraphic stream108 to provide a menu screen of an interaction with a user are multiplexed into one main stream and recorded in a storage medium in which multimedia data is recorded. Hereinafter, the multiplexed main stream is calledAV data110.
• In particular, the interactivegraphic stream108 to provide a menu screen to allow an interaction with a user includes a plurality of segments.FIG. 2 is a configuration of the interactivegraphic stream108 out of the elemental streams shown inFIG. 1.
• Referring toFIG. 2, the interactivegraphic stream108 includes a plurality of segments. A unit displayed on one screen from an interactive composition segment (ICS) to an end segment is called a display set. One display set includes, but is not limited to including:
• • 1) An ICS to record composition information of an interactive graphic;
  • 2) A palette definition segment (PDS) to define palette information of color and/or clearness which is to be applied to the interactive graphic;
  • 3) A plurality of object definition segments (ODSs) to define object data, including image information such as buttons, to be displayed on a screen;
  • 4) An end segment indicating the end of the display set.
• In particular, the ICS includes output termination time information of a relative display set, button composition information, and operation information of a reproducing apparatus according to a user operation. The ICS may be realized using an ICS data structure.
• Each segment included in one display set is recorded in a packetized elementary stream (PES), which is a packet unit of an MPEG-2 transport stream (TS). The relative display set starts to be decoded at a decoding time stamp (DTS) included in the PES and starts to be outputted to a display screen at a presentation time stamp (PTS).
• Also, an output termination time of the relative display set is determined by a value of a composition_time_out_pts field recorded in the ICS. The composition_time_out_pts field will be described later. Accordingly, the interactivegraphic stream108 is output to the screen at a designated time (PTS), receives a user operation, performs corresponding operations, and disappears from the screen at the determined output termination time (composition_time_out_pts).
• Due to the data structure as is described above, the ICS has the following disadvantages. First, where a plurality of page menus are provided, since movement to preceding and subsequent menu pages is possible only through a user operation according to a general menu characteristic, a PTS defined in a PES packet including an ICS has a meaning only in a first menu page, and PTSs in subsequent pages do not have any meaning. Therefore, in order to construct a plurality of page menus, an application type of a main stream should be set to a browsable slide show. That is, in a case where a main stream is a movie application, a plurality of page menus cannot be realized. Second, a transition effect between menu pages in a plurality of page menus cannot be provided.
SUMMARY OF THE INVENTION
• The present invention provides a storage medium having recorded thereon an interactive graphic stream providing a plurality of page menus even in a case where a main stream is a movie application and an apparatus to reproduce the same.
• The present invention also provides a storage medium having recorded thereon an interactive graphic stream by which various transition effects may be applied when transitions between pages are performed and an apparatus for reproducing the same.
• According to an aspect of the present invention, there is provided a storage medium in which multimedia information is recorded, comprising: video data; and graphic data to provide a menu screen overlaid on an image based on the video data, wherein the graphic data provides a plurality of menu pages.
• The graphic data may include composition information and object information of menus.
• The graphic data may further include color information of the menu screen.
• The composition information of the menus may include information of the plurality of menu pages.
• The information of the plurality of menu pages may be identified by a unique identification (ID) for each page.
• The information of the plurality of menu pages may further include information of transition effects applied when transitions between the plurality of menu pages are performed.
• The information of the transition effects may be designated for each button included in the plurality of menu pages, for each menu page included in the plurality of menu pages, or for each group for some buttons included in the plurality of menu pages.
• The information of the plurality of menu pages may further include duration information to designate a predetermined menu page to automatically disappear from a display screen when a user operation does not take place during a predetermined duration after the predetermined menu page is displayed.
• The information of transition effects may include at least one of a menu page transition effect, a button transition effect, and a button animation effect.
• The composition information of the menus may be a composition segment of a display set of an MPEG-2 transport stream.
• According to another aspect of the present invention, there is provided a multimedia reproducing apparatus comprising: a decoder decoding video data; and a graphic decoder decoding graphic data to provide a menu screen overlaid on an image based on the video data, wherein the graphic decoder provides a plurality of menu pages.
• The apparatus may further include a memory storing a unique ID of a currently reproduced menu page.
• The graphic decoder may provide a page transition effect by setting the memory as a unique ID of a menu page to be changed.
• Additional and/or other aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
• These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
• FIG.1 is a configuration of AV data in which various elemental streams are multiplexed;
• FIG. 2 is a configuration of an interactive graphic stream of the elemental streams shown inFIG. 1;
• FIG. 3 is a configuration of an interactive composition segment to provide a plurality of menu pages according to an embodiment of the present invention;
• FIG. 4 is a block diagram of an apparatus to reproduce AV data according to an embodiment of the present invention;
• FIG. 5 is a block diagram of an interactive graphic decoder, which processes an interactive graphic stream and is a part of the reproducing apparatus shown inFIG. 4, according to an embodiment of the present invention;
• FIG. 6 is an example of the interactive composition segment to provide a plurality of menu pages according to an embodiment of the present invention;
• FIGS. 7A through 7D are definitions of data to illustrate fields of the interactive composition segment according to an embodiment of the present invention;
• FIG. 8 illustrates an example in which an animation effect is applied to button objects in the same menu page according to an embodiment of the present invention;
• FIG. 9 illustrates an example of a screen transition effect between different menus using a plurality of screen transition objects according to another embodiment of the present invention;
• FIG. 10 illustrates an example of the interactive composition segment to apply a screen transition effect in page units according to another embodiment of the present invention;
• FIG. 11 illustrates the screen transition effect in page units shown inFIG. 10 on a time axis;
• FIG. 12 is an example of an interactive composition segment including an operation of designating a time point at which a menu page disappears from a screen when a user operation does not take place over a predetermined duration according to another embodiment of the present invention;
• FIG. 13 is an example of a status register included in a reproducing apparatus according to an embodiment of the present invention;
• FIG. 14 illustrates a page selection model when an interactive graphic stream is processed;
• FIG. 15 illustrates an initializing procedure shown inFIG. 14;
• FIG. 16 illustrates a processing procedure due to a reproducing state change shown inFIG. 14; and
• FIG. 17 illustrates a processing procedure due to generation of a page transition request shown inFIG. 14.
DETAILED DESCRIPTION OF THE EMBODIMENTS
• Reference will now be made in detail to the present embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present invention by referring to the figures.
• FIG. 3 is an example of the interactive composition segment (ICS) shown inFIG. 2. More specifically,FIG. 3 shows a configuration of anICS300 to provide a plurality of menu pages according to an embodiment of the present invention.
• Referring toFIG. 3, theICS300 includes a plurality of menu pages310. Eachmenu page310 includes a group of a plurality of buttons constructing one menu screen and is identified by a page identification (ID) page_id312. That is, a plurality ofmenu pages310 are included in oneICS300, andtransition effect information314, applied when another page is transited to a relative page, is included in onemenu page310.
• FIG. 4 is a block diagram of an apparatus to reproduceAV data110 according to an embodiment of the present invention. Referring toFIG. 4, the reproducing apparatus includes aread unit410, ademultiplexer420, a plurality ofdecoders430 through460, and ablender470.
• In detail, theread unit410 reads the multiplexedAV data110 from a storage medium400 and transmits theread AV data110 to thedemultiplexer420. Thedemultiplexer420 divides the transmittedAV data110 into avideo stream102, anaudio stream104, a presentationgraphic stream106, and an interactivegraphic stream108 according to data types and transmits the dividedstreams102 through108 to the correspondingdecoders430 through460, respectively. Each stream transmitted to the corresponding decoder is decoded according to a data type thereof and waits to be output to a screen at a designated time. The decodedvideo stream102, presentationgraphic stream106, and/or interactivegraphic stream108 are overlaid into one image by theblender470. A selected image is output to the screen based on an output state set by a user. For example, the output state of the reproducing apparatus may be controlled on the basis of user selection such as on/off of subtitles and mute audio.
• In particular, the interactivegraphic decoder450 receives the interactivegraphic stream108 from the storage medium400, decodes the received interactivegraphic stream108, and outputs a menu screen including buttons on the screen at a designated time. The user selection may be input by the user selecting a specific button in the output menu screen. That is, a user interactive operation may be provided.
• FIG. 5 is a block diagram of the interactivegraphic decoder450, which processes the interactivegraphic stream108 and is a part of the reproducing apparatus shown inFIG. 4, according to an embodiment of the present invention.
• Referring toFIG. 5, in theAV data110 read from the storage medium400, only the interactivegraphic stream108 is selectively transmitted to atransmission buffer504 through a packet identifier (PID)filter502 and decoded by the interactivegraphic decoder450.
• The interactivegraphic stream108 is temporarily stored in acoding data buffer512 in the interactivegraphic decoder450 and is later transmitted to a streamgraphic processor514. After the transmitted interactivegraphic stream108 is decoded by the streamgraphic processor514, object data to define button images is transmitted to anobject buffer516, and composition information of buttons is transmitted to acomposition buffer518. Agraphic controller520 constructs an output image by referring to composition information, which is stored in thecomposition buffer518, corresponding to each transmitted object data and transmits the constructed image to a graphic plane530. That is, at a PTS, which is an output beginning time of the interactivegraphic stream108, an image to be output onto a current screen is determined under a control of thegraphic controller520, and the determined image is transmitted from theobject buffer516 to the graphic plane530. The transmitted image is output by referring to a color lookup table (CLUP)532 according to color information included in its associated composition information. Also, thegraphic controller520 changes a button state according to movement or selection of a button by receiving a user operation (UOP). The graphic controller then reflects the changing result on the screen output.
• In particular, theICS300 shown inFIG. 3 is decoded and stored in thecomposition buffer518. Thegraphic controller520 controls an output of a graphic image stored in theobject buffer516 by referring to decoded ICS information stored in thecomposition buffer518.
• FIG. 6 is an example of an ICS to provide a plurality of menu pages according to an embodiment of the present invention.
• Referring toFIG. 6, an example of a syntax structure of an ICS according to an embodiment of the present invention is illustrated. The ICS includes a plurality ofmenu pages610, and each menu page includes a plurality ofbuttons612.
• FIGS. 7A through 7D are definitions of data for illustrating fields of the ICS according to an embodiment of the present invention. Referring toFIGS. 6 and 7A through7D, a semantic structure of each field of the ICS will now be described in detail.
• • 1) segment_type: This is a field to indicate an ICS.
  • 2) segment_length: This is a field to indicate the number of bytes of the ICS.
  • 3) composition_number: This is a field to indicate a unique value of the ICS in an interactive graphic stream. When the ICS is changed or updated, the value sequentially increases from 0.
  • 4) composition_state: This is a field to indicate types of a display set included in the ICS.
• In detail,FIG. 7A illustrates the types of the display set included in the ICS. Referring toFIG. 7A, the interactive graphic stream is comprised of units, each unit being called an epoch, in consideration of an operating model of the interactivegraphic decoder450 described above. All of interactive graphic objects included in one epoch are decoded by the interactivegraphic decoder450 and continuously stored in theobject buffer516 included in the interactivegraphic decoder450, and unless next epoch data is input, the contents are equally maintained. Accordingly, in one epoch, the interactive graphic objects, which have been decoded and stored in theobject buffer516, may be reused without decoding the interactive graphic objects every time. However, when one epoch ends and a subsequent epoch starts, all of buffers in the interactivegraphic decoder450 are reset, and all stored data disappears. Also, when the buffers in the interactivegraphic decoder450 are reset may be defined as a predetermined time in one epoch.
• A display set is defined as an output unit of the interactive graphic objects as described inFIG. 3. The display set indicates a set of interactive graphic objects output onto one screen, and one epoch may include at least one display set. There exist three types of the display set. First, the display set in an epoch start (ES) state indicates the start of an epoch and includes all data to output interactive graphics, such as interactive graphic composition information required to construct the interactive graphics and object data to be used to construct button images. Second, the display set in an acquisition point (AP) state may exist after the ES display set, and the AP display set includes all information to construct the interactive graphics of a case in which a user randomly searches. Third, the display set in a normal case (NC) includes only data to be changed out of the interactive graphics constructed by a previous display set, i.e., only data to be updated. A plurality of display sets may be included in one epoch as shown inFIG. 7A. The epoch begins with the ES display set, and the AP or NC display set may follow the ES display set. The ES display set is necessarily included in one epoch, and the AP or NC display set is selectively included.
• Referring toFIG. 6, each field of the ICS will now be described in succession.
• • 5) composition_update_flag: This is a field indicating a correlation of button commands between a previous ICS and a current ICS.
• In detail,FIG. 7B illustrates definitions of a composition_update_flag value. Referring toFIG. 7B, when the composition_update_flag value is “0b,” button commands of a previous ICS and a current ICS are all the same, and when the composition_update_flag value is “1b,” the button commands are changed.
• • 6) composition_time_out_pts: This is a field indicating an interactive display terminating time. At the terminating time, the ICS is neither valid any more nor displayed on the screen. A PTS refers to a PTS of main video.
  • 7) UO_mark_table: This is a field indicating whether to allow user operations for all interactive display durations defined in the ICS.
  • 8) animation_frame_rate_code: This is a field to designate a frame rate applied to button transition effects and/or moving buttons.
  • 9) default_selected_page_id: This is a field indicating a page ID of a page basically displayed when reproduction of the ICS begins.
• A basic definition portion of the ICS has been described, and page structures indicating a plurality of pages are included in the ICS. A configuration of the page structures indicating a plurality of pages will now be described.
• • 10) page_id: This is a field indicating a unique ID of each page in the plurality ofpage structures610 in the ICS. In an embodiment of the invention, the reproducing apparatus stores an ID of a page currently displayed on the screen among the plurality of pages in the ICS in a system register. A configuration of the system register will be described with reference toFIG. 13 later.
  • 11) selection_time_out_duration: This is a field to designate a valid duration during which a button may be selected after an associated page thereof is displayed on the screen. If the user does not select a button before the time designated by the selection_time_out_duration field expires, a button designated by a default_activated_button_number field to be described later is activated. Here, the button designated by the default_activated_button_number field is activated only when the button designated by the default_activated_button_number field is valid.
  • 12) default_selected_button_number: This is a field to designate a number of a button basically selected when associated menu page thereof is displayed on the screen.
  • 13) default_activated_button_number: This is a field to designate a number of a button to be automatically activated in a case where the user does not select a button from when an associated menu page thereof is displayed on the screen to when the time designated by the selection_time_out_duration field expires. If a value of the default_activated_button_number field is assigned to “0xFF,” after the time designated by the selection_time_out_duration field expires, a currently selected button is activated, and if the value of the default_activated_button_number field is assigned to “0x00,” no buttons are activated.
• A definition portion of the page structures indicating a plurality of pages has been described, and button structures indicating a plurality of buttons included in each menu page are included in each page structure. A configuration of the button structures indicating a plurality of pages will now be described.
• • 14) button_number: This is a field indicating a unique ID of each button in the plurality of button structures in the menu page. Also, this field may be used when a relative button is selected using a number. Values from 1 to 99 may be used.
  • 15) numerically_selectable_flag: This is a field indicating whether a relative button may be directly selected using a button_number field of the button.
• In detail,FIG. 7C illustrates whether the button may be directly selected using the button_number field of the button. Referring toFIG. 7C, if a value of the numerically_selectable_flag field is “0b,” the button cannot be directly selected using the button_number field of the button, and if the value of the numerically_selectable_flag field is “1b,” the button may be directly selected using the button_number field of the button.
• • 16) auto_action_flag: This is a field to designate an operating mode of a relative button.
• In detail,FIG. 7D illustrates operating modes of the button. Referring toFIG. 7D, if a value of the auto_action_flag field is “0b,” when the button is selected, an operating mode of the button is changed to a selected_state mode, and if the value of the auto_action_flag field is “1b,” the operating mode of the button is changed to an actioned_state mode without displaying a button image. The operating modes are defined in a lower portion ofFIG. 6.
• • 17) button_horizontal_position: This is a field to designate a horizontal position of a top-left pixel of a relative button.
  • 18) button_vertical_position: This is a field to designate a vertical position of the top-left pixel of a relative button.
  • 19) upper (lower/left/right)_button_number: This is a field to designate a button_number field of a button selected by a UOP using a move_up (down/left/right)_selected_button field when the button is selected by moving an arrow in a up/down/left/right direction.
  • 20) page_change_start_object_id_normal (selected): This is a field to designate an ID object_id of a first button object to display a button of normal (selected)_state having a transition effect when a menu page is displayed on the screen at the first time or transited to another menu page.
  • 21) page_change_end_object_id_normal (selected): This is a field to designate an ID object_id of a last button object to display a button of normal (selected)_state having a transition effect when a menu page is displayed on the screen at the first time or transited to another menu page.
  • 22) start_object_id_normal (selected): This is a field to designate an ID object_id of a first button object, which should be displayed on the screen after displaying of a button object designated by the page_change_end_object_id_normal (selected) field is finished.
  • 23) end_object_id_normal (selected): This is a field to designate an ID object_id of a last button object to display the button of the normal (selected)_state on the screen.
  • 24) repeat_normal (selected)_flag: This is a field to designate whether to continuously repeat an animation of the normal (selected)_state. If a value of the start_object_id_normal (selected) field is equal to a value of the end_object_id_normal (selected) field, the repeat_normal (selected)_flag field has a value of “0x00.”
  • 25) start_object_id_activated: This is a field to designate an ID object_id of a first button object to display the button of the actioned_state on the screen.
  • 26) end_object_id_activated: This is a field to designate an ID object_id of a last button object to display the button of the actioned_state on the screen.
  • 27) number_of_button_command: This is a field to indicate the number of commands related to a relative button. If a value of the number_of_button_command field is set to 0, the button is used as only a simple graphic image without a command.
  • 28) button_command[cmd_id]: This is a field to store one navigation command corresponding to one button. If a button is selected by the user, a corresponding navigation command is activated.
• As is described above, according to the example of theICS300 according to an embodiment of the present invention, when a specific menu page is displayed on the screen,
• • 1)fields614 to give a screen transition effect of each button included in the menu page and
  • 2)fields616 to give an animation effect of each button after the screen transition effect are designated.
• Therefore, a manufacturer should produce a plurality of button objects to display desired screen transition effects and a plurality of button objects for animation effects of buttons, which should be continuously displayed on a page after the screen transition effects. As a result of these methods, the manufacturer may provide screen transition effects of various methods.
• Basically, in order to provide more dynamic screen transition in button units, whether the number of button objects included between the page_change_start_object_id_normal (selected) field and the page_change_end_object_id_normal (selected) field for each button is not the same does not matter. However, in a case where the same transition effect such as a fade-in/out effect is applied to an entire page, in order to provide a smooth screen transition effect, all buttons included in the page, in an embodiment of the invention, have the same number of button objects included between the page_change_start_object_id_normal (selected) field and the page_change_end_object_id_normal (selected) field. In a case where the screen transition effect is unnecessary, values of the two fields are, in an embodiment of the invention, equal to the value of the start_object_id_normal (selected) field.
• An example in which thefields614 to give a screen transition effect for each button included in the menu page and thefields616 to give an animation effect for each button after the screen transition effect are used will be described in detail. That is, an example in which the manufacturer produces a plurality of screen transition button objects and applies a screen transition effect between different pages will be described. Where two pages having the same value of the composition_number field are included in an ICS, a first menu page in which page_id=1 is shown inFIG. 8, and a second page in which page_id=2 is shown inFIG. 9.
• FIG. 8 illustrates an example in which an animation effect is applied to button objects in the same menu page according to an embodiment of the present invention.
• Referring toFIG. 8, one button having button_number=1 is displayed in the first menu page. For the animation effect, the button includes five different button objects in which object_id=1 through 5. Each button object is changed and displayed according to a frame rate designated in the animation_frame_rate_code field of each button object. Accordingly, the button animation effect may be realized.
• FIG. 9 illustrates an example of a screen transition effect between different menus using a plurality of screen transition objects according to another embodiment of the present invention.
• Referring toFIG. 9, the second menu page in which page_id=2 is shown. For example, the user may change the first menu page in which page_id=1 to the second menu page in which page_id=2 by activating a button in which button_number=1 of the first menu page. Here, an effect of showing buttons in which button_number=1, 2, and 3 included in the second menu page in which page_id=2 one by one from the left to the right and from the top to the down as indicated by anarrow902 will be described. In order to provide the screen transition effect, a plurality of button objects are displayed according to values of the page_change_start_object_id_normal (selected) field and the page_change_end_object_id_normal (selected) field. In detail, in the present embodiment, in a case of the button in which button_number=1, since there is no difference in the sense of sight from the button included in the first menu page in which page_id=1, a button object for the screen transition effect is not additionally included.
• Therefore, the values of the page_change_start_object_id_normal (selected) field and the page_change_end_object_id_normal (selected) field designate the same object_id=1 as a value of the start_object_id_normal (selected) field. Accordingly, if the first menu page is transited to the second menu page, the basic animation effect is repeatedly displayed as described inFIG. 8. Here, commands included in the button may be changed according to a manufacturer's purpose.
• In a case of buttons in which button_number=2 and 3, in order to provide the screen transition effect, the buttons include a plurality of button objects in which object_id=6 through 9 and object_id=15 through 22, respectively. Accordingly, the screen transition effect as indicated by thearrow902 is displayed. For each of the buttons in which button_number=2 and 3, after displaying a button object corresponding to the page_change_end_object_id_normal (selected) field of each button, a plurality of button objects for an animation effect existing between a button object indicated by the start_object_id_normal (selected) field and a button object indicated by the end_object_id_normal (selected) field are repeatedly displayed on the screen. Accordingly, the animation effect may be represented along with the screen transition effect.
• FIG. 10 illustrates an example of the ICS to apply a screen transition effect in page units according to another embodiment of the present invention.
• Referring toFIG. 10, unlike the methods of performing screen transitions in button units as shown inFIGS. 8 and 9, a method of applying a screen transition effect for each button group defined in a specific page or applying a screen transition effect in page units is illustrated.
• In order to perform screen transitions in page units, the page_change_start_object_id_normal (selected) field and the page_change_end_object_id_normal (selected) field used to give the screen transition effect in button units in the example of the syntax structure of theICS300 shown inFIG. 6 may be removed, and a field to apply the screen transition effect to an entire menu page may be added.
• Referring toFIG. 10, an example of adding atransition_effect field802 in a page structure in order to apply the screen transition effect in page units is illustrated. That is, a predetermined screen transition effect may be represented by, after predetermined screen transition effects that may be supported by all reproducing apparatuses are pre-defined, allocating attribute values to the pre-defined screen transition effects and designating an attribute value of a screen transition effect desired by the manufacturer to thetransition_effect field802.
• FIG. 11 illustrates the screen transition effect in page units shown inFIG. 10 on a time axis.
• Referring toFIG. 11, the shown time axis of an interactive graphic stream is equal to a time axis of a video stream. In a PES packet data including an ICS as described inFIGS. 8 and 9, interactive graphic stream data, such as an ICS, a PDS, and an ODS is decoded to fit a decoding time stamp (DTS), which is decoding time information included in the PES packet data during reproduction of video. After the decoding is finished, a page designated by a default_selected_page_id field is displayed on the screen at a PTS, which is presentation time information. In response to a navigation command of a specific button included in the displayed menu page, a screen transition between pages is performed. Also, since a valid interactive display duration is finished at the time designated by a composition_time_out_pts field, the menu page is not displayed on the screen any more.
• As is described above, in a plurality of menu pages included in one ICS, transitions between menu pages may be smoothly performed in response to navigation commands allocated to specific buttons of the menu pages in a valid interactive display duration by defining a beginning time (PTS) and an ending time (composition_time_out_pts) of an entire interactive display duration.
• FIG. 12 is an example of an ICS including an operation of designating a time point at which a menu page disappears from a screen when a user operation does not take place during a predetermined duration according to another embodiment of the present invention.
• Referring toFIG. 12, the ICS of this embodiment may be used as a pop-up menu during reproduction of a movie. In this case, if a menu displayed on the screen is continuously displayed until a display ending time designated by a composition_time_out_pts field as described inFIG. 11, a user may feel inconvenient when the user watches multimedia video such as high quality movie. Therefore, as shown inFIG. 12, a field to designate a currently displayed menu page to disappear when a predetermined time elapses may be added.
• In the present embodiment, apage_disappear_duration field1202 is defined. That is, the field to designate how long to wait before a current menu page disappears when a UOP does not take place after the current menu page is displayed on the screen is added. In other words, if a manufacturer designates a certain time value to the field, a current menu page is not displayed when the time designated to the field elapses in a state where a UOP does not take place after the current menu page is displayed. Here, data included in the displayed menu page does not disappear, however, the data is just not displayed on the screen.
• As is described above, in a case where a plurality of menu pages are included in an ICS, in order to transit to another menu page, one of the buttons included in a previous menu page should have a navigation command to transit to another menu page. That is, the navigation command will be a command to replace a page_id value of a currently displayed menu page with a page_id value of a new menu page to be transited. A reproducing apparatus, according to an embodiment of the present invention, displays the new menu page on the screen on the basis of the replaced page_id value. Therefore, the reproducing apparatus of this embodiment includes menu page information in a system register to store reproduction information of a currently reproducing storage medium. A page transition effect may be realized by the navigation command setting a value of the system register storing menu page information therein.
• A page transition process will now be described in detail.
• FIG. 13 is an example of a status register included in a reproducing apparatus according to an embodiment of the present invention.
• Referring toFIG. 13, an example of a system register (player status register: PSR) of the reproducing apparatus to support a plurality of menu pages in the same ICS is illustrated. APSR111302 stores page_id information of a currently reproducing menu page in a specific ICS of an interactive graphic stream. A page transition may be performed by one of buttons included in the ICS re-establishing thePSR111302 using a navigation command.
• FIG. 14 illustrates a page selection model when an interactive graphic stream is processed.
• Referring toFIG. 14, a process required to display a proper page in an ICS when the reproducing apparatus processes the interactive graphic stream is illustrated. Twogeneral statuses1406 and1412, each represented as an elliptic shape, and threetemporary statuses1404,1410, and1416, each represented as a rectangular shape, are shown. The two general statuses indicate aninvalid status1406 and avalid status1412. Thevalid status1412 indicates a state of reproducing a valid epoch of a current interactive graphic stream. Theinvalid status1412 indicates a reproduction stop state or a state in which a valid interactive graphic stream does not exist even if the status is in the reproducing state. A general status as described above maintains a current state unless a transition to another status is generated.
• A transition, such as areference number1402,1408,1414, or1418, is generated by a reproducing state change, a UOP, or a navigation command. If the transition is generated, a processing procedure, such as areference number1404,1410, or1416, proceeds in order to obtain a proper interactive graphic stream and page information. The four transitions are disc inserting1402, going to thevalid status1408, page transiting1414, and going to theinvalid status1418.
• Each transition process will now be described in detail.
• FIG. 15 illustrates theinitializing procedure1404 shown inFIG. 14. Referring toFIGS. 14,13, and15, when a storage medium is inserted in the reproducing apparatus, the reproducing apparatus moves to theinitializing status1404, which is a temporary status, in order to obtain a proper interactive graphic stream and page information. In theinitializing status1404, a procedure of setting the PSR is performed as shown inFIG. 15. That is, aninitial value 0 is set to the PSR11 storing a page_id value of a menu page to be first displayed. The reproducing apparatus moves to theinvalid status1406 after theinitializing procedure1404.
• FIG. 16 illustrates theprocessing procedure1410 due to a reproducing state change shown inFIG. 14.
• Referring toFIG. 16, theinvalid status1406 is continuously maintained until a valid epoch of an interactive graphic stream begins, and if a transition of beginning to reproduce the valid epoch of the interactive graphic stream is generated such as thereference number1408, the reproducing apparatus moves to the reproducingstate change status1410. In the reproducingstate change status1410, the processing procedure shown inFIG. 16 is performed. That is, a default_selected_page_id value is read from an ICS inoperation1602, and if the value is a valid page_id value, the value is set to the PSR11 inoperation1606, and if the value is invalid, whether a current PSR11 value is a valid page_id value is checked. Based on the result of the checking, if the current PSR11 is already set to a valid page_id value, the current PSR11 value is maintained inoperation1608, and if the current PSR11 value is invalid, a first page_id value of the ICS is set as the PSR11 value in operation1610. Accordingly, the reproducing apparatus is changed from theinvalid status1406 to thevalid status1412.
• FIG. 17 illustrates theprocessing procedure1416 due to generation of a page transition request shown inFIG. 14.
• Referring toFIGS. 14 and 17, a specific page of the ICS selected through theprocedure1410 described inFIG. 16 maintains thevalid status1412 until the time designated by the composition_time_out_pts field unless a UOP takes place. However, in a case where a UOP of activating a button to which a navigation command to transit to another page is allocated, such as thereference number1414, is received, thevalid status1412 is transited to theprocessing status1416 due to generation of a page transition request.
• In theprocessing status1416 due to generation of a page transition request, the processing procedure shown inFIG. 17 is performed. That is, if a value X of page_id for which a page transition request is generated is valid, the PSR11 is set to X in operation1702, and if the value X is invalid, a current page_id value is maintained inoperation1704. As is described above, when theprocessing procedure1416 due to generation of a page transition request is finished, thevalid status1412 is maintained.
• In a case where the time designated by the composition_time_out_pts field of a currently reproduced ICS elapses, or in a case where the interactive graphic stream is changed, since a currently displayed page becomes invalid, thevalid status1412 is transited to theinvalid status1406. That is, if a transition such as thereference number1418 is generated, a last page_id value stored in the PSR11 is maintained.
• As is described above, according to embodiments of the present invention, an ICS structure of an interactive graphic stream including a plurality of menu pages and a model of selecting a proper page in an ICS are provided.
• Accordingly, a plurality of menu pages may be provided regardless of application types of a main stream.
• Also, various transition effects may be applied when transitions between menu pages are performed.
• Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims (2)

1. A storage medium to store multimedia data which is reproduced in a reproducing apparatus, the storage medium comprising:

video data; and

graphic data which provides a menu overlaid on an image based on the video data and comprises a plurality of display sets,

wherein each display set comprises a composition segment, an object segment, and a palette segment, and

the composition segment provides information on a plurality of menu pages, each menu page comprising a page identification and transition effect information which is applied when transitions between the plurality of menu pages are performed.

2. An apparatus for reproducing multimedia from a storage medium, the apparatus comprising:

a decoder decoding video data; and

a graphic decoder decoding graphic data which provides a menu overlaid on an image based on the video data and comprises a plurality of display sets,

wherein each display set comprises a composition segment, an object segment, and a palette segment, and

the composition segment provides information on a plurality of menu pages, each menu page comprising a page identification and transition effect information which is applied when transitions between the plurality of menu pages are performed.

Images