TECHNICAL FIELDThe present invention relates to a multimedia player and a method of displaying a menu screen. More particularly, the present invention relates to a user interface technology for giving an instruction for multimedia playing.
BACKGROUND ARTIn recent years, the variety of so-called digital home appliances has been increasing. To record a television program, for example, there can be used a hard disk recorder, a digital versatile disk (DVD) recorder, or a multifunction device combining the functions thereof. Also in playing music, various forms of music playing are now available besides playing ordinary compact disks (CDs), such as reproducing compressed data recorded in various kinds of memory cards or a hard disk.
DISCLOSURE OF INVENTIONProblem to be Solved by the InventionDigital home appliances, particularly devices for playing images or music are expected to be used by multiple people at the same time. Accordingly, unlike personal computers (PCs), such devices are often placed in a living room or another shared space in a house. A control panel or a controller of a digital home appliance is usually designed with fewer buttons and a narrower display area. Therefore, items for control are sometimes displayed on a television screen or the like, which is separate from the appliance. Since one usually watches a television screen at some distance, small character strings or movement of a small pointer, as provided on a PC screen, is unsuitable for display on a television screen. Accordingly, favorable visual appearance and ease of operation are strongly desired in the user interface of a digital home appliance using a television screen. Particularly, non-PC users may not necessarily feel comfortable with methods of operation typically used for PCs.
It is also important in a multimedia player that the user interface does not much destroy a sense of a virtual world that a content provides to users.
The inventor has made the present invention on the basis of the recognition above, and a general purpose thereof is to provide to users an intuitive user interface in a multimedia player.
Means for Solving the ProblemOne embodiment of the present invention is an apparatus capable of playing digital contents. The apparatus comprises: an operation unit which receives an instruction as to content playing via a user's operation; a storage unit which stores data of a plurality of function icons representing the types of content playing functions, contents, data of a plurality of content icons representing items of contents, and data of a semi-transparent folder icon representing a unit for displaying contents; a display output unit which outputs, to a display apparatus, image data of a menu screen related to the playing of a content, and which plays an item of a content received from the storage unit in accordance with a user's instruction received by the operation unit; and a display control unit which relates an item of a content received from the storage unit to one of the types of the content playing functions and a plurality of folder icons, and which generates image data for a menu screen including a first array in which a plurality of function icons are arranged on the screen, and a second array in which a plurality of folder icons are arranged on the screen. The display control unit receives, as a folder attachment image, one of content icons representing related contents from the storage unit, with respect to each of the plurality of folder icons, and then displays, in the second array on the menu screen, the folder attachment image and the folder icon so that the folder attachment image is included in the folder icon superimposed thereon.
The term “content” refers to information including moving images, still images, audio, texts and programs that are played, displayed or run by multiple types of information conveying means. The “content” may include information for entertainment purposes. While the term “content” refers to an abstract notion of what is played in general, the term “item of content” or “content item” may refer to an individual data file for moving image data, still image data, audio data, text data or program data as a content. The notion of “acquiring content items” may refer to acquiring of data such as a list of content names or file names as “content items”. The term “playing” may refer to running of a program as well as playing of an image or audio.
Also, “semi-transparent” means that a user can visually recognize a folder attachment image displayed transparently beneath a folder icon, which is superimposed and displayed thereon.
According to this embodiment, a menu screen is configured so that a folder attachment image related to a content can be seen transparently beneath a semi-transparent folder icon. Accordingly, a user can intuitively understand that the user can view the item of the content by selecting the folder icon.
Another embodiment of the present invention is a method for displaying a menu screen using a content player. The method comprises: retrieving data of a plurality of function icons representing the types of content playing functions, contents, data of a plurality of content icons representing items of contents, and data of a semi-transparent folder icon representing a unit for displaying contents; relating an item of a retrieved content to one of the types of the content playing functions and a plurality of folder icons, and generating image data for a menu screen with a two-dimensional array including a first array in which a plurality of function icons are arranged in a particular direction on the screen, and a second array in which a plurality of folder icons are arranged in the direction intersecting the first array on the screen; and outputting, to a display apparatus, image data of a menu screen related to the playing of a content. In the generating, one of content icons representing related contents is received as a folder attachment image, with respect to each of the plurality of folder icons, and the folder attachment image and the folder icon are displayed in the second array on the menu screen so that the folder attachment image is included in the folder icon superimposed thereon.
Also in this embodiment, a user can intuitively understand that the user can view the item of the content by selecting the folder icon.
ADVANTAGEOUS EFFECTSThe present invention provides to users an intuitive user interface in a multimedia player.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is a diagram that shows the basic configuration of a multimedia playing system.
FIG. 2 is a functional block diagram that shows a configuration of a multimedia player.
FIG. 3 is a diagram that shows a configuration of a menu screen generated by the multimedia player.
FIG. 4 is a diagram that schematically shows how the items on the menu screen change.
FIG. 5 is another diagram that schematically shows how the items on the menu screen change.
FIG. 6 is a diagram that schematically shows changes in the screen made upon selection of a content item.
FIG. 7 is another diagram that schematically shows changes in the screen made upon selection of a content item.
FIG. 8 is yet another diagram that schematically shows how the items on the menu screen change.
FIG. 9 is a diagram that shows an example of content items and views related to the respective items.
FIG. 10 is a diagram that schematically shows how the items on a menu screen change in another embodiment.
FIG. 11 is another diagram that schematically shows how the items on the menu screen change in the another embodiment.
FIG. 12 is a flowchart that shows the operational process of the multimedia player.
EXPLANATION OF REFERENCE NUMERALS- 20 multimedia player
- 40 operation unit
- 46 display output unit
- 48 display control unit
- 50 menu screen
- 70 function icon array
- 72 folder icon array
- 78 content icon array
- 80 storage unit
- 96 playing screen generating unit
- 110 menu screen generating unit
- 112 background generating unit
- 120 folder icon
- 122 folder attachment image
BEST MODE FOR CARRYING OUT THE INVENTIONA multimedia playing system according to an embodiment of the present invention is a multifunction device capable of playing or running multiple types of contents such as still images, moving images, music, broadcast and games. The device is designed to use a screen of a television set as a display screen. To manipulate the device, a user uses items displayed on the screen and operation buttons on a controller. In order to play multiple contents on a PC, a viewer or another program dedicated to each content type needs to be used. Since such dedicated programs are generally provided by different vendors, the programs do not normally share a common interface. Accordingly, there is no unity among the methods of operation for the programs. Even if such programs were integrated under a common interface such as a portal screen, the result would be mere aggregation. Further, since the activation of each program requires more than a little time, users cannot comfortably switch between the programs.
A multimedia playing system according to the present embodiment integrates playing of multiple types of contents under a common interface, so as to offer unified operability to users. Also, it is assumed that a menu screen in the system provides three-dimensional space therein, and the system provides to users an intuitive user interface that makes the users feel as if they were making operation within the three-dimensional space. This enhances users' feeling of being immersed in the content's world.
FIG. 1 shows the basic configuration of a multimedia playing system. Amultimedia playing system10 functions with amultimedia player20 as a key component. To the multimedia-player20 are connected atelevision set30 and acontroller42. Thetelevision set30, externally connected to themultimedia player20, has a function of displaying or outputting images or audio output from themultimedia player20. Thecontroller42 is a device for acquiring various instructions as to content playing via the user's operation, and functions as a part of themultimedia playing system10. Thecontroller42 may be configured as a game controller as shown inFIG. 1, or, alternatively, as a remote controller used to control various functions provided by themultimedia player20.
To themultimedia player20, information is input via various recording media or various cables. For example, contents stored inexternal devices37 and39, which are connected to aLAN35, are input to themultimedia player20 via anetwork cable34. The input contents are stored or buffered in themultimedia player20 to be played.
Themultimedia player20 has functions of data reading and data writing with respect to anoptical disk36 including a DVD or a CD, and functions of data reading and data writing with respect to adetachable memory card38. Themultimedia player20 may read data of movies or music albums from theoptical disk36, and may read data of captured images or videos from thememory card38.
Themultimedia player20 displays on the television set30 a menu screen for providing instructions as to content playing. On the menu screen, content items stored in themultimedia player20 and content items stored in theexternal devices37 and39 are displayed. According to the user's instructions, each content can be played by themultimedia player20.
FIG. 2 is a functional block diagram that shows a configuration of the multimedia player. Themultimedia player20 comprises anoperation unit40, an input/output unit44, adisplay output unit46, adisplay control unit48, astorage unit80 and agame execution unit82. Themultimedia player20 can be implemented by configurations such as a CPU, a hard disk, a RAM, a ROM and a rendering circuit in terms of hardware, and by programs for providing various functions such as data input, data storage, image processing and rendering in terms of software.FIG. 2 illustrates functional blocks implemented by the cooperation of those components. Therefore, these functional blocks may be implemented in a variety of forms by combinations of hardware and software.
Theoperation unit40 includes: adirection determination unit92 which receives an instruction as to any of the four directions of up, down, left and right, provided via the user's operation on thecontroller42; aninstruction determination unit94 which receives an instruction as to playing of a content, stopping of the playing, invoking of the menu screen or the like, provided via the user's operation on thecontroller42; and anoperation control unit95 which controls the input/output unit44,display output unit46,display control unit48 andgame execution unit82, according to the instructions received by thedirection determination unit92 andinstruction determination unit94.
The input/output unit44 includes: anetwork control unit86 which processes, via thenetwork cable34, input of contents stored in external devices or output of various data; adisk control unit88 which controls input of data stored in theoptical disk36 or data writing into theoptical disk36; and a memorycard control unit90 which inputs or outputs data to or from thememory card38. Thenetwork control unit86 detects an external device connected to theLAN35. Thenetwork control unit86,disk control unit88 and memorycard control unit90 receive information, including names of content items stored in theexternal devices37 and39,optical disk36 and thememory card38, data of icons corresponding to the content items, size of the data, etc., and store such information in thestorage unit80. The data input via the respective units constituting the input/output unit44 will be transmitted to thedisplay output unit46,display control unit48,storage unit80 andgame execution unit82.
Thestorage unit80 stores contents input from theexternal devices37 and39 via thenetwork cable34, contents such as music and movies loaded from theoptical disk36, and contents such as still images and moving images loaded from thememory card38. Thestorage unit80 further stores data of multiple function icons, which represent the types of playing functions, contents to be played by thedisplay output unit46 or contents to be executed by thegame execution unit82, data of multiple content icons, each of which represents respective content items stored in thestorage unit80, and data of semi-transparent folder icons, which represent units for displaying contents. Also, content icons representing content items stored in theexternal devices37 and39,optical disk36 andmemory card38 are received by thenetwork control unit86,disk control unit88 and memorycard control unit90, and stored in thestorage unit80. The function icons, content icons and folder icons are used to display items on the menu screen.
A function icon, a content icon or a folder icon may be an uncompressed image such as a bitmapped image, or may be a compressed image such as a JPEG image. Alternatively, such icons may be objects configured by mapping textures onto polygons. In the latter case, manipulating Z values can change the position in the direction of the screen vertical axis in the virtual three-dimensional space within the screen.
Thedisplay output unit46 includes: a playingscreen generating unit96 which decodes and plays encoded data of a content; anoutput buffer100 which temporarily stores playing data to be output to thetelevision set30; an on-screen buffer102 which temporarily stores image data for on-screen display to be output to thetelevision set30; and a synthesizingunit98 which synthesizes data of playing data and image data.
The playingscreen generating unit96 decodes encoded content data, such as movies or music, which is received from the input/output unit44 orstorage unit80 according to the user's instructions received by theoperation unit40. Such decoded content data is then stored in theoutput buffer100. The on-screen buffer102 stores, as image data for on-screen display, image data for a menu screen and a background screen generated by thedisplay control unit48, for example. The synthesizingunit98 synthesizes data of playing data stored in theoutput buffer100 and image data for a menu screen and a background image stored in the on-screen buffer102, and converts the synthesized data into an analog signal to output it to thetelevision set30.
Thedisplay control unit48 includes: amenu management unit104 which manages, as menu items, the types of playing functions and content items adaptable to the respective playing functions; acontent control unit106 which controls playing or execution of each content; aneffect processing unit108 which processes the operation of icons on a menu screen; a menuscreen generating unit110 which generates image data for a menu screen; and abackground generating unit112 which generates a background image displayed in the background of a menu screen or a playing screen.
Themenu management unit104 maintains a list of content items stored in thestorage unit80 and content items input via the input/output unit44, and also memorizes a playing function and a content currently selected. The playing functions include, for example, functions of still image playing, music playing, moving image playing, broadcast display and game execution. Further, various setting functions and a network device selection function are also included therein. Themenu management unit104 also relates a content item to a type of a content playing function and multiple folder icons. Thecontent control unit106 controls, according to the user's instructions received by theoperation unit40, switching between playing functions, starting or stopping of content playing, data input via the input/output unit44, data retrieval from thestorage unit80, and processing performed by thegame execution unit82.
The menuscreen generating unit110 generates a menu screen, which is configured with an array of multiple function icons aligned horizontally, and an array of multiple folder icons aligned vertically. These two arrays intersect each other near the center of the screen to form a cross array. The menuscreen generating unit110 highlights a function icon and a folder icon displayed at or near the intersection of the cross array, so as to visually distinguish such icons from the other icons. Further, with respect to each of the multiple folder icons, the menuscreen generating unit110 receives from thestorage unit80 one of content icons representing related contents, as a folder attachment image. The menuscreen generating unit110 then displays the folder attachment image and the folder icon so that the folder attachment image is included in the folder icon superimposed thereon.
Theeffect processing unit108 performs processing as to scroll-displaying of arrays of function icons, folder icons and content icons, and highlighting of a function icon, a folder icon and a content icon to which attention is given. A highlighted icon is provided in a different format from the other icons, with, for example, displaying of the icon using different color and the change thereto, or the enlargement of the icon and the change thereto. Thebackground generating unit112 generates, as the background of a menu screen and a playing screen, a background image including a decorative object, which transforms within the virtual three-dimensional space provided in the screen.
Thegame execution unit82 executes a game program read out by thedisk control unit88 from theoptical disk36, or a game program read out from thestorage unit80. Thegame execution unit82 then performs processing as to the operation of the game program according to the user's instructions received by theoperation unit40, and transmits images and audio of the game to thedisplay output unit46.
FIG. 3 shows a configuration of a menu screen generated by themultimedia player20. Amenu screen50 displays a two-dimensional array in which afunction icon array70, which is formed by multiple function icons aligned horizontally, intersects afolder icon array72, which is formed bymultiple folder icons120 andfolder attachment images122 aligned vertically. Thefunction icon array70 include aphoto icon52, amusic icon54, a movingimage icon56, agame icon62 and asetting icon60, which represent the types of playing functions provided by themultimedia player20. Thefolder icon array72 includes folder icons representing predetermined units for display, into which multiple contents in thestorage unit80 are divided to be displayed on the menu screen. The menu screen consisting of thefunction icon array70 andfolder icon array72 is presented as an on-screen display superimposed upon a content image. When a content image currently reproduced is displayed in abackground area160, theeffect processing unit108 may color the whole area of thefunction icon array70 andfolder icon array72 or may adjust the brightness of the content image, so that the arrays can be easily distinguished from the background image in appearance.
Afolder icon120 is texture data that represents an actual semi-transparent case of a CD or a DVD. Afolder attachment image122 is, for example, the content icon of a content that is positioned at the top when contents related to a folder icon are sorted by name. Alternatively, a user may select, from among content icons, the one to be displayed as a folder attachment image. A content icon is, for example, a thumbnail of a jacket image attached to a case.
A function icon positioned in the area where thefunction icon array70 and thefolder icon array72 intersect (intersection area76) is colored differently from the other function icons and enlarged as illustrated. Theintersection area76 is located at a predetermined position in themenu screen50. According to the user's instruction via theoperation unit40, the entirety of thefunction icon array70 moves left or right before the color and size of the function icon positioned in theintersection area76 change. Thus, a user can select a desired playing function merely by specifying the lateral direction of left or right, and hence, a decision instruction such as a mouse click typically provided on a PC is unnecessary.
Theeffect processing unit108 moves function icons left or right by scrolling the whole area of thefunction icon array70 left or right. While the function icons are moved left or right, theeffect processing unit108 displays each of them with the same color and size but changes the color and size of only the function icon positioned in theintersection area76. To change the color, theeffect processing unit108 may change such attributes of the function icon as the brightness, chroma and hue, or may display the icon flashing. In such way, since a function icon positioned in theintersection area76 is displayed in a different display format from the other function icons, a user can select a medium easily.
When there is no function icon in theintersection area76 while the function icons are moving left or right, theeffect processing unit108 does not display thefolder icon array72. When one of the function icons is positioned in theintersection area76, theeffect processing unit108 may display thefolder icon array72 in a manner such that the array extends upward and downward from theintersection area76, or may fade in thefolder icon array72 already extended on themenu screen50. On fading in the extendedfolder icon array72, blurred images of the icons in the array are gradually made clear. In other words, the intensity of a filter applied to the icons is gradually reduced with time. Also, if the folder icons and folder attachment images are objects configured by mapping textures onto polygons, the Z values of the polygons may be manipulated. By gradually increasing or decreasing the Z values of the polygons from the initial values, the extendedfolder icon array72 will be displayed in such a manner as to move downward or upward from the front or back of the screen vertical axis to the level where the menu screen is defined. Also, by gradually increasing the a values of the textures from the initial values, the extendedfolder icon array72 may be displayed in a manner such that the transparent array becomes opaque gradually. Further, the extendedfolder icon array72 may be displayed in such a manner as to move from the right or left edge of the screen to theintersection area76. The display methods stated above may be used in combination.
By merely scrolling the function icons left or right with theintersection area76 as the target point, the user can recognize contents adaptable to the playing function. If an instruction as to the lateral direction is provided while thefolder icon array72 is displayed, theeffect processing unit108 may display themenu screen50 in a converse manner such that the extendedfolder icon array72 is withdrawn toward theintersection area76, or may fade out the extendedfolder icon array72 on themenu screen50. Means used for a fade-out is the same as that for a fade-in.
Anattention area77 located near the center of themenu screen50 is an area in which the user's target icon is displayed. The menuscreen generating unit110 displays thefunction icon array70 so that theintersection area76 is located near theattention area77, or, more specifically, immediately above theattention area77. Theattention area77 constitutes a part of thefolder icon array72.
When theoperation unit40 receives the user's instruction as to the longitudinal direction of up or down, eachfolder icon120 andfolder attachment image122 is moved upward or downward according to the instruction. Theeffect processing unit108 moves thefolder icons120 andfolder attachment images122 upward or downward by scrolling up or down the whole area of thefolder icon array72.
Whilefolder icons120 andfolder attachment images122 are moved upward and downward, theeffect processing unit108 displays each of them with the same color and size but enlarges only the folder icon andfolder attachment image122 positioned in theattention area77, recognizing the icon as an attention icon. Theeffect processing unit108 may also change such attributes of the attention icon as the brightness, chroma and hue, or may display the icon flashing. Theother folder icons120 andfolder attachment images122 are displayed smaller than the attention icon. Near theattention area77, namely to the right thereof, is displayedfolder information74, which relates to a view of thefolder icon120.
The menuscreen generating unit110 displays thefunction icon array70 slightly above the vertical center of themenu screen50, and displays thefolder icon array72 slightly to the left of the horizontal center of themenu screen50.
Thephoto icon52 represents a still image playing function, so that the icon should be selected when a still image is played. An image to be played is a still image mainly captured by a digital camera, and the image is loaded from thememory card38, for example. Afolder attachment image122 that is displayed when thephoto icon52 is located in theintersection area76 is, for example, a thumbnail of a still image. When there is no image suitable for the folder attachment image, thephoto icon52 may be used instead. As thefolder information74, view information, such as “capture month” or “capture year” of a still image, “album”, “alphabetical order” and “all photos”, and the number of still images are displayed. Also, capture information including the capture date and the file size is displayed as content information.
Themusic icon54 represents a music playing function, so that the icon should be selected when music data is played. Music data to be played is generated, for example, by encoding data loaded from theoptical disk36 in a specific compression format. Afolder attachment image122 that is displayed when themusic icon54 is located in theintersection area76 is, for example, a thumbnail of a jacket image of a song distributed with music data by a vendor, or a thumbnail of a visual effect image generated from part of music data through a specific process. When there is no image suitable for the folder attachment image, themusic icon54 may be used instead. As thefolder information74, view information, such as “genre”, “album”, “artist”, “recording year”, “alphabetical order” and “all music”, and the number of pieces of music data are displayed. Also, information including the song title, the album title and the playing time is displayed as the content information.
The movingimage icon56 represents a moving image playing function, so that the icon should be selected when a moving image is played. A moving image to be played is a recorded image captured by a digital video camera or an image read out from theoptical disk36 or an external device, which are encoded in a specific compression format. Afolder attachment image122 that is displayed when the movingimage icon56 is located in theintersection area76 is, for example, a thumbnail of a jacket image distributed with a moving image by a vendor, or a thumbnail of a given frame of a moving image. The thumbnail may be a moving image. When there is no image suitable for the folder attachment image, the movingimage icon56 may be used instead. As thefolder information74, view information, such as “genre”, “artist”, “capture month” or “capture year” of a moving image, “alphabetical order” and “all images”, and the number of moving images are displayed. Also, information including the title of the moving image, the recording date and the playing time is displayed as the content information.
Thegame icon62 represents a game execution function, so that the icon should be selected when a game program is executed. An object to be executed is a game program stored in thestorage unit80 or a game program loaded from theoptical disk36. Afolder attachment image122 that is displayed when thegame icon62 is located in theintersection area76 is, for example, a thumbnail of a jacket image distributed with a game program by a vendor, an icon representing a game program, a thumbnail of a given frame of a moving image provided in a game, or a thumbnail of an image of a game character. The thumbnail may be a moving image. When there is no image suitable for the folder attachment image, thegame icon62 may be used instead. As thefolder information74, view information, such as “genre”, “alphabetical order” and “all programs”, and the number of programs are displayed. Also, information including the title of the game program and the date when the program is installed is displayed as the content information.
The settingicon60 represents various setting functions, so that the icon should be selected when each setting in themultimedia player20 is changed.
In the background of a menu screen, a background image generated by thebackground generating unit112 is displayed in abackground area160. Thebackground generating unit112 superposes adecorative object162, which transforms within the virtual three-dimensional space in the screen according to a certain rule, and a background object occupying area other than thedecorative object162, so as to generate a single background image. Thebackground generating unit112 may generate a background image that transforms according to a certain condition, without using thedecorative object162.
FIG. 4 schematically shows how the items on themenu screen50 change. When theoperation unit40 receives the user's instruction as to folder selection in the state shown inFIG. 3, theeffect processing unit108 moves thefolder attachment image122, upon which thefolder icon120 is superimposed and displayed in theattention area77, in a manner such that theimage122 is extracted from theicon120 in the direction intersecting thefolder icon array72. InFIG. 4, thefolder attachment image122 is extracted to the right. While displaying thefolder attachment image122 moving to the right, theeffect processing unit108 also moves thefunction icon array70 andfolder icon array72 slightly to the left maintaining the intersection of the both. Theeffect processing unit108 may only move the folder attachment image to the right, without moving thefunction icon array70 andfolder icon array72.
FIG. 5 shows a continuous change of themenu screen50 starting fromFIG. 3 and also shows the result of the user's instruction as to the selection of thefolder icon120. As shown inFIG. 5, since thefunction icon array70 has been moved to the left, a part of the settingicon60 is not displayed on themenu screen50. Also, theattention area77 is displayed away from the center of themenu screen50 to the left. Thefolder attachment image122 extracted from thefolder icon120 is positioned to the right of theattention area77. Such position is newly defined as asecond attention area79.
To the right of thefolder icon array72 is arranged acontent icon array78.Content icons124 that represent content items related to thefolder icon120 in theattention area77 are received from thestorage unit80 and displayed on themenu screen50. Thecontent icon array78 may be displayed, after thefolder attachment image122 is extracted to the right, in such a manner as to extend upward and downward from thesecond attention area79. It is more preferable, however, if thecontent icon array78, already extended parallel to thefolder icon array72, is faded in on the screen at a time when thefolder attachment image122 moves to the right. In the latter case, the time required to display thecontent icon array78 can be reduced. In addition, since little movement occurs on themenu screen50, the user's attention is less likely to be drawn thereto. Accordingly, thesecond attention area79 becomes more likely to gather the user's attention.
By fading in thecontent icon array78 extended upward and downward, blurred images of the icons in the array are gradually made clear. In other words, the intensity of a filter applied to the icons is gradually reduced with time. Also, if the content icons are objects configured by mapping textures onto polygons, the Z values of the polygons may be manipulated. By gradually increasing or decreasing the Z values of the polygons from the initial values, the extendedcontent icon array78 will be displayed in such a manner as to move downward or upward from the front or back of the screen vertical axis to the level where the menu screen is defined. Also, by gradually increasing the a values of the textures from the initial values, the extendedcontent icon array78 may be displayed in a manner such that the transparent array becomes opaque gradually. Further, the extendedcontent icon array78 may be displayed in such a manner as to move from the right or left edge of the screen to the right of thefolder icon array72. The display methods stated above may be used in combination.
At the stage shown inFIG. 5, thefolder attachment image122 extracted from thefolder icon120 is displayed as one of thecontent icons124. It is because thefolder attachment image122 is originally a content icon selected from among content icons of contents related to thefolder icon120. When one of thecontent icons124 is selected in thecontent icon array78, the corresponding content item is played.
As with the icon in theattention area77, thecontent icon124 positioned in thesecond attention area79 is also highlighted by theeffect processing unit108. When theoperation unit40 receives the user's instruction as to the longitudinal direction, theeffect processing unit108 moves thecontent icon array78 upward or downward, and thecontent icon124 located in thesecond attention area79 is then highlighted. Further, to the right of thecontent icon124,information140 on the corresponding content item, such as the song title or the playing time, is displayed.
After or while thefolder attachment image122 is extracted from thefolder icon120 according to the user's instruction as to folder selection, theeffect processing unit108 may preferably display the function icons52-62,folder icons120 other than the folder icon selected by the user, and folder attachment images upon which thefolder icons120 are superimposed and displayed in thefunction icon array70 and thefolder icon array72, with images acquired by applying a certain filter for making images indistinctive, instead of icons or images displayed before the selection of the folder icon. Such filter gives an effect of, for example, reducing the size of images, displaying images lighter by decreasing the luminance values of pixels, or making images blurred and unfocused. These effects may be used in combination. If such function icons, folder icons and folder attachment images are objects configured by mapping textures onto polygons, the objects may be made semi-transparent by decreasing the a values of the textures or may be moved toward the back of the screen vertical axis by manipulating the Z values, without applying a filter.
If a filter for making images indistinctive is applied to the function icons, folder icons and folder attachment images, images resulted therefrom may be used to replace the images displayed before the filter is applied, so as to generate a menu screen displayed after the folder icon is selected. Alternatively, a screen acquired by applying a filter for making images indistinctive to the entirety of themenu screen50, which is generated by the menuscreen generating unit110 before the folder icon is selected, may be used as the menu screen displayed after the folder icon is selected.
In the example shown inFIG. 5, all the icons and folder attachment images in thefunction icon array70 andfolder icon array72, except for thefolder icon120 in theattention area77, are displayed smaller and lighter than those displayed before thefolder icon120 is selected, as shown inFIG. 4. With such display, icons that are not being selected by the user and need not to attract the user's attention at the time can be made indistinctive, thereby turning the user's attention to thesecond attention area79. Meanwhile, to indicate that the function icon positioned in the intersection area76 (themusic icon54 inFIG. 4) is currently selected, the size of the icon may be provided unchanged before and after the selection of the folder icon. Also, the function icon in theintersection area76 and the folder icon in theattention area77 may be displayed with reduced size, as with the other icons, after the folder icon is selected.
By displaying icons other than that selected smaller and unfocused upon the user's instruction as to folder selection, a visual effect can be also obtained as if the icons other than the selected icon moved toward the back of the screen vertical axis from the user's point of view. This makes the user feel as if the user were making menu operation within the three-dimensional space virtually provided in themenu screen50, thereby enhancing the user's feeling of being immersed therein.
When theoperation unit40 receives the decision of playing a content that corresponds to thecontent icon124 displayed in thesecond attention area79, the menuscreen generating unit110 hides the image data of the menu screen, and thecontent control unit106 provides control to start the playing of the selected content.
FIG. 6 schematically shows a change in the screen made upon selection of a content item. When themenu screen50 shifts to acontent playing screen51, thebackground generating unit112 hides thefunction icon array70,folder icon array72 andcontent icon array78, but continues to display thedecorative object162, which has been displayed on themenu screen50, also on thecontent playing screen51. This appears as a seamless shift from the menu screen to the content playing screen. Accordingly, the user may hardly perceive discontinuity between the screens and can consequently concentrate on the content item being played. Thebackground generating unit112 displays thecontent icon124 of the selected content item in the bottom left corner of thecontent playing screen51, and also displays, to the right thereof,information146 on the selected content item. Once the content playing is started, thebackground generating unit112 operates thedecorative object162 in thebackground area160 according to parameters obtained from the output feature values of the content being played, etc.
When theoperation unit40 receives the decision of content playing from the user, thebackground generating unit112 changes the background image during the change from themenu screen50 to thecontent playing screen51, using an image with which a visual effect can be obtained as if the user were moving toward the back or returning toward the front in the three-dimensional space from the user's point of view. For example, the size of thedecorative object162 may be changed by multiplying the control parameter of the object by a factor, or operation may be provided with which an effect is obtained as if the background image moved toward the back or the front. These effects make the user feel as if the user were moving toward the back or the front within the virtual three-dimensional space, thereby helping the user concentrate on the content.
Also, thebackground generating unit112 may extract the color tone of thecontent icon124 corresponding to the content item that the user has decided to play. Then, the color of thedecorative object162 or background object, both of which constitute the background image, may be adjusted so that its color tone becomes similar to the extracted color tone. In that case, since the color tone is reflected in the background image with respect to each content, the continuity can be obtained between the atmosphere of themenu screen50 and that of thecontent playing screen51, especially when a thumbnail of a frame of a moving image content is used for a content icon. Accordingly, even with the switching from a menu screen to a content playing screen, the user can concentrate on the content.
Further, thebackground generating unit112 may change the color tone of thedecorative object162 or background object constituting the background image, at a time when theoperation unit40 receives the decision of playing from the user.
Thebackground generating unit112 may transform thedecorative object162 during content playing according to the output feature values of the content or button operation on thecontroller42 provided by the user. For example, when a music content or a moving image content is played, thedecorative object162 may be transformed using the spectrum of the audio data as a parameter. Alternatively, the control parameter of thedecorative object162 may be changed according to button operation from the user, such as “OK”, “cancel” and “move”. Thus, by using the same decorative object on a menu screen and a content playing screen, the continuity can be obtained between the atmosphere of both the screens. Accordingly, even with the switching from a menu screen to a content playing screen, the user can concentrate on the content.
When theoperation unit40 receives the user's instruction as to the displaying of the control panel during content playing, the playingscreen generating unit96 fades in anoperation panel image148 for making operation, such as playing, stopping, pausing, fast-forwarding and rewinding of the content, on the content playing screen51 (seeFIG. 7). A method of fading in is the same as stated previously. Also during such operation, thedecorative object162 continues to move in accordance with the control parameter.
When the user instructs the invoking of the menu screen via theoperation unit40 during content playing, the menu screen is superimposed and displayed upon the screen that has been provided during the content playing. On the menu screen displayed there is re-created the state that appeared when the content playing was decided.
FIG. 8 schematically shows the state in which an option menu is displayed according to the user's instruction. When theoperation unit40 receives the user's instruction as to the displaying of an option menu, the menuscreen generating unit110 generates anoption menu142. Theeffect processing unit108 then displays theoption menu142 fading in on themenu screen50. By fading in theoption menu142, in which items are arranged longitudinally, blurred image of theoption menu142 is gradually made clear. In other words, the intensity of a filter applied to the images is gradually reduced with time. Also, if theoption menu142 is an object configured by mapping textures onto polygons, the Z values of the polygons may be manipulated. By gradually increasing or decreasing the Z values of the polygons from the initial values, theoption menu142 will be displayed in such a manner as to move downward or upward from the front or back of the screen vertical axis to the level where the menu screen is defined. Also, by gradually increasing the a values of the textures from the initial values, theoption menu142 may be displayed in a manner such that the transparent menu becomes opaque gradually. Further, theoption menu142 may be displayed in such a manner as to move from the right or left edge of the screen to the right of thefolder icon array72. The display methods stated above may be used in combination.
In such occasion, theeffect processing unit108 displays the icons included in thefunction icon array70,folder icon array72 andcontent icon array78, with images acquired by applying a certain filter for making images indistinctive, instead of icons or images displayed before the displaying of theoption menu142. Such filter gives an effect of, for example, reducing the size of images, displaying images lighter by decreasing the luminance values of pixels, or making images blurred and unfocused. These effects may be used in combination. If such function icons, folder icons and folder attachment images are objects configured by mapping textures onto polygons, the objects may be made semi-transparent by decreasing the a values of the textures or may be moved toward the back of the screen vertical axis by manipulating the Z values, without applying a filter.
When theoperation unit40 receives the user's instruction as to the selection of one of the items displayed in theoption menu142, the menuscreen generating unit110 generates asecond option menu144. Theeffect processing unit108 displays, to the right of theoption menu142, thesecond option menu144 fading in on themenu screen50 so that the blurred menu gradually becomes clear. In such occasion, theeffect processing unit108 displays the icons included in thefunction icon array70,folder icon array72 andcontent icon array78, with images acquired by applying a certain filter for making images indistinctive, instead of icons or images displayed before the displaying of thesecond option menu144.
Theoption menu142 andsecond option menu144 are presented as on-screen displays superimposed upon a content image or a background image. Theeffect processing unit108 may color the whole area of theoption menu142 andsecond option menu144 or may adjust the brightness of the content image, so that the menus can be easily distinguished from the background image in appearance.
Thus, when a folder or an option menu of a lower hierarchy level is displayed, icons that have been displayed before then are displayed smaller or less clearly to be less distinctive. In other words, icons less associated with the current operation will be displayed in such a manner as to move toward the back of the screen vertical axis in the virtual three-dimensional space on the screen. Conversely, icons of a higher hierarchy level will be displayed larger and more clearly.
When “view switching” in theoption menu142 is selected, the view with which contents are related to folder icons is changed. InFIG. 8, the content icon positioned in thesecond attention area79 is music data, so that the four views of “genre”, “album”, “artist” and “all” are shown in thesecond option menu144. If the content icon positioned in thesecond attention area79 is photo data, for example, the views of “month”, “year”, “album”, “alphabetical order” and “all” may be displayed in thesecond option menu144.
FIG. 9 is a diagram that shows an example of content items and views. In the present specification, a folder icon functions as a unit for displaying content items that are adaptable to a given content playing function. Also, a view represents a category or an aspect of a content item.
In a table150, acontent column152 shows the names of content items of music data (i.e. song data). Also, agenre column154, anartist column156, analbum column158, and arecording year column159 shows the genres, artists, albums, and recording years of the content items shown in thecontent column152, respectively. In this case, the “genre”, “artist” or “album” corresponds to the “view”. Accordingly, when the genre view is selected, themenu management unit104 relates content items to the respective folder icons that are categorized into different genres. Specifically, the content items “aaa”, “bbb” and “eee” are related to the “J-POP” folder icon, and the content items “fff”, “ggg” and “hhh” are related to the “Country” folder icon. These folder icons are displayed in thefolder icon array72, as shown inFIG. 3, on themenu screen50. When a different view, the album view, for example, is selected by the user, themenu management unit104 relates the content items to the respective folder icons that are categorized into different albums. For example, the content items “fff”, “ggg” and “hhh” are related to the “ζ” folder icon this time. Accordingly, in this case, the folder icons “α”, “β”, “γ”, “δ”, “ε” and “ζ” are displayed in thefolder icon array72, as shown inFIG. 3, on themenu screen50. Also, when the artist view is selected by the user, themenu management unit104 relates the content items to the respective folder icons that are categorized into different artists. For example, the content items “ggg” and “hhh” are related to the “F” folder icon this time. The same principal will be applied also in the case of the recording year view. Thus, the same content items “fff”, “ggg” and “hhh” may be related to a common folder icon or different folder icons, depending on the view.
It should be noted that, depending on the type of the content playing function, there is a case where there exists only one content related to a folder icon. For example, if theoptical disk36 only storing one portion of image data is inserted to themultimedia player20, only one folder icon will be displayed below the movingimage icon56. Further, if such folder icon is located in the attention area, there will be displayed only one content icon positioned in thesecond attention area79.
Also, it should be noted in the present specification that the classification of content items related to folder icons is irrelevant to the places where the content items are stored. Themenu management unit104 searches thestorage unit80,external devices37 and39,optical disk36, etc. for contents before relating each content item to a folder icon in accordance with the view being selected at the time.
The kinds of the view are not limited to those stated above. For example, “genre” or “photographer” may be defined as a view for folder icons to which photo contents or moving image contents are related. Also, recording month or year may be defined as a view for folder icons to which music contents are related.
Although a case has been described with reference toFIGS. 3-9 in which themusic icon54 is selected as the function icon, the process is the same also in a case where another function icon is selected.
FIG. 10 schematically shows a menu screen in which thephoto icon52 is selected in thefunction icon array70 and moved to theintersection area76. Thephoto icon52 is highlighted, and, below the icon, afolder icon130 and afolder attachment image132 are superposed and displayed. Thefolder attachment image132 is a thumbnail of any photo data related to thefolder icon130. Unlike thefolder icon120 of square shape shown inFIGS. 3-5, thefolder icon130 is a horizontally oriented rectangle provided based on a thumbnail of photo data. To the right of thefolder icon130, the view and the number of data pieces are displayed asfolder information134. InFIG. 10, “all” is selected for the view, so that all pieces of photo data are related to thesingle folder icon130. Accordingly, only thesingle folder icon130 is displayed as thefolder icon array72.
FIG. 11 schematically shows how the menu screen shown inFIG. 10 changes. When theoperation unit40 receives the user's instruction as to view switching, themenu management unit104 classifies content items according to the switched view and relates the content items tomultiple folder icons130. InFIG. 11, “month” is selected for the view, so that the menuscreen generating unit110 arranges, above and below theintersection area76, themultiple folder icons130 to which classified content items are related according to the capture months, so as to create thefolder icon array72. Then, one content icon is selected from among content icons of content items related to afolder icon130, and the content icon is superimposed and displayed as thefolder attachment image132 with thefolder icon130. Thefolder icon130 andfolder attachment image132 positioned in theattention area77 are highlighted, and, to the right thereof, the view and the number of data pieces are displayed as thefolder information134. The view information, i.e. capture months, are also displayed to the right of theother folder icons130.
Also,textual information136 regarding the view may be superimposed and displayed with thefolder icons130. For example, upon thefolder icon130 in theattention area77, the view information “12 2005” is displayed by the menuscreen generating unit110. Accordingly, the user can easily recognize the characteristics of contents related to thefolder icons130.
FIG. 12 is a flowchart that shows the operational process of the multimedia player. When the user powers on themultimedia player20, thenetwork control unit86 detects external devices on theLAN35 via the network cable34 (S6) and detects content items in the external devices and the storage unit80 (S8). The menuscreen generating unit110 then receives items including function icons and content icons from thestorage unit80 to generate a menu screen, and thedisplay output unit46 displays the menu screen on the television set30 (S10). If theoperation unit40 receives the user's instruction as to the direction of left or right (Y at S12), theeffect processing unit108 will move the function icons left or right according to the instruction (S14). Then, theeffect processing unit108 will highlight the function icon located in the intersection area76 (S16) and will receive, from thestorage unit80 or an external device, folder icons and folder attachment images for the playing function to display the icons and images in a manner such that they extend upward and downward (S18). If there is no user's instruction as to the lateral direction, S14 will be skipped (N at S12).
If theoperation unit40 receives the user's instruction as to the direction of up or down (Y at S20), theeffect processing unit108 will move the folder icons upward or downward according to the instruction (S22). Then, theeffect processing unit108 will highlight the folder icon and folder attachment image located in theattention area77 positioned immediately below the intersection area76 (S24) and will displayinformation140 on the folder to the right of the folder icon (S26). If there is no user's instruction as to the longitudinal direction, S22 will be skipped (N at S20).
If theoperation unit40 receives the user's instruction as to folder selection (Y at S28), theeffect processing unit108 will move the folder attachment image out of the folder icon to the right according to the instruction (S30). Then, theeffect processing unit108 will display content icons of content items related to the selected folder in a manner such that they extend upward and downward (S32). Further, theeffect processing unit108 will highlight the content icon located in thesecond attention area79 and will displayinformation140 on the content item to the right of the content icon (S34). The process of S12 through S26 is repeated until the user's instruction as to folder selection is received (N at S28).
The process of S12 through S34 is repeated until theoperation unit40 receives the user's instruction as to the decision of content playing (N at S36). When theoperation unit40 receives the instruction as to the decision of content playing (Y at S36), thecontent control unit106 starts the playing of the content highlighted in the attention area77 (S38). Also, when the menu screen shifts to a content playing screen, thebackground generating unit112 provides display with which a visual effect is obtained as if the user were moving toward the back from the user's point of view (S40). If theoperation unit40 receives the user's instruction as to the invoking of the menu screen during content playing (Y at S42), the process will jump back to S10 so that the process of S10 through S40 will be performed again. If there is no user's instruction as to the invoking of the menu screen, the content playing will be continued (N at S42). Then, if theoperation unit40 receives the user's instruction as to the stopping of the content playing, thecontent control unit106 will stop the content playing (Y at S44).
As described above, themultimedia player20 of the present embodiment displays on the menu screen50 a menu image consisting of an array of playing functions and an array of folder icons. Although thefunction icon array70 orfolder icon array72 actually displayed is one row or one column, other folder icons or content icons adaptable to different playing functions will be subsequently displayed by scrolling up, down, left or right. This makes the user feel as if a number of contents were arranged as a matrix on the entire screen. The user can select a content, feeling as if the user manipulated the matrix, in which a number of contents are arranged, to bring a desired content into focus. Moreover, since few icons are displayed on the screen in actual, the user will be never given the impression that the operation is complicated.
Also, when a folder icon is selected, there can be seen the movement such that a folder attachment image superposed and displayed is extracted from the folder icon. This makes the user feel as if the user were removing a disk from a CD or DVD case in the real world.
When the user selects a folder icon or the displaying of an option menu, icons not being selected are transformed to images that are visually indistinctive and displayed on the menu screen. Accordingly, the user can easily recognize on the menu screen the hierarchy level or operation currently selected. Also, when a folder icon is selected or when an option menu is displayed, items other than the folder icon or option menu are displayed smaller and unfocused on the menu screen. Accordingly, the user can perceive the depth in the direction of the screen vertical axis and obtain the feeling of making menu operation within the virtual three-dimensional space.
Further, since content items related to folder icons can be easily changed by view switching, the user can search for a content item that the user wishes to play from various aspects. Accordingly, more prompt and less stressful searches can be achieved.
Given above is an explanation based on the exemplary embodiment. The embodiment is intended to be illustrative only and it will be obvious to those skilled in the art that various modifications to constituting elements or processes could be developed and that such modifications also fall within the scope of the present invention. Hereinbelow, some modifications will be described.
In the embodiment, the menu screen is configured so that theintersection area76 is located immediately above theattention area77. As a modification thereof, the menu screen may be configured so that, for example, theintersection area76 is located immediately below or on the periphery of theattention area77, as long as it provides an arrangement with which a user can easily check a function icon while paying attention to an attention icon.
In the embodiment, themenu screen50 is configured so that thefunction icon array70 and thefolder icon array72 are displayed horizontally and vertically, respectively. In a modification, thefunction icon array70 andfolder icon array72 may be arranged utilizing the depth of the screen. For example, thefunction icon array70 andfolder icon array72 may be arranged in such a manner as to be attached on a spherical surface virtually provided in the screen. Then, the icons in the arrays may be configured to rotate along with the spherical surface according to the user's instruction as to the direction of up, down, left or right. Alternatively, the icon positioned in the attention area may be displayed nearest the front along the screen vertical axis, so that icons other than that are displayed in the back of the screen vertical axis. Accordingly, the icon moved to the attention area according to the user's instruction as to the direction of up, down, left or right will be displayed in such a manner as to pop up frontward. If the display mode of giving depth to thefunction icon array70 orfolder icon array72 is combined with the display mode of displaying items other than the selected icon smaller and unfocused, a user will be more instilled with the feeling of making menu operation within the virtual three-dimensional space.
Themultimedia player20 of the embodiment is configured so that theintersection area76 andattention area77 are located near the center of themenu screen50. In a modification, the positions where theintersection area76 andattention area77 are displayed may be freely determined by a user.
Themultimedia player20 of the embodiment displays a menu screen for providing instructions as to content playing, on thetelevision set30 externally connected. As a modification thereof, the multimedia player may be a portable multifunction device that comprises a display integrated with the player. Also, the multimedia player may be implemented by a personal computer executing computer programs for providing various functions described in the embodiment.
INDUSTRIAL APPLICABILITYThe present invention provides to users an intuitive user interface in a multimedia player.