RELATED APPLICATIONThis application is a continuation of U.S. patent application Ser. No. 10/112,394, filed on Mar. 29, 2002, which is incorporated by reference herein in its entirety.
FIELD OF THE INVENTIONThe present invention relates to graphical user interfaces for computer operating systems and, in particular, to a graphical user interface that may be rendered according to different views to provide an enlarged operating system desktop.
BACKGROUND AND SUMMARY OF THE INVENTIONIt is now common for operating systems to have a shell that provides a graphical user interface (GUI). The shell is a piece of software (either a separate program or component part of the operating system) that provides direct communication between the user and the operating system. The graphical user interface typically provides a graphical icon-oriented and/or menu driven environment for the user to interact with the operating system.
The graphical user interface of many operating system shells is based on a desktop metaphor that creates a graphical environment simulating work at a desk. These graphical user interfaces typically employ a windowing environment with the desktop.
The windowing environment presents the user with specially delineated areas of the screen called windows, each of which is dedicated to a particular application program, file or document. Each window can act independently, as if it were a virtual display device under control of its particular application program. Windows can typically be resized, moved around the display, and stacked so as to overlay another. In some windowing environments, windows can be minimized to an icon or increased to a full-screen display.
Windows may be rendered beside each other or may have a top to bottom order in which they are displayed, with top windows at a particular location on the screen overlaying any other window at that same location according to a z-order (an order of the windows along a conceptual z-axis normal to the desktop or display screen). The top-most window has the “focus” and accepts the user's input. The user can switch other windows to the top (and thereby change the z-order) by clicking on the window with a mouse or other pointer device, or by inputting certain key combinations. This allows the user to work with multiple application programs, files and documents in a manner similar to physically working with multiple paper documents and items that can be arbitrarily stacked or arranged on an actual desk.
Typically, the physical dimensions of computer display screen are much more limited than the desires of users to have different windows, tools, icons, etc. rendered simultaneously and the ability of operating system shells to do so. The result is that the limited extent of display screen “real estate” can limit the ability of operating system shells to render multiple windows, tools, icons, etc. simultaneously.
A variety of prior implementations have attempted to compensate for the fixed and limited extent of display screens. In one prior implementation referred to as morphing, objects (e.g., windows) are quickly transformed into smaller representations or symbols to reduce the amount of display screen area they require. For example, a window may be minimized to a symbol that is rendered on a task bar along on edge of the display screen. The working size f the object may then be re-generated by selecting or activating the symbol.
In another prior implementation referred to as scrolling, some objects (e.g., windows) are accessed from an unrendered, off-screen region by scrolling the objects into the fixed display screen area. For example, the user could be provided a graphical user interface affordance (such as a scroll bar) with which the off-screen objects are to moved into view.
In yet another prior implementation referred to as pop-ups/drop-downs, a user interface affordance (e.g., a menu name) is acted on by user to produce an overlay of other elements such as a window full of menu items that are separately selectable. Typically, this overlay is easily dismissed from the display screen. Finally, in still another prior implementation referred to as drawers, a user interface affordance at the edge of a display screen or window can be pulled out to reveal an overlay of objects or menu items, in the manner of a cabinet drawer. Typically the user can control the amount of the drawer that is pulled out to reveal more or fewer of the objects.
Such prior implementations attempting to compensate for the fixed and limited extent of display screens may be characterized as allowing a user either to move objects onto the fixed display screen area (e.g., as in scrolling or pop-ups/drop-downs or drawers) or moving objects from the display screen or reducing their size (e.g., morphing). As aspect of the present invention is that the fixed and limited extent of display screens may be effectively extended or enlarged by providing different views of an underlying desktop object.
The present invention provides an operating system shell with an underlying desktop object that is rendered according to different views. The operating system shell renders on a display screen a desktop graphical user interface with windows, tools, icons, etc. that are within a segment of the desktop object that can be observed (i.e., rendered) from one of the views. In illustrated implementations, the desktop object is of an extent that is greater than can be rendered from a single view. Allowing a user to select or access different views of the desktop object effectively provides an extended desktop that overcomes the fixed and limited display capabilities of conventional operating system shells.
In one implementation, a variable viewing angle interface is rendered in accordance with first and second viewing angles, the first viewing angle being perpendicular to the desktop object and the second viewing angle being non-perpendicular to the desktop object. A user-controlled viewing selection corresponding to one of perpendicular and angled views is obtained and encompasses one of respective first and second regions of the desktop object. The operating system graphical user interface is rendered as a three-dimensional image transformation of the desktop object in accordance with the selected view.
The present invention allows use of a desktop object that is larger than or extended relative a conventional display screen. Changes between the different views, such as making the change from the perpendicular view to the angled view, is akin to taking a “peek” around an obstruction, in this case the edge of a display screen. Accordingly, this use of different image transformation representations to provide different views of a desktop object may sometimes be referred to as a “peek-around” user interface that quickly reveals portions of desktop object that would normally not be seen.
Additional objects and advantages of the present invention will be apparent from the detailed description of the preferred embodiment thereof, which proceeds with reference to the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is a block diagram of a computer system that may be used to implement the present invention.
FIG. 2 is a diagram illustrating a desktop-based graphical user interface with a perpendicular view of an underlying desktop according to the present invention.
FIG. 3 is a top plan view of an image transformation representation corresponding to the perpendicular view of the desktop ofFIG. 2.
FIG. 4 is a diagram illustrating graphical user interface with an angled-view of an underlying desktop according to the present invention.
FIG. 5 is a top plan view of an image transformation representation corresponding to the angled view of the desktop ofFIG. 4.
FIG. 6 is an image transformation representation illustrating a perpendicular view of a desktop with a non-planar, stepped desktop object.
FIG. 7 is an image transformation representation illustrating a perpendicular view of a desktop with a non-planar desktop object having inclined segments.
FIGS. 8A and 8B are image transformation representations illustrating perpendiculars a planar desktop object at different first and second image distances.
FIG. 9 is a flow diagram of a desktop shell rendering method for selectively generating different views of a desktop-based graphical user interface.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTSFIG. 1 illustrates an operating environment for an embodiment of the present invention as acomputer system20 with a computer22 that comprises at least one high speed processing unit (CPU)24 in conjunction with amemory system26, aninput device28, and anoutput device30. These elements are interconnected by at least onebus structure32.
The illustratedCPU24 is of familiar design and includes anALU34 for performing computations, a collection ofregisters36 for temporary storage of data and instructions, and acontrol unit38 for controlling operation of thesystem20. TheCPU24 may be a processor having any of a variety of architectures including Alpha from Digital, MIPS from MIPS Technology, NEC, IDT, Siemens, and others, x86 from Intel and others, including Cyrix, AMD, and Nexgen, and the PowerPC from IBM and Motorola.
Thememory system26 generally includes high-speedmain memory40 in the form of a medium such as random access memory (RAM) and read only memory (ROM) semiconductor devices, and secondary storage42 in the form of long term storage mediums such as floppy disks, hard disks, tape, CD-ROM, flash memory, etc. and other devices that store data using electrical, magnetic, optical or other recording media. Themain memory40 also can include video display memory for displaying images through a display device. Those skilled in the art will recognize that thememory26 can comprise a variety of alternative components having a variety of storage capacities.
The input andoutput devices28 and30 also are familiar. Theinput device28 can comprise a keyboard, a mouse, a physical transducer (e.g., a microphone), etc. Theoutput device30 can comprise a display, a printer, a transducer (e.g., a speaker), etc. Some devices, such as a network interface or a modem can be used as input and/or output devices.
As is familiar to those skilled in the art, thecomputer system20 further includes anoperating system44 and typically at least oneapplication program46.Operating system44 is the set of software that controls the computer system operation and the allocation of resources.Application program46 is the set of software that performs a task desired by the user, using computer resources made available throughoperating system44. Both are resident in the illustratedmemory system26.
In accordance with the practices of persons skilled in the art of computer programming, the present invention is described below with reference to acts and symbolic representations of operations that are performed bycomputer system20, unless indicated otherwise. Such acts and operations are sometimes referred to as being computer-executed and may be associated with the operating system or the application program as appropriate. It will be appreciated that the acts and symbolically represented operations include the manipulation by theCPU24 of electrical signals representing data bits which causes a resulting transformation or reduction of the electrical signal representation, and the maintenance of data bits at memory locations inmemory system26 to thereby reconfigure or otherwise alter the computer system's operation, as well as other processing of signals. The memory locations where data bits are maintained are physical locations that have particular electrical, magnetic, or optical properties corresponding to the data bits.
Operating system44 has ashell48 that provides a graphical user interface (GUI). Theshell48 is a piece of software (either a separate program or component part of the operating system) that provides direct communication between the user andoperating system44. The graphical user interface typically provides a graphical icon-oriented and/or menu driven environment for the user to interact with the operating system. The graphical user interface of many operating system shells is based on or referred to as a desktop metaphor in which a graphical environment simulates working at a desk. These graphical user interfaces typically employ a windowing environment within the desktop metaphor.
FIG. 2 is a diagram illustrating a desktop-basedgraphical user interface50 with a perpendicular view of anunderlying desktop52 over which are renderedwindows54 and56 and a portion of awindow58. (An unrendered portion ofwindow58 is indicated by dashed lines.) It will be appreciated that any number of windows could be rendered ondesktop52. Windows54-58 are rendered byshell48 and allow a user to interact withoperating system44 or anapplication46 running onoperating system44.
Desktop-basedgraphical user interface50 provides a plan view ofdesktop52 and windows54-58. In the plan view, thedesktop52 and windows54-58 are represented as being in one or more planes that are perpendicular to a predefined line of vision from a user.
FIG. 3 is a top plan view of animage transformation representation70 corresponding to the perpendicular view ofdesktop52 ingraphical user interface50.Image transformation representation70 includes a viewpoint72 (indicated schematically as animage plane72aa camera72) with aviewing range74 and a perpendicular orientation to anextended desktop object76. The perpendicular orientation ofviewpoint72 encompasses acentral segment78 ofextended desktop object76 and omitslateral segments80 and82 ofextended desktop object76.
Image transformation representation70 illustrates that the appearance ofdesktop52 rendered on a computer display screen is based upon a three-dimensional image transformation in accordance with the present invention. Accordingly,desktop52 corresponds to a view ofdesktop object76 atviewpoint72 having a perpendicular orientation. Such an image transformation may be generated by a conventional transformation matrix representing a three-dimensional rotation about a Y-axis and being of the form:
where A is the angle of rotation. The matrix M is multiplied by a matrix corresponding to an object being rendered (e.g., a window and any features to be rendered within it) to generate the resulting view, as is known in the art of three-dimensional rendering. While it is sometimes used in applications that provide three-dimensional spatial representations, this type of three-dimensional projection transformation calculation is not the typical basis used by ashell48 to generate a desktop graphical user interface.
The perpendicular view ofdesktop52 may have an appearance similar to that of a conventional desktop graphical user interface. It will be appreciated, however, that perpendicular view ofdesktop52 is generated in a manner different from that of a conventional desktop graphical user interface. The three-dimensional projection transformation calculation above is used to generate both the perpendicular and angled views of desktop-basedgraphical user interface50. In contrast, a conventional desktop style graphical user interface is typically generated as a simple two-dimensional representation that is incapable of accommodating the different viewing angles provided by the present invention.
FIG. 4 is a diagram illustratinggraphical user interface50 with an angled-view ofunderlying desktop52 over which are renderedwindows54,56,58, and60. The angled-views of windows54-60 are rendered by theshell48 ofoperating system44 and provided an extended view ofdesktop52 that allows the user to interact withoperating system44 or an application running46 onoperating system44.
In the angled view ofFIG. 4, thedesktop52 and windows54-60 are represented as being in one or more planes that are not perpendicular to a predefined line of vision from a user. In the illustrated implementation, the angled-view is angled laterally relative to the perpendicular view. In the angled view, thedesktop52 and windows54-60 are represented as having a non-perpendicular orientation to a central predefined line of vision fromviewpoint72 to the display screen. As a result, windows45-60 are rendered with a parallax that causes the otherwise rectangular windows54-60 to have trapezoidal shapes. It will be appreciated that the parallax of windows54-60 inFIG. 4 would also affect any graphics, images, text, etc. rendered within windows54-60.
FIG. 5 is a top plan view of animage transformation representation100 corresponding to the angled view ofdesktop52 ingraphical user interface50.Image transformation representation100 includes a viewpoint102 with aviewing range104 and a laterally non-perpendicular orientation todesktop object76.Viewing range104 established by the non-perpendicular orientation ofviewpoint72 encompasses a major side desktop segment106. A second minorside desktop segment108 is not included inviewing range104.
Image transformation representations70 and100 allowdesktop object76 to be larger than or extended relative a conventional desktop object. The pivoting orrotation distinguishing viewpoints72 and102 makes the change from the perpendicular view to the angled view akin to taking a “peek” around an obstruction, in this case the edge of a display screen. Accordingly, this use of different image transformation representations to provide different views of a desktop object may sometimes be referred to as a “peek-around” user interface that quickly reveals portions of desktop object that would normally not be seen.
As with conventional desktop-style graphical user interfaces,graphical user interface50 of the present invention allows a user to manipulate and move windows rendered ondesktop52. For example, users may move windows betweencentral segment78 corresponding to the perpendicular view ofFIGS. 2 and 3 andsegments80 and82 that can be encompassed within angled views.
An optional aspect ofgraphical user interface50 is that users could move windows betweencentral segment78 andsegments80 and82 with keystroke or cursor controller (e.g., mouse) actions. For example, a window that is in one ofsegments80 and82 and rendered in an angled view ofdesktop object76 could be moved tocentral segment78 by a user selecting or activating the window. Likewise, a window that is incentral segment78 and rendered in the perpendicular view ofdesktop object76 could be moved to one ofsegments80 and82 by a predefined keyboard action by the user or by the user dragging a predefined portion of the window beyond a margin of the display screen.
Extended desktop object76 inFIGS. 3 and 5 is represented as a planar image surface that is generally parallel to the display screen on whichdesktop52 is rendered. Other aspects of the present invention are that extended desktop objects of other configurations may be used and that image transformation representations other than viewpoint rotation may be used to access and render marginal segments of an extended desktop object.
FIG. 6 is animage transformation representation120 illustrating a perpendicular view of a desktop (not shown) in a graphical user interface (not shown).Image transformation representation120 includes aviewpoint126 with aviewing range128 extending over a planarcentral segment130 of a non-planar, steppeddesktop object132.Non-planar desktop object132 further includeslateral segments134 and136 that are generally parallel tocentral segment130, but correspond to a depth ordistance138 fromviewpoint126 greater than depth ordistance140 tocentral segment130.
Depth ordistance138 oflateral segments134 and136 causes windows (not shown) that are position withinsegments134 and136 to appear farther fromviewpoint126 and, as a result, are rendered with a correspondingly smaller size that allows more objects (e.g., windows) to be rendered or discerned. It will be appreciated that the generation or rendering of windows or other objects inlateral segments134 and136, in comparison to the rendering incentral segment130, is readily accommodated by a depth factor in the conventional transformation matrix calculation for the display.
FIG. 7 is animage transformation representation150 illustrating a perpendicular view of a desktop (not shown) in a graphical user interface (not shown).Image transformation representation150 includes aviewpoint156 with aviewing range158 extending over a planarcentral segment160 of anon-planar desktop object162.Non-planar desktop object162 further includeslateral segments164 and166 that are inclined (i.e., generally not parallel) relative tocentral segment160, and correspond to a depth ordistance168 fromviewpoint156 typically greater than depth or distance170 tocentral segment160.
Lateral segment164 includes a pair of oppositelyinclined regions172 and174, withinner region172 being positioned betweencentral segment160 andouter region174. Likewise,lateral segment166 includes a pair of oppositelyinclined regions176 and178, withinner region176 being positioned betweencentral segment160 andouter region178. In the illustrated implementation, innerinclined regions172 and176 are of generally the same size and inclination asouter regions174 and178, respectively. It will be appreciated, however, thatinner regions172 and176 could be of size or inclination that differ from those ofregions174 and174. For example,inner regions172 and176 could be shorter and steeper thanregions174 and174. It will be appreciated that the generation or rendering of windows or other objects inlateral segments164 and166, in comparison to the rendering incentral segment130, is readily accommodated by a depth factor in the conventional transformation matrix calculation for the display.
The inclinations ofinner regions172 and176 will result in any windows rendered in those regions to have a greater parallax than windows rendered with reference to windows rendered in lateral segments of non-inclined desktop object (e.g.,FIGS. 4 and 5). Conversely, the inclinations ofouter regions174 and178 will result in any windows rendered in those regions being rendered with little or no parallax. It will be appreciated, therefore, that relatively steep, narrowinner regions172 and176 could provide visual transitions to wider, extendedouter regions174 and178 to give a user an extended, parallax-free desktop.
Thenon-planar desktop object162 of graphical user interface154 is merely one example illustrating that graphical user interfaces of the present invention could employ a variety of non-planar desktop objects. Alternative desktop objects could employ other combinations of flat segments, as illustrated, or could employ segments with smooth or continuous configurations. It will be appreciated that the generation or rendering of windows or other objects on such desktop objects, in comparison to the rendering incentral segment130, is readily accommodated by a depth factor in the conventional transformation matrix calculation for the display.
FIG. 8A is animage transformation representation180 illustrating a first perpendicular view of a desktop (not shown) on adesktop object186 in a graphical user interface (not shown).Image transformation representation180 includes aviewpoint190 that is afirst distance192 fromdesktop object186 and includes aviewing range192 extending over acentral segment194.Lateral segments196 and198 ofdesktop object186 are not included withinviewing range192.
FIG. 8B is animage transformation representation200 illustrating a second perpendicular view of desktop (not shown) ondesktop object186 in graphical user interface (not shown).Image transformation representation200 includesviewpoint190 that is asecond distance204 fromdesktop object186 and includes aviewing range206 extending over all ofdesktop object186.Second distance204 betweenviewpoint190 anddesktop object194 is greater thanfirst distance192 so thatviewing range206 encompassesdesktop object186 whileviewing range192 encompasses onlycentral segment194.
Image transformation representations180 and200 illustrate that the use of three-dimensional image transformations for rendering operating system displays may extend beyond lateral rotations. It will be appreciated that the generation or rendering of windows or other objects inimage transformation representations180 and200 is readily accommodated by a depth factor in the conventional transformation matrix calculation for the display.
FIG. 9 is a flow diagram of a desktopshell rendering method220 for selectively generating perpendicular and angled views of desktop-basedgraphical user interface50. It will be appreciated thatmethod220 is similarly applicable to generating alternative desktop views described with reference toFIGS. 6-8, and other alternative desktop views as well.
Process block222 indicates that an extended desktop object (e.g., extended desktop object76) is defined to have at least one dimension greater than a corresponding display screen. For example, the extended desktop object may have only a lateral dimension that is greater than a corresponding display screen dimension, as with exemplaryextended desktop object76. Alternatively, the extended desktop object may have only a vertical dimension that is greater than a corresponding display screen dimension, or may have both a lateral and a vertical dimension that are greater than the corresponding display screen dimensions.
Process block224 indicates that a viewpoint (e.g., viewpoint72) is established for determining a view of the desktop object.
Process block226 indicates that a viewing angle is selected between the viewpoint and the extended desktop object. As an example, a default perpendicular viewing angle may be defined. An angled, non-perpendicular viewing angle may be selected either upon a specific user command or automatically upon a user positioning a cursor at or within a predefined distance of a side margin of the display screen. Alternatively, eye pupil motion detection may be employed to detect a user looking to a side margin of a display.
Process block228 indicates that a desktop graphical user interface is rendered in accordance with the selected viewing angle.
Having described and illustrated the principles of our invention with reference to an illustrated embodiment, it will be recognized that the illustrated embodiment can be modified in arrangement and detail without departing from such principles. It should be understood that the programs, processes, or methods described herein are not related or limited to any particular type of computer apparatus, unless indicated otherwise. Various types of general purpose or specialized computer apparatus may be used with or perform operations in accordance with the teachings described herein. Elements of the illustrated embodiment shown in software may be implemented in hardware and vice versa.
In view of the many possible embodiments to which the principles of our invention may be applied, it should be recognized that the detailed embodiments are illustrative only and should not be taken as limiting the scope of our invention. Rather, we claim as our invention all such embodiments as may come within the scope and spirit of the following claims and equivalents thereto.