USRE38883E1

Movatterモバイル変換

Info

Publication number: USRE38883E1
Application number: US09/776,543
Authority: US
Inventors: Adrian Wyard
Original assignee: Microsoft Corp
Current assignee: Microsoft Technology Licensing LLC
Priority date: 1991-11-19
Filing date: 2001-02-02
Publication date: 2005-11-22
Anticipated expiration: 2016-02-02
Also published as: US5867144A; US5630080A

Abstract

A user is provided with an easy-to-use approach to directly manipulating text in a word processing environment or the like. Text may be dragged from one location and dropped in another location to move the text to a new location. More generally, the user is provided with the option of performing a conventional drag and drop operation or an enhanced or non-default drag and drop operation. Separate buttons on a mouse are utilized to differentiate between the two types of drag and drop operations. In the conventional drag and drop operation, default behavior is exhibited when an object is dropped on another object. In the enhanced drag and drop operation, a user is presented a list of options of operations that may be performed when the object is dropped on the other object.

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application is a division of U.S. patent application Ser. No. 08/278,455, filed Jul. 21, 1994, now abandoned, which is a continuation-in-part of Ser. No. 08/054,565, filed on Apr. 28, 1993, now abandoned, which is a continuation-in-part of Ser. No. 07/794,063, filed on Nov. 19, 1991, now abandoned.

TECHNICAL FIELD

The present invention relates generally to data processing system and, more particularly, to the direct manipulation of information by users, including drag and drop operations.

BACKGROUND OF THE INVENTION

The ability to manipulate selected portions of text in a document is a common feature of word processing programs. Presently, there are word processing programs which allow a user to select a string of text and manipulate it in some way, such as moving it to a new location on the document, copying it to a new location on the document or deleting it from a document. The problem with such prior art systems is that they require a user to go through several time-consuming steps before the text manipulation is actually carried out.

For example, to move a string of text from one location to another in a document using a typical prior art system, a user is required to 1) select the string of text to be manipulated; 2) delete or “cut” the selected string of text from the location using a combination of keys or by selecting the delete or cut command; 3) move the insertion point to the new location on the document where the selected string of text is to be moved; and 4) insert or “paste” the selected string of text to the new location using a combination of keys or by selecting the insert or paste command. Similar steps are required for copying text from one location to another in a document.

In word processing systems such as Microsoft Word, that support mouse operations, a user may select text with a mouse by positioning the point at the beginning of the selection, depressing a predefined mouse button, dragging the insertion point to the end of the selection while holding down the mouse button and then releasing the mouse button. After selection, cut and paste operations, such as described above, may be performed on the selected text.

The prior art systems require a user to be familiar with a variety of function keys and edit commands. When the user is making numerous revisions to a document, it is inconvenient to perform so many steps in order to move or copy text. The user is forced to perform awkward key combinations, such as depressing the Shift key and the Delete key at the same time. No technique is known in the word processing environment for moving or copying text without going through time-consuming cut and paste type operations or performing awkward key combinations.

SUMMARY OF THE INVENTION

In accordance with the first aspect of the present invention, a method and system is provided for directly manipulating text in a word processing environment or the like. After a user has selected text to be manipulated, the manipulation may be carried out with little effort on the part of the user. In accordance with this aspect of the present invention, the user merely positions the mouse pointer over the selected text, depresses and holds down a predefined mouse button, drags the insertion point to a new location and then releases the mouse button. Depending on whether the Alt key was depressed when the mouse button was released, the user may be presented with options such as whether the manipulation should be to move, copy or link the selected text, or the selected text may be moved and no option presented.

In accordance with another aspect of the present invention, a method is practiced in a data processing system having an input device and a video display. In this method, a source-visual element, such as an icon that is associated with the source object, is displayed on the video display along with a cursor and a target-visual element, such as an icon that is associated with the target object. The source-visual element is selected for movement in response to a user positioning the cursor in proximity with the source-visual element using the input device. The input device may be a mouse with at least two buttons. The source-visual element is moved on the video display in response to use of the input device by the user. The source-visual element is displayed on the video display in proximity to the target-visual element. The source-visual element may be moved in response to the user depressing a predetermined one of the buttons of the mouse and moving the mouse when the input device is a mouse with at least two buttons.

The source-visual element is dropped on the target-visual element in response to the use of the input device by the user while the source-visual element is in proximity with the target-visual element. If the input device is a mouse with at least two buttons, the source-visual element may be dropped by releasing the predetermined one of the buttons that was depressed to move the source-visual element. The menu of operations is then displayed on the video display. One of these operations may be selected by the user and involve the source object and the target object. The system determines if any of the operations displayed on the menu is selected by the user and determines the identity of any such user-selected operation. The system then performs the user-selected operation with the source object and the target object.

The menu of operations displayed on the video display may display a default operation. The default operation may have a visual indication or queue which indicates that it is the default operation. For example, the default operation may be boldfaced.

In accordance with another aspect of the present invention, a method is practiced wherein the first visual element that is associated with the first object is dragged across the video display to be in proximity with the second visual element that is associated with the second object on the video display. The drag is performed in response to a user using the input device (such as a mouse). The first visual element is dropped onto the second visual element in response to the user using the input device to perform a first default operation. The first default operation involves the first object of the second object. When the input device is a mouse with the first button and a second button, the drag and the drop is performed using the first button of the mouse.

A third visual element that is associated with the third object is dragged across the video display in response to the user using the input device to be proximity of a fourth visual element that is associated with the fourth object. The third visual element is then dropped onto the fourth visual element of the video display in response to the user using the input device. When the input device is the mouse having the first and second buttons, the dragging of the third visual element and dropping of the third visual element is performed using the second button. A menu of operations that the user may perform with the third object and the fourth object is displayed on the video display in response to the dropping of the third visual element. The system determines if any of the operations displayed on the menu have been selected by the user and determines the identity of any such user-selected operation. The system then performs the selected operation.

In accordance with still another aspect of the present invention, the first type of drag and drop operation is performed in response to the user using a first button of a two-button mouse to interact in the first drag and drop operation. The first type of drag and drop operation includes a drag portion and a drop portion. A default operation is performed after the drop portion of the first drag and drop operation.

A second drag and drop operation is then performed. The second drag and drop operation also has a drag portion and a drop portion. The second drag and drop operation is performed in response to the user using the second button of the mouse to interact with the system in the second drag and drop operation. After completion of the drop portion of the second drag and drop operation, a menu is displayed in the video display which lists choices of operations that the user may select to be performed as a result of the second drag and drop operation. The system determines which of the operations displayed on the menu is selected by the user and performs a selected operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a two-button mouse used in the preferred embodiments of the present invention.

FIG. 2 is a diagram depicting graphic elements displayed on a video display.

FIG. 3 is a block diagram of data processing systems suitable for practicing the preferred embodiments of the present invention.

FIG. 4 shows a typical word processing window, a pointer and an insertion point as they are seen on a display screen by a user in the first preferred embodiment of the present invention.

FIG. 5 shows a word processing document, as viewed on the display screen, after a user selects a string of text in the first preferred embodiment of the present invention.

FIG. 6 shows a word processing document, as viewed on a display screen, after the user positions the pointer over the selected text in the first preferred embodiment of the present invention.

FIG. 7 shows a word processing document, as viewed on a display screen, after a user presses the predefined mouse button while the pointer is positioned over a selected text in the first preferred embodiment of the present invention.

FIG. 8 shows a word processing document, as viewed on a display screen, after a user has dragged the insertion point to the location of the document where the selected text is to be moved in accordance with the first preferred embodiment of the present invention.

FIG. 9 shows a word processing document, as viewed on a display screen, after a user has dragged the insertion point to a location outside of the selected text and released the predefined mouse button in accordance with the first preferred embodiment of the present invention.

FIG. 10 shows a word processing document, as viewed on a display screen, after a user has dragged the insertion point to a location outside of the selected text and released the predefined mouse button while depressing the Alt key, causing text manipulation options to appear in the first preferred embodiment of the present invention.

FIG. 11 is a detailed flow diagram of a text manipulation process which moves text from one location to another in a document in accordance with the first preferred embodiment of the present invention.

FIG. 12 is a flowchart showing the steps performed in a conventional drag and drop operation in accordance with the second preferred embodiment of the present invention.

FIG. 13 is a flowchart showing the steps showing the steps performed by the second preferred embodiment of the present invention in an enhanced drag and drop operation.

FIG. 14 shows an example context menu for an expanded drag and drop operation in the second preferred embodiment of the present invention.

FIG. 15 is a flowchart illustrating the steps performed by the target object in an enhanced drag and drop operation in the second preferred embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

A first preferred embodiment of the present invention provides a method and system for directly manipulating text in a word processing environment or the like in a fashion that requires little effort on the part of the user. For example, the user may drag and drop text in order to move the text to new locations. In accordance with a second preferred embodiment of the present invention, the user is provided with the option of providing an expanded drag and drop operation in which the user selects and performs one of several different operations, rather than merely performing the default operation or employing difficult to use modifier keys to perform a limited number of operations. In this second preferred embodiment, the user also has the option of performing a conventional drag and drop operation. The drag and drop operations are not limited to text manipulations.

FIG. 1 shows an example of a two-button mouse that is suitable for performing a drag and drop operation. The two-button mouse10 includes aleft button12 and aright button14. A roller ball (not shown) is provided on the underside of themouse10 to generate directional commands as the mouse rolls along a flat surface.

As is illustrated inFIG. 2, the movement of the mouse is translated into the movement of thecursor16 on avideo display18.

FIG. 3 shows a block diagram of an illustrated data processing system for practicing the preferred embodiment to the present invention. Thedata processing system36 includes a central processing unit (CPU)38, a memory40, akeyboard42, avideo display44 and the conventional two-button mouse10. Those skilled in the art will appreciate that another style mouse, such as the three-button mouse, may be used with the present invention as well. The memory40 holds code for a word processing (WP)program47. In addition, for each drag and drop operation performed in the second preferred embodiment of the present invention, code for thesource object46, code thetarget object48 and code for theoperating system50 are stored within the memory40.

FIG. 4 shows a typicalword processing window57, as provided by the first preferred embodiment of the present invention.FIG. 4 also shows apointer56 and aninsertion point58, as they are seen on thedisplay screen55 by user. The mouse10 (FIG. 1) is used to position thepointer56, normally in the shape of an I-beam, over text/data displayed on thedisplay screen55. When themouse button12 is depressed, theinsertion point58 appears at the location of thepointer56. If thepointer56 is positioned beyond the end of a line and themouse button12 is depressed, the insertion point appears immediately after the last character on the line, not directly under the pointer. If themouse10 is moved while the mouse button53 is depressed, the insertion point is, in effect, dragged and text/data is highlighted as the insertion point is dragged over it to signify selection. The highlighting begins over the text when themouse button12 is depressed and continues to the text where themouse button12 is released.

FIG. 5 shows the user-selected text highlighted on the display screen. Thepointer56 remains in the shape of an I-beam, while theinsertion point58 disappears when the selection is made. If theprimary mouse button12 is depressed when thepointer56 is not over any part of the selectedtext59, the selection is canceled when theinsertion point58 appears at the location corresponding to thepointer56.

FIG. 6 shows the new shape of thepointer56 after the pointer is positioned over selectedtext59. In the first preferred embodiment described herein, thepointer56 takes the shape of a slanted arrow while it is positioned over the selectedtext59. After the text is selected, it is treated as a single object.

FIG. 7 shows the new shape of thepointer56 after the user depresses the mouse button53 while thepointer56 is positioned over the selectedtext59. In the first preferred embodiment of the present invention, the pointer takes the shape of a slanted arrow coming out of the dash-lined square and theinsertion point58 appears as a dash vertical bar when the mouse button53 is depressed while thepointer56 is positioned over the selectedtext59. A mouse then appears at the bottom of the screen prompting the user to use the mouse to move the selected text to a new location. If themouse button12 is depressed and released while thepointer56 is over any part of the selected text, the selection is canceled. The insertion point appears under thepointer56, and both the insertion point and the pointer reassume their original shapes.

FIG. 8 illustrates the display screen after the user has dragged theinsertion point58 to the location of the document where the selectedtext59 is to be inserted. Theinsertion point58 was moved by the user holding down the mouse button53 and repositioning thepointer56.

FIG. 9 shows the results of the text manipulation, in this case, a move operation. The selectedtext59 was deleted from its previous location and inserted at the location marked by the insertion point after the user released themouse button12. The text remains highlighted after the text manipulation is completed.

FIG. 10 shows an alternative implementation of the first preferred embodiment of the present invention. In particular, a pop-upmenu60 appears after the user drags the insertion point outside the selected text and releases the mouse button. The user then uses the mouse button to select one of the text manipulation options, such as “copy,” “move,” or “link.” A similar pop-up menu is used in the second preferred embodiment of the present invention, which is described below.

FIG. 11 is a detailed diagram of the steps performed in the first preferred embodiment of the present invention. The process of this first preferred embodiment begins withstep101, where the user must select a portion of text in the document using the mouse and mouse button. The selected text is highlighted. Next, the process continues withstep102, where the process queries whether the pointers positioned over the selected text. If the pointer is not positioned over the selected text, the process makes sure and step102A that the pointers shape is set to an I-beam and then queries instep103 whether the mouse button is down (MBD). If the mouse button is down and the pointer is now positioned over the selected text, the selection is canceled instep104, the highlighting disappears and the user may make a new selection. If the process determines instep103 that the mouse button is not down, the process loops back to step102 to check the position of the pointer.

The process determines instep102 that the pointer is positioned over the selected text and proceeds to step105, where the pointer shape is changed. In the preferred embodiment described herein, the pointers change from its normal I-beamed shape to a slanted arrow. Once the pointer is positioned over the selected text, the process queries instep106 whether the mouse button is down. If the mouse button is not down, the process loops atstep106. If the mouse button is down, the process continues on to step107 where the pointer shape is then changed and the insertion point is displayed to mark the location in the document corresponding to the pointer position.

The process then queries instep108 where the insertion point is positioned inside the selected text. The process checks the location of the insertion point rather than the pointer, because the pointer could be pointing to a location in the document other than the selected text while the insertion point is still within the selected text. Because the pointer may be positioned over any part of the screen, it follows the insertion point for the word processing documents does not always appear directly under the pointer. As shown inFIG. 3, even though thepointer56 may be positioned passed the end of the text in the last line, the insertion point only appears immediately after the last typed character, including spaces.

When the insertion point is positioned inside of the selected text, the process queries instep109 whether the mouse is still down. The process remains in the loop while the insertion point is positioned inside any part of the selected text and themouse button12 is down. If themouse button12 has been released while the insertion point is positioned inside of the selected text, the process continues on to step110 where the selection is canceled and the process is terminated. The user may begin the process again by selecting text.

If the process determines instep108 that the insertion point is positioned outside of the selected text, the process skips to step111. Instep111 the process queries whether the mouse button is still down. While the mouse button is down, the process merely loops atstep111, waiting for the mouse button to be released. When the mouse button is released, the process continues on to step112, where the selected text is moved to the location marked by the insertion point. The text remains highlighted in its new location and the pointer changes shape, the shape depending on the location of the pointer.

The second preferred embodiment of the present invention focuses on the non-default drag and drop feature described above relative to a word processing program. The second preferred embodiment of the present invention provides a more generalized mechanism for non-default drag and drop operation.

The second preferred embodiment of the present invention enables the user to perform a conventional drag and drop operation or, alternatively, a non-default drag (enhanced) and drop operation. The second preferred embodiment is applicable to any drag and drop operation and is not limited to drag and drop operations that involve text.

The second preferred embodiment of the present invention is especially well adapted for use in an object oriented programming environment. Hence, in the second preferred embodiment of the present invention described herein, the code for theoperating system50 provides an object-oriented programming environment. The target and source of the drag and drop operation are implemented as “objects.” An object is a combination of data members (i.e., attributes held in data structures) and member functions that act upon the data members. Those skilled in the art will appreciate, however, that the second preferred embodiment of the present invention need not be implemented in an object-oriented programming environment.

FIG. 12 is a flowchart illustrating the steps that are performed in a conventional drag and drop operation using theprimary button12 of the mouse10 (e.g., the left button in this case). Initially, a user moves the mouse10 (FIG. 1) to move the cursor16 (FIG. 2) on thevideo display18 until the cursor is positioned over a source-visual element20 that is associated with the source object. The user then clicks on the source-visual element20 by depressingbutton12 of the mouse10 (step126 in FIG.12). While keeping thebutton12 depressed, the user drags the source-visual element20 (FIG. 2) across thevideo display18 until the source-visual element20 is positioned over a targetvisual element22 that is associated with the target object (step128 in FIG.12). The user then releases theleft button12 of themouse10 to cause a drop in the source-visual element20 onto the target-visual element22 (step130 in FIG.12). A default operation is automatically performed (step132), and the source-visual element20 is advised of the default operation (step134).

The non-default or expanded drag and drop operation of the second preferred embodiment of the present invention is performed by executing the steps shown in the flowchart of FIG.13. The expanded drag and drop operation is initiated by positioning the cursor16 (FIG. 2) on the source-visual element20 and clicking the secondary button14 (FIG. 1) of the mouse10 (step152 in FIG.13). The source-visual element20 in the target-visual element may take many forms, including text, icons or graphic elements. The code for the source object46 (FIG. 3) is informed that thecursor16 has been positioned over the source-visual element and is also informed that the secondary button14 (FIG. 1) of themouse10 has been depressed by the messages that are sent to it. Movement of themouse10 and depressing a mouse button are events that are translated into messages by the code for theoperating system50. These messages are placed in a message queue for the executing application program.

Each application program run on the operating system has a separate message queue. Each application program retrieves messages from the message queue using a selection of code known as the “message loop.” Once the application program has retrieved a message from its message queue, the application program determines which window procedure should receive the message. A separate window procedure is provided for each window. The application program may provide several windows, and thus, the application program must determine which window is the proper destination for the message when the message is retrieved from the queue.

When thecursor16 is positioned over the source-visual element20, a message is generated that specifies the position of the cursor and the window which holds the sourcevisual element20. This message provides a relative position of thecursor16 in (X,Y) coordinates relative to the upper left-hand corner of the window. The window procedure associated with the window that holds the source-visual element20 receives this message and passes the message to the code for the source object46 (FIG.3). When the secondary button14 (FIG. 1) of themouse10 is depressed, the code for thesource object46 receives a message informing of the depression of the secondary button.

Oncestep152 ofFIG. 13 is performed, the source visual element20 (FIG. 2) is dragged by movement of the mouse10 (FIG. 1) until the source-visual element is positioned over the targetvisual element22. As the drag begins, the code for thesource object46 sends a message to the code for theoperating system50. This message holds an identifier for the source object associated with the source-visual element, information about the source-visual element20 and an indication of the operations that may be performed on the source object (step154 in FIG.13). The code theoperating system50 is responsible for tracking the mouse movements until the source-visual element20 is dropped.

When the source-visual element20 is positioned over the target-visual element22, thesecondary button14 of themouse10 is released to drop the source visual element (step156 in FIG.13). The code for the operating system50 (FIG. 3) for the list of valid operations from the source object for code to thetarget object48. Acontext menu163, such as shown inFIG. 14, is then displayed to show the possible operations that a user may perform (step158 in FIG.13). The operations listed on the context menu may include operations such as “move,” “copy,” and “link.” Among the operations shown in thecontext menu163 is the default operation, which is indicated in boldface (note that “move” is boldfaced in FIG.14). The operations listed in thecontext menu163 depend upon the nature of the target object and the source object. The determination of what operations are listed on thecontext menu163 will be described in more detail below. The user then may choose an operation for the context menu163 (step160 in FIG.13). The system determines that the selection is chosen and determines the identity of any such user-selected operation (step161). The selection option is then performed (step162). The user may also cancel the effect of the drag and drop operation so that no operation is performed. For example, a canceled option may be provided on the context menu162 (FIG. 14) or the user may cancel the operation by hitting the escape button or clicking the mouse outside the menu.

In order to understand what occurs once the source-visual element20 (FIG. 2) is positioned over the target-visual element22 in the second preferred embodiment of the present invention, it is helpful to review the steps performed by the code for the target object48 (FIG.3).

FIG. 15 is a flowchart showing the steps performed by the target object for a typical drag and drop sequence in the second preferred embodiment of the present invention. Before a target object may be a target for a drag and drop operation, it must first register as a target (step154). If an object is not registered as a target object, a source object will not be allowed to drop on the target object. Later, once the drag and drop operation is in progress, the target object receives a message that the source-visual element20 is positioned over the target-visual element22 (step166). Subsequently, the target object receives the message that the secondary button14 (FIG. 1) of themouse10 has been released to initiate a drop (step168 in FIG.15). This message of the mouse message that is not placed into the message queue, as described above, but rather is sent directly to the target object to ensure that the target object is properly informed of the drop. The target object then determines what operations are available to the user (step170). The determination of the available operation is performed by negotiation between the source object and the target object. The source object may have restrictions on the operations that can be performed on it. Likewise, the target object may have similar restrictions. Both the source object and the target object provide sets of possible operations that may be performed. The target object then determines the intersection of these two sets as the available set of operations (see step170).

Once the available operations have been determined, a context menu163 (FIG. 14) is displayed on thevideo display44 with a list of the available operations (step172). The user makes a selection from thecontext menu163 and the selection is relayed to the target object (step174). The code for the target object148 then performs a selected option that communicates with which operation was selected by the user to the source object (step176).

While the present invention has been described with reference to a preferred embodiment thereof, those skilled in the art will, nevertheless, appreciate that various changes in form and detail may be made without departing from the present invention, as defined in the appended claims.

Claims

1. In a computer system employing a graphical user interface and including a display and a user interface selection device, a method for moving text displayed in window, comprising the steps of:

displaying text in a window;

displaying a cursor in the window, the cursor being responsive to signals from the user interface selection device;

receiving a first selection signal indicating that a portion of the displayed text has been selected;

receiving a first position signal indicating that the cursor is positioned at a first position coinciding with the selected text;

in response to the first position signal, altering the appearance of the cursor to indicate that the selected text may be moved;

receiving a second selection signal, the second selection signal being received while the cursor is in the first position;

in response to the second selection signal, altering the appearance of the cursor to indicate the selected text is in the process of being moved;

receiving a second position signal indicating that the cursor is positioned at a second position, the second positioned being different from the first position, the cursor being moved while the second selection signal is maintained;

receiving a third selection signal; and

in response to the third selection signal, moving the selected text to the second position.

2. The method ofclaim 1, wherein the first selection signal comprises dragging the cursor across a portion of the displayed text.

3. The method ofclaim 1, wherein the second selection signal comprises a mouse button down signal and the third selection signal comprises a mouse button up signal.

4. A computer-readable medium having computer-executable instructions for performing steps comprising:

displaying text in a window;

receiving a third selection signal; and

5. The computer-readable medium ofclaim 4, wherein the first selection signal comprises dragging the cursor across a portion of the displayed text.

6. The computer-readable medium ofclaim 4, wherein the second selection signal comprises a mouse button down signal and the third selection signal comprises a mouse button up signal.

7. The method ofclaim 1, further comprising the step of:

in response to the first position signal, altering the appearance of the cursor to indicate that the selected text may be moved.

8. The computer-readable medium of

claim 4

, wherein the computer-executable instructions further perform the step of: