This application is based on application No. JP 2011-232772 filed in Japan, the contents of which are hereby incorporated by reference.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to an electronic device including a display screen configured as a touch panel.
2. Description of the Background Art
Conventionally, various techniques concerning an electronic device have been proposed. For example, Japanese Patent Application Laid-Open No. 2004-170444 discloses a technique concerning a mobile phone that is one kind of the electronic device.
In the electronic device, an improvement in its operability is demanded.
SUMMARY OF THE INVENTIONAn electronic device according to an aspect includes: a display screen configured as a touch panel; a screen operation identification module for identifying an operation performed on the display screen; a process execution module for executing a process in accordance with the operation identified by the screen operation identification module; and a storage module for storing correspondence information in which a process with use of information displayed on the display screen and an execution instruction operation on the display screen for instructing execution of said process are registered in association with each other. When the screen operation identification module identifies that, subsequent to a selection operation for selecting information displayed on the display screen, the execution instruction operation has been performed on the display screen, the process execution module executes the process associated with said execution instruction operation in the correspondence information, with use of the information selected by the selection operation.
A computer readable memory according to an aspect stores therein a control program for controlling an electronic device. The electronic device includes a display screen configured as a touch panel and stores therein correspondence information in which a process with use of information displayed on the display screen and an execution instruction operation on the display screen for instructing execution of said process are registered in association with each other. The control program is configured to cause the electronic device to perform the steps of: (a) identifying an operation performed on the display screen; and (b) upon identification in the step (a) that, subsequent to a selection operation for selecting information displayed on the display screen, the execution instruction operation has been performed on the display screen, executing, with use of the information selected by the selection operation, the process associated with said execution instruction operation in the correspondence information.
A process execution method according to an aspect is a process execution method in an electronic device including a display screen configured as a touch panel and storing therein correspondence information in which a process with use of information displayed on the display screen and an execution instruction operation on the display screen for instructing execution of said process are registered in association with each other. The process execution method includes the steps of: (a) identifying an operation performed on the display screen; and (b) upon identification in the step (a) that, subsequent to a selection operation for selecting information displayed on the display screen, the execution instruction operation has been performed on the display screen, executing, with use of the information selected by the selection operation, the process associated with said execution instruction operation in the correspondence information.
A process execution method according to an aspect is a process execution method in an electronic device including a display screen configured as a touch panel and storing therein correspondence information in which a process with use of information displayed on the display screen and an execution instruction operation on the display screen for instructing execution of said process are registered in association with each other. The process execution method includes the steps of: (a) displaying information on the display screen; (b) identifying that a selection operation for selecting information displayed on the display screen has been performed on the display screen; (c) after identifying the selection operation, identifying that an execution instruction operation has been performed on the display screen; and (d) executing the process associated with the execution instruction operation in the correspondence information, with use of the information selected by the selection operation.
In the above-described aspects, the operability of the electronic device is improved.
These and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is a perspective view showing an external appearance of an electronic device in a closed state;
FIG. 2 is a perspective view showing an external appearance of the electronic device in the closed state;
FIG. 3 is a perspective view showing an external appearance of the electronic device in an open state;
FIG. 4 is a perspective view showing an external appearance of the electronic device in the open state;
FIG. 5 is a block diagram showing an electrical configuration of the electronic device;
FIG. 6 is a diagram showing a functional block configuration of a control part;
FIG. 7 is a diagram showing one example of a correspondence table;
FIG. 8 is a diagram showing one example of the correspondence table in a graphical form;
FIG. 9 is a diagram showing a situation where a user selects information;
FIG. 10 is a diagram showing an exemplary display on a display screen after the information is selected;
FIG. 11 is a diagram showing a situation where the user performs an execution instruction operation;
FIG. 12 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed:
FIG. 13 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 14 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 15 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 16 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 17 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 18 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 19 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 20 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 21 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 22 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 23 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 24 is a diagram for explaining a method for identifying the execution instruction operation;
FIG. 25 is a diagram showing a table setting screen;
FIG. 26 is a diagram showing a situation where the user associates the execution instruction operation with a displayed information use process;
FIG. 27 is a diagram showing the table setting screen;
FIG. 28 is a diagram showing a situation where the user associates the execution instruction operation with the displayed information use process;
FIG. 29 is a diagram showing the table setting screen;
FIG. 30 is a diagram showing the table setting screen;
FIG. 31 is a diagram showing one example of the correspondence table;
FIG. 32 is a diagram showing one example of the correspondence table in a graphical form;
FIG. 33 is a diagram for explaining a method for identifying the execution instruction operation;
FIG. 34 is a diagram for explaining a method for identifying the execution instruction operation;
FIG. 35 is a diagram for explaining a method for identifying the execution instruction operation;
FIG. 36 is a diagram showing an exemplary display on the display screen;
FIG. 37 is a diagram showing one example of the correspondence table;
FIG. 38 is a diagram showing one example of the correspondence table in a graphical form;
FIG. 39 is a diagram showing a situation where the user selects a vertically written character string;
FIG. 40 is a diagram showing an exemplary display on the display screen after the vertically written character string is selected;
FIG. 41 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 42 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 43 is a diagram showing a situation where the user performs the execution instruction operation;
FIG. 44 is a diagram showing an exemplary display on the display screen after the execution instruction operation is performed;
FIG. 45 is a diagram showing one example of the correspondence table;
FIG. 46 is a diagram showing one example of the correspondence table in a graphical form;
FIG. 47 is a diagram showing a situation where the correspondence table is displayed on the display screen;
FIG. 48 is a diagram showing a situation where the correspondence table is displayed on the display screen;
FIG. 49 is a diagram showing an exemplary display in the electronic device;
FIG. 50 is a diagram showing an exemplary display in the electronic device;
FIG. 51 is a diagram showing an exemplary display in the electronic device; and
FIG. 52 is a diagram showing an exemplary display in the electronic device.
DESCRIPTION OF THE PREFERRED EMBODIMENTSFIGS. 1 to 4 are perspective views showing external appearances of anelectronic device100 according to this preferred embodiment. Theelectronic device100 is one kind of computer and is, for example, an openable and closable mobile phone. Theelectronic device100 includes afirst housing1 and asecond housing2.FIG. 1 shows theelectronic device100 being closed (in a closed state) as seen from thefirst housing1 side.FIG. 2 shows theelectronic device100 being closed as seen from thesecond housing2 side.FIGS. 3 and 4 show theelectronic device100 being opened (in an open state).
Here, as shown inFIGS. 1 and 2, a state of theelectronic device100 being closed is a state where thefirst housing1 and thesecond housing2 are arranged so as to overlap each other while afirst display screen4aof afirst display part3aprovided in thefirst housing1 is exposed. In this case, thefirst display screen4aand asecond display screen4bof asecond display part3bprovided in thesecond housing2 overlap each other with a space therebetween. Therefore, it can be said the angle formed therebetween is 0 degree.
On the other hand, as shown inFIGS. 3 and 4, a state of theelectronic device100 being opened is a state where thefirst housing1 and thesecond housing2 are arranged so as not to overlap each other so that thefirst display screen4aof thefirst display part3aand thesecond display screen4bof thesecond display part3bare simultaneously visible. Theelectronic device100 shown inFIG. 3 is opened in such a manner that thefirst display screen4aand thesecond display screen4bform an angle of 180 degrees, in other words, in such a manner that they lie in the same plane. Theelectronic device100 shown inFIG. 4 is opened in such a manner that thefirst display screen4aand thesecond display screen4bform an angle greater than 0 degree and smaller than 180 degrees.
Hereinafter, a state where thefirst display screen4aand thesecond display screen4blie in the same plane as shown inFIG. 3 will be referred to as “flat state”. A state where thefirst display screen4aand thesecond display screen4bare opened to form an angle greater than 0 degree and smaller than 180 degrees as shown inFIG. 4 will be referred to as “tilted state”.
Thefirst display screen4ais a touch panel, and receives a screen operation performed by a user on thefirst display screen4a. Likewise, thesecond display screen4bis a touch panel, and receives a screen operation performed by the user on thesecond display screen4b. In the following, in a case where there is no need to distinguish thefirst display part3afrom thesecond display part3b, each of them will be referred to as “display part3” and the display screen of each of them will be referred to as “display screen4”.
Thefirst housing1 and thesecond housing2 are coupled to each other by ahinge portion5 and anarm portion6. Thehinge portion5 is provided in thesecond housing2. Thearm portion6 is connected to thehinge portion5 with its angle relative to thesecond housing2 being variable. Thearm portion6 is connected to thefirst housing1 with its angle relative to thefirst housing1 being variable. Due to a function of thehinge portion5 and thearm portion6, theelectronic device100 can shift from the closed state shown inFIGS. 1 and 2 into the tilted state shown inFIG. 4, and can shift from the tilted state shown inFIG. 4 into the flat state shown inFIG. 3. Additionally, due to the function of thehinge portion5 and thearm portion6, theelectronic device100 can shift from the flat state shown inFIG. 3 into the tilted state shown inFIG. 4, and can shift from the tilted state shown inFIG. 4 into the closed state shown inFIGS. 1 and 2.
In thefirst housing1, not only thefirst display part3abut also asound input part7, a firstsound output part8, and afirst operation part10 are provided. In thesecond housing2, not only thesecond display part3bbut also a secondsound output part9, asecond operation part11, athird operation part12, a memorycard insertion slot13, and a chargingterminal14 are provided.
Thesound input part7 configured with a microphone, an amplifier, and the like. Each of the firstsound output part8 and the secondsound output part9 is configured with a speaker, an amplifier, and the like. The firstsound output part8 is configured for a call, and the volume thereof is set to be relatively low to such a level that the user can hear a sound outputted from the firstsound output part8 only when the user puts his/her ear close to the firstsound output part8. On the other hand, the volume of the secondsound output part9 is set to be relatively high to such a level that the user carrying theelectronic device100 can hear a sound outputted from the secondsound output part9 without putting his/her ear close to the secondsound output part9.
Thefirst operation part10 includes ahome key10a, amenu key10b, and a back key10c. These operation keys are provided on a main surface at thefirst display screen4aside of thefirst housing1, and each of them receives a contact operation performed by the user. Thehome key10ais an operation key for displaying a home screen (initial screen) on thefirst display screen4a. Themenu key10bis an operation key for displaying a menu screen. The back key10cis an operation key for returning a display on thefirst display screen4ato a previous display.
Similarly to thefirst operation part10, thesecond operation part11 includes ahome key11a, amenu key11b, and a back key11c. These keys are provided on a main surface at thesecond display screen4bside of thesecond housing2, and each of them receives a contact operation performed by the user. Functions of thehome key11a, themenu key11b, and the back key11care the same as functions of thehome key10a, themenu key10b, and the back key10cof thefirst operation part10.
Thethird operation part12 includes apower key12aand an adjustingkey12b. Thepower key12ais an operation key for turning on and off the power of theelectronic device100. The adjustingkey12bis an operation key for adjusting the brightness of thedisplay screen4 and for adjusting the volumes of the firstsound output part8 and the secondsound output part9. These operation keys are provided on a side surface of thesecond housing2, and each of them receives a pressing operation performed by the user.
In the memorycard insertion slot13, a memory card that is a card-shaped storage medium is inserted. To the chargingterminal14, a cable connected to a charger for charging theelectronic device100 is connected.
<Electrical Configuration>
FIG. 5 is a block diagram showing an electrical configuration of theelectronic device100. As shown inFIG. 5, theelectronic device100 includes, in addition to the above-described component parts such as thefirst display part3aand thesecond display part3b, acontrol part20, awireless communication part21, astorage part22, and abattery23.
Thecontrol part20 is configured of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and the like, and controls other component parts of theelectronic device100 to thereby manage an overall operation of theelectronic device100. Thecontrol part20 performs various operations in accordance with user operations received by thefirst display part3a, thesecond display part3b, thefirst operation part10, thesecond operation part11, and thethird operation part12.
Thestorage part22 is configured of a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. Thestorage part22 stores therein amain program220 that is a control program for controlling theelectronic device100, a plurality of application programs221 (only oneapplication program221 is shown in the drawing), and the like. Various functions of thecontrol part20 are implemented by the CPU and the DSP of thecontrol part20 executing the various programs stored in thestorage part22. Thestorage part22 also stores therein a correspondence table222 which will be described later. The correspondence table222 is used in a process performed by aprocess execution part200 which will be described later.
Thewireless communication part21 receives, via anantenna21a, a signal supplied through a base station from a mobile phone different from theelectronic device100 or a communication device such as a web server connected to the Internet. Thewireless communication part21 performs an amplification process and a down-conversion on a received signal, and outputs a resulting signal to thecontrol part20. Thecontrol part20 performs a demodulation process and the like on the received signal inputted thereto, to obtain various data, such as voice data and image data, included in the received signal. Thewireless communication part21 performs an up-conversion and an amplification process on a transmission signal including voice data and the like which is generated by thecontrol part20, and wirelessly transmits the transmission signal obtained as a result of the process, via theantenna21a, to a mobile phone different from theelectronic device100 or a communication device connected to the Internet.
Thesound input part7 converts a sound inputted from the outside, such as a voice, into sound data, and outputs the sound data to thecontrol part20. Each of the firstsound output part8 and the secondsound output part9 converts sound data supplied from thecontrol part20, such as voice data and music data, into a sound, and outputs the sound to the outside.
Thefirst display part3aand thesecond display part3bhave the same configuration. Eachdisplay part3 is, for example, a backlight-type liquid crystal display part that presents a color display, and includes a liquid crystal display panel and a backlight for emitting a light thereto. Under control by thecontrol part20, eachdisplay part3 displays various information such as characters, symbols, and graphics on thedisplay screen4 thereof. Thedisplay part3 may be configured as a display part different from a liquid crystal display part. For example, thedisplay part3 may be an organic EL display, or may be a display part having a plurality of LEDs arranged in a matrix.
Thebattery23 generates power of theelectronic device100. The power generated by thebattery23 is supplied to electronic components included in thecontrol part20, thewireless communication part21, and the like, of theelectronic device100.
Thestorage part22 stores therein various application programs221 (hereinafter simply referred to as “application221”). Thestorage part22 stores therein, for example, a call application for performing voice communication, a browser for displaying a website, a mail application for preparing, viewing, transmitting, and receiving an e-mail, an electronic book viewing application for viewing an electronic book.
When the CPU or the DSP of thecontrol part20 reads out theapplication221 from thestorage part22 and executes theapplication221, thisapplication221 is invoked in theelectronic device100. Thecontrol part20 executing theapplication221 controls other component parts, such as thewireless communication part21 and thedisplay part3, in theelectronic device100, and thereby a function (a function for performing the voice communication, a function for displaying a web site, or the like) corresponding to thisapplication221 is run on theelectronic device100.
Next, a plurality of function blocks included in thecontrol part20 will be described.FIG. 6 is a diagram showing the plurality of function blocks. The CPU of thecontrol part20 executes themain program220 stored in thestorage part22, and thereby function blocks such as aprocess execution part200, a screenoperation identification part210, and a keyoperation identification part211 are formed in thecontrol part20, as shown inFIG. 6.
The screenoperation identification part210 identifies a content of the screen operation received by thefirst display screen4a. For example, the screenoperation identification part210 identifies the screen operation performed on thefirst display screen4aas an operation of pressing a certain portion of thefirst display screen4aby a finger, or as an operation of moving a finger from a certain portion to another portion with the finger touching thefirst display screen4a. Likewise, the screenoperation identification part210 identifies a content of the screen operation received by thesecond display screen4b.
The keyoperation identification part211 identifies which of the plurality of operation keys included in thefirst operation part10 has been operated. The keyoperation identification part211 also identifies which of the plurality of operation keys included in thesecond operation part11 has been operated. The keyoperation identification part211 also identifies which of the plurality of operation keys included in thethird operation part12 has been operated.
Theprocess execution part200 executes a process in accordance with the screen operation identified by the screenoperation identification part210, and executes a process in accordance with a key operation identified by the keyoperation identification part211. Theprocess execution part200 includes anapplication execution part201, acommunication control part202, a soundoutput control part203, and adisplay control part204.
Theapplication execution part201 executes theapplication221 stored in thestorage part22. More specifically, in a case where the screenoperation identification part210 identifies that a screen operation instructing execution of acertain application221 has been performed on thedisplay screen4, theapplication execution part201 executes thisapplication221 stored in thestorage part22. In this preferred embodiment, an icon corresponding to theapplication221 is presented on the home screen displayed on thedisplay screen4, and when this icon is operated by the user, anapplication221 corresponding to this icon is executed. The operation performed on this icon is equivalent to the screen operation instructing execution of theapplication221 which is performed on thedisplay screen4.
The soundoutput control part203 controls a sound output of the firstsound output part8. The soundoutput control part203 outputs sound data to the firstsound output part8, and causes the firstsound output part8 to output a sound to the outside. The soundoutput control part203 also stops the output of the sound data to the firstsound output part8, and causes the firstsound output part8 to stop the output of the sound to the outside. The soundoutput control part203 can control the volume of the firstsound output part8. In the same manner, the soundoutput control part203 also controls a sound output of the secondsound output part9.
Thedisplay control part204 controls displays on thefirst display part3aand thesecond display part3b. Under control by thedisplay control part204, thefirst display part3adisplays information such as characters on thefirst display screen4a. Under control by thedisplay control part204, thesecond display part3bdisplays information such as characters on thesecond display screen4b.
Thecommunication control part202 controls thewireless communication part21, to perform various communication with a communication partner. For example, thecommunication control part202 perform voice communication and e-mail communication with a communication partner mobile phone. To perform the voice communication, thecommunication control part202 generates a transmission signal including voice data received from thesound input part7, and transmits the transmission signal to the communication partner mobile phone via thewireless communication part21. Thecommunication control part202 obtains voice data from a signal received by thewireless communication part21, and outputs the voice data to the firstsound output part8. Thecommunication control part202 performs data communication with the web server. A web page received by thecommunication control part202 from the web server via thewireless communication part21 is, under control on thedisplay part3 by thedisplay control part204, displayed on thedisplay screen4 of thedisplay part3.
<Process with Use of Associated Correspondence Table>
Next, a process executed by theprocess execution part200 by using the correspondence table222 will be described.FIG. 7 is a diagram showing one example of the correspondence table222. The correspondence table222 is correspondence information in which a process with use of information displayed on thedisplay screen4 and a screen operation on thedisplay screen4 instructing execution of this process are registered in association with each other. Hereinafter, the process with use of the information displayed on thedisplay screen4, such as a character, a symbol, a graphic, or an image, will be referred to as “displayed information use process”. The screen operation on thedisplay screen4 instructing execution of the displayed information use process will be referred to as “execution instruction operation”. In the correspondence table222, each of a plurality of displayed information use processes is associated with the execution instruction operation that instructs execution of this displayed information use process.
In a case where the screenoperation identification part210 identifies that a screen operation for selecting information displayed on thedisplay screen4 is performed on thedisplay screen4 and then, following the screen operation, the execution instruction operation has been performed on thedisplay screen4, theprocess execution part200 executes the displayed information use process associated with this execution instruction operation in the correspondence table222 by using the information selected by the screen operation.
Hereinafter, the screen operation on thedisplay screen4 for selecting the information displayed on thedisplay screen4 will be referred to as “displayed information selection operation”. The information selected by the displayed information selection operation will be referred to as “selected information”. As the displayed information selection operation, for example, an operation is adopted in which a region of thedisplay screen4 where selection object information is displayed is traced with screen operation means and then the screen operation means is separated away from thedisplay screen4. At a time point when, after the region of thedisplay screen4 where the selection object information is displayed is traced with the screen operation means, the screen operation means is separated away from thedisplay screen4, the screenoperation identification part210 determines that the displayed information selection operation is completed. Examples of the screen operation means include a finger of the user or a pen-like member held by the user.
In this preferred embodiment, as the execution instruction operation, for example, a sliding operation for sliding in a predetermined direction from the selected information displayed on thedisplay screen4. That is, in this preferred embodiment, an operation in which the screen operation means is moved in the predetermined direction from the selected information displayed on thedisplay screen4 while the user touches thedisplay screen4 with the screen operation means, is adopted as the execution instruction operation.
In the correspondence table222, a plurality of kinds of sliding operations for sliding in different directions from the selected information are registered as the execution instruction operation. In an example shownFIG. 7, an upper right sliding operation, a direct upward sliding operation, an upper left sliding operation, a lower left sliding operation, a direct downward sliding operation, and a lower right sliding operation are registered in the correspondence table222.
Here, the “upper right sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in an upper right direction from the selected information as seen from the viewpoint of the user. The “direct upward sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in a direct upward direction from the selected information as seen from the viewpoint of the user. The “upper left sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in an upper left direction from the selected information as seen from the viewpoint of the user. The “lower left sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in a lower left direction from the selected information as seen from the viewpoint of the user. The “direct downward sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in a direct downward direction from the selected information as seen from the viewpoint of the user. The “lower right sliding operation” represents an operation in which the user viewing thedisplay screen4 slides the screen operation means in a lower right direction from the selected information as seen from the viewpoint of the user. Hereinafter, directions such as a right direction and a left direction represent directions as seen from the viewpoint of the user viewing thedisplay screen4.
In the example shown inFIG. 7, in the correspondence table222, the upper right sliding operation is associated with a process for copying the selected information. The direct upward sliding operation is associated with a document search for searching a document the indicating selected information for this selected information. In the correspondence table222, the upper left sliding operation is associated with an Internet search for searching the Internet for the selected information by using a search site. The lower left sliding operation is associated with a process for registering the selected information in a dictionary. In the correspondence table222, the direct downward sliding operation is associated with a process for translating the selected information (for example, a process for translating into English). The lower right sliding operation is associated with a process for cutting the selected information from a document indicating this selected information.
FIG. 8 shows the correspondence table222 in a graphical form by using acircle230, for ease of visual understanding of the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table222 shown inFIG. 7. Acenter point230aof thecircle230 indicates the position of the selected information on thedisplay screen4.
As shown inFIG. 8, thecircle230 is divided into upper and lower two parts based on thecenter point230aas a reference. Each of an upper half circle and a lower half circle is sectioned into three fan-shapedregions230b. In the fan-shapedregion230blocated upper right of thecenter point230a(the position of the selected information), a character string “copy” is shown. From this, it is understood that the upper right sliding operation is associated with the process for copying the selected information.
In the fan-shapedregion230blocated direct upward of thecenter point230a(the position of the selected information), a character string “document search” is shown. From this, it is understood that the direct upward sliding operation is associated with the document search for searching a document indicating the selected information for this selected information.
In the fan-shapedregion230blocated upper left of thecenter point230a(the position of the selected information), a character string “Internet search” is shown. From this, it is understood that the upper left sliding operation is associated with the Internet search for searching the Internet for the selected information by using the search site.
In the fan-shapedregion230blocated lower left of thecenter point230a(the position of the selected information), a character string “dictionary registration”. From this, it is understood that the lower left sliding operation is associated with the process for registering the selected information in the dictionary.
In the fan-shapedregion230blocated direct downward of thecenter point230a(the position of the selected information), a character string “translation” is shown. From this, it is understood that the direct downward sliding operation is associated with the process for translating the selected information.
In the fan-shapedregion230blocated lower right of thecenter point230a(the position of the selected information), a character string “cut” is shown. From this, it is understood that the lower right sliding operation is associated with the process for cutting the selected information from the document indicating this selected information.
A cancellation of the selection of information displayed on thedisplay screen4 is executed when, for example, a tapping operation is performed on a region of thedisplay screen4 other than the region where this information is displayed. That is, in a case where, after the displayed information selection operation is performed, the screenoperation identification part210 identifies that the tapping operation has been performed on a region of thedisplay screen4 other than the region where the selected information is displayed, theprocess execution part200 cancels the selection of the information selected by the displayed information selection operation. The tapping operation represents an operation performed from when the screen operation means touches the display screen to when the screen operation means is separated away without changing the touched portion. In a state where the selection of the information displayed on thedisplay screen4 is cancelled, even when the execution instruction operation is performed on thedisplay screen4, the displayed information use process corresponding to this execution instruction operation is not performed.
Next, a description will be given to a sequence of operations of theelectronic device100 in a time period from the displayed information selection operation being performed on thedisplay screen4 to execution of the displayed information use process with use of the information selected by the displayed information selection operation. In the following, a description will be given to an operation of theelectronic device100 in a case where the user selects a character string displayed on the display screen4 (thefirst display screen4aor thesecond display screen4b) while theapplication execution part201 is executing a web browser, a mail application, or an electronic book viewing application. Hereinafter, thedisplay screen4 to which the description is given will be sometimes referred to as “objective display screen4”.
As shown inFIG. 9, when the user traces, with his/herfinger250, a region of theobjective display screen4 where a selection object character string is displayed in the right direction and then separates thefinger250 away from theobjective display screen4, the screenoperation identification part210 identifies that the displayed information selection operation for selecting this character string has been performed on theobjective display screen4. Thus, in theprocess execution part200, thedisplay control part204 controls thedisplay part3 including theobjective display screen4, to highlight (emphasize) the selected character string260 (hereinafter referred to as “selectedcharacter string260”) that is the selected information on theobjective display screen4, as shown inFIG. 10.
In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the upper right direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 11, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the upper right sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute the displayed information use process corresponding to the upper right sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 copies the selectedcharacter string260, and stores the copy in thestorage part22.
In theprocess execution part200, after the displayed information use process is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, processcompletion notification information270 indicating that the displayed information use process is completed, which is, here, processcompletion notification information270 indicating that copying of the selectedcharacter string260 is completed, as shown inFIG. 12. After the processcompletion notification information270 has been displayed on theobjective display screen4 for a certain time period, thedisplay part3 including theobjective display screen4 erases the display of the processcompletion notification information270. Thereby, the processcompletion notification information270 is automatically erased after being displayed for the certain time period.
FIG. 13 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the lower right sliding operation on theobjective display screen4. In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the lower right direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 13, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the lower right sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute a cutout process corresponding to the lower right sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 cuts the selectedcharacter string260 from the document indicating this selectedcharacter string260.
In theprocess execution part200, after the cutout process is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, the processcompletion notification information270 indicating that the cutout process on theobjective display screen4 is completed, as shown inFIG. 14. The processcompletion notification information270 is automatically erased after being displayed for a certain time period.
FIG. 15 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the direct downward sliding operation on theobjective display screen4. In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the direct downward direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 15, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the direct downward sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute a translation process corresponding to the direct downward sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 translates the selectedcharacter string260 into English.
In theprocess execution part200, after the translation process is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, processingresult notification information280 indicating a processing result of the displayed information use process, which is, here, processingresult notification information280 indicating a result of translation of the selected character string260 (English translation of the selected character string260), as shown inFIG. 16.
Here, if the processingresult notification information280 is automatically erased after being displayed for a certain time period similarly to the processcompletion notification information270, there is a possibility that the user cannot sufficiently check the processing result of the displayed information use process executed by theelectronic device100. Accordingly, in this preferred embodiment, the display of the processingresult notification information280 can be erased at the discretion of the user. More specifically, as shown inFIG. 16, not only the processingresult notification information280 but also a display erasebutton280afor erasing this display is displayed on theobjective display screen4. When the screenoperation identification part210 identifies that the user has operated the display erasebutton280a, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 erases the display of the processingresult notification information280.
Instead of providing the display erasebutton280a, it may be also acceptable that the display of the processingresult notification information280 is erased when the user performs the tapping operation on a region of thedisplay screen4 different from the regions where the selectedcharacter string260 and the processingresult notification information280 are displayed.
FIG. 17 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the direct upward sliding operation on theobjective display screen4. In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the direct upward direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 17, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the direct upward sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute the document search corresponding to the direct upward sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 searches the document indicating the selectedcharacter string260 for this selectedcharacter string260.
In theprocess execution part200, after the document search is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, the processcompletion notification information270 indicating that the document search on theobjective display screen4 is completed, as shown inFIG. 18. The processcompletion notification information270 is automatically erased after being displayed for a certain time period.
Moreover, on theobjective display screen4, a result of the document search for the selectedcharacter string260 is presented. More specifically, as shown inFIG. 18, in the document including the selectedcharacter string260, acharacter string290 that is coincident with the selectedcharacter string260 is highlighted. At this time, the selectedcharacter string260 and thecharacter string290 coincident with the selectedcharacter string260 may be highlighted in different manners.
FIG. 19 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the upper left sliding operation on theobjective display screen4. In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the upper left direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 19, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the upper left sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute the Internet search corresponding to the upper left sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 searches the Internet for the selectedcharacter string260 by using the search site.
In theprocess execution part200, after the Internet search is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, the processingresult notification information280 indicating a processing result of the Internet search, as shown inFIG. 20. In an example shown inFIG. 20, a thumbnail of the search site indicating a search result obtained by inputting the selectedcharacter string260 as a search keyword is displayed as the processingresult notification information280. Similarly to an example shown inFIG. 16, the processingresult notification information280 is erased from theobjective display screen4 when the screenoperation identification part210 identifies that the user has operated the display erasebutton280a. In this case as well, instead of providing the display erasebutton280a, it may be also acceptable that the display of the processingresult notification information280 is erased when the user performs the tapping operation on a region of thedisplay screen4 different from the regions where the selectedcharacter string260 and the processingresult notification information280 are displayed.
As the processingresult notification information280, a search site indicating a search result obtained by inputting the selectedcharacter string260 as a search keyword may be displayed, without any change, on thedisplay screen4 by using a web browser.
In a case where the search site used in the Internet search is an image search site, a thumbnail of an image that is a search result obtained by inputting the selectedcharacter string260 as a search keyword to the image search site may be displayed as the processingresult notification information280.
FIG. 21 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the lower left sliding operation on theobjective display screen4. As shown inFIG. 21, in a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the lower left direction from the selectedcharacter string260 while his/herfinger250 is touching theobjective display screen4, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the lower left sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table222, to execute the dictionary registration process corresponding to the lower left sliding operation with use of the selectedcharacter string260. To be specific, theprocess execution part200 registers the selectedcharacter string260 into a dictionary database stored in thestorage part22.
In theprocess execution part200, after the dictionary registration process is completed, under control by thedisplay control part204, thedisplay part3 including theobjective display screen4 displays, on theobjective display screen4, the processcompletion notification information270 indicating that the dictionary registration process on theobjective display screen4 is completed, as shown inFIG. 22. The processcompletion notification information270 is automatically erased after being displayed for a certain time period.
In the example described above, the description has been given to the operation of theelectronic device100 in a case where the selected information is composed of characters. However, in cases where the selected information is composed of a symbol, the selected information is composed of a graphic, and the selected information is composed of an image, theelectronic device100 similarly executes the displayed information use process with use of the selected information.
Here, in a case where the selected information is composed of a graphic or an image, the selected information cannot be registered in the dictionary and the selected information cannot be translated. Therefore, in this preferred embodiment, the lower left sliding operation and the direct downward sliding operation performed on thedisplay screen4 in such cases are invalid. More specifically, in a case where the selected information is composed of a graphic or an image, even when the screenoperation identification part210 identifies that the lower left sliding operation has been performed on thedisplay screen4, theprocess execution part200 does not executes the displayed information use process corresponding to the lower left sliding operation. In a case where the selected information is composed of a graphic or an image, even when the screenoperation identification part210 identifies that the direct downward sliding operation has been performed on thedisplay screen4, theprocess execution part200 does not execute the displayed information use process corresponding to the direct downward sliding operation.
In some cases, information such as characters shown on a website or an electronic book may be forbidden from a cut process. Additionally, some types of the document file preparation applications are provided with a function that can forbid, for example, copying of characters and the like contained in a document prepared by using this application. Thus, the information selected by the displayed information selection operation may not be copied, for example.
In this preferred embodiment, in a case where the execution instruction operation is performed subsequent to the displayed information selection operation, when the displayed information use process corresponding to this execution instruction operation with use of the information selected by the displayed information selection operation is forbidden, theprocess execution part200 does not execute such a displayed information use process. At this time, after the execution instruction operation is performed, executiondisapproval notification information300 for notifying that the displayed information use process corresponding to this execution instruction operation cannot be executed, may be displayed on thedisplay screen4, as shown inFIG. 23. As described above, it is also possible that, in a case where the selected information is composed of a graphic or an image, the executiondisapproval notification information300 is displayed on thedisplay screen4 when the lower left sliding operation or the direct downward sliding operation is performed on thedisplay screen4.
<Details of Method for Identifying Execution Instruction Operation>
In this preferred embodiment, even when the sliding operation is performed on thedisplay screen4, the screenoperation identification part210 does not immediately identify that the execution instruction operation has been performed on thedisplay screen4. In a case where the sliding operation is performed over a predetermined distance on thedisplay screen4, the screenoperation identification part210 identifies that the execution instruction operation has been performed on thedisplay screen4. That is, the execution instruction operation according to this preferred embodiment is not simply a sliding operation, but a sliding operation over the predetermined distance or more. This improves the operability because, even if the user makes an accidental operation, no response is made as long as it is not the sliding operation over the predetermined distance. In the following, a method by which the screenoperation identification part210 identifies the execution instruction operation will be described in detail with reference toFIG. 24.FIG. 24 is a diagram for explaining an operation of the screenoperation identification part210.
After performing the displayed information selection operation, in order to perform the execution instruction operation, the user firstly touches, with the screen operation means (such as a finger or a pen-like member), aregion310 of thedisplay screen4 where the selected information (in an example shown inFIG. 24, a selected character string260) is displayed. The screenoperation identification part210 considers acircle330 having a predetermined radius around acenter point320 that is a touch point touched by the screen operation means. Then, the screenoperation identification part210 divides thecircle330 into upper and lower two parts based on thecenter point320 as a reference, and sections each of resulting upper and lower half circles into three fan-shapedregions330a. When the touch point touched by the screen operation means on thedisplay screen4 is moved from thecenter point320, the screenoperation identification part210 identifies the fan-shapedregion330ato which the touch point is moved, and thereby identifies a sliding direction of the screen operation means, that is a direction in which the sliding operation as the execution instruction operation is being performed. For example, in a case where the touch point touched by the screen operation means on thedisplay screen4 is moving in the fan-shapedregion330alocated upper right of thecenter point320, the screenoperation identification part210 determines that the sliding operation (upper right sliding operation) sliding in the upper right direction from the selected information is being performed as the execution instruction operation. Then, as indicated by anarrow350 inFIG. 24, when the touch point touched by the screen operation means on thedisplay screen4 is moved through the fan-shapedregion330ato the outside of thecircle330, the screenoperation identification part210 determines that the execution instruction operation has been performed (completed) on thedisplay screen4. At this time, it is possible that, when the touch point touched by the screen operation means on thedisplay screen4 is moved to the outside of thecircle330 and the screen operation means is separated away from thedisplay screen4, the screenoperation identification part210 determines that the execution instruction operation has been performed on thedisplay screen4. In other words, operations performed until the screen operation means is separated away from thedisplay screen4 may be included in the sliding operation. Theprocess execution part200 executes the displayed information use process in accordance with the execution instruction operation identified by the screenoperation identification part210.
On the other hand, as indicated by anarrow360 inFIG. 24, when the screen operation means is separated away from thedisplay screen4 while the touch point touched by the screen operation means on thedisplay screen4 is not moved to the outside of thecircle330, the screenoperation identification part210 determines that the execution instruction operation has not been performed (completed) on thedisplay screen4. In this case, theprocess execution part200 does not execute the displayed information use process with use of the selected information.
In a case where the screen operation means is separated away from thedisplay screen4 while the touch point touched by the screen operation means on thedisplay screen4 is not moved to the outside of thecircle330, the selection of the selected information may be cancelled, or the selection of the selected information may be maintained. When the selection of the selected information is cancelled, the user will newly perform the displayed information selection operation and then perform the execution instruction operation. When the selection of the selected information is maintained, the user can perform the execution instruction operation without newly performing the displayed information selection operation.
<Method for Setting Associated Correspondence Between Execution Instruction Operation and Displayed Information Use Process>
In this preferred embodiment, the user is allowed to set the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table222 described above. In the following, a method for setting the associated correspondence between the execution instruction operation and the displayed information use process will be described.
FIG. 25 is a diagram showing a situation where atable setting screen400 is displayed on thedisplay screen4. Thetable setting screen400 is used in setting the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table. When themenu key10bor themenu key11bis operated, the menu screen is displayed on thedisplay screen4 exposed on, among thefirst housing1 and thesecond housing2, the housing having the operated menu key. This menu screen displays a setting button for making various settings on theelectronic device100. When the user operates the setting button, set item buttons each corresponding to each set item are displayed on thedisplay screen4. The set item buttons include a set item button for setting the associated correspondence between the execution instruction operation and the displayed information use process. When the user operates this set item button, thetable setting screen400 shown inFIG. 25 is displayed on thedisplay screen4.
As shown inFIG. 25, names of a plurality of displayed information use processes that can be registered in the correspondence table222 are shown in a right portion of thetable setting screen400, and acircle410 is shown in a left portion thereof. In thecircle410, each of an upper half circle and a lower half circle is sectioned into three fan-shapedregions410a. The six fan-shapedregions410aincluded in thecircle410 correspond to six kinds of execution instruction operations that can be registered in the correspondence table222, which are, in this example, six kinds of sliding operations. More specifically, the fan-shapedregions410alocated upper right, direct upward, and upper left of acenter point410bof thecircle410 correspond to the upper right sliding operation, the direct upward sliding operation, and the upper left sliding operation, respectively. The fan-shapedregions410alocated lower left, direct downward, and lower right of thecenter point410bof thecircle410 correspond to the lower left sliding operation, the direct downward sliding operation, and the lower right sliding operation, respectively.
To associate a certain displayed information use process with a certain execution instruction operation, the user touches, with the screen operation means, a region of thetable setting screen400 where the name of this displayed information use process is shown, and then slides the screen operation means to the fan-shapedregion410acorresponding to this execution instruction operation. When such a sliding operation is identified by the screenoperation identification part210, theprocess execution part200 registers the displayed information use process and the execution instruction operation in association with each other in the correspondence table222.
FIG. 26 is a diagram showing a situation where the user is associating “copy” with “upper right sliding operation” with his/herfinger250. As shown inFIG. 26, when the user touches aregion460aof thetable setting screen400 where the character string “copy” is shown with thefinger250 and then slides thefinger250 to the fan-shapedregion410acorresponding to “upper right sliding operation”, “copy” and “upper right sliding operation” are registered in association with each other in the correspondence table222. Thereby, as shown inFIG. 27, the character string “copy” is shown in the fan-shapedregion410acorresponding to the upper right sliding operation.
Then, as shown inFIG. 28, when the user touches aregion460bof thetable setting screen400 where the character string “document search” is shown with thefinger250 and then slides thefinger250 to the fan-shapedregion410acorresponding to “direct upward sliding operation”, “document search” and “direct upward sliding operation” are registered in association with each other in the correspondence table222. Thereby, as shown inFIG. 29, the character string “document search” is shown in the fan-shapedregion410acorresponding to “direct upward sliding operation”.
Then, in the same manner, “Internet search” and “upper left sliding operation” are associated with each other, “dictionary registration” and “lower left sliding operation” are associated with each other, “translation” and “direct downward sliding operation” are associated with each other, and “cut” and “lower right sliding operation” are associated with each other. As a result, a display as shown inFIG. 30 is presented on thetable setting screen400. Thereby, the above-described correspondence table222 as shown inFIG. 7 is generated.
As described above, in theelectronic device100 according to this preferred embodiment, in a case where the execution instruction operation subsequent to the displayed information selection operation is performed on thedisplay screen4, the displayed information use process associated with this execution instruction operation in the correspondence table222 is executed with use of the selected information. Accordingly, the user, after selecting information displayed on thedisplay screen4, has merely to perform a simple operation on thedisplay screen4 in order to cause theelectronic device100 to execute the desired displayed information use process with use of this information. This improves the operability of theelectronic device100.
On the other hand, in a case where the user uses a mouse in order to instruct a personal computer to execute a process such as copying, the user needs to perform an operation for selecting information displayed on the display screen by using the mouse and then click the right mouse button to thereby display a context menu for selecting a process that should be executed by the personal computer. Then, the user selects a process that should be executed by the personal computer, in the displayed context menu. That is, in this case, it is necessary that the user performs the operation for selecting information displayed on the display screen and then performs the operation for displaying the context menu for selecting the process that should be executed by the personal computer.
In this preferred embodiment, the user, after selecting information displayed on thedisplay screen4, can cause theelectronic device100 to execute the displayed information use process only by performing the execution instruction operation. Accordingly, the user can cause theelectronic device100 to execute a desired process without performing any operation for displaying the context menu.
In this preferred embodiment, the sliding operation is adopted as the execution instruction operation. Accordingly, the user can, by a simple operation, instruct theelectronic device100 to execute the displayed information use process.
In this preferred embodiment, the plurality of kinds of sliding operations corresponding to different directions are registered in the correspondence table222. Accordingly, the user can change the displayed information use process that should be executed by theelectronic device100, only by changing the direction of the sliding operation. This further improves the operability of theelectronic device100.
<Various Modifications>
<First Modification>
Although, inn the example described above, the sliding operation is adopted as the execution instruction operation, other screen operations are adoptable. For example, a flick operation may be adopted as the execution instruction operation. Here, the flick operation represents such an operation that a time period from when the screen operation means touches the display screen to when the screen operation means is separated away from the display screen is shorter than a predetermined time period and the screen operation means is moved over a predetermined distance or more during the time period from when the screen operation means touches the display screen to when the screen operation means is separated away from the display screen.
In a case where the flick operation is adopted as the execution instruction operation, instead of the upper right sliding operation, the direct upward sliding operation, the upper left sliding operation, the lower left sliding operation, the direct downward sliding operation, and the lower right sliding operation, a flick operation in the upper right direction, a flick operation in the direct upward direction, a flick operation in the upper left direction, a flick operation in the lower left direction, a flick operation in the direct downward direction, and a flick operation in the lower right direction, respectively, are registered in the correspondence table222.
In this manner, also in a case where the flick operation is adopted as the execution instruction operation, the user can, by a simple operation, instruct theelectronic device100 to execute the displayed information use process.
When a plurality of kinds of flick operations traveling in different directions are registered in the correspondence table222, the user can change the displayed information use process that should be executed by theelectronic device100, only by changing the direction of the flick operation. This improves the operability of theelectronic device100.
<Second Modification>
Although, in the example described above, the six displayed information use processes are registered in the correspondence table222, the number of registered displayed information use processes may be smaller than six, or the number of registered displayed information use processes may be greater than six.
As for the displayed information use process, a process different from the processes shown inFIG. 7 may be registered in the correspondence table222. For example, a process for translating the selected information into French, or a process for translating the selected information into Korean, may be registered in the correspondence table222.
FIG. 31 is a diagram showing a situation where only two displayed information use processes of “copy” and “translation” are registered in the correspondence table222. In the correspondence table222 shown inFIG. 31, “copy” and “upward sliding operation” are associated with each other, and “translation” and “downward sliding operation” are associated with each other. Here, the “upward sliding operation” represents an operation in which the user slides the screen operation means in an upward direction from the selected information. The “downward sliding operation” represents an operation in which the user slides the screen operation means in the downward direction from the selected information.
FIG. 32, similarly toFIG. 8 described above, shows the correspondence table222 in a graphical form by using acircle500, for ease of visual understanding of the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table222 shown inFIG. 31. Acenter point500aof thecircle500 indicates the position of the selected information on thedisplay screen4.
As shown inFIG. 32, thecircle500 is divided into upper and lower two parts based on thecenter point500aas a reference. In an upperhalf circle500bbased on thecenter point500a(the position of the selected information), a character string “copy” is shown. In alower half circle500cbased on thecenter point500a(the position of the selected information), a character string “translation” is shown. From this, it is understood that the upward sliding operation is associated with the process for copying the selected information while the downward sliding operation is associated with the process for translating the selected information.
FIG. 33 is a diagram for explaining a method by which the screenoperation identification part210 identifies the execution instruction operation in a case of using the correspondence table222 shown inFIG. 31.
As described above, after performing the displayed information selection operation, in order to perform the execution instruction operation, the user firstly touches, with the screen operation means, aregion510 of thedisplay screen4 where the selected information (in an example shown inFIG. 33, the selected character string260) is displayed. The screenoperation identification part210 considers acircle530 having a predetermined radius around acenter point520 that is the touch point touched by the screen operation means. Then, the screenoperation identification part210 sections thecircle530 into upper and lower twohalf circles530abased on thecenter point520 as a reference. As indicated by anarrow550 inFIG. 33, when the touch point touched by the screen operation means on thedisplay screen4 is moved from thecenter point520 through the upperhalf circle530ato the outside of thecircle530, the screenoperation identification part210 determines that the upward sliding operation has been performed on thedisplay screen4. In other words, when the user slides the screen operation means from thecenter point520 through the upperhalf circle530ato the outside of thecircle530, the screenoperation identification part210 determines that the upward sliding operation has been performed on thedisplay screen4. Theprocess execution part200 executes the copy process corresponding to the upward sliding operation identified by the screenoperation identification part210.
On the other hand, as indicated by anarrow560 inFIG. 33, when the touch point touched by the screen operation means on thedisplay screen4 is moved from thecenter point520 through thelower half circle530ato the outside of thecircle530, the screenoperation identification part210 determines that the downward sliding operation has been performed on thedisplay screen4. In other words, when the user slides the screen operation means from thecenter point520 through thelower half circle530ato the outside of thecircle530, the screenoperation identification part210 determines that the downward sliding operation has been performed on thedisplay screen4. Accordingly, theprocess execution part200 executes the translation process corresponding to the downward sliding operation identified by the screenoperation identification part210.
When the screen operation means is separated away from thedisplay screen4 while the touch point touched by the screen operation means on thedisplay screen4 is not moved to the outside of thecircle530, that is, when the user terminates the sliding of the screen operation means within thecircle530, the screenoperation identification part210 determines that the execution instruction operation has not been performed on thedisplay screen4. In this case, theprocess execution part200 does not execute the displayed information use process with use of the selected information.
In this example, similarly, when the screen operation means is separated away from thedisplay screen4 while the touch point touched by the screen operation means on thedisplay screen4 is not moved to the outside of thecircle530, the selection of the selected information may be cancelled, or the selection of the selected information may be maintained. When the selection of the selected information is cancelled, the user will newly perform the displayed information selection operation and then perform the execution instruction operation. When the selection of the selected information is maintained, the user can perform the execution instruction operation without newly performing the displayed information selection operation.
In this example, the copy process may be executed not only when the touch point touched by the screen operation means on thedisplay screen4 is moved from thecenter point520 through the upperhalf circle530ato the outside of thecircle530 but also in a case where, as indicated by anarrow570 inFIG. 34, the touch point is once moved from thecenter point520 into the lower half circle530band eventually moved through the upperhalf circle530ato the outside of thecircle530. The sliding operation in the latter case cannot be equal to the sliding operation in the upward direction from the selected information (selected character string260), but the screenoperation identification part210 also identifies the sliding operation in the latter case as the upward sliding operation.
Likewise, not only in a case where the touch point touched by the screen operation means on thedisplay screen4 is moved from thecenter point520 through thelower half circle530ato the outside of thecircle530 but also in a case where, as indicated by anarrow580 inFIG. 35, the touch point is once moved from thecenter point520 into the upper half circle530band eventually moved through thelower half circle530ato the outside of thecircle530, it can be determined that the downward sliding operation has been performed on thedisplay screen4, and the translation process corresponding to the downward sliding operation can be performed.
In a case where not only the sliding operations indicated by thearrows550 and560 inFIG. 33 but also the sliding operations indicated by thearrow570 inFIG. 34 and thearrow580 inFIG. 35 are identified as the execution instruction operation by the screenoperation identification part210, a track of the sliding operation within thecircle530, that is, a track of movement of the touch point touched by the screen operation means on thedisplay screen4 within thecircle530, is ignored. When the position of the touch point is located above thecenter point520 at a time point when the touch point goes out of thecircle530, the screenoperation identification part210 identifies that the upward sliding operation has been performed. When the position of the touch point is located below thecenter point520 at a time point when the touch point goes out of thecircle530, the screenoperation identification part210 identifies that the downward sliding operation has been performed. In other words, when the sliding operation in the upward direction has been performed immediately before the touch point touched by the screen operation means on thedisplay screen4 goes out of thecircle530, the screenoperation identification part210 determines that the upward sliding operation (execution instruction operation) has been performed, and when the sliding operation in the downward direction has been performed immediately before the touch point goes out of thecircle530, the screenoperation identification part210 determines that the downward sliding operation (execution instruction operation) has been performed.
In this manner, the displayed information use process that should be executed is determined in accordance with the direction of the sliding operation performed immediately before the touch point touched by the screen operation means on thedisplay screen4 goes out of thecircle530. This improves the operability of theelectronic device100.
For example, in a case where a user intending to make copying mistakenly performs the sliding operation in the downward direction from the selected information but immediately recognizes the mistake, the user can cause theelectronic device100 to execute copying by changing the direction of the sliding operation into the upward direction.
In a case where a user intending to make translation slightly performs the sliding operation in the downward direction but, on second thoughts, decides to perform copying, the user can cause theprocess execution part200 to execute copying by changing the direction of the sliding operation into the upward direction.
<Third Modification>
In a case where a plurality of execution instruction operations are continuously performed on thedisplay screen4, the displayed information use processes corresponding to the plurality of execution instruction operations, respectively, may be continuously executed.
For example, in a case where the correspondence table222 shown inFIG. 7 described above is used, when the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the upper right sliding operation and the direct downward sliding operation have been continuously performed, theprocess execution part200 continuously performs the copy process and the translation process corresponding to the upper right sliding operation and the direct downward sliding operation, respectively, with use of the selected information. At this time, it is desirable that, as shown inFIG. 36, the processcompletion notification information270 indicating that the copy process corresponding to the sliding operation in the upward direction is completed is displayed above the selected information (selected character string260), and the processingresult notification information280 indicating a result of the translation process corresponding to the sliding operation in the downward direction is displayed below the selected information (selected character string260). This facilitates intuitive understanding of which of the two sliding operations that have been continuously performed corresponds to each of the processcompletion notification information270 and the processingresult notification information280 that are simultaneously displayed. That is, the information (hereinafter referred to as “process-completed displayed information”) such as the processcompletion notification information270 which is displayed after the completion of the displayed information use process corresponding to the sliding operation that is the execution instruction operation is positioned at a location (above or below the selected information) corresponding to the direction (upward or downward direction) of this sliding operation. Accordingly, even in a case where a plurality of kinds of process-completed displayed information are simultaneously displayed after the completion of a plurality of displayed information use processes corresponding to a plurality of execution instruction operations that are continuously executed, it is easy to identify where the process-completed displayed information corresponding to each execution instruction operation is displayed.
<Fourth Modification>
To select a vertically written character string or symbol string displayed on thedisplay screen4, it is necessary to move the screen operation means in the upward and downward directions. At this time, in a case where the sliding operation in the upward direction or the sliding operation in the downward direction is adopted as the execution instruction operation as described above, the displayed information selection operation and the execution instruction operation are similar to each other and they are confusing.
Therefore, in addition to the correspondence table222 in which the sliding operation in the upward direction and the sliding operation in the downward direction are registered as the execution instruction operations, a correspondence table622 is provided which is used in a case where the selected information is vertically written information. In this correspondence table622, the sliding operation in the right direction and the sliding operation in the left direction are registered as the execution instruction operations.FIG. 37 is a diagram showing one example of the correspondence table622.
As shown inFIG. 37, in the correspondence table622, “copy”, “document search”, “Internet search”, “dictionary registration”, “translation”, and “cut” are associated with “lower right sliding operation”, “direct right sliding operation”, “upper right sliding operation”, “upper left sliding operation”, “direct left sliding operation”, and “lower left sliding operation”, respectively.
Here, the “direct right sliding operation” represents an operation in which the user slides the screen operation means in the direct right direction from the selected information. The “direct left sliding operation” represents an operation in which the user slides the screen operation means in the direct left direction from the selected information.
FIG. 38, similarly toFIG. 8 described above, shows the correspondence table622 in a graphical form by using acircle630, for ease of visual understanding of the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table622 shown inFIG. 37. Acenter point630aof thecircle630 indicates the position of the selected information on thedisplay screen4.
As shown inFIG. 38, thecircle630 is divided into left and right two parts based on thecenter point630aas a reference. Each of a right half circle and a left half circle is sectioned into three fan-shapedregions630b. In the fan-shapedregion630blocated lower right of thecenter point630a(the position of the selected information), a character string “copy” is shown. From this, it is understood that the lower right sliding operation is associated with the process for copying the selected information.
In the fan-shapedregion630blocated direct right of thecenter point630a(the position of the selected information), a character string “document search” is shown. From this, it is understood that the direct right sliding operation is associated with the document search for searching a document indicating the selected information for this selected information.
In the fan-shapedregion630blocated upper right of thecenter point630a(the position of the selected information), a character string “Internet search” is shown. From this, it is understood that the upper right sliding operation is associated with the Internet search for searching the Internet for the selected information by using the search site.
In the fan-shapedregion630blocated upper left of thecenter point630a(the position of the selected information), a character string “dictionary registration” is shown. From this, it is understood that the upper left sliding operation is associated with the process for registering the selected information in the dictionary.
In the fan-shapedregion630blocated direct left of thecenter point630a(the position of the selected information), a character string “translation” is shown. From this, it is understood that the direct left sliding operation is associated with the process for translating the selected information.
In the fan-shapedregion630blocated lower left of thecenter point630a(the position of the selected information), a character string “cut” is shown. From this, it is understood that the lower left sliding operation is associated with the process for cutting the selected information from the document indicating this selected information.
In a case where the selected information is a vertically written character string and in a case where the selected information is a vertically written symbol string, theprocess execution part200 refers to the correspondence table622, to execute the displayed information use process in accordance with the execution instruction operation identified by the screenoperation identification part210.
On the other hand, in a case where the selected information is other than a vertically written character string and in a case where the selected information is other than a vertically written symbol string, theprocess execution part200 refers to the correspondence table222 in the above described manner, to execute the displayed information use process in accordance with the execution instruction operation identified by the screenoperation identification part210.
Next, a description will be given to a sequence of operations of theelectronic device100 in a time period from when the displayed information selection operation for selecting a vertically written character string displayed on theobjective display screen4 is performed to when the displayed information use process with use of this character string is executed.
FIG. 39 is a diagram showing a situation where the user selects the vertically written character string. As shown inFIG. 39, when the user traces, with his/herfinger250, a region of theobjective display screen4 where a vertically written character string that is a selection object is displayed in the downward direction and then separates thefinger250 away from theobjective display screen4, the screenoperation identification part210 identifies that the displayed information selection operation for selecting this character string has been performed on theobjective display screen4. Thus, on theobjective display screen4, as shown inFIG. 40, the selected character string660 (hereinafter referred to as “selectedcharacter string660”) that is the selected information is highlighted (emphasized).
In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the lower right direction from the selectedcharacter string660 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 41, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the lower right sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table622, to execute the displayed information use process corresponding to the lower right sliding operation with use of the selectedcharacter string660. To be specific, theprocess execution part200 copies the selectedcharacter string660 and stores the copy in thestorage part22. Then, as shown inFIG. 42, the processcompletion notification information270 indicating that the copy process is completed is displayed on theobjective display screen4.
FIG. 43 is a diagram showing a situation where, subsequent to the displayed information selection operation, the user performs the direct left sliding operation on theobjective display screen4. In a case where, subsequent to the displayed information selection operation, the user slides his/herfinger250 in the direct left direction from the selectedcharacter string660 while his/herfinger250 is touching theobjective display screen4 as shown inFIG. 43, the screenoperation identification part210 identifies that, subsequent to the displayed information selection operation, the direct left sliding operation has been performed on theobjective display screen4. Thus, theprocess execution part200 refers to the correspondence table622, to execute the displayed information use process corresponding to the direct left sliding operation with use of the selectedcharacter string660. To be specific, theprocess execution part200 translates the selectedcharacter string660 into English. Then, as shown inFIG. 44, the processingresult notification information280 indicating a processing result of the translation process and the display erasebutton280aare displayed on theobjective display screen4. When the display erasebutton280ais operated by the user, the display of the processingresult notification information280 is erased from theobjective display screen4.
In the method for identifying the execution instruction operation described above with reference toFIG. 24, it is possible to identify the execution instruction operation in the same manner even in a case where the selected information is vertically written information, by dividing thecircle330 into left and right two parts and sectioning each of a right half circle and a left half circle into three fan-shapedregions330a.
In a case of using the correspondence table222 shown inFIG. 31 described above, the correspondence table622 is configured as shown inFIG. 45. In the correspondence table622 shown inFIG. 45, “copy” and “right sliding operation” are associated with each other, and “translation” and “left sliding operation” are associated with each other. Here, the “right sliding operation” represents an operation in which the user slides the screen operation means in the right direction from the selected information. The “left sliding operation” represents an operation in which the user slides the screen operation means in the left direction from the selected information.
FIG. 46, similarly toFIG. 32 described above, shows the correspondence table222 in a graphical form by using acircle700, for ease of visual understanding of the associated correspondence between the execution instruction operation and the displayed information use process in the correspondence table622 shown inFIG. 45. Acenter point700aof thecircle700 indicates the position of the selected information on thedisplay screen4.
As shown inFIG. 46, thecircle700 is divided into left and right two parts based on thecenter point700aas a reference. In ahalf circle700blocated to the right of thecenter point700a(the position of the selected information), a character string “copy” is shown. In ahalf circle700clocated to the left of thecenter point700a(the position of the selected information), a character string “translation” is shown. From this, it is understood that the right sliding operation is associated with the process for copying the selected information, and the left sliding operation is associated with the process for translating the selected information.
In a case of using the correspondence table622 shown inFIG. 45 when the selected information is vertically written information, it is possible to identify the execution instruction operation by the method for identifying the execution instruction operation described above with reference toFIG. 33, by dividing thecircle530 into left and right two parts.
In a case of using the correspondence table622 shown inFIG. 45, as described above with reference toFIGS. 34 and 35, the displayed information use process that should be executed may be determined in accordance with the direction (the right direction or the left direction) of the sliding operation performed immediately before the touch point touched by the screen operation means on thedisplay screen4 goes out of thecircle530.
It may be acceptable that only the sliding operation in the upward direction or only the sliding operation in the downward direction is registered in the correspondence table222. For example, in the correspondence table222 shown inFIG. 7, only the upper right sliding operation, the direct upward sliding operation, and the upper left sliding operation may be registered, or only the lower left sliding operation, the direct downward sliding operation, and the lower right sliding operation may be registered. Additionally, in the correspondence table222 shown inFIG. 31, only the upward sliding operation may be registered or only the downward sliding operation may be registered.
Moreover, it may be also acceptable that only the sliding operation in the right direction or only the sliding operation in the left direction is registered in the correspondence table622. For example, in the correspondence table622 shown inFIG. 37, only the lower right sliding operation, the direct right sliding operation, and the upper right sliding operation may be registered, or only the upper left sliding operation, the direct left sliding operation, and the lower left sliding operation may be registered. In the correspondence table622 shown inFIG. 45, only the right sliding operation may be registered, or only the left sliding operation may be registered.
In a case of adopting the flick operation as the execution instruction operation, in the correspondence table222, only the flick operation in the upward direction or only the flick operation in the downward direction may be registered, and in the correspondence table622, only the flick operation in the right direction or only the flick operation in the left direction may be registered.
<Fifth Modification>
In theelectronic device100, it may be acceptable that, when the screenoperation identification part210 identifies that the displayed information selection operation has been performed on thedisplay screen4, in other words, when the screenoperation identification part210 determines that the displayed information selection operation on thedisplay screen4 is completed, then thedisplay control part204 controls thedisplay part3 including thisdisplay screen4 to display the correspondence table222 on thedisplay screen4.
For example, thedisplay control part204 forms a graphic of the correspondence table222 similarly to the above-described graphic shown inFIG. 8, and, when the displayed information selection operation is performed on thedisplay screen4, displays a resulting graphic800 ondisplay screen4 as shown inFIG. 47. Then, when the execution instruction operation is performed on thedisplay screen4, thedisplay control part204 erases the graphic800 from thedisplay screen4.
In a case of using the correspondence table622, thedisplay control part204 forms a graphic of the correspondence table622 similarly to the above-described graphic shown inFIG. 38, and, when the displayed information selection operation is performed on thedisplay screen4, displays a resulting graphic810 on thedisplay screen4 as shown inFIG. 48. Then, when the execution instruction operation is performed on thedisplay screen4, thedisplay control part204 erases the graphic810 from thedisplay screen4.
In this manner, when information displayed on thedisplay screen4 is selected, the correspondence table222 or622 is displayed on thedisplay screen4 without requiring an instruction from the user. Thereby, the user can easily perform the execution instruction operation. At this time, as shown inFIGS. 47 and 48, the correspondence table222 or622 is displayed on thedisplay screen4 such that it does not overlap the information (selectedcharacter string260 or660) selected by the user. Thereby, the user can perform the desired execution instruction operation while checking the selected information. It may be also acceptable that, in a case where the correspondence table222 or622 is displayed so as to overlap the information selected by the user, the correspondence table222 or622 (in more detail, the graphic800 or810) is displayed in a translucent manner such that the information selected by the user is visible. In this case as well, the user can perform the desired execution instruction operation while checking the selected information.
<Sixth Modification>
In the example described above, at the time point when, after the region of thedisplay screen4 where the selection object information is displayed is traced with the screen operation means, the screen operation means is separated away from thedisplay screen4, the screenoperation identification part210 determines that the displayed information selection operation is completed. However, the determination that the displayed information selection operation is completed may be made based on other criteria.
For example, it may be possible that the screenoperation identification part210 determines that the displayed information selection operation is completed, in a case where, after the region of thedisplay screen4 where the selection object information is displayed is traced with the screen operation means, such a situation is detected that the screen operation means continuously keeps touching thedisplay screen4 for a certain time period or longer in a terminating point of the tracing, that is, in a position at which the movement of the screen operation means is stopped. Then, when the screenoperation identification part210 determines that the displayed information selection operation is completed, the correspondence table222 or622 may be displayed on thedisplay screen4 as described above.
In this manner, in a case where, after the region of thedisplay screen4 where the selection object information is displayed is traced with the screen operation means, the screen operation means continuously keeps touching thedisplay screen4 in the terminating point for a certain time period or more, the displayed information selection operation determines the completion. Thereby, even when the user traces, with the screen operation means, the region of thedisplay screen4 where the selection object information is displayed and then separates the screen operation means away from thedisplay screen4, the user can re-select information displayed on thedisplay screen4, as long as the screen operation means does not continuously keep touching thedisplay screen4 for the certain time period or longer in the position at which the movement of the screen operation means is stopped. This further improves the operability of theelectronic device100.
<Seventh Modification>
FIGS. 49 to 52 are diagrams showing an exemplary display in theelectronic device100 according to this modification. In this modification, when the displayed information selection operation is performed on thedisplay screen4, as shown inFIG. 49, anedit object900 for edition of a selection range is displayed under the head of the selectedcharacter string260. At this time, as shown inFIG. 49, the graphic800 representing the correspondence table222 may be displayed on thedisplay screen4.
In a state shown inFIG. 49, when the user performs the execution instruction operation on thedisplay screen4, the displayed information use process associated with this execution instruction operation in the correspondence table222 is executed with use of the selectedcharacter string260. On the other hand, when the user touches theedit object900 with the screen operation means, the edition of a displayed information selection range is allowed in theelectronic device100, and, as shown inFIG. 50, the graphic800 representing the correspondence table222 is erased from thedisplay screen4.
In a state shown inFIG. 50, by moving the screen operation means in touch with theedit object900 in the right direction or the left direction while the screen operation means is touching thedisplay screen4, the user can change a character string selection range based on a position of theedit object900 as a starting point.
FIG. 51 is a diagram showing a situation where the user has changed a rear position of the selectedcharacter string260, by moving the screen operation means in touch with theedit object900 in the right direction while the screen operation means is touching thedisplay screen4. As shown inFIG. 51, in a case where the screen operation means is moved in the right direction from theedit object900, theedit object900 is displayed under the head of the selectedcharacter string260 and anotheredit object901 is displayed under the end of the selectedcharacter string260. That is, a character string sandwiched between the twoedit objects900 and901 is the selectedcharacter string260. At this time, the graphic800 representing the correspondence table222 is displayed again. When, in a state shown inFIG. 51, the user performs the execution instruction operation on thedisplay screen4, the displayed information use process associated with this execution instruction operation in the correspondence table222 is executed with use of the selectedcharacter string260.
FIG. 52 is a diagram showing a situation where the user has changed a head position of the selectedcharacter string260, by moving the screen operation means in touch with theedit object900 in the left direction while the screen operation means is touching thedisplay screen4. As shown inFIG. 52, in a case where the screen operation means is moved in the left direction from theedit object900, theedit object900 is displayed under the end of the selectedcharacter string260 and anotheredit object901 is displayed under the head of the selectedcharacter string260. That is, a character string sandwiched between the twoedit objects900 and901 is the selectedcharacter string260. At this time, the graphic800 representing the correspondence table222 is displayed again. When, in a state shown inFIG. 52, the user performs the execution instruction operation on thedisplay screen4, the displayed information use process associated with this execution instruction operation in the correspondence table222 is executed with use of the selectedcharacter string260.
In a case where theelectronic device100 is brought into the state shown inFIG. 51 or52, the user is allowed to move the edit objects900 and901 in the right direction and the left direction by using the screen operation means. When the screen operation means in touch with theedit object900 is slid in the right direction or the left direction, theedit object900 is moved in this sliding direction. Likewise, when the screen operation means in touch with theedit object901 is slid in the right direction or the left direction, theedit object901 is moved in this sliding direction. The user can change a range of the selectedcharacter string260, by move at least one of the edit objects900 and901.
<Other Modifications>
Although, in the preferred embodiment and its modifications described above, a case where the invention of the present application is applied to a mobile phone has been illustrated. However, the invention of the present application is applicable to electronic devices different from mobile phones.
The invention of the present application is also applicable to an electronic device in which, unlike the above-describedelectronic device100, a plurality of display screens are simultaneously visible at any time. Moreover, the invention of the present application is also applicable to an electronic device in which a plurality of display screens are simultaneously visible in an open state but all of the plurality of display screens are not visible in a closed state. The invention of the present application is applicable to, for example, a flip-type mobile phone or a note-type personal computer having two housings that are provided with display screens on the inner surfaces thereof and that can be overlapped each other to thereby fold the flip-type mobile phone or the note-type personal computer. Furthermore, the invention of the present application is also applicable to an electronic device having only one display screen unlike the above-describedelectronic device100.
While the invention has been shown and described in detail, the foregoing description is in all aspects illustrative and not restrictive. It is therefore understood that numerous modifications and variations can be devised without departing from the scope of the invention.