Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 illustrates the subscriber equipment 1 for carrying out application operating according to one aspect of the invention, and wherein, subscriber equipment 1 comprises that operation deriving means 11, instruction determinedevice 12 and instruction executing device 13.Particularly, operation deriving means 11 obtains the combination touch operation that the user carries out on the touch input device of subscriber equipment, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value; Instruction determines thatdevice 12 is according to described combination touch operation, determines the application operating command information corresponding with described combination touch operation; The corresponding object application of 13 pairs of described combination touch operation of instruction executing device, carry out described application operating command information.
At this, subscriber equipment 1 is a kind ofly anyly can carry out by touch input device the electronic product of man-machine interaction, as smart mobile phone, PDA, portable game machine, palm PC PPC or panel computer etc.; Wherein, touch input device includes but not limited to following at least any one: 1) touch-screen (Touch Screen) comprises capacitive touch screen, resistive touch screen, piezoelectric type touch screen, infrared-type touch-screen, surface acoustic wave touch screen etc.; 2) touch pad, the movement by finger on touch pad (Touch Pad), can easily complete the movement of mouse; 3) Trackpad, by one can the finger sensing running orbit pressure sensitivity plate and two buttons form, two buttons are equivalent to the right and left key of standard mouse.Those skilled in the art will be understood that above-mentioned subscriber equipment 1 and touch input device are only for giving an example; other subscriber equipmenies existing or that may occur from now on or touch input device are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this at this with way of reference.
Particularly, operation deriving means 11 uses the electric signal of finger performed generations such as touch action on the touch-screen of subscriber equipment 1 by detecting and resolve the user, obtain the combination touch operation that the user carries out on the touch input device of subscriber equipment 1, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value.At this, described operating interval threshold value can be scheduled to, and can be also that the user arranges voluntarily.At this, different touch operation in the combination touch operation can act on different object application or act on identical object application, wherein, described touch operation includes but not limited to slide, click, press, drag, and any predefined other operation, described object application includes but not limited to as video, webpage, picture, app(application, application program) etc.At this, the implication of described different touch operation includes but not limited to following at least any one: the touch operation of 1) different objects being applied; 2) the different touch operation of same target being applied.Those skilled in the art will be understood that the implication of combinations thereof touch operation, object application and different touch operation is only for giving an example; the implication of the application of other combination touch operation existing or that may occur from now on or object or different touch operation is as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
For example, the subscriber equipment 1 of supposing user A is the electronic product with resistive touch screen, user A opens the video file Dream of the Red Mansion be stored in its subscriber equipment 1, want to watch video " A Dream of Red Mansions the 6th collection ", at first it clicked video player storm wind sound shadow shortcut by the touch-screen of subscriber equipment 1, then clicked again video file to be opened " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, to realize playing " A Dream of Red Mansions the 6th collection " by storm wind sound shadow, correspondingly, operation deriving means 11 uses the finger electric signal that the performed touch operation action of continuously different objects being applied for twice produces on the touch-screen of subscriber equipment 1 by detecting and resolve the user, get the combination touch operation that this user carries out on the touch input device of subscriber equipment 1.And for example, suppose that user A is watching video " A Dream of Red Mansions the 6th collection " by its subscriber equipment 1, but need to close and watch this video because of other things, it uses a finger to draw a fork " * " on the touch-screen of this subscriber equipment 1, to realize closing in progress video " A Dream of Red Mansions the 6th collection ", operate deriving means 11 and use the picture that finger is carried out on the touch-screen of subscriber equipment 1 to pitch the electric signal that action produces by detecting and resolve the user, get the combination touch operation that this user carries out on the touch input device of subscriber equipment 1.
Those skilled in the art will be understood that the mode of the touch operation that the above-mentioned user of obtaining carries out on the touch input device of subscriber equipment is only for giving an example; other existing or modes of obtaining the touch operation that the user carries out on the touch input device of subscriber equipment that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
Instruction determines thatdevice 12 is according to described combination touch operation, determines the application operating command information corresponding with described combination touch operation.At this, described application operating command information includes but not limited to as time-out, F.F., playback, closes, sends, uploads, issues, amplifies, dwindles, shares etc.Those skilled in the art will be understood that above-mentioned application operating command information is only for giving an example; other application operating command informations existing or that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.At this, instruction determines that the method fordevice 12 definite described application operating command informations includes but not limited to following at least any one:
1) according to described combination touch operation, carry out matching inquiry in the predefine storehouse of the mapping relations that store described combination touch operation and application operating command information, to obtain the application operating command information corresponding with described combination touch operation, as, " || " means that video suspends, “ ↖ ↗ " application of expression shared object etc.For example, suppose that user A is just watching video " A Dream of Red Mansions the 6th collection " on its ipad2, suppose that operation deriving means 11 gets user A and carried out the combination touch operation with a finger picture " || " on the touch-screen of its ipad2, instruction determines that the definite application operating command information corresponding with described combination touch operation ofdevice 12 comprises time-out video " A Dream of Red Mansions the 6th collection ".
2), according to described combination touch operation, in conjunction with the corresponding touch point of described combination touch operation quantity information, determine the application operating command information corresponding with described combination touch operation.At this, the corresponding touch point of described combination touch operation quantity information can comprise as touch point quantity corresponding to touch operation one of in the combination touch operation 1); 2) the included touch point quantity of described combination touch operation.For example, suppose at touch-screen right half-court territory adopting consecutive click chemical reaction or slide to the right to mean video fast forward, mean that at touch-screen left half-court territory adopting consecutive click chemical reaction or slip left video falls back, the subscriber equipment 1 of supposing user A is the electronic product with capacitive touch screen, it possesses multiple point touching (Muti-Touch) characteristic, suppose that user A is watching video " A Dream of Red Mansions the 6th collection " by its subscriber equipment 1, operation deriving means 11 gets user A and only carries out twice single-click operation in the territory, right half-court of touch-screen quick (completing in as 2 seconds), the combination touch operation thatdevice 12 forms according to this twice single-click touch operation is determined in instruction, combine the corresponding touch point of touch operation quantity information as two touch point quantity informations in conjunction with this, determine the application operating command information corresponding with described combination touch operation comprise F.F. not displaying video duration video 20%, perhaps, if the total playing duration of video " A Dream of Red Mansions the 6th collection " is divided into to 5 sections, 2/5 of the total playing duration of F.F..Also as, connect example, suppose that at first operation deriving means 11 gets user A and point quick sliding left in the territory, left half-court of touch-screen with one, then point left quick sliding in the territory, left half-court of touch-screen with two as got again user A in 2 seconds within a short period of time, the combination touch operation ofdevice 12 according to this single-click touch operation and 2 touch operation formation determined in instruction, combine the corresponding touch point of touch operation quantity information as three touch point quantity informations in conjunction with this, determine that the application operating command information corresponding with described combination touch operation comprises 30% of the displaying video duration video not of falling back, perhaps, if the total playing duration of video " A Dream of Red Mansions the 6th collection " is divided into to 5 sections, 3/5 of total playing duration that falls back.
At this, the multiple point touching technology that realizes " multiple point touching " refers to that the permission computer user controls a kind of technology of man-machine interaction simultaneously by a plurality of touch contacts that contact with touch input device, it includes but not limited to following at least any one: 1) the multiple point touching technology based on optics, comprise frustrated total internal reflection multiple point touching technology (FTIR), front and back scattered light multiple point touching technology (Front and Rear DI), laser plane multiple point touching technology (LLP), LED plane multiple point touching technology (LED-LP), scattered light planar multi-point touch technology (DSI), 2) scattered light illumination multiple point touching technology, 3) laser plane multiple point touching technology, 4) scattered light flat illumination multiple point touching technology, 5) LED plane multiple point touching technology.
Those skilled in the art will be understood that and above-mentionedly determine that the mode of the application operating command information corresponding with described combination touch operation is only for giving an example; other existing or modes of determining the application operating command information corresponding with described combination touch operation that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
The corresponding object application of 13 pairs of described combination touch operation of instruction executing device, carry out described application operating command information.For example, presumptive instruction determines that the definite application operating command information corresponding with described combination touch operation ofdevice 12 is for suspending video " A Dream of Red Mansions the 6th collection ", the corresponding object application of 13 pairs of described combination touch operation of instruction executing device is video " A Dream of Red Mansions the 6th collection ", carries out and suspends.
Between each device of subscriber equipment 1, be constant work.Particularly, operation deriving means 11 continues to obtain the combination touch operation that the user carries out on the touch input device of subscriber equipment, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value; Instruction determines thatdevice 12 continues according to described combination touch operation, determines the application operating command information corresponding with described combination touch operation;Instruction executing device 13 continues, to the corresponding object application of described combination touch operation, to carry out described application operating command information.At this, those skilled in the art will be understood that " continuing " refers between each device of subscriber equipment 1 and are constantly combined respectively determining and carrying out of the obtaining of touch operation, application operating command information, until subscriber equipment 1 stops obtaining the combination touch operation in a long time.
Preferably, instruction determines thatdevice 12 also can be according to described combination touch operation, and the application related information of applying in conjunction with described object, determine the application operating command information corresponding with described combination touch operation; Wherein, described application related information comprises following at least any one:
The application type information of the corresponding object application of-described combination touch operation;
Application simple crosscorrelation information in-described combination touch operation between the corresponding object application of different touch operation.
For example, when described application related information comprises the application type information of the corresponding object application of described combination touch operation, at this, described application type information includes but not limited to as video, webpage, picture, app etc., the object application of different application type, the corresponding application operating instruction of like combinations touch operation difference, as hypothesis both can mean video fast forward at touch-screen right half-court territory adopting consecutive click chemical reaction or slip to the right, also can mean that picture amplifies, both can mean at touch-screen left half-court territory adopting consecutive click chemical reaction or slip left that video fell back, also can mean that picture dwindles, as supposed, user A is by its subscriber equipment 1 browsing pictures photo1, operation deriving means 11 gets user A and only carries out twice single-click operation in the territory, right half-court of touch-screen quick (completing in as 2 seconds), the combination touch operation thatdevice 12 forms according to this twice single-click touch operation is determined in instruction, application type information " picture " in conjunction with the corresponding object application of this combination touch operation picture photo1, determine that the application operating command information corresponding with described combination touch operation is for amplifying picture photo1, as picture photo1 is enlarged into to original 2 times.
For another example, during application simple crosscorrelation information in described combination touch operation between the application of the corresponding object of different touch operation, suppose that operation deriving means 11 gets user A and at first by the touch-screen of subscriber equipment 1, clicked app as " transfer files " button in the qq client, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of video file waiting for transmission " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, there is application simple crosscorrelation information between " transfer files " button in this combination touch operation in the twice corresponding object application of touch operation qq client and " video file " A Dream of Red Mansions the 6th collection " ", as " transfer files " button by the qq client can transmitting video files " A Dream of Red Mansions the 6th collection ", the combination touch operation thatdevice 12 forms according to this twice single-click touch operation is determined in instruction, in conjunction with the application simple crosscorrelation information between the corresponding object application of different touch operation in this combination touch operation, determine that the application operating command information corresponding with described combination touch operation is transmitting video files " A Dream of Red Mansions the 6th collection ", for another example, suppose that operation deriving means 11 gets user A and at first by the touch-screen of subscriber equipment 1, clicked video player storm wind sound shadow shortcut, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of txt file to be opened " A Dream of Red Mansions appreciation " by the touch-screen of subscriber equipment 1, do not there is application simple crosscorrelation information in this combination touch operation between twice corresponding object application of touch operation " video player storm wind sound shadow shortcut " and " txt file " A Dream of Red Mansions appreciation " ", by " video player storm wind sound shadow shortcut can't be opened " txt file " A Dream of Red Mansions appreciation " ", the combination touch operation thatdevice 12 forms according to this twice single-click touch operation is determined in instruction, in conjunction with the application simple crosscorrelation information between the corresponding object application of different touch operation in this combination touch operation, determine that the application operating command information corresponding with described combination touch operation be not for opening " txt file " A Dream of Red Mansions appreciation " ", and return to wrong application operating instruction.
Those skilled in the art will be understood that the above-mentioned mode of determining the application operating command information in conjunction with described application related information is only for for example; other existing or modes of determining the application operating command information in conjunction with described application related information that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
More preferably, when described application related information comprises the application simple crosscorrelation information between the corresponding object application of different touch operation in described combination touch operation, the user establishes and also comprises that simple crosscorrelation determines the device (not shown).Particularly, simple crosscorrelation determines that device determines the application simple crosscorrelation information between the application of the corresponding object of described combination touch operation; Wherein, instruction determines thatdevice 12 is according to described combination touch operation, in conjunction with described application simple crosscorrelation information, determines the application operating command information corresponding with described combination touch operation.
Particularly, simple crosscorrelation determines that device determines the application simple crosscorrelation information between the corresponding object application of different touch operation in described combination touch operation.At this, simple crosscorrelation determines that device determines that the mode of described application simple crosscorrelation information includes but not limited to following at least any one:
1) touch the apply property information of the corresponding object application of different touch operation in behaviour according to described combination, determine described application simple crosscorrelation information.At this, described apply property information include but not limited to as described in the application type information, application descriptor etc. of object application.For example, suppose that operation deriving means 11 gets user A and at first by the touch-screen of subscriber equipment 1, clicked application program word2003 shortcut, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of word file to be opened " A Dream of Red Mansions appreciation " by the touch-screen of subscriber equipment 1, in this combination touch operation last time the apply property information of the corresponding object of touch operation application " word2003 shortcut " as the application descriptor, be " Microsoft Office Word2003 ", target type is " application program ", and in this combination touch operation last time the apply property information of the corresponding object of touch operation application " word file " A Dream of Red Mansions appreciation " " as file type information, be Microsoft Word document (.doc), simple crosscorrelation determines that device can determine in this combination touch operation between twice corresponding object application of touch operation to have application simple crosscorrelation information, as application program word2003 can open word file " A Dream of Red Mansions appreciation ".
2) according to from the corresponding object of different touch operation in described combination touch operation, applying corresponding functional configuration information, determine described application simple crosscorrelation information.For example, suppose that operation deriving means 11 gets user A and at first by the touch-screen of subscriber equipment 1, clicked app as " transfer files " button in the qq client, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of video file waiting for transmission " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, in this combination touch operation last time functional configuration information corresponding to " transfer files " button in the corresponding object application of touch operation qq client be " transferring documents ", and the document of functional configuration information for being transmitted corresponding to the corresponding object application of time touch operation after in this combination touch operation " video file " A Dream of Red Mansions the 6th collection " ", simple crosscorrelation determines that device can determine in this combination touch operation between twice corresponding object application of touch operation to have application simple crosscorrelation information, as " transfer files " button by the qq client can transmitting video files " A Dream of Red Mansions the 6th collection ".
Those skilled in the art will be understood that the mode of above-mentioned definite described application simple crosscorrelation information is only for giving an example; the mode of other existing or definite described application simple crosscorrelation information that may occur from now on is as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
Instruction determines thatdevice 12 is according to described combination touch operation, in conjunction with described application simple crosscorrelation information, determines the application operating command information corresponding with described combination touch operation.At this, instruction determines thatdevice 12 determines described application operating command information mode in conjunction with described application simple crosscorrelation information and aforementioned instruction determine thatdevice 12 determines that in conjunction with described application related information the mode of described application operating command information is identical or basic identical, during simple and clear, therefore again repeat no more, and be contained in this by reference.
Preferably, subscriber equipment 1 also comprises the generator (not shown), particularly, generator is by dynamic web page techniques such as ASP, JSP or PHP, the perhaps communication mode of other agreements, as communication protocols such as http or https, the application operating object information that the described object application of operation is obtained offers described user.For example, presumptive instruction determines thatdevice 12 determines that the application operating command information corresponding with described combination touch operation comprises in the in progress video of F.F. " A Dream of Red Mansions the 6th collects " not 20% of displaying video duration video, and 13 pairs of in progress videos of instruction executing device " A Dream of Red Mansions the 6th collection " have been carried out this application operating command information, be about in progress video " A Dream of Red Mansions the 6th collection " F.F. not displaying video duration video 20%, as suppose video " A Dream of Red Mansions the 6th collection " position, the current 20min of playing to place, also remain the 40min duration, the video after F.F. should play to 28min, generator offers user A by the video pictures at 28min place.
Fig. 2 illustrate in accordance with a preferred embodiment of the present invention for carrying out the equipment schematic diagram of application operating, wherein, subscriber equipment 1 comprises that operation deriving means 11 ', instruction determine device 12 ' and instruction executing device 13 ', wherein, operation deriving means 11 ' comprises operation acquiring unit 111 ', detecting unit 112 ' and assembledunit 113 '.Particularly, operation acquiring unit 111 ' obtains a plurality of touch operation that the user carries out on the touch input device of subscriber equipment; Detecting unit 112 ' detects the whether satisfied combination condition that combines touch operation that belongs to of described a plurality of touch operation; Assembled unit 113 ' is using at least two touch operation meeting described combination condition in described a plurality of touches as described combination touch operation, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value; Instruction determines that device 12 ' is according to described combination touch operation, determines the application operating command information corresponding with described combination touch operation; Instruction executing device 13 ', to the corresponding object application of described combination touch operation, is carried out described application operating command information.At this, instruction determines that device 12 ' is identical or basic identical with the content of corresponding intrument in Fig. 1 embodiment with actuating unit 13 ', for simplicity's sake, thus do not repeat them here, and comprise therewith by reference.
Particularly, operation acquiring unit 111 ' uses the electric signal of finger performed generations such as touch action on the touch-screen of subscriber equipment 1 by detecting and resolve the user, obtain a plurality of touch operation that the user carries out on the touch input device of subscriber equipment.For example, the subscriber equipment 1 of supposing user A is the electronic product with resistive touch screen, user A opens the video file Dream of the Red Mansion be stored in its subscriber equipment 1, want to watch video " A Dream of Red Mansions the 6th collection ", at first it clicked video player storm wind sound shadow shortcut by the touch-screen of subscriber equipment 1, then clicked again video file to be opened " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, to realize playing " A Dream of Red Mansions the 6th collection " by storm wind sound shadow, then, after a while, user A has drawn again one " || " on the touch-screen of subscriber equipment 1, correspondingly operate acquiring unit 111 ' and use the finger electric signal that performed different touch operation actions produce on the touch-screen of subscriber equipment 1 by detecting and resolve the user, get a plurality of touch operation that this user carries out on the touch input device of subscriber equipment 1.
Detecting unit 112 ' detects the whether satisfied combination condition that combines touch operation that belongs to of described a plurality of touch operation; Preferably, described combination condition comprises following at least any one:
Execution time interval between-any two described touch operation is less than or equal to the assembly time threshold value;
The deadline of-adjacent two or more described touch operation is less than or equal to the scheduled duration threshold value;
Meet predetermined location relationship between the operation trace of-adjacent two or more described touch operation.
For example, when comprising execution time interval between any two described touch operation, described combination condition is less than or equal to the assembly time during threshold value, connect example, suppose that the execution time interval between the touch operation of the video file " A Dream of Red Mansions the 6th collects " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution was less than or equal to the assembly time threshold value as 3 seconds, and user A carries out the touch operation of clicking video file to be opened " A Dream of Red Mansions the 6th collection " and the execution time of carrying out between the touch operation of having drawn " || " on the touch-screen of subscriber equipment 1 is spaced apart 20min, be greater than the assembly time threshold value, detecting unit 112 ' can judge the satisfied combination condition that combines touch operation that belongs to of touch operation of the video file " A Dream of Red Mansions the 6th collection " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution, and the touch operation of clicking video file to be opened " A Dream of Red Mansions the 6th collection " has been drawn the satisfied combination condition that combines touch operation that belongs to of touch operation of " || " with execution on the touch-screen of subscriber equipment 1.
For another example, when described combination condition comprises that the deadline of adjacent two or more described touch operation is less than or equal to the scheduled duration threshold value, still connect example, the deadline of supposing the touch operation of the video file " A Dream of Red Mansions the 6th collects " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution is within 5 seconds, to be less than the scheduled duration threshold value as 10 seconds, detecting unit 112 ' can judge the satisfied combination condition that combines touch operation that belongs to of touch operation of the video file " A Dream of Red Mansions the 6th collection " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution.
Also as, while between described combination condition comprises the operation trace of adjacent two or more described touch operation, meeting predetermined location relationship, as supposed, user A carries out has successively drawn two " | " on the touch-screen of subscriber equipment 1, and meet predetermined location relationship between the operation trace of this two " | " as " || ", detecting unit 112 ' can judge these adjacent two the satisfied combination conditions that combine touch operation that belong to of touch operation of drawing " | ".
Those skilled in the art will be understood that whether the described a plurality of touch operation of above-mentioned detection meet the mode that belongs to the combination condition that combines touch operation is only for example; whether the described a plurality of touch operation of other detections existing or that may occur from now on meet the mode that belongs to the combination condition that combines touch operation as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
Those skilled in the art will be understood that detecting unit 112 ' also can detect according to the combination of one or more combination conditions of combinations thereof condition described a plurality of touch operation and whether meet and belong to the combination condition that combines touch operation.
Assembled unit 113 ' is using at least two touch operation meeting described combination condition in described a plurality of touches as described combination touch operation, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value.For example, suppose the satisfied combination condition that combines touch operation that belongs to of touch operation of the video file " A Dream of Red Mansions the 6th collection " that the touch operation of the click video player storm wind sound shadow shortcut that detecting unit 112 ' judgement user A carries out is to be opened with the click of execution, assembled unit 113 ' is using these two touch operation as described combination touch operation, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value.
Fig. 3 illustrate according to a further aspect of the present invention for carrying out the method flow diagram of application operating.
Particularly, in step S1, subscriber equipment 1 obtains the combination touch operation that the user carries out on the touch input device of subscriber equipment, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value; In step S2, subscriber equipment 1, according to described combination touch operation, is determined the application operating command information corresponding with described combination touch operation; In step S3, the corresponding object application of 1 pair of described combination touch operation of subscriber equipment, carry out described application operating command information.
At this, subscriber equipment 1 is a kind ofly anyly can carry out by touch input device the electronic product of man-machine interaction, as smart mobile phone, PDA, portable game machine, palm PC PPC or panel computer etc.; Wherein, touch input device includes but not limited to following at least any one: 1) touch-screen (Touch Screen) comprises capacitive touch screen, resistive touch screen, piezoelectric type touch screen, infrared-type touch-screen, surface acoustic wave touch screen etc.; 2) touch pad, the movement by finger on touch pad (Touch Pad), can easily complete the movement of mouse; 3) Trackpad, by one can the finger sensing running orbit pressure sensitivity plate and two buttons form, two buttons are equivalent to the right and left key of standard mouse.Those skilled in the art will be understood that above-mentioned subscriber equipment 1 and touch input device are only for giving an example; other subscriber equipmenies existing or that may occur from now on or touch input device are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this at this with way of reference.
Particularly, in step S1, subscriber equipment 1 uses the electric signal of finger performed generations such as touch action on the touch-screen of subscriber equipment 1 by detecting and resolve the user, obtain the combination touch operation that the user carries out on the touch input device of subscriber equipment 1, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value.At this, described operating interval threshold value can be scheduled to, and can be also that the user arranges voluntarily.At this, different touch operation in the combination touch operation can act on different object application or act on identical object application, wherein, described touch operation includes but not limited to slide, click, press, drag, and any predefined other operation, described object application includes but not limited to as video, webpage, picture, app(application, application program) etc.At this, the implication of described different touch operation includes but not limited to following at least any one: the touch operation of 1) different objects being applied; 2) the different touch operation of same target being applied.Those skilled in the art will be understood that the implication of combinations thereof touch operation, object application and different touch operation is only for giving an example; the implication of the application of other combination touch operation existing or that may occur from now on or object or different touch operation is as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
For example, the subscriber equipment 1 of supposing user A is the electronic product with resistive touch screen, user A opens the video file Dream of the Red Mansion be stored in its subscriber equipment 1, want to watch video " A Dream of Red Mansions the 6th collection ", at first it clicked video player storm wind sound shadow shortcut by the touch-screen of subscriber equipment 1, then clicked again video file to be opened " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, to realize playing " A Dream of Red Mansions the 6th collection " by storm wind sound shadow, correspondingly, in step S1, subscriber equipment 1 uses the finger electric signal that the performed touch operation action of continuously different objects being applied for twice produces on the touch-screen of subscriber equipment 1 by detecting and resolve the user, get the combination touch operation that this user carries out on the touch input device of subscriber equipment 1.And for example, suppose that user A is watching video " A Dream of Red Mansions the 6th collection " by its subscriber equipment 1, but need to close and watch this video because of other things, it uses a finger to draw a fork " * " on the touch-screen of this subscriber equipment 1, to realize closing in progress video " A Dream of Red Mansions the 6th collection ", in step S1, subscriber equipment 1 uses the picture that finger is carried out on the touch-screen of subscriber equipment 1 to pitch the electric signal that action produces by detecting and resolve the user, get the combination touch operation that this user carries out on the touch input device of subscriber equipment 1.
Those skilled in the art will be understood that the mode of the touch operation that the above-mentioned user of obtaining carries out on the touch input device of subscriber equipment is only for giving an example; other existing or modes of obtaining the touch operation that the user carries out on the touch input device of subscriber equipment that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
In step S2, subscriber equipment 1, according to described combination touch operation, is determined the application operating command information corresponding with described combination touch operation.At this, described application operating command information includes but not limited to as time-out, F.F., playback, closes, sends, uploads, issues, amplifies, dwindles, shares etc.Those skilled in the art will be understood that above-mentioned application operating command information is only for giving an example; other application operating command informations existing or that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.At this, in step S2, subscriber equipment 1 determines that the method for described application operating command information includes but not limited to following at least any one:
1) according to described combination touch operation, carry out matching inquiry in the predefine storehouse of the mapping relations that store described combination touch operation and application operating command information, to obtain the application operating command information corresponding with described combination touch operation, as, " || " means that video suspends, “ ↖ ↗ " application of expression shared object etc.For example, suppose that user A is just watching video " A Dream of Red Mansions the 6th collection " on its ipad2, suppose in step S1, subscriber equipment 1 gets user A and carried out the combination touch operation with a finger picture " || " on the touch-screen of its ipad2,, in step S2, subscriber equipment 1 determines that the application operating command information corresponding with described combination touch operation comprises time-out video " A Dream of Red Mansions the 6th collection ".
2), according to described combination touch operation, in conjunction with the corresponding touch point of described combination touch operation quantity information, determine the application operating command information corresponding with described combination touch operation.At this, the corresponding touch point of described combination touch operation quantity information can comprise as touch point quantity corresponding to touch operation one of in the combination touch operation 1); 2) the included touch point quantity of described combination touch operation.For example, suppose at touch-screen right half-court territory adopting consecutive click chemical reaction or slide to the right to mean video fast forward, mean that at touch-screen left half-court territory adopting consecutive click chemical reaction or slip left video falls back, the subscriber equipment 1 of supposing user A is the electronic product with capacitive touch screen, it possesses multiple point touching (Muti-Touch) characteristic, suppose that user A is watching video " A Dream of Red Mansions the 6th collection " by its subscriber equipment 1, in step S1, subscriber equipment 1 gets user A and only carries out twice single-click operation in the territory, right half-court of touch-screen quick (completing in as 2 seconds), in step S2, the combination touch operation that subscriber equipment 1 forms according to this twice single-click touch operation, combine the corresponding touch point of touch operation quantity information as two touch point quantity informations in conjunction with this, determine the application operating command information corresponding with described combination touch operation comprise F.F. not displaying video duration video 20%, perhaps, if the total playing duration of video " A Dream of Red Mansions the 6th collection " is divided into to 5 sections, 2/5 of the total playing duration of F.F..Also as, connect example, suppose in step S1, at first subscriber equipment 1 gets user A and points quick sliding left in the territory, left half-court of touch-screen with one, then point left quick sliding in the territory, left half-court of touch-screen with two as got again user A in 2 seconds within a short period of time, in step S2, subscriber equipment 1 is according to the combination touch operation of this single-click touch operation and 2 touch operation formation, combine the corresponding touch point of touch operation quantity information as three touch point quantity informations in conjunction with this, determine that the application operating command information corresponding with described combination touch operation comprises 30% of the displaying video duration video not of falling back, perhaps, if the total playing duration of video " A Dream of Red Mansions the 6th collection " is divided into to 5 sections, 3/5 of total playing duration that falls back.
At this, the multiple point touching technology that realizes " multiple point touching " refers to that the permission computer user controls a kind of technology of man-machine interaction simultaneously by a plurality of touch contacts that contact with touch input device, it includes but not limited to following at least any one: 1) the multiple point touching technology based on optics, comprise frustrated total internal reflection multiple point touching technology (FTIR), front and back scattered light multiple point touching technology (Front and Rear DI), laser plane multiple point touching technology (LLP), LED plane multiple point touching technology (LED-LP), scattered light planar multi-point touch technology (DSI), 2) scattered light illumination multiple point touching technology, 3) laser plane multiple point touching technology, 4) scattered light flat illumination multiple point touching technology, 5) LED plane multiple point touching technology.
Those skilled in the art will be understood that and above-mentionedly determine that the mode of the application operating command information corresponding with described combination touch operation is only for giving an example; other existing or modes of determining the application operating command information corresponding with described combination touch operation that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
In step S3, the corresponding object application of 1 pair of described combination touch operation of subscriber equipment, carry out described application operating command information.For example, suppose in step S2, subscriber equipment 1 determines that the application operating command information corresponding with described combination touch operation is for suspending video " A Dream of Red Mansions the 6th collection ", in step S3, the corresponding object application of 1 pair of described combination touch operation of subscriber equipment is video " A Dream of Red Mansions the 6th collection ", carries out and suspends.
Between each step of subscriber equipment 1, be constant work.Particularly, in step S1, subscriber equipment 1 continues to obtain the combination touch operation that the user carries out on the touch input device of subscriber equipment, and wherein, the execution time interval in described combination touch operation between any two touch operation is greater than the operating interval threshold value; In step S2, subscriber equipment 1 continues according to described combination touch operation, determines the application operating command information corresponding with described combination touch operation; In step S3, subscriber equipment 1 continues, to the corresponding object application of described combination touch operation, to carry out described application operating command information.At this, those skilled in the art will be understood that " continuing " refers between each step of subscriber equipment 1 and are constantly combined respectively determining and carrying out of the obtaining of touch operation, application operating command information, until subscriber equipment 1 stops obtaining the combination touch operation in a long time.
Preferably, in step S2, subscriber equipment 1 also can, according to described combination touch operation, in conjunction with the application related information of described object application, be determined the application operating command information corresponding with described combination touch operation; Wherein, described application related information comprises following at least any one:
The application type information of the corresponding object application of-described combination touch operation;
Application simple crosscorrelation information in-described combination touch operation between the corresponding object application of different touch operation.
For example, when described application related information comprises the application type information of the corresponding object application of described combination touch operation, at this, described application type information includes but not limited to as video, webpage, picture, app etc., the object application of different application type, the corresponding application operating instruction of like combinations touch operation difference, as hypothesis both can mean video fast forward at touch-screen right half-court territory adopting consecutive click chemical reaction or slip to the right, also can mean that picture amplifies, both can mean at touch-screen left half-court territory adopting consecutive click chemical reaction or slip left that video fell back, also can mean that picture dwindles, as supposed, user A is by its subscriber equipment 1 browsing pictures photo1, in step S1, subscriber equipment 1 gets user A and only carries out twice single-click operation in the territory, right half-court of touch-screen quick (completing in as 2 seconds), in step S2, the combination touch operation that subscriber equipment 1 forms according to this twice single-click touch operation, application type information " picture " in conjunction with the corresponding object application of this combination touch operation picture photo1, determine that the application operating command information corresponding with described combination touch operation is for amplifying picture photo1, as picture photo1 is enlarged into to original 2 times.
For another example, during application simple crosscorrelation information in described combination touch operation between the application of the corresponding object of different touch operation, suppose in step S1, subscriber equipment 1 gets user A and at first by the touch-screen of subscriber equipment 1, has clicked app as " transfer files " button in the qq client, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of video file waiting for transmission " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, there is application simple crosscorrelation information between " transfer files " button in this combination touch operation in the twice corresponding object application of touch operation qq client and " video file " A Dream of Red Mansions the 6th collection " ", as " transfer files " button by the qq client can transmitting video files " A Dream of Red Mansions the 6th collection ", in step S2, the combination touch operation that subscriber equipment 1 forms according to this twice single-click touch operation, in conjunction with the application simple crosscorrelation information between the corresponding object application of different touch operation in this combination touch operation, determine that the application operating command information corresponding with described combination touch operation is transmitting video files " A Dream of Red Mansions the 6th collection ", for another example, suppose in step S1, subscriber equipment 1 gets user A and at first by the touch-screen of subscriber equipment 1, has clicked video player storm wind sound shadow shortcut, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of txt file to be opened " A Dream of Red Mansions appreciation " by the touch-screen of subscriber equipment 1, do not there is application simple crosscorrelation information in this combination touch operation between twice corresponding object application of touch operation " video player storm wind sound shadow shortcut " and " txt file " A Dream of Red Mansions appreciation " ", can't open " txt file " A Dream of Red Mansions appreciation " " by " video player storm wind sound shadow shortcut ", in step S2, the combination touch operation that subscriber equipment 1 forms according to this twice single-click touch operation, in conjunction with the application simple crosscorrelation information between the corresponding object application of different touch operation in this combination touch operation, determine that the application operating command information corresponding with described combination touch operation be not for opening " txt file " A Dream of Red Mansions appreciation " ", and return to wrong application operating instruction.
Those skilled in the art will be understood that the above-mentioned mode of determining the application operating command information in conjunction with described application related information is only for for example; other existing or modes of determining the application operating command information in conjunction with described application related information that may occur from now on are as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
More preferably, when described application related information comprises the application simple crosscorrelation information between the corresponding object application of different touch operation in described combination touch operation, the user establishes and also comprises that step S4(is not shown).Particularly, in step S4, subscriber equipment 1 is determined the application simple crosscorrelation information between the corresponding object application of described combination touch operation; Wherein, in step S2, subscriber equipment 1, according to described combination touch operation, in conjunction with described application simple crosscorrelation information, is determined the application operating command information corresponding with described combination touch operation.
Particularly, in step S4, subscriber equipment 1 is determined the application simple crosscorrelation information between the corresponding object application of different touch operation in described combination touch operation.At this, in step S4, subscriber equipment 1 determines that the mode of described application simple crosscorrelation information includes but not limited to following at least any one:
1) touch the apply property information of the corresponding object application of different touch operation in behaviour according to described combination, determine described application simple crosscorrelation information.At this, described apply property information include but not limited to as described in the application type information, application descriptor etc. of object application.For example, suppose in step S1, subscriber equipment 1 gets user A and at first by the touch-screen of subscriber equipment 1, has clicked application program word2003 shortcut, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of word file to be opened " A Dream of Red Mansions appreciation " by the touch-screen of subscriber equipment 1, in this combination touch operation last time the apply property information of the corresponding object of touch operation application " word2003 shortcut " as the application descriptor, be " Microsoft Office Word2003 ", target type is " application program ", and in this combination touch operation last time the apply property information of the corresponding object of touch operation application " word file " A Dream of Red Mansions appreciation " " as file type information, be Microsoft Word document (.doc), in step S4, subscriber equipment 1 can determine in this combination touch operation to have application simple crosscorrelation information between twice corresponding object application of touch operation, as application program word2003 can open word file " A Dream of Red Mansions appreciation ".
2) according to from the corresponding object of different touch operation in described combination touch operation, applying corresponding functional configuration information, determine described application simple crosscorrelation information.For example, suppose in step S1, subscriber equipment 1 gets user A and at first by the touch-screen of subscriber equipment 1, has clicked app as " transfer files " button in the qq client, then clicked again the combination touch operation of the touch operation formation of continuously different objects being applied for twice of video file waiting for transmission " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, in this combination touch operation last time functional configuration information corresponding to " transfer files " button in the corresponding object application of touch operation qq client be " transferring documents ", and the document of functional configuration information for being transmitted corresponding to the corresponding object application of time touch operation after in this combination touch operation " video file " A Dream of Red Mansions the 6th collection " ", in step S4, subscriber equipment 1 can determine in this combination touch operation to have application simple crosscorrelation information between twice corresponding object application of touch operation, as " transfer files " button by the qq client can transmitting video files " A Dream of Red Mansions the 6th collection ".
Those skilled in the art will be understood that the mode of above-mentioned definite described application simple crosscorrelation information is only for giving an example; the mode of other existing or definite described application simple crosscorrelation information that may occur from now on is as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
In step S2, subscriber equipment 1, according to described combination touch operation, in conjunction with described application simple crosscorrelation information, is determined the application operating command information corresponding with described combination touch operation.At this, in step S2, subscriber equipment 1 is determined the mode of described application operating command information and aforementioned in step S2 in conjunction with described application simple crosscorrelation information, subscriber equipment 1 determines that in conjunction with described application related information the mode of described application operating command information is identical or basic identical, during simple and clear, therefore again repeat no more, and be contained in this by reference.
Preferably, subscriber equipment 1 also is included in step S5, subscriber equipment 1(is not shown), particularly, in step S5, subscriber equipment 1 is by dynamic web page techniques such as ASP, JSP or PHP, or the communication mode of other agreements, as communication protocols such as http or https, the application operating object information that the described object application of operation is obtained offers described user.For example, suppose in step S2, subscriber equipment 1 determines that the application operating command information corresponding with described combination touch operation comprises in the in progress video of F.F. " A Dream of Red Mansions the 6th collects " not 20% of displaying video duration video, and in step S3, 1 pair of in progress video of subscriber equipment " A Dream of Red Mansions the 6th collection " has been carried out this application operating command information, be about in progress video " A Dream of Red Mansions the 6th collection " F.F. not displaying video duration video 20%, as suppose video " A Dream of Red Mansions the 6th collection " position, the current 20min of playing to place, also remain the 40min duration, the video after F.F. should play to 28min, in step S5, subscriber equipment 1 offers user A by the video pictures at 28min place.
Fig. 4 illustrate in accordance with a preferred embodiment of the present invention for carrying out the method flow diagram of application operating.
Wherein, comprise step S1 ', step S2 ' and step S3 ', wherein, step S1 ' comprises step S11 ', step S12 ' and step S13 '.Particularly, in step S11 ', subscriber equipment 1 obtains a plurality of touch operation that the user carries out on the touch input device of subscriber equipment; In step S12 ', subscriber equipment 1 detects the whether satisfied combination condition that combines touch operation that belongs to of described a plurality of touch operation; In step S13 ', subscriber equipment 1 will meet at least two touch operation of described combination condition as described combination touch operation in described a plurality of touches, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value; In step S2 ', subscriber equipment 1, according to described combination touch operation, is determined the application operating command information corresponding with described combination touch operation; In step S3 ', the corresponding object application of 1 pair of described combination touch operation of subscriber equipment, carry out described application operating command information.At this, step S2 ' is identical or basic identical with the content of corresponding step in Fig. 3 embodiment with step S3 ', for simplicity's sake, thus do not repeat them here, and comprise therewith by reference.
Particularly, in step S11 ', subscriber equipment 1 uses the electric signal of finger performed generations such as touch action on the touch-screen of subscriber equipment 1 by detecting and resolve the user, obtain a plurality of touch operation that the user carries out on the touch input device of subscriber equipment.For example, the subscriber equipment 1 of supposing user A is the electronic product with resistive touch screen, user A opens the video file Dream of the Red Mansion be stored in its subscriber equipment 1, want to watch video " A Dream of Red Mansions the 6th collection ", at first it clicked video player storm wind sound shadow shortcut by the touch-screen of subscriber equipment 1, then clicked again video file to be opened " A Dream of Red Mansions the 6th collection " by the touch-screen of subscriber equipment 1, to realize playing " A Dream of Red Mansions the 6th collection " by storm wind sound shadow, then, after a while, user A has drawn again one " || " on the touch-screen of subscriber equipment 1, correspondingly, in step S11 ', subscriber equipment 1 uses the finger electric signal that performed different touch operation actions produce on the touch-screen of subscriber equipment 1 by detecting and resolve the user, get a plurality of touch operation that this user carries out on the touch input device of subscriber equipment 1.
In step S12 ', subscriber equipment 1 detects the whether satisfied combination condition that combines touch operation that belongs to of described a plurality of touch operation; Preferably, described combination condition comprises following at least any one:
Execution time interval between-any two described touch operation is less than or equal to the assembly time threshold value;
The deadline of-adjacent two or more described touch operation is less than or equal to the scheduled duration threshold value;
Meet predetermined location relationship between the operation trace of-adjacent two or more described touch operation.
For example, when comprising execution time interval between any two described touch operation, described combination condition is less than or equal to the assembly time during threshold value, connect example, suppose that the execution time interval between the touch operation of the video file " A Dream of Red Mansions the 6th collects " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution was less than or equal to the assembly time threshold value as 3 seconds, and user A carries out the touch operation of clicking video file to be opened " A Dream of Red Mansions the 6th collection " and the execution time of carrying out between the touch operation of having drawn " || " on the touch-screen of subscriber equipment 1 is spaced apart 20min, be greater than the assembly time threshold value, in step S12 ', subscriber equipment 1 can judge the satisfied combination condition that combines touch operation that belongs to of touch operation of the touch operation of the click video player storm wind sound shadow shortcut that user A the carries out video file to be opened with the click of execution " A Dream of Red Mansions the 6th collection ", and the touch operation of clicking video file to be opened " A Dream of Red Mansions the 6th collection " has been drawn the satisfied combination condition that combines touch operation that belongs to of touch operation of " || " with execution on the touch-screen of subscriber equipment 1.
For another example, when described combination condition comprises that the deadline of adjacent two or more described touch operation is less than or equal to the scheduled duration threshold value, still connect example, the deadline of supposing the touch operation of the video file " A Dream of Red Mansions the 6th collects " that the touch operation of the click video player storm wind sound shadow shortcut that user A carries out is to be opened with the click of execution is within 5 seconds, to be less than the scheduled duration threshold value as 10 seconds, in step S12 ', subscriber equipment 1 can judge the satisfied combination condition that combines touch operation that belongs to of touch operation of the touch operation of the click video player storm wind sound shadow shortcut that user A the carries out video file to be opened with the click of execution " A Dream of Red Mansions the 6th collection ".
Also as, while between described combination condition comprises the operation trace of adjacent two or more described touch operation, meeting predetermined location relationship, as supposed, user A carries out has successively drawn two " | " on the touch-screen of subscriber equipment 1, and meet predetermined location relationship between the operation trace of this two " | " as " || ",, in step S12 ', subscriber equipment 1 can judge these adjacent two the satisfied combination conditions that combine touch operation that belong to of touch operation of drawing " | ".
Those skilled in the art will be understood that whether the described a plurality of touch operation of above-mentioned detection meet the mode that belongs to the combination condition that combines touch operation is only for example; whether the described a plurality of touch operation of other detections existing or that may occur from now on meet the mode that belongs to the combination condition that combines touch operation as applicable to the present invention; also should be included in protection domain of the present invention, and be contained in this with way of reference.
Those skilled in the art will be understood that in step S12 ', and whether subscriber equipment 1 also can detect according to the combination of one or more combination conditions of combinations thereof condition described a plurality of touch operation and meet and belong to the combination condition that combines touch operation.
In step S13 ', subscriber equipment 1 will meet at least two touch operation of described combination condition as described combination touch operation in described a plurality of touches, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value.For example, suppose in step S12 ', the satisfied combination condition that combines touch operation that belongs to of touch operation of the video file " A Dream of Red Mansions the 6th collection " that the touch operation of the click video player storm wind sound shadow shortcut that subscriber equipment 1 judgement user A carries out and the click of execution are to be opened, in step S13 ', subscriber equipment 1 is using these two touch operation as described combination touch operation, wherein, in described combination touch operation, the execution time interval between any two touch operation is greater than the operating interval threshold value.
It should be noted that the present invention can be implemented in the assembly of software and/or software and hardware, for example, can adopt special IC (ASIC), general purpose computing machine or any other similar hardware device to realize.In one embodiment, software program of the present invention can carry out to realize step mentioned above or function by processor.Similarly, software program of the present invention (comprising relevant data structure) can be stored in computer readable recording medium storing program for performing, for example, and RAM storer, magnetic or CD-ROM driver or flexible plastic disc and similar devices.In addition, steps more of the present invention or function can adopt hardware to realize, for example, thereby as coordinate the circuit of carrying out each step or function with processor.
In addition, a part of the present invention can be applied to computer program, and for example computer program instructions, when it is carried out by computing machine, by the operation of this computing machine, can call or provide the method according to this invention and/or technical scheme.And call the programmed instruction of method of the present invention, may be stored in fixing or movably in recording medium, and/or be transmitted by the data stream in broadcast or other signal bearing medias, and/or be stored in the working storage of the computer equipment moved according to described programmed instruction.At this, comprise according to one embodiment of present invention a device, this device comprises storer for storing computer program instructions and for the processor of execution of program instructions, wherein, when this computer program instructions is carried out by this processor, trigger this device operation based on the aforementioned method according to a plurality of embodiment of the present invention and/or technical scheme.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned example embodiment, and in the situation that do not deviate from spirit of the present invention or essential characteristic, can realize the present invention with other concrete form.Therefore, no matter from which point, all should regard embodiment as exemplary, and be nonrestrictive, scope of the present invention is limited by claims rather than above-mentioned explanation, therefore is intended to be included in the present invention dropping on the implication that is equal to important document of claim and all changes in scope.Any Reference numeral in claim should be considered as limit related claim.In addition, obviously other unit or step do not got rid of in " comprising " word, and odd number is not got rid of plural number.A plurality of unit of stating in the device claim or device also can be realized by software or hardware by a unit or device.The first, the second word such as grade is used for meaning title, and does not mean any specific order.