Movatterモバイル変換


[0]ホーム

URL:


CN110456979A - For showing equipment, method and the graphic user interface that can indicate in background - Google Patents

For showing equipment, method and the graphic user interface that can indicate in background
Download PDF

Info

Publication number
CN110456979A
CN110456979ACN201910756761.2ACN201910756761ACN110456979ACN 110456979 ACN110456979 ACN 110456979ACN 201910756761 ACN201910756761 ACN 201910756761ACN 110456979 ACN110456979 ACN 110456979A
Authority
CN
China
Prior art keywords
indicate
content
value
show
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910756761.2A
Other languages
Chinese (zh)
Other versions
CN110456979B (en
Inventor
W·S·万
C·G·卡鲁纳姆尼
M·阿朗索鲁伊斯
B·西查诺斯基
B·E·尼尔森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DKPA201770711Aexternal-prioritypatent/DK179931B1/en
Application filed by Apple IncfiledCriticalApple Inc
Publication of CN110456979ApublicationCriticalpatent/CN110456979A/en
Application grantedgrantedCritical
Publication of CN110456979BpublicationCriticalpatent/CN110456979B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

This disclosure relates to for showing equipment, method and the graphic user interface that can be indicated in background.Electronic equipment has display and touch sensitive surface, shows content over the display and shows and can indicate.Showing can indicate to be shown in a part of content;The value for showing the same display attribute that can be indicated is determined based on the value of the display properties of a part for showing the content that can be indicated;And allow the value of the display properties of content to change within the scope of the first value and constrain to show that the value for the display properties that can be indicated changes within the scope of the second value less than the first value range;When showing content and showing can indicate, equipment detection shows the cosmetic variation for the content that can be indicated and in response to detecting that the cosmetic variation for the content that can be indicated is shown in display, the appearance that can be indicated is shown in equipment change, include: to have reduced/increased according to the value for the display properties for determining content, increases/reduce the value for showing the display properties that can be indicated according to the amplitude of variation of the value of the display properties of content and second value range.

Description

For showing equipment, method and the graphic user interface that can indicate in background
The application is that the applying date is entitled " for carrying on the back application No. is 20188000152.8 on January 25th, 2018Show equipment, method and the graphic user interface that can be indicated on scape " application for a patent for invention divisional application.
Technical field
Present invention relates generally to the electronic equipments with display and touch sensitive surface, including but not limited in its touch-sensitive displayScreen display virtually shows the electronic equipment that can indicate (for example, control, indicator and vision guide etc.).
Background technique
Use in recent years significant growth of the touch sensitive surface as the input equipment of computer and other electronic computing devices.Exemplary touch sensitive surface includes touch tablet and touch-screen display.Such surface is widely used for manipulating user circle on displayFace and object therein.Exemplary user interface object include digital picture, video, text, icon and control element (such as,Button) and other figures.
Electronic computing device usually shows virtual control or vision guide on its display.For example, can activate and manipulateKeyboard, menu, dialog box, alarm and other controls (for example, passing through touch input) so that portable electronic device (for example,Smart phone, tablet computer or laptop) on execute operation.Indicator and vision guide can be covered on background (for example, answeringWith the user interface of program or the user interface of operating system) on, pass associated with the specific region of background or screen is providedIn the input type that can be provided that and/or the visual cues for the action type that can be performed.
For showing that the existing method of control, indicator and vision guide may be more troublesome and inefficient.For example, control,Indicator and vision guide may cause unnecessary interference when user manipulates user interface to user, or relative to backgroundNot clear enough or prominent, so that user's mistake and user be caused to be obscured when user interacts with equipment, this can also be to the energy of equipmentConsumption has a negative impact.This later regard is especially important in battery-driven equipment.
In addition, it is certain form of show can indicate to be shown in various backgrounds and content, sometimes extend the time inDo not move.Therefore, display can express in use for some time shows the afterimage (or image retention) that can be indicated.It reduces and eliminatesDisplay image retention is the continual challenge that display device manufacturer faces.Solve the problems, such as that this some existing methods (such as, introduce screenCurtain protective program or flashing icon) it is not satisfactory solution, because they have side effect (for example, leading to eyeEyeball fatigue, dispersion attention etc.) and lack effect (for example, only in equipment free time Shi Keyong) in many cases.
Summary of the invention
Therefore, it is necessary to have it is prominent but it is less it is distractive show can indicate (for example, Virtual Space, indicator and viewFeel guidance) electronic equipment, help to provide enough visual difference degree, thus guide user provide needed for input with realityIt is existing desired as a result, attention without unnecessarily dispersion user to the content shown in application program or system user interfacePower.In addition, for extend in the time be displayed without it is mobile it is certain show and can indicate, need to reduce or eliminate screen image retentionMode show and can indicate to show.
In addition, either automatic still to input in response to user, showing can indicate as background content constantly changes at any timeAppearance be also required to adapt dynamically to, so as to continue keep efficiently and effectively with for the above purpose.In particular, being used as triggeringThe showing of the control of the gesture of some common system functions or vision guide can indicate to be displayed in many different scenes (for example,In the user interface of different application and operating system).Sometimes, giving in scene shows the background that can be indicated (for example, canThe content of rolling, fast-changing interior perhaps uncertain content) also dynamically change, further requirement, which is shown, can indicate outerSight is constantly adapted to show the cosmetic variation that can indicate the rear backdrop being initially shown in background.It is this to show that the example that indicated isIt is used to indicate the system-level of the initiation region of home/ multitask gesture to show and can indicate, causes to release the application journey currently shownSequence user interface simultaneously shows home on-screen user interface, or releases the system information interface of similar cover (for example, notice centerOr lock-screen user interface) and show the user interface (for example, application program user interface or home screen) previously shown.
In addition, sometimes, after showing and can indicate to be shown on application program user interface, operation feelings occur in application programScape variation, this can qualitatively change user by with show a possibility that capable of indicating to interact or needing to show the vision guide that can be indicated.InIn this case, need to adjust holding show can indicate protrusion and to show the balance between capable of indicating less to take sb's mind off sth,To maintain the validity and efficiency of user interface.
In addition, for extend in the time be displayed without it is mobile it is certain show and can indicate, need to reduce or eliminate and shieldThe mode of curtain image retention is shown and can be indicated to show.
The demand, which needs new method and interface, to be shown and can indicate and adjust in background and show and can indicate showing (for example,Virtual control, indicator and vision guide) appearance.This kind of equipment, method and interface can be reduced to cognition caused by user security riskIt bears and generates more effective man-machine interface.In addition, this kind of equipment, method and interface can reduce or eliminate screen image retention, fromAnd it reduces maintenance of equipment cost and extends service life of equipment.
In some embodiments, which is desktop computer.In some embodiments, which is portable(for example, laptop, tablet computer or handheld device).In some embodiments, which is personal electronic equipments (exampleSuch as, wearable electronic, such as wrist-watch).In some embodiments, which has touch tablet.In some embodimentsIn, which has touch-sensitive display (also referred to as " touch screen " or " touch-screen display ").In some embodiments, this setsIt is standby that there is graphic user interface (GUI), one or more processors, memory and one or more modules, be stored in storageWith the program or instruction set for executing multiple functions in device.In some embodiments, user mainly passes through stylus and/or handGesture in abutment and touch sensitive surface is interacted with GUI.In some embodiments, function optionally includes imageEditor, drawing, presentation, word processing, electrical form production, game, phone, video conference, Email, instant message, forgingRefining support, digital filming, digital video recordings, web page browsing, digital music broadcasting, note taking, digital video play and areIrrespective of size operation (such as, shows home screen, locking device, display of system level notification screen, display of system level control panel userInterface etc.).Executable instruction for executing these functions be optionally included in non-transient computer readable storage medium or byIt is configured in other computer program products being performed by one or more processors.
According to some embodiments, a kind of method includes: at the equipment with display and touch sensitive surface: in displayUpper display content and show and can indicate, in which: showing can indicate to be shown in a part of content;It can be indicated based on showing on itThe value of display properties of described a part of content determine the value for showing the same display attribute that can be indicated;And allow contentThe value of display properties change within the scope of the first value, and constrain the value for showing the display properties that can be indicated within the scope of second valueVariation, the second value range is less than the first value range;When showing content and showing can indicate, detects and show the content that can be indicatedCosmetic variation;And in response to detecting that the cosmetic variation for the content that can be indicated is shown in display, the appearance that can be indicated is shown in change, wrapsIt includes: having been reduced according to the value for the display properties for determining content, according to the amplitude of variation and second value of the value of the display properties of contentRange shows the value for the display properties that can be indicated to increase;And increased according to the value for the display properties for determining content, according to interiorThe amplitude of variation and second value range of the value of the display properties of appearance reduces the value for showing the display properties that can be indicated.
According to some embodiments, a kind of method includes: at the equipment with display and touch sensitive surface: display applicationThe user interface of program;When showing the user interface of application program in the first pattern, display has first on a user interfaceShowing for appearance can indicate, in which: showing can indicate to be shown in a part of user interface, and showing with the first appearance can tableThe value of the one group of one or more display properties shown according to first group of one or more rule, according to be located at show can indicate belowThe variation of the value of one group of one or more display properties of the part of user interface and change;When in the use shown in the first patternDisplay has the showing when can indicate of the first appearance in a part at family interface, and detection from show user interface transformation in the first patternFor the request for showing user interface in a second mode;And in response to detecting the request: showing user interface in a second mode;And in the user interface shown in a second mode display have showing for the second appearance can indicate, in which: according to first groupSecond group of different one or more rule of one or more rules, shows one group one for capable of indicating or more with the second appearanceThe value of a display properties shows one group of one or more display properties of a part for the user interface that can indicate lower section according to being located atValue variation and change;
According to some embodiments, a kind of method includes: at the equipment with display and touch sensitive surface: in displayUpper display content and show and can indicate, in which: showing can indicate to be shown in a part of content;It can be indicated based on showing on itThe value of display properties of described a part of content determine the value for showing the same display attribute that can be indicated;And allow contentThe value of display properties change within the scope of the first value, and constrain and show that the value of the display properties that can be indicated can indicate appearance showingIt is worth variation in range, this, which shows, can indicate appearance value range less than the first value range;When display content and shows when can indicate and work asShow that the cosmetic variation for the content that can be indicated is shown in detection when can indicate that appearance value range is second value range;And in response toDetect that the cosmetic variation for the content that can be indicated is shown in display, the appearance that can be indicated is shown in change, comprising: according to the appearance for determining contentVariation meets range switching standards: will show can indicate that appearance value range shift as third value range, wherein third value range and theTwo-value range is different, and third value range is less than the first value range;And according to the display category for showing the content that can be indicatedProperty value change and show the value of the same display attribute that can be indicated, wherein showing that the display properties that can be indicated is confined to showing and can indicateChange within the scope of appearance value;And range switching standards are unsatisfactory for according to the cosmetic variation for determining content, showing according to display can tableThe value of the display properties for the content shown changes the value for showing the same display attribute that can be indicated, while will show and can indicate appearance value rangeRemain second value range.
According to some embodiments, a kind of electronic equipment includes: display;Touch sensitive surface;Optionally one or more is depositedReservoir, for detecting and the contact strength of touch sensitive surface;Optionally one or more tactile output generators;At one or moreManage device;And memory, the memory store one or more programs;The one or more program is configured to by one or moreA processor executes, and one or more programs include the operation for executing or causing to execute any method described hereinInstruction.According to some embodiments, a kind of non-transient computer readable storage medium is stored with instruction wherein, these instructionsWhen being executed by electronic equipment, so that the equipment executes the operation of any method as described herein or makes any side described hereinThe operation of method is performed, and the electronic equipment has display, touch sensitive surface, for detecting and the contact strength of touch sensitive surfaceOptionally one or more sensors, and optionally one or more tactile output generators.According to some embodiments, positionIt include shown one or more elements in any method described herein in the graphic user interface on electronic equipment, this oneA or multiple element in response to input be updated, the electronic equipment have display, touch sensitive surface, for detect with it is touch-sensitiveThe optionally one or more sensors of the contact strength on surface, optionally one or more tactile output generators, memoryWith the one or more processors for executing one or more programs stored in memory, any side as described hereinDescribed in method.According to some embodiments, a kind of electronic equipment include: display, touch sensitive surface, for detect with it is touch-sensitiveThe optional one or more sensors of the contact strength on surface, and optionally one or more tactile output generators.WithAnd for execute or cause execute methods described herein in either method operation device.According to some embodiments, useInformation processing equipment in electronic equipment includes operation for executing any method as described herein or makes described hereinAny method the device that is performed of operation, the electronic equipment has display, touch sensitive surface, for detecting and touch-sensitive tableThe optionally one or more sensors of the contact strength in face, and optionally one or more tactile output generators.
Therefore, it provides to electronic equipment for carrying out navigation between user interface and interacting with control objectImproved method and interface, to improve the validity of these equipment, efficiency and user satisfaction, the electronic equipment has aobviousShow device, touch sensitive surface, for detecting and the optionally one or more sensors of the contact strength of touch sensitive surface, optionally oneOr multiple tactile output generators, optionally one or more apparatus orientation sensors, and optionally audio system.This kind of sideMethod and interface can supplement or be substituted for show the conventional method that can be indicated in background.
Detailed description of the invention
The various embodiments in order to better understand should refer to following specific embodiment in conjunction with the following drawings,Wherein similar drawing reference numeral indicates corresponding part in all the appended drawings.
This patent or patent application document include the attached drawing that an at least width colour is drawn.It is requesting and is paying necessary expensesUnder the premise of, Patent Office will provide the copy with one or more color drawings of this patent or patent application publication.
Figure 1A is the block diagram for showing the portable multifunction device with touch-sensitive display according to some embodiments.
Figure 1B is the block diagram for showing the example components for event handling according to some embodiments.
Fig. 2 shows the portable multifunction devices with touch screen according to some embodiments.
Fig. 3 is the block diagram according to the exemplary multifunctional equipment with display and touch sensitive surface of some embodiments.
Fig. 4 A shows the showing for the application menu on portable multifunction device according to some embodimentsExample property user interface.
Fig. 4 B shows setting with the multi-functional of touch sensitive surface that display separates for having according to some embodimentsStandby exemplary user interface.
It includes showing energy with the appearance for being adapted to background appearance that Fig. 5 A to Fig. 5 D, which is shown according to some embodiments,The exemplary user interface of expression.
Fig. 5 E, which is shown, showing energy table for generating in Fig. 5 A to Fig. 5 D based on lower section content according to some embodimentsThe filter for the appearance shown.
Fig. 5 F is shown according to some embodiments for executing the exemplary reverse curve of reversion shown in Fig. 5 E.
Fig. 5 G to Fig. 5 K, which is shown, to be shown according to the first of some embodiments appearance type can be indicated (for example, " dark " shows energyIndicate type) show the cosmetic variation that can be indicated.
Fig. 5 L to Fig. 5 P, which is shown, to be shown according to the second of some embodiments appearance type can be indicated (for example, " bright " shows energyIndicate type) show the cosmetic variation that can be indicated.
Fig. 5 Q shows two kinds of in the case where the identical change of generation in the background according to some embodiments showCan indicate appearance type shows the difference in appearance that can be indicated.
Fig. 5 R show according to some embodiments show the display properties that can be indicated and hint can indicate appearance type andThe bright value range for showing the lower section content that can indicate appearance type and inverse relation.
Fig. 5 S to Fig. 5 AA shows the user interface according to some embodiments, the user interface include have in response toWhat the cosmetic variation of background and operation mode associated with background changed shows and can indicate.
Fig. 5 AB to Fig. 5 AC is shown can indicate according to showing for the backgrounds under different operation modes of some embodimentsDifference in appearance.
Fig. 5 AD shows the user interface according to some embodiments, which includes being based on lower section content at any timeBetween change and showing that can indicate dynamically to switch between appearance type show and can indicate.
Fig. 5 AE show according to some embodiments show the display properties that can be indicated and it is bright show can indicate appearance type,Implying can indicate that appearance type and transformation show the value range and inverse relation of the lower section content that can indicate appearance type.
Fig. 5 AF, which is shown, can indicate that appearance type can be indicated from hint according to showing by multiple transformations for some embodimentsAppearance type to it is bright show can indicate the gradually transfer of appearance type.
Fig. 5 AG to Fig. 5 AK is to show that the display properties that can be indicated is different from shown in Fig. 5 AF to show the lower section that can indicate typeThe amplification copy of the inverse relation of content.
Fig. 6 A to Fig. 6 C is to show to show energy table according to changing according to the cosmetic variation of lower section content for some embodimentsThe flow chart of the method for the appearance shown.
Fig. 7 A to Fig. 7 E is to show to show and can indicate according to the cosmetic variation and display according to lower section content of some schemesThe patterns of change of user interface changes the flow chart of the method for showing the appearance that can be indicated.
Fig. 8 A to Fig. 8 F is to show to show energy table according to changing according to the cosmetic variation of lower section content for some embodimentsThe appearance shown and show the flow chart that can indicate the method for appearance type.
Specific embodiment
Showing for showing according to conventional methods can indicate usually visually to take sb's mind off sth and user interface may be made mixedDisorderly.In addition, showing that the appearance that can be indicated is usually fixed and being not suitable for the variation occurred in the content of lower section or lower section userThe operation mode at interface changes.Following embodiments disclose it is a kind of shown based on the variation of lower section content and change show can tableThe mode for the appearance shown, wherein the determination that is reversed to of the display properties of lower section content shows that the value for the same display attribute that can be indicated mentionsBasis is supplied.In addition, being the value range of the display properties of lower section content by the value range constraint for showing the display properties that can be indicatedSubrange.For example, by show the brightness that can be indicated different value range assign for different integral brightness levels background (for example,Dark background and bright background) selected difference is shown that appearance type can be indicated (for example, appearance type can be indicated and bright show can table by implyingShow appearance type).This improves the visibility that shows and can indicate relative to variation background, unsuitable dry without causing to userIt disturbs.In some embodiments, depending on showing the operation mode of the user interface that can be indicated, show the appearance that can indicate according toThe rule of difference group changes with the appearance of background, thus provide it is a kind of adjust need to maintain to show the visibility that can indicate andIt needs to reduce by showing the balance that can be indicated between caused inappropriate dispersion attention when the operational scenarios that can be indicated variation showingMode.In some embodiments, showing the appearance that can be indicated and showing can indicate appearance type all according to the appearance of lower section contentVariation (including transient change and at any time accumulated change) and change.
Following figure 1 A provides the description to example devices to Figure 1B, Fig. 2 and Fig. 3.Fig. 4 A to Fig. 4 B, Fig. 5 A extremely scheme5D, Fig. 5 G to Fig. 5 P, Fig. 5 S to Fig. 5 AA and 5AD show the appearance having according to some embodiments according to lower section contentChange and change its appearance shows the exemplary user interface that can be indicated.Fig. 5 E, Fig. 5 Q, Fig. 5 R, Fig. 5 AB, Fig. 5 AC and 5AEIt is shown to Fig. 5 AK and shows the difference in appearance that can be indicated and for generating 5A to Fig. 5 D, Fig. 5 G extremely according to some embodimentsShow the lower section appearance value range that can be indicated shown in Fig. 5 P, Fig. 5 S to Fig. 5 AA and Fig. 5 AD.Fig. 6 A to Fig. 6 C, Fig. 7 A extremely scheme7E and Fig. 8 A to Fig. 8 F is the flow chart for showing the method for the appearance that can be indicated according to the display and adjusting of some embodiments.FigureUser interface shown in 4A to Fig. 4 B and Fig. 5 A to Fig. 5 AK is shown and can indicate appearance and value range for explanatory diagram 6A to schemingProcess in 6C, Fig. 7 A to Fig. 7 E and Fig. 8 A to Fig. 8 F.
Example devices
Reference will now be made in detail to embodiment, the example of these embodiments is shown in the accompanying drawings.Following retouches in detailMany details are shown in stating, are fully understood in order to provide to various described embodiments.But to this fieldThose of ordinary skill is evident that various described embodiments can be without these specific detailsIt is practiced.In other cases, well-known method, process, component, circuit and network are not described in detail, thus notIt can unnecessarily make the various aspects of embodiment hard to understand.
Although will be further understood that in some cases, term " first ", " second " etc. are various for describing hereinElement, but these elements should not be limited by these terms.These terms are only intended to an element and another element regionIt separates.For example, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact, andThe range of various described embodiments is not departed from.First contact and the second contact are contact, but they are not sameContact, unless the context clearly.
Term used in the description to the various embodiments is intended merely to description particular implementation side hereinThe purpose of case, and be not intended to be limiting.Such as in the description and the appended claims in the various embodimentsUsed "one" is intended to also include plural form with "the" singular like that, indicates unless the context clearly.It will be further understood that term "and/or" used herein refer to and cover in associated listed project oneAny and all possible combinations of a or multiple projects.It will be further understood that term " includes " (" includes "," including ", " comprises " and/or " comprising ") it specifies to exist when using in the present specification and be statedFeature, integer, step, operations, elements, and/or components, but it is not excluded that in the presence of or add other one or more features, wholeNumber, step, operation, component, assembly unit and/or its grouping.
As used herein, based on context, term " if " be optionally construed as to imply that " and when ... when " or" ... when " or " in response to determination " or " in response to detection ".Similarly, based on context, phrase " if it is determined that ... " orIf " detecting [condition or event stated] " is optionally interpreted to refer to " when in determination ... " or " in response to trueIt is fixed ... " or " when detecting [condition or event stated] " or " in response to detecting [the condition or thing statedPart] ".
This document describes electronic equipments, the embodiment party of the user interface of such equipment and the correlated process using such equipmentCase.In some embodiments, which is also portable comprising other function such as PDA and/or music player functionalityCommunication equipment, such as mobile phone.The exemplary implementation scheme of portable multifunction device includes but is not limited to come from AppleInc. (Cupertino, California)iPodWithEquipment.Optionally just using otherTake formula electronic equipment, such as laptop computer or plate with touch sensitive surface (for example, touch-screen display and/or touch tablet)Computer.It is to be further understood that in some embodiments, which is not portable communication device, but there is touch-sensitive tableThe desktop computer in face (for example, touch-screen display and/or touch tablet).
In the following discussion, a kind of electronic equipment including display and touch sensitive surface is described.However, should manageSolution, the electronic equipment optionally include other one or more physical user-interface devices, such as physical keyboard, mouse and/orControl stick.
The equipment usually supports various application programs, one or more application programs in such as following application program: noteApplication program, word-processing application, website creation application program, disk volume is presented in notes application program, drawing application programCollect application program, spreadsheet applications, game application, telephony application, videoconference application, electronics postalApplication program, photo management application program, digital camera applications journey are supported in part application program, instant message application program, body-buildingSequence, digital camera applications program, web page browsing application program, digital music player application and/or digital video are broadcastPut device application program.
The physical user-interface device that the various application programs executed in equipment optionally use at least one general, it is allSuch as touch sensitive surface.One or more functions of touch sensitive surface and the corresponding informance being displayed in equipment are optionally for differenceApplication program is adjusted and/or changes, and/or is adjusted and/or changes in corresponding application programs.In this way, equipment sharesPhysical structure (such as touch sensitive surface) supports various answer optionally with intuitive for a user and clear user interfaceUse program.
The embodiment that attention is drawn to the portable device with touch-sensitive display.Figure 1A is shown according to oneThe block diagram of the portable multifunction device 100 with touch-sensitive display system 112 of a little embodiments.Touch-sensitive display system112 are called " touch screen " sometimes for convenient, and are called touch-sensitive display for short sometimes.Equipment 100 includes memory102 (it optionally includes one or more computer readable storage mediums), Memory Controller 122, one or more processingUnit (CPU) 120, peripheral device interface 118, RF circuit 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, input/Export (I/O) subsystem 106, other inputs or control equipment 116 and outside port 124.Equipment 100 optionally includes oneOr multiple optical sensors 164.Equipment 100 is optionally included for detection device 100 (for example, touch sensitive surface, such as equipment100 touch-sensitive display system 112) on contact strength one or more intensity sensors 165.Equipment 100 is optionally wrappedOne or more tactile output generators 167 for generating tactile output on the appliance 100 are included (for example, all in touch sensitive surfaceAs generated tactile output in the touch-sensitive display system 112 of equipment 100 or the touch tablet 355 of equipment 300).These components are optionalGround passes through one or more communication bus or signal wire 103 is communicated.
As used in the specification and claims, term " tactile output ", which refers to, to utilize user's by userThe equipment that sense of touch detects is opposite relative to physical displacement, the component (for example, touch sensitive surface) of equipment of the previous position of equipmentIn the displacement relative to the mass center of equipment of physical displacement or component of another component (for example, shell) of equipment.For example, InThe component and user of equipment or equipment connect to sensitive surface (for example, other parts of finger, palm or user's hand) is touchedIn the case where touching, the tactile output generated by physical displacement will be construed to sense of touch by user, which corresponds to equipment or setThe variation of the physical features of standby component perceived.For example, the movement of touch sensitive surface (for example, touch-sensitive display or Trackpad)" pressing click " or " unclamp and click " to physical actuation button is optionally construed to by user.In some cases, user willFeel sense of touch, such as " click is pressed " or " unclamp and click ", even if being physically pressed (example by the movement of userSuch as, be shifted) physical actuation button associated with touch sensitive surface when not moving.For another example, though touch sensitive surface lightWhen slippery is unchanged, the movement of touch sensitive surface also optionally can be explained by user or be sensed as touch sensitive surface " roughness ".ThoughIndividuation sensory perception by user is limited such explanation of touch by right user, but is known many sense organs of touchFeel is that most users are shared.Therefore, when tactile output is described as the specific sensory perception corresponding to user (for example, " pressingLower click ", " unclamp click ", " roughness ") when, unless otherwise stated, otherwise tactile output generated correspond to equipment orThe physical displacement of its component, the physical displacement will generate the sensory perception of typical (or common) user.It is defeated using tactileTouch feedback is provided a user out and enhances the operability of equipment, and keeps user's equipment interface more efficient (for example, passing through sideUser's mistake when user being helped to provide input appropriate and reduce operation equipment/interact with equipment), thus can by using familyMore rapidly and efficiently uses equipment and further reduce electricity usage and extend the battery life of equipment.
In some embodiments, tactile output mode specifies the characteristic of tactile output, such as amplitude of tactile output, touchingFeel the duration of the shape of the moving wave shape of output, the frequency of tactile output, and/or tactile output.
When equipment via the mobile one or more tactiles to generate tactile output of removable mass are exported (for example, send outRaw device) when generating the tactile output with different tactile output modes, tactile output can be in the user of gripping or touch apparatusGenerate different senses of touch.Although the perception that the sense organ of user exports tactile based on user, most users will be recognized and be setThe variation of the waveform, frequency and amplitude of the standby tactile output generated.Therefore, waveform, frequency and amplitude can be conditioned with to userInstruction has performed different operation.In this way, have be designed, select and/or be used for simulate given environment (e.g., includingThe user interface of graphic feature and object, the analog physical environment with virtual boundary and virtual objects, have physical boundary andThe actual physical situation of physical object, and/or the combination of any of the above person) in Properties of Objects (for example, size, material, againAmount, rigidity, smoothness etc.);Behavior (such as oscillation, displacement, acceleration, rotation, stretching, extension etc.);And/or interaction is (for example, colliding, being viscousIt is attached, repel, attract, friction etc.) tactile output mode tactile output will be provided in some cases for user it is helpfulFeedback reduces input error and improves the efficiency of operation of the user to equipment.In addition, tactile output is optionally generated as pairThe unrelated feedback of Ying Yuyu institute analog physical characteristic (such as input threshold value or Object Selection).Such tactile output is in some casesUnder helpful feedback will be provided for user, reduce input error and improve the efficiency of operation of the user to equipment.
In some embodiments, the tactile output with suitable tactile output mode is served as in the user interface or is being setThe prompt of events of interest occurs behind standby middle screen.The example of events of interest includes providing in equipment or in user interfaceShow and can indicate the activation of (such as true or virtual push button or tumbler switch), request the success or failure operated, reach orBoundary in user interface, into new state, between objects switch input focus, activation new model, reach or pass throughInput threshold value, detection or a type of input of identification or gesture etc..In some embodiments, tactile output is provided to fillWhen about unless change direction or interrupt input be timely detected, otherwise what can be occurred will occur the warning of event or resultOr prompt.In other cases, tactile output be also used to abundant user experience, improve equipment to vision or dyskinesia orThe accessibility of the user of other accessibility demands and/or the efficiency and function for improving user interface and/or equipment.OptionallyTactile output and audio input and/or visual user interface change are compared, this further enhances user and user interfaceAnd/or when equipment interaction user experience, and be conducive to the more preferable biography of the information of state about user interface and/or equipmentIt is defeated, and this reduces input error and improves the efficiency of operation of the user to equipment.
It should be appreciated that equipment 100 is only an example of portable multifunction device, and equipment 100 optionally hasThere are components more more or fewer than shown component, optionally combines two or more components, or optionally there is thisThe different configurations of a little components or arrangement.Various parts shown in Figure 1A are in hardware, software, firmware or any combination of themImplement in (including one or more signal processing circuits and/or specific integrated circuit).
Memory 102 optionally includes high-speed random access memory, and also optionally includes nonvolatile memory,Such as one or more disk storage equipments, flash memory device or other non-volatile solid state memory equipment.Equipment100 other component (such as one or more CPU 120 and peripheral device interface 118) to the access of memory 102 optionallyIt is controlled by Memory Controller 122.
Peripheral device interface 118 can be used for the input peripheral of equipment and output peripheral equipment being couple to memory102 and one or more CPU 120.The operation of one or more processors 120 or execution are stored in various in memory 102Software program and/or instruction set, to execute the various functions of equipment 100 and handle data.
In some embodiments, peripheral device interface 118, one or more CPU 120 and Memory Controller 122Optionally realized on one single chip such as chip 104.In some other embodiments, they are optionally in independent chipUpper realization.
RF (radio frequency) circuit 108 sends and receivees the RF signal of also referred to as electromagnetic signal.RF circuit 108 turns electric signalIt is changed to electromagnetic signal/by electromagnetic signal and is converted to electric signal, and via electromagnetic signal and communication network and other communication equipmentsIt is communicated.RF circuit 108 optionally includes the well known circuit for executing these functions, including but not limited to aerial systemSystem, RF transceiver, one or more amplifiers, tuner, one or more oscillators, digital signal processor, encoding and decoding corePiece group, subscriber identity module (SIM) card, memory etc..RF circuit 108 comes and network and other optionally by wireless communicationEquipment is communicated, these networks are that such as internet (also referred to as WWW (WWW)), Intranet and/or wireless network are (allSuch as, cellular phone network, WLAN (LAN) and/or Metropolitan Area Network (MAN) (MAN)).The wireless communication optionally uses a variety of communicationsAny one of standard, agreement and technology, including but not limited to global system for mobile communications (GSM), enhanced data GSM feelingsScape (EDGE), high-speed downlink packet access (HSDPA), High Speed Uplink Packet access (HSUPA), evolution clear data(EV-DO), HSPA, HSPA+, double unit HSPA (DC-HSPDA), long term evolution (LTE), near-field communication (NFC), wideband code divisionMultiple access (W-CDMA), CDMA (CDMA), time division multiple acess (TDMA), bluetooth, Wireless Fidelity (Wi-Fi) are (for example, IEEE802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g and/or IEEE802.11n), internet protocol voice technology (VoIP), Wi-MAX, email protocol are (for example, internet message access protocol(IMAP) and/or post office protocol (POP)), instant message (for example, scalable message processing and there are agreement (XMPP), for i.e.When message and there is Session initiation Protocol (SIMPLE), instant message and the presence service (IMPS) using extension), and/or it is shortMessaging service (SMS) or include this document submission date also it is untapped go out communication protocol other are any appropriate logicalBelieve agreement.
Voicefrequency circuit 110, loudspeaker 111 and microphone 113 provide the audio interface between user and equipment 100.AudioCircuit 110 receives audio data from peripheral device interface 118, audio data is converted to electric signal, and electric signal transmission is arrivedLoudspeaker 111.Loudspeaker 111 converts electrical signals to the audible sound wave of the mankind.Voicefrequency circuit 110 is also received by microphone113 electric signals converted from sound wave.Voicefrequency circuit 110 converts electrical signals to audio data and is transferred to audio data outerPeripheral equipment interface 118 is for handling.Audio data is optionally retrieved from and/or is transmitted to storage by peripheral device interface 118Device 102 and/or RF circuit 108.In some embodiments, voicefrequency circuit 110 further includes earphone jack (for example, in Fig. 2212).Earphone jack provides the interface being located between voicefrequency circuit 110 and removable audio input/output peripheral equipment, shouldThe earphone or have output (for example, single head-receiver or ears that removable audio input/output peripheral equipment such as only exportsEarphone) and input both (for example, microphone) headset.
I/O subsystem 106 by the input/output peripheral equipment in equipment 100, such as touch-sensitive display system 112 and itsHe inputs or control equipment 116, couples with peripheral device interface 118.I/O subsystem 106 optionally includes display controller156, optical sensor controller 158, intensity sensor controller 159, tactile feedback controller 161 and for other inputOr one or more input controllers 160 of control equipment.One or more of input controllers 160 are from other inputs or controlThe reception of control equipment 116 electric signal/send other described inputs for electric signal or control equipment.Other input control apparatus 116Optionally include physical button (for example, pushing button, rocker buttons etc.), dial, slide switch, control stick, click wheel etc..In some alternative embodiments, one or more input controllers 160 are optionally coupled to any one of the following termsAny one of (or be not coupled to the following terms): keyboard, infrared port, USB port, stylus, and/or pointing device are such asMouse.One or more buttons (for example, 208 in Fig. 2) optionally include the sound for loudspeaker 111 and/or microphone 113Measure the up/down button of control.One or more buttons, which optionally include, pushes button (for example, 206 in Fig. 2).
Touch-sensitive display system 112 provides the input interface and output interface between equipment and user.Display controller 156Electric signal is received from touch-sensitive display system 112 and/or electric signal is sent to touch-sensitive display system 112.Touch-sensitive displaySystem 112 shows visual output to user.Visual output optionally includes figure, text, icon, video and theirs is anyIt combines (being referred to as " figure ").In some embodiments, some or all of visual output corresponds to user interface object.The example of user's interactive graphical user interface object include but is not limited to button, sliding block, icon, optional menu item, switch,Hyperlink or other users interface control.In some embodiments, some or all of visual output visual output is correspondingIn indicator and vision guide, the kind of input associated with the different zones of user interface or screen and/or operation is providedThe visual cues of class.The example of indicator and vision guide includes but is not limited to arrow, item, covering, spotlight or is designedFor other visually distinguishing region or the shapes for providing a user visual cues.As used herein, term " showing can indicate "Refer to the user's interactive graphics shown in background (for example, a part of application program user interface or system user interface)User interface object and/or indicator and vision guide.
Touch-sensitive display system 112 has the touch-sensitive table for receiving input from the user based on tactile and/or tactile contactFace, sensor or sensor group.Touch-sensitive display system 112 and display controller 156 are (any related in memory 102The module and/or instruction set of connection are together) detection touch-sensitive display system 112 on contact (and the contact any movement or inIt is disconnected), and the contact that will test be converted to user interface object (for example, one or more soft-key buttons, icon, webpage orImage) interaction, the user interface object is displayed in touch-sensitive display system 112.In some embodiments, it is touchingContact point between quick display system 112 and user corresponds to the finger or stylus of user.
Touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer displays)Technology or LED (light emitting diode) technology, but other display technologies are used in other embodiments.Touch-sensitive display system112 and display controller 156 optionally using in the currently known or later a variety of touch-sensing technologies that will be developed appointWhat technology and other proximity sensor arrays or for determine the one or more points contacted with touch-sensitive display system 112 itsHis element is including but not limited to capacitive, electric to detect contact and its any movement or interruption, a variety of touch-sensing technologiesResistive, infrared ray and surface acoustic wave technique.In some embodiments, using projection-type mutual capacitance detection technology, such asFrom Apple Inc.'s (Cupertino, California)iPodWithThe technology of middle discovery.
Touch-sensitive display system 112 is optionally with the video resolution for being more than 100dpi.In some embodiments, it touchesTouching screen video resolution is more than 400dpi (for example, 500dpi, 800dpi or bigger).User optionally uses any suitable objectBody or additives stylus, finger etc. are contacted with touch-sensitive display system 112.In some embodiments, by user interfaceIt is designed to work together with contact and gesture based on finger, since the contact area of finger on the touchscreen is larger, thisIt may be accurate not as good as the input based on stylus.In some embodiments, the rough input based on finger is converted essence by equipmentTrue pointer/cursor position or order is for executing the desired movement of user.
In some embodiments, in addition to a touch, equipment 100 optionally includes specific for activating or deactivatingThe touch tablet (not shown) of function.In some embodiments, touch tablet is the touch sensitive regions of equipment, different from touch screen, shouldTouch sensitive regions do not show visual output.Touch tablet is optionally the touch sensitive surface separated with touch-sensitive display system 112, eitherBy the extension for the touch sensitive surface that touch screen is formed.
Equipment 100 further includes the electric system 162 for powering for various parts.Electric system 162 optionally includes electricityPower management system, one or more power supply (for example, battery, alternating current (AC)), recharging system, power failure detection circuit,Power converter or inverter, power supply status indicator (for example, light emitting diode (LED)) and with the electricity in portable devicePower generates, managees, and distributes any other associated component.
Equipment 100 optionally further includes one or more optical sensors 164.Figure 1A show in I/O subsystem 106The optical sensor that optical sensor controller 158 couples.One or more optical sensors 164 optionally include Charged CoupleDevice (CCD) or complementary metal oxide semiconductor (CMOS) phototransistor.One or more optical sensors 164 are from environmentThe light projected by one or more lens is received, and converts light to indicate the data of image.In conjunction with image-forming module 143(being also designated as camera model), one or more optical sensors 164 optionally capture still image and/or video.SomeIn embodiment, optical sensor be located at equipment 100 with the opposite facing rear portion of touch-sensitive display system 112 on equipment frontOn, so that touch screen can be used as the view finder for still image and/or video image acquisition.In some embodiments,Another optical sensor is located on the front of equipment, to obtain the image of the user (for example, for self-timer, being used in userVideo conference etc. is carried out when watching other video conference participants on the touchscreen).
Equipment 100 optionally further includes one or more contact strength sensors 165.Figure 1A is shown and I/O subsystemThe contact strength sensor that intensity sensor controller 159 in 106 couples.One or more contact strength sensors 165 are appointedSelection of land includes one or more piezoresistive strain instrument, capacitive force transducer, electric force snesor, piezoelectric force transducer, opticsForce snesor, capacitive touch sensitive surfaces or other intensity sensors (for example, for measuring the contact on touch sensitive surface power (orPressure) sensor).One or more contact strength sensors 165 receive contact strength information (for example, pressure is believed from environmentThe surrogate of breath or pressure information).In some embodiments, at least one contact strength sensor and touch sensitive surface (for example,Touch-sensitive display system 112) Alignment or neighbouring.In some embodiments, at least one contact strength sensor is located atEquipment 100 be located at equipment 100 front on the opposite facing rear portion of touch-sensitive display system 112 on.
Equipment 100 optionally further includes one or more proximity sensors 166.Figure 1A is shown and peripheral device interfaceThe proximity sensor 166 of 118 couplings.Alternatively, 160 coupling of input controller in proximity sensor 166 and I/O subsystem 106It connects.In some embodiments, when multifunctional equipment is placed near user's ear (for example, when user is making a phone call),Proximity sensor closes and disables touch-sensitive display system 112.
Equipment 100 optionally further includes one or more tactile output generators 167.Figure 1A is shown and I/O subsystemThe tactile output generator that tactile feedback controller 161 in 106 couples.In some embodiments, one or more tactilesOutput generator 167 includes one or more electroacoustic equipment such as loudspeaker or other acoustic components;And/or for energy to be turnedChange into the electromechanical equipment of linear movement such as motor, solenoid, electroactive polymerizer, piezoelectric actuator, electrostatic actuator or itsHis tactile exports generating unit (for example, component for converting the electrical signal to the output of the tactile in equipment).It is one or moreTactile output generator 167 receives touch feedback from haptic feedback module 133 and generates instruction, and generates energy on the appliance 100Enough tactiles felt by the user of equipment 100 export.In some embodiments, at least one tactile output generator and touchingSensitive surfaces (for example, touch-sensitive display system 112) Alignment or neighbouring, and optionally by vertically (for example, to equipment100 surface inside/outside) or it is laterally (for example, in plane identical with the surface of equipment 100 rearwardly and a forwardly) mobile touch-sensitiveSurface exports to generate tactile.In some embodiments, at least one tactile output generator sensor is located at equipment 100On the opposite facing rear portion of touch-sensitive display system 112 on the front of equipment 100.
Equipment 100 optionally further includes one or more accelerometers 168.Figure 1A is shown and 118 coupling of peripheral device interfaceThe accelerometer 168 connect.Alternatively, accelerometer 168 is optionally coupled with the input controller 160 in I/O subsystem 106.In some embodiments, it is shown based on to the analysis from the one or more accelerometer received data in touch screenInformation is shown with longitudinal view or transverse views on device.Equipment 100 further includes magnetic force optionally other than accelerometer 168Instrument (not shown) and GPS (or GLONASS or other Global Navigation Systems) receiver (not shown), for obtaining about equipmentThe information of 100 position and orientation (for example, vertical or horizontal).
In some embodiments, the software component being stored in memory 102 includes operating system 126, communication module(or instruction set) 128, contact/motion module (or instruction set) 130, figure module (or instruction set) 132, haptic feedback module(or instruction set) 133, text input module (or instruction set) 134, global positioning system (GPS) module (or instruction set) 135, withAnd application program (or instruction set) 136.In addition, in some embodiments, memory 102 stores equipment/overall situation internal state157, if figure is shown in the 1A and Fig. 3.Equipment/overall situation internal state 157 includes one or more of the following: activity applicationProgram state indicates which application program (if any) is currently movable;What display state indicates using journeySequence, view or other information occupy each region of touch-sensitive display system 112;Sensor states, including from each of equipmentThe information that sensor and other inputs or control equipment 116 obtain;And about equipment position and/or posture position and/Or azimuth information.
Operating system 126 is (for example, iOS, Darwin, RTXC, LINUX, UNIX, OSX, WINDOWS or embedded operation systemSystem such as VxWorks) it include for controlling and managing general system task (for example, memory management, the control of storage equipment, electricitySource control etc.) various software components and/or driver, and be conducive to the communication between various hardware and software components.
Communication module 128 is conducive to be communicated by one or more outside ports 124 with other equipment, and alsoIncluding for handling by the various software components of 124 received data of RF circuit 108 and/or outside port.Outside port 124(for example, universal serial bus (USB), firewire etc.) is suitable for being directly coupled to other equipment or indirectly via network (for example, mutuallyNetworking, Wireless LAN etc.) coupling.In some embodiments, outside port be with Apple Inc. (Cupertino,California) someiPodThe identical or class with 30 needle connectors used in iPod equipmentLike and/or compatible spininess (for example, 30 needles) connector.In some embodiments, outside port is and Apple Inc.(Cupertino, California's) is someiPodWith used in iPod equipmentThe same or like and/or compatible Lightning connector of Lightning connector.
Contact/motion module 130 optionally detects and touch-sensitive display system 112 (in conjunction with display controller 156) and itsThe contact of his touch-sensitive device (for example, touch tablet or physics click wheel).Contact/motion module 130 include various software components withThe relevant various operations of detection are contacted with (for example, by finger or stylus) for executing, such as to determine that whether being in contact(for example, detection finger down event), the intensity of determining contact (for example, the power or pressure of contact, or the power or pressure of contactSub), determine whether there is the movement of contact and track the movement across touch sensitive surface (for example, detecting one or more handsRefer to drag events) and determine contact (for example, detection finger is lifted away from event or contact disconnects) whether it has stopped.Contact/fortuneDynamic model block 130 receives contact data from touch sensitive surface.Determine that the movement of contact point optionally includes the rate (amount of determining contact pointValue), speed (magnitude and direction) and/or acceleration (change in magnitude and/or direction), the movement of the contact point is by a series ofContacting data indicates.These operations are optionally applied to single-contact (for example, single abutment or stylus contact) or multiple spotContact (for example, " multiple point touching "/more abutments) simultaneously.In some embodiments, contact/motion module 130 and display controlDevice 156 processed detects the contact on touch tablet.
Contact/motion module 130 optionally detects the gesture input of user.Different gestures on touch sensitive surface have differenceContact mode (for example, the different motion of detected contact, timing and/or intensity).Therefore, special optionally by detectionDetermine contact mode and carrys out detection gesture.For example, detection singly refers to that Flick gesture includes detection finger down event, then pressed with fingerDetection finger lifts and (is lifted away from) thing at (for example, at picture mark position) the identical position (or substantially the same position) of lower eventPart.For another example, detecting the finger on touch sensitive surface and gently sweeping gesture includes detection finger down event, then detects one or more handsRefer to drag events, and then detection finger lifts and (be lifted away from) event.Similarly, by detect stylus specific contact patterns comeThe tap of stylus is optionally detected, gently sweeps, drag and other gestures.
In some embodiments, detect that finger Flick gesture depends on detecting that finger down event is lifted with fingerTime span between event, but the finger contact strength between finger down event and digit up event is unrelated.InIn some embodiments, it is less than according to the time span determined between finger down event and digit up event predeterminedIt is worth (for example, less than 0.1,0.2,0.3,0.4 or 0.5 second), detects Flick gesture, the intensity contacted but regardless of finger during tapWhether given intensity threshold (be greater than Nominal contact detection intensity threshold value), such as light press or deep pressing intensity threshold are reached.Therefore, finger Flick gesture can satisfy specific input standard, which does not require the characteristic strength of contact to meetIntensity threshold is given to meet specific input standard.For clarity, the finger contact in Flick gesture usually requires to meet markClaim contact detection intensity threshold value to detect finger down event, when being lower than the Nominal contact detection intensity threshold value, will not detectTo contact.Similar analysis is suitable for through stylus or other contact detection Flick gestures.It is able to detect in equipment in touch-sensitive tableIn the case that the finger or stylus to hover above face contacts, Nominal contact detection intensity threshold value optionally not with finger or stylus withPhysical contact between touch sensitive surface is corresponding.
Same concept is suitable for other kinds of gesture in a similar manner.For example, can based on for include in gestureContact intensity is unrelated or the satisfaction that does not require the contact for executing gesture to reach intensity threshold so as to identified standardOptionally gesture, kneading gesture, expansion gesture and/or long pressing gesture are gently swept in detection.For example, gently sweeping gesture is based on one or moreThe amount of the movement of a contact detects;Scaling gesture is detected based on two or more movements of contact towards each other;Expansion is let goGesture contacts movement away from each other based on two or more to detect;And long pressing gesture is based on having on touch sensitive surface fewIt is detected in duration of the contact of amount of threshold shift.Do not require contact strength full accordingly, with respect to certain gestures criterion of identificationThe corresponding intensity threshold of foot means that certain gestures criterion of identification can be in gesture to meet the statement of certain gestures criterion of identificationIn contact be satisfied when being not up to corresponding intensity threshold, and can also reach in one or more contacts in gesture orIt is satisfied in the case where more than corresponding intensity threshold.In some embodiments, it is examined in time predefined section based on determiningFinger down event and digit up event are measured to detect Flick gesture, without considering that contact is during time predefined sectionGesture gently is swept to detect greater than predefined magnitude above or below corresponding intensity threshold, and based on determining that contact is mobile,Even if it is also such that contact, which is higher than corresponding intensity threshold, at the end of contacting mobile.Even if being executed in the detection to gesture(for example, equipment is quickly when the intensity of contact is higher than intensity threshold in the specific implementation of the influence of the intensity of the contact of gestureDetect long pressing, or when the intensity of contact is higher, equipment can postpone the detection to tap input), as long as contacting notThe standard that can satisfy identification gesture in the case where reaching certain strength threshold value, then will not require to connect to the detection of these gesturesTouching reaches certain strength threshold value (for example, even if time quantum needed for identification gesture changes).
In some cases, contact strength threshold value, duration threshold and mobile threshold value carry out group with various various combinationsIt closes, distinguishes gestures different for two or more of identical input element or region to create heuritic approach, so thatThe set of richer user interaction and response is capable of providing with multiple and different interactions of identical input element.It is specific about one groupGesture identification standard does not require the intensity of contact to meet corresponding intensity threshold to meet the statement of certain gestures criterion of identification notIt excludes that other intensity related gesture criterion of identification are carried out while being assessed, to identify that with gesture is worked as include having to be higher than accordingly by forceSpend other gestures for the standard being satisfied when the contact of the intensity of threshold value.For example, in some cases, first gesture it is first-handGesture criterion of identification (it does not require the intensity of contact to meet corresponding intensity threshold to meet first gesture criterion of identification) and secondSecond gesture criterion of identification (it depends on the contact for reaching respective strengths threshold value) competition of gesture.In such competition, such asThe second gesture criterion of identification standard first of fruit second gesture is met, then gesture is not identified as optionally meeting first-handThe first gesture criterion of identification of gesture.For example, if contact reaches corresponding intensity before the mobile predefined amount of movement of contactThreshold value then detects deep pressing gesture rather than gently sweeps gesture.On the contrary, if being connect before contact reaches corresponding intensity thresholdThe mobile predefined amount of movement of touching then detects and gently sweeps gesture rather than deep pressing gesture.Even in this case, first-handThe first gesture criterion of identification of gesture does not require the intensity of contact to meet corresponding intensity threshold still to meet first gesture identificationStandard, because if contact keeps below corresponding intensity threshold until gesture terminates (for example, phase will not be increased to above by havingThat answers the contact of the intensity of intensity threshold gently sweeps gesture), gesture will be identified as gently sweeping gesture by first gesture criterion of identification.CauseThis, does not require the intensity of contact to meet corresponding intensity threshold to meet the certain gestures criterion of identification of certain gestures criterion of identificationWill (A) in some cases, ignore relative to the contact strength (for example, for Flick gesture) of intensity threshold and/or(B) in some cases, if before certain gestures criterion of identification identifies gesture corresponding with input, the intensity of one group of competitionRelated gesture criterion of identification (for example, for pressing gesture deeply) input is identified as it is corresponding with intensity related gesture, then notIt is able to satisfy certain gestures criterion of identification (for example, for long pressing gesture), in this sense, still depends on phaseFor the contact strength (for example, for long pressing gesture of deep pressing gesture competition identification) of intensity threshold.
Figure module 132 includes for figure to be rendered and shown in touch-sensitive display system 112 or other displaysVarious known software components, including for changing shown figure visual impact (for example, brightness, transparency, saturation degree,Contrast or other perceptual properties) component.As used herein, term " figure " includes can be displayed to user any rightAs without limitation including text, webpage, icon (such as including the user interface object of soft key), digital picture, video, movingDraw etc..
In some embodiments, figure module 132 stores the data for indicating figure ready for use.Each figure is optionallyIt is assigned corresponding code.Figure module 132 is used to specify one or more of figure to be shown from receptions such as application programsA code also receives coordinate data and other graphic attribute data together in the case of necessary, and then generates screen mapAs data, with output to display controller 156.
Haptic feedback module 133 includes for generating instruction (for example, the instruction used by tactile feedback controller 161)Various software components use with the interaction in response to user and equipment 100 tactile output generator 167 on the appliance 100One or more positions generate tactile output.
The text input module 134 for being optionally the component of figure module 132 is provided in various application program (examplesSuch as, contact person 137, Email 140, IM 141, browser 147 and any other application program for needing text input) inInput the soft keyboard of text.
GPS module 135 determines the position of equipment and provides this information to use in various application programs (for example, mentioningIt is supplied to the phone 138 for location-based dialing;It is provided to camera 143 and is used as picture/video metadata;And it is provided toFor location based service such as weather desktop small routine, local Yellow Page desktop small routine and map/navigation desktop small routineApplication program).
Application program 136 is optionally included with lower module (or instruction set) or its subset or superset:
Contact module 137 (sometimes referred to as address list or contacts list);
Phone module 138;
Video conference module 139;
Email client module 140;
Instant message (IM) module 141;
Body-building support module 142;
For still image and/or the camera model 143 of video image;
Image management module 144;
Browser module 147;
Calendaring module 148;
Desktop small routine module 149, optionally includes one or more of the following terms: weather desktop small routine149-1, stock market desktop small routine 149-2, calculator desktop small routine 149-3, alarm clock desktop small routine 149-4, dictionary desktopThe desktop small routine 149-6 of small routine 149-5 and other desktop small routines and user's creation for being obtained by user;
It is used to form the desktop small routine builder module 150 of the desktop small routine 149-6 of user's creation;
Search module 151;
Video and musical player module 152, are optionally made of video player module and musical player module;
Notepad module 153;
Mapping module 154;And/or
Online Video module 155.
The example for the other applications 136 being optionally stored in memory 102 includes other text processing application journeysOther picture editting's application programs, drawing application program, application program, the application program for supporting JAVA, encryption, number is presented in sequenceWord rights management, speech recognition and speech reproduction.
It is defeated in conjunction with touch-sensitive display system 112, display controller 156, contact module 130, figure module 132 and textEnter module 134, contact module 137 includes executable instruction for managing address list or contacts list (for example, being stored inIn the application program internal state 192 of contact module 137 in reservoir 102 or memory 370), comprising: addition name to lead toNews record;One or more names are deleted from address book;By one or more telephone numbers, one or more e-mail address,One or more physical address or other information are associated with name;Image is associated with name;Name is sorted out and is classified;Telephone number and/or e-mail address are provided to initiate and/or promote through phone 138, video conference 139, Email140 or instant message 141 communication;Etc..
In conjunction with RF circuit 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, touch-sensitive display system 112, displayController 156, contact module 130, figure module 132 and text input module 134, phone module 138 include for carry out withThe executable instruction of lower operation: the one or more electricity in input character string corresponding with telephone number, accessing address list 137Words number, modification inputted telephone number, dial corresponding telephone number, conversate and when session complete when disconnectionOr it hangs up.As described above, wireless communication is optionally using any one of a variety of communication standards, agreement and technology.
In conjunction with RF circuit 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, touch-sensitive display system 112, display controlDevice 156 processed, one or more optical sensors 164, optical sensor controller 158, contact module 130, figure module 132,Text input module 134, contacts list 137 and phone module 138, video conference module 139 include coming according to user instructionsInitiate, carry out and terminate the executable instruction of the video conference between user and other one or more participants.
In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, figure module 132With text input module 134, email client module 140 includes for creating, sending in response to user instruction, receiveWith the executable instruction of management Email.In conjunction with image management module 144, email client module 140 makes veryIt is easy creation and sends the Email with the still image or video image that are shot by camera model 143.
In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, figure module 132With text input module 134, instant message module 141 includes the executable instruction for performing the following operation: being inputted and instantThe corresponding character string of message modifies the character being previously entered, sends corresponding instant message (for example, using for based on phoneInstant message short message service (SMS) or multimedia messaging service (MMS) agreement or using for Internet-basedXMPP, SIMPLE, Apple push notification service (APNs) of instant message or IMPS), receive instant message and check instituteReceived instant message.In some embodiments, the instant message transferred and/or received optionally include figure, photograph,Other attachments for being supported in audio file, video file, and/or MMS and/or enhancing messaging service (EMS).Such as this paper instituteWith " instant message " is referred to message (for example, the message sent using SMS or MMS) based on phone and Internet-based disappearedBoth breaths (for example, the message sent using XMPP, SIMPLE, APNs or IMPS).
In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, figure module132, text input module 134, GPS module 135, mapping module 154 and video and musical player module 152, body-building branchHolding module 142 includes executable instruction for creating body-building (for example, having time, distance and/or caloric burn target);It is communicated with (in sporting equipment and smartwatch) body-building sensor;Receive workout sensor data;Calibration is for monitoring body-buildingSensor;Music is selected and played for body-building;And it shows, store and transmit workout data.
In conjunction with touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensingDevice controller 158, contact module 130, figure module 132 and image management module 144, camera model 143 include for carrying outThe executable instruction operated below: still image or video (including video flowing) are captured and stores them in memory 102In, the feature of modification still image or video, and/or delete still image or video from memory 102.
In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, figure module 132, text inputModule 134 and camera model 143, image management module 144 include for arranging, modifying (for example, editor) or with its other partyFormula manipulates, tags, deleting, showing (for example, in digital slide or photograph album) and storage still image and/or videoThe executable instruction of image.
In conjunction with RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mouldBlock 132 and text input module 134, browser module 147 include according to user instructions come browse internet (including search, chainBe connected to, receive and show webpage or part thereof and be linked to the attachment and alternative document of webpage) executable instruction.
In conjunction with RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mouldBlock 132, text input module 134, email client module 140 and browser module 147, calendaring module 148 include usingAccording to user instructions come create, show, modify and store calendar and data associated with calendar (for example, calendar,Backlog etc.) executable instruction.
In conjunction with RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mouldBlock 132, text input module 134 and browser module 147, desktop small routine module 149 are optionally to be downloaded and made by userMiniature applications program is (for example, weather desktop small routine 149-1, stock market desktop small routine 149-2, calculator desktop little ChengSequence 149-3, alarm clock desktop small routine 149-4 and dictionary desktop small routine 149-5) or by user create miniature applications program(for example, desktop small routine 149-6 of user's creation).In some embodiments, desktop small routine includes HTML (hypertext markRemember language) file, CSS (cascading style sheets) file and JavaScript file.In some embodiments, desktop small routine packetXML (extensible markup language) file and JavaScript file are included (for example, Yahoo!Desktop small routine).
In conjunction with RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mouldBlock 132, text input module 134 and browser module 147, desktop small routine builder module 150 include for creating desktopThe executable instruction of small routine (for example, user's specified portions of webpage are gone in desktop small routine).
In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132 and textInput module 134, search module 151 include for carrying out searching in searching storage 102 with one or more according to user instructionsThe matched text of rope condition (for example, search term that one or more user specifies), music, sound, image, video and/or itsThe executable instruction of his file.
In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132, audio-frequency electricRoad 110, loudspeaker 111, RF circuit 108 and browser module 147, video and musical player module 152 include allowing userDownload and play back the music recorded stored with one or more file formats (such as MP3 or AAC file) and other soundThe executable instruction of file, and for showing, presenting or otherwise play back video (for example, in touch-sensitive display system 112Executable instruction above or on the external display being wirelessly connected via outside port 124).In some embodiments, ifStandby 100 optionally include MP3 player, the functionality of such as iPod (trade mark of Apple Inc.).
In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, figure module 132 and text inputModule 134, notepad module 153 include creating and managing holding for notepad, backlog etc. for according to user instructionsRow instruction.
In conjunction with RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mouldBlock 132, text input module 134, GPS module 135 and browser module 147, mapping module 154 include for being referred to according to userIt enables to receive, show, modify and store map and data associated with map (for example, driving route;Specific location orThe data in neighbouring shop and other points of interest;With other location-based data) executable instruction.
In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132, audio-frequency electricRoad 110, loudspeaker 111, RF circuit 108, text input module 134, email client module 140 and browser module147, Online Video module 155 includes allowing user to access, browsing, receiving (for example, by stream transmission and/or downloading), returnIt puts (such as on touch screen 112 or on external display that is wireless connection or connecting via outside port 124), send toolHave to the Email of the link of specific Online Video and otherwise manages one or more file formats such asH.264 the executable instruction of Online Video.In some embodiments, using instant message module 141 rather than electronics postalPart client modules 140 send the link of specific Online Video.
Above-mentioned identified each module and application correspond to for executing above-mentioned one or more functions and in this ShenPlease described in one group of method (for example, computer implemented method described herein and other information processing method)Executable instruction.These modules (that is, instruction set) need not be realized with independent software program, process, or module, therefore these mouldsEach subset of block is optionally combined in various embodiments or is otherwise rearranged.In some embodiments,Memory 102 optionally stores the subgroup of above-mentioned module and data structure.It is not retouched above in addition, memory 102 optionally storesThe other module and data structure stated.
In some embodiments, equipment 100 is that the operation of predefined one group of function in the equipment uniquely passes throughTouch screen and/or touch tablet are performed equipment.By using touch screen and/or touch tablet as operating equipment 100Main input control apparatus is physically entered control equipment (for example, pushing button, driver plate etc. optionally in reduction equipment 100Deng) quantity.
Predefined one group of function is uniquely performed by touch screen and/or touch tablet and is optionally included in user circleNavigation between face.In some embodiments, the touch tablet when being touched by user by equipment 100 from being displayed on equipmentAny user interface navigation on 100 is to main menu, home menu or root menu.In such embodiment, touch tablet is usedTo realize " menu button ".In some other embodiments, menu button is that physics pushes button or other are physically enteredControl equipment rather than touch tablet.
Figure 1B is the block diagram for showing the example components for event handling according to some embodiments.In some implementationsIn scheme, memory 102 (in Figure 1A) or memory 370 (Fig. 3) include event classifier 170 (for example, in operating system 126In) and corresponding application program 136-1 (for example, any of aforementioned applications program 136,137 to 155,380 to 390 applyProgram).
Event classifier 170 receives event information and determination for application program 136-1 that event information is delivered to and answersWith the application view 191 of program 136-1.Event classifier 170 includes event monitor 171 and event dispatcher module174.In some embodiments, application program 136-1 includes application program internal state 192, the application program internal stateThe one or more that indicating is movable when application program or while being carrying out shows in touch-sensitive display system 112 is currently answeredUse Views.In some embodiments, equipment/overall situation internal state 157 is by event classifier 170 for which to be determined(which) application program is currently movable, and application program internal state 192 will for determination by event classifier 170The application view 191 that event information is delivered to.
In some embodiments, application program internal state 192 includes additional information, such as one of the following termsOr more persons: when application program 136-1 restores to execute recoverys information to be used, indicate just shown by application program 136-1Information or be ready for by the user interface state information of the application program 136-1 information shown, for enabling a user toThe repetition for the prior actions enough taken back to the state queue and user of the previous state of application program 136-1 or view/Cancel queue.
Event monitor 171 receives event information from peripheral device interface 118.Event information includes about subevent (exampleSuch as, as in the touch-sensitive display system 112 of a part of multi-touch gesture user touch) information.Peripheral equipment connectsMouthfuls 118 transmission its from I/O subsystem 106 or sensor such as proximity sensor 166, one or more accelerometers 168 and/orMicrophone 113 (passing through voicefrequency circuit 110) received information.Peripheral device interface 118 is from the received letters of the institute of I/O subsystem 106Breath includes the information from touch-sensitive display system 112 or touch sensitive surface.
In some embodiments, event monitor 171 sends the request to peripheral equipment at predetermined intervals and connectsMouth 118.In response, 118 transmitting event information of peripheral device interface.In other embodiments, peripheral device interface 118 is onlyWhen there are significant events (for example, receiving the input higher than predetermined noise threshold and/or receiving is more than to predefineDuration input) when ability transmitting event information.
In some embodiments, event classifier 170 further includes hit view determination module 172 and/or life eventIdentifier determining module 173.
When touch-sensitive display system 112 shows more than one view, hit view determination module 172 is provided for determiningThe subevent software process where occurred in one or more views.View can be seen over the display by userThe control and other elements arrived is constituted.
The another aspect of user interface associated with application program is one group of view, otherwise referred to as applies journey hereinSequence view or user interface windows are wherein showing information and the gesture based on touch occur.Wherein detecting touch(corresponding application programs) application view optionally corresponds in the sequencing or view hierarchies structure of application programSequencing is horizontal.For example, being optionally referred to as hit view in the floor level view for wherein detecting touch, and it is identifiedEvent set to correctly enter is based in part on the hit view of initial touch optionally at least to determine, the initial touch is openedPrimordium is in the gesture of touch.
It hits view determination module 172 and receives information relevant to the subevent of the gesture based on touch.Work as application programWhen with the multiple views organized in hierarchical structure, hit view determination module 172 will hit view, and be identified as should be to sub- thingMinimum view in the hierarchical structure that part is handled.In most cases, hit view is to initiate subevent (to form thingThe first subevent in the subevent sequence of part or potential event) in the floor level view wherein occurred.Once hitting viewIt is hit view determination module to be identified, hit view, which is just usually received, to be identified as hitting the targeted same touching of view with itIt touches or the relevant all subevents of input source.
It is specific that life event identifier determining module 173 determines which or which view in view hierarchies structure should receiveSubevent sequence.In some embodiments, life event identifier determining module 173 determines that only hit view should just receive spyStator sequence of events.In other embodiments, life event identifier determining module 173 determines the physical bit including subeventAll views set are the view of active participation, it is thus determined that all views actively participated in should all receive specific subevent sequenceColumn.In other embodiments, it even if touch subevent is confined to region associated with a particular figure completely, is classifiedHigher view in structure will still maintain view for active participation.
Event information is assigned to event recognizer (for example, event recognizer 180) by event dispatcher module 174.It is wrappingIn the embodiment for including life event identifier determining module 173, event information is delivered to by living by event dispatcher module 174Dynamic 173 definite event identifier of event recognizer determining module.In some embodiments, event dispatcher module 174 existsEvent information is stored in event queue, which is retrieved by corresponding event receiver module 182.
In some embodiments, operating system 126 includes event classifier 170.Alternatively, application program 136-1 packetInclude event classifier 170.In another embodiment, event classifier 170 is standalone module, or to be stored in storageA part of another module (such as contact/motion module 130) in device 102.
In some embodiments, application program 136-1 includes multiple button.onreleases 190 and one or more applicationViews 191, wherein each application view includes for handling the corresponding view occurred in the user interface of application programThe instruction of touch event in figure.Each application view 191 of application program 136-1 includes one or more event recognitionsDevice 180.In general, corresponding application programs view 191 includes multiple event recognizers 180.In other embodiments, event recognitionOne or more event recognizers in device 180 are a part of standalone module, the standalone module such as user interface tool packetThe higher levels of object of (not shown) or application program 136-1 therefrom inheritance method and other attributes.In some embodimentsIn, corresponding event processing routine 190 includes one or more of the following terms: data renovator 176, object renovator 177,GUI renovator 178, and/or from the received event data 179 of event classifier 170.Button.onrelease 190 optionally withOr data renovator 176, object renovator 177 or GUI renovator 178 is called to carry out more new application internal state 192.OptionallyGround, one or more application views in application view 191 include one or more corresponding event processing routines190.In addition, in some embodiments, one of data renovator 176, object renovator 177 and GUI renovator 178 orMore persons are included in corresponding application programs view 191.
Corresponding event recognizer 180 receives event information (for example, event data 179) from event classifier 170, andFrom event information identification events.Event recognizer 180 includes Event receiver 182 and event comparator 184.In some embodiment partyIn case, event recognizer 180 further includes at least one subset in following the two: metadata 183 and event transmitting 188 (its of instructionOptionally include subevent delivery instructions).
Event receiver 182 receives the event information from event classifier 170.Event information includes about subevent exampleAs touched or touching mobile information.According to subevent, event information further includes additional information, the position of such as subevent.WhenWhen subevent is related to the movement touched, event information optionally further includes rate and the direction of subevent.In some embodimentsIn, event include equipment from an orientation rotate to another orientation (for example, rotate to horizontal orientation from machine-direction oriented, or vice versa), and event information includes the corresponding informance of the current orientation (also referred to as equipment posture) about equipment.
Event information and predefined event or subevent definition are compared by event comparator 184, and being based on shouldCompare to determine event or subevent, or the state of determining or update event or subevent.In some embodiments, eventComparator 184 includes that event defines 186.Event defines 186 definition (for example, predefined subevent sequence) comprising event,Such as event 1 (187-1), event 2 (187-2) and other events.In some embodiments, the subevent in event 187Start for example including touch, touch terminate, touch it is mobile, touch and cancel and multiple point touching.In one example, 1 (187- of event1) definition is the double-click on shown object.For example, double-clicking the first time including the predetermined duration on shown objectTouch (touch starts), the predetermined duration that the first time of predetermined duration lifts (touch terminates), is shown on objectTouch (touch starts) and predetermined duration for second lift (touch terminates) for the second time.In another example,The definition of event 2 (187-2) is the dragging on display object.For example, when dragging includes predetermined on shown objectMovement and touch of the long touch (or contact), touch in touch-sensitive display system 112 are lifted away from (touch terminates).InIn some embodiments, event further includes the information for one or more associated button.onreleases 190.
In some embodiments, it includes the definition to the event for respective user interfaces object that event, which defines 187,.InIn some embodiments, event comparator 184 executes hit test, to determine which user interface object is related to subeventConnection.For example, being shown in touch-sensitive display system 112 in the application view of three user interface objects, when touch-sensitive aobviousShow that event comparator 184 executes hit Test to determine in these three user interface objects when detecting touch in device system 112Which user interface object it is associated with touch (subevent).If each shown object and corresponding event handle journeySequence 190 is associated, then event comparator determines which button.onrelease 190 should be swashed using the result that the hit is testedIt is living.For example, the selection of event comparator 184 button.onrelease associated with the object of subevent and triggering hit test.
It in some embodiments, further include delay voltage to the definition of corresponding event 187, which postpones eventThe delivering of information, until having determined that whether subevent sequence exactly corresponds to or do not correspond to the event type of event recognizer.
It, should when the determining subevent sequence of corresponding event identifier 180 does not define any event in 186 with event to be matched180 entry event of corresponding event identifier is impossible, event fails or event terminates state, ignores after this based on touchThe subsequent subevent of gesture.In this case, for hit view keep other movable event recognizers (if there isWords) continue to track and handle the subevent of the gesture based on touch of lasting progress.
In some embodiments, corresponding event identifier 180 includes metadata 183, which has instruction eventDelivery system how should execute the configurable attribute to the delivering of the subevent of the event recognizer of active participation, label and/orList.In some embodiments, metadata 183 includes how instruction event recognizer interacts or how to interact each otherConfigurable attribute, mark and/or list.In some embodiments, metadata 183 includes whether instruction subevent is delivered to viewConfigurable attribute, mark and/or the list of figure or the different levels in sequencing hierarchical structure.
In some embodiments, when one or more specific subevents of identification events, corresponding event identifier 180Activate button.onrelease 190 associated with event.In some embodiments, corresponding event identifier 180 will be with eventAssociated event information is delivered to button.onrelease 190.Activation button.onrelease 190 is different from sending subevent(and delaying to send) hits view to corresponding.In some embodiments, event recognizer 180 is dished out and the event phase that is identifiedAssociated mark, and button.onrelease 190 associated with the mark captures the mark and executes predefined process.
In some embodiments, event delivery instruction 188 includes delivering the event information about subevent without swashingThe subevent delivery instructions of button.onrelease living.On the contrary, event information is delivered to and subevent sequence by subevent delivery instructionsIt arranges associated button.onrelease or is delivered to the view of active participation.View with subevent sequence or with active participationAssociated button.onrelease receives event information and executes predetermined process.
In some embodiments, data renovator 176 creates and updates the data used in application program 136-1.For example, data renovator 176 is updated telephone number used in contact module 137, or to video or musicVideo file used in player module 152 is stored.In some embodiments, object renovator 177 creates simultaneouslyUpdate the object used in application program 136-1.It is used for example, object renovator 177 creates new user interface object or updatesThe position of family interface object.GUI renovator 178 updates GUI.For example, GUI renovator 178 prepares display information and will displayInformation is sent to figure module 132, for showing on the touch sensitive display.
In some embodiments, button.onrelease 190 includes data renovator 176, object renovator 177 and GUIRenovator 178 or with the access authority to them.In some embodiments, data renovator 176, object renovator177 and GUI renovator 178 is included in corresponding application programs 136-1 or the individual module of application view 191.At itIn his embodiment, they are included in two or more software modules.
It should be appreciated that the above-mentioned discussion of the event handling about user's touch on touch-sensitive display is applied also for using defeatedEnter user's input that equipment carrys out the other forms of operating multifunction equipment 100, not all user's input is all in touch screenUpper initiation.For example, optionally pressing or pinning the mouse movement to cooperate and mouse button down with single or multiple keyboards;TouchingContact in template is mobile, tap, dragging, rolling etc.;Stylus input;The movement of equipment;Spoken command;The eye detectedEyeball is mobile;Biological characteristic input;And/or any combination of them is optionally used as corresponding to the son for limiting the event to be identifiedThe input of event.
Fig. 2 shows according to some embodiments with touch screen (for example, touch-sensitive display system 112 of Figure 1A)Portable multifunction device 100.Touch screen optionally shows one or more figures in user interface (UI) 200.At theseIn embodiment and in other embodiments for being described below, user can be by, for example, one or more fingers202 (being not drawn on scale in figure) or one or more stylus 203 (being not drawn on scale in figure) are sold on figureGesture selects one or more figures in these figures.In some embodiments, it interrupts as user and schemes with one or moreWhen the contact of shape, the selection to one or more figures will occur.In some embodiments, gesture optionally include it is primary orRepeatedly (from left to right, from right to left, up and/or down) and/or tap, one or many gently sweep occur with equipment 100The rolling (from right to left, from left to right, up and/or down) of the finger of contact.In some specific implementations or in some feelingsUnder condition, figure inadvertently will not be selected with pattern contact.For example, applying journey when gesture corresponding with selection is tapSwept above sequence icon gently corresponding application program will not optionally be selected by sweeping gesture.
Equipment 100 optionally further includes one or more physical buttons, such as " home " button or menu button 204.Such asPreceding described, menu button 204 is optionally for times navigate in one group of application program being optionally performed on the appliance 100What application program 136.Alternatively, in some embodiments, menu button is implemented as being displayed on touchThe soft key in GUI on panel type display.
In some embodiments, equipment 100 includes touch-screen display, (the sometimes referred to as home button of menu button 204204), pushing button 206, the one or more volume knobs for keeping equipment power on/off and for locking device208, subscriber identity module (SIM) card slot 210, earphone jack 212 and docking/charging external port 124.Button 206 is pushed to appointSelection of land is used to continue predefined time interval by depressing the button and the button being maintained at depressed state come to equipmentCarry out machine open/close;By depressing the button and discharging the button before in the past in the predefined time interval come locking device;And/or unlocking process is unlocked or initiated to equipment.In some embodiments, equipment 100 is also connect by microphone 113By the voice input for activating or deactivating certain functions.Equipment 100 is also optionally included for detecting touch-sensitive display systemSystem 112 on contact intensity one or more contact strength sensors 165 and/or for for equipment 100 user generateOne or more tactile output generators 167 of tactile output.
Fig. 3 is the block diagram according to the exemplary multifunctional equipment with display and touch sensitive surface of some embodiments.Equipment 300 needs not be portable.In some embodiments, equipment 300 is laptop computer, desktop computer, plate electricityBrain, multimedia player device, navigation equipment, educational facilities (such as children for learning toy), game system or control equipment (exampleSuch as, household controller or industrial controller).Equipment 300 generally include one or more processing units (CPU) 310, one orMultiple networks or other communication interfaces 360, memory 370 and one or more communication bus for interconnecting these components320.Communication bus 320 optionally includes the circuit system for making the communication between system unit interconnection and control system component(sometimes referred to as chipset).Equipment 300 includes input/output (I/O) interface 330 with display 340, and the display is usualIt is touch-screen display.I/O interface 330 also optionally includes keyboard and/or mouse (or other sensing equipments) 350 and touch tablet355, for generating the tactile output generator 357 of tactile output in equipment 300 (for example, being similar to above with reference to Figure 1A instituteThe one or more tactile output generators 167 stated), sensor 359 is (for example, optical sensor, acceleration transducer, closeSensor, touch-sensitive sensors, and/or similar to one or more contact strengths sensor 165 above with reference to described in Figure 1AContact strength sensor).Memory 370 include high-speed random access memory, such as DRAM, SRAM, DDRRAM or other withMachine accesses solid-state memory device;And nonvolatile memory is optionally included, such as one or more disk storage equipments,Optical disc memory apparatus, flash memory device or other non-volatile solid-state memory devices.Memory 370 optionally includes separateOne or more storage equipment that CPU 310 is positioned.In some embodiments, the storage of memory 370 and portable multi-functionSimilar program, module and the data knot of program, module and the data structure stored in the memory 102 of equipment 100 (Figure 1A)Structure or their subgroup.In addition, memory 370 is optionally stored in the memory 102 of portable multifunction device 100 notExisting appendage, module and data structure.For example, the memory 370 of equipment 300 optionally stores graphics module 380, is inExisting module 382, word processing module 384, website creation module 386, disk editor module 388, and/or spreadsheet module 390,And the memory 102 of portable multifunction device 100 (Figure 1A) does not store these modules optionally.
Each element in Fig. 3 in above-mentioned identified element is optionally stored in previously mentioned memory devicesIn one or more memory devices.Each module in above-mentioned identified module corresponds to one for executing above-mentioned functionGroup instruction.Above-mentioned identified module or program (that is, instruction set) need not be implemented as individual software program, process or mouldBlock, therefore each subset of these modules is optionally combined in various embodiments or is otherwise rearranged.OneIn a little embodiments, memory 370 optionally stores the subgroup of above-mentioned module and data structure.In addition, memory 370 is optionallyStore other module and data structure not described above.
It attention is drawn to the reality for the user interface (" UI ") optionally realized on portable multifunction device 100Apply scheme.
Fig. 4 A shows the exemplary of the application menu on the portable multifunction device 100 according to some embodimentsUser interface.Similar user interface is optionally realized in equipment 300.In some embodiments, user interface 400 includesFollowing elements or its subset or superset:
Such as one or more wireless communications, one or more signal strengths of cellular signal and Wi-Fi signalIndicator;
Time;
Bluetooth indicator;
Battery Status Indicator;
With common application program image target pallet 408, icon such as:
The icon 416 for being marked as " phone " of ο phone module 138, the icon optionally include missed call or voiceThe indicator 414 of the quantity of message;
The icon 418 for being marked as " mail " of ο email client module 140, which, which optionally includes, does not readThe indicator 410 of the quantity of Email;
The icon 420 for being marked as " browser " of ο browser module 147;And
The label of ο video and musical player module 152 be music " icon 422;And
The icon of other applications, such as:
The icon 424 for being marked as " message " of ο IM module 141;
The icon 426 for being marked as " calendar " of ο calendaring module 148;
The icon 428 for being marked as " photo " of ο image management module 144;
The icon 430 for being marked as " camera " of ο camera model 143;
The icon 432 for being marked as " Online Video " of ο Online Video module 155;
The icon 434 for being marked as " stock market " of the stock market ο desktop small routine 149-2;
The icon 436 for being marked as " map " of ο mapping module 154;
The icon 438 for being marked as " weather " of ο weather desktop small routine 149-1;
The icon 440 for being marked as " clock " of ο alarm clock desktop small routine 149-4;
The icon 442 for being marked as " body-building support " of ο body-building support module 142;
The icon 444 for being marked as " notepad " of ο notepad module 153;And
ο is used to be arranged the icon 446 of application program or module, which is provided to equipment 100 and its various application programsThe access of 136 setting.
It should be noted that icon label shown in Fig. 4 A is only exemplary.For example, other labels are optionally for eachKind application icon.In some embodiments, the label of corresponding application programs icon includes and the corresponding application programs figureMark the title of corresponding application program.In some embodiments, the label of application-specific icon is different from specific with thisThe title of the corresponding application program of application icon.
Fig. 4 B is shown with the touch sensitive surface 451 separated with display 450 (for example, plate or touch tablet in Fig. 3355) the exemplary user interface in equipment (for example, equipment 300 in Fig. 3).Equipment 300 is also optionally included for detectingThe intensity of contact on touch sensitive surface 451 one or more contact strength sensors (for example, one in sensor 357 orMultiple sensors) and/or for for equipment 300 user generate tactile output one or more tactile output generators 359.
Although by being provided then with reference to the input on touch-screen display 112 (being wherein combined with touch sensitive surface and display)Many examples, but in some embodiments, the input on touch sensitive surface that equipment detection is separated with display, such as Fig. 4 BShown in.In some embodiments, touch sensitive surface (for example, 451 in Fig. 4 B) have on display (for example, 450)The corresponding main shaft (for example, 452 in Fig. 4 B) of main shaft (for example, 453 in Fig. 4 B).According to these embodiments, ifIt is standby detect at position corresponding with corresponding position on display the contact with touch sensitive surface 451 (for example, in Fig. 4 B 460 and462) (for example, in figure 4b, 470) 460, which correspond to 468 and 462, corresponds to.In this way, in touch sensitive surface (for example, in Fig. 4 B451) with the display (for example, 450 in Fig. 4 B) of multifunctional equipment be marquis when separating, by equipment on touch sensitive surface instituteThe user's input (for example, contact 460 and 462 and their movement) detected is used to manipulate the use on display by the equipmentFamily interface.It should be appreciated that similar method is optionally for other users interface as described herein.
In addition, though mostly in reference to finger input (for example, finger contact, singly referring to that Flick gesture, finger gently sweep gestureDeng) provide following example it should be appreciated that in some embodiments, one in the input of these fingers orMultiple finger inputs are by input (for example, input or stylus based on mouse input) replacement from another input equipment.For example,It gently sweeps gesture and (for example, rather than contact) is optionally clicked by mouse, be that cursor along the path gently swept moves (example laterSuch as, rather than contact movement) substitution.For another example, Flick gesture optionally by above the position that cursor is located at Flick gesture whenMouse click and (for example, instead of the detection to contact, be off detection contact later) substitution.Similarly, when being detected simultaneously byMultiple users input when, it should be appreciated that multiple computer mouses be optionally used simultaneously or mouse and finger contact appointSelection of land is used simultaneously.
As used herein, term " focus selector " refers to the user interface for being used to indicate that user is just interacting therewithThe input element of current portions.In some specific implementations for including cursor or other positions label, cursor serves as " focus selectionDevice ", so that when cursor is above particular user interface element (for example, button, window, sliding block or other users interface element)Detect input (for example, pressing on touch sensitive surface (for example, touch sensitive surface 451 in touch tablet 355 or Fig. 4 B in Fig. 3)Input) in the case where, which is adjusted according to detected input.It is including making it possible to realizeWith the touch-screen display of the user interface element on touch-screen display directly interacted (for example, the touch-sensitive display in Figure 1ATouch screen in device system 112 or Fig. 4 A) some specific implementations in, " focus choosing is served as in the contact detected on the touchscreenSelect device " so that working as on touch-screen display in particular user interface element (for example, button, window, sliding block or other usersInterface element) position at detect input (for example, by contact pressing input) when, adjusted according to detected inputWhole particular user interface element.In some specific implementations, focus is moved to user interface from a region of user interfaceAnother region, the movement of the contact in correspondence movement or touch-screen display without cursor is (for example, by using tabulationFocus is moved to another button from a button by key or arrow key);In these specific implementations, focus selector is according to cokeIt puts the movement between the different zones of user interface and moves.The concrete form that focus selector is taken, focus are not consideredSelector is usually from user's control to transmit with the desired interaction of the user of user interface (for example, by indicating to equipmentThe user of user interface it is expected the element interacted) user interface element (or contact on touch-screen display).For example, when detecting pressing input on touch sensitive surface (for example, touch tablet or touch screen), focus selector (for example, cursor,Contact or choice box) position above the corresponding button will indicate that user it is expected to activate the corresponding button (rather than device displayOn the other users interface element that shows).
As used in the present specification and claims, " intensity " of the contact on term touch sensitive surface refers to touchingThe power or pressure (power of per unit area) of contact (for example, finger contact or stylus contact) on sensitive surfaces, or refer to touch-sensitiveThe power of contact on surface or the sub (surrogate) of pressure.The intensity of contact has value range, which includes at leastFour different values and more typically include a different values up to a hundred (for example, at least 256).The intensity of contact optionally makes(or measurement) is determined with the combination of various methods and various sensors or sensor.For example, below touch sensitive surface or adjacentIn touch sensitive surface one or more force snesors optionally for measurement touch sensitive surface on difference at power.In some toolsDuring body is implemented, the power measurement from multiple force sensors is merged (for example, weighted average or adduction), to determine connecing for estimationTouch.Similarly, pressure of the pressure-sensitive top of stylus optionally for determining stylus on touch sensitive surface.Alternatively, touch-sensitiveThe size of the contact area detected on surface and/or its variation, contact near touch sensitive surface capacitor and/or its variation withAnd/or the touch sensitive surface near person's contact resistance and/or power of contact for being optionally used as on touch sensitive surface of its variation orThe substitute of pressure.In some specific implementations, the substitute measurement of contact force or pressure, which is directly used in, to determine whether to have surpassedCross intensity threshold (for example, intensity threshold is described to correspond to the unit that substitute measures).In some specific implementations, it will connectTouch or the substitution measured value of pressure, which are converted to, estimates power or pressure, and power is estimated in use or pressure determines whether to be more than strongDegree threshold value (for example, intensity threshold is the pressure threshold measured with pressure unit).The intensity of contact is used to input as userAttribute, so that user can indicated and/or receive for showing (for example, on the touch sensitive display) by allowing user to access userInput the area on the spot of (for example, via touch-sensitive display, touch sensitive surface or physical control/machinery control such as knob or button)The optional equipment function that cannot be easily accessed originally in limited smaller equipment.
In some embodiments, contact/motion module 130 determines operation using one group of one or more intensity thresholdWhether (for example, determining that whether user " clicks " icon) is executed by user.In some embodiments, according to software parameterCome determine intensity threshold at least one subset (for example, intensity threshold is not determined by the activation threshold of specific physical actuation device,And it can be adjusted in the case where not changing the physical hardware of equipment 100).For example, not changing Trackpad or touch screen is shownIn the case where device hardware, mouse " click " threshold value of Trackpad or touch-screen display can be arranged to the big model of predefined thresholdsAny one threshold value in enclosing.In addition, the user of equipment is provided with for adjusting in one group of intensity threshold in some specific implementationsOne or more intensity thresholds (for example, by adjusting each intensity threshold and/or by utilizing the system to " intensity " parameterGrade click comes the multiple intensity thresholds of Primary regulation) software setting.
As used in the specification and in the claims, " characteristic strength " of contact this term refers to one based on contactThe feature of the contact of a or multiple intensity.In some embodiments, characteristic strength is based on multiple intensity samples.Characteristic strength is appointedSelection of land is based on (for example, after detecting contact, before detecting that contact is lifted away from, detecting relative to predefined eventBefore or after contact start is mobile, before detecting that contact terminates, before or after detecting that the intensity of contact increasesAnd/or detect contact intensity reduce before or after) in the predetermined period (for example, 0.05 second, 0.1Second, 0.2 second, 0.5 second, 1 second, 2 seconds, 5 seconds, 10 seconds) during acquire predefined quantity intensity sample or one group of intensity sample.The characteristic strength of contact is optionally based on one or more of the following terms: the maximum value of contact strength, contact strength it is equalValue, the average value of contact strength, contact strength preceding 10% at value, half maximum value of contact strength, contact strength 90%Maximum value, the value generated by the low-pass filtering contact strength in time predefined section or since time predefined etc..InIn some embodiments, when determining characteristic strength using the duration of contact (for example, being the intensity contacted in characteristic strengthWhen average value in time).In some embodiments, characteristic strength and one group of one or more intensity threshold are comparedCompared with to determine whether user has executed operation.For example, the group one or more intensity threshold may include the first intensity threshold andTwo intensity thresholds.In this example, the contact that characteristic strength is less than first threshold leads to the first operation, and characteristic strength is more than theOne intensity threshold but the contact for being less than the second intensity threshold lead to the second operation, and characteristic strength is more than connecing for second thresholdTouching causes third to operate.In some embodiments, come using the comparison between characteristic strength and one or more intensity thresholdsDetermine whether to execute one or more operations (such as, if execute respective selection or abandon executing corresponding operating), rather thanThe first operation or the second operation are executed for determining.
In some embodiments, identify a part of gesture for determining characteristic strength.For example, touch sensitive surface can connectReceipts continuously gently sweep contact, this is continuously gently swept contact from initial position transition and reaches end position (such as drag gesture), at thisAt end position, the intensity of contact increases.In this example, characteristic strength of the contact at end position can be based only upon continuous lightIt sweeps a part of contact, rather than entirely gently sweeps contact (for example, only a part for gently sweeping contact at end position).SomeIn embodiment, algorithm can be smoothed in the intensity application that the forward direction for the characteristic strength for determining contact gently sweeps gesture.For example, smoothChange algorithm and optionally include one of the following terms or a variety of: not weighting sliding average smoothing algorithm, triangle smoothing is calculatedMethod, median filter smoothing algorithm and/or exponential smoothing algorithm.In some cases, these smoothing algorithms eliminateThe narrow spike or recess in the intensity of contact is swept, gently to realize the purpose for determining characteristic strength.
User interface map described herein optionally includes various intensity maps, these intensity illustrate connecing on touch sensitive surfaceTouching is relative to one or more intensity thresholds (for example, contact detection intensity threshold value IT0, light press intensity threshold ITL, deep press pressureSpend threshold value ITD(for example, being at least initially higher than ITL) and/or other one or more intensity thresholds (for example, comparing ITLLow intensityThreshold value ITH)) current intensity.The intensity map is not usually a part of shown user interface, but is provided to helpExplain the figure.In some embodiments, light press intensity threshold corresponds to such intensity: equipment will be held under the intensityRow operation usually associated with the button for clicking physics mouse or Trackpad.In some embodiments, deep to press Compressive Strength thresholdValue correspond to such intensity: under the intensity equipment will execute with usually with click physics mouse or Trackpad button it is relatedThe different operation of the operation of connection.In some embodiments, when detect characteristic strength lower than light press intensity threshold (for example,And it is higher than Nominal contact detection intensity threshold value IT0, the contact lower than Nominal contact detection intensity threshold value be no longer detected)When contact, equipment by according to movement of the contact on touch sensitive surface come moving focal point selector, without executing and flicking Compressive StrengthThreshold value or the deep pressing associated operation of intensity threshold.In general, unless otherwise stated, otherwise these intensity thresholds in differenceIt is consistent between the user interface attached drawing of group.
In some embodiments, equipment depends on based on connecing during input the response of input detected by equipmentTouch the standard of intensity.For example, being inputted for some " light press ", more than the intensity of the contact of the first intensity threshold during inputThe first response of triggering.In some embodiments, equipment depends on the response of the input as detected by equipment to include inputThe standard of the contact strength of period and time-based both criteria.For example, for some " deep to press " inputs, as long as meetingPass through delay time between the second intensity threshold of first intensity threshold and satisfaction, the first of light press is exceeded more than during inputThe intensity of the contact of second intensity threshold of intensity threshold just triggers the second response.The duration of the delay time is usually less than(for example, 40ms, 100ms or 120ms, this depends on the magnitude of the second intensity threshold to 200ms (millisecond), wherein the delay timeAs the second intensity threshold increases and increase).The delay time helps to avoid unexpectedly to identify deep pressing input.For another example, forSome " deep pressing " inputs, the period that susceptibility reduction will occur after reaching the first intensity threshold.It is dropped in the susceptibilityDuring the low period, the second intensity threshold increases.This temporary increase of second intensity threshold, which additionally aids, avoids unexpected depthPressing input.For other pressing inputs deeply, time-based standard is not dependent on to the response for detecting deep pressing input.
In some embodiments, one or more of input intensity threshold value and/or corresponding output are based on one or moreA factor (such as, user setting, contact movement, incoming timing, application program operation, rate when applying intensity, input simultaneouslyQuantity, user's history, environmental factor (for example, scene noise), focus selector position etc. and change.Illustrative factor existsIt is described in U.S. Patent Application Serial Number 14/399,606 and 14/624,296, these U.S. Patent applications full text is to quoteMode is incorporated herein.
For example, in some embodiments, resistance to vibration threshold portion based on touch input intensity at any time and withTime change.Resistance to vibration threshold value is the summation of two components: predefined since being initially detected touch inputThe first component decayed at any time after delay time p1, and the second component of the intensity of touch input is tracked at any time.TheThe initial high-intensitive threshold value of one component reduces unexpected triggering " deep pressing " response, while still allowing for providing foot in touch input" deep pressing " response immediately is carried out in the case where enough intensity.Second component reduces the gradual strength fluctuation by touch inputAnd inadvertent free " deep pressing " response.In some embodiments, the time point of resistance to vibration threshold value is met in touch input," deep pressing " response is triggered.
In another example, in some embodiments, resistance to vibration threshold value is (for example, intensity threshold ID) with two itsHe is intensity threshold (the first intensity threshold ITHWith the second intensity threshold IL) be used in combination.In some embodiments, although touchingInput meets the first intensity threshold IT before time p2HWith the second intensity threshold ITL, but until by delay time p2Response can be provided.In some embodiments, resistance to vibration threshold value decays at any time, wherein decay from the second intensity thresholdITLIt is associated respond time point (for example, time p2) for being triggered begin to pass through after predefined delay time p1 whenBetween point start.Such resistance to vibration threshold value is reduced immediately in triggering and lower threshold intensity (such as the first intensity thresholdITHOr the second intensity threshold IL) after associated response or simultaneously unexpected triggering and resistance to vibration threshold value ITDIt is associatedResponse.
In another example, in some embodiments, from touch input by initial detecting to begin to pass through delayAfter time p2, triggering and intensity threshold ITLAssociated response.Meanwhile since touch input by initial detecting to throughIt crosses after predefined delay time p1, resistance to vibration threshold value is (for example, intensity threshold ID) decaying.Therefore, in triggering and intensityThreshold value ILThe intensity that touch input is reduced after associated response, then increases in the case where not discharging touch input and touchesThe intensity of input can trigger and intensity threshold ITDAssociated response, even if the intensity when touch input is lower than another intensity thresholdValue is (for example, intensity threshold IL) when be also such.
Contact characteristic intensity is from lower than light press intensity threshold ITLIntensity increase between light press intensity threshold ITLWithDeep pressing intensity threshold ITDBetween intensity be sometimes referred to as " light press " input.The characteristic strength of contact is from lower than deep pressingIntensity threshold ITDIntensity increase to above deep pressing intensity threshold ITDIntensity be sometimes referred to as " deep pressing " input.Contact is specialIntensity is levied from lower than contact detection intensity threshold value IT0Intensity increase between contact detection intensity threshold value IT0With flicking Compressive StrengthThreshold value ITLBetween intensity be sometimes referred to as and detect contact on touch-surface.The characteristic strength of contact is examined from contact is higher thanSurvey intensity threshold IT0Intensity be decreased below contact detection intensity threshold value IT0Intensity sometimes referred to as detect contact from touchingSurface is touched to be lifted away from.In some embodiments, IT0It is zero.In some embodiments, IT0Greater than zero in some diagrams, yinShadow circle is oval for indicating the intensity of the contact on touch sensitive surface.In some diagrams, shadeless circle or ellipse are used forIndicate the corresponding contact on touch sensitive surface without the specified intensity accordingly contacted.
Herein in some embodiments, in response to detecting gesture or response including corresponding pressing inputOne or more operations are executed in detecting using corresponding pressing input performed by corresponding contact (or multiple contacts), whereinIt is based at least partially on and detects that the intensity of the contact (or multiple contacts) increases to above pressing input intensity threshold value and detectsIt is inputted to the corresponding pressing.In some embodiments, in response to detecting that it is defeated that the intensity accordingly contacted increases to above pressingEnter intensity threshold to execute corresponding operating (for example, executing corresponding operating on " downward stroke " of corresponding pressing input).OneIn a little embodiments, pressing input includes that the intensity accordingly contacted increases to above pressing input intensity threshold value and the contactIntensity is decreased subsequently to lower than pressing input intensity threshold value, and in response to detecting that it is low that the intensity accordingly contacted is decreased subsequently toThreshold value is inputted in pressing to execute corresponding operating (for example, executing corresponding operating on " up stroke " of corresponding pressing input).
In some embodiments, equipment is lagged using intensity to avoid the accident input sometimes referred to as " shaken ",Middle equipment limits or selection has the lag intensity threshold of predefined relationship (for example, lag intensity with pressing input intensity threshold valueThreshold value than the low X volume unit of pressing input intensity threshold value, or lag intensity threshold be pressing input intensity threshold value 75%,90% or some rational proportion).Therefore, in some embodiments, pressing input includes that the intensity accordingly contacted increases to heightIt is decreased subsequently in the intensity of pressing input intensity threshold value and the contact lower than the lag for corresponding to pressing input intensity threshold valueIntensity threshold, and in response to detecting that the intensity accordingly contacted is decreased subsequently to execute corresponding behaviour lower than lag intensity thresholdMake (for example, executing corresponding operating on " up stroke " of corresponding pressing input).Similarly, in some embodiments, onlyIt detects that contact strength is increased to from the intensity equal to or less than lag intensity threshold in equipment and is equal to or higher than pressing input by forceSpend threshold value intensity and optionally contact strength be decreased subsequently to be equal to or less than lag intensity intensity when just detect byPressure input, and hold in response to detecting pressing input (for example, according to scene, contact strength increases or contact strength reduces)Row corresponding operating.
In order to be easy to explain, be optionally in response to detect following situations and trigger in response to pressing input intensity thresholdBe worth the description of associated pressing input or the operation executed in response to including the gesture of pressing input: the intensity of contact increasesIt is strong from pressing input is increased to above lower than the intensity for lagging intensity threshold to pressing input intensity threshold value, the intensity of contact is higher thanDegree threshold value intensity, the intensity of contact be decreased below pressing input intensity threshold value or contact intensity be decreased below with byPress the corresponding lag intensity threshold of input intensity threshold value.In addition, describing the operations as in response to detecting that the intensity of contact subtractsIt is small to lower than pressing input intensity threshold value and in the example that executes, be optionally in response to detect that the intensity of contact is decreased belowCorrespond to and is less than the lag intensity threshold of pressing input intensity threshold value to execute operation.As described above, in some embodiment partyIn case, the triggering of these operations is additionally depended on and meets time-based standard (for example, meeting the first intensity threshold and satisfactionDelay time is had been subjected between second intensity threshold).
User interface and associated process
It attention is directed to be used to detect and touch sensitive surface with display, touch sensitive surface and (optionally)It is realized on the electronic equipment of the one or more sensors of the intensity of contact such as portable multifunction device 100 or equipment 300User interface (" UI ") and associated process embodiment.
Fig. 5 A to Fig. 5 D, which is shown, to be shown according to having for some embodiments and can indicate showing for (for example, home, which showing, to be indicated)Example property user interface, this, which shows, can indicate to be used for navigation gesture (for example, for navigating to home screen on instruction contact sensitive display screenCurtain user interface gesture) gesture start region.In some embodiments, it is also shown and is used for using method shown in this articleControl or offer can be indicated about the showing for guidance of the other function or operation of equipment.User interface in these attached drawings is used forIllustrate procedures described below, including the process in Fig. 6 A to Fig. 6 C, Fig. 7 A to Fig. 7 E and Fig. 8 A to Fig. 8 F.For the ease of solutionIt releases, some implementations in embodiment will be discussed with reference to the operation executed in the equipment with touch-sensitive display system 112Scheme.In such embodiment, focus selector is optionally: respective finger or stylus contact correspond to finger or stylusThe representative point (for example, the center of gravity that accordingly contacts or with accordingly contact associated point) of contact or in touch-sensitive display system 112The center of gravity of two or more detected contacts.
For the ease of explaining, by with reference in the equipment for not having home button the operation that executes discuss in embodimentSome embodiments, and release the user interface currently shown using the gesture for meeting predefined standard and show homeOn-screen user interface.It include home button in equipment in some embodiments although being not shown in figures 5a to 5d(for example, mechanical button, solid-state button or virtual push button), and the home button is used to release the user interface currently shown simultaneouslyShow home on-screen user interface.(inputting for example, pressing in response to individual palpation) and/or display multi-task user interface are (for example, responseIt is inputted in double pressures).
In figures 5a to 5d, when equipment shows any user interface, gesture since the bottom of screen (for example,In the predefined region of equipment, the edges of the predefined region proximity displays (e.g., including the close equipment bottom of displayThe fringe region of the predefined part (for example, 20 pixels are wide) at portion edge)) user interface navigation process is called, and be based onThe speed of input and direction and the user interface object currently shown is optionally based on (for example, the user interface currently shownDiminution ratio indicate) moving parameter and feature optionally instruct the navigation between multiple user interfaces.
The exemplary user interface of the application program operated on an electronic device includes showing to indicate (for example, home shows energyIndicate that 5002) this, which shows, can indicate to provide a user the vision guide about the following terms: can start the fringe region of navigation gesturePosition;And optionally, whether navigation is limited in the current mode of the application program currently shown (for example, not depositingShow and can indicate in the home of instruction following situations: navigating and be limited, and need confirmation input or the navigation gesture of enhancing (for example,Press and gently swept upwards after gently sweeping or touching upwards holding input after inputting) to be navigated between user interface (for example, such as Fig. 5 X is extremelyShown in Fig. 5 AA, wherein needing initial input to show again and show and can indicate, subsequent navigation gesture then can recognize)).SomeIn embodiment, home, which shows, can indicate activate or not do touch input directly in a manner of being similar to virtual push buttonIt responds out.In some embodiments, using method described herein realize home show can indicate or other show can indicate soundShould be in touch input, which includes directly showing the contact on capable of indicating.
Fig. 5 A shows the web page browsing user interface of the content of display webpage 5004.Home, which shows, can indicate that 5002 is shownFor a part for being covered on the content that the bottom margin of touch screen 112 is nearby shown.User interface navigation process is by contact 5006Activation, which shows in home can indicate below 5002, start at the position on or near, and upward from the bottom of screenIt advances, as shown in Fig. 5 A to Fig. 5 B.
In figure 5B, web page browsing user interface is by indicating 5008 generation of card of the web browser user interface in Fig. 5 AIt replaces.In Fig. 5 A to Fig. 5 C, when input moves up on the screen, card 5008 is dynamically shunk, to show in the backgroundThe obscured views 5010 of home screen.In some embodiments, applied to the fuzzy quantity of home screen according to contact 5006 away fromThe distance of bottom of screen dynamically changes.
In some embodiments, as shown in Figure 5 B, when user interface navigation process is passed through the defeated of 5006 progress of contactWhen entering to activate, home, which shows, can indicate that 5002 stoppings are shown (for example, home, which shows, can indicate that 5006 can not directly be grasped by touch inputIt is vertical, and stop display when it has completed to provide a user the purpose about the vision guide of navigation gesture).When card 5008Size it is sufficiently small when, other cards are (for example, card 5012 and 5014, respectively indicates and system control panel user interface and beat recentlyThe user interface for the application program opened) it is shown in 5008 side of card.Optionally, input is terminated when showing multiple cards (for example, lift5006) equipment is made to enter multi job mode (for example, display application program switch user interface, allows user to select from contactApplication program is selected so that Web-browser application is replaced with foreground application).
In figure 5 c, when contact 5006 continues to move up and meets predefined home navigation standard (for example, contact5006 predefined feature (for example, position, speed etc.) meets predefined thresholds) when, other cards on screen stop display, andAnd only card 5008 retains on the screen.When input terminates (for example, detecting being lifted away from for contact 5006), while only showing card5008 (for example, being similar to user interface state shown in Fig. 5 C), equipment show home screen 5016, (example as shown in Figure 5 DSuch as, dotted ellipse indicates that contact 5006 is lifted away from position).When showing home screen 6016 on touch screen 112, in touch screenOn do not show that home shows and can indicate 5002.
Due in many scenes (for example, when show different application program or other systems grade user interface (for example,Notice central user interface, cover user interface, control panel user interface etc.) when) need to release user circle currently shownFace simultaneously goes to home screen, and home, which shows, can indicate that 5002 needs are shown in the background of all kinds, this can also be spontaneously or loudIt should be manipulated in user and instantaneous and change over time.In addition, determining to start to navigate along the bottom edge region of touch screenWhen the position of gesture, the bigger freedom degree of user is given, therefore, home, which shows, can indicate that 5002 are configured to have biggish levelSpan has relatively small width to indicate the scalability of the conversion zone for gesture to avoid keeping screen excessively chaoticAnd unnecessary interference is caused to user.Therefore, though lower section content be at any time it is static, home, which shows, to be indicated under 5002A part of the content of side may include color and brightness and other display properties in the different piece of a part of the contentVariation.Therefore, in some embodiments, show each subdivision that can be indicated (for example, each pixel or each small pixelCluster) appearance be based on be located at this show that the appearance of the content immediately below the subdivision that can be indicated (and optionally, extends slightly intoShow the content except the boundary for the subdivision that can be indicated appearance (for example, by internally perhaps show can indicate apply obscure orAverage effect)) come what is be individually determined.As shown in Figure 5A, home shows the one of the content 5004 that can indicate that 5002 are shown in webpageOn part.A part of the content includes having the region of different luminance levels, and obtained home shows can indicate 5002It further include the brightness change of (for example, horizontal extent) along its length.
In some embodiments, as shown in fig. 5e, by multiple images processing filters (for example, in order or not limitingThe sequence of filter) it is applied to show the background content that can indicate lower section, the appearance that can be indicated is shown with determination.For example, by contentOriginal full-colour image desaturation, to obtain the luminance graph of content.The brightness of content is inverted (for example, according to the brightness value of backgroundWith show predefined inverse relation between the brightness value that can be indicated (for example, inverse relation shown in Fig. 5 F, Fig. 5 R, Fig. 5 AE etc.One of)), shown with acquisition and shows the brightness value that can be indicated at each pixel that can be indicated.Show the brightness and lower section content that can be indicatedBrightness between inverse relation be used as showing the corresponding relationship that can be indicated between the value of the selected display properties of lower section contentExample.The variant of other kinds of display properties, such as gray value or brightness can also be used in various embodiments.
As shown in fig. 5e, be reversed in show can indicate between the content of lower section generate appearance comparison.When one of lower section contentWhen dividing brighter (for example, there is higher brightness value), show that the corresponding part that can be indicated is darker (for example, having lower brightnessValue).For example, to the different piece of the desaturation background content with different brightness values (for example, being labeled in desaturation bandFor the part of 1,2,3 and 4 circle encirclement) it executes reversion and obtains and show the corresponding part (example that can be indicated with different brightness valuesSuch as, the part that 1,2,3 and 4 circle surrounds is marked as in reversion band).Fig. 5 F is shown for bright by corresponding backgroundThe exemplary reverse curve that can indicate brightness value is shown in angle value generation.With the background of the circles mark in Fig. 5 E and show pair that can be indicatedAnswer the value of part by the circles mark labeled as 1,2,3,4, as illustrated in figure 5f.Show the shade that can be indicated also in Fig. 5 F label for1, it is reproduced in 2,3,4 circle.In some embodiments, after executing reversion, threshold process is determined to brightness value execution, withReduce the dynamic range of brightness value.For example, showing that the brightness value for each pixel that can be indicated is restricted to show can indicate most lightThe 50% of degree has the softer appearance of lower internal visual contrast (for example, showing after reversion can be indicated and be determined to generateShowing after threshold value can indicate to be compared).In some embodiments, in order to further decrease in interior change and showing can indicateContrast, be averaged using blur filter to the brightness change on multiple neighborhood pixels in content, and therefore to showingThe brightness change on multiple neighborhood pixels in capable of indicating is averaged.Finally, it is obtained show can indicate have in lower sectionThe corresponding wider stroke brightness change of brightness change in appearance.
When generate relative to different background it is outstanding show can indicate when, even if to brightness value carry out simple reverse can be bigEnough contrasts are generated in most cases, using showing that all light angle value range that can be indicated would generally obtain more dazzling appearance,This may dispersion user attention.It would thus be advantageous to will show that the range of luminance values that can be indicated is constrained to the brightness value of contentThe subrange of range.In addition, depending on the expection luminance level of lower section content, it will show that the brightness range values that can be indicated are constrained to" dark " show can table indication range or " bright " show can table indication range, can be indicated or " bright " is shown to indicate to generate " dark " and show.InIn some embodiments, show can indicate appearance type (for example, " dark " and " bright ") will not be initially displayed show can indicate after becomeChange, even if the appearance of lower section content is always on from very secretly becoming non-, or vice versa (as shown in Fig. 5 G to Fig. 5 P).In some realitiesApply in scheme, show can indicate appearance type (for example, " dark " and " bright ") will not in response to content transient change (for example, shortContent luminance level is temporarily inverted in time) and change, but eventually in response to the more longlasting variation of content (for example, longerWhen put on the reversion for keeping content luminance level) and change.In some embodiments, it can indicate at present according to showing for the first timeThe original intensity level of square content can indicate appearance type (for example, " bright " or " dark " or showing and can indicate specific outer to select to showSight value range), and show that can indicate to maintain this to show can indicate appearance type, until scene handover event occurs (for example, applyingSwitch between program, switch between application program or system user interface or switch between two systems user interfaceDeng), and redefined based on the lower section content in new scene and to show and can indicate appearance type.As an example, Fig. 5 R is shown" bright ", which is shown, to be indicated and " dark " shows the exemplary inverse relation (for example, curve is respectively labeled as " LA " and " DA ") that can be indicated,Middle content range of luminance values (for example, along value of trunnion axis) is entire scope from black to white (for example, the gray value of gray level imageFor the brightness value of [0,1] or color image be [0,255] or brightness or other similar display properties is [0,100%]), show energyIndicate that range of luminance values (for example, along value of vertical axis) is constrained on upper limit value range (for example, " bright " shows the value model that can be indicatedEnclose) or lower limit value range (for example, " dark " shows the value range that can be indicated) in.In some embodiments, two value ranges do not weighFolded (for example, being separated by gap).As shown in Fig. 5 R, two curves (for example, curve LA and curve DA) show the brightness of contentIncreasing leads to show that the brightness that can be indicated reduces.
Fig. 5 F shows the exemplary luminance reversion for executing reversion shown in Fig. 5 E according to some embodimentsCurve 5017.In this example, being constrained on showing between upper and lower bound can one of table indication range greater than background valuesHalf, and do not include black (value=0) and pure white (for example, value=1).In some embodiments, reverse curve is continuous,It and does not include continuity point.
Fig. 5 G to Fig. 5 K, which is shown, to be shown according to the first of some embodiments appearance type can be indicated (for example, " dark " shows energyIndicate type) show the cosmetic variation that can indicate (for example, 5002-DA can be indicated by showing).Fig. 5 G to Fig. 5 K is shown in touch screenThe rolling of content 5018 shown in the web browser user interface shown on 112.When content 5018 rolls, positioned at touchingThat touches the bottom margin display nearby of screen shows a part variation that can indicate the content below 5002-DA.In other words, it is rollingDuring content 5018, the different piece of content 5018, which is moved to following showing, can indicate 5002-DA.
As depicted in fig. 5g, in some embodiments, when be initially displayed show can indicate 5002-DA when (for example, when open netPage browsing device application program, and when initially displaying together web browser interface with content 5018), assessment content 5018 shouldPartial integral brightness level, and be directed to and show that can indicate that selection is suitably shown can indicate appearance type.In this particular example,Positioned at show can indicate lower section 5018 part of content it is relatively darker (for example, integral brightness level be lower than predefined luminance thresholdValue), it selects and shows to indicate that (for example, range is [0,0.4]) is corresponding shows and can indicate for " darker " part of range of luminance valuesType (for example, " dark ", which shows, can indicate type) is as showing that showing of can indicating can indicate type.For example, using one as shown in fig. 5eSet filter, which generates, shows that the inverse relation that can be indicated, and use is to imply the inverse relation that can indicate appearance type (for example, figureCurve DA shown in 5R).
In fig. 5h, it detects on the touchscreen in user interface navigation gesture (for example, by 5006 progress of contactHome/ multitask gesture, as shown in Fig. 5 A to Fig. 5 D) conversion zone except (for example, top) start rolling input (exampleSuch as, it is moved up on the touchscreen by contact 5020).Rolling input makes the content 5018 of webpage scroll up and makes previously not5018 part of content of display, which reaches, to be shown and can indicate below 5002-DA.At the time of description in fig. 5h, it can be indicated positioned at showing5018 part of content immediately below 5002-DA be it is complete it is white (for example, brightness value be 1 or 100%), correspondingly, showing can indicateThe brightness value of 5002-DA be it is completely black (for example, brightness value be 0 or 0%), such as based on imply can indicate appearance type reversion passSystem (for example, as the curve DA in Fig. 5 R describes) determines.
Fig. 5 I to Fig. 5 K is shown as the continuation for rolling input (for example, contact 5020 continues to move up, then contacts5020 are lifted away from final speed), content 5018 can indicate to scroll up below 5002-DA showing.Showing can indicate that 5002-DA's is outerIt sees basis and is currently located at 5018 part of the content variation shown and can indicated below 5002-DA.Showing can indicate that the brightness of 5002-DA is baseThe inverse relation (for example, as the curve DA in Fig. 5 R describes) of appearance type can be indicated in hint to determine.
In particular, can indicate that 5018 part of content immediately below 5002-DA exists positioned at showing at the time of description in fig. 5jLeft side be it is complete it is white (for example, brightness value be 1 or 100%), and right side be it is completely black (for example, brightness value be 0 or 0%),Correspondingly, showing for left side can indicate that the half of 5002-DA is completely black (as consistent with situation shown in Fig. 5 H), and right sideShow and can indicate that the half of 5002-DA is not complete white.On the contrary, show can indicate 5002-DA right one side of something be grey (for example,Showing can indicate that brightness value is greater than 0 (for example, 0.4)), such as the inverse relation of appearance type can be indicated (for example, such as Fig. 5 R based on hintIn curve DA described) determine.In other words, implying can indicate that the range of luminance values of (for example, 5002-DA) is confined toLower than the range of maximum brightness threshold value (for example, 0.4).
Fig. 5 L to Fig. 5 P, which is shown, to be shown according to the second of some embodiments appearance type can be indicated (for example, " bright " shows energyIndicate type) show the cosmetic variation that can be indicated.
Fig. 5 L to Fig. 5 P shows content 5018 shown in the web browser user interface shown on touch screen 112Rolling.Rolling is the reversion for the rolling described in Fig. 5 G to Fig. 5 K.
As shown in fig. 5l, in some embodiments, when be initially displayed show can indicate 5002-LA when (for example, when open netPage browsing device application program, and when initially displaying together web browser interface with content 5018), assessment content 5018 shouldPartial integral brightness level, and be directed to and show that can indicate that selection is suitably shown can indicate appearance type.In this particular example,Positioned at show can indicate lower section 5018 part of content it is relatively bright (for example, integral brightness level be higher than predefined luminance thresholdValue), it selects and shows to indicate that (for example, range is [0.6,1]) is corresponding shows and can indicate for " brighter " part of range of luminance valuesType (for example, " bright ", which is shown, can indicate type) is as showing that showing of can indicating can indicate type.For example, using one as shown in fig. 5eSet filter generation shows that the inverse relation that can be indicated, and use is bright to show the inverse relation that can be indicated (for example, shown in Fig. 5 RCurve LA).
In Fig. 5 L to Fig. 5 M, detect on the touchscreen user interface navigation gesture (for example, by contact 5006 intoCapable home/ multitask gesture, as shown in Fig. 5 A to Fig. 5 D) conversion zone except (for example, top) start rolling input(for example, being moved down on the touchscreen by contact 5022).Rolling input scrolls down through the content 5018 of webpage and makes interiorThe upper part arrival for holding 5018 is shown and can be indicated below 5002-LA.
At the time of description in Fig. 5 M, it can indicate that 5018 part of content immediately below 5002-LA in left side is complete positioned at showingIt is white (for example, brightness value be 1 or 100%), and right side be it is completely black (for example, brightness value be 0 or 0%), it is correspondingly, rightShowing for side can indicate that the half of 5002-LA is complete white, and showing for left side can indicate that the half of 5002-LA is not completely black.On the contrary, showing can indicate that left one side of something of 5002-LA is grey (for example, brightness value is greater than 0 (for example, 0.6)), such as show energy based on brightIndicate that the inverse relation (for example, as the curve LA in Fig. 5 R describes) of appearance type determines.In other words, bright to show and indicateShow the range that can indicate that range of luminance values is confined to higher than minimum brightness threshold value (for example, 0.6).In some embodimentsIn, if Fig. 5 J and Fig. 5 M describe, for identical background, hint can indicate that the overall appearance of 5002-DA is shown than light and can be indicatedThe overall appearance of 5002-LA is darker.
Fig. 5 N to Fig. 5 P is shown as the continuation for rolling input (for example, contact 5022 continues to move down, then contacts5022 are lifted away from final speed), content 5018 can indicate that 5002-LA is rolled downward below showing.Showing can indicate that 5002-LA's is outerIt sees basis and is currently located at and show a part that can indicate the content below 5002-DA 5018 and change.Showing can indicate that 5002-LA's is brightDegree be based on it is bright show can indicate the inverse relation (for example, as the curve LA in Fig. 5 R describes) of appearance type come determining.
At the time of description in Fig. 5 O, it can indicate that 5018 part of content immediately below 5002-LA is complete white (example positioned at showingSuch as, brightness value is 1 or 100%), and correspondingly, showing can indicate that the brightness value of 5002-LA is not completely black.On the contrary, showing can indicate5002-LA is grey (for example, brightness value be greater than 0 (for example, 0.6)), such as based on it is bright show can indicate the reversion pass of appearance typeSystem (for example, as the curve LA in Fig. 5 R describes) determines.In other words, bright to show that the range of luminance values that indicated is confined toHigher than the range of minimum brightness threshold value (for example, 0.6).
Fig. 5 Q shows that there is a situation where identical changes in background (for example, content 5018) according to some embodimentsUnder it is two kinds of show can indicate appearance type (for example, LA and DA) show can indicate 5002 difference in appearance.
Fig. 5 Q list shown in Fig. 5 G to Fig. 5 P every kind of state show can indicate 5002 appearance.These states are dividedFor five groups, each group of corresponding state corresponding to content 5018 shown in web browser user interface.For example, on toUnder, five groups correspond to: (i) Fig. 5 G and Fig. 5 P, (ii) Fig. 5 H and Fig. 5 O, (iii) Fig. 5 I and Fig. 5 N, (iv) Fig. 5 J and Fig. 5 M withAnd (v) Fig. 5 K and Fig. 5 L.
As shown in Fig. 5 Q, for corresponding to each group of corresponding contents state, showing can be indicated (for example, by identical content barThe DA version and LA version that can indicate 5002 with following showing are compared) hint can indicate that appearance type is shown and can be indicated than brightAppearance type has whole darker appearance (for example, lower overall brightness).
Fig. 5 R, which is shown, shows the display properties (for example, brightness or gray value) that can indicate and dark according to some embodimentsAppearance type and the bright value range for showing the lower section content that can indicate appearance type and inverse relation can be indicated by showing.
Difference in appearance shown in Fig. 5 Q is also be reflected in Fig. 5 R, wherein bright show that showing of can indicating can indicate range of luminance valuesIt is substantially higher than and implies that can be indicated shows and can indicate range of luminance values, and two value ranges are not overlapped optionally.
Fig. 5 S to Fig. 5 AA shows the user interface according to some embodiments, the user interface include have in response toWhat the cosmetic variation of background and operation mode associated with background user interface changed shows and can indicate.
In Fig. 5 S, start Web-browser application, and show web browser user interface on the touchscreen5024.In this example, web browser user interface is shown with horizontal orientation according to the orientation of equipment 100.With first state(for example, fully visible state/high contrast state 5002-A) shows that home shows near the bottom margin of touch screen and can indicate5002.Showing can indicate that 5002 show and can indicate that appearance type is optionally based on the web page contents for being located at and showing and capable of indicating 5002 lower sectionsThe initial integral brightness level of a part selects.
Fig. 5 S to Fig. 5 T shows selection media item (for example, film editing " Live Bright ") for playing back (exampleSuch as, it in Fig. 5 S, is put on by contact 5026 in playback diagram associated with media item and carries out tap input).In response to selectionMedia item starts media player application program, and shows the user interface of media player application program on the touchscreen(for example, user interface 5028).In Fig. 5 T, media player application program is in the first pattern (for example, have shown controlScreen mode toggle or interactive mode) operation.When just starting media playback, user interface 5028 includes being covered on media to returnMultiple control areas on region (for example, the media content for substantially taking up entire screen) are put, these control areas include eachKind control, such as media washer are used for closing media player application program and returning to Web-browser application" completion " button, volume slide control, rewinding control, pause/play control and the F.F. control at family interface 5024.These controlsBe initially shown on media playback region because user see for the first time media content seem or sound how after, willIt is possible that want to adjust the default initial position selected by equipment or volume, or back to previous application program.SomeIn embodiment, when being switched to media player user interface 5028 from web browser user interface 5024, scene switchingEvent is recorded by equipment, and based on when for the first time start media playback when positioned at show can indicate 5002 lower section media content onePartial initial integral brightness level, which redefines, to be shown and can indicate that 5002 show and can indicate appearance type.Regardless of whether redefiningAppearance type can be indicated by showing, initially be shown in user interface 5028 with fully visible state (for example, high contrast state)It can indicate 5002.
Fig. 5 U instruction is in the first predetermined time quantum (for example, 10 seconds) after media playback starting, control zoneDomain kept on media content as it can be seen that and show can indicate 5002 in user interface 5028 with fully visible state (for example, completeContrast state) it keeps.During this period of time, it is determined according to first group of rule and shows the appearance that can indicate 5002.In some implementationsIn scheme, first group of rule includes a set filter (such as, those filters shown in Fig. 5 E) and inverse relation is (such as,Those inverse relations shown in Fig. 5 R), wherein the first of filter group parameter and/or the shape of one or more reverse curveIt is optionally show the first state that can be indicated preselected.In Fig. 5 S to Fig. 5 U, showing can indicate that 5002-A is no color letterThe grey of breath, which is shown, to be indicated, even if lower section content is panchromatic.
In Fig. 5 V, the first predetermined time quantum (for example, 10 seconds) after media playback starting is had been switched off.In response to the first predetermined time quantum cut-off, control area stops on media content and shows.Control area is faded can winkShi Fasheng is occurred by short animation.First predetermined time quantum cut-off and/or control area stop at media playerShow instruction media player user interface now just in a second mode (for example, without the complete of shown control in user interfaceShield display pattern or media consumption mode) operation.In addition, end in response to the first predetermined time quantum, equipment according toSecond group of different rule of first group of rule, which determines, shows the appearance that can indicate 5002.In other words, showing can indicate with the second state(half visible state/low contrast state 5002-A') display.In some embodiments, second group of rule includes one group of filteringDevice (such as, those filters shown in Fig. 5 E) and inverse relation (such as, those inverse relations shown in Fig. 5 R), whereinSecond group of parameter of filter and/or the shape of one or more reverse curves be optionally show can indicate 5002 the second state(for example, half visible state/low contrast state 5002-A''s) is preselected.In some embodiments, in low contrast stateUnder, show some colors that can indicate content below 5002 holdings.For example, instead of by the complete desaturation of lower section content to obtain contentLuminance graph, by each pixel only 70% color value (for example, rgb value) desaturation, and each pixel in the content of lower section30% colouring information is to show that the FINAL APPEARANCE that can be indicated is kept.In some embodiments, it adjusts and shows the transparency that can be indicatedLevel, so that showing that it is not fully opaque for capable of indicating, and some colouring informations of lower section content are sent to and show and can indicatePixel.In some embodiments, execute brightness reversion after, show can indicate remaining color saturation increase (for example,Increase by 30%) so that showing can indicate to seem slightly more Animando, to preferably mix with background.5002 can be indicated by showingThe visibility or contrast of second state reduce allow for initial time section of the user after starting media playback for the first time itWant to reduce with a possibility that any widget interaction afterwards.In some embodiments, from first state to the transformation of the second stateOptionally be in multiple intermediate state between the first state and a second state gradually and continuous transformation, and it is unexpected and discreteTransformation is opposite.Gradually change the attention for being less likely dispersion user viewing media content.
As shown in Fig. 5 V to Fig. 5 W, it can indicate that 5002 are in the second state (for example, half visible state/low contrast when showingState 5002-A') when, show the appearance that can indicate 5002 based on second group of rule according to positioned at the change for showing the content below capable of indicatingChange and changes.
In Fig. 5 X, it can indicate that 5002 reach the second predetermined time quantum (for example, 5 seconds) in the second state showingLater, showing can indicate that 5002 are changed into invisible mode (for example, the referred to as third state) from the second state, or in other words,Showing can indicate to fade out and stop at completely on media content to show.In some embodiments, from the second state to third shapeThe transformation of state be optionally in multiple intermediate state between the second state and the third state gradually and continuous transformation, and it is prominentSo and discrete transition is opposite.Gradually change the attention for being less likely dispersion user viewing media content.
Fig. 5 Y to Fig. 5 AA show show can indicate 5002 no longer on media content 5028 show after, media playbackIt is continued until and detects input (for example, the movement of equipment, the tap carried out on the touchscreen by contact are inputted or gently swept defeatedEnter, the contact near the bottom edge region of display etc.).In response to detecting input, showing can be indicated 5002 in media contentIt is shown again on 5028.
As shown in Fig. 5 Y, in response to the movement of equipment 100, (or other kinds of input, such as contact is at the bottom of displayTap near portion's fringe region, gently sweep or touch-down), show can indicate 5002 with the second state (for example, half is visible/low rightThan degree state 5002-A') display (for example, together with other control areas) again on media content 5028.In some implementationsIt in scheme, is not shown again in response to the input control region, and equipment continues with the full frame of media player application programDisplay pattern (without shown control) operation.In some embodiments, if be not detected in threshold amount of time anotherInput (for example, tap inputs or gently sweep input), then stop showing and capable of indicating again.If detected in threshold amount of timeRequired input is then shown again with first state and shows and can indicate, and also optionally shows media control area again.User circleFace back to media player application program first operator scheme (for example, with shown control full screen playback mode,Or interactive mode).With shown with first state show can indicate 5002 and immediately return first operator scheme on the contrary, initial response inFirst input, which provides showing in the second state, can indicate that 5002 have provided a user and show the position that can be indicated and use about homeSome instructions of the state at family interface, but have also contemplated that input may be unintentionally and user is actually not intended to disperse simultaneouslyWatch the attention of media content.If user's it is intended that with control and/or show and can indicate 5002, needs from userConfirmation input (for example, the sustained touch carried out by the same contact that reaches threshold amount of time, by with threshold value by pressureThe pressing input or inputted by second of tap that another contact carries out that the same contact of degree carries out).
Fig. 5 Z and Fig. 5 AA are shown in some embodiments, show energy property 5002 (for example, such as institute in Fig. 5 X when not showingShow) when or can indicate 5002 when showing with the second state (for example, translucent/low contrast state 5002-A') (for example,As shown in Fig. 5 Y) when, the input carried out by contact (for example, contact 5030) is detected on the touchscreen.In response to by connecingThe input that touching 5030 carries out, with the second state (for example, half visible/low contrast state 5002-A') display (if not yet aobviousShow) show and can indicate 5002.In addition, media control area is also shown in media player user interface again.In other words, matchmakerBody player application returns to first operator scheme.In some embodiments, near the bottom edge region of displaySustained touch input show equipment again with the second state first to indicate (for example, when detecting contact), thenBeing shown again with first state can indicate (for example, being more than to be maintained less than amount of threshold shift from touch-down in contactWhen threshold amount of time).In some embodiments, after being shown again with first state and can indicate, when detecting contactMovement (what is do not contacted is lifted away from) when, equipment navigation by recognition gesture.In some embodiments, instead of requiring contact to be keptThe substantially stationary threshold amount of time that reaches is to be shown again and can be indicated with first state, and the intensity of equipment requirement contact is with smallIn contact amount of threshold shift be more than predefined light press intensity threshold.In some embodiments, with first state weightNewly show after capable of indicating, when detecting movement (what is do not contacted is lifted away from) of contact, equipment navigation by recognition gesture.
In Fig. 5 AA, the first mode of operation (for example, interaction mode) is returned in response to media player application program,Showing can indicate that 5002 also change back to first state from the second state (for example, half visible state/low contrast state 5002-A')(for example, fully visible state/high contrast state 5002-A).In some embodiments, from the second state to first stateTransformation be optionally discrete transition, it is opposite in multiple intermediate state between the first state and a second state.Turn suddenlyChange is possible to that the operation mode of user's user interface is reminded to change, and shortens the waiting time of user's access control simultaneouslySubsequent input is provided.In some embodiments, when detecting confirmation input (for example, in response to first time tap and with theTwo-state shows second of the tap shown after capable of indicating, or by triggering the same contact shown with the second status display and can indicatedThe sustained touch of progress) when, directly the state shown in Fig. 5 Y is changed into state shown in Fig. 5 AA, skips institute in Fig. 5 ZThe state shown.
Fig. 5 AB to Fig. 5 AC is shown can indicate according to showing for the backgrounds under different operation modes of some embodimentsDifference in appearance.
In Fig. 5 AB, show that the first state 5002-A that can be indicated is opaque, and in media player user interfaceTo use when the first mode of operation (for example, interaction mode) operation and when showing media control on media content.SecondState 5002-A' is translucent, and in media player user interface with the second mode of operation (for example, protected shapeState or media consumption state) operation and the use when not showing media control on media content.The third state is no longer to showShowing can indicate and user interface continues the shape that operates with the second mode of operation (for example, protected state or media consumption state)State.It is not received by when in time quantum predetermined after starting media player (for example, with full frame or transverse mode)When input, showing can indicate that 5002 pass through these states.
In Fig. 5 AC, showing can indicate to start with invisible mode or not show on media content (for example, due to notStop showing and capable of indicating after 5002 there are user's input).In response to the first input of input or first part, with secondStatus display, which is shown, to be indicated, at the same media player user interface with the second mode of operation (for example, protected state or media disappearTake state) it keeps.Then, it in response to the second input of input or second part, is shown with first state 5002-A and shows and can indicate,And user interface returns to the first mode of operation (for example, interaction mode).In first state 5002-A, showing can indicate to be notTransparent.In the second state 5002-A', showing can indicate to be translucent.
In some embodiments, showing showing of can indicating can indicate that appearance type is fixed, and become in lower section contentIt will not change when change.This provide it is consistent show can indicate appearance, the interference to user can be reduced.However, in some scene kinds,When showing that the content change that can be indicated is very big, after content is tuned as whole light tone from whole dead color, fixedShowing can indicate that type possibly can not provide enough contrasts or vice versa in the background of lower section.In addition, sometimes, content is brightThe switching of degree level is short-term switching (for example, rolling through the black text row in white background), and in this case,Switch in response to this short-term change show can indicate type may be it is inefficient, obscure user and the attention of dispersion userPower.On the other hand, if the switching of content luminance level be more permanent or long-term switching (for example, from page (for example,Show the warm-toned page of evening sky) it is turned to another page (for example, display starlit night scene)), then it keeps showing and capable of indicatingFixed may cause of appearance type shows that the visibility that can be indicated is extending deficiency in the period.
To solve the above-mentioned problems, maintain the demand of visibility without causing undue disturbance to user in still balanceWhile, in some embodiments, equipment, which allows to show, can indicate switching it shows and can indicate appearance type, and correspondingly, whenWhen meeting predefined range switching standards, showing for value can be indicated that appearance value range is shifted from a value range as another valueRange.In some embodiments, when be located at show can indicate below (and being optionally disposed in around it) content entirety it is brightThe measurement (for example, accumulated value and polymerizing value of brightness value) of degree state is since the appearance of content changes over time and is more than predefinedWhen threshold value, that is, meet range switching standards.In some embodiments, the measurement of the overall brightness state of content considers one sectionThe luminance level (for example, using the operation mean value of weighting) of the relevant portion of content in time, and be also partial to keep showingCan indicate currently show can indicate appearance type it is constant (for example, be biased to optionally by assign content older luminance level compared withHigh weight and assign the smaller weight of newer luminance level of content to realize).Due to showing energy with cumulative effect and to currentThe deviation for indicating appearance type, the temporary variation relative to content keep showing the short-term goal that can indicate appearance stablity, Yi JiPersistently provided in the content of variation it is enough show can indicate that high-lighting is satisfied.
Fig. 5 AD shows the user interface according to some embodiments, which includes being based on lower section content at any timeBetween change and showing that can indicate dynamically to switch between appearance type show and can indicate.
Fig. 5 A shows simple example, wherein showing can indicate that 5002 can indicate to start (for example, initially locating as hintIt is shown in the user interface of state as shown in figure 5g).Then, positioned at show can indicate 5002 lower section content for example pass throughRolling becomes relatively bright state (for example, the state for becoming user interface as shown in fig. 5k).In this example, show energyIndicate that 5002 show and can indicate that appearance type does not change during rolling content, such as the reason is that rolling is relatively fast, andShowing of being partial to keep currently selecting can indicate that appearance type not yet passes the cosmetic variation of content in the short time and is overcome.InStop after rolling content, showing can indicate still to be covered in content shown in bright state.As time goes by, content is wholeBody luminance state gradually changes, and the luminance level of current background is gradually taken over and the brightness water of the background of leading previously illustratedIt is flat (for example, when be initially displayed show can indicate when or during rolling content).Finally, at time t1, the overall brightness of backgroundThe measurement of state is more than predefined thresholds, and meets range handover trigger standard.In some embodiments, in response to detectionTo meeting range handover trigger standard, equipment switches immediately to be shown and can indicate appearance type, and can indicate outer according to showing for newly selectingIt sees type to show and shows and can indicate, such as shown on the user interface on the right side of Fig. 5 AD.Show in the appearance that can be indicated and Fig. 5 LShown in appearance it is identical, but in this example, user need not close Web-browser application and restart it to makeShowing, which can indicate to be shown as bright in content 5018, shows and can indicate.
In some embodiments, when meeting range handover trigger standard, equipment, which starts to show from first, can indicate appearanceType (for example, imply can indicate appearance type) be gradually converted into second show can indicate appearance type (for example, it is bright show can indicate outsideSee type).For example, showing can indicate that appearance value range passes through during the predetermined transformation period (for example, T=t2-t1,5 seconds)Cross one or more intermediate ranges between the first appearance type and the value range of the second appearance type.During changing the periodAny moment shows that the appearance that can be indicated is based on being currently used as showing the specific intermediate range that can indicate appearance value range come reallyFixed.As shown in the intermediate user interface in Fig. 5 AD, in the identical situation of background content, showing can indicate there is intermediate luminanceLevel, the intermediate brightness levels between imply can indicate and it is bright show can indicate between.
In some embodiments, during changing the period, the measurement of the overall brightness state of lower section content at any time afterIt is continuous to update, wherein at the nearlyr time at the luminance level adapter tube earlier time of content content luminance level.If met againRange handover trigger standard is (for example, having can indicate outside for the same threshold that more early switches or depending on showing of currently selectingSee type different threshold values), then be not fully complete to second and show the switching that can indicate appearance type, and show can indicate returnAppearance type can be indicated by showing to first.In this particular example, content does not change, and will no longer satisfy during changing the periodRange handover trigger standard, as a result, complete at time t2 (for example, the period between t1 and t2 is the predefined transformation period)It is accomplished to second and shows the switching that can indicate appearance type.Be accomplished to second show the switching that can indicate appearance type after, lower sectionThe measurement of the overall brightness state of content continues to update at any time, and when due to lower section content accumulated change (for example, due toHandover situations, rolling etc.) when meeting range handover trigger standard again, switching can return to first again, which to be shown, can indicate appearanceType.
Fig. 5 AE, which is shown, shows that the display properties (for example, brightness) that can be indicated shows energy table with bright according to some embodimentsShow that appearance type (A), hint can indicate that appearance type (C) and transformation show the value model that can indicate the lower section content of appearance type (B)It encloses and inverse relation.In some embodiments, reverse curve shown in Fig. 5 AE is optionally for showing in generation Fig. 5 ADIt can indicate 5002 appearance.
In the example shown in 5AE, different appearances show can indicate type (A), (B), (C) the shape of reverse curve beIt is identical.Allow the background value of each point in calculating figure using the reverse curve with same shape and show to indicate brightCorresponding relationship value between angle value simultaneously stores it in tables of data so that when show can indicate transformation between type continuously acrossWhen many intermediate ranges, the brightness of respective pixel in background can be based at least partially on by the lookup in table come simply reallySurely show the brightness of each pixel on capable of indicating.For example, during changing the period, each of multiple evenly spaced time pointsTime point shows that the corresponding intermediate range between energy table indication range and hint energy table indication range is associated to bright, and even ifThe content consecutive variations during changing the period, showing can indicate that appearance still can pair of the place based on the time point at every point of timeThe reverse curve of intermediate range is answered quickly to determine.
As shown in Fig. 5 AE, reverse curve 5032 includes two discontinuity poinies.Left side discontinuity point 5034 is introduced to solveCertainly interference point (for example, at 25.4% background luminance), the noise spot are the isopleth of brightness 5036 (for example, brightness=back can be indicated by showingScape brightness) interception and the not no reverse curve of discontinuity point.Left side discontinuity point, which allows to show, can indicate to have and background luminanceNot exactly the same brightness value, to avoid occurring " invisible " in some special cases showing a possibility that capable of indicating.It is similarGround introduces right side discontinuity point 5038 to solve interference point (for example, at 74.51% brightness), which is the isopleth of brightnessThe reverse curve of 5036 interception and not discontinuity point.Right side discontinuity point, which allows to show, can indicate with endless with background luminanceExactly the same brightness value, to avoid occurring " invisible " in some special cases showing a possibility that capable of indicating.
In addition, can indicate that brightness carries out special correction to showing, therefore will not be always near discontinuity point 5036 and 5038Observe stringent reversion (can indicate brightness for example, increasing background luminance and showing corresponding to reduction, vice versa).For example, on a left sideIn the correction zone of side discontinuity point 5036, showing on the side with higher background luminance can indicate brightness relatively flat, and haveThere is showing on the side of lower background luminance that can indicate that brightness includes the smaller reversion of normal inverse relation.In right side discontinuity pointIn 5038 correction zone, with lower background luminance side on showing can indicate brightness include normal inverse relation relativelyBig reversion.The design of the accurate shape of these correction zones considers human vision to the responsiveness of the brightness value in these areas, withAnd show the needs that can indicate that enough contrasts are generated between background near interference point.For example, the width of interference region and rightThe adjusting of normal inverse relation depends on the comparison measurement that the showing in background at these interference points can indicate required.
Figure each of (A), (B) and (C) shown in Fig. 5 AE further includes background luminance item and shows and can indicate to respond item(being shown in below graph region).The background luminance item of each figure and showing can indicate that responding item shows according to the reversion in same figureThe correspondence background luminance and show and can indicate brightness that curve 5032 generates.In addition, implying that the background color for the figure (A) that can be indicated is whiteColor, allow to show imply can indicate all shades (e.g., including showing for black completely can indicate, but not include completeWhite is shown and can be indicated).The bright background color for showing the figure (C) that can be indicated is black, allows to show the bright institute that shows and can indicateHave shade (e.g., including completely white show and can indicate, but do not include that can indicate showing for complete black).Transformation is shown and can be indicatedThe background color for scheming (B) is grey (50% brightness).Background luminance can indicate that brightness is slightly more shallow ash for 50% showColor (for example, brightness value is lower than 50%), such as by the way that showing along trunnion axis half can be indicated response and at the bottom of figure (B)Shown in 50% grey bar of display is compared.
Fig. 5 AF is shown can indicate appearance type (for example, scheming according to showing by multiple transformations for some embodiments(B-1), (B-2), indicate in (B-3)) can indicate that appearance type (for example, indicating in figure (A)) is shown and can be indicated to bright from implyingThe gradually transfer of appearance type (for example, being indicated in figure (C)).
In some embodiments, when meeting range handover trigger standard at time t1, equipment starts to show from firstCan indicate that appearance type (for example, imply can indicate appearance type) is gradually converted into second and shows can indicate appearance type (for example, brightAppearance type can be indicated by showing).Then, during predetermined transformation period (for example, T=t2-t1), appearance value can be indicated by showingRange is by multiple intermediate ranges (for example, what the sum of intermediate range can be indicated depending on the refresh rate and hint of displayThe gap of the value between the upper limit of brightness and 1 can be indicated by showing) turn between the first appearance type and the value range of the second appearance typeMove (for example, depend on switching direction and upward or downward).At any moment during changing period T, showing can indicate outerSight is determined based on specific intermediate range, which, which is currently used as showing, can indicate appearance value range.
In some embodiments, during changing the period, the measurement of the overall brightness state of lower section content at any time afterIt is continuous to update, wherein at the nearlyr time at the luminance level adapter tube earlier time of content content luminance level.If met againRange handover trigger standard is (for example, having can indicate outside for the same threshold that more early switches or depending on showing of currently selectingSee the different threshold values of type), then it is not fully complete to second and shows the switching that can indicate appearance type, and show and can indicate appearanceThe transfer of value range, which inverts on direction and shows to indicate finally to can return to first and show, can indicate appearance type.If changingRange handover trigger standard is not met during period for the second time, then appearance can be indicated by being accomplished to second at the end of changing the period and showingThe switching of type.Be accomplished to second show the switching that can indicate appearance type after, the degree of the overall brightness state of lower section contentAmount continue to update at any time, and when due to lower section content accumulated change (for example, due to handover situations, rollings etc.) anotherWhen meeting range handover trigger standard, switching can return to first again, which to be shown, can indicate appearance type.
In the example shown in 5AF, different appearances, which are shown, can indicate type (A), (B-1), (B-2), (B-3) and (C)The shape of reverse curve is identical.Allow each point in calculating figure (or each using the reverse curve with same shapeThe reverse curve of intermediate range) background value and show and can indicate the corresponding relationship value between brightness value and store it inIt, can at least partly ground so that when showing can indicate transformation between type continuously across many intermediate ranges in tables of dataThe brightness of respective pixel shows each pixel on capable of indicating by the quick lookup in tables of data simply to determine in backgroundBrightness.For example, each time point in multiple evenly spaced time points shows energy expression value model with bright during changing the periodIt encloses and implies that the corresponding intermediate range between energy table indication range is associated, and even if content is continuous during changing the periodVariation and lower section content are showing below the different piece that can be indicated that showing can indicate that appearance still may be used with very big brightness changeTo locate quickly to determine based on data pre-stored in tables of data at every point of time.
Fig. 5 AG to Fig. 5 AK is to show that the display properties that can be indicated is different from shown in Fig. 5 AF to show the lower section that can indicate typeThe amplification copy of the inverse relation of content.
Fig. 6 A to Fig. 6 C is to show to show energy table according to changing according to the cosmetic variation of lower section content for some embodimentsThe flow chart of the method 6000 for the appearance shown.Method 6000 is in the electronic equipment with display and touch sensitive surface (for example, equipment300, Fig. 3;Or portable multifunction device 100, Figure 1A) on execute.In some embodiments, electronic equipment include forDetect the one or more sensors of the intensity of the contact of touch sensitive surface.In some embodiments, the touch sensitive surface and displayDevice is integrated into touch-sensitive display.In some embodiments, display is touch-screen display, and touch sensitive surface is in displayIt is upper or integrated with display.In some embodiments, display is to separate with touch sensitive surface.Some behaviour in method 6000It is optionally combined and/or the sequence of some operations is optionally changed.
Method 6000, which is related to showing in terms of content as follows, to be shown and can indicate (to indicate the gesture for showing home screenShowing for acceptable initiation region can indicate): display properties (for example, gray value or brightness value) wherein based on lower section content becomesChange dynamically changes the same display attribute shown and can indicated.In particular, show the value of the display properties that can be indicated with lower section inThe value of the same display attribute of appearance changes variation on opposite direction (for example, showing that the gray value that can be indicated is the ash of lower section contentThe reversion of angle value).In addition, showing that the value for the display properties that can be indicated is confined to the value smaller than the value of the display properties of lower section contentRange.Therefore, equipment can be shown and can indicate less to take sb's mind off sth or less there is intrusive mode to provide, simultaneouslyIt keeps enough when the appearance of content continues variation (for example, due to rolling, scene switches and dynamic content playback) and shows energy tableShow visibility.There is provided in a manner described herein, there is the showing for appearance of the appearance dynamic change based on lower section content can indicate,The operability of equipment is enhanced (for example, passing through the guidance for providing a user the required input about expected result without to useUndue disturbance is caused at family, this can reduce user's mistake when operation equipment), and make the more effective (example of user's equipment interfaceUser's mistake when such as, by helping user to realize expected results using required input and reducing operation equipment/interact with equipmentAccidentally), so as to improve equipment battery life (for example, by help user more rapidly, more efficiently use equipment).With hereinThe mode, which provides, to be shown and can indicate to allow to show on screen and can indicate effectively to replace in many different user interface scenesThe hardware button of identical function (for example, display home screen) is provided, this manufacturing cost for helping to reduce equipment and maintenance atThis.Furthermore, it desired to which the solution of protection constrains the value range shown and can indicated, shows and can indicate between background content to eliminateWhite background black and black matrix white contrast, so that mitigating can indicate and lead due to showing for a long time in white background or black backgroundThe risk of the display image retention of cause.The known reason for leading to screen image retention is to show non-moving images (for example, system-level for a long timeShowing can indicate, such as home gesture indicator), in addition non-homogeneous use pixel (for example, this is between foreground and background contentIt is most serious in the case that contrast is high).(show and can indicate for example, implementing system-level home) under certain usage scenarios, instituteThe solution (for example, reducing Very High Contrast, while keeping showing the vision high-lighting that can be indicated) of proposition efficiently solvesImage retention problem.Image retention problem and its reason in the display of mobile phone are documented in trade literature for many years, andAnd it is still present in many commercial product problems.Up to the present, it has attempted to show and can indicate on the screen everywhere by allowingMovement only disappears after a period of time is inactive to solve the problems, such as this.However, this solution can make equipment canOperability becomes worse.(display properties of content is reversed in display attribute value claimed solution below whereinSubrange in determination show that the value for the same display attribute that can be indicated provides the foundation) allow to show energy in same position useIndicate the risk that image retention is generated without having.
Method 6000 is in the equipment with display and touch sensitive surface (for example, serving as both display and touch sensitive surfaceTouch-screen display) on execute.Equipment shows (6002) content (for example, home screen, desktop small routine screen over the displayCurtain, desktop, the user interface of application program, media player user interface etc.) and show and can indicate (for example, on indication displayThe home of home gesture conversion zone show and can indicate), in which: showing in a part of content can indicate;Showing can indicateDisplay properties (for example, gray value or brightness value of image (for example, color image or monochrome image)) value, except gray value orIntrinsic display parameters (for example, the tone of full-colour image, saturation degree etc.) except brightness value, or it is intrinsic based on one or moreThe derivation display parameters that display parameters (for example, gray value or brightness value or its variant or equivalent of full-colour image) calculate)It is to be determined based on the value for the same display attribute for showing a part that can indicate the content shown on it;And allow contentThe value of display properties in the first value range, (for example, range [0,1], such as " range " is mathematically defined as range maximumBe worth different the value difference between stated range minimum) in variation, and show that the value for the display properties that can be indicated is confined to less than theThe second value range of one value range is (for example, in range [0,0.4], [0.6,1], [0.1,0.7], [0,0.7] or [0.3,1] etc.One of, " subrange " of " the first range " is defined as maximum value and is greater than the less than the maximum value and minimum value of the first rangeThe range or maximum value of the minimum value of one range are less than the maximum value and minimum value of the first range and the minimum value of the first rangeIdentical range or maximum value is identical as the maximum value of the first range and minimum value be greater than the first range minimum value modelEnclose) in variation;When display content and show that the cosmetic variation for the content that can be indicated is shown in equipment detection (6004) when can indicate.In response to detecting that display shows that the cosmetic variation for the content that can be indicated, equipment change (6006) and show the appearance that can be indicated, comprising: rootReduced according to the value of display properties for determining content, according to the amplitude of variation of the value of the display properties of content and second value range comeIncrease show the display properties that can be indicated value (for example, when be located at show can indicate below content become darker when, show can indicate changeIt obtains brighter);And increased according to the value for the display properties for determining content, according to the amplitude of variation of the value of the display properties of contentReduce the value for showing the display properties that can be indicated with second value range (for example, showing that the content below capable of indicating becomes more when being located atWhen bright, showing can indicate to become darker).This shows in such as Fig. 5 F, Fig. 5 G to Fig. 5 P, Fig. 5 Q and Fig. 5 R, wherein showing can indicateDisplay properties (for example, brightness) according to the variation of the same display attribute (for example, brightness) of lower section content (for example, in rollingWhen appearance) and change.In addition, showing for display properties (for example, brightness) can indicate that appearance value range is confined to the phase of lower section contentWith the value range (for example, from black (for example, 0 or 0%) to the total head range of white (for example, 1 or 100%)) of display propertiesSubrange.
In some embodiments, the cosmetic variation of content be (6008) as caused by content navigation (for example, due to interiorRolling, paging of appearance etc., which cause to be located at, shows that a part of content below capable of indicating changes).For example, this is in Fig. 5 G to figureIt is shown in 5P.Change, which is shown, while in lower section, the display properties of content is changed due to content navigation can indicate identical aobviousThe value for showing attribute enhances the operability of equipment (for example, showing that can indicate can by keeping enough in entire content is navigatedOpinion property, and help user provide realize expected result needed for input), and keep user facility operation more effective (for example, passing throughUser's mistake when reducing to interference caused by user security risk and reducing using equipment or interacted with equipment), in addition improve functionRate efficiency and equipment battery life (for example, by reduce user's mistake and help user more rapidly, more efficiently use and setIt is standby).
In some embodiments, the cosmetic variation of content be (6010) caused by content changes over time (for example,Content is video or animation being played on, and the image of shown video or animation changes over time).For example, thisIt is shown in Fig. 5 T to Fig. 5 U.In lower section, the display properties of content changes while change and shows since content changes over timeThe value for the same display attribute that can be indicated, enhances the operability of equipment (for example, by changing over time in entire contentKept in journey it is enough show can indicate visibility, and help user provide realize expected result needed for input), and make userEquipment operation is more effective (for example, use when by reducing to interference caused by user security risk and reduce using equipment or interact with equipmentFamily mistake), in addition improve the battery life of power efficiency and equipment (for example, by reducing user's mistake and helping to useFamily more rapidly, more efficiently use equipment).
In some embodiments, showing can indicate there is (6012) first variants and the second variant, which hasFor first group of end value of second value range, which has second group of end value for second value range, second group of endValue is different from first group of end value, and (for example, for " bright to show and indicate " that initially shows in bright background, second value range has theOne starting point and First terminal point, and " hint can indicate " for initially showing on a dark background, second value range has differenceSecond starting point and second terminal different from the first starting point and the second terminal).For example, this shows in Fig. 5 A and Fig. 5 R.OneIn a little embodiments, the value range of the first variant is not Chong Die with the value range of the second variant (for example, the value model of " bright to show and indicate "The all values enclosed are greater than all values in the value range of " implying can indicate ").There is provided, there is showing for different value range can indicateTwo variants allow equipment to further increase the visibility that shows and can indicate, while holding shows the appearance that can be indicated in different typeContent on not high-lighting, to enhance the operability of equipment (for example, by keeping enough for different types of contentVisibility can be indicated by showing, and help user provide realize expected result needed for input), and keep user facility operation more effective(for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, according to determining that content corresponds to the first application program (6014) and show and can indicate to showFirst variant, and second application program different from the first application program is corresponded to according to determining content and shows and can indicate to showThe second variant (for example, used in the application program currently shown " bright " is shown with " dark " can indicate to be answered by what is currently shownIt is selected with the application developer of program, and equipment is shown according to what is specified in the program code of the application program currently shownCan indicate the respective sets end value of selection parameter or second value range show show the first variant that can be indicated or the second variant (for example,When the value for the display properties that can be indicated is shown in change, the first group of end value or second group of end value of second value range are used)).AllowDifferent application programs can indicate that variant is facilitated application developer and made by oneself based on application scenario using different showingJustice shows the appearance that can be indicated, thus further increase show it is compatible between the appearance and the appearance of application content that can be indicatedProperty, thus enhance equipment operability (for example, by keep it is enough show visibility can be indicated without causing not to userInterference appropriate, and help user provide realize expected result needed for input), and make user facility operation more effective(for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, show that the outward appearance change (6016) of the first part for the content that can be indicated is shown with displayThe different amount of the appearance of the second part for the content that can be indicated;And changes and show that the appearance that can be indicated includes by first with contentThe corresponding outward appearance change for showing the first part that can be indicated in part is corresponding with the second part of content to be shown and can indicateThe different amount of the appearance of second part is (for example, showing can indicate according to positioned at the corresponding content shown below the first part that can be indicatedA part appearance variation and change).For example, this shows in Fig. 5 Q.For example, if lower section content change is (for example, showEnergy expression is fuzzy/desaturation/inverted version of a part of content), then show the cosmetic variation that can be indicated, and show and can indicateThe appearance of different piece reflect the appearance for being located at and showing content below the different piece that can be indicated.Allow based in lower sectionThe difference variable quantity is applied to show the different portions that can be indicated by the different variable quantities occurred in the display properties of the different piece of appearanceThe display properties divided, enhances the operability of equipment (for example, showing and can indicate by keeping enough in entire content changesVisibility, and help user provide realize expected result needed for input), and keep user facility operation more effective (for example, logicalCross user's mistake when reducing to interference caused by user security risk and reducing using equipment or interact with equipment), in addition improvePower efficiency and equipment battery life (for example, by reduce user's mistake and help user more rapidly, more efficiently use and setIt is standby).
In some embodiments, the first value range is (6018) successive value range, and second value range includes not connectingContinuous point, the discontinuity point are corresponding at least the first value of display properties in the first value range.For example, in some embodimentsIn, for being located at the display properties for showing the content that can indicate lower section close to 0.5 small value range, show the display properties that can be indicatedValue is discontinuous, and jumps to the second value higher than 0.5 from the first value lower than 0.5.In some embodiments, equipment makesThe value for showing the same display attribute that can be indicated is calculated based on the value of the display properties of lower section content with discontinuous function, with trueIt protects and shows that the appearance that can be indicated will not get too close to the appearance of lower section content (for example, can indicate be shown in ensure that grey is shownGray value and the grey are shown on the grey content that can indicate very close).Fig. 5 AE shows the display properties that can be indicatedThe reverse curve including two discontinuity poinies (for example, 5034 and 5038) of value.Using showing not connecting for the display properties that can be indicatedThe successive value range that continuous value range keeps the value of lower section content to show simultaneously, which helps avoid showing, can indicate that the value used excessively connectsThe value of nearly lower section content can indicate visibility deficiency so as to cause showing.Use the discrete value model for showing the display properties that can be indicatedEnclose enhance equipment operability (for example, by kept in entire content changes it is enough show can indicate visibility, and helpHelp user provide realize expected result needed for input), and make user facility operation it is more effective (for example, by reduce toUser's mistake when being interfered caused by family and reducing using equipment or interacted with equipment), thus in addition improve power efficiency andEquipment battery life (for example, by reduce user's mistake and help user more rapidly, more efficiently use equipment).
In some embodiments, showing can indicate to have (6020) first variants and the second variant (for example, " bright to show energy tableShow " and " hint can indicate "), the first value range corresponding with the first variant that can be indicated is shown and with show the second change that can be indicatedThe corresponding second value range of body is not overlapped (for example, the value range quilt of the value range of " bright to show and indicate " and " implying can indicate "" cutoff value range " separates), and equipment is dynamically selected one of the first variant and the second variant, predeterminedTime (for example, when application program launching, or when in video there are when scene changes, or when the user interface in application programWhen switching etc.) initial value of the display properties based on content shows in terms of content.For example, if content initially has darker ashAngle value (for example, less than 0.5), then the initial value (for example, being greater than 0.6) in bright intensity value ranges can be indicated by showing;And such asFruit content initially has brighter gray value (for example, being greater than 0.5), then the initial value within the scope of dark gray can be indicated by showing(for example, less than 0.4).Show that the accurate greyscale value that can be indicated is obtained optionally by following procedure: by with show can indicate justBeginning appearance is associated bright or the correspondence inverted functions of dark value range invert the gray value of content.In some embodiments,If showing that can indicate is that be initially shown on dark content (for example, gray value be 0.2) bright is shown and can be indicated (for example, gray value is0.9), then when showing can indicate that following content becomes more and more brighter (for example, gray value increases towards 1), showing can indicate to becomeDarkness deepens (for example, gray value towards 0 reduce), but show the gray value that can indicate by minimum threshold gray value (for example,0.6) constraint, the minimum threshold gray value are still brighter than the center gray value (for example, 0.5) on gray scale [0,1].It can table when showingShow following content become that darkness deepens (for example, gray value reduces towards 0) when, showing can indicate to become more and more brighter (for example, greyAngle value increases towards 1), until when content becomes complete black, it becomes white completely (for example, reaching on gray scale [0,1]End value 1).In another example, if show can indicate be initially shown in it is dark on bright content (for example, gray value be 0.9)Show and can indicate (for example, gray value is 0.2), then can indicate that following content becomes that darkness deepens (for example, gray value direction when showing0 reduces) when, showing can indicate to become more and more brighter (for example, gray value direction 1 increase), but show the gray value that can indicate byThe constraint of max-thresholds gray value (for example, 0.4), the max-thresholds gray value is still than the center gray value on gray scale [0,1](for example, 0.5) is dark.When showing can indicate that following content becomes more and more brighter (for example, gray value increases towards 1), showing can tableShowing becomes that darkness deepens (for example, gray value reduces towards 0), until when content becomes complete white, it becomes complete black(for example, reaching the end value 0 on gray scale [0,1]).Fig. 5 G shows the initial overall brightness based on relatively darker lower section contentState come select imply can indicate, and Fig. 5 L show the initial overall brightness state based on relatively bright lower section content comeIt selects bright to show and can indicate.Allow application program from show can indicate two different variants (for example, for darker content with it is brighter interiorHold) in be dynamically selected, further improve and the appearance that can be indicated shown based on application scenario, to further mentionIt is high show can compatibility between the appearance that indicated and the appearance of lower section content, thus enhance equipment operability (for example,By keep it is enough show can indicate visibility without causing undue disturbance to user, and help user provide realize expectationAs a result the input needed for), and make user facility operation more effective (for example, by reducing to interference caused by user security risk and subtractingUser's mistake using equipment or when being interacted with equipment less).
In some embodiments, show can indicate include (6022) when equipment is in first orientation with first size(for example, near bottom margin of equipment), which shows, to be indicated, and this method comprises: shows energy table when showing with first sizeWhen showing, rotation of the detection device from first orientation to the second orientation different from first orientation is (for example, the rotation of equipment makes to showThe content shown from the first user interface be orientated (for example, machine-direction oriented) become second user interface be orientated (for example, laterally takeTo));And in response to detecting rotation of the equipment from first orientation to second orientation, with second ruler different from first sizeIt is very little show can indicate (and optionally, at different locations (for example, as second orientation based on equipment limit equipmentNear new bottom margin) show and can indicate)).In some embodiments, the longer version of display when equipment is in horizontal orientationThis shows and can indicate, and shows that showing for shortened version can indicate when equipment is in machine-direction oriented.It is shown in slewingIt is various sizes of show can indicate to improve that show can be between the orientation (and being therefore the orientation of content) of the appearance that indicated and equipmentVision compatibility, thus enhance equipment operability (for example, by keep it is enough show can indicate visibility without toUser causes undue disturbance, and help user provide realize expected result needed for input), and user equipment is graspedMake more effective (for example, user when by reducing to interference caused by user security risk and reduce using equipment or interact with equipment is wrongAccidentally).
In some embodiments, display properties be (6024) gray value (for example, gray value have total head range [0,1],Indicate intensity value ranges from black (for example, gray value=0) to white (for example, gray value=1).It provides based on lower section contentWhat gray value changed its gray value shows the operability that can indicate to enhance equipment (for example, by keeping enough showing and capable of indicatingVisibility without causing undue disturbance to user, and help user provide realize expected result needed for input), and makeIt is more effective (for example, by reducing to interference caused by user security risk and reducing using equipment or interact with equipment to obtain user facility operationWhen user's mistake).
In some embodiments, the current value of the display properties of content is obtained by obscuring a part of content(6026) (for example, being shown by the way that the ambiguity function (for example, Gaussian blurring function) with predefined blur radius to be applied to be located atIt can indicate the content area of lower section, and will be applied to be located at the ambiguity function of at least one blur radius and show and can indicate justAround the content area of lower section).In some embodiments, it after content is fuzzy, using other filters, such as goes to satisfyWith and/or change opacity.The identical display category that there is the display properties of the lower section content based on blurry versions to derive is providedProperty show and can indicate, enhance equipment operability (for example, by keep it is enough show visibility can be indicated without to userCause undue disturbance, and help user provide realize expected result needed for input), and make user facility operation moreEffectively (for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, the current value of the display properties of content is (6028) by going to satisfy a part of contentWith come obtain (for example, by will be located at show can indicate below content area each pixel color value (for example, rgb value,HSL value or HSV value) or the region around at least one blur radius conversion monochromatizing scale (for example, gray scale) on correspondenceScalar value (for example, gray value)).In some embodiments, after by content desaturation, using other filters, such asFuzzy and/or change opacity.The identical aobvious of the display properties derivation for having the lower section content based on desaturation version is providedShow that showing for attribute can indicate, enhance equipment operability (for example, by keep it is enough show can indicate visibility without toUser causes undue disturbance, and help user provide realize expected result needed for input), and user equipment is graspedMake more effective (for example, user when by reducing to interference caused by user security risk and reduce using equipment or interact with equipment is wrongAccidentally).
In some embodiments, showing can indicate that instruction (6030) is used to start the conversion zone of Pre-defined gesture input(for example, for showing the home/ multitask gesture of home screen and/or application program switch user interface).For example, thisIt is shown in Fig. 5 A to Fig. 5 D.In some embodiments, show that can indicate is not practical button.Tap or pressing show that energy table will not touchSend out any function of equipment.In some embodiments, when no longer showing can indicate (for example, at it with application programAfter screen mode toggle fades out), predefined gesture (for example, home/ multitask gesture) is still as when display, which is shown, to be indicatedIt works like that.In some embodiments, when detecting user's input (for example, light on home/ multitask gesture or displayHit input etc.) when, being shown again with full screen content display pattern can indicate.This shows that can indicate is that height and length are smallerIt is narrow to show and indicate.Indicate that showing for the conversion zone for starting Pre-defined gesture can indicate to be not usually required to have relative to lower sectionThe visibility of content especially enhanced, it is more advantageous because the conversion zone of gesture is usually more roomy than the conversion zone of buttonBe to show to indicate that the interference to user can be reduced, so that user when helping avoid interacting with equipment malfunctions.Therefore, withManner described herein use with dynamic change display properties show can indicate to enhance equipment operability (for example,By keep it is enough show can indicate visibility without causing undue disturbance to user, and help user provide realize expectationAs a result the input needed for), and make user facility operation more effective (for example, by reducing to interference caused by user security risk and subtractingUser's mistake using equipment or when being interacted with equipment less).
It should be appreciated that the particular order that the operation in Fig. 6 A to Fig. 6 C is described is only exemplary, not purportShowing that the sequence is the unique order that can execute these operations.Those skilled in the art will recognize that various waysTo resequence to operations described herein.Additionally, it should be noted that herein in regard to other methods as described herein (for example,Method 7000 and method 8000) description other processes details equally in a similar way be suitable for above for Fig. 6 A to schemeThe method 6000 of 6C description.For example, being regarded above with reference to the contact of the description of method 6000, gesture, user interface object, application programFigure, control panel, control, show can indicate, position threshold, direction condition, reverse curve, filter, value range, navigation standard,Moving parameter, focus selector and/or animation optionally have herein with reference to other methods as described herein (for example, method7000 with 8000) description contacts, gesture, user interface object, application view, control panel, control, position threshold,One or more of direction condition, navigation standard, moving parameter, focus selector and/or feature of animation.It is risen in order to conciseSee, these details are not repeated herein.
Operation in above- mentioned information processing method is optionally by one or more functions in operation information processing equipmentModule realizes, all for example general processors of the information processing equipment (for example, as above in regard to described in Figure 1A and Fig. 3)Or the chip specific to application.
Operation above with reference to Fig. 6 A to Fig. 6 C description is optionally implemented by component that Figure 1A describes into Figure 1B.ExampleSuch as, detection operation and change operation are optionally by event classifier 170, event recognizer 180 and button.onrelease 190 realIt applies.Event monitor 171 in event classifier 170 detects the contact on touch-sensitive display 112, and event dispatcher mouldEvent information is transmitted to application program 136-1 by block 174.The corresponding event identifier 180 of application program 136-1 is by event information186 are defined with corresponding event to be compared, and whether determine the first contact on touch sensitive surface at first position (or the equipmentRotation whether) correspond to predefined event or subevent, such as selection to the object in user interface or the equipment fromRotation of one orientation to another orientation.When detecting corresponding predefined event or subevent, event recognizer 180Activate button.onrelease 190 associated with the detection to the event or subevent.Button.onrelease 190 optionally usesOr data renovator 176 or object renovator 177 is called to carry out more new application internal state 192.In some embodiments,Button.onrelease 190 accesses corresponding GUI renovator 178 and carrys out content shown by more new application.Similarly, this fieldTechnical staff can know clearly based in Figure 1A, into Figure 1B, how discribed component can realize other processes.
Fig. 7 A to Fig. 7 E is to show to show and can indicate according to the cosmetic variation and display according to lower section content of some schemesThe patterns of change of user interface changes the flow chart of the method for showing the appearance that can be indicated.Method 7000 is with display and touchingThe electronic equipment of sensitive surfaces is (for example, equipment 300, Fig. 3;Or portable multifunction device 100, Figure 1A) on execute.In some realitiesIt applies in scheme, electronic equipment includes the one or more sensors of the intensity for the contact with touch sensitive surface is detected.SomeIn embodiment, the touch sensitive surface and display are integrated into touch-sensitive display.In some embodiments, display is touch screenDisplay, and touch sensitive surface is over the display or integrated with display.In some embodiments, display and touch sensitive surfaceIt is separated.Some operations in method 600 are optionally combined and/or the sequence of some operations is optionally changed.
Method 7000, which is related to showing on application program user interface as follows, can indicate that (instruction is for showingShowing for the acceptable initiation region of the gesture of home screen can indicate): wherein depending on the current aobvious of application program user interfaceShow mode, the one group of display shown and can indicated is changed based on one group of display properties of lower section content according to the rule of two different groupsAttribute (for example, gray value, brightness value, opacity, tone, saturation degree etc.).For example, working as with interactive mode (for example, wherein pre-Phase user input is frequent) display application program user interface when, show appearance of the appearance based on lower section content that can be indicated with firstMode (for example, based on first group of rule) variation, so that showing can indicate to become apparent from;And when with full screen content display pattern (exampleSuch as, wherein content checks to may be primary goal) display application program user interface when, show the appearance that can indicate based in lower sectionThe appearance of appearance changes (for example, based on second group of rule) in a second manner, so that showing the attention that can indicate less dispersion userPower.Therefore, appearance of the display pattern offer based on lower section content based on application program user interface changes it in different waysShowing for appearance can indicate, enhance the operability of equipment (for example, by providing a user the required input about expected resultAppropriate guidance without causing undue disturbance to user, this can reduce user's mistake when operation equipment), and make userEquipment interface is more effective (for example, by helping user to realize expected results using required input and reducing operation equipment/and equipmentUser's mistake when interaction), (help user more rapidly, more effectively to make for example, passing through so as to improve the battery life of equipmentWith equipment).It provides in a manner described herein and shows and can indicate to show on permission screen and can indicate effectively to replace many differentThe hardware button of identical function (for example, display home screen) is provided in user interface scene, this facilitates the system for reducing equipmentCause this and maintenance cost.It provides in a manner described herein and shows that the image retention that can indicate to additionally aid reduction and elimination display is askedTopic.
Method 7000 is in the equipment with display and touch sensitive surface (for example, serving as both display and touch sensitive surfaceTouch-screen display) on execute.Equipment is not in the first pattern (for example, include the interior of full screen content, window scheme or default modeHold display pattern) show the user interface of (7002) application program (for example, media player user interface, browser client circleFace, instant message user interface, map user interface, telephone user interface, gaming user interface etc.).When showing in the first patternWhen showing the user interface of application program, equipment show on a user interface (7004) have the showing and can indicate of the first appearance (for example,The home of home gesture conversion zone on indication display shows and can indicate), in which: show in a part of user interfaceCan indicate (for example, display the first predefined region (for example, be located at display bottom center region near homeDisplay area can be indicated by showing) in show and can indicate, and it is regular according to first group of one or more, there is showing for the first appearanceThe value for the one group of one or more display properties that can be indicated shows energy table according to being located at according to one group of one or more display propertiesShow the variation of the value of one group of one or more display properties of a part of the user interface of lower section and changes (for example, showing can tableThe one group of one or more display properties shown is obtained by following procedure: will can indicate lower section positioned at showing using the first set filterA part of desaturation of user interface, fuzzy, the brightness or gray scale that change opacity and/or invert the image of the partValue)).When showing that showing with the first appearance can indicate in a part in the user interface shown in the first pattern, equipmentDetect (7006) request (for example, by offer user interface application program or operating system be based on current operational conditions (for example,For a long time there is no input, predefined standard for being switched between operation mode etc.) request of generation or user askAsk (for example, the tap input carried out on the touchscreen by contact, or gently sweep input etc.)), with from showing use in the first patternFamily interface, which is changed into, shows user interface in a second mode (for example, full screen content display pattern).In response to detecting request: settingIt is standby show in a second mode (7008) user interface (for example, with full screen content display pattern, a part of quilt of original user interfaceAmplify, some user interface elements (such as, the application menu column, scroll bar etc.) in user interface are moved from user interfaceIt removes, and the system mode column previously displaying together with user interface is also removed from display);And equipment is with the second mouldThere is showing for the second appearance can indicate for display in the user interface that formula is shown, in which: according to regular with first group of one or moreThe one or more rules of different second group, the value for showing the one group of one or more display properties that can be indicated with the second appearanceBecome according to the variation for being located at the value of one group of one or more display properties of a part for showing the user interface that can indicate lower sectionChange (for example, showing that the one group of one or more display properties that can be indicated is obtained by following procedure: applying the second set filter by positionIn a part of desaturation, fuzzy, change opacity and/or the image for inverting the part that show the user interface that can indicate lower sectionBrightness or gray value) (for example, showing with the second appearance can indicate to make the modification that can be indicated of showing with the first appearance, butIt is that both of which derives from the filter for being located at a part for showing the user interface that can indicate lower section, but using different groups, or toolThere is identical group of filter of different adjustment parameter).This shows in Fig. 5 S to Fig. 5 W, wherein for example when equipment is initially withOne state (for example, fully visible state in Fig. 5 T and Fig. 5 U) show can indicate after be changed into media from interactive mode and disappearTake mode, 5002 can be indicated by showing with the second state (for example, low contrast state in Fig. 5 V and Fig. 5 W).
In some embodiments, when in the user interface shown in a second mode display there is second appearance to show energyWhen expression: meeting standard of fading out according to determining, equipment stops (7010) and shows in the user interface shown in a second modeIt can indicate (for example, keeping showing user interface in a second mode simultaneously);And the standard of fading out is unsatisfactory for according to determination, is maintained atThere is showing for the second appearance can indicate for display in the user interface shown in a second mode.For example, this shows in Fig. 5 X, whereinShowing in low contrast state can indicate that 5002 finally completely disappear after the extra time section of no user input.OneIn a little embodiments, standard requirements of fading out do not detect that user is defeated at least predefined thresholds time quantum on touch sensitive surfaceEnter, so as to meet the standard of fading out (for example, when enter full screen content display pattern after 30 seconds in equipment not on touch sensitive surfaceWhen any position detection is to any touch input, or when after entering full screen content display pattern in 30 seconds equipment not in touch screenThe bottom center region of display nearby detects when any touch input (for example, the other parts of display can continue toReceive and respond user's input without influencing the determination about the standard of fading out), meet standard of fading out).Based on predefined standardIt fades out or maintain to show with the predefined display pattern of application program user interface shows that the display that can be indicated enhances equipmentOperability by providing a user the appropriate of the required input about expected result (for example, instructed without causing not to userInterference appropriate, this can reduce user's mistake when operation equipment), and keep user's equipment interface more effective (for example, passing through benefitUser's mistake when helping user to realize expected results with required input and reducing operation equipment/interact with equipment), so as to improveThe battery life of equipment (for example, by help user more rapidly, more efficiently use equipment).
In some embodiments, the user interface of the application program shown in the first pattern is occupied including (7012) to be less thanAll display areas of display are (for example, the system in the user interface and display of the application program shown in the first patternStatus bar is shown simultaneously) content (for example, video, game, document, album of songs picture) expression;And in a second modeThe user interface of the application program of display includes the expression for the content of all display areas for occupying display (for example, with full frameA part of content-presentation mode, original user interface is amplified, and some user interface elements in user interface (such as, are answeredWith programs menu column, scroll bar etc.) the system mode column that removes from user interface, and previously display together with user interfaceAlso it is removed from display).It is to be provided with conventional display pattern or full-screen display mode display with not Tongfang depending on contentFormula shown and can be indicated based on its appearance of the outward appearance change of lower section content, enhances the operability of equipment (for example, by userThe appropriate guidance of the required input about expected result is provided without causing undue disturbance to user, this can reduce operation and setUser's mistake when standby), and keep user's equipment interface more effective (for example, pre- by helping user to realize using required inputPhase result and user's mistake when reducing operation equipment/interact with equipment), so as to improve equipment battery life (for example, logicalCross help user more rapidly, more efficiently use equipment).
In some embodiments, show the first appearance that can be indicated and the second appearance (for example, such as showing can indicate brightDegree, intensity or gray value are reflected) at least one of be located at based on (7014) and show one of the user interface below capable of indicatingThe reversion divided.For example, in some embodiments, a part of desaturation for showing the user interface that can indicate lower section will be located to obtainMonochrome image is taken, monochrome image is obscured, then shows the brightness of pixel in fuzzy monochrome image or gray value reversion to obtainThe brightness of pixel in capable of indicating or gray value.There is provided showing for the display properties that there is the reversion based on lower section content to derive can tableShow, enhance equipment operability (for example, by keep it is enough show can indicate that visibility is inappropriate without causing to userInterference, and help user provide realize expected result needed for input), and make user facility operation it is more effective (for example,User's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, under first group of rule requires (7016) to be applied to be located at by the first reversion amount and show and can indicateTo obtain the first appearance shown and can indicated, second group of rule requires for the second reversion amount to be applied to a part of the user interface of sidePositioned at a part of the user interface that can indicate lower section is shown to obtain the second appearance shown and can indicated, and the second reversion amount is less thanFirst reversion amount (for example, second group of rule reduces the reversion amount for being located at a part for showing the user interface that can indicate lower section, withThe one group of display properties that can be indicated is shown in acquisition).Change and is applied to the reversion amount of lower section content and shows to obtain and can indicate to facilitate rootThe visibility that shows and can indicate is adjusted according to the display pattern of application program user interface, to enhance the operability (example of equipmentSuch as, show the enough visibility requirements that can be indicated and the requirement of not high-lighting by intelligently balancing, and user is helped to provide the realization phaseInput needed for hoping result), and keep user facility operation more effective (for example, by reducing to interference caused by user security risk and subtractingUser's mistake using equipment or when being interacted with equipment less).
In some embodiments, show the first appearance that can be indicated and the second appearance (for example, such as showing can indicate brightDegree, intensity or gray value are reflected) at least one of will be located at by (7018) and show one of the user interface below capable of indicatingObscure portions obtain.For example, in some embodiments, will be located at and show that a part for the user interface that can indicate lower section goes to satisfyWith to obtain monochrome image, monochrome image is obscured, then by the brightness of pixel in fuzzy monochrome image or gray value reversion withObtain brightness or the gray value for showing the pixel in capable of indicating.There is provided has by the way that lower section content is obscured the display properties obtainedShowing can indicate, enhance equipment operability (for example, by keep it is enough show visibility can be indicated without causing to userUndue disturbance, and help user provide realize expected result needed for input), and make user facility operation more effective(for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, first group of rule requires (7020) by the first fuzzy quantity (for example, Gaussian blurring function)Applied to a part for showing the user interface that can indicate lower section is located to obtain the first appearance shown and can indicated, second group of rule is wantedIt asks and the second fuzzy quantity (for example, Gaussian blurring function) is applied to be located at a part for showing the user interface that can indicate lower section to obtainTake the second appearance shown and can indicated, and the second fuzzy quantity less than the first fuzzy quantity (for example, the second ambiguity function has than firstThe smaller blur radius of ambiguity function) (for example, second group of rule, which reduces, is located at one that shows the user interface that can indicate lower sectionThe fuzzy quantity divided shows can indicate one group of display properties to obtain).Change and shows energy applied to the fuzzy quantity of lower section content to obtainExpression helps to adjust the visibility that shows and can indicate according to the display pattern of application program user interface, to enhance equipmentOperability (for example, showing the enough visibility requirements that can be indicated and the requirement of not high-lighting by intelligently balance, and helps userInput needed for realizing expected result is provided), and keep user facility operation more effective (for example, causing by reducing to userInterference and user's mistake when reducing using equipment or being interacted with equipment).
In some embodiments, show the first appearance that can be indicated and the second appearance (for example, such as showing can indicate brightDegree, intensity or gray value are reflected) at least one of will be located at by (7022) and show one of the user interface below capable of indicatingPart desaturation obtains.For example, in some embodiments, will be located at and show that a part for the user interface that can indicate lower section is goneSaturation is obscured monochrome image with obtaining monochrome image, then inverts the brightness of pixel in fuzzy monochrome image or gray valueTo obtain the brightness or the gray value that show the pixel in capable of indicating.The display category having by obtaining lower section content desaturation is providedProperty show and can indicate, enhance equipment operability (for example, by keep it is enough show visibility can be indicated without to userCause undue disturbance, and help user provide realize expected result needed for input), and make user facility operation moreEffectively (for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment).
In some embodiments, the first desaturation amount is applied to be located at and shows and can indicate by first group of rule requirement (7024)To obtain the first appearance shown and can indicated, second group of rule requires to answer the second desaturation amount a part of the user interface of lower sectionFor being located at a part for showing the user interface that can indicate lower section to obtain the second appearance shown and can indicated, and the second desaturationIt measures less than the first desaturation amount (for example, second group of rule, which reduces, is located at a part for showing the user interface that can indicate lower sectionDesaturation amount shows can indicate one group of display properties to obtain).Change and shows energy applied to the desaturation amount of lower section content to obtainExpression helps to adjust the visibility that shows and can indicate according to the display pattern of application program user interface, to enhance equipmentOperability (for example, showing the enough visibility requirements that can be indicated and the requirement of not high-lighting by intelligently balance, and helps userInput needed for realizing expected result is provided), and keep user facility operation more effective (for example, causing by reducing to userInterference and user's mistake when reducing using equipment or being interacted with equipment).
In some embodiments, when showing that user interface can be indicated without showing in a second mode, equipment detection(7026) meet and first show the input that can indicate to show standard again, wherein when on touch sensitive surface (for example, corresponding to firstAt the position of display position) when detecting input, meeting first and showing can indicate to show standard again;And it is full in response to detectingFoot shows the input that can indicate to show standard again, and equipment is shown again in the user interface shown in a second mode can tableShow.For example, this shows in Fig. 5 X to Fig. 5 AA.In some embodiments, when in the user interface shown in a second modeAgain show when can indicate, according to second group of one or more rule, show the one group of one or more display properties that can be indicatedValue changed according to the variation of the value of one group of one or more display properties of a part of user interface.In some embodiment partyIn case, when showing again in the user interface shown in the first pattern can indicate, advised according to first group of one or moreThen, show that the value for the one group of one or more display properties that can be indicated is aobvious according to one group of one or more of a part of user interfaceShow the variation of the value of attribute and changes.Based on predefined standard fade out show can indicate after show again and can indicate, increasingThe strong operability of equipment (for example, by provide a user the required input about expected result it is appropriate instruct without toUser causes undue disturbance, this can reduce user's mistake when operation equipment), and keep user's equipment interface more effective(for example, user's mistake when by helping user to realize expected results using required input and reduce operation equipment/interact with equipmentAccidentally), so as to improve equipment battery life (for example, by help user more rapidly, more efficiently use equipment).
In some embodiments, when showing that user interface can be indicated without showing in a second mode, equipment detection(7028) meet and second show the input that can indicate to show standard again, wherein when input is from showing user interface in a second modeWhen being changed into the request for showing user interface in the first pattern, satisfaction second, which is shown, can indicate to show standard again;And in response toDetect that satisfaction second shows the input that can indicate to show standard again, equipment shows user interface again in the first pattern;AndEquipment is shown again in the user interface shown again in the first pattern to be indicated.For example, this shows in Fig. 5 X to Fig. 5 AAOut.In some embodiments, when showing again in the user interface shown in the first pattern can indicate, according to firstThe one or more rules of group show the value of the one group of one or more display properties that can be indicated according to the one of a part of user interfaceIt organizes the variation of the value of one or more display properties and changes.Again when being changed into the first display pattern from the second display patternShowing can indicate, enhance the operability of equipment (for example, by providing a user the required input about expected resultWithout causing undue disturbance to user, this can reduce user's mistake when operation equipment for appropriate guidance), and set userFor interface more effectively (for example, by helping user to realize expected results using required input and reducing operation equipment/and equipment friendshipMutually when user's mistake), so as to improve equipment battery life (for example, by help user more rapidly, more efficiently useEquipment).
In some embodiments, show at least one of the first appearance that can be indicated and second appearance according to (7030) InThe variation that occurs dynamically is adjusted (for example, due to user interface in a part for showing the user interface that can indicate lower sectionIn dynamic content variation or the content due to showing in the user interface in navigated and caused a part of user interfaceVariation).For example, this shows in Fig. 5 T to Fig. 5 W.For example, when scroll user interface, or the use that ought be shown in a second modeWhen family interface is the continuous full-length movies for developing and refreshing, game or webpage, show that the appearance that can be indicated also is constantly updated to reflectFollowing user interface variation.When showing user interface in the first pattern, show that the appearance that can be indicated is dynamic according to first group of ruleChange to state, and when showing user interface in a second mode, shows that the appearance that can be indicated dynamically becomes according to second group of ruleChange.Cosmetic variation based on lower section content dynamically changes the appearance shown and can indicated, enhance equipment operability (for example,By continuing to provide a user the appropriate guidance of the required input about expected result at any time when variation in content without to useCause undue disturbance in family), and keep user's equipment interface more effective (for example, by helping user real using required inputExisting expected results and user's mistake when reducing operation equipment/interact with equipment), so as to improve the battery life (example of equipmentSuch as, by help user more rapidly, more efficiently use equipment).
In some embodiments, to be (7032) show the user interface below capable of indicating based on being applied to be located to the first appearanceFirst set filter (for example, fuzzy, desaturation and reversion) of a part (and fringe region around the region) generate, the second appearance is generated based on the second set filter for being applied to be located at a part for showing the user interface that can indicate lower section, and for two or more filters in the second set filter, the first set filter includes same type but hasDifferent adjustment parameter correspondence filter (for example, blur filter with different blur radius, with different reverse curvesInvert filter, the opaque filter with different transparency levels, the desaturation filter with different desaturation ratiosDeng).Change it in different ways using the set filter with different adjustment parameter to provide the appearance based on lower section contentShowing for appearance can indicate, allow to show the appearance that can indicate to keep relatively uniform during switching display pattern and less disperseThe attention of user, to enhance the operability of equipment (for example, defeated needed for expected result by providing a userWithout causing undue disturbance to user, this can reduce user's mistake when operation equipment for the appropriate guidance entered), and useFamily equipment interface it is more effective (for example, by help user to realize expected results using required input and reduce operation equipment/with setUser's mistake when standby interaction).
In some embodiments, in response to detect request: equipment generate (7034) for show one for capable of indicating orMultiple intermediate appearances, the one or more intermediate appearance is between the first appearance and the second appearance;And equipment will be used to showThe one or more intermediate appearances that can be indicated are shown as showing that showing with the first appearance can be indicated and be shown with the second appearanceShow the transformation between capable of indicating.In some embodiments, intermediate appearance is shown on a user interface in a second mode, andIntermediate appearance is the interpolation shown between the first appearance and the second appearance that can be indicated.In the display pattern of application program user interfaceIt is generated during switching and shows the intermediate appearance that can indicate to bridge the transformation for showing the appearance that can be indicated, so that less dispersion userAttention, to enhance the operability of equipment (for example, by providing a user the suitable of the required input about expected resultWithout causing undue disturbance to user, this can reduce user's mistake when operation equipment for amount guidance), and make user equipmentInterface is more effective (for example, being interacted by helping user to realize expected results using required input and reducing operation equipment/with equipmentWhen user's mistake).
In some embodiments, generate for show one between the first appearance and the second appearance that can be indicated orMultiple intermediate appearances are gradually converted into second group of rule from first group of rule including (7036) and (are applied in lower section for example, changingHold to generate the amplitude for showing can indicate filter, is applied to lower section content without changing to generate other that shows and can indicateThe amplitude of filter).Show one group of rule of the appearance that can be indicated for generating by gradually changing come in generating and showing and can indicateBetween appearance so that the attention of less dispersion user, to enhance the operability of equipment (for example, by mentioning to userAppropriate for the required input about expected result is instructed without causing undue disturbance to user, this can reduce operation equipmentWhen user's mistake), and keep user's equipment interface more effective (for example, being expected by helping user to realize using required inputUser's mistake when as a result and reducing operation equipment/interact with equipment).
In some embodiments, showing with the first appearance can indicate there is (7038) first opacities, and haveThere is showing for the second appearance that can indicate with the second opacity less than the first opacity (for example, the color of user interface is aobviousIt is shown as penetrating).The opacity that can be indicated is shown in display pattern change based on application program user interface, facilitates according to applicationThe display pattern of program user interface adjusts the visibility that shows and can indicate, to enhance the operability of equipment (for example, passing throughIntelligently balance shows the enough visibility requirements and the requirement of not high-lighting that can be indicated, and helps user to provide and realize expected result instituteThe input needed), and keep user facility operation more effective (for example, by reducing to interference caused by user security risk and reducing use and setUser's mistake standby or when being interacted with equipment).
In some embodiments, showing with the first appearance can indicate and showing with the second appearance can indicate showingThere is (7040) identical size and position on device.It keeps showing and capable of indicating in the different display modes of application program user interfaceSize and location, help to keep showing the continuity of the appearance that can be indicated during user interface switches, to enhance equipmentOperability (for example, by keep user scene, and help user provide realize expected result needed for input), andSo that user facility operation is more effective (for example, by reducing to interference caused by user security risk and reducing using equipment or hand over equipmentUser's mistake when mutually).
In some embodiments, first group of showing for one or more rule formation (7042) can indicate and application programVisual difference between user interface can be indicated than showing of being formed by second group of one or more rule and the user of application programVisual difference between interface is big.The visual difference degree that can be indicated is shown in display pattern change based on application program user interface,Help to adjust the visibility that shows and can indicate according to the display pattern of application program user interface, to enhance grasping for equipmentThe property made (for example, showing the enough visibility requirements that can be indicated and the requirement of not high-lighting by intelligently balance, and helps user to provideInput needed for realizing expected result), and keep user facility operation more effective (for example, by reducing to caused by user security risk dryUser's mistake when disturbing and reducing using equipment or interacted with equipment).
It should be appreciated that the particular order that the operation in Fig. 7 A to Fig. 7 E is described is only exemplary, not purportShowing that the sequence is the unique order that can execute these operations.Those skilled in the art will recognize that various waysTo resequence to operations described herein.Additionally, it should be noted that herein in regard to other methods as described herein (for example,Method 6000 and method 8000) description other processes details equally in a similar way be suitable for above for Fig. 7 A to schemeThe method 7000 of 7E description.For example, being regarded above with reference to the contact of the description of method 7000, gesture, user interface object, application programFigure, control panel, control, show can indicate, position threshold, direction condition, reverse curve, filter, value range, navigation standard,Moving parameter, focus selector and/or animation optionally have herein with reference to other methods as described herein (for example, method6000 with 8000) description contacts, gesture, user interface object, application view, control panel, control, position threshold,One or more of direction condition, navigation standard, moving parameter, focus selector and/or feature of animation.It is risen in order to conciseSee, these details are not repeated herein.
Operation in above- mentioned information processing method is optionally by one or more functions in operation information processing equipmentModule realizes, all for example general processors of the information processing equipment (for example, as above in regard to described in Figure 1A and Fig. 3)Or the chip specific to application.
Operation above with reference to Fig. 7 A to Fig. 7 E description is optionally implemented by component that Figure 1A describes into Figure 1B.ExampleSuch as, detection operation and display operation are optionally by event classifier 170, event recognizer 180 and button.onrelease 190 realIt applies.Event monitor 171 in event classifier 170 detects the contact on touch-sensitive display 112, and event dispatcher mouldEvent information is transmitted to application program 136-1 by block 174.The corresponding event identifier 180 of application program 136-1 is by event information186 are defined with corresponding event to be compared, and whether determine the first contact on touch sensitive surface at first position (or the equipmentRotation whether) correspond to predefined event or subevent, such as selection to the object in user interface or the equipment fromRotation of one orientation to another orientation.When detecting corresponding predefined event or subevent, event recognizer 180Button.onrelease 190 is activated, the button.onrelease is associated with the detection to the event or subevent.Button.onrelease190 optionally using or call data renovator 176 or object renovator 177 to carry out more new application internal state 192.OneIn a little embodiments, button.onrelease 190 accesses corresponding GUI renovator 178 and carrys out content shown by more new application.ClassAs, those skilled in the art can know clearly based in Figure 1A, into Figure 1B, how discribed component can realize otherProcess.
Fig. 8 A to Fig. 8 F is to show to show energy table according to changing according to the cosmetic variation of lower section content for some embodimentsThe appearance shown and show the flow chart that can indicate the method for appearance type.Method 8000 is in the electronics with display and touch sensitive surfaceEquipment is (for example, equipment 300, Fig. 3;Or portable multifunction device 100, Figure 1A) on execute.In some embodiments, electronicsEquipment includes the one or more sensors of the intensity for the contact with touch sensitive surface is detected.In some embodiments, shouldTouch sensitive surface and display are integrated into touch-sensitive display.In some embodiments, display is touch-screen display, and is touchedSensitive surfaces are over the display or integrated with display.In some embodiments, display is to separate with touch sensitive surface.MethodSome operations in 8000 are optionally combined and/or the sequence of some operations is optionally changed.
Method 8000, which is related to showing in terms of content as follows, to be shown and can indicate (for example, instruction is in the user interfaceExecute the acceptable starting of the gesture of predefined operation (such as, showing home screen or application program switch user interface)Showing for region can indicate): display properties (for example, the gray value or brightness value) variation wherein based on lower section content dynamically changesShow the same display attribute that can be indicated.In addition, this method, which requires to show, can indicate that appearance value range depends on the display of lower section contentWhether attribute change meets predefined range switching standards, in two different value ranges (for example, " hint can indicate " value modelEnclose and " bright to show and indicate " value range) between switch.Therefore, equipment can make to show that the appearance that can be indicated is adapted to lower section contentVariation, to keep showing the visual contrast that can be indicated between the content of lower section, and less to take sb's mind off sth or lessWith intrusive mode (for example, by avoid due to change too quickly show the appearance that can be indicated caused by show and can indicate fastSpeed flash is bright, this will disperse the attention of user in some cases) it provides and shows and can indicate, show and can indicate without what is initially selectedThe constraint of appearance type (for example, " bright " or " dark ", which is shown, can indicate type).It provides to have in a manner described herein and is based on lower sectionThe appearance of content and showing for the appearance of dynamic change can indicate and allow to show that appearance value range can be indicated based on lower section contentVariation and switching at runtime at any time, enhance the operability of equipment (for example, by providing a user the institute about expected resultFor the visual guide that need to be inputted without causing undue disturbance to user, this can reduce user's mistake when operation equipment), andMake user's equipment interface it is more effective (for example, by help user to realize expected results using required input and reduce operation equipment/User's mistake when being interacted with equipment), (help user more rapidly, more to have for example, passing through so as to improve the battery life of equipmentEffect ground uses equipment).In a manner described herein provide show can indicate allow screen on show can indicate effectively replacement and improvementThe hardware button of identical function (for example, display home screen) is provided in many different user interface scenes, this facilitatesReduce the manufacturing cost and maintenance cost of equipment.It provides in a manner described herein and shows that can indicate to additionally aid reduction and elimination showsShow the image retention problem of device.
Method 8000 is in the equipment with display and touch sensitive surface (for example, serving as both display and touch sensitive surfaceTouch-screen display) on execute.Equipment shows (8002) content (for example, home screen, desktop small routine screen over the displayCurtain, desktop, the user interface of application program, media player user interface etc.) and show and can indicate (for example, on indication displayThe home of home gesture conversion zone show and can indicate), in which: showing can indicate to be shown in a part of content;Showing can indicateDisplay properties (for example, gray value or brightness value of image (for example, color image or monochrome image)) value, except gray value orIntrinsic display parameters (for example, the tone of full-colour image, saturation degree etc.) except brightness value, or it is intrinsic based on one or moreThe derivation that display parameters (for example, the gray value or brightness value of full-colour image or its small variant or equivalent) calculate is shownParameter) it is to be determined based on the value for the same display attribute for showing a part that can indicate the content shown on it;And permitPerhaps the value of the display properties of content is in the first value range (for example, range [0,1], optionally in 0% brightness to 100% brightnessOn scale, wherein 0% brightness is 0,100% brightness is 1) interior variation, and shows that the value for the display properties that can be indicated is confined toAppearance value range can indicated (for example, can indicate that showing can indicate that appearance value range is for hint less than showing for the first value range[0,0.4], optionally on the scale of black to white, wherein black is 0, and white is 1;Or show and can indicate for bright, it shouldBeing worth range is [0.6,1], and optionally on the scale of 0% brightness to 100% brightness, wherein 0% brightness is 0,100% brightness is1;The two value ranges are both less than the value range [0,1] of content) in variation.In display content and shows when can indicate and showing energyIndicate appearance value range be second value range (for example, it is dark show showing of can indicating can indicate appearance value range for [0,0.4], timesSelection of land is on the scale of black to white, and wherein black is 0, white for 1) when, equipment detection (8004) is shown and can be indicatedThe cosmetic variation of content.In response to detecting that display shows that the cosmetic variation for the content that can be indicated, equipment change (8006) and show energy tableThe appearance (for example, based on short time cosmetic variation strategy and long-time cosmetic variation strategy) shown, comprising: according to determining contentCosmetic variation meets range switching standards (for example, showing the overall brightness or darkness that can indicate content below and around when being located atMeasurement (for example, accumulated value and polymerizing value of display properties (for example, gray value or brightness)) due to background content appearance becomeChange when more than the first predefined thresholds, that is, meet range switching standards): will show can indicate that appearance value range shifts as third modelEnclose value (for example, light shows that showing of can indicating can indicate appearance value range [0.6,1], optionally on the scale of black to white,Middle black is 0, and white is 1), wherein third value range is different from second value range (for example, third value range includes not being included inIn second value range and optionally at least one nonoverlapping value of second value range) (for example, when meet range switching standardsWhen, showing of currently selecting can indicate that type can indicate that type (for example, implying can indicate) becomes optionally showing from showing of previously having selectedCan indicate type (bright to show and indicate)), and third value range (for example, [0.6,1], optionally in black to the scale of whiteOn, wherein black is 0, and white is 1) less than the first value range;And according to the display properties for showing the content that can be indicatedValue changes the value for showing the same display attribute that can be indicated (based on type capable of being indicated (for example, bright show energy table with showing of currently selectingShow) mapping of corresponding first predefined value determines the value of the display properties for showing each pixel that can be indicated), wherein showing energy tableThe display properties shown is confined to indicate to change within the scope of appearance value showing;And it is discontented according to the cosmetic variation for determining contentSufficient range switching standards show the same display attribute that can be indicated according to the change of the value for the display properties for showing the content that can be indicatedValue (for example, based on that can indicate type (for example, implying can indicate) corresponding second predefined conversion with showing of currently selectingRelationship determines the value of the display properties for showing each pixel that can be indicated), while will show and can indicate that appearance value range remains(for example, when being unsatisfactory for the first standard, showing for currently selecting can indicate that type keeps showing energy table with what is previously selected to two-value rangeShow that type (for example, implying can indicate) is identical).For example, this shows in Fig. 5 AD to Fig. 5 AE.
In some embodiments, range switching standards include that (8008) range handover trigger standard and range switching are completedStandard, the cosmetic variation of range handover trigger standard requirements content include the first variable quantity in first time period, first changeChange amount makes the predefined measurement of content appearance (for example, (such as, showing can indicate below and show indicate the interior of lower section display propertiesThe polymerization brightness value of a part of appearance) biasing operation mean value) be more than predefined thresholds (for example, when from it is bright show can indicate to cutHint being changed to when can indicate, predefined thresholds are first threshold, and when from imply can indicate to be switched to it is bright show make a reservation for when can indicateAdopted threshold value is the second threshold different from first threshold), and the cosmetic variation of range switching completion standard requirements content is not wrappedThe second variable quantity in second time period after the first period of time is included, in predefined transformation period (for example, 5 seconds) InCut-off meets range handover trigger standard again before after meeting range handover trigger standard.It is required that meeting range for the first timeRange handover trigger standard is not met again within the predefined transformation period after handover trigger standard, to complete two valuesShowing between range can indicate that appearance range switches, and enhance the operability of equipment (for example, by avoiding unnecessarily switchingAppearance type can be indicated and avoid interfering when the variation of lower section content is instantaneous to user by showing), and to useFamily equipment operation is more effective (for example, passing through when reducing to interference caused by user security risk and reducing using equipment or interact with equipmentUser's mistake), so as to improve equipment battery life (for example, reducing since range switches to processor and screenDemand).
In some embodiments, it is used as based on (8010) and shows appearance value range can be indicated (for example, currently used shows energyIndicate the value range of type) current value range select the predefined thresholds for range handover trigger standard, comprising: when showingWhen can indicate that appearance value range is second value range, use first threshold as predefined thresholds;And appearance can be indicated when showingWhen value range is third value range, use second threshold as predefined thresholds.(in some embodiments, when showing and can indicateAppearance value range between second value range (for example, value range associated with " hint can indicate ") and third value range (for example,Value range associated with " bright to show and indicate ") between when, predefined thresholds are based on any value range selected recently as showingAppearance value range can be indicated (for example, once selecting to show " bright to show and the indicate " range that can indicate appearance value as showing can indicate outerThe target zone of sight value, " bright to show and indicate " threshold value, which is just used to determine when to switch back into, shows " the hint energy table that can indicate appearance valueShow " range, and once select to show " hint can the indicate " range of appearance value can be indicated as showing the target that can indicate appearance valueRange, " hint can indicate " threshold value are just used to determine when to switch back into and show " bright to show and the indicate " range that can indicate appearance value).MakeThe operability of equipment is enhanced (for example, being partial to currently select by adjusting with the different threshold values of range handover trigger standardShow and can indicate appearance type and avoid unnecessarily switching the variation for showing and capable of indicating appearance type and avoiding in lower section contentInterfered when being instantaneous to user), and make user facility operation more effective (for example, causing by reducing to userInterference and user's mistake when reducing using equipment or being interacted with equipment), so as to improve equipment battery life (for example,Reduce the demand to processor and screen since range switches).
In some embodiments, in response to detecting that the cosmetic variation for the content that can be indicated is shown in display and changes and shows energy tableThe appearance shown includes (8012): meeting range handover trigger standard simultaneously by the first variable quantity in first time period according to determiningAnd before meeting range and converting standard: will show can indicate that the transfer of appearance value range is and second value range and third value modelDifferent intermediate ranges is enclosed (for example, intermediate range [0.3-0.7], optionally on the scale of black to white, wherein blackColor is 0, and white is 1, and the initial value of the intermediate range is between the initial value of second value range and the initial value of third value rangeBetween, and its end value is between the end value of second value range and the end value of third value range);And according to displayShow that the value of the display properties for the content that can be indicated changes the value for showing the same display attribute that can be indicated (based on showing with what is currently selectedIt can indicate that the corresponding first predefined value mapping of type (for example, bright show and can indicate) shows each pixel that can be indicated to determineThe value of display properties), wherein showing that the display properties that can be indicated is confined to indicate to change within the scope of appearance value showing.SomeIn embodiment, there are multiple intermediate ranges between second value range and third value range, and equipment is predefinedIt is mobile by each of multiple intermediate ranges in order in the transformation period, until meeting range switching completion standard.InAfter meeting range switching completion standard, show the display properties that can be indicated when any additional cosmetic variation according to content changesWhen, show that the display properties that can be indicated is constrained within the scope of third value.To show can indicate the transfer of appearance value range for two it is steadyIt is fixed to show the intermediate range that indicate the appearance value range of appearance type different (or between them), as steady at twoThe fixed transformation shown during capable of indicating to switch between appearance type enhances the operability of equipment (for example, by making to cutChange show can indicate that appearance type is more fine and the attention of less dispersion user), and make user facility operation moreEffectively (for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment), fromAnd improve equipment battery life (for example, by allow user more rapidly, more effectively operate equipment).
In some embodiments, the cosmetic variation of content include (8014) after the first period of time, meeting rangeThird variable quantity after handover trigger standard and within the third period before meeting range switching completion standard.ExampleSuch as, after meeting range handover trigger standard, device selection bit in it is bright show can indicate and imply the content that can be indicated is shown can tableAppearance reverse curve can be indicated by showing that the medium content between appearance reverse curve shows, and be determined such as using intermediate reverse curveDuring where changing the period (for example, meeting 5 seconds after range handover trigger standard in) based on the brightness change of content comeThe brightness that can be indicated is shown in change.It can indicate that appearance range is whithin a period of time another from a stationary value range transfer when showingWhen stationary value range, allow to show that the appearance that can be indicated continues to enhance the operability (example of equipment with lower section content changingSuch as, show the visual continuity that can indicate appearance by providing during switching shows can indicate appearance type), and user is setStandby operation is more effective (for example, user when by reducing to interference caused by user security risk and reduce using equipment or interact with equipmentMistake), so as to improve equipment battery life (for example, by allow user more rapidly, more effectively operate equipment).
In some embodiments, the cosmetic variation for showing the content that can be indicated is that (8016) are caused by the rolling of content, and range switching standards do not need the rolling for lacking content, to meet range switching standards.When rolling lower section contentWhen, allow to show that the appearance that can be indicated with lower section content changing, enhances the operability of equipment (for example, by under rollingThere is provided when square content and show the visual continuity that can indicate appearance), and make user facility operation more effective (for example, by subtractingFew user's mistake to interference caused by user security risk and when reducing using equipment or being interacted with equipment), so as to improve the electricity of equipmentThe pond service life (for example, by allow user more rapidly, more effectively operate equipment).
In some embodiments, the cosmetic variation for showing the content that can be indicated is that (8018) by showing can indicate followingCaused by the movement (for example, the scaling of content or rolling) of content, and range switching standards require to show can indicate following interiorHold the movement at least predetermined time quantum and be less than predefined amount, to meet range switching standards.For example, in addition to requiringThe predefined measurement of content appearance is (for example, (such as, showing can indicate below and show indicate the one of the content of lower section display propertiesPartial polymerization brightness value) biasing operation mean value) be more than predefined thresholds except, range switching standards also require content to existMore than the time of predefined thresholds, nearby keeping substantially stationary reaches a bit of time.The interior of lower section can be indicated it is required that being located at and showingHold substantially stationary (for example, stopping rolling) to meet range switching standards, enhances the operability of equipment (for example, logicalCross avoid unnecessarily toggling when causing content quickly to change due to progressive rolling movement show can indicate appearance type), andAnd make user facility operation more effective (for example, by reducing to interference caused by user security risk and reducing using equipment or and equipmentUser's mistake when interaction), it (more rapidly, is more effectively grasped for example, passing through permission user so as to improve the battery life of equipmentMake equipment).
In some embodiments, change the value for showing the same display attribute that can be indicated according to the value of the display properties of contentIncluding (8020): having reduced that (and optionally, the value of the display properties of content is the according to the value for the display properties for determining content(for example, two special ranges, which exist, to be shown except two special ranges of contents value in the predefined subrange of one value rangeThe discontinuity point of energy expression value)), energy table is shown to increase according to variation (for example, reduction) amplitude of the value of the display properties of contentThe value of the display properties shown (for example, when positioned at showing that the content that can indicate lower section becomes darker, showing can indicate to become brighter);RootValue according to the display properties for determining content has increased that (and optionally, the value of the display properties of content is in the pre- of the first value rangeIt defines in subrange (for example, two special ranges, which exist, shows energy expression value not except two special ranges of contents valueContinuity point)), the display properties that shows and can indicate is reduced according to variation (for example, increase) amplitude of the value of the display properties of contentValue (for example, when be located at show can indicate below content become brighter when, showing can indicate to become darker).Use value inverts (exampleSuch as, increase when reducing contents value and show the value that can be indicated, and the value that can be indicated is shown in reduction when increasing contents value) come under being based onThe value of the display properties of square content determines the value for showing the same display attribute that can be indicated, enhance equipment operability (for example,By provide it is enough show visibility can be indicated without taking sb's mind off sth or having intrusive), and make user facility operationMore effectively (for example, user's mistake when by reducing to interference caused by user security risk and reduce using equipment or interacted with equipment),So as to improve equipment battery life (for example, by allow user more rapidly, more effectively operate equipment).
In some embodiments, when the value for showing the display properties that can be indicated changes within the scope of second value (for example, InBefore meeting range switching standards) and when the value for showing the display properties that can be indicated changes within the scope of third value (for example, InAfter meeting range transfer standard), the given amplitude of variation of the value of the display properties of content, which causes (for example, 8022) to show, to be indicatedThe identical change amplitude of the value of display properties.For example, this shows in Fig. 5 AE and Fig. 5 AF.In some embodiments, show energyContent between the display properties of expression and the same display attribute of content, which is shown, can indicate appearance reverse curve (for example, showing can tableShow brightness and background luminance curve) hint having the same can indicate with it is bright show can indicate shape, and for currently selectingType can be indicated by showing, the brightness value for showing each pixel that can be indicated is searched from the database of pre-stored brightness value pair.It wantsIt asks to be located at and shows that the content below capable of indicating substantially stationary (for example, stopping rolling) to meet range switching standards, enhancesThe operability of equipment is (for example, unnecessarily come switchback when avoid causes content quickly to change and due to progressive rolling movementChange show can indicate appearance type), and make user facility operation more effective (for example, by reducing to interference caused by user security riskAnd user's mistake when reducing using equipment or being interacted with equipment), (permit for example, passing through so as to improve the battery life of equipmentFamily allowable more rapidly, more effectively operate equipment).
In some embodiments, equipment, which will be shown, can indicate appearance value range from (8024) second value range (for example, implyingShowing for capable of indicating can indicate appearance value range) transfer is third value range (for example, bright show that showing of can indicating can indicate appearance value modelEnclose), being included in a period of time (for example, 5 seconds) gradually is third value range from the transfer of second value range;And this method packetIt includes, when will gradually show can indicate that appearance value range is shifted from second value range as third value range: detection is shown and can be indicatedContent additional cosmetic variation;And in response to detecting that the additional cosmetic variation for the content that can be indicated is shown in display, according to showingCan indicate that appearance value range (for example, can indicate that appearance value range gradually shifts at any time with showing) change is shown can indicate outerIt sees, comprising: range switching standards (for example, meeting range switching standards for the second time) is met according to the cosmetic variation for determining content,Start gradually show can indicate appearance value range be transferred back to second value range (for example, a period of time (such as, 1,2,3,4,5,10 seconds) beginning and end of interior change value range);And range switching standards are unsatisfactory for according to the cosmetic variation for determining content(for example, meeting range switching standards for the second time), continuation, which will gradually be shown, can indicate that appearance value range is from the transfer of second value rangeThird value range.In some embodiments, as described above, being used to determine whether to meet the predefined thresholds of range switching standardsBased on showing that the target range that can indicate appearance value range is second value range (for example, for hint can indicate) still third valueRange (for example, show and can indicate for bright) and change.This method allow to show can indicate within the predefined transformation period gradually fromA kind of appearance type is switched to another appearance type;And during the predefined transformation period, show the appearance value that can be indicatedContinue to change according to the variation of the appearance value of lower section content.In addition, can meet again range during shifting appearance value range and cutDehorn is quasi- (for example, due to content and showing that the appearance that can be indicated persistently changes).Therefore, whether again to depend on during changing the periodSecondary to meet range switching standards, equipment enables the range triggered and switches to be inverted or continue to complete.For in the transformation periodThe mechanism of period reversion range switching enhances the operability of equipment (for example, by the way that avoid need not when content quickly changesStrategic point toggle show can indicate appearance type), and make user facility operation more effective (for example, by reducing to userCaused by user's mistake when interfering and reducing using equipment or interacted with equipment), so as to improve the battery life (example of equipmentSuch as, by allow user more rapidly, more effectively operate equipment).
In some embodiments, change third value meeting range switching standards according to the cosmetic variation of determining contentAfter the value for showing the display properties that can be indicated in range, the additional appearance for the content that can be indicated is shown in equipment detection (8026)Variation;And in response to detecting that the additional cosmetic variation for the content that can be indicated is shown in display, the appearance that can be indicated is shown in equipment change,It include: to meet range handover trigger standard for the first time according to the additional cosmetic variation of determining content and be unsatisfactory for range to have switchedAt standard, change the value (example for showing the same display attribute that can be indicated according to the value for the display properties for showing the content that can be indicatedSuch as, true based on that can indicate that type (for example, bright show and can indicate) corresponding first predefined value mapping comes with showing of currently selectingSurely show the value of the display properties for each pixel that can be indicated), wherein showing that the display properties that can be indicated is confined between secondIt is worth variation in the first intermediate range between range and third value range;According to the additional cosmetic variation of determining content firstMeet range handover trigger standard for the second time after secondary and be unsatisfactory for range switching completion standard, according in showing and capable of indicatingThe value of the display properties of appearance changes the value for showing the same display attribute that can be indicated, wherein showing that the display properties that can be indicated is confined toChange in the second intermediate range between third value range and the first intermediate range;And according to determining contentAdditional cosmetic variation only once meets range handover trigger standard before meeting range switching completion standard, shows energy according to displayThe value of the display properties of the content of expression changes the value for showing the same display attribute that can be indicated, wherein showing the display properties that can be indicatedIt is confined to change within the scope of second value.Show can indicate to be switched to the second appearance type from the first appearance type after (exampleSuch as, in response to meeting range switching standards for the first time), if meeting range handover trigger standard again, showing can indicate openBegin to switch back into the first appearance type from the second appearance type.During the predefined transformation period, appearance value range continues from theThe value range transfer of two appearance types is the value range of the first appearance type.During shifting appearance value range, it can expire againSufficient range handover trigger standard (for example, due to content and showing that the appearance that can be indicated persistently changes).Therefore, the range triggered is cutChanging can invert from its current state and continue again towards the value range of the second appearance type.For anti-during changing the periodTurn range switching mechanism enhance the operability of equipment (for example, by avoid when content quickly changes unnecessarily comeSwitchback change show can indicate appearance type), and make user facility operation more effective (for example, by reducing to caused by user security riskUser's mistake when interfering and reducing using equipment or interacted with equipment), so as to improve equipment battery life (for example, logicalCross permission user more rapidly, more effectively operate equipment).
In some embodiments, (for example, scene switching occurs, cause on screen when being initially displayed home and show and can indicateThe content of display changes) when, equipment not yet accumulates the information about lower section content of sufficient amount, with various embodimentsDescribed in measurement of the mode based on content appearance select for certain it is bright show can indicate and imply and can indicate.Therefore, equipment is optionalThe value for showing the display properties that can be indicated sets predefined value by ground, and such as median is (for example, 0.5 or all light angle value50%) it, then allows above-mentioned dynamic algorithm to update at any time to show appearance can be indicated (for example, according to short time as described herein and lengthBoth time parameter methods).In some embodiments, when be initially displayed show can indicate when, show for switching and can indicate appearance typeProgression rates be temporarily increased and (maintain what is currently selected to show the deviation that can indicate type for example, reducing) so that show can table by homeShow the appearance based on lower section content rapidly adapt to it is bright show can indicate or imply and can indicate.In some embodiments, such as, when aobviousShow when new application program user interface (for example, via selected in multitask user the application program opened recently orStart application program from application graphs on home screen) when, when pulling down cover user interface (example from the edge of displaySuch as, system level information screen) with cover currently show application program user interface or home screen when, or work as rotatable user circleWhen face (for example, due to slewing) etc., it is initially displayed home and shows that the case where capable of indicating switches thing by the scene in user interfacePart triggering.In some embodiments, initially use animation transformation shows and can indicate to show, the animation change including at any time byIt is cumulative plus show the opacity that can be indicated, will show at any time can indicate from the boundary slip to screen of screen and/or withTime gradually increases the size shown and can indicated.
It should be appreciated that the particular order that the operation in Fig. 8 A to Fig. 8 F is described is only exemplary, not purportShowing that the sequence is the unique order that can execute these operations.Those skilled in the art will recognize that various waysTo resequence to operations described herein.Additionally, it should be noted that herein in regard to other methods as described herein (for example,Method 6000 and method 7000) description other processes details equally in a similar way be suitable for above for Fig. 8 A to schemeThe method 8000 of 8E description.For example, being regarded above with reference to the contact of the description of method 8000, gesture, user interface object, application programFigure, control panel, control, show can indicate, position threshold, direction condition, reverse curve, filter, value range, navigation standard,Moving parameter, focus selector and/or animation optionally have herein with reference to other methods as described herein (for example, method6000 with 7000) description contacts, gesture, user interface object, application view, control panel, control, position threshold,One or more of direction condition, navigation standard, moving parameter, focus selector and/or feature of animation.It is risen in order to conciseSee, these details are not repeated herein.
Operation in above- mentioned information processing method is optionally by one or more functions in operation information processing equipmentModule realizes, all for example general processors of the information processing equipment (for example, as above in regard to described in Figure 1A and Fig. 3)Or the chip specific to application.
Operation above with reference to Fig. 8 A to Fig. 8 F description is optionally implemented by component that Figure 1A describes into Figure 1B.ExampleSuch as, detection operation, transfer operation and change operation are optionally by event classifier 170, event recognizer 180 and event handling journeySequence 190 is implemented.Event monitor 171 in event classifier 170 detects the contact on touch-sensitive display 112, and thingEvent information is transmitted to application program 136-1 by part dispenser module 174.The corresponding event identifier 180 of application program 136-1Event information is defined 186 with corresponding event to be compared, and determines that the first contact on touch sensitive surface at first position isWhether no (or the rotation of the equipment) corresponds to predefined event or subevent, such as choosing to the object in user interfaceIt selects or the equipment is orientated the rotation to another orientation from one.When detecting corresponding predefined event or subevent,Event recognizer 180 activates button.onrelease 190 associated with the detection to the event or subevent.Button.onrelease190 optionally using or call data renovator 176 or object renovator 177 to carry out more new application internal state 192.OneIn a little embodiments, button.onrelease 190 accesses corresponding GUI renovator 178 and carrys out content shown by more new application.ClassAs, those skilled in the art can know clearly based in Figure 1A, into Figure 1B, how discribed component can realize otherProcess.
For illustrative purposes, the description of front is described by reference to specific embodiment.However, example aboveThe property shown discussion is not intended to exhausted or limits the invention to disclosed precise forms.According to above teaching content, veryMore modifications and variations are all possible.Selection and description embodiment are to most preferably illustrate the principle of the present inventionAnd its practical application, so as to so that others skilled in the art most preferably can be suitable for being conceived using havingThe described embodiment of the invention and various of the various modifications of special-purpose.

Claims (28)

CN201910756761.2A2017-09-092018-01-25Device, method and electronic device for displaying an affordance on a backgroundActiveCN110456979B (en)

Applications Claiming Priority (7)

Application NumberPriority DateFiling DateTitle
US201762556402P2017-09-092017-09-09
US62/556,4022017-09-09
DKPA2017707112017-09-22
DKPA201770711ADK179931B1 (en)2017-09-092017-09-22Devices, methods and graphical user interfaces for displaying an affordance on a background
US15/878,2762018-01-23
US15/878,276US10691321B2 (en)2017-09-092018-01-23Device, method, and graphical user interface for adjusting a display property of an affordance over changing background content
CN201880001526.8ACN109769396B (en)2017-09-092018-01-25 Apparatus, method and graphical user interface for displaying affordances on a background

Related Parent Applications (1)

Application NumberTitlePriority DateFiling Date
CN201880001526.8ADivisionCN109769396B (en)2017-09-092018-01-25 Apparatus, method and graphical user interface for displaying affordances on a background

Publications (2)

Publication NumberPublication Date
CN110456979Atrue CN110456979A (en)2019-11-15
CN110456979B CN110456979B (en)2021-11-02

Family

ID=61163854

Family Applications (2)

Application NumberTitlePriority DateFiling Date
CN201880001526.8AActiveCN109769396B (en)2017-09-092018-01-25 Apparatus, method and graphical user interface for displaying affordances on a background
CN201910756761.2AActiveCN110456979B (en)2017-09-092018-01-25Device, method and electronic device for displaying an affordance on a background

Family Applications Before (1)

Application NumberTitlePriority DateFiling Date
CN201880001526.8AActiveCN109769396B (en)2017-09-092018-01-25 Apparatus, method and graphical user interface for displaying affordances on a background

Country Status (2)

CountryLink
CN (2)CN109769396B (en)
WO (1)WO2019050562A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2021143929A1 (en)*2020-01-192021-07-22华为技术有限公司Display method and electronic device
US20220050583A1 (en)*2018-12-172022-02-17Sony Group CorporationImage processing apparatus, image processing method, and program
CN114253401A (en)*2021-12-272022-03-29郑州捷安高科股份有限公司Method and device for determining position in virtual scene, electronic equipment and storage medium

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
EP3286915B1 (en)2015-04-232021-12-08Apple Inc.Digital viewfinder user interface for multiple cameras
US10009536B2 (en)2016-06-122018-06-26Apple Inc.Applying a simulated optical effect based on data received from multiple camera sensors
DK180859B1 (en)2017-06-042022-05-23Apple Inc USER INTERFACE CAMERA EFFECTS
US11112964B2 (en)2018-02-092021-09-07Apple Inc.Media capture lock affordance for graphical user interface
US11722764B2 (en)2018-05-072023-08-08Apple Inc.Creative camera
DK201870623A1 (en)2018-09-112020-04-15Apple Inc.User interfaces for simulated depth effects
US11128792B2 (en)2018-09-282021-09-21Apple Inc.Capturing and displaying images with multiple focal planes
US11321857B2 (en)2018-09-282022-05-03Apple Inc.Displaying and editing images with depth information
US11706521B2 (en)2019-05-062023-07-18Apple Inc.User interfaces for capturing and managing visual media
US11770601B2 (en)2019-05-062023-09-26Apple Inc.User interfaces for capturing and managing visual media
CN111901475A (en)*2019-05-062020-11-06苹果公司User interface for capturing and managing visual media
CN119815169A (en)*2020-06-012025-04-11苹果公司 User interface for managing media
US11054973B1 (en)2020-06-012021-07-06Apple Inc.User interfaces for managing media
US11212449B1 (en)2020-09-252021-12-28Apple Inc.User interfaces for media capture and management
US11778339B2 (en)2021-04-302023-10-03Apple Inc.User interfaces for altering visual media
US11539876B2 (en)2021-04-302022-12-27Apple Inc.User interfaces for altering visual media
US12112024B2 (en)2021-06-012024-10-08Apple Inc.User interfaces for managing media styles
US20240373121A1 (en)2023-05-052024-11-07Apple Inc.User interfaces for controlling media capture settings

Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2008076816A2 (en)*2006-12-132008-06-26Adobe Systems, IncorporatedMethod and systems for dynamic, luminance-based color contrasting in a region of interest in a graphic image
US8091038B1 (en)*2006-11-292012-01-03Adobe Systems IncorporatedAdaptive graphical interface
US20150205505A1 (en)*2014-01-172015-07-23Jeremy B. ConnDynamic adjustment of a user interface
US20160246475A1 (en)*2015-02-222016-08-25Microsoft Technology Licensing, LlcDynamic icon recoloring to improve contrast

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN108958550B (en)*2012-05-092021-11-12苹果公司Device, method and graphical user interface for displaying additional information in response to user contact
KR102001332B1 (en)*2012-12-292019-07-17애플 인크.Device, method, and graphical user interface for determining whether to scroll or select contents
US9880735B2 (en)*2015-08-102018-01-30Apple Inc.Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US8091038B1 (en)*2006-11-292012-01-03Adobe Systems IncorporatedAdaptive graphical interface
WO2008076816A2 (en)*2006-12-132008-06-26Adobe Systems, IncorporatedMethod and systems for dynamic, luminance-based color contrasting in a region of interest in a graphic image
US20150205505A1 (en)*2014-01-172015-07-23Jeremy B. ConnDynamic adjustment of a user interface
US20160246475A1 (en)*2015-02-222016-08-25Microsoft Technology Licensing, LlcDynamic icon recoloring to improve contrast

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20220050583A1 (en)*2018-12-172022-02-17Sony Group CorporationImage processing apparatus, image processing method, and program
WO2021143929A1 (en)*2020-01-192021-07-22华为技术有限公司Display method and electronic device
CN114253401A (en)*2021-12-272022-03-29郑州捷安高科股份有限公司Method and device for determining position in virtual scene, electronic equipment and storage medium

Also Published As

Publication numberPublication date
WO2019050562A1 (en)2019-03-14
CN110456979B (en)2021-11-02
CN109769396A (en)2019-05-17
CN109769396B (en)2023-09-01

Similar Documents

PublicationPublication DateTitle
CN110456979A (en)For showing equipment, method and the graphic user interface that can indicate in background
US12154218B2 (en)User interfaces simulated depth effects
US11989364B2 (en)Reduced-size interfaces for managing alerts
US12189872B2 (en)Interacting with an electronic device through physical movement
JP6816188B2 (en) Devices, methods and graphical user interfaces for adjusting the appearance of controls
JP6705842B2 (en) Device, method, and graphical user interface for providing navigation and search functionality
CN110795018B (en)Device, method and graphical user interface for switching between camera interfaces
JP2023098962A (en)Devices, methods and graphical user interfaces for displaying affordance on background
CN109643217A (en)Device, method and user interface for interacting with user interface objects by proximity-based and contact-based input
EP4510653A2 (en)Voice communication method
CN110162243A (en)Equipment, method and graphic user interface for being interacted with control object
US20170359302A1 (en)Managing contact information for communication applications
CN108334227A (en)Method, equipment, medium and device for deleting content
CN107924264A (en)For adjusting the equipment, method and graphic user interface of user interface object
CN109298789A (en)For providing equipment, method and the graphic user interface of feedback for state of activation
CN106462321A (en)Application menu for video system
CN108845748A (en)For abandoning generating equipment, method and the graphic user interface of tactile output for more contact gestures
US20240053859A1 (en)Systems, Methods, and Graphical User Interfaces for Interacting with Virtual Reality Environments
CN108700949A (en)For the tactile time feedbacking based on wrist of loss of sight user
CN108829325A (en)For dynamically adjusting the equipment, method and graphic user interface of the presentation of audio output
CN109974581A (en)The device and method measured using augmented reality
CN109416599A (en)For handling the device and method of touch input based on the input parameter of adjustment
CN110134248A (en)Tactile output based on content
US20240380834A1 (en)User interfaces for communication using electronic devices
HK1221041A1 (en)Electronic touch communication

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp