Specific embodiment
In order to make the above objects, features, and advantages of the present application more apparent, with reference to the accompanying drawing and it is specific realApplying mode, the present application will be further described in detail.
In the embodiment of the present application, background can be used for indicating the bottom at interface；Prospect is on the background at interface, for renderingThe content for needing to show；Background image is used to indicate to be used to draw the bottom figure at the position of corresponding interface element in interfacePicture.Interface element refers to the series of elements for meeting user's interactive requirements that the interface that can meet interaction demand is included, interfaceThe example of element may include: window, dialog box, menu, scroll bar, figure etc..
The embodiment of the present application provides a kind of interface processing scheme of mobile device, the available mobile device of the programThe corresponding image of external environment；According to the corresponding image of the external environment, at least portion is determined in the interface of the mobile deviceThe background image of boundary surface element, the tone of the background image and the tone of the external environment corresponding image match；At least partly background of interface element is set in the interface of the mobile device by the background image；Since the application is implementedIn example in the interface of mobile device at least partly the tone of background image corresponding to the background of interface element and external environment it is rightAnswering the tone of image can match, therefore at least partly interface element can be in the interface of mobile device in the embodiment of the present applicationThe external environment of mobile device is adapted, in this way, it is possible to prevente effectively from the excessively bright interface for leading to mobile device of external environment is seen notClearly and external environment secretly leads to excessively dazzling etc. the situations in the interface of external equipment excessively, therefore can be improved the boundary of mobile deviceThe clarity and readability in face；Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present applicationThe unintelligible bring security risk in interface can also be avoided, the safety of driving is improved.
In the embodiment of the present application, mobile device usually has a display screen, can be used family obtain whenever and wherever possible it is variousInformation.Above-mentioned mobile device specifically includes but unlimited: (dynamic image is special by smart phone, tablet computer, E-book reader, MP3Family's compression standard audio level 3, Moving Picture Experts Group Audio Layer III) player, MP4(dynamic image expert's compression standard audio level 4, Moving Picture Experts Group Audio Layer IV) is broadcastIt puts device, pocket computer on knee, intelligent automobile, mobile unit, desktop computer, set-top box, intelligent TV set, wearable setIt is standby etc..
The embodiment of the present application is mainly illustrated the interface processing scheme of mobile device by taking mobile unit as an example.It is vehicle-mounted to setThe standby electronic equipment that can be used for indicating to be applied to vehicle, the mobile unit can provide a user vehicle-mounted user's navigation, driving noteRecord, phone, music, online FM (frequency modulation, Frequency Modulation), weather, the functions such as take pictures；Also, this is vehicle-mounted to setIt is standby that UI can be provided, not only the contents such as operation interface, image, video can be showed to user by UI, but also may be implementedHuman-computer interaction.According to some embodiments, the example of above-mentioned mobile unit may include: that automatic navigator, driving recording, intelligence are completeShield rearview mirror, electronic eyes, reversing radar, vehicle-carrying DVD (digital versatile disc, Digital Versatile Disc) etc..
The example of onboard operations system corresponding to above-mentioned mobile unit may include: WinCE, Linux, IOS, Android,YunOS, QNX etc., above-mentioned onboard operations system can be user and vehicle-mounted hardware interface, while may be vehicle-mounted hardware andThe interface of upper layer software (applications)；The function of above-mentioned onboard operations system may include: to manage hardware, software and the data money of onboard systemSource, the operation of control program, improve man-machine interface, provide for upper layer software (applications) support, allow mobile device resource and receive numberAccording to, signal, audio, video play a role to the maximum extent, various forms of UI are provided, good driving ring is provided a userBorder, and auxiliary driving, semi-automatic driving, even automatic Pilot are effectively provided.It is appreciated that the embodiment of the present application is for specificMobile device and its corresponding onboard operations system it is without restriction.
Referring to Fig.1, a kind of step flow chart of the interface processing method embodiment of mobile device of the application is shown, is hadBody may include steps of:
Step 101, the corresponding image of external environment for obtaining mobile device；
Step 102, according to the corresponding image of the external environment, determine in the interface of the mobile device at least partly boundaryThe background image of surface element, the tone of the background image and the tone of the external environment corresponding image match；
The background image is set in the interface of the mobile device at least partly back of interface element by step 103Scape.
In the embodiment of the present application, external environment can be used for indicating external environment locating for mobile device, optionally, above-mentioned outerPortion's environment may include: the ambient enviroment of mobile device, for example, the front and/or rear of mobile device and/or side and/orThe environment of lower section.
In practical applications, step 101 can obtain the corresponding image of external environment by camera.Optionally, above-mentionedCamera may include: front camera and/or rear camera and/or side view camera and/or lower section camera etc., can be withUnderstand, the quantity of above-mentioned front camera and/or rear camera and/or side view camera and/or lower section camera can beOne or more.By above-mentioned front camera and/or rear camera and/or side view camera and/or lower section camera,The corresponding image of environment in the front and/or rear and/or side and/or lower section of external environment can be obtained respectively.
According to some embodiments, the corresponding image of external environment that camera can be acquired in real time, as external environmentCorresponding image；However, the mode of above-mentioned acquisition image, by operation spent by the easy interface processing for increasing mobile deviceAmount.
In practical applications, external environment can be corresponding with and hold time, the internal and external environment of holding time can notIt changes or occurs small change.For example, vehicle, during straight trip, the environment in front of mobile unit can be oneIt does not change in fixing time or occurs small change.Therefore, in order to reduce spent by the interface processing of mobile deviceOperand, some embodiments of the present application can realize the interface processing frequency for mobile device by the acquisition process of imageThe control of rate.
In a kind of alternative embodiment of the application, acquisition side corresponding to the corresponding image of above-mentioned acquisition external environmentFormula can specifically include:
The corresponding figure of external environment of acquisition modes 1, the mobile device acquired according to the first during cycle, acquisition cameraPicture, the corresponding image of external environment as mobile device；And/or
Acquisition modes 2, the corresponding video of external environment for obtaining the mobile device that camera acquires, according in the videoSimilarity between adjacent two frame obtains the corresponding image of external environment of mobile device from the video；And/or
Acquisition modes 3, according to the second during cycle, the corresponding video of external environment of the mobile device acquired from cameraMiddle extraction first frame obtains the external environment of mobile device according to the similarity between adjacent first frame from the first frameCorresponding image.
Acquisition modes 1 can carry out the acquisition of image according to the first during cycle；First during cycle can be by this fieldTechnical staff sets according to practical application request, can also be set by the user, for example, first during cycle can be 60s, 90sDeng.Alternatively, being expert under the scape of parking lot, first during cycle can also be determined according to speed and running distance, the first preset weekPhase can be inversely proportional with speed, and directly proportional to running distance, it will be understood that the embodiment of the present application is preset for specific firstPeriod and its method of determination are without restriction.
Acquisition modes 2 can obtain external according to the similarity between two frame adjacent in the video from the videoThe corresponding image of environment meets prerequisite namely changes greatly it is possible thereby to monitor to obtain the similarity between adjacent two frameFrame, the corresponding image of external environment as mobile device.
Acquisition modes 3 can be first, in accordance with the second during cycle, from the corresponding video of external environment that camera acquiresFirst frame is extracted, the number of first frame can be greater than 1.It is alternatively possible to first frame is stored in the first store path, for readingIt takes.Each first frame can then be read from first store path, and according to the similarity between adjacent first frame, from described theThe corresponding image of external environment is obtained in one frame.Since first frame is the video frame extracted according to the second during cycle, thereforeThe extraction of first frame can play the screening effect of video frame, obtain external environment from the first frame in this way, can reduceThe operand of corresponding image.In a kind of application example of the application, it is assumed that video frame includes: F1、F2、…Fi..., whereinI is positive integer, it assumes that the second during cycle is 10 video frames corresponding time, that is, can mention every 10 video framesA first frame is taken, then can extract F1、F11、F21、F31Etc. video frames as first frame, and calculate adjacent first frame (with F1WithF11) between similarity.Wherein, the method for determination of the second during cycle is similar with the method for determination of the first during cycle mode,And therefore not to repeat here, cross-referenced.
In a kind of alternative embodiment of the application, the color of adjacent two frame (former frame and present frame) can be obtained respectivelyHistogram, the color histogram can be used for describing the distribution situation of tone in a frame image, can reveal that each in a frame imageThe appearance quantity of pixel under a gray scale；Further, it is possible to compare the color histogram of adjacent two frame by image recognition algorithmFigure, to obtain the color similarity between adjacent two frame, and it is current less than the first similarity threshold to get color similarityFrame, as image.For example, the color similarity may include: the difference between the appearance quantity of adjacent each tone of two frames, it is above-mentionedFirst similarity threshold can be determined by those skilled in the art according to practical application request.
In another alternative embodiment of the application, it can be directed to adjacent two frame, calculate the gray value of all pixels pointThe average value of difference obtains the gray scale difference average value of adjacent two frame, as the gray scale difference similarity between adjacent two frame, and obtainsPresent frame to similarity less than the second similarity threshold, as the corresponding image of external environment.
In a kind of application example of the application, the calculating process of gray value difference is referred to formula (1), and gray scale difference is flatThe calculating process of mean value is referred to formula (2).
Yt=Xt-Xt-1 (1)
Wherein, XtAnd Xt-1Respectively indicate the present frame and former frame in adjacent two frame, YtIndicate XtAnd Xt-1Corresponding differenceImage, the error image may include multiple pixels, and the value of each pixel represents gray value difference,Indicate the differential chartAs corresponding gray scale difference average value, M and N respectively indicate the width and height of image, and i and j respectively indicate the row and column element of imageNumber.
It is appreciated that above-mentioned color similarity and gray scale difference similarity be intended only as in the embodiment of the present application adjacent two frame itBetween similarity alternative embodiment, in fact, the embodiment of the present application is without restriction for the embodiments mode of similarity.
To sum up, above-mentioned acquisition modes 1 control the acquisition opportunity of the corresponding image of external environment, with pre- according to firstThe period is set to the subsequent corresponding image of step 102 offer external environment, it is possible thereby to realize the interface for mobile deviceManage the control of frequency.Above-mentioned acquisition modes 2 can be obtained from the video according to the similarity between two frame adjacent in videoThe frame that similarity between adjacent two frame meets prerequisite namely changes greatly also can as the corresponding image of external environmentThe enough control for realizing the interface processing frequency for mobile device.Above-mentioned acquisition modes 3 can be in conjunction with acquisition modes 1 and acquisition sideFormula 2 obtains the corresponding image of external environment.Therefore, above-mentioned acquisition modes 1, acquisition modes 2 and acquisition modes 3 can reduceOperand spent by the interface processing of mobile device.
It is appreciated that above-mentioned acquisition modes 1, acquisition modes 2 and acquisition modes 3 be intended only as obtaining external environment it is correspondingThe alternative embodiment of image, in fact, the embodiment of the present application is not added for obtaining the detailed process of the corresponding image of external environmentWith limitation.
Step 102 can obtain the corresponding image of external environment according to step 101, determine in the interface of mobile device at leastThe background image of part interface element, wherein the tone of the background image acquired is corresponding with the external environmentThe tone of image can match.
In the embodiment of the present application, it is big color effect that tone, which refers to the general inclination of a width picture-in-picture complexion coloured silk,.ColorTune may include: dominant hue and/or auxiliary tone.
Wherein, dominant hue can be used for indicating the basic tendency of the primary color of image and the color appearance of image.One frame figureAlthough it is inclined that it for example is partially blue or partially red that image, which is generally to have a kind of tendency in color, as that can use multiple colorWarm or colder etc., the basic tendency of color appearance is exactly the dominant hue of a frame image.For example, being transferred in terms of changes in temperature to mass-toneRow divides, available: " warm tones ", " cool tone " and " semi-tone ".Generally, red, orange, yellow is to indicate warm colourIt adjusts；Green, blue, black indicate cool tone；And grey, purple, white then indicate semi-tone；The brightness of cool tone is higher,Its overall feeling is warmer, and warm-toned brightness is higher, and overall feeling is more colder.Auxiliary tone is only secondary and dominant hue visionThe complementary colors of area is the auxiliary tone for setting off dominant hue by contrast, supporting dominant hue, playing fusion dominant hue effect.
The color of the tone image corresponding with external environment of the background image acquired due to the embodiment of the present applicationTune can match, therefore can make that at least partly interface element is adapted with external environment in the interface of mobile device.Wherein, it carries on the backThe tone of the tone of scape image image corresponding with external environment matches, and can specifically include: the tone of background image and outerThe tone of the corresponding image of portion's environment is identical, similar or related.
It is above-mentioned according to the corresponding image of the external environment in a kind of alternative embodiment of the application, determine the shiftingThe process of at least partly background image of interface element may include: that the acquisition external environment is corresponding in the interface of dynamic equipmentThe tone of image；According to the tone, at least partly background image of interface element is generated in the interface of the mobile device.ByIt is generated in the tone that background image is foundation image, therefore the phase between the tone of background image and the tone of image may be implementedMatching.
The embodiment of the present application can use arbitrary tone acquisition methods, obtain the color of the corresponding image of the external environmentIt adjusts.For example, a kind of tone acquisition methods can first determine whether to constitute the color of each pixel of the corresponding image of external environment；Then, the tone of the corresponding image of external environment is determined using the pixel quantity of various colors, corresponding determination process canTo include: the dominant hue by the maximum color of accounting as the corresponding image of external environment, wherein above-mentioned accounting can be imageIn certain color pixel quantity for being included account for the ratio of all pixels point quantity in image.It is appreciated that can be by accounting notIt is the largest color, the auxiliary tone as the corresponding image of external environment.It is appreciated that the embodiment of the present application is for specific colorAdjust acquisition methods without restriction.
The tone of image can be applied to the background image at the interface of mobile device by the embodiment of the present application, so that the backgroundImage changes with external environment, and then provides a user the interface of clarity and readable preferable mobile device, is answeringFor drive a vehicle scene when, the safety of driving can also be improved.
According to some embodiments, the background image generated according to the tone can be the uniform background image of color,It can be the background image of linear gradient, wherein the stereovision of background image can be enhanced in the background image of linear gradient.
A kind of process of background image that linear gradient is generated according to tone is provided herein, wherein can extract toneHSV (i.e. coloration Hue, saturation degree Saturation and lightness Value), according to the HSV of tone, setting starting color and termination faceColor, and linear color rendering device and gradual change direction are set, and then according to linear color rendering device and gradual change direction, by toneHSV change of gradient is carried out on painting canvas, to generate the background image of linear gradient.It is appreciated that the back of above-mentioned linear gradientThe generating process of scape image is intended only as example, in fact, those skilled in the art can use arbitrary image processing toolTo generate the background image of linear gradient according to tone, the embodiment of the present application is for the Background according to tone generation linear gradientThe detailed process of picture is without restriction.
In a kind of embodiment of the application, the behaviour for the tone for obtaining described image can be executed respectively by different applicationsMake and generate according to the tone operation of background image, application herein may include: system application (operating system it is included orThe application that person provides) and/or nonsystematic application (application of user installation).For example, first applies the available external ringsThe tone of the corresponding image in border, and send the tone to the second application, then second application can be raw according to the toneAt background image.Wherein, the first application can send the tone to the second application by interprocess communication mode, optionally,Above-mentioned interprocess communication mode may include: broadcast, AIDL (Android Interface Definition Language, Android InterfaceDefinition Language) etc..It is appreciated that the embodiment of the present application is for obtaining the corresponding image of the external environmentThe specific executing subject of the operation of tone and the operation according to tone generation background image is without restriction.
It is above-mentioned according to the corresponding image of the external environment in another alternative embodiment of the application, determine described inThe process of at least partly background image of interface element may include: corresponding to the external environment in the interface of mobile deviceImage carries out Gaussian Blur processing, to obtain corresponding Gaussian Blur image, as at least portion in the interface of the mobile deviceThe background image of boundary surface element.Since above-mentioned Gaussian Blur image is to carry out height on the basis of external environment corresponding imageWhat this Fuzzy Processing obtained, therefore above-mentioned Gaussian Blur image can retain tone (such as mass-tone of the corresponding image of external environmentAdjust), therefore matching between the tone for the tone image corresponding with external environment that background image may be implemented.
Also, above-mentioned Gaussian Blur processing can be by the pixel color in the corresponding image of external environment around certain pixelValue is got up by Gaussian curve statistics, and mathematically average weighted calculation method obtains the average color of this Gaussian curve for use,The color value of the pixel is adjusted to the average color, in this way, the color value of each pixel is taken being averaged for neighboring pixelValue, this is a kind of smoothing techniques of pixel color value, and the partial pixel point of the corresponding image of external environment is made to lose details, realExisting Gaussian Blur processing.Since the background image of the embodiment of the present application is to carry out height on the basis of external environment corresponding imageWhat this Fuzzy Processing obtained, therefore can be improved the contrast between the background and prospect at the interface of mobile device, improve prospectLegibility and clarity.
The background image that step 103 can obtain step 102 is set as in the interface of the mobile device at least partlyThe background of interface element, to use the Background at least partly in the background of interface element in the interface of the mobile devicePicture.In practical applications, background and prospect can be overlapped, to obtain the interface of mobile device.
In a kind of alternative embodiment of the application, the corresponding image of the external environment can be carried out by the first application highThis Fuzzy Processing, to obtain corresponding Gaussian Blur image.Then the method can also include: that the first application is sent out to third applicationSend the store path of the Gaussian Blur image and/or the Gaussian Blur image；It is described to set institute for the background imageThe process for stating at least partly background of interface element in the interface of mobile device may include: that third is applied the Gaussian BlurImage is set as in the interface of the mobile device at least partly background of interface element.Wherein, the first application and the hereinIt can be identical or not that three applications, which can be applied for system application or nonsystematic application, third with the second application above-mentioned,Same application.First application can send the Gaussian Blur image and/or institute to third application by interprocess communication modeState the store path of Gaussian Blur image.
In another alternative embodiment of the application, the interface of the mobile device can be card form interface, describedCard form interface may include at least one card, wherein as the interface element at the card form interface, card can be friendshipThe supporting body of mutual information, is usually presented in a manner of rectangle, and the form that the card of page format can be concentrated with one provides quickAnd relevant information；One of the characteristics of card is interactivity, that is, card can not only provide information, but also can be usedAnother mild and roundabout mode goes to require once to interact.
It is above-mentioned to set the movement for the background image in the case where the interface of mobile device is card form interfaceThe process of at least partly background of interface element may include: in the interface of equipment
Set above-mentioned background image to the background of card in above-mentioned card form interface；And/or
Set above-mentioned background image to the wallpaper background at above-mentioned card form interface.
In the embodiment of the present application, wallpaper can be used for indicating background picture used in the display screen of mobile device, the applicationEmbodiment can set above-mentioned background image to the wallpaper at entire card form interface, and/or, above-mentioned background image can be setIt is set to the background of card included by above-mentioned card form interface.
It is appreciated that above-mentioned card form interface is intended only as the alternative embodiment at the interface of mobile device, in fact, arbitrarilyInterface (such as list type interface) within the protection scope at the interface of the mobile device of the embodiment of the present application.
In another alternative embodiment of the application, the interface of above-mentioned mobile device may include multiple interfaces windows,Then different interfaces windows can correspond to same or different background image.Wherein, above-mentioned multiple interfaces windows can on toUnder set gradually, interfaces windows above can be covered on following interfaces windows, and interfaces windows above can be according toIt is hidden according to the operation of user.In the case where different interfaces windows correspond to different background images, the layer at interface can be enhancedSecondary sense.
In a kind of application example of the application, it is assumed that the interface of above-mentioned mobile device includes: the first interfaces windows andSecond interface window, wherein the first interfaces windows are covered on second contact surface window；First interfaces windows state for renderingThe system informations such as column, navigation bar, notice, second contact surface window can be used for presenting the content of application, such as system setting, desktop, leadThe information of the applications such as boat, music, desktop are the applications of first starting after system is got up, and are mainly used for carrying by card and applyIcon, the information such as illustrate, by clicking card, corresponding application interface can be jumped to.In practical applications, mobile deviceAbove-mentioned first interfaces windows and above-mentioned second contact surface window can be initialized respectively after actuation.Assuming that above-mentioned first interfaces windows andThe first card and the second card are respectively arranged in above-mentioned second contact surface window, the size of usual first card is greater than the second cardSize, then the background image of the first card and the second card can be same or different.
To sum up, the interface processing method of the mobile device of the embodiment of the present application, the external environment of available mobile deviceCorresponding image determines in the interface of the mobile device at least partly Interface Element according to the corresponding image of the external environmentThe background image of element, the tone of the background image and the tone of the external environment corresponding image match, and will be describedBackground image is set as in the interface of the mobile device at least partly background of interface element；Due at least portion in mobile deviceThe tone of background image corresponding to the background at the interface of boundary surface element can match with the tone of external environment correspondence image,Therefore at least partly interface element can be adapted with external environment in the interface of the embodiment of the present application, in this way, it is possible to prevente effectively fromThe excessively bright interface for leading to mobile device of external environment is not seen and external environment secretly causes the interface of mobile device excessively to be pierced excessivelyThe situations such as eye, therefore can be improved the clarity and readability at the interface of mobile device, that is, the embodiment of the present application can be improvedCompatible degree between the interface and external environment of mobile device, and then the interface of intelligence beauty can be provided a user.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoidedThe unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
To make those skilled in the art more fully understand the embodiment of the present application, referring to Fig. 2, a kind of shifting of the application is shownThe step flow chart of the interface processing method embodiment of dynamic equipment, in the embodiment, which can be mobile unit, shouldMobile unit may include: built-in or external camera, can run multiple applications in the mobile unit, which setsThe step of standby interface processing method embodiment, can be executed by multiple applications:
Step 201, driving recording apply the external environment of the mobile unit according to the second during cycle, acquired from cameraFirst frame is extracted in corresponding video；
Step 202, driving recording apply the store path that first frame is sent to the first application；
For example, driving recording application can be to the store path of the first application broadcast first frame.
Step 203, the first application obtain external environment from the first frame according to the similarity between adjacent first frameCorresponding image；
First application can be any application of onboard operations system, can be used as driving recording and apply and the second applicationPerhaps the medium between third application can be used for providing the information of the background at interface to the second application or third application.
Step 204, the first application carry out Gaussian Blur processing to the corresponding image of the external environment, corresponding to obtainGaussian Blur image；
Step 205, the first application send the store path of Gaussian Blur image to the second application；
For example, the first application can be to the store path of the second application broadcast Gaussian Blur image.
Step 206, the first application obtain the dominant hue of the corresponding image of the external environment；
Step 207, the first application send the dominant hue of the corresponding image of the external environment to third application；
The Gaussian Blur image is set in corresponding interface at least partly interface element by step 208, the second applicationBackground；
Step 209, third apply the gradient that linear gradient is generated according to the dominant hue of the corresponding image of the external environmentImage；
Step 210, third are applied using the gradient image of the linear gradient as at least partly Interface Element in correspondence interfaceThe background of element.
According to some embodiments, the second application and third can be different interfaces windows using corresponding interface, for example,The second corresponding interface of application can be system interface, which can be used for presenting the systems such as status bar, navigation bar, noticeInformation, third can be desk interface using corresponding interface, which can be used for presenting the content of application.Optionally,Second application and third application can be respectively using the gradient images of Gaussian Blur image and linear gradient as the wall at corresponding interfacePaper background, alternatively, second application and third application can respectively using the gradient image of Gaussian Blur image and linear gradient asThe background of corresponding the included card in interface.
It should be noted that above-mentioned driving recording application, the first application, the second application and third application are intended only as this ShenPlease embodiment mobile device interface processing method executing subject example, in fact, those skilled in the art can rootAccording to practical application request, the interface processing method of the mobile device of the embodiment of the present application is executed using arbitrary executing subject, thisApply for that embodiment is without restriction for specific executing subject.
Referring to Fig. 3, a kind of step flow chart of the interface processing method embodiment of mobile device of the application is shown, is hadBody may include steps of:
Step 301, the corresponding information of external environment for obtaining mobile device；
Step 302, according to the corresponding information of the external environment, determine in the interface of the mobile device at least partly boundaryThe background image of surface element, the tone phase that the tone of the background image is characterized with information corresponding to the external environmentMatch；
The background image is set in the interface of the mobile device at least partly back of interface element by step 303Scape.
In practical applications, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic orderThe corresponding characteristic information of the external environment arrived.Wherein, image can shoot to obtain by camera；Phonetic order can be userVoice messaging, can be used for characterizing the corresponding characteristic information of external environment of mobile device.
In practical applications, above-mentioned phonetic order can be received by microphone or other voice collecting devices, alternatively, baseThe above-mentioned phonetic order of communications reception between equipment.And it is possible to by speech recognition technology, phonetic order is converted to pairThe corresponding characteristic information of the external environment of the text answered, the text namely mobile device.
If phonetic order is denoted as S, corresponding phonetic feature sequence O is obtained after carrying out a series of processing to S,It is denoted as O={ O1, O2..., Oi..., OT, wherein OiIt is i-th of phonetic feature, T is phonetic feature total number.S pairs of phonetic orderThe sentence answered is considered as a word string being made of many words, is denoted as W={ w1, w2..., wn}.The process of speech recognition is exactlyAccording to known phonetic feature sequence O, most probable word string W is found out.
Specifically, speech recognition is the process of a Model Matching, in this process, can be first according to the language of peopleSound feature establishes speech model, by the analysis of the voice signal to input, extracts required feature, Lai Jianli speech recognition instituteThe template needed；The process that voice inputted to user is identified is by the feature of the inputted voice of user and the template ratioCompared with process, the finally determining optimal Template with the inputted voice match of the user, to obtain the result of speech recognition.ToolThe speech recognition algorithm of body can be used the training and recognizer of the hidden Markov model based on statistics, base can also be usedIn the training of neural network and recognizer, based on the matched recognizer of dynamic time consolidation etc. other algorithms, the present inventionEmbodiment is without restriction for specific speech recognition process.
The embodiment of the present application can provide interactive voice ability, and user can be supported to set by voice command control movementThe processing at standby interface.Specifically, user can obtain the corresponding characteristic information of external environment of mobile device by naked eyes, andGenerate corresponding phonetic order.
Optionally, the corresponding characteristic information of the external environment of mobile device may include: the corresponding color letter of external environmentBreath, corresponding phonetic order can be " external environment is green ", " outside is green " etc..
Optionally, the corresponding characteristic information of the external environment of mobile device may include: the corresponding object letter of external environmentBreath, corresponding phonetic order can be " external environment is forest ", " front is a black car ", " the right and left is highPoplar " or " the right and left is high buildings and large mansions " etc..
It is above-mentioned according to the corresponding information of the external environment in a kind of embodiment of the application, determine that the movement is setAt least partly process of the background image of interface element in standby interface, may include: according to the corresponding spy of the external environmentReference breath, determines the first tone；According to first tone, at least partly interface element is generated in the interface of the mobile deviceBackground image.Specifically, the first tone can be extracted from the corresponding colouring information of the external environment, for example, from " externalEnvironment is green " in the first tone for extracting be " green " etc..
It is above-mentioned according to the corresponding information of the external environment in another embodiment of the application, determine the movementAt least partly process of the background image of interface element in the interface of equipment may include: to determine object corresponding with external environmentThe second tone that body information matches；According to first tone, at least partly interface is generated in the interface of the mobile deviceThe background image of element.For example, determining the second matched color for objects such as forest, car, high buildings and large mansions, poplarsAdjust etc..
It is above-mentioned according to the corresponding information of the external environment in the another embodiment of the application, determine the movementAt least partly process of the background image of interface element in the interface of equipment may include: to determine object corresponding with external environmentThe first image that body information matches；According to the first image, at least partly interface is determined in the interface of the mobile deviceThe background image of element.Wherein it is possible to obtain the first image that object information corresponding with external environment matches in picture library, such asCorresponding first image of the objects such as forest, car, high buildings and large mansions, poplar etc..
For according to the first image, determining in the interface of the mobile device at least partly Background of interface elementFor the process of picture, due to its with aforementioned step 102 according to the corresponding image of the external environment, determine the mobile deviceInterface in at least partly background image of interface element process it is similar, and therefore not to repeat here, cross-referenced.
To sum up, the interface processing method of the mobile device of the embodiment of the present application, can provide interactive voice ability, and can be withUser is supported to pass through the processing at the interface of voice command control mobile device；Specifically, it can be obtained according to based on phonetic orderThe corresponding characteristic information of external environment, determine in the interface of the mobile device at least partly background image of interface element,And at least partly background of interface element is set in the interface of the mobile device by the background image.
The tone of the background image as corresponding at least partly background at the interface of interface element in mobile device and outsideThe tone of environment correspondence image can match, therefore at least partly interface element can be with outside in the interface of the embodiment of the present applicationEnvironment is adapted, in this way, it is possible to prevente effectively from the excessively bright interface for leading to mobile device of external environment is not seen and external environmentCrossing secretly leads to excessively dazzling etc. the situations in the interface of mobile device, therefore can be improved the clarity at the interface of mobile device and readableProperty, that is, the embodiment of the present application can be improved the compatible degree between the interface of mobile device and external environment, and then can toFamily provides intelligence beautiful interface.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoidedThe unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the methodIt closes, but those skilled in the art should understand that, the embodiment of the present application is not limited by the described action sequence, because according toAccording to the embodiment of the present application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also shouldKnow, the embodiments described in the specification are all preferred embodiments, and related movement not necessarily the application is implementedNecessary to example.
The embodiment of the present application also provides a kind of interface processor units of mobile device.
Referring to Fig. 4, a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application is shown, specificallyMay include following module:
Image collection module 401, the corresponding image of external environment for obtaining mobile device；
Background image determining module 402, for determining the mobile device according to the corresponding image of the external environmentAt least partly background image of interface element in interface, the tone of the background image and the external environment corresponding imageTone matches；And
Background setup module 403, for setting the background image in the interface of the mobile device at least partlyThe background of interface element.
Optionally, the background image determining module 402 may include:
Tone acquisition submodule, for obtaining the tone of the corresponding image of the external environment；And
Background image generates submodule, for generating in the interface of the mobile device at least partly according to the toneThe background image of interface element.
Optionally, the background image determining module 402 may include:
Gaussian Blur handles submodule, for carrying out Gaussian Blur processing to the corresponding image of the external environment, withTo corresponding Gaussian Blur image, as at least partly background image of interface element in the interface of the mobile device.
Optionally, the interface of the mobile device can be card form interface, and the card form interface includes at least oneCard, then the background setup module 403 may include:
Submodule is arranged in first background, for setting the background image to the back of card in the card form interfaceScape；And/or
Submodule is arranged in second background, for setting the background image to the wallpaper background at the card form interface.
Optionally, the interface of the mobile device includes multiple interfaces windows, different interfaces windows can correspond to it is identical orThe different background image of person.
Optionally, described image acquisition module 401 may include:
First image acquisition submodule, for according to the first during cycle, the external environment for obtaining camera acquisition to be correspondingImage, as the corresponding image of external environment；And/or
Second image acquisition submodule, the corresponding video of external environment of the mobile device for obtaining camera acquisition,According to the similarity between two frame adjacent in the video, the corresponding figure of external environment of mobile device is obtained from the videoPicture；And/or
Third image acquisition submodule, the outside for the mobile device for being used to, according to the second during cycle, acquire from cameraFirst frame is extracted in the corresponding video of environment, according to the similarity between adjacent first frame, movement is obtained from the first frameThe corresponding image of the external environment of equipment.
Optionally, the tone may include: dominant hue and/or auxiliary tone.
Optionally, the mobile device may include: mobile unit.
To sum up, the interface processor unit of the mobile device of the embodiment of the present application, the external environment of available mobile deviceCorresponding image determines in the interface of the mobile device at least partly Interface Element according to the corresponding image of the external environmentThe background image of element, the tone of the background image and the tone of the external environment corresponding image match, and will be describedBackground image is set as in the interface of the mobile device at least partly background of interface element；Due at least portion in mobile deviceThe tone of background image corresponding to the background at the interface of boundary surface element can match with the tone of external environment correspondence image,Therefore at least partly interface element can be adapted with external environment in the interface of the embodiment of the present application, in this way, it is possible to prevente effectively fromThe excessively bright interface for leading to mobile device of external environment is not seen and external environment secretly causes the interface of mobile device excessively to be pierced excessivelyThe situations such as eye, therefore can be improved the clarity and readability at the interface of mobile device, that is, the embodiment of the present application can be improvedCompatible degree between the interface and external environment of mobile device, and then the interface of intelligence beauty can be provided a user.
Also, in the equipment under mobile device is the driving scene such as mobile unit, the embodiment of the present application can also be avoidedThe unintelligible bring security risk in interface, improves the safety of driving, and then can promote the security reliability of mobile device.
Referring to Fig. 5, a kind of structural block diagram of the interface processor unit embodiment of mobile device of the application is shown, specificallyMay include following module:
Data obtaining module 501, the corresponding information of external environment for obtaining mobile device；
Background image determining module 502, for determining the mobile device according to the corresponding information of the external environmentInformation institute corresponding at least partly background image of interface element in interface, the tone of the background image and the external environmentThe tone of characterization matches；
Background image setup module 503, for setting the background image in the interface of the mobile device at leastThe background of part interface element.
Optionally, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic order outerThe corresponding characteristic information of portion's environment.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simplePlace illustrates referring to the part of embodiment of the method.
The embodiment of the present application also provides a kind of equipment, which may include: one or more processors；It deposits thereonThe one or more machine readable medias for containing instruction, when being executed by one or more of processors, so that the equipmentExecute method described in Fig. 1 to Fig. 3.In practical applications, which can be used as terminal device, can also be used as server,The example of terminal device may include: smart phone, tablet computer, E-book reader, (dynamic image expert compresses mark to MP3Quasi- audio level 3, Moving Picture Experts Group Audio Layer III) player, MP4 (dynamic imageExpert's compression standard audio level 4, Moving Picture Experts Group Audio Layer IV) it is player, above-kneeType portable computer, vehicle-mounted computer, set-top box, intelligent TV set, wearable device etc., the embodiment of the present application is for specificEquipment is without restriction.
The embodiment of the present application also provides a kind of non-volatile readable storage medium, be stored in the storage medium one orMultiple modules (programs) when the one or more module is used in mobile device, can make the mobile device executeThe instruction (instructions) of the included step of the interface processing method of mobile device in the embodiment of the present application.
Fig. 6 is the hardware structural diagram for the mobile device that one embodiment of the application provides.As shown in fig. 6, the movement is setStandby may include: input equipment 1100, processor 1101, output equipment 1102, memory 1103 and at least one communication bus1104.Communication bus 1104 is for realizing the communication connection between element.Memory 1103 may include high speed RAM memory,It may also further include non-volatile memories NVM, a for example, at least magnetic disk storage can store various journeys in memory 1103Sequence, for completing various processing functions and realizing the method and step of the present embodiment.
Optionally, above-mentioned processor 1101 can be for example central processing unit (Central Processing Unit, letterClaim CPU), application specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), can compileJourney logical device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic componentsIt realizes, which is coupled to above-mentioned input equipment 1100 and output equipment 1102 by wired or wireless connection.
Optionally, above-mentioned input equipment 1100 may include a variety of input equipments, such as may include user oriented useAt least one of family interface, device oriented equipment interface, the programmable interface of software, camera, sensor.Optionally, shouldDevice oriented equipment interface can be wireline interface for carrying out data transmission between equipment and equipment, can also be and is used forHardware insertion interface (such as USB interface, serial ports etc.) carried out data transmission between equipment and equipment；Optionally, should towards withThe user interface at family for example can be user oriented control button, voice-input device and use for receiving voice inputThe touch awareness apparatus (such as touch screen, Trackpad with touch sensing function etc.) of family reception user's touch input；It is optional, the programmable interface of above-mentioned software for example can be the entrance for editing or modifying program for user, such as the input of chipPin interface or input interface etc.；Optionally, above-mentioned transceiver can be rf chip, base with communication functionTape handling chip and dual-mode antenna etc..The audio input device such as microphone can receive voice data.Output equipment 1102 canTo include the output equipments such as display, sound equipment.
In the present embodiment, the processor of the mobile device includes for executing each module of data processing equipment in each equipmentFunction, concrete function and technical effect are referring to above-described embodiment, and details are not described herein again.
Fig. 7 is the hardware structural diagram for the mobile device that one embodiment of the application provides.Fig. 7 is to Fig. 6 in realityA specific embodiment during now.As shown in fig. 7, the mobile device of the present embodiment may include processor 1201 andMemory 1202.
Processor 1201 executes the computer program code that memory 1202 is stored, and realizes Fig. 1 in above-described embodiment, figure2 or mobile device shown in Fig. 3 interface processing method.
Memory 1202 is configured as storing various types of data to support the operation in mobile device.These dataExample includes the instruction of any application or method for operating on the mobile apparatus, such as message, picture, video etc..Memory 1202 may include random access memory (random access memory, abbreviation RAM), it is also possible to further include non-Volatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Optionally, processor 1201 is arranged in processing component 1200.The mobile device can also include: communication component1203, power supply module 1204, multimedia component 1205, audio component 1206, input/output interface 1207 and/or sensor groupPart 1208.Processing component 1200, communication component 1203, it is power supply module 1204, multimedia component 1205, audio component 1206, defeatedEnter/can be connected by bus between output interface 1207 and/or sensor module 1208.The group that mobile device is specifically includedPart etc. is set according to actual demand, and the embodiment of the present application is not construed as limiting this.
The integrated operation of the usually control mobile device of processing component 1200.Processing component 1200 may include one or moreProcessor 1201 executes instruction, to complete all or part of the steps of method shown in above-mentioned Fig. 1, Fig. 2 or Fig. 3.In addition, processingComponent 1200 may include one or more modules, convenient for the interaction between processing component 1200 and other assemblies.For example, processingComponent 1200 may include multi-media module, to facilitate the interaction between multimedia component 1205 and processing component 1200.
Power supply module 1204 provides electric power for the various assemblies of mobile device.Power supply module 1204 may include power managementSystem, one or more power supplys and other with for mobile device generate, manage, and distribute the associated component of electric power.
Multimedia component 1205 includes the display screen of one output interface of offer between mobile device and user.OneIn a little embodiments, display screen may include liquid crystal display (LCD) and touch panel (TP).If display screen includes touch surfacePlate, display screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touchingsSensor is touched to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or cunningThe boundary of movement, but also detect duration and pressure associated with the touch or slide operation.
Audio component 1206 is configured as output and/or input audio signal.For example, audio component 1206 includes a wheatGram wind (MIC), when mobile device is in operation mode, when such as speech recognition mode, microphone is configured as receiving external audioSignal.The received audio signal can be further stored in memory 1202 or send via communication component 1203.OneIn a little embodiments, audio component 1206 further includes a loudspeaker, is used for output audio signal.
Input/output interface 1207 provides interface between processing component 1200 and peripheral interface module, and above-mentioned periphery connectsMouth mold block can be click wheel, button etc..These buttons may include, but are not limited to: volume button, start button and locking press button.
Sensor module 1208 includes one or more sensors, and the state for providing various aspects for mobile device is commentedEstimate.For example, sensor module 1208 can detecte the state that opens/closes of mobile device, the relative positioning of component, Yong HuyuThe existence or non-existence of mobile device contact.Sensor module 1208 may include proximity sensor, be configured to do not havingDetected the presence of nearby objects when any physical contact, including detection user between mobile device at a distance from.In some implementationsIn example, which can also be including camera etc..
Communication component 1203 is configured to facilitate the communication of wired or wireless way between mobile device and other equipment.It movesDynamic equipment can access the wireless network based on communication standard, such as WiFi, 2G or 3G or their combination.In one embodimentIn, it may include SIM card slot in the mobile device, which step on mobile device for being inserted into SIM cardGPRS network is recorded, is communicated by internet with server foundation.
From the foregoing, it will be observed that communication component 1203, audio component 1206 involved in Fig. 7 embodiment and input/outputInterface 1207, sensor module 1208 can be used as the implementation of the input equipment in Fig. 6 embodiment.
The embodiment of the present application also provides a kind of operating systems for equipment, as shown in figure 8, this is used for the operation of equipmentSystem may include:
Image acquisition unit 801, the corresponding image of external environment for obtaining mobile device；
Background image determination unit 802, for determining the mobile device according to the corresponding image of the external environmentAt least partly background image of interface element in interface, the tone of the background image and the external environment corresponding imageTone is consistent；And
Background setting unit 803, for setting the background image in the interface of the mobile device at least partlyThe background of interface element.
Optionally, the background image determination unit 802 may include:
Tone obtains subelement, for obtaining the tone of the corresponding image of the external environment；And
Background image generates subelement, for generating in the interface of the mobile device at least partly according to the toneThe background image of interface element.
Optionally, the background image determination unit 802 may include:
Gaussian Blur handles subelement, for carrying out Gaussian Blur processing to the corresponding image of the external environment, withTo corresponding Gaussian Blur image, as at least partly background image of interface element in the interface of the mobile device.
Optionally, the interface of the mobile device can be card form interface, and the card form interface includes at least oneCard, then the background setting unit 803 may include:
Subelement is arranged in first background, for setting the background image to the back of card in the card form interfaceScape；And/or
Subelement is arranged in second background, for setting the background image to the wallpaper background at the card form interface.
Optionally, the interface of the mobile device includes multiple interfaces windows, different interfaces windows can correspond to it is identical orThe different background image of person.
Optionally, described image acquiring unit 801 may include:
First image obtains subelement, for according to the first during cycle, the external environment for obtaining camera acquisition to be correspondingImage, as the corresponding image of external environment；And/or
Second image obtains subelement, the corresponding video of external environment of the mobile device for obtaining camera acquisition,According to the similarity between two frame adjacent in the video, the corresponding figure of external environment of mobile device is obtained from the videoPicture；And/or
Third image obtains subelement, the outside for the mobile device for being used to, according to the second during cycle, acquire from cameraFirst frame is extracted in the corresponding video of environment, according to the similarity between adjacent first frame, movement is obtained from the first frameThe corresponding image of the external environment of equipment.
Optionally, the tone may include: dominant hue and/or auxiliary tone.
Optionally, the mobile device may include: mobile unit.
The embodiment of the present application also provides a kind of operating systems for equipment, as shown in figure 9, this is used for the operation of equipmentSystem may include:
Information acquisition unit 901, the corresponding information of external environment for obtaining mobile device；
Background image determination unit 902, for determining the mobile device according to the corresponding information of the external environmentInformation institute corresponding at least partly background image of interface element in interface, the tone of the background image and the external environmentThe tone of characterization matches；
Background image setting unit 903, for setting the background image in the interface of the mobile device at leastThe background of part interface element.
Optionally, the corresponding information of the external environment be may include: image, and/or be obtained based on phonetic order outerThe corresponding characteristic information of portion's environment.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are withThe difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiments of the present application may be provided as method, apparatus or calculatingMachine program product.Therefore, the embodiment of the present application can be used complete hardware embodiment, complete software embodiment or combine software andThe form of the embodiment of hardware aspect.Moreover, the embodiment of the present application can be used one or more wherein include computer canWith in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program codeThe form of the computer program product of implementation.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/outputInterface, network interface and memory.Memory may include the non-volatile memory in computer-readable medium, random access memoryThe forms such as device (RAM) and/or Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is to calculateThe example of machine readable medium.Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be withRealize that information is stored by any method or technique.Information can be computer readable instructions, data structure, the module of program orOther data.The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory(SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory(ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, CD-ROM are read-onlyMemory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage orOther magnetic storage devices or any other non-transmission medium can be used for storing the information that can be accessed with mobile device.According toHerein defines, and computer-readable medium does not include non-persistent computer readable media (transitory media), such asThe data-signal and carrier wave of modulation.
The embodiment of the present application is referring to the method, mobile device (system) and computer program according to the embodiment of the present applicationThe flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructionsIn each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide theseComputer program instructions are set to the processing movement of general purpose computer, special purpose computer, Embedded Processor or other programmable datasStandby processor is to generate a machine, so that being held by the processor that computer or other programmable datas handle mobile deviceCapable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagramThe device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable datas processing mobile deviceIn computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packetThe manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagramThe function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable datas processing mobile device, so thatSeries of operation steps are executed on computer or other programmable movement equipment to generate computer implemented processing, thusThe instruction executed on computer or other programmable movement equipment is provided for realizing in one or more flows of the flowchartAnd/or in one or more blocks of the block diagram specify function the step of.
Although preferred embodiments of the embodiments of the present application have been described, once a person skilled in the art knows basesThis creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted asIncluding preferred embodiment and all change and modification within the scope of the embodiments of the present application.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to byOne entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operationBetween there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaningCovering non-exclusive inclusion, so that process, method, article or mobile device including a series of elements are not only wrappedThose elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, articleOr the element that mobile device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limitedElement, it is not excluded that there is also other identical elements in process, method, article or the mobile device for including the element.
Above to a kind of interface processing method of mobile device provided herein, a kind of interface processing of mobile deviceDevice, a kind of equipment, a kind of machine readable media and a kind of operating system for equipment, are described in detail, hereinApplying specific case, the principle and implementation of this application are described, and the explanation of above example is only intended to helpUnderstand the present processes and its core concept；At the same time, for those skilled in the art, according to the thought of the application,There will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be construed as to thisThe limitation of application.