Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, completeDescribe, it is clear that described embodiment is a part of embodiment of the present invention rather than whole embodiments wholely.Based on thisEmbodiment in bright, the every other enforcement that those of ordinary skill in the art are obtained under not making creative work premiseExample, broadly falls into the scope of protection of the invention.
Should be appreciated that when using in this specification and in the appended claims, term " includes " and " comprising " instructionDescribed feature, entirety, step, operation, element and/or the existence of assembly, but it is not precluded from one or more further feature, wholeBody, step, operation, element, assembly and/or the existence of its set or interpolation.
It is also understood that the term used in this description of the invention is merely for the sake of the mesh describing specific embodimentAnd be not intended to limit the present invention.As used in description of the invention and appended claims, unless onHereafter clearly indicating other situation, otherwise " ", " " and " being somebody's turn to do " of singulative is intended to include plural form.
It will be further appreciated that, the term "and/or" used in description of the invention and appended claims isRefer to the one or more any combination being associated in the item listed and likely combine, and including that these combine.
As used in this specification and in the appended claims, term " if " can be according to context quiltBe construed to " when ... " or " once " or " in response to determining " or " in response to detecting ".Similarly, phrase " if it is determined that " or" if be detected that [described condition or event] " can be interpreted to mean according to context " once it is determined that " or " in response to reallyFixed " or " [described condition or event] once being detected " or " in response to [described condition or event] being detected ".
In implementing, the terminal described in the embodiment of the present invention includes but not limited to such as have touch sensitive surfaceMobile phone, laptop computer or the tablet PC of (such as, touch screen follower and/or touch pad) etc other justPortable device.It is to be further understood that in certain embodiments, described equipment not portable communication device, but have tactileTouch the desk computer of sensing surface (such as, touch screen follower and/or touch pad).
In discussion below, describe the terminal including follower and touch sensitive surface.It is, however, to be understood thatIt is that terminal can include such as physical keyboard, mouse and/or control other physical user-interface device one or more of bar.
Terminal supports various application programs, such as following in one or more: drawing application program, demonstration application journeySequence, word-processing application, website create application program, dish imprinting application program, spreadsheet applications, game applicationProgram, telephony application, videoconference application, email application, instant messaging applications, exerciseSupport the application of application program, photo management application program, digital camera application program, digital camera application program, web-browsingProgram, digital music player application and/or video frequency player application program.
The various application programs that can perform in terminal can use at least one of such as touch sensitive surface publicPhysical user-interface device.Among applications and/or can adjust in corresponding application programs and/or change and touch sensitive tableThe corresponding information of output in one or more functions in face and terminal.So, the public physical structure of terminal (such as, touchesSensing surface) the various application programs with the most directly perceived and transparent user interface can be supported.
See Fig. 1, be a kind of exemplary flow adjusting screen display direction control method of one embodiment of the invention offerFigure, as it can be seen, the method can comprise the following steps that
S101, the acoustical signal of detection screen periphery, determine the orientation of the sound source of the acoustical signal detected；
Concrete, available multiple voice collection device, such as mike, detect the acoustical signal of screen periphery, really in real timeDetermining the orientation of the sound source of acoustical signal, wherein the orientation of sound source is not limited to one.Wherein mike is preferably 2, is respectively provided withIn the different preset positions of terminal, such as top and the bottom of terminal.
S102, by each display subregion of this screen, the display direction of the display subregion nearest apart from this orientation, adjustWhole is the user corresponding towards this orientation.
By the viewing area of screen according to preset rule, it is divided into multiple display subregion.Calculate each display subregionAnd the distance between the orientation of each sound source determined, according to result of calculation, determines that the target needing to adjust display direction showsSubregion, then by the display direction of each target display subregion, is adjusted to the use corresponding towards the orientation nearest apart from selfFamily.
Wherein, the display direction of display subregion, i.e. show in subregion the picture of display top towards such as: vacationIf display subregion includes upper and lower, left and right four direction, this four direction corresponds respectively to the top of terminal, bottom, left sideAnd right side, when this picture is entered towards the mode of the top (that is, the top of terminal) of display subregion with the coboundary of pictureDuring row display, the display direction of display subregion is upper；When by this picture with the coboundary of picture towards under display subregionWhen the mode of side (that is, the bottom of terminal) shows, under the display direction of display subregion is；When by this picture with pictureCoboundary towards the mode of left direction (that is, the left side of terminal) of display subregion show time, the display of display subregionDirection is left, by that analogy.
In the embodiment of the present invention, by detecting the acoustical signal of screen periphery, determine the sound of the acoustical signal detectedThe orientation in source, the display direction of the display subregion that the orientation distance in this screen determined is nearest, it is adjusted to towards the partyThe user that position is corresponding, improves the motility that screen shows, can meet the screen display demand of multi-user's multiple watching-angle.
See Fig. 2, be a kind of signal stream adjusting screen display direction control method of another embodiment of the present invention offerCheng Tu, as in figure 2 it is shown, the method can comprise the following steps that
S201, the acoustical signal of detection screen periphery, determine the orientation of the sound source of the acoustical signal detected；
Available multiple voice collection device, such as mike, detect the acoustical signal of screen periphery in real time, determine that sound is believedNumber the orientation of sound source.In conjunction with Fig. 2 a, wherein determine that the principle in the orientation of the sound source of the acoustical signal detected is: same soundSource is after sounding, and the time that different mikes receives has some differences.Closer meeting first receives sound wave letterNumber, distant meeting is slow.By this time difference, direction and the position of sound source can be determined.
Specifically, utilize multiple mike to gather multiple acoustical signals of screen periphery respectively, and be output as time-domain signal；Each frame data of the time-domain signal of output are carried out Short Time Fourier Transform, obtains the space of corresponding each frame time-domain signalSpectrum；Estimated the sound source number of each frame time-domain signal by spatial spectrum, and by spatial spectrum is carried out spectrum peak search, estimate everyThe sound bearing of one frame time-domain signal；Sound source number and sound bearing to the multiframe time-domain signal estimated carry out statistical average,Result according to statistical average determines orientation and the quantity of sound source.
S202, the vocal print feature of acoustical signal is mated with preset vocal print feature；
Extract the vocal print feature in the acoustical signal detected, the vocal print feature of extraction is carried out with preset vocal print featureCoupling, to remove the interference sound signal in the acoustical signal detected, such as: the sound of animal, the background sound in surroundingHappy, and the sound of other non-user, thus the effectiveness that display subregion direction adjusts can be improved.
S203, according to matching result, by the orientation of vocal print feature and the preset unmatched acoustical signal of vocal print feature fromThe orientation of the institute's sound source determined is deleted；
If the vocal print feature of the acoustical signal detected is not mated with preset vocal print feature, then can determine that this acoustical signalThe non-user from this terminal, then delete the orientation of this acoustical signal from the orientation of the institute's sound source determined, and correspondingReduce the quantity of sound source.
S204, quantity according to sound source, be divided into multiple display subregions of correspondence by the viewing area of screen；
According to the quantity of the residue sound source determined, the whole viewing area of the screen of terminal is divided into the multiple of correspondenceDisplay subregion, will the viewing area of screen according to preset size or shape, be divided into multiple display subregion, with correspondenceDifferent sound sources, the display size of plurality of display subregion or shape can unanimously can also be different.
In other embodiments of the present invention, the preset operation that split screen operation is carried out also dependent on user triggers.Specifically,Can be that the preset gesture made according to user triggers split screen operation, it is also possible to trigger split screen by button set in advance and graspMake.After detecting that split screen operation is triggered, the screen of terminal is divided into the next corresponding display of several separate screens differentContent.Such as: according to the gesture of user, screen can be divided into several regions, each region shows a content respectively.
Further, when receiving the END instruction that user triggers, at the beginning of being reverted to by the display direction of each display subregionBeginning direction, i.e. the display direction before adjustment or acquiescence display direction.
S205, orientation according to each sound source, by the display direction of each display subregion, be adjusted to respectively towards apart from selfThe user that nearest orientation is corresponding.
Specifically, according to the orientation of the sound source of each acoustical signal determined, by the split screen in the orientation close to each sound sourceHold, be adjusted to the azimuth direction along sound source and show, i.e. with towards being located at the user in this orientation, then, at each display subregionThe preset that middle display is corresponding.Concrete, such as, as shown in Figure 2 b, the split screen interface closest to sound source 1 is in screenThe interface 1 of top, now, the display direction at interface 1 is just towards the direction of sound source 1.Interface closest to sound source 2 is in screenInterface 2 below Mu, now the direction at interface 2 is just towards what the direction of sound source 2 showed.
It is to be appreciated that the direction of display is preferably normal to or is parallel to the both direction at an edge of terminal.Such as: centered by mobile phone, the viewing area of screen is divided into several regions according to different directions, as shown in Figure 2 c, isIt is divided into 4 regions.If in when sound-source signal being detected in the region on right side, direction the most as shown in Figure 2 c showsImage, as closer in the region above sound source 1 off screen curtain, now, interface 1 above just shows according to the direction of sound source 1Show.
In other embodiments of the present invention, it is possible to determine each sound that vocal print feature and preset vocal print feature matchThe target display subregion that signal is corresponding, and by the display direction of each target display subregion, be adjusted to respectively towards the most rightThe user that the orientation of the acoustical signal answered is corresponding.
In the embodiment of the present invention, by detecting the acoustical signal of screen periphery, determine the sound of the acoustical signal detectedThe orientation in source, the display direction of the display subregion that the orientation distance in this screen determined is nearest, it is adjusted to towards the partyThe user that position is corresponding, improves the motility that screen shows, can meet the screen display demand of multi-user's multiple watching-angle.
See Fig. 3, be the schematic block diagram of a kind of terminal that one embodiment of the invention provides.As it is shown on figure 3, this terminal bagInclude: detector unit 301 and the first adjustment unit 302.
Wherein, detector unit 301, for detecting the acoustical signal of screen periphery, determine the sound of the acoustical signal detectedThe orientation in source.
First adjustment unit 302, for each of this screen is shown in subregion, the sub-district of the display nearest apart from this orientationThe display direction in territory, is adjusted to the user corresponding towards this orientation.
Concrete, detector unit 301 controls multiple voice collection device, such as mike, detects the sound of screen periphery in real timeTone signal, determines the orientation of the sound source of acoustical signal, and wherein the orientation of sound source is not limited to one.Wherein mike is preferably 2,It is respectively arranged at the different preset positions of terminal, such as top and the bottom of terminal.First adjustment unit 302 calculates in screen each aobviousShow the distance between subregion and the orientation of each sound source determined, according to result of calculation, determine and need to adjust display directionTarget display subregion, then by the display direction of each target display subregion, is adjusted to nearest towards being positioned at apart from selfThe user in orientation.
The terminal that the embodiment of the present invention provides, by detecting the acoustical signal of screen periphery, determines the sound letter detectedNumber the orientation of sound source, the display direction of the display subregion that the orientation distance in this screen determined is nearest, be adjusted to courtTo the user that this orientation is corresponding, improve the motility that screen shows, the screen display need of multi-user's multiple watching-angle can be metAsk.
See Fig. 4, be the schematic block diagram of a kind of terminal that another embodiment of the present invention provides.As shown in Figure 4, this terminal bagInclude: detector unit the 401, first adjustment unit 402, matching unit 403, delete unit the 404, second adjustment unit 405 and drawSubdivision 406.
Wherein, detector unit 401, for detecting the acoustical signal of screen periphery, determine the sound of the acoustical signal detectedThe orientation in source.
First adjustment unit 402, for each of this screen is shown in subregion, the sub-district of the display nearest apart from this orientationThe display direction in territory, is adjusted to the user corresponding towards this orientation.
Further, this detector unit 401 includes: collecting unit 4011 and processing unit 4012.
Collecting unit 4011 is for utilizing multiple mike to gather multiple acoustical signals of this screen periphery respectively and defeatedGo out for time-domain signal.
Processing unit 4012, for each frame data of the time-domain signal of output are carried out Short Time Fourier Transform, obtainsThe spatial spectrum of corresponding each this time-domain signal of frame, is estimated the sound source number of each this time-domain signal of frame, and leads to by this spatial spectrumCross and this spatial spectrum carried out spectrum peak search, estimate the sound bearing of each this time-domain signal of frame, to the multiframe estimated this timeThe sound source number of territory signal and sound bearing carry out statistical average, determine orientation and the quantity of sound source according to the result of statistical average.
Matching unit 403, for mating the vocal print feature of this acoustical signal with preset vocal print feature.
Delete unit 404, for according to matching result, vocal print feature being believed with the preset unmatched sound of vocal print featureNumber orientation delete from the orientation of the institute's sound source determined.
Second adjustment unit 405, for determining each acoustical signal pair that vocal print feature and preset vocal print feature matchThe target display subregion answered, and the display direction of each target display subregion is adjusted to towards each self-corresponding acoustical signalUser corresponding to orientation.
Division unit 406, for the quantity according to this sound source, the viewing area of this screen is divided into the multiple of correspondence shouldDisplay subregion；
First adjustment unit 402, specifically for the orientation according to respectively this sound source, by the display side of respectively this display subregionTo, it is adjusted to the user corresponding towards the orientation nearest apart from self respectively.
Concrete, first collecting unit 4011 utilizes multiple mike to gather multiple sound letter of this screen periphery respectivelyNumber, and it is output as time-domain signal；Then each frame data of time-domain signal of output are carried out in short-term in Fu by processing unit 4012Leaf transformation, obtains the spatial spectrum of corresponding each this time-domain signal of frame, estimates each this time-domain signal of frame by this spatial spectrumSound source number, and by this spatial spectrum is carried out spectrum peak search, estimate the sound bearing of each this time-domain signal of frame, to estimatingThe sound source number of this time-domain signal of multiframe and sound bearing carry out statistical average, determine the side of sound source according to the result of statistical averagePosition and quantity；Then, the vocal print feature of this acoustical signal is mated by matching unit 403 with preset vocal print feature；Then,Deletion unit 404 is according to matching result, by the orientation of vocal print feature and the preset unmatched acoustical signal of vocal print feature from reallyThe orientation of the institute's sound source made is deleted；Afterwards, the second adjustment unit 405 determines vocal print feature and preset vocal print feature phaseCoupling each acoustical signal corresponding target display subregion, and by each target display subregion display direction be adjusted to towardsThe user that the orientation of each self-corresponding acoustical signal is corresponding.
In other embodiments of the invention, at deletion unit 404 according to matching result, by vocal print feature and preset vocal printAfter the orientation of the unmatched acoustical signal of feature is deleted from the orientation of the institute's sound source determined, division unit 406 basisThe quantity of residue sound source, is divided into these display subregions multiple of correspondence by this screen；Then, the first adjustment unit 402 basisEach orientation remaining sound source, by the display direction of respectively this display subregion, is adjusted to nearest towards being positioned at apart from self respectivelyThe user in orientation.
Further, the first adjustment unit 402 or the second adjustment unit 405, also refer to when the end receiving user's triggeringOrder, reverts to inceptive direction by the display direction of each display subregion, i.e. the display direction before adjustment or acquiescence display direction.
Further, the first adjustment unit 402 or the second adjustment unit 405, it is additionally operable to the preset hands made according to userGesture triggers split screen operation, it is also possible to triggers split screen by button set in advance and operates.After detecting that split screen operation is triggered,The screen of terminal is divided into several separate screens and carrys out the content that corresponding display is different.Such as: can according to the gesture of user,Screen is divided into several regions, and each region shows a content respectively.
The terminal that the embodiment of the present invention provides, by detecting the acoustical signal of screen periphery, determines the sound letter detectedNumber the orientation of sound source, the display direction of the display subregion that the orientation distance in this screen determined is nearest, be adjusted to courtTo the user that this orientation is corresponding, improve the motility that screen shows, the screen display need of multi-user's multiple watching-angle can be metAsk.
See Fig. 5, be a kind of terminal schematic block diagram of further embodiment of this invention offer.In the present embodiment as depictedTerminal may include that one or more processor 801, one or more input equipments 802, one or more outut devices803 and memorizer 804.Above-mentioned processor 801, input equipment 802, outut device 803 and memorizer 804 are connected by bus.Memorizer 802 is used for storing instruction, and processor 801 is for performing the instruction of memorizer 802 storage.Wherein, processor 801 is usedIn: the acoustical signal of detection screen periphery, determine the orientation of the sound source of the acoustical signal detected；By each display of described screenIn subregion, the display direction of the display subregion nearest apart from described orientation, it is adjusted to the user corresponding towards described orientation.
Further, processor 801 is additionally operable to the multiple sound utilizing multiple mike to gather described screen periphery respectivelySignal, and it is output as time-domain signal；Each frame data of the time-domain signal of output are carried out Short Time Fourier Transform, obtains correspondenceThe spatial spectrum of time-domain signal described in each frame, estimates the sound source number of time-domain signal described in each frame by described spatial spectrum, andBy described spatial spectrum is carried out spectrum peak search, estimate the sound bearing of time-domain signal described in each frame, many to estimatingThe sound source number of time-domain signal described in frame and sound bearing carry out statistical average, determine the orientation of sound source according to the result of statistical averageAnd quantity.
Further, processor 801 is additionally operable to carry out the vocal print feature of described acoustical signal with preset vocal print featureCoupling；According to matching result, by the orientation of vocal print feature and the preset unmatched acoustical signal of vocal print feature from determiningThe orientation of institute's sound source is deleted.
Further, processor 801 is additionally operable to determine each sound letter that vocal print feature and preset vocal print feature matchNumber corresponding target display subregion, and by the display direction of each target display subregion, be adjusted to respectively towards the most correspondingUser corresponding to the orientation of acoustical signal.
Further, processor 801 is additionally operable to the quantity according to described sound source, is divided into the viewing area of described screenCorresponding multiple described display subregion；According to the orientation of each described sound source, by the display direction of each described display subregion, pointIt is not adjusted to the user corresponding towards the orientation nearest apart from self.
Should be appreciated that in embodiments of the present invention, alleged processor 801 can be CPU (CentralProcessing Unit, CPU), this processor can also is that other general processors, digital signal processor (DigitalSignal Processor, DSP), special IC (Application Specific Integrated Circuit,ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other FPGAsDevice, discrete gate or transistor logic, discrete hardware components etc..General processor can be microprocessor or this atReason device can also be the processor etc. of any routine.
Input equipment 802 can include that Trackpad, fingerprint adopt sensor (for gathering the finger print information of user and fingerprintDirectional information), mike etc., outut device 803 can include follower (LCD etc.), speaker etc..
This memorizer 804 can include read only memory and random access memory, and to processor 801 provide instruction andData.A part for memorizer 804 can also include nonvolatile RAM.Such as, memorizer 804 can also be depositedThe information of storage device type.
In implementing, processor 801, input equipment 802 described in the embodiment of the present invention, outut device 803 canThe first embodiment of the adjustment screen display direction control method that the execution embodiment of the present invention provides and the second embodiment are retouchedThe implementation stated, it is possible to the implementation of execution terminal described by the embodiment of the present invention, does not repeats them here.
Those of ordinary skill in the art are it is to be appreciated that combine the list of each example that the embodiments described herein describesUnit and algorithm steps, it is possible to electronic hardware, computer software or the two be implemented in combination in, in order to clearly demonstrate hardwareWith the interchangeability of software, the most generally describe composition and the step of each example according to function.ThisA little functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.SpeciallyIndustry technical staff can use different methods to realize described function to each specifically should being used for, but this realization is notIt is considered as beyond the scope of this invention.
Those skilled in the art is it can be understood that arrive, for convenience of description and succinctly, and the end of foregoing descriptionEnd and the specific works process of unit, be referred to the corresponding process in preceding method embodiment, do not repeat them here.
In several embodiments provided herein, it should be understood that disclosed terminal and method, can be passed through itIts mode realizes.Such as, device embodiment described above is only schematically, such as, and the division of described unit, onlyBeing only a kind of logic function to divide, actual can have other dividing mode, the most multiple unit or assembly to tie when realizingClose or be desirably integrated into another system, or some features can be ignored, or not performing.It addition, the phase that institute exports or discussesCoupling between Hu or direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, device or unit or communicationConnect, it is also possible to be electric, machinery or other form connect.
The described unit illustrated as separating component can be or may not be physically separate, defeated as unitThe parts gone out can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multipleOn NE.Some or all of unit therein can be selected according to the actual needs to realize embodiment of the present invention schemePurpose.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible toIt is that unit is individually physically present, it is also possible to be that two or more unit are integrated in a unit.Above-mentioned integratedUnit both can realize to use the form of hardware, it would however also be possible to employ the form of SFU software functional unit realizes.
If described integrated unit realizes and as independent production marketing or use using the form of SFU software functional unitTime, can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantiallyThe part in other words prior art contributed, or this technical scheme completely or partially can be with the form of software productEmbodying, this computer software product is stored in a storage medium, including some instructions with so that a computerEquipment (can be personal computer, server, or the network equipment etc.) performs the complete of method described in each embodiment of the present inventionPortion or part steps.And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journeyThe medium of sequence code.
Step in embodiment of the present invention method can carry out order according to actual needs and adjust, merges and delete.
Unit in embodiment of the present invention terminal can merge according to actual needs, divides and delete.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and anyThose familiar with the art, in the technical scope that the invention discloses, can readily occur in the amendment of various equivalence or replaceChanging, these amendments or replacement all should be contained within protection scope of the present invention.Therefore, protection scope of the present invention should be with rightThe protection domain required is as the criterion.