Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
In subsequent description, it is only using the suffix for indicating such as " module ", " component " or " unit " of elementBe conducive to explanation of the invention, itself there is no a specific meaning.Therefore, " module ", " component " or " unit " can mixGround uses.
Terminal can be implemented in a variety of manners.For example, terminal described in the present invention may include such as mobile phone, plateComputer, laptop, palm PC, personal digital assistant (Personal Digital Assistant, PDA), portableMedia player (Portable MediaPlayer, PMP), navigation device, wearable device, mobile terminal, pedometer etc. moveThe fixed terminals such as dynamic terminal, and number TV, desktop computer.
It will be illustrated by taking mobile terminal as an example in subsequent descriptions, it will be appreciated by those skilled in the art that in addition to specialExcept element for moving purpose, the construction of embodiment according to the present invention can also apply to the terminal of fixed type.
Referring to Fig. 1, a kind of hardware structural diagram of its mobile terminal of each embodiment to realize the present invention, the shiftingDynamic terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit103, A/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit108, the components such as memory 109, processor 110 and power supply 111, the number of the processor 110 are at least one.AbilityField technique personnel are appreciated that mobile terminal structure shown in Fig. 1 does not constitute the restriction to mobile terminal, and mobile terminal canTo include perhaps combining certain components or different component layouts than illustrating more or fewer components.
It is specifically introduced below with reference to all parts of the Fig. 1 to mobile terminal:
Radio frequency unit 101 can be used for receiving and sending messages or communication process in, signal sends and receivees, specifically, by base stationDownlink information receive after, to processor 110 handle；In addition, the data of uplink are sent to base station.In general, radio frequency unit 101Including but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, penetratingFrequency unit 101 can also be communicated with network and other equipment by wireless communication.Any communication can be used in above-mentioned wireless communicationStandard or agreement, including but not limited to GSM (Global System of Mobile communication, global system for mobile telecommunicationsSystem), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (CodeDivision Multiple Access 2000, CDMA 2000), WCDMA (Wideband Code DivisionMultiple Access, wideband code division multiple access), TD-SCDMA (Time Division-Synchronous CodeDivision Multiple Access, TD SDMA), FDD-LTE (Frequency DivisionDuplexing-Long Term Evolution, frequency division duplex long term evolution) and TDD-LTE (Time DivisionDuplexing-Long Term Evolution, time division duplex long term evolution) etc..
WiFi belongs to short range wireless transmission technology, and mobile terminal can help user to receive and dispatch electricity by WiFi module 102Sub- mail, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 1 showsGo out WiFi module 102, but it is understood that, and it is not belonging to must be configured into for mobile terminal, it completely can be according to needIt to omit within the scope of not changing the essence of the invention.
Audio output unit 103 can be in call signal reception pattern, call mode, record mould in mobile terminal 100When under the isotypes such as formula, speech recognition mode, broadcast reception mode, by radio frequency unit 101 or WiFi module 102 it is received orThe audio data stored in memory 109 is converted into audio signal and exports to be sound.Moreover, audio output unit 103Audio output relevant to the specific function that mobile terminal 100 executes can also be provided (for example, call signal receives sound, disappearsBreath receives sound etc.).Audio output unit 103 may include loudspeaker, buzzer etc..
A/V input unit 104 is for receiving audio or video signal.A/V input unit 104 may include graphics processor(Graphics Processing Unit, GPU) 1041 and microphone 1042, graphics processor 1041 is in video acquisition modeOr the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries outReason.Treated, and picture frame may be displayed on display unit 106.Through graphics processor 1041, treated that picture frame can be depositedStorage is sent in memory 109 (or other storage mediums) or via radio frequency unit 101 or WiFi module 102.MikeWind 1042 can connect in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone 1042Quiet down sound (audio data), and can be audio data by such acoustic processing.Audio that treated (voice) data canTo be converted to the format output that can be sent to mobile communication base station via radio frequency unit 101 in the case where telephone calling model.Microphone 1042 can be implemented various types of noises elimination (or inhibition) algorithms and send and receive sound to eliminate (or inhibition)The noise generated during frequency signal or interference.
Mobile terminal 100 further includes at least one sensor 105, such as optical sensor, motion sensor and other biographiesSensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environmentThe light and shade of light adjusts the brightness of display panel 1061, and proximity sensor can close when mobile terminal 100 is moved in one's earDisplay panel 1061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generalFor three axis) size of acceleration, it can detect that size and the direction of gravity when static, can be used to identify the application of mobile phone posture(such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.；The fingerprint sensor that can also configure as mobile phone, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer,The other sensors such as hygrometer, thermometer, infrared sensor, details are not described herein.
Display unit 106 is for showing information input by user or being supplied to the information of user.Display unit 106 can wrapDisplay panel 1061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be usedForms such as (Organic Light-Emitting Diode, OLED) configure display panel 1061.Display unit 106 can wrapInclude the first screen area and the second screen area.
User input unit 107 can be used for receiving the number or character information of input, and generate the use with mobile terminalFamily setting and the related key signals input of function control.Specifically, user input unit 107 may include touch panel 1071 withAnd other input equipments 1072.Touch panel 1071, also referred to as touch screen collect the touch operation of user on it or nearby(for example user uses any suitable objects or attachment such as finger, stylus on touch panel 1071 or in touch panel 1071Neighbouring operation), and corresponding attachment device is driven according to preset formula.Touch panel 1071 may include touch detectionTwo parts of device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation bandThe signal come, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and by itIt is converted into contact coordinate, then gives processor 110, and order that processor 110 is sent can be received and executed.In addition, canTo realize touch panel 1071 using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touch panel1071, user input unit 107 can also include other input equipments 1072.Specifically, other input equipments 1072 can wrapIt includes but is not limited in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc.It is one or more, specifically herein without limitation.
Further, touch panel 1071 can cover display panel 1061, when touch panel 1071 detect on it orAfter neighbouring touch operation, processor 110 is sent to determine the type of touch event, is followed by subsequent processing device 110 according to touch thingThe type of part provides corresponding visual output on display panel 1061.Although in Fig. 1, touch panel 1071 and display panel1061 be the function that outputs and inputs of realizing mobile terminal as two independent components, but in certain embodiments, it canThe function that outputs and inputs of mobile terminal is realized so that touch panel 1071 and display panel 1061 is integrated, is not done herein specificallyIt limits.
Interface unit 108 be used as at least one external device (ED) connect with mobile terminal 100 can by interface.For example,External device (ED) may include wired or wireless headphone port, external power supply (or battery charger) port, wired or nothingLine data port, memory card port, the port for connecting the device with identification module, audio input/output (I/O) endMouth, video i/o port, ear port etc..Interface unit 108 can be used for receiving the input from external device (ED) (for example, numberIt is believed that breath, electric power etc.) and by least one element that the input received is transferred in mobile terminal 100 or can useIn transmitting data between mobile terminal 100 and external device (ED).
Memory 109 can be used for storing software program and various data.Memory 109 can mainly include storing program areaThe storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one functionSound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such asAudio data, phone directory etc.) etc..In addition, memory 109 may include high-speed random access memory, it can also include non-easyThe property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 110 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connectionA part by running or execute the software program and/or module that are stored in memory 109, and calls and is stored in storageData in device 109 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.PlaceManaging device 110 may include at least one processing unit；Preferably, processor 110 can integrate application processor and modulation /demodulation processingDevice, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is mainly locatedReason wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 110.
Mobile terminal 100 can also include the power supply 111 (such as battery) powered to all parts, it is preferred that power supply 111Can be logically contiguous by power-supply management system and processor 110, to realize management charging by power-supply management system, putThe functions such as electricity and power managed.
Although Fig. 1 is not shown, mobile terminal 100 can also be including bluetooth module etc., and details are not described herein.
Embodiment to facilitate the understanding of the present invention, the communications network system that mobile terminal of the invention is based below intoRow description.
Referring to Fig. 2, Fig. 2 is a kind of communications network system architecture diagram provided in an embodiment of the present invention, the communication network systemSystem is the LTE system of universal mobile communications technology, which includes UE (User Equipment, the use of successively communication connectionFamily equipment) (the land Evolved UMTS Terrestrial Radio Access Network, evolved UMTS 201, E-UTRANGround wireless access network) 202, EPC (Evolved Packet Core, evolved packet-based core networks) 203 and operator IP operation204。
Specifically, UE201 can be above-mentioned mobile terminal 100, and details are not described herein again.
E-UTRAN202 includes eNodeB2021 and other eNodeB2022 etc..Wherein, eNodeB2021 can be by returningJourney (backhaul) (such as X2 interface) is connect with other eNodeB2022, and eNodeB2021 is connected to EPC203,ENodeB2021 can provide the access of UE201 to EPC203.
EPC203 may include MME (Mobility Management Entity, mobility management entity) 2031, HSS(Home Subscriber Server, home subscriber server) 2032, other MME2033, SGW (Serving Gate Way,Gateway) 2034, PGW (PDN Gate Way, grouped data network gateway) 2035 and PCRF (Policy andCharging Rules Function, policy and rate functional entity) 2036 etc..Wherein, MME2031 be processing UE201 andThe control node of signaling, provides carrying and connection management between EPC203.HSS2032 is all to manage for providing some registersSuch as the function of home location register (not shown) etc, and preserves some related service features, data rates etc. and useThe dedicated information in family.All customer data can be sent by SGW2034, and PGW2035 can provide the IP of UE 201Address distribution and other functions, PCRF2036 are strategy and the charging control strategic decision-making of business data flow and IP bearing resourcePoint, it selects and provides available strategy and charging control decision with charge execution function unit (not shown) for strategy.
IP operation 204 may include internet, Intranet, IMS (IP Multimedia Subsystem, IP multimediaSystem) or other IP operations etc..
Although above-mentioned be described by taking LTE system as an example, those skilled in the art should know the present invention is not onlySuitable for LTE system, be readily applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA withAnd the following new network system etc., herein without limitation.
Based on above-mentioned 100 hardware configuration of mobile terminal and communications network system, each embodiment of the method for the present invention is proposed.
It is a kind of step flow chart of interactive image pickup method provided in an embodiment of the present invention refering to Fig. 3, Fig. 3, such as Fig. 3 instituteShow, which comprises
Step S301: in the moment that the shutter of the mobile terminal is pressed, shooting the 0th frame image according to set strategy,And using the 0th frame image as reference frame, the preview interface for being uploaded to the mobile terminal is shown.
In the present embodiment, the preview frame that reference frame presses shutter moment with user in order to prevent has differences, and causes mostThe image synthesized eventually differs greatly with preview, the moment that can be pressed in the shutter of the mobile terminal, according to set strategyShoot the 0th frame image, wherein the set strategy includes the preset time for exposure and preset preference strategy, described pre-If preference strategy include but are not limited to select clarity to be greater than a frame of given threshold as the 0th frame image.
In the present embodiment, the method for obtaining the 0th frame image can be the preset shooting for first obtaining the mobile terminalParameter；Then a frame image is shot, and calculates the clarity of the frame image.Wherein, sharpness computation formula is as follows:
D (f)=∑y∑x|f(x+2,y)-f(x,y)|2
Wherein, f (x, y) indicates that the gray value of image f corresponding pixel points (x, y), D (f) are image definition calculated result.
Then, judge whether the clarity D (f) of described image f is greater than given threshold；If the determination result is YES, then by instituteImage f is stated to export as the 0th frame image；If judging result be it is no, shot again, until the clarity of described image fGreater than the given threshold, exported described image f as the 0th frame image.
In the present embodiment, using the 0th frame image as reference frame, it is denoted as Re f0, and it is uploaded to the pre- of the mobile terminalLooking at interface is shown.In this way, reference frame and the preview frame difference that user presses shutter moment are small, the image finally synthesized and pre-Frame difference of looking at is little.
Step S302: the reference frame image parameter and total shooting number N are obtained, and is joined according to the reference frame imageNumber obtains the i-th frame acquisition parameters, wherein the value of i and N is all the integer more than or equal to 1；
In the present embodiment, the value for obtaining total shooting number N, the N is preset value, and size is constant.It needs to illustrateIt is that total shooting number N is exactly preset value at the beginning, is not reduced because of the acquisition of the 0th frame image, when described the0 frame image as reference frame, be uploaded to the mobile terminal preview interface shown after, shooting frame number i is just started counting.Wherein, the value of the i is incremental with number is shot, and the value of i and N are all the integer more than or equal to 1.For example, exportingReference frame, in the case where knowing that total shooting number N is 2, then also needing to shoot the 1st frame image, the 2nd frame image, i.e. i's is takenIt is worth related to N.The value of specific N can be in practice by user preset, and specific value is herein with no restrictions.
In the present embodiment, after obtaining the reference frame image parameter, according to the reference frame image parameter, the is obtainedI frame acquisition parameters.It will be appreciated by persons skilled in the art that image parameter includes but is not limited to shutter speed, aperture, focal lengthAnd the time for exposure, when shooting the photomontage of multiformat film, the generally parameters such as setting shutter speed, aperture and focal length are identical, noTime for exposure at same frame needs to confirm.
In the present embodiment, the time for exposure for obtaining i-th frame may comprise steps of: calculate the reference frameBrightness variance stdrefAnd mean value meanref；
Judge the brightness variance std of the reference framerefWhether the given threshold is greater than；
If the brightness variance std of the reference framerefLess than the given threshold, then the i-th exposed frame time with it is describedThe time for exposure of 0th frame is identical, i.e. ISOi=ISO0；Wherein, ISOiIndicate the i-th exposed frame time parameter, ISO0Indicate the 0th frame(i.e. reference frame) exposure time parameter；
If the brightness variance std of the reference framerefGreater than the given threshold, then the i-th exposed frame time is describedThe ratio of the luminance mean value of given threshold and the reference frame, i.e. ISOi=α/meanref, the α expression given threshold.
Wherein, the brightness variance std of reference framerefWith luminance mean value meanrefCalculation formula is general knowledge known in this field,This is repeated no more.
Step S303: according to the i-th frame acquisition parameters, the i-th frame image is shot.
In the present embodiment, it in the case where value the i-th frame acquisition parameters for obtaining N, is shot according to i-th frameParameter shoots the i-th frame image.
Step S304: the i-th frame image and the (i-1)-th frame image sequence before the i-th frame image are merged into knotFruit image carries out image co-registration after carrying out image registration, obtains the fusion results image of the i-th frame image sequence, and the fusion is tiedThe preview interface that fruit image is uploaded to the mobile terminal is shown, until the value of presently described i is greater than the value of the N.
Step S305: the final fusion results image is saved and feeds back to user.
In the present embodiment, since the value of N is there are many mode, can be divided to the value of N is greater than 1 and 1 two kinds of feelings such as the value of NCondition.
In a case of n=1, then it only needs to shoot the 1st frame image Reg1, i=1, by the 1st frame image Reg1With the 0th frame figureAs Ref0Image co-registration is carried out after carrying out image registration, obtains the fusion results image R of the 1st frame image sequencemerge；Melt describedClose result images RmergeIt saves as the final fusion results image and is uploaded to the preview interface progress of the mobile terminal moreNew display, feeds back to user.
It will be appreciated by persons skilled in the art that image registration and image co-registration are two crucial skills of image mosaicArt.Image registration is the basis of image co-registration, and operand when image registration is usually all bigger, therefore image is spelledThe development of connection technology is essentially all to be determined by the update of image registration techniques.The method for registering images of early stage is mainly benefitWith the matched method of point, with speed for such method compared with slow, precision is relatively low, and at the beginning of usually requiring that artificial selectionThe match point of beginning, this method are not appropriate for the fusion of the image of big data quantity.The method of image mosaic is different there are many kindMethod and step has different, but process generally is all identical.Generally, the step of image mosaic is mainly wrappedInclude following five step:
The pretreatment of image: image includes the basic operation of Digital Image Processing and for establishing image with processing workThe operation such as certain transformation is carried out with template and to image.As we usually denoise image, at edge extracting, histogramThe operations such as reason, Fourier transformation, wavelet transformation carry out the pretreatment work of image.
The registration of image: we choose certain image matching method, select in image to be spliced characteristic point eitherTemplate in image, we are with corresponding position in splicing reference picture later, so that it is determined that the transformation between two images is closedSystem.
Establish the transformation model of image: according to the corresponding pass between the template in characteristic point and image with stitching imageSystem, we find out the parameter value in corresponding mathematical model, and then we establish the mathematical transformation model of two images.
Uniform coordinate transformation: there are our mathematical models for having built up of previous step, the coordinate system appropriate to two imagesIt is converted, the coordinate system in two images is crossed and reaches unified.
Fusion reconstruct: the part of image to be spliced to overlap is merged, the splicing of image is carried out, is splicedThe panoramic picture of smooth and seamless afterwards.
In the present embodiment, it when the value of N is greater than 1, under constantly the i-th frame image conditions of shooting, needs to sentenceWhether the value of presently described i of breaking is greater than the value of the N.If the value of presently described i is less than the value of the N, illustrate image alsoCompletion is not shot, needs constantly to repeat step S304, it is merged knot with image sequence before by one frame image of every shootingFruit is merged, and every fusion is primary, and fusion results are just reached preview interface, until the value of presently described i is greater than the N'sValue.
In the case where N > 1, first judge whether the value of presently described i is greater than the value of the N；
If the value of the presently described i be less than the N value, due to i value when can with shooting number be incremented by, instituteFirst to obtain the value of presently described i.
If i=1, by the 1st frame image Reg1With the 0th frame image Ref0Image co-registration is carried out after carrying out image registration, obtains theThe fusion results image R of 1 frame image sequencemerge；By the fusion results image RmergeIt is uploaded to the preview of the mobile terminalInterface is updated display.
If i > 1, by the i-th frame image RegiKnot is merged with the (i-1)-th frame image sequence before the i-th frame imageFruit image RmergeImage co-registration is carried out after carrying out image registration, obtains the fusion results image R of the i-th frame image sequencemerge；It willThe fusion results image RmergeThe preview interface for being uploaded to the mobile terminal is updated display.
Wherein, RmergeValue in dynamic change, every progress image co-registration is primary, RmergeValue just update oneSecondary, i.e. one frame image of every shooting merges it with the fusion results of image sequence before, and every fusion is primary, just will fusionAs a result preview interface is reached, until the value of presently described i is greater than the value of the N.
In the present embodiment, when judgement show whether the value of presently described i is greater than the value of the N, then show that image is clappedIt takes the photograph frame number to be fully completed, terminates melting to the i-th frame image and the (i-1)-th frame image sequence before the i-th frame imageClose result images carry out image registration after carry out image co-registration, using the fusion results image of (i-1)-th frame image sequence asThe final fusion results image；The final fusion results image is saved and feeds back to user.
For example, N=3, then:
When shooting the 1st frame image, the value of i is also not more than N, by the 1st frame image Reg1With the 0th frame image Ref0It carries outImage co-registration is carried out after image registration, obtains the fusion results image R of the 1st frame image sequencemerge 1；By the fusion results figureAs Rmerge 1The preview interface for being uploaded to the mobile terminal is updated display.
Continue to shoot the 2nd frame image, when shooting the 2nd frame image, the value of i is also no more than N, by the 2nd frame figureAs Re g2With the fusion results image R of the 1st frame image sequence before the 2nd frame imagemerge 1It is laggard to carry out image registrationRow image co-registration obtains the fusion results image R of the 2nd frame image sequencemerge 2；By the fusion results image Rmerge 2It uploadsPreview interface to the mobile terminal is updated display.
Continue to shoot the 3rd frame image, when shooting the 3rd frame image, the value of i is also no more than N, by the 3rd frame figureAs Re g3With the fusion results image R of the 2nd frame image sequence before the 3rd frame imagemerge 2It is laggard to carry out image registrationRow image co-registration obtains the fusion results image R of the 3rd frame image sequencemerge 3；By the fusion results image Rmerge 3It uploadsPreview interface to the mobile terminal is updated display.
Continue to shoot the 4th frame image, when shooting the 4th frame image, the value of i is greater than N, shows image taking frame numberIt has been be fully completed that, terminated to the 4th frame image Re g4Knot is merged with the 3rd frame image sequence before the 4th frame imageFruit image carries out image co-registration after carrying out image registration, by the fusion results image R of (i-1)-th frame image sequencemerge 3MakeFor the final fusion results image Rmerge；The final fusion results image is saved and feeds back to user.
Interactive image pickup method proposed by the invention is pressed by the moment being pressed in the shutter of the mobile terminalAccording to the 0th frame image of set strategy shooting, and using the 0th frame image as reference frame, it is uploaded to the preview of the mobile terminalInterface is shown；Obtain the reference frame image parameter and total shooting number N, and according to the reference frame image parameter,Obtain the i-th frame acquisition parameters；According to the i-th frame acquisition parameters, the i-th frame image is shot；By the i-th frame image and described i-thThe fusion results image of the (i-1)-th frame image sequence before frame image carries out image co-registration after carrying out image registration, obtains the i-th frameThe fusion results image of image sequence shows the preview interface that the fusion results image is uploaded to the mobile terminalShow, until the value of presently described i is greater than the value of the N；The final fusion results image is saved and feeds back to user.ThisSample, mobile terminal is by using the 0th frame as reference frame, reducing the difference between final image and user's preview, shooting and merging simultaneouslyRow carries out, and shortens whole shooting time；Result picture in synthesis process is reached into preview interface, i.e., at the browsable image of userThe change procedure that picture quality grows from weak to strong in reason provides interactive shooting experience, and the user experience is improved.
The step of refering to Fig. 4, Fig. 4 being a kind of 0 frame of acquisition of interactive image pickup method provided in an embodiment of the present invention streamCheng Tu, as shown in Figure 4, which comprises
Step S401: the preset acquisition parameters of the mobile terminal are obtained.
Step S402: one frame image of shooting.
Step S403: the clarity of the frame image is calculated.
Step S404: judge whether the clarity of the described image is greater than given threshold.
If the determination result is YES, then S405 is entered step；If judging result is no, return step step S402.
Step S405: it is exported described image as the 0th frame image.
In the present embodiment, sharpness computation formula is as follows:
D (f)=∑y∑x|f(x+2,y)-f(x,y)|2
Wherein, f (x, y) indicates that the gray value of image f corresponding pixel points (x, y), D (f) are image definition calculated result.
In the present embodiment, using the 0th frame image as reference frame, it is denoted as Re f0, and it is uploaded to the pre- of the mobile terminalLooking at interface is shown.
The method that interactive image pickup method proposed by the invention obtains the 0th frame, passes through the shutter in the mobile terminalThe moment being pressed shoots the 0th frame image according to set strategy, and using the 0th frame image as reference frame, is uploaded to describedThe preview interface of mobile terminal is shown.In this way, reference frame and the preview frame difference that user presses shutter moment are small, it is final to closeAt image and preview frame difference it is little.
It is the structure chart of mobile terminal provided in an embodiment of the present invention referring to Fig. 5, Fig. 5, as shown in figure 5, mobile terminal 500It include: that the first shooting module 501, acquisition module 502, the second shooting module 503, the first image co-registration module 504 and image are anti-Module 505 is presented, the first shooting module 501 and acquisition module 502 connect, module 502 and the connection of the second shooting module 503 are obtained,Second shooting module 503 and the connection of the first image co-registration module 504, the first image co-registration module 504 and image feedback module 505Connection, in which:
First shooting module 501, the moment for being pressed in the shutter of the mobile terminal shoot according to set strategy0th frame image, and using the 0th frame image as reference frame, the preview interface for being uploaded to the mobile terminal is shown；
Module 502 is obtained, for obtaining the reference frame image parameter and total shooting number N, and according to the referenceFrame image parameter obtains the i-th frame acquisition parameters, wherein the value of i and N is all the integer more than or equal to 1；
Second shooting module 503, for shooting the i-th frame image according to the i-th frame acquisition parameters；
First image co-registration module 504, for by the (i-1)-th frame figure before the i-th frame image and the i-th frame imageImage co-registration is carried out after carrying out image registration as the fusion results image of sequence, obtains the fusion results figure of the i-th frame image sequencePicture shows the preview interface that the fusion results image is uploaded to the mobile terminal, until the value of presently described i is bigIn the value of the N；
Image feedback module 505, for being saved the final fusion results image and feeding back to user.
Optionally, the mobile terminal 500 further include:
Setup module 506, for being arranged the set strategy, the set strategy include the preset time for exposure andPreset preference strategy, the preset preference strategy include but are not limited to the frame work that selection clarity is greater than given thresholdFor the 0th frame image.
Optionally, first shooting module 501 is also used to:
Obtain the preset acquisition parameters of the mobile terminal；
Shoot a frame image；
Calculate the clarity of the frame image；
Judge whether the clarity of described image is greater than given threshold；
If the determination result is YES, then it is exported described image as the 0th frame image；
If judging result be it is no, shot again, until described image clarity be greater than the given threshold, willDescribed image is exported as the 0th frame image.
Optionally, the acquisition module 502 is also used to:
Calculate the brightness variance and mean value of the reference frame；
Judge whether the brightness variance of the reference frame is greater than the given threshold；
If the brightness variance of the reference frame is less than the given threshold, the i-th exposed frame time and the 0th frameTime for exposure it is identical；
If the brightness variance of the reference frame is greater than the given threshold, the i-th exposed frame time is described setThe ratio of the luminance mean value of threshold value and the reference frame.
Wherein, the value of the i is incremented by with shooting number, and the value of the N is preset value, and size is constant.
Optionally, described image Fusion Module 504 is also used to:
Judge whether the value of presently described i is greater than the value of the N, wherein the value of the N is the integer greater than 1；
If the value of the presently described i is less than the value of the N, the value of presently described i is obtained；
If i=1, image co-registration is carried out after the 1st frame image and the 0th frame image are carried out image registration, obtains the 1st frame imageThe fusion results image of sequence；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, described image Fusion Module 504 is also used to:
If i > 1, by the fusion results figure of the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageAs carrying out image co-registration after carrying out image registration, the fusion results image of the i-th frame image sequence is obtained；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, described image Fusion Module 504 is also used to:
If the value of presently described i is greater than the value of the N；
Terminate the fusion results image to the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageCarry out image registration after carry out image co-registration, using the fusion results image of (i-1)-th frame image sequence as finally described inFusion results image；
The final fusion results image is saved and feeds back to user.
Optionally, the mobile terminal 500 further include:
1st frame image and the 0th frame image are carried out image registration for working as i=N=1 by the second image co-registration module 507After carry out image co-registration, obtain the fusion results image of the 1st frame image sequence；
The fusion results image is saved as into the final fusion results image and is uploaded to the pre- of the mobile terminalLooking at interface is updated display, feeds back to user.
Mobile terminal 500 provided in an embodiment of the present invention, mobile terminal is by using the 0th frame as reference frame, reducing final figurePicture and the difference between user's preview；It shoots and merges parallel progress, shorten whole shooting time；By the result in synthesis processPicture reaches preview interface, i.e., the change procedure that picture quality grows from weak to strong in the browsable image procossing of user provides interactive modeShooting experience, the user experience is improved.
It can be with those of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment method isIt is completed by the relevant hardware of at least one program instruction, at least one described program can store in shifting as shown in Figure 1It in the memory 109 of dynamic terminal 100, and can be executed by the processor 110, at least one described program is by the processor110 realize following steps when executing:
It obtains the reference frame image parameter and total shooting number N, and according to the reference frame image parameter, obtains theI frame acquisition parameters, wherein the value of i and N is all the integer more than or equal to 1；
According to the i-th frame acquisition parameters, the i-th frame image is shot；
The fusion results image of the (i-1)-th frame image sequence before the i-th frame image and the i-th frame image is carried outImage co-registration is carried out after image registration, obtains the fusion results image of the i-th frame image sequence, and the fusion results image is uploadedPreview interface to the mobile terminal is shown, until the value of presently described i is greater than the value of the N；
The final fusion results image is saved and feeds back to user.
Optionally, the set strategy includes the preset time for exposure and preset preference strategy, described presetThe frame that preference strategy includes but are not limited to that clarity is selected to be greater than given threshold is as the 0th frame image.
Optionally, the moment being pressed in the shutter of the mobile terminal shoots the 0th frame figure according to set strategyPicture, comprising:
Obtain the preset acquisition parameters of the mobile terminal；
Shoot a frame image；
Calculate the clarity of the frame image；
Judge whether the clarity of described image is greater than given threshold；
If the determination result is YES, then it is exported described image as the 0th frame image；
If judging result be it is no, shot again, until described image clarity be greater than the given threshold, willDescribed image is exported as the 0th frame image.
Optionally, the acquisition reference frame image parameter and total shooting number N, and according to the reference frame imageParameter obtains the i-th frame acquisition parameters, further includes:
Calculate the brightness variance and mean value of the reference frame；
Judge whether the brightness variance of the reference frame is greater than the given threshold；
If the brightness variance of the reference frame is less than the given threshold, the i-th exposed frame time and the 0th frameTime for exposure it is identical；
If the brightness variance of the reference frame is greater than the given threshold, the i-th exposed frame time is described setThe ratio of the luminance mean value of threshold value and the reference frame.
Wherein, the value of the i is incremented by with shooting number, and the value of the N is preset value, and size is constant.
Optionally, the merging the i-th frame image and the (i-1)-th frame image sequence before the i-th frame imageResult images carry out image co-registration after carrying out image registration, the fusion results image of the i-th frame image sequence are obtained, by the fusionThe preview interface that result images are uploaded to the mobile terminal shown, until the value of presently described i is greater than the value of the N,Include:
Judge whether the value of presently described i is greater than the value of the N, wherein the value of the N is the integer greater than 1；
If the value of the presently described i is less than the value of the N, the value of presently described i is obtained；
If i=1, image co-registration is carried out after the 1st frame image and the 0th frame image are carried out image registration, obtains the 1st frame imageThe fusion results image of sequence；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, if the value of the presently described i is less than the value of the N, the value of presently described i is obtained, further includes:
If i > 1, by the fusion results figure of the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageAs carrying out image co-registration after carrying out image registration, the fusion results image of the i-th frame image sequence is obtained；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, whether the value for judging presently described i is greater than the value of the N, further includes:
If the value of presently described i is greater than the value of the N；
Terminate the fusion results image to the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageCarry out image registration after carry out image co-registration, using the fusion results image of (i-1)-th frame image sequence as finally described inFusion results image；
The final fusion results image is saved and feeds back to user.
Optionally, described according to the i-th frame acquisition parameters, after shooting the i-th frame image, the method also includes:
If i=N=1, image co-registration is carried out after the 1st frame image and the 0th frame image are carried out image registration, obtains the 1stThe fusion results image of frame image sequence；
The fusion results image is saved as into the final fusion results image and is uploaded to the pre- of the mobile terminalLooking at interface is updated display, feeds back to user.
Mobile terminal 100 provided in an embodiment of the present invention, mobile terminal is by using the 0th frame as reference frame, reducing final figurePicture and the difference between user's preview；It shoots and merges parallel progress, shorten whole shooting time；By the result in synthesis processPicture reaches preview interface, i.e., the change procedure that picture quality grows from weak to strong in the browsable image procossing of user provides interactive modeShooting experience, the user experience is improved.
It can be with those of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment method isIt is completed by the relevant hardware of at least one program instruction, at least one described program can store in a storage medium,At least one program is when being executed, comprising the following steps:
It obtains the reference frame image parameter and total shooting number N, and according to the reference frame image parameter, obtains theI frame acquisition parameters, wherein the value of i and N is all the integer more than or equal to 1；
According to the i-th frame acquisition parameters, the i-th frame image is shot；
The fusion results image of the (i-1)-th frame image sequence before the i-th frame image and the i-th frame image is carried outImage co-registration is carried out after image registration, obtains the fusion results image of the i-th frame image sequence, and the fusion results image is uploadedPreview interface to the mobile terminal is shown, until the value of presently described i is greater than the value of the N；
The final fusion results image is saved and feeds back to user.
Optionally, the set strategy includes the preset time for exposure and preset preference strategy, described presetThe frame that preference strategy includes but are not limited to that clarity is selected to be greater than given threshold is as the 0th frame image.
Optionally, the moment being pressed in the shutter of the mobile terminal shoots the 0th frame figure according to set strategyPicture, comprising:
Obtain the preset acquisition parameters of the mobile terminal；
Shoot a frame image；
Calculate the clarity of the frame image；
Judge whether the clarity of described image is greater than given threshold；
If the determination result is YES, then it is exported described image as the 0th frame image；
If judging result be it is no, shot again, until described image clarity be greater than the given threshold, willDescribed image is exported as the 0th frame image.
Optionally, the acquisition reference frame image parameter and total shooting number N, and according to the reference frame imageParameter obtains the i-th frame acquisition parameters, further includes:
Calculate the brightness variance and mean value of the reference frame；
Judge whether the brightness variance of the reference frame is greater than the given threshold；
If the brightness variance of the reference frame is less than the given threshold, the i-th exposed frame time and the 0th frameTime for exposure it is identical；
If the brightness variance of the reference frame is greater than the given threshold, the i-th exposed frame time is described setThe ratio of the luminance mean value of threshold value and the reference frame.
Wherein, the value of the i is incremented by with shooting number, and the value of the N is preset value, and size is constant.
Optionally, the merging the i-th frame image and the (i-1)-th frame image sequence before the i-th frame imageResult images carry out image co-registration after carrying out image registration, the fusion results image of the i-th frame image sequence are obtained, by the fusionThe preview interface that result images are uploaded to the mobile terminal shown, until the value of presently described i is greater than the value of the N,Include:
Judge whether the value of presently described i is greater than the value of the N, wherein the value of the N is the integer greater than 1；
If the value of the presently described i is less than the value of the N, the value of presently described i is obtained；
If i=1, image co-registration is carried out after the 1st frame image and the 0th frame image are carried out image registration, obtains the 1st frame imageThe fusion results image of sequence；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, if the value of the presently described i is less than the value of the N, the value of presently described i is obtained, further includes:
If i > 1, by the fusion results figure of the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageAs carrying out image co-registration after carrying out image registration, the fusion results image of the i-th frame image sequence is obtained；
The preview interface that the fusion results image is uploaded to the mobile terminal is updated display.
Optionally, whether the value for judging presently described i is greater than the value of the N, further includes:
If the value of presently described i is greater than the value of the N；
Terminate the fusion results image to the (i-1)-th frame image sequence before the i-th frame image and the i-th frame imageCarry out image registration after carry out image co-registration, using the fusion results image of (i-1)-th frame image sequence as finally described inFusion results image；
The final fusion results image is saved and feeds back to user.
Optionally, described according to the i-th frame acquisition parameters, after shooting the i-th frame image, the method also includes:
If i=N=1, image co-registration is carried out after the 1st frame image and the 0th frame image are carried out image registration, obtains the 1stThe fusion results image of frame image sequence；
The fusion results image is saved as into the final fusion results image and is uploaded to the pre- of the mobile terminalLooking at interface is updated display, feeds back to user.
Storage medium provided in an embodiment of the present invention, mobile terminal by using the 0th frame as reference frame, reduce final image withDifference between user's preview；It shoots and merges parallel progress, shorten whole shooting time；By the result picture in synthesis processPreview interface is reached, i.e., the change procedure that picture quality grows from weak to strong in the browsable image procossing of user provides interactive batExperience is taken the photograph, the user experience is improved.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-rowHis property includes, so that the process, method, article or the device that include a series of elements not only include those elements, andAnd further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsicElement.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to doThere is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment sideMethod can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many casesThe former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior artThe part contributed out can be embodied in the form of software products, which is stored in a storage mediumIn (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothesBusiness device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hairEquivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skillsArt field, is included within the scope of the present invention.