CN102355527A

Movatterモバイル変換

Info

Publication number: CN102355527A
Application number: CN2011102084050A
Authority: CN
Inventors: 吴龙飞
Original assignee: SHENZHEN WIRELESSK K-PHONE TECHNOLOGY Co Ltd
Current assignee: SHENZHEN WIRELESSK K-PHONE TECHNOLOGY Co Ltd
Priority date: 2011-07-22
Filing date: 2011-07-22
Publication date: 2012-02-15

Abstract

The invention relates to a mood induction apparatus of a mobile phone and a method thereof. The apparatus comprises an acquisition module, an identification module, a comparison module, a mobile phone master control module and a playing module. The acquisition module is used for capturing a facial image and/or voice of a mobile phone user according to an induction command. The identification module is used for carrying out characteristic analysis and obtaining a characteristic parameter. The comparison module is used for comparing the obtained characteristic parameter with an expression characteristic database stored in training according to the induction command and matching corresponding mood. The mobile phone master control module is used for calling a corresponding interface and/or sound effect according to the matched mood. The playing module is used for playing the corresponding interface and/or sound effect. According to the apparatus and the method of the present invention, a mobile phone interface can give corresponding display adjusting according to mood of the user and play different sound effects to interact with the user, mobile phone usage experience of the user is optimized, and the mobile phone has a hommization effect.

Description

A kind of mobile phone induction mood device and method

Technical field

The present invention relates to the mobile phone technique field, more particularly, relate to a kind of mobile phone induction mood device and method.

Background technology

Along with scientific and technological progress, mobile phone is basically popularized, and becomes the general consumer goods.But in the prior art, the user interaction function of mobile phone is not strong, can only control by the user, and can't carry out certain operations on one's own initiative.

For example, mobile phone does not possess the function of initiatively responding to user mood, thereby can not adjust the demonstration of mobile phone interface according to the difference of user mood, reaches the effect with user interaction.No matter the user is still dejected happily, and mobile phone can not respond, and for example its mobile phone interface only can show according to user's setting, can't make a response to the difference of user's mood on one's own initiative, as adjusting interface display etc.

Summary of the invention

The technical problem that the present invention will solve is, and is not strong to the user interaction function of existing mobile phone, can not a kind of mobile phone induction mood device and method be provided according to the defective of user's mood display interface.

The technical solution adopted for the present invention to solve the technical problems is: construct a kind of mobile phone induction mood device and method; Through face-image of catching the cellie and/or the sound that the user sends, carry out the identification of characteristics of image and sound signature analysis, the pairing feature database of various moods with the user who pre-deposits compares again; Thereby differentiation user mood; Adjust interface display according to user mood again, and/or play corresponding audio effect file, reach effect with user interaction.

First aspect present invention provides a kind of mobile phone induction mood device, comprising: acquisition module, identification module, comparison module, mobile phone main control module and playing module;

Said acquisition module is used for catching cellie's face-image and/or sound according to the induction order, and sends to said identification module;

Said identification module is used for carrying out signature analysis according to responding to the face-image and/or the sound of order to the cellie of collection, obtains characteristic parameter;

Comparing in the expressive features storehouse that said comparison module deposits in when being used for ordering characteristic parameter that obtains and training according to induction, matches corresponding mood;

Said mobile phone main control module is used for sending the induction order and starts acquisition module, comparison module and identification module, and calls corresponding interface and/or audio according to the mood that comparison module matches;

Said playing module is used to play the interface and/or the audio of said correspondence.

In the described mobile phone induction mood device according to first aspect present invention, said comparison module comprises the memory cell in the expressive features storehouse that deposits in when being used to store training.

In the described mobile phone induction mood device according to first aspect present invention, said mobile phone main control module finds corresponding interface and/or the audio of mood that matches through look-up table.

In described mobile phone induction mood device according to first aspect present invention; Said comparison module matees respectively the face-image that obtains cellie in the characteristic parameter and the characteristic parameter of sound, when coming to the same thing, sends the mood of the correspondence that matches and gives said mobile phone main control module; When the result is inequality, send comparison error and instruct to said mobile phone main control module, said mobile phone main control module sends induction order startup acquisition module, comparison module and identification module once more and begins new round induction.

In the described mobile phone induction mood device according to first aspect present invention, said mobile phone main control module receives the user and imports and send induction order or timed sending induction order.

In the described mobile phone induction mood device according to first aspect present invention, said acquisition module, identification module, comparison module, mobile phone main control module and playing module are integrated in the cell phone mainboard.

Second aspect present invention provides a kind of mobile phone induction mood method, may further comprise the steps:

Acquisition step, the face-image and/or the sound of catching the cellie;

Identification step carries out signature analysis to the cellie's that gathers face-image and/or sound, obtains characteristic parameter;

Comparison step, the feature database that deposits in during with characteristic parameter that obtains and training is compared, and matches corresponding mood;

Finding step calls corresponding interface and/or audio according to the mood that matches;

Step for playing is used to play the interface and/or the audio of said correspondence.

In described mobile phone induction mood device, find corresponding interface and/or the audio of mood that matches through look-up table in the said finding step according to second aspect present invention.

In described mobile phone induction mood device according to second aspect present invention, in the said comparison step face-image that obtains cellie in the characteristic parameter and the characteristic parameter of sound are mated respectively, when coming to the same thing, carry out said finding step; When the result is inequality, go to said acquisition step and begin new round induction.

In the described mobile phone induction mood device according to second aspect present invention, said acquisition step begins to carry out by receiving user's input, perhaps regularly begins to carry out.

The mobile phone induction mood device and method of embodiment of the present invention has following beneficial effect: when the present invention uses mobile phone the user, through face-image of catching the cellie and/or the sound that the user sends; Carry out the identification of characteristics of image and sound signature analysis; The pairing expressive features of various moods storehouse with the user who pre-deposits compares again, thereby differentiates user mood, again according to user mood adjustment interface display; And/or play corresponding audio effect file; Reach the effect with user interaction, increase and optimize the experience that the user uses mobile phone, make mobile phone have more the hommization effect.

Description of drawings

To combine accompanying drawing and embodiment that the present invention is described further below, in the accompanying drawing:

Fig. 1 is the module diagram according to mobile phone induction mood device in the preferred embodiment of the present invention;

Fig. 2 is the sketch map according to the mapping table of mobile phone induction mood device employing in the preferred embodiment of the present invention;

Fig. 3 a-c is respectively the sketch map at the interface that poor, the in a good humor and mood of mood plays when general;

Fig. 4 is the circuit theory diagrams of mobile phone induction mood device in the preferred embodiment of the present invention;

Fig. 5 is a mobile phone induction mood method flow diagram in the preferred embodiment of the present invention.

Embodiment

In order to make the object of the invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.

See also Fig. 1, be module diagram according to mobile phone induction mood device in the preferred embodiment of the present invention.As shown in Figure 1, the mobile phone induction mood device of this embodiment comprises: mobile phone main control module 100, and theacquisition module 200 that is attached thereto,identification module 300,comparison module 400 andplaying module 500.

Wherein, mobile phone main control module 100 is used for sending induction orderstartup acquisition module 200,comparison module 300 and identification module 400.In a preferred embodiment of the invention, mobile phone main control module 100 can receive the user and import transmission induction order, and promptly the user can import manually opened induction mood operation through mobile phone.In another preferred embodiment of the present invention, mobile phone main control module 100 can timed sending induction order unlatching induction mood be operated, and is for example every at a distance from 10s photographic images and/or collection sound.

Acquisition module 200 begins to catch cellie's face-image and/or sound after receiving acquisition, and sends to identification module 300.Camera and/or microphone thatacquisition module 200 can carry for mobile phone also can adopt image sensor chip or recording chip to realize.

Identification module 300 receives the cellie's ofacquisition module 200 collections face-image and/or sound after receiving acquisition, and it is carried out signature analysis, obtains characteristic parameter.In a preferred embodiment of the invention, the process of facial expression image identification is following: carry out the analysis of face-image, be partitioned into forehead, eyebrow, eyes; Face, parts such as tooth are through judging forehead, eyebrow, eyes; Face, the textural characteristics of tooth is discerned expression, and these characteristics have: forehead wrinkle, eyebrow cockle; The following curved degree of eye, the degree of crook of face, and have or not tooth, have or not tears etc.The identifying of sound: the voice data to the user that collects, carry out after the preliminary treatment such as branch frame, windowing, preemphasis, end-point detection, extract Mel frequency cepstral coefficient characteristic parameters such as (MFCC).

Comparison module 400 is after receiving the induction order, and comparing in the expressive features storehouse that the characteristic parameter thatidentification module 300 is obtained deposits in during with training, matches corresponding mood according to differentcharacter.Comparison module 400 can comprise the memory cell in the expressive features storehouse that deposits in when being used to store training.In order to improve discrimination and recognition speed; The present invention can be in advance train mobile phone induction mood device, (as laughs at the various moods of cellie, cries in advance; Indignation, sadnesss etc.) pairing facial expression image textural characteristics and/or sound characteristic record in the expressive features database.For example; Collect and record facial expression image textural characteristics and/or sound characteristic when laughing in advance; As possibly show one's teeth when smiling, therefore the spectrum analysis characteristic parameter scope with tooth deposits in the expressive features database, if the spectrum analysis characteristic parameter of tooth is positioned at this scope in the facial expression that when the induction mood, photographs; Then can be judged as the user and smile, the mood that matches the user thus is for well.In like manner; Can adopt DTW (Dynamic Time Warping; The characteristic parameter data of the emotion sound (like sound such as " heartily ", " laughing a great ho-ho ", " sounds of sighing ") that the dynamic time consolidation) deposits in when algorithm and training in advance are advanced contrast, thereby match corresponding mood.At this, the method that the present invention can adopt any image and field of speech recognition to adopt realizes the coupling to facial expression image and sound.

Afteracquisition module 200 has been gathered face-image and sound simultaneously;Identification module 300 is discerned the characteristic parameter of this face-image and sound simultaneously; Need adopt algorithm that both are mated respectively atcomparison module 400 subsequently; Because the External Stochastic Factor that occurs or the mistake of programmed algorithm possibly cause both to produce different matching results.Therefore, another unique distinction of the present invention is, the solution that different matching results occurs is provided.For example,comparison module 400 is judged according to the face-image that collects and is the face of crying, and represent mood poor, and the sound that collects is similar with the sound characteristic of " laughing a great ho-ho ", represents in a good humorly, and both evident difference occurs.At this moment,comparison module 400 will send comparison error and instruct to mobile phone main control module 100 when both results are inequality, and mobile phone main control module 100 will send each module of induction order startup once more and begin new round induction after receiving this instruction.The mood of the correspondence that whencomparison module 400 is judged both result's unanimities, will match sends to mobile phone main control module 100, carries out subsequent calls and playing process.

Mobile phone main control module 100 calls corresponding interface and/or audio after receiving the mood thatcomparison module 400 matches.For example, set up the mapping table of a mood and interface and audio, as shown in Figure 2.Be mapped to different moods on the different interface and audio.It is in a good humor for example to represent the smiling face happiness to be classified as, and cries, frowns that it is poor to represent sadness to be classified as mood, and other represent mood general; In a good humor corresponding display color interface; On the interface, show all-purpose card smiling face head portrait, and play cheerful and light-hearted audio effect file, the corresponding grey of mood difference interface; Show the all-purpose card face head portrait of crying on the interface, and play and constrain overcast audio effect file.Mood generally then is mapped to generic interface and shows common cartoon head portrait and general audio, or the like.The sketch map at the interface of playing in the time of as Fig. 3 a-c is respectively poor, the in a good humor and mood of mood.The present invention can be provided with multiple mood mode as required.When matching user's mood, through tabling look-up, find the mobile phone interface that will show and audio effect file to be play, show through playingmodule 500 then and play back, make corresponding reaction.

Playing module 500 is used to play interface and/or the audio that mobile phone main control module 100 accesses.Therefore playingmodule 500 can be realized by display screen and/or loud speaker that mobile phone carries, perhaps sets up display chip and realizes.

See also Fig. 4, be the circuit theory diagrams of mobile phone induction mood device in the preferred embodiment of the present invention.As shown in Figure 1,acquisition module 200 comprises image sensor chip U3;Identification module 300 comprises identification chip U2, is the burned dsp chip that is used for the relative program of recognition feature;Comparison module 400 comprises comparable chip U3, is the burned dsp chip that is used for the relative program of comparison match characteristic; 100 of mobile phone main control modules directly adopt cell phonemainboard circuit U 4 to realize;Playing module 500 comprises LCM chip J1.

In this embodiment, cell phonemainboard circuit U 4 is communicated by letter with comparable chip U3 with identification chip U2 with I2C_SDC through I2C_SDA, sends the induction order.Identification chip U2 sends and should order to pin SDA and the SDL of image sensor chip U3 through I2C_SDA_CAM and I2C_SDC_CAM.

Image sensor chip U3 receives induction order back and starts scanning, the face-image that begins to catch the cellie.Image sensor chip U3 is sent to identification chip U2 through data-interface with the data of gathering.Cell phonemainboard circuit U 4 is also supplied with the operating voltage of image sensor chip U3 through VDD_SENSOR18 and VDD_SENSOR28 control.In another embodiment of the present invention, this cell phonemainboard circuit U 4 can also be controlled microphone collection cellie's sound, and sends to identification chip U2.

Identification chip U2 exports related data to the SPI2_DAIN of comparable chip U3 through SPI_DAOUT after identifying characteristic parameter.Comparable chip U3 exports to the SPI_DAIN of cell phonemainboard circuit U 4 through SPI1_DAIN after matching corresponding mood.

Cell phonemainboard circuit U 4 sends to LCM chip J1 and shows after calling out corresponding display interface.Cell phonemainboard circuit U 4 can also be directly through the loudspeaker plays acoustics.

Realize acquisition module, identification module, comparison module, mobile phone main control module and playing module though adopted independent chip among this embodiment; Yet it will be appreciated by those skilled in the art that the present invention is not limited only to this; And can above-mentioned module be integrated in the cell phone mainboard; Through cell phone mainboard control camera and/or microphone images acquired and/or voice signal; Through corresponding identification software is installed, realize above-mentioned identification, comparison and the process of transferring subsequently in cell phone system, pass through the display screen and/or the loudspeaker plays effect of mobile phone again.Can under the situation that does not increase hardware, only, corresponding software realize above-mentioned functions thus through being installed.

See also Fig. 5, be mobile phone induction mood method flow diagram in the preferred embodiment of the present invention.As shown in Figure 5, the mobile phone induction mood method among this embodiment may further comprise the steps:

At first in step S1, begin to respond to the mood operation, this step begins to carry out by receiving user's input, perhaps regularly begins to carry out.Preferably; When method of the present invention adopts said apparatus to realize, for example, in a preferred embodiment of the invention; Mobile phone main control module 100 can receive the user and import transmission induction order, and promptly the user can import manually opened induction mood operation through mobile phone.In another preferred embodiment of the present invention, mobile phone main control module 100 can timed sending induction order unlatching induction mood be operated, and is for example every at a distance from 10s photographic images and/or collection sound.

Subsequently, in step S2, catch cellie's face-image and/or sound.The detailed process of this step is consistent with above-mentioned description to acquisition module.Preferably, when method of the present invention adopted said apparatus to realize, this step was carried out byacquisition module 200, after receiving acquisition, begins to catch cellie's face-image and/or sound, and sends to identification module 300.Camera and/or microphone thatacquisition module 200 can carry for mobile phone also can adopt image sensor chip or recording chip to realize.

Subsequently, in step S3, the cellie's that gathers face-image and/or sound is carried out signature analysis, obtain characteristic parameter.The detailed process of this step is consistent with above-mentioned description to identification module.Preferably; When method of the present invention adopted said apparatus to realize, this step after receiving acquisition, received the cellie's ofacquisition module 200 collections face-image and/or sound byidentification module 300; And it is carried out signature analysis, obtain characteristic parameter.

Subsequently, in step S4, the feature database that deposits in during with characteristic parameter that obtains and training is compared, and matches corresponding mood.The detailed process of this step is with above-mentioned consistent to the description of comparing module.Preferably; When method of the present invention adopts said apparatus to realize; After receiving the induction order, compare, and matches corresponding mood according to different character by the expressive features storehouse that the characteristic parameter thatidentification module 300 is obtained deposits in during with training bycomparison module 400 for this step.In this step, can mate respectively the face-image that obtains cellie in the characteristic parameter and the characteristic parameter of sound, when coming to the same thing, carry out said finding step; When the result is inequality, go to said acquisition step and begin new round induction.

Subsequently, in step S5, call corresponding interface and/or audio according to the mood that matches.In this step, can find corresponding interface and/or the audio of mood that matches through look-up table.The detailed process of this step is consistent with above-mentioned description to the mobile phone main control module.Preferably, when method of the present invention adopted said apparatus to realize, this step after receiving the mood thatcomparison module 400 matches, was called corresponding interface and/or audio by mobile phone main control module 100.For example, set up the mapping table of a mood and interface and audio, as shown in Figure 2.Be mapped to different moods on the different interface and audio.

Subsequently, in step S6, play the interface and/or the audio of said correspondence.The detailed process of this step is consistent with above-mentioned description to playing module.

Subsequently, according to different audios, execution in step S7, S8 or S9.For example, in step S7, the mood difference then is mapped to grey interface display cry face cartoon head portrait and overcast oppressive audio.In step S8, in a good humor colored interface display smiling face's cartoon head portrait and the cheerful and light-hearted audio of then being mapped to.In step S9, mood generally then is mapped to generic interface and shows common cartoon head portrait and general audio.

At last, method ends at step S10.

In sum, mobile phone induction mood apparatus and method of the present invention are when the user uses mobile phone; Through face-image of catching the cellie and/or the sound that the user sends, carry out the identification of characteristics of image and sound signature analysis, the pairing expressive features of the various moods storehouse with the user who pre-deposits compares again; Thereby differentiation user mood; Adjust interface display according to user mood again, and/or play corresponding audio effect file, reach effect with user interaction; Increase and optimization user use the experience of mobile phone, make mobile phone have more the hommization effect.

The present invention describes according to specific embodiment, but it will be understood by those skilled in the art that when not breaking away from the scope of the invention, can carry out various variations and be equal to replacement.In addition, for adapting to the specific occasion or the material of the present invention's technology, can carry out many modifications and not break away from its protection range the present invention.Therefore, the present invention is not limited to specific embodiment disclosed herein, and comprises that all drop into the embodiment of claim protection range.

Claims

1. a mobile phone induction mood device is characterized in that, comprising: acquisition module, identification module, comparison module, mobile phone main control module and playing module;

2. mobile phone induction mood device according to claim 1 is characterized in that said comparison module comprises the memory cell in the expressive features storehouse that deposits in when being used to store training.

3. mobile phone induction mood device according to claim 1 is characterized in that said mobile phone main control module finds corresponding interface and/or the audio of mood that matches through look-up table.

4. according to any described mobile phone induction mood device among the claim 1-3; It is characterized in that; Said comparison module matees respectively the face-image that obtains cellie in the characteristic parameter and the characteristic parameter of sound, when coming to the same thing, sends the mood of the correspondence that matches and gives said mobile phone main control module; When the result is inequality, send comparison error and instruct to said mobile phone main control module, said mobile phone main control module sends induction order startup acquisition module, comparison module and identification module once more and begins new round induction.

5. respond to the mood device according to any described mobile phone among the claim 1-3, it is characterized in that, said mobile phone main control module reception user imports to send to respond to and orders perhaps timed sending to respond to order.

6. according to any described mobile phone induction mood device among the claim 1-3, it is characterized in that said acquisition module, identification module, comparison module, mobile phone main control module and playing module are integrated in the cell phone mainboard.

7. a mobile phone induction mood method is characterized in that, may further comprise the steps:

Acquisition step, the face-image and/or the sound of catching the cellie;

8. mobile phone induction mood device according to claim 7 is characterized in that, finds corresponding interface and/or the audio of mood that matches through look-up table in the said finding step.

9. according to claim 7 or 8 described mobile phone induction mood devices; It is characterized in that; In the said comparison step face-image that obtains cellie in the characteristic parameter and the characteristic parameter of sound are mated respectively, when coming to the same thing, carry out said finding step; When the result is inequality, go to said acquisition step and begin new round induction.

10. according to claim 7 or 8 described mobile phone induction mood devices, it is characterized in that said acquisition step begins to carry out by receiving user's input, perhaps regularly begins to carry out.