Summary of the invention
Because above-mentioned situation the invention provides a kind of messaging device and information processing method, it can utilize the communication information producing in communication process, thereby further promotes the using value of communication, enriches user's experience.
Further, the messaging device of the embodiment of the present invention and information processing method can utilize the communication information producing in communication process, for example the user institute relating in communication may interested information be offered to corresponding user, thereby a kind of new mode of utilizing the communication information is provided, has greatly enriched user's experience.
According to one embodiment of the invention, a kind of information processing method is provided, be applied to server, described information processing method comprises: in the process that the first electronic equipment and the second electronic equipment communicate, at least one from described the first electronic equipment and described the second electronic equipment receives the communication information that described signal post produces; Based on the described communication information, determine handling object and send object; Described handling object is analyzed, to obtain the related information being associated with described handling object; And described related information is sent to described transmission object.
Described server, for the each user of the multiple users including the first user of described the first electronic equipment and the second user of described the second electronic equipment, stores the relation information that represents the relation between described each user and other users; The step of described definite transmission object comprises: based on the described communication information, determine targeted customer from described multiple users; Obtain described targeted customer's relation information; And relation information based on described targeted customer, determine the user who meets predetermined condition with described targeted customer's relation, as described transmission object.
In described server, store multiple users' user profile, described user profile at least comprises user's mark; The step of described definite transmission object comprises: based on the described communication information, judge whether to exist the mark of mating with the described communication information; And in the time that judgement exists the mark of mating with the described communication information, determine described transmission object based on described mark.
Described communication at least comprises voice communication, and determines that the described mark of mating with the described communication information comprises: the communication information of described voice communication is carried out to audio identification, to judge whether the described communication information mates with one of multiple marks.
Described communication at least comprises voice communication, and the step of described definite transmission object comprises: the communication information of described voice communication is carried out to semantic analysis, to determine transmission object.
Described communication at least comprises textcommunication, and the step of described definite transmission object comprises: the communication information of described textcommunication is carried out to text analyzing, to determine transmission object.
Described server stores has the user profile of the multiple users including the second user of the first user of described the first electronic equipment and described the second electronic equipment, and determine that the step that sends object comprises: the described communication information is analyzed, will be defined as targeted customer for the interested user of described handling object; And user profile based on described targeted customer, determine described transmission object.
Described communication at least comprises video communication, the information that the described communication information comprises video pictures, and described definite handling object comprises: receive the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation; And based on described input trajectory information, determine handling object.
Described communication at least comprises video communication, the information that the described communication information comprises video pictures, and described definite handling object comprises: described video pictures is carried out to image recognition, so that described tableaux is divided into multiple regions; Based on preassigned, from described multiple regions, determine target area; And based on described target area, determine described handling object.
Described communication at least comprises video communication, the information that the described communication information comprises dynamic menu, described definite handling object also comprises: described dynamic menu is identified to the specific action of making in described communication process with the object identifying in described dynamic menu; And based on described specific action, determine described handling object.
Described communication at least comprises voice communication, and described definite handling object comprises: the communication information of described voice communication is carried out to audio identification, to determine handling object.
Described definite handling object also comprises: based on the described communication information, determine multiple candidate targets; Described multiple candidate targets are sent to at least one in described the first electronic equipment and described the second electronic equipment; Receive described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target; And based on described selection information, selected described at least one candidate target is defined as to described handling object.
According to another embodiment of the present invention, a kind of messaging device is provided, be applied to server, described messaging device comprises: receiving element, in the process that the first electronic equipment and the second electronic equipment communicate, at least one from described the first electronic equipment and described the second electronic equipment receives the communication information that described signal post produces; Determining unit, based on the described communication information, determines handling object and sends object; Analytic unit, analyzes described handling object, to obtain the related information being associated with described handling object; And transmitting element, described related information is sent to described transmission object.
Described server, for the each user of the multiple users including the first user of described the first electronic equipment and the second user of described the second electronic equipment, stores the relation information that represents the relation between described each user and other users; Described determining unit comprises: targeted customer's determining unit, based on the described communication information, from described multiple users, determine targeted customer; Relation information acquiring unit, obtains described targeted customer's relation information; And send object determining unit, based on described targeted customer's relation information, determine the user who meets predetermined condition with described targeted customer's relation, as described transmission object.
In described server, store multiple users' user profile, described user profile at least comprises user's mark; Described determining unit comprises: mark judging unit, based on the described communication information, judges whether to exist the mark of mating with the described communication information; And send object determining unit, in the time that judgement exists the mark of mating with the described communication information, determine described transmission object based on described mark.
Described communication at least comprises voice communication, and described mark judging unit comprises: audio identification unit, carries out audio identification to the communication information of described voice communication, to judge whether the described communication information mates with one of multiple marks.
Described communication at least comprises voice communication, and described determining unit comprises: communication information analytic unit, carries out semantic analysis to the communication information of described voice communication, to determine transmission object.
Described communication at least comprises textcommunication, and described determining unit comprises: communication information analytic unit, carries out text analyzing to the communication information of described textcommunication, to determine transmission object.
Described server stores has the user profile of the multiple users including the second user of the first user of described the first electronic equipment and described the second electronic equipment, and described communication information analytic unit comprises: targeted customer's determining unit, the described communication information is analyzed, will be defined as targeted customer for the interested user of described handling object; And send object determining unit, based on described targeted customer's user profile, determine described transmission object.
Described communication at least comprises video communication, the information that the described communication information comprises video pictures, and described determining unit comprises: trace information receiving element, receive the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation; And handling object determining unit, based on described input trajectory information, determine handling object.
Described communication at least comprises video communication, the information that the described communication information comprises video pictures, and described determining unit comprises: cutting unit, carries out image recognition to described video pictures, so that described tableaux is divided into multiple regions; Target area determining unit based on preassigned, is determined target area from described multiple regions; And handling object determining unit, based on described target area, determine described handling object.
Described communication at least comprises video communication, the information that the described communication information comprises dynamic menu, described determining unit also comprises: action recognition unit, described dynamic menu is identified to the specific action made from the object identifying in described dynamic menu in described communication process; And handling object determining unit, based on described specific action, determine described handling object.
Described communication at least comprises voice communication, and described determining unit comprises: audio identification unit, carries out audio identification to the communication information of described voice communication, to determine handling object.
Described determining unit also comprises: candidate target determining unit, based on the described communication information, determine multiple candidate targets; Candidate target transmitting element, is sent at least one in described the first electronic equipment and described the second electronic equipment by described multiple candidate targets; Select information receiving unit, receive described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target; And handling object determining unit, based on described selection information, selected described at least one candidate target is defined as to described handling object.
In the messaging device and information processing method of the embodiment of the present invention, can utilize the described communication information, for example produce the user who relates in communication and clearly represent interest or the interested information of possibility, and described information is offered to described user or has the user of particular kind of relationship with described user, thereby provide a kind of new mode of utilizing the communication information, take full advantage of the value of the communication information, greatly enriched user's experience.
Embodiment
Describe the embodiment of the present invention in detail below with reference to accompanying drawing.
The information processing method of the embodiment of the present invention and messaging device are applied to the environment that the first electronic equipment and the second electronic equipment communicate.Described the first electronic equipment and described the second electronic equipment can be the electronic equipments that such as landline telephone, mobile phone, panel computer, personal computer etc. has communication function.Described communication can be traditional voice communication (as via landline telephone), can be also video communication (as via Video chat application), can also be textcommunication (as via instant message (text chat) application).Described the first electronic equipment can be identical with the kind of described the second electronic equipment, also can be different.
In addition, communicating by letter between described the first electronic equipment and described the second electronic equipment can be via the network such as internet, is undertaken by server (below, suitably time also referred to as remote server).That is to say, the communication information is sent to described server by one of described the first electronic equipment and described second electronic equipment, and the described communication information is forwarded to another of described the first electronic equipment and described the second electronic equipment by described server.
In the following description, taking communicating by letter as example between the first electronic equipment and these two electronic equipments of the second electronic equipment, the embodiment of the present invention has been described.But, it will be appreciated by those skilled in the art that the information processing method of the embodiment of the present invention and messaging device can be applied to the scene communicating more than between the electronic equipment of two.
Below, describe according to the information processing method of the embodiment of the present invention with reference to Fig. 1.In the time that the information processing method of the embodiment of the present invention starts, described the first electronic equipment and described the second electronic equipment are in the process communicating.
As shown in Figure 1, first, at step S101, in the process that the first electronic equipment and the second electronic equipment communicate, at least one from described the first electronic equipment and described the second electronic equipment of described information processing method receives the communication information that described signal post produces.The described communication information is to produce in the process that described the first electronic equipment and described the second electronic equipment communicate, and is sent to described server by least one in described the first electronic equipment and described the second electronic equipment.The described communication information can be audio-frequency information, video information, text message etc., can be also the combination in any of above-mentioned information.
In the following description, suppose that described information processing method receives the described communication information from described the first electronic equipment.
Next,, at step S102, described information processing method, based on the described communication information, is determined handling object and is sent object.
The input operation that can initiatively carry out by detection user of determining of described handling object realizes, and also can automatically be analyzed and identify and realize the communication information by described information processing method.
Particularly, in one embodiment, described communications packets is containing video communication, and the described communication information information that comprises video pictures.In the case, user is by carrying out input operation and designated treatment object to described video pictures.The information of the input operation that correspondingly, the information processing method of the embodiment of the present invention carries out described video pictures by acquisition user is determined the handling object that user is specified.
More specifically, described information processing method receives the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment.The electronic equipment that sends described input trajectory information and the electronic equipment that sends the communication information in above-mentioned steps S101 can be identical electronic equipments, can be also different electronic equipments.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation.Described input trajectory information both can comprise the information of a series of track being formed by multiple tracing points, also can comprise the information of the track being formed by single tracing point.For example, in the situation that described electronic equipment comprises that touch control unit and user carry out input operation by described touch control unit, described input trajectory information can be the information that the slip gesture by detecting user produces, and can be also the information that the clicking operation by detecting user produces.
In addition the electronic equipment that, sends described input trajectory information in described the first electronic equipment and described the second electronic equipment also can send the information such as size of the display frame of described electronic equipment etc.
After this, described information processing method, based on described input trajectory information, is determined handling object.
More specifically, for example, in the first example, for example user of the first electronic equipment can select a region in described video pictures.Correspondingly, the input operation that described the first electronic equipment is used for a region of selected described video pictures by detection forms input trajectory information.After this, the electronic equipment parameter information of described input trajectory information and described the first electronic equipment is sent to described server by described the first electronic equipment.Next, described information processing method will be defined as handling object with the corresponding partial video picture in described region in described video pictures.
In the second example, for example the user of the first electronic equipment can click the ad-hoc location in described video pictures.Correspondingly, the clicking operation that described the first electronic equipment is used for clicking described video pictures by detection forms input trajectory information.After this, described input trajectory information is sent to described server by described the first electronic equipment.
Next, described information processing method, based on described input trajectory information, determines that described input trajectory information is corresponding to which position in described video pictures (, above-mentioned ad-hoc location).After this, described information processing method carries out image to described video pictures to be cut apart, and to obtain the partial video picture that comprises described ad-hoc location, and described partial video picture is defined as to handling object.Equally, described information processing method can carry out aforesaid operations based on various image segmentation algorithms known in the art, is not described in detail in this.
In the 3rd example, described information processing method can be by combining user's active input to determine handling object with the automatic analysis of server.
Particularly, described information processing method can carry out image recognition to described video pictures, to determine multiple candidate targets.After this, described information processing method can be sent to multiple candidate targets at least one in described the first electronic equipment and described the second electronic equipment, selects for user.The selection operation of described at least one detection user in described the first electronic equipment and described the second electronic equipment at least one candidate target in described multiple candidate targets, produces corresponding input trajectory information and is sent to described server.
Thus, described server, based on operating by detecting described selection the selection information (, input trajectory information as above) obtaining, is defined as described handling object by selected described at least one candidate target.
Below, will describe by automatically the communication information being analyzed and identified the situation of determining handling object.
Particularly, in the first example, the information that the described communication information comprises tableaux.In the case, described information processing method carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions.Those skilled in the art can adopt various algorithms to carry out image to cut apart, be not described in detail in this.After this, described information processing method, based on preassigned, is determined target area from described multiple regions.Those skilled in the art can adopt various standards and respective algorithms to determine target area, are not described in detail in this.
After determining described target area, described information processing method, based on described target area, is determined described handling object.Particularly, for example, described information processing method can be analyzed the video pictures of described target area, to determine handling object.For example, the video pictures that described information processing method can be by identifying described target area to be to determine its object kind, thereby determines handling object.Again for example, described information processing method can be by the image in the video pictures of described target area and pre-stored information bank is carried out to fuzzy matching, thereby determine handling object.Certainly, above-mentioned based target region determines that the method for handling object is only example.The information processing method of the embodiment of the present invention can adopt other the whole bag of tricks well known by persons skilled in the art to determine handling object, is not described in detail in this.
In the second example, the described communication information comprises the information of dynamic menu.In the case, described information processing method can be identified described dynamic menu, the specific action of making in described communication process to identify user.For example, described information processing method can be by the dynamic menu being made up of multiple frames continuous in time being carried out and described similar identification above, thereby identify the action that user makes in section at this moment.
After this, described information processing method can, based on described specific action, be determined described handling object.For example, the table of the incidence relation of described information processing method between can action and handling object based on pre-stored, determines handling object according to described specific action.
In the 3rd example, the described communication information comprises the information of audio frequency.In the case, described information processing method can carry out audio identification to described audio frequency, to determine handling object.
More specifically, for example, described information processing method can judge in described audio frequency, whether there is the audio fragment mating with predetermined keyword.In the time judging the audio fragment that in described audio frequency, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described audio fragment.
Again for example, described information processing method can carry out semantic analysis to described audio frequency, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out audio identification to described audio frequency, is not described in detail in this.
In addition, the information processing method of the embodiment of the present invention can combine user's active input with the automatic identification of described electronic equipment.Particularly, in the 4th example, described information processing method, based on the described communication information, is determined multiple candidate targets, and described multiple candidate targets are sent to at least one in described the first electronic equipment and described the second electronic equipment.The electronic equipment that receives described candidate target detects user for selecting the selection operation of at least one candidate target, and described selection is operated to the selection information producing is sent to described server.Described information processing method receives described selection information, and based on described selection information, selected described at least one candidate target is defined as to described handling object.
In the 5th example, the described communication information comprises text message.In the case, described information processing method can carry out text identification to described text, to determine handling object.
More specifically, for example, described information processing method can judge in described text, whether there is the text fragments mating with predetermined keyword.In the time judging the text fragments that in described text, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described text fragments.
Again for example, described information processing method can carry out semantic analysis to described text, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out text identification to described text, is not described in detail in this.
Above, described information processing method described determined the way of example of described handling object.Also describe in connection with several concrete scenes the processing of determining handling object in detail after a while.
On the other hand, at step S102, described information processing method, based on the described communication information, is determined and is sent object.
Particularly, in one embodiment, described server, for the each user of the multiple users including the first user of described the first electronic equipment and the second user of described the second electronic equipment, stores the relation information that represents the relation between described each user and other users.Described relation information is for example included in each user's user profile.
Relation between described user and other users can be man-to-man, can be also one-to-many.In addition, the relation between described user and other use can be both unidirectional, can be also two-way.Certainly, described user also can and other any users between do not there is relation.In the case, described user's relation information is for example empty.
For example, in the application that relates to so-called social good friend, described relation information can comprise between described user for example information for two-way relation, as described in user's good friend's friend information.Described relation information can also comprise between described user for example information for unidirectional relation, as described in the user's that user paid close attention to concern user profile, or pay close attention to the bean vermicelli information of described user's bean vermicelli.
Described server is for example stored in described relation information in the database of for example described server with the various forms of mapping table or chained list etc.
Thus, described information processing method, based on the described communication information, is determined targeted customer from described multiple users.
Particularly, for example, in the case of voice communication or the audio/video communication that comprises voice communication, described information processing method can carry out semantic analysis to the communication information of described voice communication.The in the situation that of textcommunication, described information processing method can carry out text analyzing to the text message of described textcommunication, thus, determines targeted customer from described multiple users.
More specifically, one of the first user that can be described the first electronic equipment by the determined described targeted customer of above-mentioned analysis and second user of described the second electronic equipment, can be also except described first user or described the second user, other involved users in described communication process.For example, in one embodiment, described information processing method can by communication process to handling object as above represent interest user (as described in first user and as described in one of the second user) be defined as targeted customer.Again for example, described information processing method can by communication process involved may to the interested user of handling object as above (as described in first user and/or as described in other users of being mentioned of the second user) be defined as targeted customer.
After this, described information processing method obtains described targeted customer's as above relation information, and relation information based on described targeted customer, determines the user who meets predetermined condition with described targeted customer's relation, as described transmission object.
Particularly, described information processing method can be preset the predetermined condition (, strategy) of various definite transmission objects.Be applied as example with above-mentioned social activity, described information processing method by the user who has a two-way concern relation with described targeted customer (for example can be preset, good friend) or have the user (for example, bean vermicelli or concern user) of unidirectional concern relation to be defined as sending object with described targeted customer.Certainly, above-described predetermined condition is only example.Those skilled in the art can be as required, designs different predetermined conditions, and it all within the scope of the invention.
A kind of mode of definite transmission object has more than been described.Determine by describing the another kind of mode that sends object below.
In this embodiment, in described server, store multiple users' user profile.Described user profile at least comprises user's mark, for example described user's name information, username information, pet name information etc.
Thus, described information processing method, based on the described communication information, judges whether to exist the mark of mating with the described communication information.
Particularly, for example, in the case of voice communication or the audio/video communication that comprises voice communication, described information processing method can carry out audio identification to the communication information of described voice communication, to judge whether the described communication information mates with one of multiple marks.The in the situation that of textcommunication, described information processing method can carry out text matches to the communication information of described textcommunication, to judge whether the described communication information mates with one of multiple marks.
In the time that judgement exists the mark of mating with the described communication information, described information processing method is determined described transmission object based on described mark.In an example, corresponding described mark user is defined as described transmission object by described information processing method.In another example, the user who meets predetermined condition with the corresponding user's of described mark relation is defined as described transmission object by described information processing method.More specifically, described information processing method obtains the corresponding user's of described mark user profile (more specifically, relation information).After this, described information processing method is based on described relation information, by and the corresponding user of described mark between the relation user that meets predetermined condition be defined as described transmission object.
Above, described information processing method described determined the way of example of described transmission object.Also describe in detail and determine the processing that sends object in connection with several concrete scenes after a while.
After having determined transmission object and handling object by the processing of step S102, at step S103, described information processing method is analyzed described handling object, to obtain the related information being associated with described handling object.
Particularly, in one embodiment, the pre-stored object information of multiple objects in described server, and the object information of each object and attribute information are stored explicitly.Described attribute information is for representing the attribute of described object.
Thus, described information processing method is the incidence relation based between described object information and attribute information for example, described handling object is analyzed, to determine the attribute of described handling object.After this, the attribute of described information processing method based on described handling object, determines attribute information corresponding in the attribute information of storing.For example, described attribute information can be divided into different classes of.Described information processing method can be defined as corresponding attribute information by the attribute information that belongs to same classification or respective classes with the attribute of described handling object in stored attribute information.Next, the object information associated with described corresponding attribute information is defined as described related information by described information processing method.
In another embodiment, the information that described attribute information comprises multiple attribute.Described information processing method, after having determined a certain attribute of described handling object, can directly be defined as described related information by other attribute informations of described handling object.
It is pointed out that the mode that above-described described information processing method is determined related information is only example.Those skilled in the art can adopt other variety of ways to obtain described related information.
Thus, described information processing method has been determined related information by the processing of step S103.
After this,, at step S104, described related information is sent to described transmission object by described information processing method.More specifically, described information processing method can be sent to described related information described transmission object (, user) in a predefined manner.For example, described information processing method can be sent to described related information account, E-mail address, phone number of described transmission object etc.The information of described account, E-mail address or phone number etc. is stored in described server as a part for user profile in advance.
The information processing method of the embodiment of the present invention has been described above.According in the information processing method of the embodiment of the present invention, the communication information producing based on described signal post is determined handling object and is sent object, obtains the related information associated with described handling object, and described related information is sent to described transmission object.
Therefore, by the information processing method of the embodiment of the present invention, can utilize the communication information producing in communication process, thus except realize communication objective, can also further promote the using value of communication, greatly enriched user's experience.
More specifically, in the information processing method of the embodiment of the present invention, can utilize the described communication information, for example produce the user who relates in communication and clearly represent interest or the interested information of possibility, and described information is offered to described user or has the user of particular kind of relationship with described user, thereby a kind of new mode of utilizing the communication information is provided, takes full advantage of the value of the communication information, greatly enriched user's experience.
In addition,, because the information processing method of the embodiment of the present invention is applied to server side, therefore, in the case of the disposal ability of electronic equipment side is limited, the information processing method of the embodiment of the present invention can alleviate the processing load of electronic equipment side, thereby particularly favourable.
But, it is pointed out that and it will be appreciated by those skilled in the art that the section processes of the information processing method of the embodiment of the present invention also can suitably be carried out in electronic equipment side along with the improving constantly of electronic equipment disposal ability.For example, described the first electronic equipment and/or described the second electronic equipment can be determined handling object based on the described communication information, even determine the related information associated with described handling object, and determined handling object and/or related information are sent to described server.
Below, with reference to Fig. 2, the process of determining handling object in the information processing method of the embodiment of the present invention is described in conjunction with some concrete scenes.
In the scene shown in Fig. 2, the first electronic equipment and the second electronic equipment are carrying out audio/video communication (following, to be called for short video communication).Fig. 2 is diagram and the demonstration schematic diagram of having applied on the display screen 200 of the first electronic equipment of server communication of information processing method of the embodiment of the present invention.
Described display screen 200 is divided into two regions: first area 201 and second area 202.In first area 201, show user's's (following, to be called first user suitably time) of the first electronic equipment that described the first electronic equipment gathers by the image acquisition units of for example front-facing camera image.In second area 202, show user's's (following, to be called the second user suitably time) of the second electronic equipment that described the second electronic equipment gathers by the image acquisition units of for example camera image.In the following description, the display screen 200 of supposing described the first electronic equipment is touch display screen.
In the scene of Fig. 2, first user with the second user's video communication in, the second user's upper garment has been produced to interest, and has irised out region 503 corresponding with described upper garment on described display screen 500 by gesture.
The trace information that described the first electronic equipment produces described gesture sends to described server.In addition, described the first electronic equipment also can send the information of size such as the display frame of described electronic equipment etc.Thus, described information processing method, based on described input trajectory information, will be defined as handling object with the corresponding partial video picture in described region 503 in described video pictures.
Alternatively, first user also can be clicked the arbitrary position in the residing region of described upper garment on described display screen 200 by gesture.Correspondingly, the clicking operation that described the first electronic equipment is used for clicking described video pictures by detection forms input trajectory information.After this, described input trajectory information is sent to described server by described the first electronic equipment.Next, described information processing method, based on described input trajectory information, determines that described input trajectory information is corresponding to which position in described video pictures (, above-mentioned ad-hoc location).After this, described information processing method carries out image to described video pictures to be cut apart, and to obtain the partial video picture (, with the corresponding picture in described region 203) that comprises described ad-hoc location, and described partial video picture is defined as to handling object.
Alternatively, described information processing method also can carry out image recognition to described video pictures automatically, so that described video pictures is divided into multiple regions, for example the region 203 corresponding with upper garment, with region 204 corresponding to trousers, with region 205 corresponding to footwear, with region 206 corresponding to face and the region 207 corresponding with background.After this, described information processing method is based on preassigned, and for example significance based on region, is defined as handling object by the region in multiple regions 203.
Alternatively, described information processing method also can combine above-mentioned user's input with automatically definite mode.; described information processing method can carry out image recognition to described video pictures first automatically, to determine multiple candidate targets, and for example upper garment 203, trousers 204 and footwear 205; and described multiple candidate targets are sent to described the first electronic equipment, select for first user.Described the first electronic equipment detects the selection operation of user at least one candidate target in described multiple candidate targets, produces corresponding input trajectory information and is sent to described server.
Thus, described server, based on operating by detecting described selection the selection information (, input trajectory information as above) obtaining, is defined as described handling object by selected described at least one candidate target.
Thereby described information processing method obtains the related information associated with described handling object.Particularly, in this scene, for example, described information processing method is determined the brand of described upper garment by graphical analysis, obtains thus the attribute informations such as the price, fabric, the place of production of described upper garment as related information.Again for example, described information processing method is determined the brand of described upper garment by graphical analysis, and obtains thus with the information of other upper garments of the same brand of described upper garment etc. as related information.
Above, the information processing method of having described the embodiment of the present invention in conjunction with Fig. 2 is determined handling object and is obtained accordingly the concrete example of the operation of related information.
The definite operation that sends object of information processing method of the embodiment of the present invention is described in connection with several typical scenes below.
In the first scene, the second user B of the first user A of the first electronic equipment and the second electronic equipment is carrying out voice communication.In the communication process of first user A and the second user B, first user A mentions " I like eating ice cream ".The voice communication information that comprises foregoing is sent to server by described the first electronic equipment.
The server of the information processing method of the application embodiment of the present invention is after receiving the described communication information, the above-mentioned communication information is carried out to semanteme identification, determine that handling object is " ice cream ", and will be defined as targeted customer to the interested first user A of described handling object " ice cream ".After this, described server from the user profile (wherein inclusion relation information) of stored first user A, for example, is determined the good friend user C of first user A, and described user C is defined as sending object.
Next, described server is analyzed described handling object " ice cream ", to obtain the related information associated with described handling object, the information of the brand of such as ice cream salable, price, selling spot etc., and described related information is sent to described transmission object C, be for example sent to account that described user C is corresponding etc.Described user C, for example can be according to described related information to first user A gifts etc. after receiving described related information.
Thus, in the information processing method of this embodiment of the present invention, can utilize the described communication information to produce the information that communication user one side clearly represents interest, and described information is offered to the user with described communication user with particular kind of relationship, thereby this user with particular kind of relationship for example can meet according to described information the hobby of described communication user easily.
With the hobby that needs to guess described communication user in prior art, even or the hobby of knowing described communication user also needs to collect voluntarily the information that described hobby is relevant and compares, the information processing method of the embodiment of the present invention provides a kind of new mode of utilizing the communication information, take full advantage of the value of the communication information, greatly simplify user's operation, save user's time, enriched user's experience.
In the second scene, the second user B of the first user A of the first electronic equipment and the second electronic equipment is carrying out video communication.In the communication process of first user A and the second user B, first user A clicks the region of the upper garment of the second user B on video pictures, and mention " C necessarily likes this part clothes ", user that " C " wherein is for example familiar with for first user A, store equally user profile at described server place.Described user profile for example comprises the mark of user C, as the name of user C " C ".The video communication information that comprises foregoing (and trace information of the gesture operation of possible user A) is sent to server by described the first electronic equipment.
The server of information processing method of the application embodiment of the present invention, after receiving the described communication information, comprises to the video information in the above-mentioned communication information processing that image as above is cut apart etc., determines that handling object is the upper garment of the second user B.On the other hand, described server carries out audio identification to the audio-frequency information in the above-mentioned communication information, identify in the described communication information and comprise the content corresponding to mark " C " of storing with it, determine and send object based on this mark thus, for example, the 3rd user C is defined as sending object.
Next, described server is analyzed the upper garment of described the second user B, to obtain the related information associated with described upper garment, the brand of such as described upper garment, price, selling spot or with the information of upper garment of other brands of the identical style of described upper garment etc., and described related information is sent to described transmission object C, be for example sent to outside mailbox that described user C is corresponding etc.
In the information processing method of this embodiment of the present invention, can utilize the described communication information, for example produce the involved interested information of non-communication user possibility of communication user, and described information is offered to described non-communication user, thereby this non-communication user for example can meet according to described information the wish of oneself easily.
To in prior art, need user to collect voluntarily the information that described hobby is relevant to compare, the information processing method of the embodiment of the present invention provides a kind of new mode of utilizing the communication information, take full advantage of the value of the communication information, greatly simplify user's operation, save user's time, enriched user's experience.
In the 3rd scene, the second user B of the first user A of the first electronic equipment and the second electronic equipment is carrying out video communication.Same with above-mentioned the second scene, in the communication process of first user A and the second user B, first user A clicks the region of the upper garment of the second user B on video pictures, and mention " C necessarily likes this part clothes ", user that " C " wherein is for example familiar with for first user A, store equally user profile at described server place.Described user profile for example comprises the mark of user C, as the name of user C " C ".The video communication information that comprises foregoing (and trace information of the gesture operation of possible user A) is sent to server by described the first electronic equipment.
With above-mentioned same, described server determines that handling object is the upper garment of the second user B, and obtain the related information associated with described upper garment, the brand of such as described upper garment, price, selling spot or with the information of upper garment of other brands of the identical style of described upper garment etc.
In addition,, with above-mentioned same, described server identifies equally in the described communication information and comprises the content corresponding to mark " C " of storing with it, determines and sends object thus based on this mark.But from different in above-mentioned the second scene, described server is not defined as sending object by described the 3rd user C.Alternatively, described server from the user profile (wherein inclusion relation information) of the 3rd stored user C, for example, is determined the good friend user D of the 3rd user C, and described user D is defined as sending object.
Thus, described server is for example sent to described related information described transmission object D, for example, be sent to phone number that described user D is corresponding etc.
In the information processing method of this embodiment of the present invention, can utilize the described communication information, for example produce the involved interested information of non-communication user possibility of communication user, and described information is offered to other users with described non-communication user with particular kind of relationship, thereby described other users for example can meet according to described information the wish of described non-communication user easily.
With the hobby that needs to guess described non-communication user in prior art, even or the hobby of knowing described non-communication user also needs to collect voluntarily the information that described hobby is relevant and compares, the information processing method of the embodiment of the present invention provides a kind of new mode of utilizing the communication information, take full advantage of the value of the communication information, greatly simplify user's operation, save user's time, enriched user's experience.
The information processing method of the embodiment of the present invention has been described above.
The messaging device of the embodiment of the present invention is described with reference to Fig. 3 below.
The messaging device of the embodiment of the present invention is applied to server.As shown in Figure 3, the messaging device 300 of the embodiment of the present invention comprises: receiving element 301, determining unit 302, analytic unit 303 and transmitting element 304.
Particularly, described receiving element 301 is in the process that the first electronic equipment and the second electronic equipment communicate, and at least one from described the first electronic equipment and described the second electronic equipment receives the communication information that described signal post produces.Described determining unit 302, based on the described communication information, is determined handling object and is sent object.Described analytic unit 303 is analyzed described handling object, to obtain the related information being associated with described handling object.Described related information is sent to described transmission object by described transmitting element 304.
In one embodiment, described server, for the each user of the multiple users including the first user of described the first electronic equipment and the second user of described the second electronic equipment, stores the relation information that represents the relation between described each user and other users.
Described determining unit 302 comprises: targeted customer's determining unit, based on the described communication information, from described multiple users, determine targeted customer; Relation information acquiring unit, obtains described targeted customer's relation information; And send object determining unit, based on described targeted customer's relation information, determine the user who meets predetermined condition with described targeted customer's relation, as described transmission object.
In another embodiment, store multiple users' user profile in described server, described user profile at least comprises user's mark.
Described determining unit 302 comprises: mark judging unit, based on the described communication information, judges whether to exist the mark of mating with the described communication information; And send object determining unit, in the time that judgement exists the mark of mating with the described communication information, determine described transmission object based on described mark.
In another embodiment, described communication at least comprises voice communication, and described mark judging unit comprises: audio identification unit, carries out audio identification to the communication information of described voice communication, to judge whether the described communication information mates with one of multiple marks.
In another embodiment, described communication at least comprises voice communication, and described determining unit 302 comprises: communication information analytic unit, carries out semantic analysis to the communication information of described voice communication, to determine transmission object.
In another embodiment, described communication at least comprises textcommunication, and described determining unit 302 comprises: communication information analytic unit, carries out text analyzing to the communication information of described textcommunication, to determine transmission object.
In another embodiment, described server stores has the user profile of the multiple users including the first user of described the first electronic equipment and the second user of described the second electronic equipment.Described communication information analytic unit comprises: targeted customer's determining unit, the described communication information is analyzed, and will be defined as targeted customer for the interested user of described handling object; And send object determining unit, based on described targeted customer's user profile, determine described transmission object.
In another embodiment, described communication at least comprises video communication, the information that the described communication information comprises video pictures.Described determining unit 302 comprises: trace information receiving element, receive the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation; And handling object determining unit, based on described input trajectory information, determine handling object.
In another embodiment, described communication at least comprises video communication, the information that the described communication information comprises video pictures.Described determining unit 302 comprises: cutting unit, carries out image recognition to described video pictures, so that described tableaux is divided into multiple regions; Target area determining unit based on preassigned, is determined target area from described multiple regions; And handling object determining unit, based on described target area, determine described handling object.
In another embodiment, described communication at least comprises video communication, the information that the described communication information comprises dynamic menu.Described determining unit 302 also comprises: action recognition unit, described dynamic menu is identified to the specific action made from the object identifying in described dynamic menu in described communication process; And handling object determining unit, based on described specific action, determine described handling object.
In another embodiment, described communication at least comprises voice communication.Described determining unit 302 comprises: audio identification unit, carries out audio identification to the communication information of described voice communication, to determine handling object.
In another embodiment, described determining unit 302 also comprises: candidate target determining unit, based on the described communication information, determine multiple candidate targets; Candidate target transmitting element, is sent at least one in described the first electronic equipment and described the second electronic equipment by described multiple candidate targets; Select information receiving unit, receive described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target; And handling object determining unit, based on described selection information, selected described at least one candidate target is defined as to described handling object.
The messaging device of the embodiment of the present invention has been described above.According in the messaging device of the embodiment of the present invention, the communication information producing based on described signal post is determined handling object and is sent object, obtains the related information associated with described handling object, and described related information is sent to described transmission object.
Therefore, by the messaging device of the embodiment of the present invention, can utilize the communication information producing in communication process, thus except realize communication objective, can also further promote the using value of communication, greatly enriched user's experience.
More specifically, in the messaging device of the embodiment of the present invention, can utilize the described communication information, for example produce the user who relates in communication and clearly represent interest or the interested information of possibility, and described information is offered to described user or has the user of particular kind of relationship with described user, thereby a kind of new mode of utilizing the communication information is provided, takes full advantage of the value of the communication information, greatly enriched user's experience.
In addition,, because the messaging device of the embodiment of the present invention is applied to server side, therefore, in the case of the disposal ability of electronic equipment side is limited, the messaging device of the embodiment of the present invention can alleviate the processing load of electronic equipment side, thereby particularly favourable.
Above, described according to the information processing method of the embodiment of the present invention and messaging device referring to figs. 1 through Fig. 3.
It should be noted that, in this manual, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
In addition, it should be noted that, in this manual, the statement of similar " first ... unit ", " second ... unit " is only for convenient differentiation in the time describing, and and do not mean that it must be embodied as two or more unit of physical separation.In fact, as required, described unit can entirety be embodied as a unit, also can be implemented as multiple unit.
Finally, also it should be noted that, above-mentioned a series of processing not only comprise the processing of carrying out by time series with order described here, and comprise processing parallel or that carry out respectively instead of in chronological order.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add essential hardware platform by software and realize, and can certainly all implement by hardware.Based on such understanding, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the present invention or embodiment.
In embodiments of the present invention, units/modules can realize with software, to carried out by various types of processors.For instance, the executable code module of a mark can comprise one or more physics or the logical block of computer instruction, and for instance, it can be built as object, process or function.However, the executable code of institute's identification module is without being physically located in together, but can comprise the different instruction on being stored in coordination not, and in the time combining in these command logics, its Component units/module and realize the regulation object of this units/modules.
In the time that units/modules can utilize software to realize, consider the level of existing hardware technique, so units/modules that can realize with software, in the situation that not considering cost, those skilled in the art can build corresponding hardware circuit and realize corresponding function, and described hardware circuit comprises conventional ultra-large integrated (VLSI) circuit or gate array and the existing semiconductor such as logic chip, transistor or other discrete element.Module can also be used programmable hardware device, realizations such as field programmable gate array, programmable logic array, programmable logic device.
Above the present invention is described in detail, has applied specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.