Summary of the invention
The embodiment of the present application proposes the method and apparatus for pushed information.
In a first aspect, the embodiment of the present application provides a kind of method for pushed information, comprising: in response to detecting useInclude video information in the page of family browsing, obtains the facial image of above-mentioned user；Identify the table of user in above-mentioned facial imageFeelings；Based on the expression identified, target video information is chosen from above-mentioned video information；Push the phase of above-mentioned target video informationClose information.
In some embodiments, above-mentioned video information includes label information；And it is above-mentioned based on the expression identified, from upperIt states and chooses target video information in video information, comprising: determine the type of the expression identified；Determine in above-mentioned label information withThe matched label information of the above-mentioned type；Using video information belonging to matched label information as target video information.
In some embodiments, the above method further include: identify the age of user in above-mentioned facial image；And above-mentioned baseIn the expression identified, target video information is chosen from above-mentioned video information, comprising: according to the age of user and is identifiedExpression, choose target video information from above-mentioned video information.
In some embodiments, the above method further include: in video display process, obtain an at least spectators at leastOne facial image；Expression Recognition is carried out to an above-mentioned at least facial image；According to Expression Recognition as a result, generating above-mentioned videoViewing information.
In some embodiments, the above method further include: in response to including present count in the above-mentioned Expression Recognition result of determinationThe expression of a preset kind is measured, pushing video replaces information.
In some embodiments, above-mentioned video information includes video type；And the above-mentioned above-mentioned target video information of pushRelevant information, comprising: in response to determining that video type is that stereoscopic type according to above-mentioned facial image determines whether user wearsWith glasses；In response to determining that user wears glasses, the prompt information for selecting glasses type is pushed.
Second aspect, the embodiment of the present application provide a kind of device for pushed information, comprising: the first image obtains singleMember is configured in response in the page for detecting user's browsing include video information, obtains the facial image of above-mentioned user；TheOne Expression Recognition unit, is configured to identify the expression of user in above-mentioned facial image；Video information selection unit, is configured toBased on the expression identified, target video information is chosen from above-mentioned video information；Relevant information push unit is configured to push awayServe the relevant information for stating target video information.
In some embodiments, above-mentioned video information includes label information；And above-mentioned video information selection unit is into oneStep is configured to: determining the type of the expression identified；Determine in above-mentioned label information with the matched label information of the above-mentioned type；Using video information belonging to matched label information as target video information.
In some embodiments, above-mentioned apparatus further include: age recognition unit is configured to identify in above-mentioned facial imageThe age of user；And above-mentioned video information selection unit is further configured to: according to the age of user and being identifiedExpression chooses target video information from above-mentioned video information.
In some embodiments, above-mentioned apparatus further include: the second image acquisition unit is configured in video display processIn, obtain at least facial image of at least one spectators；Second Expression Recognition unit is configured to above-mentioned at least oneFacial image carries out Expression Recognition；Viewing information generating unit is configured to according to Expression Recognition as a result, generating above-mentioned videoViewing information.
In some embodiments, above-mentioned apparatus further include: replacement information push unit is configured in response to determine above-mentionedIt include the expression of preset quantity preset kind in Expression Recognition result, pushing video replaces information.
In some embodiments, above-mentioned video information includes video type；And above-mentioned relevant information push unit is into oneStep is configured to: in response to determining that video type determines whether user wears eye according to above-mentioned facial image for stereoscopic typeMirror；In response to determining that user wears glasses, the prompt information for selecting glasses type is pushed.
The third aspect, the embodiment of the present application provide a kind of server, comprising: one or more processors；Storage device,One or more programs are stored thereon with, when said one or multiple programs are executed by said one or multiple processors, so thatSaid one or multiple processors realize the method as described in first aspect any embodiment.
Fourth aspect, the embodiment of the present application provide a kind of computer-readable medium, are stored thereon with computer program, shouldThe method as described in first aspect any embodiment is realized when program is executed by processor.
The method and apparatus provided by the above embodiment for pushed information of the application, in the page for detecting user's browsingIt include the facial image of available user after video information in face.Then, the expression of user in facial image is identified.Then,According to the expression identified, target video information is chosen from above-mentioned video information.Finally, pushing above-mentioned target video informationRelevant information.So as to push suitable video to user according to the expression of user, saves user and select suitable videoTime.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouchedThe specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order toConvenient for description, part relevant to related invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phaseMutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 is shown can be using the method for pushed information of the application or the implementation of the device for pushed informationThe exemplary system architecture 100 of example.
As shown in Figure 1, system architecture 100 may include terminal device 101,102,103, network 104 and server 105.Network 104 between terminal device 101,102,103 and server 105 to provide the medium of communication link.Network 104 can be withIncluding various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 101,102,103 and be interacted by network 104 with server 105, to receive or send outSend message etc..Various telecommunication customer end applications can be installed, such as web browser is answered on terminal device 101,102,103With, shopping class application, searching class application, instant messaging tools, mailbox client, social platform software etc..
Terminal device 101,102,103 can be hardware, be also possible to software.When terminal device 101,102,103 is hardWhen part, it can be the various electronic equipments with display screen and supported web page browsing, including but not limited to smart phone, plateComputer, pocket computer on knee and desktop computer, the booking machine of cinema etc..When terminal device 101,102,103When for software, it may be mounted in above-mentioned cited electronic equipment.Its may be implemented into multiple softwares or software module (such asFor providing Distributed Services), single software or software module also may be implemented into.It is not specifically limited herein.
Server 105 can be to provide the server of various services, such as to showing on terminal device 101,102,103Webpage provides the background server supported.Background server the data such as the Webpage request received such as can analyzeProcessing, and processing result (such as relevant information of video information) is fed back into terminal device 101,102,103.
It should be noted that server 105 can be hardware, it is also possible to software.It, can when server 105 is hardwareTo be implemented as the distributed server cluster that multiple servers form, individual server also may be implemented into.When server 105 isWhen software, multiple softwares or software module (such as providing Distributed Services) may be implemented into, also may be implemented into singleSoftware or software module.It is not specifically limited herein.
It should be noted that the method provided by the embodiment of the present application for pushed information is generally held by server 105Row, correspondingly, the device for pushed information is generally positioned in server 105.
It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization needIt wants, can have any number of terminal device, network and server.
With continued reference to Fig. 2, the process of one embodiment of the method for pushed information according to the application is shown200.The method for pushed information of the present embodiment, comprising the following steps:
Step 201, include video information in the page in response to detecting user's browsing, obtain the facial image of user.
It in the present embodiment, can be with for the executing subject of the method for pushed information (such as server 105 shown in FIG. 1)The mark (such as network address) of the page of user's browsing is obtained by wired connection mode or radio connection to determine userThe page of browsing.Then detect in the above-mentioned page whether include at least one video video information.The above-mentioned page can be endThe page shown by the booking application installed on end or booking machine.The above-mentioned page may include video information, above-mentioned videoInformation may include film information.Executing subject includes available use after video information in the page for determining user's browsingThe facial image at family.Specifically, executing subject can send image capture instruction to the image collecting device for communicating with connection,Acquire the facial image of user.Or image capture instruction is sent to terminal, terminal utilizes connected image collecting device to adoptCollect the facial image of user.
It should be pointed out that above-mentioned radio connection can include but is not limited to 3G/4G connection, WiFi connection, bluetoothConnection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection and other currently known or exploitations in the futureRadio connection.
Step 202, the expression of user in facial image is identified.
After obtaining facial image, executing subject can carry out Expression Recognition to facial image, obtain the expression of user.It canWith understanding, Expression Recognition is existing technology, and details are not described herein again.The type of the expression of user may include glad, sadWound, pain etc..
Step 203, based on the expression identified, target video information is chosen from video information.
Executing subject can choose target video information from above-mentioned video information based on the expression of user.For example, userExpression be sadness, then executing subject can choose the video information made laughs as target video information from video information.
In some optional implementations of the present embodiment, video information includes label information.Above-mentioned label information is usedIn description video.For example, above-mentioned label information can be make laughs, comedy, suspense, science fiction, military affairs etc..Above-mentioned steps 203 haveBody can be realized by following steps unshowned in Fig. 2: determine the type of the expression identified.Determine in label information withThe matched label information of the above-mentioned type.Using video information belonging to matched label information as target video information.
In this implementation, executing subject can determine the type of the expression of user first.Then, by the above-mentioned type and markLabel information is matched.Matching herein can refer to type and label information is near synonym or type and label information packetThe quantity for including identical character is greater than preset value etc..Executing subject can make video information belonging to matched label informationFor target video information.
In some optional implementations of the present embodiment, video information includes image.Executing subject can also pass throughUnshowned following steps determine target video information in Fig. 2: determining whether the image for including in video information includes faceImage.Include face in response to the above-mentioned image of determination, Expression Recognition is carried out to above-mentioned face, determines the class of the expression of above-mentioned faceType.Video information that type identical with the type of the expression of user is corresponding is as target video information.
In this implementation, above-mentioned image can be the propagating poster of film.Under normal circumstances, on the propagating poster of filmIt will include the image for the role that performer is played in play.Executing subject can carry out expression knowledge to the face in above-mentioned imageNot.It, will be above-mentioned when the expression of performer is identical as the expression of user in determining some or the propagating poster of multiple video informationsOne or more video informations are as target video information.
In some optional implementations of the present embodiment, the above method can further include in Fig. 2 and be not shownFollowing steps: identification facial image in user age.
In this implementation, executing subject can identify the age of user in facial image by various modes, for example,The age of user is identified by convolutional neural networks.
Correspondingly, above-mentioned steps 203 can specifically be realized by following steps unshowned in Fig. 2: according to user'sAge and the expression identified, choose target video information from video information.
Executing subject, can age with reference to user and expression when determining target video information.For example, when holdingWhen row main body identifies that the age of user is children, then can be determined first from video information the video information of cartoon class forSelect video information.Then according to the expression of children, target video information is chosen from above-mentioned video information to be selected.
Step 204, the relevant information of target video information is pushed.
Executing subject can push the phase of target video after target video information has been determined to terminal used by a userClose information.Herein, relevant information can refer to information relevant to video information.For example, relevant information can be with target videoInformation includes identical video name, or can include identical actor names with target video information.It is electricity with video informationIllustrate for shadow information, relevant information can be the titbit, film clips, theme song video of film, can also be same director'sOther films and television programs can also be at least film of at least one performer including the film.
In some optional implementations of the present embodiment, above-mentioned video information includes video name, actor names, leadsDrill name.Executing subject can determine the relevant information of target video information by following steps unshowned in Fig. 2: pre-If relevant set of information in determine at least one phase with video name in target video information, actor names, director namesRelevant information of the same relevant information as target video information.
In this implementation, the relevant video of target video information can will be pushed, guidance user selects associated film.
With continued reference to the signal that Fig. 3, Fig. 3 are according to an application scenarios of the method for pushed information of the present embodimentFigure.In the application scenarios of Fig. 3, user passes through the film booking application-browsing booking page installed in mobile phone.On the booking pageIncluding multiple film informations shown, including film information AAA and film information BBB.At this point, the front camera of mobile phoneAcquire the facial image of user.And facial image is sent to server.Server identifies the type of the expression of user for compassionWound, then it is target video information that film information BBB is selected from film information.Then, to mobile phone push film information BBB'sCamera titbits and film clips.
In some optional implementations of the present embodiment, above-mentioned video information includes video type.Video type is usedIn indicate video whether be three-dimensional (3D, 3Dimensions) type video.Above-mentioned steps 203 specifically can by Fig. 2 notThe following steps shown are realized: in response to determining that video type is that stereoscopic type determines whether user wears according to facial imageWith glasses；In response to determining that user wears glasses, the prompt information for selecting glasses type is pushed.
This implementation can be applied in film ticket purchase scene, if executing subject determines that video type is 3D classType, executing subject can determine whether the face in facial image wears glasses.Executing subject can determine face figure firstWhether the characteristic point of human eye as in, then determining has the characteristic point of glasses around the characteristic point of human eye.If there is, it is determined that userWith glasses.If it is determined that user wears glasses, the prompt information for selecting glasses type is pushed.Above-mentioned prompt informationThe 3D glasses that can be used for that user is prompted to select clip type, can be used for prompt cinema is the 3D eye that user prepares clip typeMirror.
The method provided by the above embodiment for pushed information of the application is wrapped in the page for detecting user's browsingAfter including video information, the facial image of available user.Then, the expression of user in facial image is identified.Then, according to knowledgeNot Chu expression, choose target video information from above-mentioned video information.Finally, pushing the related letter of above-mentioned target video informationBreath.So as to push suitable video to user according to the expression of user, the time that user selects suitable video is saved.
With continued reference to Fig. 4, it illustrates the streams according to another embodiment of the method for pushed information of the applicationJourney 400.As shown in figure 4, the method for the present embodiment can with the following steps are included:
Step 401, in video display process, at least facial image of at least one spectators is obtained.
In the present embodiment, in video display process, executing subject can also control the Image Acquisition for communicating connectionDevice acquires at least facial image of at least one spectators.Above-mentioned image collecting device can be more in video display processThe facial image of secondary acquisition spectators.It is understood that showing the page in the device of broadcasting video and embodiment illustrated in fig. 2 hereinDevice can not be identical.Spectators herein can be identical as the user in embodiment illustrated in fig. 2, can also be different.
Step 402, Expression Recognition is carried out to an at least facial image.
Executing subject can carry out Expression Recognition to it after getting an above-mentioned at least facial image.It obtains at leastThe expression of at least one face, obtains Expression Recognition result in one facial image.Above-mentioned Expression Recognition result may include tableThe type of feelings, such as laugh, smile, shed tears, frown etc..
Step 403, according to Expression Recognition as a result, generating the viewing information of video.
Executing subject is obtaining Expression Recognition as a result, the viewing information of video can be generated.Above-mentioned viewing information can wrapInclude the statistical result of expression.Such as may include laugh 3 times, smile it is 2 inferior.
Step 404, in response to determining the expression in Expression Recognition result including preset quantity preset kind, pushing videoReplace information.
Executing subject can push away if it is determined that including the expression of preset quantity preset kind in above-mentioned Expression Recognition resultVideo is sent to replace information.For example, executing subject can determine whether the number frowned for including in above-mentioned Expression Recognition result surpassesIt crosses 10 times, if it exceeds 10 times, then pushing video replaces information.Video replacement information can be used for prompting the user whether needing moreChange the video for needing to play.
The method provided by the above embodiment for pushed information of the application can acquire use in video display processThe facial image at family, and viewing information and pushing video replacement information are generated according to the expression of user.WithoutUser is manually entered viewing information；User can also be prompted to replace video when judging that user does not like currently playing video,Improve user experience.
With further reference to Fig. 5, as the realization to method shown in above-mentioned each figure, this application provides one kind for pushing letterOne embodiment of the device of breath, the Installation practice is corresponding with embodiment of the method shown in Fig. 2, which can specifically answerFor in various electronic equipments.
As shown in figure 5, the device 500 for pushed information of the present embodiment includes: the first image acquisition unit 501,One Expression Recognition unit 502, video information selection unit 503 and relevant information push unit 504.
First image acquisition unit 501 is configured in response to include video information in the page for detecting user's browsing,Obtain the facial image of user.
First Expression Recognition unit 502, is configured to identify the expression of user in facial image.
Video information selection unit 503 is configured to choose target video from video information based on the expression identifiedInformation.
Relevant information push unit 504 is configured to push the relevant information of target video information.
In some optional implementations of the present embodiment, video information includes label information.Video information is chosen singleMember 503 can be further configured to: determine the type of the expression identified；It determines matched with the above-mentioned type in label informationLabel information；Using video information belonging to matched label information as target video information.
In some optional implementations of the present embodiment, device 500 can further include unshowned in Fig. 5Age recognition unit is configured to identify the age of user in the facial image.Correspondingly, video information selection unit 503It is further configured to: according to the age of user and the expression identified, target video information is chosen from video information.
In some optional implementations of the present embodiment, device 500 can further include unshowned in Fig. 5Second image acquisition unit, the second Expression Recognition unit and viewing information generating unit.
Second image acquisition unit, is configured in video display process, obtains at least one of at least one spectatorsFacial image.
Second Expression Recognition unit is configured to carry out Expression Recognition to an above-mentioned at least facial image.
Viewing information generating unit is configured to according to Expression Recognition as a result, generating the viewing information of video.
In some optional implementations of the present embodiment, device 500 can further include unshowned in Fig. 5Information push unit is replaced, is configured in response to determine the table in Expression Recognition result including preset quantity preset kindFeelings, pushing video replace information.
In some optional implementations of the present embodiment, video information includes video type.Relevant information push is singleMember 504 can be further configured to: in response to determining that video type determines that user is according to facial image for stereoscopic typeIt is no to wear glasses；In response to determining that user wears glasses, the prompt information for selecting glasses type is pushed.
The device provided by the above embodiment for pushed information of the application wraps in the page for detecting user's browsingAfter including video information, the facial image of available user.Then, the expression of user in facial image is identified.Then, according to knowledgeNot Chu expression, choose target video information from above-mentioned video information.Finally, pushing the related letter of above-mentioned target video informationBreath.So as to push suitable video to user according to the expression of user, the time that user selects suitable video is saved.
It should be appreciated that the unit 501 for recording in the device 500 of pushed information is to unit 504 respectively and in reference Fig. 2Each step in the method for description is corresponding.As a result, above with respect to the operation and feature of the method description for pushed informationIt is equally applicable to device 500 and unit wherein included, details are not described herein.
Below with reference to Fig. 6, it illustrates the computer systems 600 for the server for being suitable for being used to realize the embodiment of the present applicationStructural schematic diagram.Server shown in Fig. 6 is only an example, should not function and use scope band to the embodiment of the present applicationCarry out any restrictions.
As shown in fig. 6, computer system 600 includes central processing unit (CPU) 601, it can be read-only according to being stored inProgram in memory (ROM) 602 or be loaded into the program in random access storage device (RAM) 603 from storage section 608 andExecute various movements appropriate and processing.In RAM 603, also it is stored with system 600 and operates required various programs and data.CPU 601, ROM 602 and RAM 603 are connected with each other by bus 604.Input/output (I/O) interface 605 is also connected to alwaysLine 604.
I/O interface 605 is connected to lower component: the importation 606 including keyboard, mouse etc.；It is penetrated including such as cathodeThe output par, c 607 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage section 608 including hard disk etc.；And the communications portion 609 of the network interface card including LAN card, modem etc..Communications portion 609 via such as becauseThe network of spy's net executes communication process.Driver 610 is also connected to I/O interface 605 as needed.Detachable media 611, such asDisk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 610, in order to read from thereonComputer program be mounted into storage section 608 as needed.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart descriptionSoftware program.For example, embodiment of the disclosure includes a kind of computer program product comprising carrying is on a machine-readable mediumComputer program, which includes the program code for method shown in execution flow chart.In such implementationIn example, which can be downloaded and installed from network by communications portion 609, and/or from detachable media 611It is mounted.When the computer program is executed by central processing unit (CPU) 601, limited in execution the present processes upperState function.
It should be noted that computer-readable medium described herein can be computer-readable signal media orComputer readable storage medium either the two any combination.Computer readable storage medium for example can be --- butBe not limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.The more specific example of computer readable storage medium can include but is not limited to: have one or more conducting wires electrical connection,Portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only depositReservoir (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memoryPart or above-mentioned any appropriate combination.
In this application, computer readable storage medium can be any tangible medium for including or store program, the journeySequence can be commanded execution system, device or device use or in connection.And in this application, it is computer-readableSignal media may include in a base band or as carrier wave a part propagate data-signal, wherein carrying computer canThe program code of reading.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal, optical signal orAbove-mentioned any appropriate combination.Computer-readable signal media can also be any other than computer readable storage mediumComputer-readable medium, the computer-readable medium can send, propagate or transmit for by instruction execution system, device orPerson's device uses or program in connection.The program code for including on computer-readable medium can be with any appropriateMedium transmission, including but not limited to: wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The calculating of the operation for executing the application can be write with one or more programming languages or combinations thereofMachine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C++, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code canFully to execute, partly execute on the user computer on the user computer, be executed as an independent software package,Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part.In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN)Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet serviceProvider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the application, method and computer journeyThe architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generationA part of one module, program segment or code of table, a part of the module, program segment or code include one or more useThe executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in boxThe function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actuallyIt can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuseMeaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holdingThe dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instructionCombination realize.
Being described in unit involved in the embodiment of the present application can be realized by way of software, can also be by hardThe mode of part is realized.Described unit also can be set in the processor, for example, can be described as: a kind of processor packetInclude the first image acquisition unit, the first Expression Recognition unit, video information selection unit and relevant information push unit.Wherein,The title of these units does not constitute the restriction to the unit itself under certain conditions, for example, relevant information push unit is alsoIt can be described as " pushing the unit of the relevant information of the target video information ".
As on the other hand, present invention also provides a kind of computer-readable medium, which be can beIncluded in device described in above-described embodiment；It is also possible to individualism, and without in the supplying device.Above-mentioned calculatingMachine readable medium carries one or more program, when said one or multiple programs are executed by the device, so that shouldDevice: include video information in the page in response to detecting user's browsing, obtain the facial image of the user；Identify faceThe expression of user in image；Based on the expression identified, target video information is chosen from video information；Push target video letterThe relevant information of breath.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the artMember is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristicScheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent featureAny combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed hereinCan technical characteristic replaced mutually and the technical solution that is formed.