CN113032605A - Information display method, device and equipment and computer storage medium - Google Patents

Abstract

The invention discloses an information display method, an information display device, information display equipment and a computer storage medium. The method comprises the following steps: respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area; determining a target user according to TOF information and image information of a plurality of users; determining at least one first target information according to the image information of the target user; and displaying at least one first target information. The target user is determined through the TOF information and the image information of the user, targeted target information is provided for the target user according to the image information of the target user, and the pertinence of information display is improved.

Description

Information display method, device and equipment and computer storage medium

Technical Field

The invention belongs to the field of information display, and particularly relates to an information display method, an information display device, information display equipment and a computer storage medium.

Background

The existing information display mode is roughly divided into two modes, one is a fixed content mode, and the display information is pasted or directly printed on carriers such as bulletin boards and the like through paper in the mode; the other is electronic type, and the display information is statically or rollably displayed through a display or a projector. The current information display is randomly displayed for users and has no pertinence.

The advertisement is a relatively representative type in the aspect of information display, the advertisement refers to a medium for transmitting advertisement information, most of the existing advertisements display contents to random users, and the method is not targeted and cannot attract the interests of viewers. Such advertisements occupy a large number of positions but cannot achieve a good advertising effect, which causes resource waste.

Therefore, how to improve the pertinence of information presentation becomes a problem to be solved.

Disclosure of Invention

The embodiment of the invention provides an information display method, an information display device, information display equipment and a computer storage medium, and aims to solve the problem that the display information of the current advertisement is not high in pertinence.

In a first aspect, the present application provides an information display method applied to an information display device, the method including: respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area; determining a target user according to TOF information and image information of a plurality of users; determining at least one first target information according to the image information of the target user; and displaying at least one first target information.

The information display equipment is used for displaying target information.

In one possible implementation, after presenting the at least one first objective information, the method further comprises: receiving a target action input of a target user; second target information is determined from the at least one first target information according to the target motion input.

In one possible implementation, determining at least one first target information according to the image information of the target user includes: determining a characteristic label of a target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.

In one possible implementation, determining the target user according to TOF information and image information of a plurality of users includes:

determining moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.

In one possible implementation, determining the target user from the TOF information and the image information of each user includes:

determining face information of each user according to the TOF information and the image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.

In one possible implementation, in the case that the number of the first users is at least two, the distances between the at least two first users and the information presentation device are respectively determined; taking the first user as a target user, specifically comprising: and determining the first user corresponding to the distance meeting the preset condition as the target user.

In one possible implementation, receiving a target action input of a target user includes: acquiring TOF information of the whole outline area of a target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.

In one possible implementation, determining second target information from the at least one first target information according to the target action input includes: determining a user instruction according to the target action input of the target user; and determining second target information from the at least one first target information according to the user instruction.

In one possible implementation, after determining the target user from the TOF information and the image information of the plurality of users, the method further comprises: acquiring TOF information of a target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.

In one possible implementation, obtaining TOF information of the target user overall contour region includes: receiving initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.

In a second aspect, an embodiment of the present invention provides an information displaying apparatus, where the apparatus includes: the acquisition module is used for respectively acquiring the TOF information and the image information of the flight time of a plurality of users in a preset area; the first determining module is used for determining a target user according to TOF information and image information of a plurality of users; the second determining module is used for determining at least one first target information according to the image information of the target user; and the display module is used for displaying at least one piece of first target information.

In a third aspect, an embodiment of the present invention provides a computing device, where the device includes: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the processing methods as provided by embodiments of the present invention.

In a fourth aspect, an embodiment of the present invention provides a computer storage medium, where computer program instructions are stored, and when the computer program instructions are executed by a processor, the computer program instructions implement the processing method provided by the embodiment of the present invention.

According to the information display method, the information display device, the information display equipment and the computer storage medium, the target user is determined through the TOF information and the image information of the user, and the targeted information with pertinence is provided for the target user according to the image information of the target user, so that the pertinence of information display is improved, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of an information displaying method according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of an interactive advertisement device according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a resource pool system according to an embodiment of the present invention;

FIG. 4 is a block diagram of a program system according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of another interactive advertisement device provided by the embodiment of the present invention;

fig. 6 is a schematic structural diagram of an information display apparatus according to an embodiment of the present invention;

fig. 7 is a schematic diagram of an exemplary hardware architecture provided by an embodiment of the present invention.

Detailed Description

Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The existing information display methods are roughly divided into two types, one is a fixed content type, and the other is an electronic type. The current information display is randomly displayed for users and has no pertinence. The advertisement is a relatively representative type in the aspect of information display, the advertisement refers to a medium for transmitting advertisement information, most of the existing advertisements are in two forms, one is a fixed content type, and the advertisement content is pasted on carriers such as a billboard through paper or is directly printed on the carriers; the other is electronic type, and the advertisement content is displayed through a display or a projector.

The existing information display (or advertisement) mainly has the following defects: firstly, most of the existing advertisements show the content to random users, and the mode has no pertinence and cannot attract the interest of viewers; secondly, most of the existing advertisements only have the function of outputting information, and only can recommend the advertisement content to the viewer, according to the prior art, the viewer needs to purchase corresponding commodities in other ways, such as mobile phone purchase, telephone order and the like, under most conditions, the popularization rate of the method is low, the viewer can forget the advertisement content after leaving the billboard, the conversion rate is low, additional operation is needed for purchasing in other ways, and the convenience is not provided. Thirdly, most of the existing advertisement contents are single, which easily causes the viewers to feel dislike, thereby reducing the promotion rate of the advertisement and the satisfaction degree of the viewers.

With the rapid development of Artificial Intelligence technology in recent years and the improvement of computer performance, Artificial Intelligence (AI) is used to obtain user characteristics in the field of information display, so that information display can be performed better according to the user characteristics, and the trend is popular.

In order to solve the problem of low pertinence of the current information display, comprehensive judgment can be carried out according to user image information acquired by an image sensor and Time of Flight (TOF) information acquired by TOF equipment, the advantages of the two information acquisition equipment can be fully exerted, user characteristic information with high data rate is obtained, and then the targeted information display based on the user characteristic information is realized. Based on this, the embodiment of the invention provides an information display method.

The information display method provided by the embodiment of the invention is described below.

Fig. 1 is a schematic flow chart of an information display method according to an embodiment of the present invention.

As shown in fig. 1, the information presentation method may include S101-S104, and the method is applied to a server, and specifically as follows:

s101, respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area.

S102, determining target users according to the TOF information and the image information of the multiple users.

S103, determining at least one piece of first target information according to the image information of the target user.

S104, displaying at least one piece of first target information.

According to the information display method, the target user is determined through the TOF information and the image information of the user, and targeted information is provided for the target user according to the image information of the target user, so that the pertinence of information display is improved, and the user experience is improved.

The contents of S101-S104 are described below, respectively:

first, a specific implementation of S101 will be described.

In one embodiment, time of flight TOF information and image information of a plurality of users in a preset area are respectively obtained, wherein the preset area can be a preset area in front of the information display device at a certain distance, and collecting the TOF information and the image information of the users in the preset area can help to judge whether the users are target users to interact.

Next, a specific implementation of S102 is described.

The step of determining the target user according to the TOF information and the image information of the multiple users may include two implementation methods, and the specific implementation manner is as follows.

(1) The step of determining the target user according to the TOF information and the image information of a plurality of users in the embodiment of the invention may include:

determining moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.

According to the TOF information and the image information of a plurality of users, the coordinate corresponding relation between the image information of each user and the TOF information of each user is established, the human body contour of each user in the image information can be judged more accurately, the moving speed of each user is judged, and if the average moving speed of the user in a preset time period is smaller than a preset threshold value, the user can be used as a candidate user of a target user. For example, a user whose average moving speed in the first 2 seconds of the current time is lower than 0.5 m/s is taken as the candidate user for the target user.

(2) The step of determining the target user according to the TOF information and the image information of a plurality of users in the embodiment of the invention may include:

determining face information of each user according to the TOF information and the image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.

According to the TOF information and the image information of the users, the coordinate corresponding relation between the image information of each user and the TOF information is established, and the face information of each user in the image information can be judged more accurately. Face information for each user may be determined based on a pre-trained face recognition model.

The face information here may be face orientation information, and whether or not the user is looking at the information presentation apparatus is judged by the face orientation information of the user, and if the output result of the face recognition model is that the user is looking at the information presentation apparatus, it may be a candidate user of the target user. The face information here may also be user pupil information, and it may be determined whether the user is looking at the information presentation apparatus based on an output result of a pupil recognition model trained in advance, and if the output result is that the user is looking at the information presentation apparatus, it may be used as an alternative user to the target user.

Therefore, through the two implementation methods for determining the target user according to the TOF information and the image information of the multiple users, the target user can be accurately screened from the multiple users, and the pertinence is improved for the information display service provided for the target user subsequently.

For more accurate determination of the target user, after the step of determining the target user at S102, the following steps may be further included:

respectively determining the distances between at least two first users and the information display equipment under the condition that the number of the first users is at least two; taking the first user as a target user, specifically comprising: and determining the first user corresponding to the distance meeting the preset condition as the target user.

If a plurality of alternative users of the target user are determined by the two target user determining modes. That is, if the speed information of a plurality of candidate users meets the preset condition, or the face information of a plurality of candidate users meets the preset condition, the candidate user closest to the information display device is marked as the target user. Therefore, the target user can be determined more accurately, accurate interactive service can be provided for the target user subsequently, and user experience is improved.

In order to improve the effect of information presentation, after the step of determining the target user in S102, the following steps may be further included:

acquiring TOF information of a target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.

Judging the distance between the target user and the information display equipment, judging the signal intensity of the target user through the TOF signal, further judging whether the target user is too far away, inputting an image for guiding the target user to move forwards if the target user is out of the threshold range, and guiding the target to move forwards actively. The image guiding the target user to move forward may be a mini-game or an Augmented Reality (AR) game. The information display equipment is used for displaying target information.

For example, the information presentation device displays an image obtained by a camera, and displays a highlighted circle in an augmented reality manner in an optimal recognition range of the TOF through an AR technology, thereby guiding a target user to actively approach the information presentation device. Therefore, TOF signals of the user can be better captured, more accurate interaction service is provided for the user, and the information display effect can be improved.

Then, a specific implementation of S103 is introduced.

The step of determining at least one first target information according to the image information of the target user in the embodiment of the present invention may include: determining a characteristic label of a target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.

And performing AI portrait according to the image information of the target user to obtain a feature tag of the target user, and determining at least one first target information according to the feature tag of the target user. For example, the target information is commodity information, and the commodity information comprises commodity name information, commodity advertisement image information, commodity classification information and commodity label information; the commodity label information is a characteristic label of the commodity, and comprises applicable people, applicable age, style, color, size information and the like of the commodity.

Therefore, the information highly matched with the characteristics of the target user can be displayed for the target user in a targeted manner according to the characteristics of the target user, and the information display effect is improved.

Next, a specific implementation of S104 will be described.

As an implementation manner of the present application, in order to better display the target information and improve the user experience, after S104, the following steps may be further included: receiving a target action input of a target user; second target information is determined from the at least one first target information according to the target motion input.

The information display device comprises an information display screen, a display screen and a display control unit, wherein the information display screen comprises at least one first target information display unit, the first target information display unit is used for displaying the first target information, the display control unit is used for displaying the first target information on the display screen, and the display control unit is used for controlling the display control unit to display the first target information. The motion input here may be a touch screen motion input, or may be gesture information of the user, for example, if the user compares "OK" with hand, it indicates confirmation.

The step of receiving the target action input of the target user may specifically include: acquiring TOF information of the whole outline area of a target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.

And comparing the acquired TOF signal of the whole contour area of the target user with the TOF signal of the body limb obtained through deep learning to obtain the joint node position of the main target, so that the TOF signal of the local area of the target user can be determined, and the action of the target user is determined in real time according to the TOF signal of the local area of the target user.

For example, the obtained TOF signal of the limb outline of the target user is compared with the TOF signal of the human limb obtained by deep learning to obtain the joint node position of the main target, the arm joint of the main target is identified to obtain the TOF signal of the target arm limb, and the action of the TOF signal of the target arm limb is obtained in real time to obtain the action information of the target arm limb. The interaction operation is mainly carried out according to the gesture action of the target in the subsequent interaction process, and the signal for judging the action of the target limb by the interference in the TOF signal can be filtered in advance through the signal filtering, so that the accuracy of target action input identification can be improved in the subsequent interaction process, the interaction information to be expressed by a user can be received more accurately, and the user experience is improved.

The step of obtaining TOF information of the target user overall contour region may specifically include: receiving initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.

The recognizable range of the TOF equipment is increased by arranging the TOF equipment in the direction far away from the information display equipment, so that the recognition accuracy of the TOF equipment is improved, and the interaction experience of the target is optimized. For example, for an information presentation device working outdoors, a plurality of TOF devices may be arranged in a direction away from the information presentation device, and after signals of all TOF devices are acquired, the signal acquired by the TOF device with the strongest signal may be selected for limb identification of a user. And multiple groups of signals acquired by multiple TOF devices can be weighted to obtain more stable signals. Therefore, the identification accuracy of the TOF equipment can be improved, and the interaction experience of the target is optimized.

The step of determining the second target information from the at least one first target information according to the target action input may specifically include: determining a user instruction according to the target action input of the target user; and determining second target information from the at least one first target information according to the user instruction.

And comparing the target action input of the target user with the preset action information to determine the interactive content information of the target user, namely the user instruction. And if the interactive content information is a switching instruction, switching the currently displayed information on the information display equipment, and if the interactive content information is a confirmation instruction, confirming the currently displayed information on the information display equipment. And the user experience is further improved.

In summary, according to the information display method provided by the embodiment of the invention, the target user is determined through the TOF information and the image information of the user, the targeted target information is provided to the target user according to the image information of the target user, the user action information can be determined according to the TOF information of the target user, and then the target user is interacted with the target user, the target user can switch the target information matched with the target user in the interaction process, the pertinence of information display is improved, and the user experience is improved.

In addition, based on the information display method, an embodiment of the present invention further provides an interactive advertisement device, which is specifically described in detail with reference to fig. 2.

Fig. 2 is a schematic structural diagram of an interactive advertisement device according to an embodiment of the present invention.

As shown in fig. 2, the interactive advertising apparatus may include: processor 200,image input interface 210,TOF device interface 220,image output interface 230,transaction interface 240, audiovisual component interface 250, resource pool system 300,program system 400, andsensor interface 260.

The following are described separately:

and a processor 200 for integrating information output by the constituent elements of the interactive advertising device to perform hierarchical processing.

Animage input interface 210 for inputting image information, the image input interface being capable of connecting to an image acquisition device such as a camera.

ATOF device interface 220 for connecting to a TOF device.

And animage output interface 230 for outputting an image, which can be connected to an image output device such as a display or a projector.

And atransaction interface 240 for connecting to a transaction platform or a shopping platform, wherein the interactive advertisement device can initiate a transaction to the transaction platform through the transaction interface.

And the audio and video component interface 250 is used for connecting the audio and video components and outputting sound information, and can be connected with sound output equipment such as audio and video.

Resource pool system 300 includes a user representation resource pool and a content resource pool. The user portrait resource pool is used for carrying out AI portrait according to the image of the target to obtain a characteristic label of the target; the content resource pool comprises a commodity content resource pool and an interactive content resource pool.

Theprogram system 400 includes a signal acquiring unit, a signal processing unit, a content matching unit, and an interaction control unit.

And asensor interface 260 for connecting a sensor, which may be a distance sensor.

Next, the resource pool system 300 will be described in detail with reference to fig. 3.

As shown in fig. 3, the resource pool system 300 may include: userrepresentation resource pool 310 and content resource pool 320. Content asset pool 320, in turn, includes commodity content asset pool 330 and interactive content asset pool 340.

The following are described separately:

a userportrait resource pool 310, configured to perform AI portrait according to an image of a target to obtain a feature tag of the target; specifically, the user portrait resource pool stores feature image information and feature tag information corresponding thereto.

Content asset pool 320 includes commodity content asset pool 330 and interactive content asset pool 340.

A commodity content resource pool 330 for storing commodity information, wherein the commodity information includes commodity name information, commodity advertisement image information, commodity classification information, and commodity label information; the commodity label information is a characteristic label of the commodity, and comprises applicable people, applicable age, style, color, size information and the like of the commodity.

The interactive content resource pool 340 is used for storing interactive content and interactive information corresponding to the interactive content; the interactive content includes a commodity content switching action, a purchase confirmation action, an interactive game action and the like, and the interactive information is corresponding gesture information and/or image information and the like.

Next, theprogram system 400 will be described in detail with reference to fig. 4.

As shown in fig. 4, theprogram system 400 may include:

the program system comprises: a signal acquisition unit 410, asignal processing unit 420, a signal output unit 430, and an interaction control unit 440.

The signal acquisition unit 410 is first introduced.

A signal acquisition unit 410 for transmitting the video image information and the TOF signal to asignal processing unit 420. The signal acquisition unit 410 includes aguidance interaction unit 411, an image signal acquisition unit 412, and a TOF signal acquisition unit 413.

Theguidance interaction unit 411 is configured to guide the target to adjust the position of the target to a position with better interaction experience, that is, a position with higher identification sensitivity of the TOF device, specifically, the guidance interaction unit acquires image information input by the image signal acquisition unit 412 and a TOF signal input by the TOF signal acquisition unit 413 in real time, determines the distance between the target and the device through the image information, determines whether the target is within a threshold interval in combination with a distance value of the TOF signal, and sends interaction content, which is included in the interaction content resource pool and can guide the target to move to the threshold interval of the optimal identification range of the TOF, to the signal output unit 430 if the target is not within the threshold interval of the optimal identification range of the TOF, so that the signal output unit 430 outputs a corresponding interaction content image to guide the target to actively move to the optimal identification interval of the TOF.

The guidinginteraction unit 411 is further configured to obtain sensor data input by thesensor interface 260 in real time, and if the sensor data reaches a preset threshold interval, send the interaction content of the interaction content resource pool guiding target moving to the optimal identification range threshold interval of the TOF to the signal output unit 430, so that the signal output unit 430 outputs a corresponding interaction content image to guide the target to actively move to the optimal identification interval of the TOF.

The guidinginteraction unit 411 is specifically configured to attract the attention of the target through an interaction means, and actively guide the target to an interaction area; the popularization rate of the advertisement is improved; specifically, the guiding interaction unit judges the distance between the target and the device through image information, judges the signal intensity of the target through TOF signals, further judges whether the target is too far away, and inputs an image for guiding the target to move forward if the target is out of a threshold range, so as to guide the target to move forward actively; the image guiding the forward movement of the target may be a mini game or an AR game; for example, the advertising device displays an image obtained by a camera, displays a highlighted circle in an augmented reality manner at an optimal recognition range of TOF by AR technology, and thus guides the target to actively move to the optimal recognition range of TOF.

The back and the side of the interactive advertising device are not in an interactive range, so that distance sensors are arranged on the back and the side of the interactive advertising device and are connected with the processor through thesensor interface 260, theguide interaction unit 411 obtains parameters output by the distance sensors, when a person approaches, sound information is output through the loudspeaker 251 to attract the attention of a target, the guide target actively moves to an interaction area, the popularization rate of the advertising device can be improved, and the interactive experience of participants is improved.

And an image signal acquiring unit 412, configured to acquire video image information input by the image input interface in real time.

And the TOF signal acquisition unit 413 is used for acquiring the TOF signal input by the TOF equipment interface in real time.

The TOF signal acquiring unit 413 further includes a TOF signal selecting unit 414, where the TOF signal selecting unit 414 is used for determining a trusted TOF device when the TOF device is connected to multiple TOF devices through interfaces, and specifically, the TOF signal selecting unit acquires TOF signals input by all TOF devices and removes TOF signals with weak signals and long target distances.

Thesignal processing unit 420 is described next.

And thesignal processing unit 420 is used for processing signals and sending the commodity list to the signal output unit. Thesignal processing unit 420 includes a user profile unit 421, a signal filtering unit 422, and a content matching unit 423.

The user portrait unit 421 is configured to obtain the video image information output by the signal obtaining unit, and compare the image information with the image information in the user portrait resource pool to obtain a matched user feature tag.

And the signal filtering unit 422 is configured to filter the TOF signal in combination with the video image information output by the image signal acquiring unit to obtain the motion information of the target arm limb.

The signal filtering unit 422 is used for filtering TOF signals, and specifically comprises a main target filtering unit 4221 and alimb filtering unit 4222.

The main target filtering unit 4221 is configured to filter signals other than the target signal in the TOF signal, specifically, the main target filtering unit obtains the image signal output by the image signal obtaining unit and the TOF signal output by the TOF signal obtaining unit, establishes a coordinate corresponding relationship between the image signal and the TOF signal, determines a human body contour in the image signal, and determines a moving speed of the human body contour, if its average moving speed of the last 2 seconds is lower than 0.5 meters per second, the object closest to the device is marked as the primary object if a plurality of human body contours are satisfied, and obtaining a limb contour signal of a main target in the TOF signal through the coordinate corresponding relation between the image signal and the TOF signal, removing other signals except the limb contour signal of the main target, only reserving the limb contour signal of the main target, and outputting the limb contour signal of the main target to a limb filtering unit.

Thelimb filtering unit 4222 is used for filtering other signals except for the arm limb signal in the limb contour signal; specifically, the TOF signals of the human body limbs, recorded by the limb filtering unit and obtained through deep learning, comprise position information of human body joint nodes, the TOF signals of the limb outline of the main target are obtained by the limb filtering unit, the TOF signals of the human body limbs, obtained through deep learning, are compared with the TOF signals of the human body limbs to obtain the joint node positions of the main target, arm joints of the human body limbs are identified to obtain the TOF signals of the target arm limbs, and the action of the TOF signals of the target arm limbs is obtained in real time to obtain action information of the target arm limbs.

The signal filtering unit 422 can also realize a filtering algorithm of the TOF signal, wherein the TOF signal acquired by the TOF device is filtered to finally obtain the action information of the target arm limb.

The content matching unit 423 is configured to perform product content matching on the target, and specifically, the content matching unit obtains tag information of the target output by the user portrait unit, and compares the tag information with tag information of the product recorded in the product content resource pool to obtain a matched product content list.

The signal output unit 430 is then introduced.

And the signal output unit 430 is configured to obtain the commodity content list output by the content matching unit, search commodity contents related to the commodity content list in the commodity content resource pool, and output commodity advertisement image information through the image output interface.

Finally, an interaction control unit 440 is introduced.

And the interaction control unit 440 comprises a switching unit and a transaction unit. And the action instruction is used for identifying the target.

Theswitching unit 441 is configured to obtain the motion information of the target arm limb output by the signal filtering unit in real time, compare the motion information of the target arm limb with the gesture information recorded in the interactive content resource pool to obtain matched interactive content information, and perform judgment by the switching unit, if the interactive content information is a switching instruction, send a content switching instruction to the signal output unit, and the signal output unit switches a commodity target according to the commodity content list and finally outputs commodity advertisement image information through the image output interface.

The transaction unit 442 is configured to obtain the motion information of the target arm limb output by the signal filtering unit in real time, compare the motion information of the target arm limb with the gesture information recorded in the interactive content resource pool to obtain matched interactive content information, and perform judgment by the interactive unit, and send transaction information to the transaction interface if the interactive content information is a transaction instruction.

In summary, the program system shown in fig. 4 can push targeted product advertisement content to a target, the target can browse the matched product content in an interactive manner, and can also purchase a specified product in an interactive manner, the interactive manner can quickly attract the attention of the target, the target can quickly purchase the recommended product, target forgetting is prevented, the promotion rate of product advertisement is improved, and convenience of user operation is improved.

Next, an interactive advertisement apparatus including a plurality of TOF devices is further described with particular reference to fig. 5.

As shown in fig. 5,TOF device interface 220 connects a plurality of TOF devices, which may include: a first TOF device 22, asecond TOF device 222 and athird TOF device 223.

The interactive advertising device is used for being installed outdoors, and the recognizable range of the TOF equipment is enlarged by arranging a plurality of TOF equipment in a direction far away from the interactive advertising device; therefore, the identification accuracy of the TOF equipment is improved, and the interaction experience of the target is optimized.

Specifically, set up a plurality of TOF equipment to the mutual advertisement device of outdoor work on the ground direction of keeping away from mutual advertisement device, TOF signal selection unit acquires the signal of all TOF equipment inputs, and the TOF equipment signal nearest apart from the target is strong, and other signals weaken in proper order, and TOF signal selection unit selects the TOF equipment that the signal is strong to be used for user's limbs discernment, improves TOF equipment's discernment accuracy, optimizes the interactive experience of target.

In addition, based on the information display method, the embodiment of the invention also provides a structural schematic diagram of the information display device.

As shown in fig. 6, theapparatus 600 may include:

the acquiring module 610 is configured to acquire time of flight TOF information and image information of a plurality of users in a preset region respectively.

A first determining module 620, configured to determine a target user according to TOF information and image information of multiple users.

The first determining module 620 may be specifically configured to determine moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.

The first determining module 620 may be specifically configured to determine face information of each user according to TOF information and image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.

Therefore, the target user can be accurately screened from the plurality of users, and the pertinence of the information display service provided for the target user is improved.

The first determining module 620 may be further configured to determine distances between the at least two first users and the information presentation device, respectively, if the number of the first users is at least two; and determining the first user corresponding to the distance meeting the preset condition as the target user.

Therefore, the target user can be determined more accurately, accurate interactive service can be provided for the target user subsequently, and user experience is improved.

The first determination module 620 may also be configured to obtain TOF information of the target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.

Therefore, TOF signals of the user can be better captured, more accurate interaction service is provided for the user, and the information display effect can be improved.

A second determining module 630, configured to determine at least one first target information according to the image information of the target user.

Therefore, the information highly matched with the characteristics of the target user can be displayed for the target user in a targeted manner according to the characteristics of the target user, and the information display effect is improved.

The second determining module 630 may be specifically configured to determine the feature tag of the target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.

A display module 640 is configured to display at least one first target information.

The presentation module 640 may also be configured to receive a target action input by a target user; second target information is determined from the at least one first target information according to the target motion input.

The presentation module 640 may also be configured to obtain TOF information of the overall contour region of the target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.

Therefore, the accuracy of target action input identification can be improved, the interactive information to be expressed by the user can be received more accurately, and the user experience is improved.

The presentation module 640 may also be used to receive initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.

Therefore, the identification accuracy of the TOF equipment can be improved, and the interaction experience of the target is optimized.

The presentation module 640 may also be configured to determine a user instruction based on a target action input of a target user; and determining second target information from the at least one first target information according to the user instruction.

In summary, the information display device provided by the embodiment of the invention determines the target user through the TOF information and the image information of the user, provides targeted target information to the target user according to the image information of the target user, and also determines user action information according to the TOF information of the target user, so as to interact with the target user, and the target user can switch the target information matched with the target user in the interaction process, thereby improving the pertinence of information display and improving the user experience.

Fig. 7 is a diagram illustrating an exemplary hardware architecture provided by an embodiment of the present invention.

The positioning device may include aprocessor 701 and amemory 702 storing computer program instructions.

Specifically, theprocessor 701 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing an embodiment of the present invention.

Memory 702 may include a mass storage for data or instructions. By way of example, and not limitation,memory 702 may include a Hard Disk Drive (HDD), a floppy Disk Drive, flash memory, an optical Disk, a magneto-optical Disk, tape, or a Universal Serial Bus (USB) Drive or a combination of two or more of these.Memory 702 may include removable or non-removable (or fixed) media, where appropriate. Thememory 702 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, thememory 702 is non-volatile solid-state memory. In a particular embodiment, thememory 702 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.

Theprocessor 701 reads and executes the computer program instructions stored in thememory 702 to implement any one of the information presentation methods in the above embodiments.

In one example, the positioning device may also include acommunication interface 703 and abus 710. As shown in fig. 7, theprocessor 701, thememory 702, and thecommunication interface 703 are connected by abus 710 to complete mutual communication.

Thecommunication interface 703 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiment of the present invention.

Bus 710 includes hardware, software, or both to couple the components of the information presentation device to each other. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these.Bus 710 may include one or more buses, where appropriate. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.

The processing device may execute the information presentation method in the embodiment of the present invention, thereby implementing the information presentation method described in conjunction with fig. 1.

In addition, in combination with the information display method in the foregoing embodiments, the embodiments of the present invention may provide a computer storage medium to implement. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement any of the information presentation methods in the embodiments described above.

It is to be understood that the embodiments of the invention are not limited to the particular configurations and processes described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the embodiments of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the embodiments of the present invention.

It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the embodiments of the present invention are not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.

As described above, only the specific embodiments of the present invention are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present invention, and these modifications or substitutions should be covered within the scope of the present invention.

Claims (13)

Translated fromChinese

1.一种信息展示方法，应用于信息展示设备，其中，其特征在于，所述方法包括：1. An information display method, applied to an information display device, wherein the method comprises:分别获取预设区域的多个用户的飞行时间TOF信息和图像信息；Obtain the TOF information and image information of the flight time of multiple users in the preset area respectively;根据所述多个用户的TOF信息和图像信息确定目标用户；Determine a target user according to the TOF information and image information of the multiple users;根据所述目标用户的图像信息确定至少一个第一目标信息；Determine at least one first target information according to the image information of the target user;展示所述至少一个第一目标信息。The at least one first target information is displayed.2.根据权利要求1所述的方法，其特征在于，在所述展示所述至少一个第一目标信息之后，所述方法还包括：2. The method according to claim 1, wherein after the displaying the at least one first target information, the method further comprises:接收所述目标用户的目标动作输入；receiving a target action input of the target user;根据所述目标动作输入从所述至少一个第一目标信息中确定第二目标信息。Second target information is determined from the at least one first target information according to the target action input.3.根据权利要求1所述的方法，其特征在于，所述根据所述目标用户的图像信息确定至少一个第一目标信息，包括：3. The method according to claim 1, wherein the determining at least one first target information according to the image information of the target user comprises:根据目标用户的图像信息确定所述目标用户的特征标签；Determine the feature tag of the target user according to the image information of the target user;根据所述目标用户的特征标签确定所述至少一个第一目标信息。The at least one first target information is determined according to the feature tag of the target user.4.根据权利要求1所述的方法，其特征在于，所述根据所述多个用户的TOF信息和图像信息确定目标用户，包括：4. The method according to claim 1, wherein the determining a target user according to the TOF information and image information of the multiple users comprises:根据所述多个用户的TOF信息和图像信息，确定每个用户的移动速度信息；Determine the movement speed information of each user according to the TOF information and image information of the multiple users;将满足预设条件的移动速度信息对应的用户确定为第一用户；Determining the user corresponding to the movement speed information that satisfies the preset condition as the first user;将所述第一用户作为目标用户。The first user is used as the target user.5.根据权利要求1所述的方法，其特征在于，所述根据每个用户的TOF信息和图像信息确定目标用户，包括：5. The method according to claim 1, wherein, determining the target user according to the TOF information and image information of each user, comprising:根据所述每个用户的TOF信息和图像信息，确定所述每个用户的面部信息；According to the TOF information and image information of each user, determine the facial information of each user;将满足预设条件的面部信息对应的用户确定为第一用户；Determining the user corresponding to the facial information that satisfies the preset condition as the first user;将所述第一用户作为目标用户。The first user is used as the target user.6.根据权利要求4或5所述的方法，其特征在于，所述方法还包括：6. The method according to claim 4 or 5, wherein the method further comprises:在所述第一用户为至少两个的情况下，分别确定所述至少两个第一用户与所述信息展示设备之间的距离；In the case that there are at least two first users, respectively determining the distances between the at least two first users and the information display device;所述将所述第一用户作为目标用户，具体包括：The using the first user as the target user specifically includes:将满足预设条件的距离对应的第一用户确定为所述目标用户。The first user corresponding to the distance satisfying the preset condition is determined as the target user.7.根据权利要求2所述的方法，其特征在于，所述接收所述目标用户的目标动作输入，包括：7. The method according to claim 2, wherein the receiving the target action input of the target user comprises:获取所述目标用户整体轮廓区域的TOF信息；Obtain the TOF information of the overall outline area of the target user;根据所述目标用户整体轮廓区域的TOF信息和预先训练的用户TOF信息模型确定所述目标用户局部区域的TOF信息；Determine the TOF information of the local area of the target user according to the TOF information of the overall outline area of the target user and the pre-trained user TOF information model;根据所述局部区域的TOF信息，确定所述目标用户的目标动作输入。According to the TOF information of the local area, the target action input of the target user is determined.8.根据权利要求2所述的方法，其特征在于，所述根据所述目标动作输入从所述至少一个第一目标信息中确定第二目标信息，包括：8. The method according to claim 2, wherein the determining the second target information from the at least one first target information according to the target action input comprises:根据所述目标用户的目标动作输入确定用户指令；Determine the user instruction according to the target action input of the target user;根据所述用户指令从所述至少一个第一目标信息中确定第二目标信息。The second target information is determined from the at least one first target information according to the user instruction.9.根据权利要求1所述的方法，其特征在于，在所述根据所述多个用户的TOF信息和图像信息确定目标用户之后，所述方法还包括：9. The method according to claim 1, wherein after the target user is determined according to the TOF information and image information of the multiple users, the method further comprises:获取所述目标用户的TOF信息；Obtain the TOF information of the target user;根据目标用户的TOF信息确定所述目标用户与所述信息展示设备之间的目标距离；Determine the target distance between the target user and the information display device according to the TOF information of the target user;在所述目标距离大于预设阈值的情况下，在所述信息展示设备上展示第一信息，所述第一信息用于使用户向缩小所述目标距离的方向移动。When the target distance is greater than a preset threshold, display first information on the information display device, where the first information is used to make the user move in a direction of reducing the target distance.10.根据权利要求7所述的方法，其特征在于，所述获取所述目标用户整体轮廓区域的TOF信息，包括：10. The method according to claim 7, wherein the acquiring TOF information of the target user's overall outline region comprises:接收至少一个TOF设备采集的初始TOF信息；Receive initial TOF information collected by at least one TOF device;根据所述初始TOF信息确定所述目标用户整体轮廓区域的TOF信息。The TOF information of the overall contour area of the target user is determined according to the initial TOF information.11.一种信息展示装置，其特征在于，包括：11. An information display device, comprising:获取模块，用于分别获取预设区域的多个用户的飞行时间TOF信息和图像信息；an acquisition module, used to acquire the TOF information and image information of the flight time of multiple users in the preset area respectively;第一确定模块，用于根据所述多个用户的TOF信息和图像信息确定目标用户；a first determining module, for determining a target user according to the TOF information and image information of the multiple users;第二确定模块，用于根据所述目标用户的图像信息确定至少一个第一目标信息；a second determining module, configured to determine at least one first target information according to the image information of the target user;展示模块，用于展示所述至少一个第一目标信息。A display module, configured to display the at least one first target information.12.一种计算设备，其特征在于，所述设备包括：处理器以及存储有计算机程序指令的存储器；12. A computing device, characterized in that the device comprises: a processor and a memory storing computer program instructions;所述处理器执行所述计算机程序指令时实现如权利要求1-10任意一项所述的信息展示方法。When the processor executes the computer program instructions, the information display method according to any one of claims 1-10 is implemented.13.一种计算机存储介质，其特征在于，所述计算机存储介质上存储有计算机程序指令，所述计算机程序指令被处理器执行时实现如权利要求1-10任意一项所述的信息展示方法。13. A computer storage medium, wherein computer program instructions are stored on the computer storage medium, and when the computer program instructions are executed by a processor, the information display method according to any one of claims 1-10 is implemented .

Images