Detailed Description
The invention will be described in detail hereinafter with reference to the drawings in conjunction with embodiments. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.
Alternatively, in the present embodiment, the above-described information display method may be applied to a hardware environment constituted by the server 102 and the terminal 104 as shown in fig. 1. As shown in fig. 1, which is a schematic diagram of a hardware environment of an information display method according to an embodiment of the present invention, a server 102 is connected to a terminal 104 through a network, where the network includes, but is not limited to: the terminal 104 is not limited to a PC, a mobile phone, a tablet computer, etc., but is a wide area network, a metropolitan area network, or a local area network. The information display method according to the embodiment of the present invention may be executed by the server 102, may be executed by the terminal 104, or may be executed by both the server 102 and the terminal 104. The information display method performed by the terminal 104 according to the embodiment of the present invention may be performed by a client installed thereon.
In this embodiment, there is provided an information display method operating on the mobile terminal, and fig. 2 is a flowchart of the information display method according to an embodiment of the present invention, as shown in fig. 2, where the flowchart includes the following steps:
step S202, acquiring a target voice signal when a target application displays a live broadcast interface;
the live interface of the target application includes a live interface as shown in fig. 3, and fig. 3 is a schematic diagram of a live interface according to an alternative embodiment of the present invention, where in a process of broadcasting by a host, or in a process of watching live by a user, a target voice signal is obtained, and the target voice signal may be a voice signal sent by the host broadcasting the live content, or may be a voice signal sent by the user watching the live.
Step S204, when the keywords in the target voice signal are matched with the target keywords in the preset keyword set, displaying the target keywords on the live interface;
where the predetermined set of keywords includes preset keywords, for example, "Li Jiaqi" and "alica" are currently of interest in webcast, then "Li Jiaqi" and "alica" may be included in the predetermined set of keywords. As web-popular content is updated, the predetermined set of keywords is updated in real-time. And when the keywords in the target voice are matched with the target keywords in the preset keyword set, displaying the target keywords on the live interface. For example, the target keywords "Li Jiaqi" and "alita" are included in the target voice, and then as shown in fig. 4, a schematic diagram of the target keywords being displayed in the live interface, and "Li Jiaqi" and "alita" being displayed in the live display interface in the figure, according to an alternative embodiment of the present invention.
Step S206, acquiring target information related to a first keyword in the target keywords under the condition that the first keyword is selected;
The number of the target keywords can be one or more, the first keywords which want to acquire the related information can be selected from the target keywords, the color of the selected first keywords can be changed, or the selected keywords can be cancelled from being displayed in the live broadcast display interface, or the first keywords can be selected in the live broadcast interface through identification, and the specific state of displaying the selected first keywords can be adjusted according to actual conditions. Fig. 5 is a schematic view showing selection of a first keyword according to an alternative embodiment of the present invention, in which the first keyword "alita" is indicated to be selected by changing colors.
Step S208, displaying the target information on the live broadcast interface.
Wherein, a live broadcast interface may be split into two screens, one screen displays live broadcast content, and the other screen displays target information, as shown in fig. 6, where in an alternative embodiment of the present invention, a schematic diagram of displaying target information on the live broadcast interface, as shown in fig. 6, where in a case where a keyword "alicta" is selected, a terminal display screen is split into two screens, where in an upper screen displays content related to a first keyword, in fig. 6, content related to the first keyword "alicta" has a consultation, a video, a music, and a picture, where in the lower screen is provided with a corresponding identifier, where in a case where an identifier is selected, content corresponding to the identifier is displayed in the lower screen, for example, where in fig. 6, a picture is selected, then in the lower screen, a picture of "alicta" is displayed, and clicking the identifier "x" in the lower screen may close the split screen display. The target information may also be displayed on a floating screen of the live broadcast interface, the live broadcast interface is located behind the floating screen, and the live broadcast content is continuously displayed in the live broadcast interface, as shown in fig. 7, which is a schematic diagram of displaying the target information on the live broadcast interface according to another alternative embodiment of the present invention, in fig. 7, a manner of displaying the target information on the floating screen is shown, the floating screen is a screen disposed above the live broadcast display interface, the live broadcast content is continuously played behind the floating screen, and the information related to the first keyword "alicita" is displayed in the floating screen. In the case of selecting target information of video or music, in order to avoid audio mixing, the live broadcast is paused, and the video or audio is played, but the live broadcast picture is still continuously played.
Through the steps, as the target voice signal is obtained in the live broadcast process, keywords appearing in the target voice signal are matched with keywords in the keyword set in a reservation mode, when matched target keywords exist, a first keyword is selected from the target keywords, target information related to the first keyword is obtained, and the target information is displayed in a live broadcast interface. Therefore, the method and the device can solve the problem that the information related to the live content cannot be conveniently acquired in the live broadcast process, achieve the purpose that the information related to the live content can be conveniently acquired in the live broadcast process, increase the appreciation and the interestingness of the live broadcast, and improve the effect of user experience.
Alternatively, the execution subject of the above steps may be a terminal or the like, but is not limited thereto.
In an optional embodiment, the displaying the target keyword on the live interface includes: displaying the group of keywords on the live broadcast interface in multiple times under the condition that the target keywords comprise a group of keywords and the number of the keywords in the group of keywords is larger than a preset threshold, wherein part of the keywords in the group of keywords are displayed on the live broadcast interface each time; and/or, when the target keyword includes the group of keywords and the number of keywords in the group of keywords is less than or equal to the predetermined threshold, displaying the group of keywords on the live interface at one time. In this embodiment, a plurality of target keywords may be included in the target voice signal, and due to the size limitation of the display interface, the display effect in the live interface may be affected when the number of target keywords exceeds a certain threshold. In order to avoid the occurrence of the above situation, all target keywords can be displayed on the live interface for multiple times. A predetermined number of keywords are displayed at a time. For example, a segment of voice signal contains 10 target keywords, and the live interface can only display 4 keywords at a time, then the 10 keywords are displayed three times, the first four keywords in the voice signal are displayed first, after a certain time, the 5 th to 8 th keywords are displayed, and after a certain time, the last two keywords are displayed. It should be noted that, the above examples are only for illustrating the embodiment, and the number of target keywords included in a specific target voice signal and the number of keywords that can be displayed on the live interface each time may be adjusted according to actual situations. If the number of the target keywords included in the target voice signal is less than or equal to the keywords that can be displayed on the live broadcast interface, all the target keywords included in the target voice signal can be displayed on the live broadcast interface at one time, for example, the number of the keywords displayed on the live broadcast interface is 6 at most, and the number of the target keywords included in the target voice signal is less than or equal to 6, then all the target keywords included in the target voice signal can be displayed on the live broadcast interface at one time on the live broadcast interface.
In an alternative embodiment, the displaying the set of keywords on the live interface multiple times includes: and displaying a preset number of keywords in the keywords which are not displayed in the group of keywords on the live broadcast interface every time, and stopping displaying the preset number of keywords on the live broadcast interface when the duration of displaying the preset number of keywords on the live broadcast interface reaches a first preset time threshold. In this embodiment, the first predetermined time threshold may be adjusted according to actual situations, for example, may be 5 seconds, 10 seconds, 20 seconds, etc., may be a default definition value of the system, or may be a user definition of a user logging in the target application. Assuming that the target voice signal is "net red of the most recent comparison fire in the network has Li Jiaqi, the unrestrained nature, the punica granatum, the little glow and the thailand tour guide", the target voice signal is matched with "Li Jiaqi", "unrestrained nature", "punica granatum", "little glow and" thailand tour guide "in the preset keyword set in the section of voice, and the user sets to display two keywords in the live interface each time in the target application, wherein the duration of each display is 10 seconds. The system may display the 5 target keywords of "Li Jiaqi", "unrestrained nature" and "punica" and "bright wisdom" in the live interface three times, for example, the target keywords may be displayed sequentially in the target voice signal, where "Li Jiaqi" and "unrestrained nature" are displayed for the first time, 10 seconds later, and "bright wisdom" are displayed for 10 seconds later.
In an alternative embodiment, after said displaying said set of keywords on said live interface at once, comprising: and stopping displaying the group of keywords on the live broadcast interface when the duration of the group of keywords displayed on the live broadcast interface reaches a second preset time threshold. In this embodiment, the display time of the target keyword may be set by the system or may be set by the user of the target application. Specifically, the setting may be performed according to the number of target keywords included in the target voice, and the second predetermined time threshold may be greater as the number of target keywords is greater. That is, the target keywords in the target voice signal are displayed in the live interface for a certain period of time, and are displayed in the live interface for a second predetermined time, and the display in the live interface is canceled beyond the predetermined time threshold.
In an alternative embodiment, the acquiring the target voice signal when the target application displays the live interface includes: and when the target application displays the live broadcast interface, acquiring the target voice signal sent by a host target, wherein the host target is a target for hosting a live broadcast event corresponding to the live broadcast interface, and the target application is logged in by a first account associated with the host target. In this embodiment, the target voice signal may be sent by a live host, and when the host sets an option capable of monitoring voice and displaying keywords in an application interface during the live process, the system detects the voice sent by the live host during the live process and matches keywords in the voice sent by the host with keywords in a predetermined keyword set.
In an optional embodiment, in a case that the target information is displayed on the live interface, the method further includes: transmitting a display instruction from the target application logged in by the first account to a target application logged in by a second account, wherein the display instruction is used for indicating to display the target information on a live broadcast interface displayed by the target application logged in by the second account, the second account is an account associated with a viewing object, and the viewing object is an object for viewing a live broadcast event corresponding to the live broadcast interface; and/or displaying the target information on a live broadcast interface displayed by a target application logged in by the second account, wherein the second account is an account associated with a viewing object, and the viewing object is an object for viewing a live broadcast event corresponding to the live broadcast interface. In this embodiment, when it is detected that the target voice signal sent by the anchor matches the target keyword in the predetermined keyword set, the display of the target keyword in the live interface may be displayed according to the setting of the user in the target application. That is, the live interface used by the host may be displayed, the live interface of the user watching the live may be displayed, or both the live interfaces may be displayed, specifically according to the setting of the user of the target application in the target application. In the case that the anchor determines the first keyword among the plurality of target keywords, a display instruction may be transmitted by a target application used by the anchor to a target application of a user viewing live broadcasting to instruct to display target information related to the first keyword on a live broadcasting display live broadcasting interface of the user viewing live broadcasting. Or, the target information related to the first keyword is directly displayed in the target application of the user watching the live broadcast.
In an alternative embodiment, the acquiring the target voice signal when the target application displays the live interface includes: and when the target application displays the live broadcast interface, acquiring the target voice signal sent by a viewing object, wherein the viewing object is an object for viewing a live broadcast event corresponding to the live broadcast interface, and the target application is logged in by a second account associated with the viewing object. In this embodiment, the target voice signal may also be voice uttered by a user watching live broadcast. In the live broadcast watching process of a user, detecting voice sent by the user watching live broadcast, comparing keywords in an obtained voice signal with keywords in a preset keyword set, displaying target keywords in a live broadcast interface of the user watching live broadcast under the condition that matched target keywords exist, determining a first keyword in a plurality of target keywords by the user watching live broadcast, and displaying target information on the live broadcast interface of the user watching live broadcast after target information related to the first keyword is obtained. In this way, in the process of watching live broadcast by a user, related information of keywords appearing in the content broadcast by the host can be directly known in the live broadcast interface.
In an alternative embodiment, displaying the target information on the live interface includes: and displaying the target information in a floating window floating above the live interface. In this embodiment, as shown in fig. 7, a floating window may be provided on the live interface, and the target information may be displayed in the floating window. Thus, the live content still continues to be played in the live interface, and the target information is displayed in the floating window.
In an alternative embodiment, the displaying the target information in a floating window floating above the live interface includes: and displaying the first type of information in a first tag field in the floating window, wherein a plurality of tag fields comprising the first tag field are arranged in the floating window, each tag field corresponds to one type of information, and the target information comprises the first type of information. In the present embodiment, as shown in fig. 7, a plurality of tags "information", "video", "music", "picture" are set in the floating window. This may be displayed according to the type of target information, for example, the information of the picture type is displayed under the "picture" identifier, and the information of the video class is displayed under the "video" identifier. The specific type of identification may be dependent on the actual situation. And displaying the information of the type corresponding to the selected identifier under the condition that the trigger signal of the selected identifier of the user is acquired. For example, the user selects "picture" from "information", "video", "music", "picture", the picture identification is selected, and the picture information of the first keyword is displayed under the picture identification.
In an alternative embodiment, after the displaying the target information in a floating window floating above the live interface, the method includes: detecting touch operation for closing the floating window in the target application; and closing the floating window in response to the touch operation. In this embodiment, as shown in fig. 7, an "x" in the hover window indicates an identifier for closing the hover window, and after the user clicks the identifier for closing the hover window, the hover window is closed, and the live content continues to be played.
The present application is described below by way of a specific embodiment, and fig. 8 is a schematic diagram of a system structure according to an alternative embodiment of the present invention, where the steps include:
step 1: a target speech signal is acquired. Specifically, collecting voice data of a user through live broadcast audio and video;
step 2: matching with target keywords in a predetermined keyword set. Specifically, identifying target keywords matched with a preset keyword library in voice data through a voice identification technology;
step 3: acquiring target information related to a target keyword;
step 4: and displaying the target information on a live interface of the live client.
Specifically, the multimedia information such as information, video, music, pictures and the like matched with the target keywords is searched in real time through a search engine, the multimedia information is presented on a live client, and a user can view the multimedia information related to voice on the live client in real time;
step 5: the predetermined keyword set is updated in real time. Specifically, the preset keyword set management is put in the background, so that the current most popular keywords can be updated in real time, and live interaction is more advanced.
In the above specific embodiment, the predetermined keyword set may be stored in the client or may be stored in the server.
In the case where a predetermined keyword set is stored in the client, a specific implementation flow is shown in fig. 9, which is a flowchart of a first information display method according to an alternative embodiment of the present invention. The method specifically comprises the following steps:
step 1: the user starts a live broadcast sending request;
step 2: the client starts a microphone to collect voice signals of a user;
step 3: the user speaks through the microphone;
step 4: the client performs voice recognition, judges whether the voice content contains keywords in a preset keyword set, and displays corresponding target keywords if the voice content contains keywords in the preset keyword set;
Step 5: clicking a first keyword to be checked by a user;
step 6: searching information related to the first keyword and displaying the information in a live interface. Specifically, the client searches multimedia information such as information, video, music, pictures and the like related to the keywords clicked by the user in real time through the search engine, and displays the multimedia information.
In the case that the predetermined keyword set is stored in the server, a specific implementation flow is shown in fig. 10, which is a flow chart of a second information display method according to an alternative embodiment of the present invention. The method specifically comprises the following steps:
step 1: the user starts a live broadcast sending request;
step 2: the client starts a microphone to collect voice data of a user;
step 3: a user speaks through the microphone;
step 4: the client sends the voice signal of the user to the server;
step 5: and performing voice recognition, and matching the acquired voice signals with a preset keyword set to determine a target keyword with matching degree. Specifically, the server side carries out voice recognition and judges whether the voice content contains keywords in a preset keyword library or not;
step 6: and returning the matched target keywords. Specifically, if keywords in a preset keyword library are contained, the server side returns corresponding keywords to the client side;
Step 7: the client displays the corresponding target keywords;
step 8: clicking a first keyword to be checked by a user;
step 9: and searching information related to the first keyword by the client and displaying the information in the live interface. Specifically, the client searches multimedia information such as information, video, music, pictures and the like related to the keywords clicked by the user in real time through the search engine, and displays the multimedia information.
In the above embodiment, whether the predetermined keyword set is stored in the client or the server, the predetermined keyword set is placed in the background keyword library to manage, so that the current most popular keywords are updated and replaced by the preset keywords. Through this application, can enrich the content of live broadcast process, let live broadcast have more interest and sight. And the background manages the keywords, so that the logic of updating the keywords in real time is satisfied, and live interaction is more advanced.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
In this embodiment, an information display device is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, and will not be described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 11 is a block diagram of a structure of an information display apparatus according to an embodiment of the present invention, as shown in fig. 11, the apparatus including: a first obtaining module 1102, configured to obtain a target voice signal when the target application displays a live interface; a first display module 1104, configured to display, on the live interface, a target keyword in the target voice signal when the keyword matches a target keyword in a predetermined keyword set; a second obtaining module 1106, configured to obtain, when a first keyword in the target keywords is selected, target information related to the first keyword; a second display module 1108, configured to display the target information on the live interface.
In an optional embodiment, the first display module 1104 is further configured to display, in a case where the target keyword includes a set of keywords and the number of keywords in the set of keywords is greater than a predetermined threshold, the set of keywords on the live interface in multiple times, where a part of the keywords in the set of keywords are displayed on the live interface at a time; and/or, when the target keyword includes the group of keywords and the number of keywords in the group of keywords is less than or equal to the predetermined threshold, displaying the group of keywords on the live interface at one time.
In an alternative embodiment, the first display module 1104 is further configured to display a predetermined number of keywords in the keywords that are not yet displayed in the set of keywords on the live broadcast interface, and stop displaying the predetermined number of keywords on the live broadcast interface when a duration of displaying the predetermined number of keywords on the live broadcast interface reaches a first predetermined time threshold.
In an optional embodiment, the foregoing apparatus is further configured to stop displaying the set of keywords on the live interface when a duration of displaying the set of keywords on the live interface reaches a second predetermined time threshold after the set of keywords are displayed on the live interface at one time.
In an optional embodiment, the first obtaining module 1102 is further configured to obtain, when the target application displays the live interface, the target voice signal sent by a host object, where the host object is an object hosting a live event corresponding to the live interface, and the target application is logged in by a first account associated with the host object.
In an optional embodiment, the device is further configured to send a display instruction from the target application logged in by the first account to a target application logged in by a second account, where the display instruction is configured to instruct to display the target information on a live interface displayed by the target application logged in by the second account, and the second account is an account associated with a viewing object, and the viewing object is an object for viewing a live event corresponding to the live interface; and/or displaying the target information on a live broadcast interface displayed by a target application logged in by the second account, wherein the second account is an account associated with a viewing object, and the viewing object is an object for viewing a live broadcast event corresponding to the live broadcast interface.
In an optional embodiment, the first obtaining module 1102 is further configured to obtain, when the target application displays the live interface, the target voice signal sent by a viewing object, where the viewing object is an object for viewing a live event corresponding to the live interface, and the target application is logged in by a second account associated with the viewing object.
In an alternative embodiment, the second display module 1108 is further configured to display the target information in a hover window hovering over the live interface.
In an alternative embodiment, the second display module 1108 is further configured to display a first type of information in a first tab field in the floating window, where a plurality of tab fields including the first tab field are disposed in the floating window, each tab field corresponds to one type of information, and the target information includes the first type of information.
In an optional embodiment, the device is further configured to detect, in the target application, a touch operation for closing a floating window above the live interface after the target information is displayed in the floating window; and closing the floating window in response to the touch operation.
It should be noted that each of the above modules may be implemented by software or hardware, and for the latter, it may be implemented by, but not limited to: the modules are all located in the same processor; alternatively, the above modules may be located in different processors in any combination.
An embodiment of the invention also provides a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the method embodiments described above when run.
Alternatively, in the present embodiment, the above-described storage medium may be configured to store a computer program for performing the steps of:
s1, acquiring a target voice signal when a target application displays a live broadcast interface;
s2, displaying the target keywords on the live broadcast interface under the condition that the keywords in the target voice signals are matched with target keywords in a preset keyword set;
s3, under the condition that a first keyword in the target keywords is selected, acquiring target information related to the first keyword;
and S4, displaying the target information on the live broadcast interface.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing a computer program.
An embodiment of the invention also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
s1, acquiring a target voice signal when a target application displays a live broadcast interface;
s2, displaying the target keywords on the live broadcast interface under the condition that the keywords in the target voice signals are matched with target keywords in a preset keyword set;
s3, under the condition that a first keyword in the target keywords is selected, acquiring target information related to the first keyword;
and S4, displaying the target information on the live broadcast interface.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
It will be appreciated by those skilled in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may alternatively be implemented in program code executable by computing devices, so that they may be stored in a memory device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps within them may be fabricated into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention should be included in the protection scope of the present invention.