Movatterモバイル変換


[0]ホーム

URL:


CN112689201B - Barrage information identification method, barrage information display method, server and electronic equipment - Google Patents

Barrage information identification method, barrage information display method, server and electronic equipment
Download PDF

Info

Publication number
CN112689201B
CN112689201BCN201910990386.8ACN201910990386ACN112689201BCN 112689201 BCN112689201 BCN 112689201BCN 201910990386 ACN201910990386 ACN 201910990386ACN 112689201 BCN112689201 BCN 112689201B
Authority
CN
China
Prior art keywords
bullet screen
information
target
object information
screen information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910990386.8A
Other languages
Chinese (zh)
Other versions
CN112689201A (en
Inventor
易园林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co LtdfiledCriticalVivo Mobile Communication Co Ltd
Priority to CN201910990386.8ApriorityCriticalpatent/CN112689201B/en
Priority to PCT/CN2020/120415prioritypatent/WO2021073478A1/en
Publication of CN112689201ApublicationCriticalpatent/CN112689201A/en
Application grantedgrantedCritical
Publication of CN112689201BpublicationCriticalpatent/CN112689201B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本发明实施例提供了一种弹幕信息识别方法、显示方法、服务器及电子设备。该方法包括:获取电子设备对目标图像区域进行识别后确定的识别结果,根据识别结果,从目标视频包括的第一对象信息中确定第二对象信息,从而使确定的第二对象信息不但属于目标视频中的第一对象信息,而且属于目标图像区域中的对象信息,因此从存储的弹幕信息中识别出的包括至少一个第二对象信息的目标弹幕信息是与目标图像区域中的对象信息相关、且与目标视频相关的弹幕信息,并向电子设备发送目标弹幕信息,从而使电子设备可以展示目标弹幕信息,从而能够为用户推送用户真正感兴趣的弹幕信息,丰富并满足用户对弹幕信息的个性化需求。

Figure 201910990386

Embodiments of the present invention provide a method for identifying bullet screen information, a method for displaying it, a server, and an electronic device. The method includes: acquiring a recognition result determined after the electronic device recognizes a target image area, and according to the recognition result, determining second object information from the first object information included in the target video, so that the determined second object information not only belongs to the target The first object information in the video belongs to the object information in the target image area, so the target bullet screen information including at least one second object information identified from the stored bullet screen information is the same as the object information in the target image area. Relevant and relevant bullet screen information related to the target video, and send the target bullet screen information to the electronic device, so that the electronic device can display the target bullet screen information, so as to push the user's really interested bullet screen information to the user, enrich and satisfy the Users' personalized needs for bullet screen information.

Figure 201910990386

Description

Translated fromChinese
弹幕信息识别方法、显示方法、服务器及电子设备Barrage information identification method, display method, server and electronic device

技术领域technical field

本发明实施例涉及数据处理技术领域,尤其涉及一种弹幕信息识别方法、显示方法、服务器及电子设备。Embodiments of the present invention relate to the technical field of data processing, and in particular, to a method for identifying bullet screen information, a method for displaying it, a server, and an electronic device.

背景技术Background technique

随着电子设备数量的高速增长以及移动网络的速度与稳定性的提高,结合移动通信网特点的电子设备应用必然成为用户的很重要的需求。With the rapid growth of the number of electronic devices and the improvement of the speed and stability of the mobile network, the application of electronic devices combined with the characteristics of the mobile communication network will inevitably become a very important requirement of users.

目前,使用电子设备的用户在观看视频的过程中,如果想看弹幕信息,在开启弹幕开关后会看到大量的弹幕信息,这些信息都是其他观看本视频的用户发表的一些评论或吐槽,每个用户发的弹幕信息都会出现在视频的特定时间点,这些弹幕信息能够增加用户之间的互动,也让观看视频变得更加有趣。At present, users using electronic devices will see a lot of bullet screen information after turning on the bullet screen switch if they want to see the bullet screen information during the process of watching the video. These information are some comments made by other users who watch this video. Or Tucao, the bullet screen information sent by each user will appear at a specific time point in the video. These bullet screen information can increase the interaction between users and make watching videos more interesting.

然而,当用户需要屏蔽那些自己不感兴趣的弹幕时,一般需要用户直接关闭弹幕开关,而直接关掉弹幕开关则会影响用户之间的互动体验,也少了一些观看视频的乐趣。因此,如何为,逐渐成为个性化服务领域亟待解决的技术问题。However, when users need to block those bullet screens that they are not interested in, the user generally needs to directly turn off the bullet screen switch, and directly turning off the bullet screen switch will affect the interactive experience between users, and also reduce the fun of watching videos. Therefore, how to act has gradually become a technical problem that needs to be solved urgently in the field of personalized service.

发明内容SUMMARY OF THE INVENTION

本发明实施例提供一种弹幕信息识别方法、显示方法、服务器及电子设备,以解决现有技术中无法为用户推送用户真正感兴趣的弹幕信息,丰富并满足用户对弹幕信息的个性化需求的问题。Embodiments of the present invention provide a method for identifying bullet screen information, a method for displaying it, a server, and an electronic device, so as to solve the problem that in the prior art, the bullet screen information that the user is really interested in cannot be pushed to the user, and to enrich and satisfy the user's personality to the bullet screen information. the question of demand.

为了解决上述技术问题,本发明是这样实现的:In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

根据本发明实施例的第一方面,本发明实施例提供了一种弹幕信息识别方法,所述方法应用于服务器,所述方法包括:According to the first aspect of the embodiments of the present invention, the embodiments of the present invention provide a method for identifying bullet screen information. The method is applied to a server, and the method includes:

获取电子设备对目标图像区域进行识别后确定的识别结果,所述目标图像区域为所述电子设备根据用户对目标视频的第一输入确定的,所述目标视频为所述电子设备上当前播放的视频;Obtain the recognition result determined by the electronic device after recognizing the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is currently playing on the electronic device video;

根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息;According to the recognition result, determine second object information from the first object information included in the target video;

从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;Identify target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one of the second object information;

向所述电子设备发送所述目标弹幕信息。Sending the target bullet screen information to the electronic device.

根据本发明实施例的第二方面,本发明实施例还提供了一种弹幕信息显示方法,所述方法应用于电子设备,所述方法包括:According to the second aspect of the embodiment of the present invention, the embodiment of the present invention further provides a method for displaying bullet screen information, the method is applied to an electronic device, and the method includes:

接收用户对所述电子设备上播放的目标视频的第一输入;receiving the first input from the user to the target video played on the electronic device;

响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;In response to the first input, determining a target frame image of the target video, and determining a target image area on the target frame image;

对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;Identify the target image area, obtain a recognition result, and send the recognition result to the server, so that the server can determine second object information from the first object information included in the target video according to the recognition result , and identify the target bullet screen information from the stored bullet screen information, the target bullet screen information includes at least one of the second object information;

接收所述服务器发送的所述目标弹幕信息;receiving the target bullet screen information sent by the server;

显示所述目标弹幕信息。Display the target barrage information.

根据本发明实施例的第三方面,本发明实施例还提供了一种服务器,包括:According to a third aspect of the embodiments of the present invention, the embodiments of the present invention further provide a server, including:

第一获取模块,用于获取电子设备对目标图像区域进行识别后确定的识别结果,所述目标图像区域为所述电子设备根据用户对目标视频的第一输入确定的,所述目标视频为所述电子设备上当前播放的视频;The first acquisition module is used to acquire the recognition result determined after the electronic device recognizes the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is the target video. the video currently playing on the electronic device;

确定模块,用于根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息;a determining module, configured to determine second object information from the first object information included in the target video according to the identification result;

识别模块,用于从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;an identification module, configured to identify target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one of the second object information;

发送模块,用于向所述电子设备发送所述目标弹幕信息。A sending module, configured to send the target bullet screen information to the electronic device.

根据本发明实施例的第四方面,本发明实施例还提供了一种电子设备,其特征在于,包括:According to a fourth aspect of the embodiments of the present invention, the embodiments of the present invention further provide an electronic device, characterized in that it includes:

第一接收模块,用于接收用户对所述电子设备上播放的目标视频的第一输入;a first receiving module, configured to receive a user's first input of the target video played on the electronic device;

确定模块,用于响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;a determining module, configured to determine a target frame image of the target video in response to the first input, and determine a target image area on the target frame image;

识别模块,用于对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;An identification module, configured to identify the target image area, obtain the identification result, and send the identification result to the server, so that the server can select the first object information included in the target video from the first object information according to the identification result. Determine the second object information, and identify the target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one of the second object information;

第二接收模块,用于接收所述服务器发送的所述目标弹幕信息;a second receiving module, configured to receive the target bullet screen information sent by the server;

目标弹幕信息显示模块,用于显示所述目标弹幕信息。The target bullet screen information display module is used to display the target bullet screen information.

根据本发明实施例的第五方面,本发明实施例还提供了一种服务器,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现上述所述的弹幕信息识别方法的步骤。According to a fifth aspect of the embodiments of the present invention, the embodiments of the present invention further provide a server, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer When the program is executed by the processor, the steps of the above-mentioned method for identifying bullet screen information are realized.

根据本发明实施例的第六方面,本发明实施例还提供了一种电子设备,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现上述所述的弹幕信息显示方法的步骤。According to a sixth aspect of the embodiments of the present invention, the embodiments of the present invention further provide an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, the When the computer program is executed by the processor, the steps of the above-mentioned method for displaying bullet screen information are realized.

在本发明实施例中,通过获取电子设备对目标图像区域进行识别后确定的识别结果,根据识别结果,从目标视频包括的第一对象信息中确定第二对象信息,从而使确定的第二对象信息不但属于目标视频中的第一对象信息,而且属于目标图像区域中的对象信息,因此从存储的弹幕信息中识别出的包括至少一个第二对象信息的目标弹幕信息是与目标图像区域中的对象信息相关、且与目标视频相关的弹幕信息,也即目标弹幕信息是用户感兴趣的目标弹幕信息。并向电子设备发送目标弹幕信息,从而使电子设备可以展示目标弹幕信息,从而用能够为用户推送用户真正感兴趣的弹幕信息,丰富并满足用户对弹幕信息的个性化需求。In the embodiment of the present invention, the recognition result determined after the electronic device recognizes the target image area is obtained, and according to the recognition result, the second object information is determined from the first object information included in the target video, so that the determined second object The information not only belongs to the first object information in the target video, but also belongs to the object information in the target image area. Therefore, the target bullet screen information including at least one second object information identified from the stored bullet screen information is the same as the target image area. The bullet screen information related to the object information in and related to the target video, that is, the target bullet screen information is the target bullet screen information that the user is interested in. And send the target bullet screen information to the electronic device, so that the electronic device can display the target bullet screen information, so that the user can push the bullet screen information that the user is really interested in, enrich and meet the user's personalized needs for the bullet screen information.

附图说明Description of drawings

图1示出了本发明实施例中提供的一种弹幕信息识别方法的流程图;1 shows a flowchart of a method for identifying bullet screen information provided in an embodiment of the present invention;

图2示出了本发明实施例中提供的一种目标视频的示意图;2 shows a schematic diagram of a target video provided in an embodiment of the present invention;

图3示出了本发明实施例中提供的另一种弹幕信息识别方法的流程图;3 shows a flowchart of another method for identifying bullet screen information provided in an embodiment of the present invention;

图4示出了本发明实施例中提供的一种非闭合区域补充为闭合区域的示意图;FIG. 4 shows a schematic diagram of supplementing a non-closed area to a closed area provided in an embodiment of the present invention;

图5示出了本发明实施例中提供的一种与每个所述类别的目标弹幕信息显示的示意图;FIG. 5 shows a schematic diagram of displaying target bullet screen information with each of the categories provided in an embodiment of the present invention;

图6示出了本发明实施例中提供的一种对象图标展示示意图;FIG. 6 shows a schematic diagram of displaying an object icon provided in an embodiment of the present invention;

图7示出了本发明实施例中提供的一种目标弹幕信息排序以及突出处理的示意图;7 shows a schematic diagram of sorting and highlighting of target bullet screen information provided in an embodiment of the present invention;

图8示出了本发明实施例中提供的一种服务器800的框图;FIG. 8 shows a block diagram of aserver 800 provided in an embodiment of the present invention;

图9示出了本发明实施例中提供的另一种服务器900的框图;FIG. 9 shows a block diagram of anotherserver 900 provided in an embodiment of the present invention;

图10示出了本发明实施例中提供的一种电子设备1000的框图;FIG. 10 shows a block diagram of anelectronic device 1000 provided in an embodiment of the present invention;

图11示出了本发明实施例中提供的另一种电子设备1100的框图;FIG. 11 shows a block diagram of anotherelectronic device 1100 provided in an embodiment of the present invention;

图12示出了本发明实施例中提供的又一种电子设备1200的框图;FIG. 12 shows a block diagram of anotherelectronic device 1200 provided in an embodiment of the present invention;

图13为实现本发明各个实施例的一种电子设备的硬件结构示意图。FIG. 13 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

下面结合具体实施例对本发明进行详细说明。The present invention will be described in detail below with reference to specific embodiments.

参照图1,示出了本发明实施例中提供的一种弹幕信息识别方法的流程图,应用于服务器,方法具体可以包括如下步骤:Referring to FIG. 1, a flowchart of a method for identifying bullet screen information provided in an embodiment of the present invention is shown, which is applied to a server, and the method may specifically include the following steps:

步骤101、获取电子设备对目标图像区域进行识别后确定的识别结果,目标图像区域为电子设备根据用户对目标视频的第一输入确定的,目标视频为电子设备上当前播放的视频。Step 101: Obtain the recognition result determined by the electronic device after recognizing the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is the video currently playing on the electronic device.

电子设备可以包括智能手机、平板电脑、笔记本电脑等,上述示例只是举例说明,本发明对此不作限定。第一输入可以为用户使用鼠标在目标视频上划线,以圈定目标视频中的目标图像区域的操作,或者第一输入为手指在目标视频上划线圈定目标视频中的目标图像区域的操作。本发明实施例对第一输入的形式不进行限制。The electronic device may include a smart phone, a tablet computer, a notebook computer, etc. The above examples are only examples, which are not limited in the present invention. The first input may be an operation of the user using a mouse to draw a line on the target video to delineate the target image area in the target video, or the first input may be an operation of drawing a finger on the target video to delineate the target image area in the target video. This embodiment of the present invention does not limit the form of the first input.

例如参照图2,示出了本发明实施例中提供的一种目标视频的示意图。图2中的圆圈201所圈定的圆圈201的内部区域即为电子设备202根据用户对目标视频的第一输入确定的目标图像区域,目标图像区域为闭合区域。第一输入可以为用户的一次划线操作,也可以为多次划线操作,一次划线操作所圈定的目标图像区域的个数可以为一个,也可以为多个,例如向数字“8”所圈定的目标图像区域则为两个,即有两个闭合区域。第一输入也可以为多次划线操作所圈定的多个闭合区域,本发明对目标图像区域的个数不限制。用户可以通过划线操作圈定自己感兴趣的图像区域。需要说明的是,图2中的一组“★”表示一条弹幕信息,弹幕信息为用户观看目标视频时发表的弹幕信息。For example, referring to FIG. 2 , a schematic diagram of a target video provided in an embodiment of the present invention is shown. The inner area of thecircle 201 enclosed by thecircle 201 in FIG. 2 is the target image area determined by the electronic device 202 according to the user's first input to the target video, and the target image area is a closed area. The first input can be a user's one-time scribing operation or multiple scribing operations. The number of target image areas delineated by one scribing operation can be one or more, for example, to the number "8". The circled target image areas are two, that is, there are two closed areas. The first input may also be multiple closed regions delineated by multiple scribing operations, and the present invention does not limit the number of target image regions. Users can delineate the area of the image they are interested in by scribing. It should be noted that a group of "★" in FIG. 2 represents a piece of bullet screen information, and the bullet screen information is the bullet screen information published when the user watches the target video.

需要说明的是,目标图像区域的形状可以为如图2的圆形区域,也可以为椭圆形区域、方形区域等其他形状的闭合区域,本发明对此不进行限制。It should be noted that the shape of the target image area may be a circular area as shown in FIG. 2 , or may be a closed area of other shapes such as an oval area, a square area, etc., which is not limited in the present invention.

电子设备对目标图像区域进行识别,获得识别结果,电子设备可以将识别结果发送给服务器,从而使服务器获取到电子设备对目标图像区域进行识别后确定的识别结果。识别结果中包括目标图像区域包括的对象信息。例如,电子设备对图2中的目标图像区域进行识别收确定的识别结果为对象信息A,对象信息A可以为A对象的名称。The electronic device recognizes the target image area and obtains the recognition result, and the electronic device can send the recognition result to the server, so that the server obtains the recognition result determined after the electronic device recognizes the target image area. The recognition result includes object information included in the target image area. For example, the recognition result obtained by the electronic device identifying and determining the target image area in FIG. 2 is object information A, and the object information A may be the name of the A object.

步骤102、根据识别结果,从目标视频包括的第一对象信息中确定第二对象信息。Step 102: According to the identification result, determine the second object information from the first object information included in the target video.

目标视频包括的第一对象信息可以为对象的名称。对象例如为某个人或者某个物体等。如果目标视频为时长40分钟的视频,则目标视频包括的第一对象信息为该40分钟内的所有帧视频图像中的对象的信息。以第一对象信息包括对象信息A、对象信息B、对象信息C、对象信息D、以及对象信息E为例,如果在步骤101中确定的识别结果中为对象信息A,则在本步骤中根据识别结果,确定的第二对象信息为第一对象信息中的对象信息A。如果在步骤101中确定的识别结果中为对象信息A和对象信息F,则在本步骤中根据识别结果,确定的第二对象信息为第一对象信息中的对象信息A,即确定的第二对象信息是属于第一对象信息中的信息。The first object information included in the target video may be the name of the object. The object is, for example, a person or an object. If the target video is a video with a duration of 40 minutes, the first object information included in the target video is information of objects in all video frames within the 40 minutes. Taking the first object information including object information A, object information B, object information C, object information D, and object information E as an example, if the identification result determined instep 101 is object information A, then in this step according to As a result of the identification, the determined second object information is the object information A in the first object information. If the identification result determined instep 101 is object information A and object information F, then according to the identification result in this step, the determined second object information is the object information A in the first object information, that is, the determined second object information is the object information A in the first object information. The object information is information belonging to the first object information.

步骤103、从存储的弹幕信息中识别目标弹幕信息,目标弹幕信息包括至少一个第二对象信息。Step 103: Identify target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one second object information.

存储的弹幕信息为观看目标视频的用户通过电子设备向服务器发送的弹幕信息,服务器可以存储弹幕信息,并从存储的弹幕信息中识别包括至少一个第二对象信息的弹幕信息。例如如果在步骤102中确定的第二对象信息为对象信息A,则从存储的弹幕信息中识别包括对象信息A的弹幕信息。如果在步骤102中确定的第二对象信息为对象信息A、对象信息B和对象信息C,则从存储的弹幕信息中识别包括至少一个第二对象信息的目标弹幕信息。The stored bullet screen information is the bullet screen information sent by the user watching the target video to the server through the electronic device. The server can store the bullet screen information and identify the bullet screen information including at least one second object information from the stored bullet screen information. For example, if the second object information determined instep 102 is the object information A, the bullet screen information including the object information A is identified from the stored bullet screen information. If the second object information determined instep 102 is the object information A, the object information B, and the object information C, the target bullet screen information including at least one second object information is identified from the stored bullet screen information.

为了更加清楚介绍上述步骤,下面结合表1进行说明。如果目标视频包括的第一对象信息为:对象信息A、对象信息B、对象信息C、对象信息D、以及对象信息E,服务器中共存储10条弹幕信息,确定的第二对象信息为对象信息A、对象信息B和对象信息C。其中,10条弹幕信息中的弹幕信息1包括对象信息A,弹幕信息2包括对象信息B、弹幕信息3包括对象信息B、弹幕信息4包括对象信息A、弹幕信息5包括对象信息C、弹幕信息6包括对象信息B,弹幕信息7包括对象信息A、弹幕信息8包括对象信息A,弹幕信息9包括对象信息E,弹幕信息10包括对象信息F。如下表1所示,第一列为存储的弹幕信息,第二列为弹幕信息包括的对象信息,第三列为确定的第二对象信息,第三列为目标弹幕信息,第四列为弹幕信息是否为目标弹幕信息,例如,由于弹幕信息1包括对象信息A,因此识别出弹幕信息1是目标弹幕信息,同样识别出弹幕信息2、弹幕信息3、弹幕信息4、弹幕信息5、弹幕信息6、弹幕信息7和弹幕信息8是目标弹幕信息。In order to introduce the above steps more clearly, the following description is made in conjunction with Table 1. If the first object information included in the target video is: object information A, object information B, object information C, object information D, and object information E, the server stores a total of 10 pieces of bullet screen information, and the determined second object information is object information A, object information B and object information C. Among them, the bullet screen information 1 of the 10 bullet screens includes object information A, the bullet screen information 2 includes object information B, the bullet screen information 3 includes object information B, the bullet screen information 4 includes object information A, and the bullet screen information 5 includes object information A. Object information C, bullet screen information 6 includes object information B, bullet screen information 7 includes object information A, bullet screen information 8 includes object information A, bullet screen information 9 includes object information E, and bullet screen information 10 includes object information F. As shown in Table 1 below, the first column is the stored bullet screen information, the second column is the object information included in the bullet screen information, the third column is the determined second object information, the third column is the target bullet screen information, and the fourth column is the target bullet screen information. Whether the bullet screen information is listed as the target bullet screen information, for example, since the bullet screen information 1 includes object information A, it is recognized that the bullet screen information 1 is the target bullet screen information, and the bullet screen information 2, bullet screen information 3, The bullet screen information 4, the bullet screen information 5, the bullet screen information 6, the bullet screen information 7 and the bullet screen information 8 are the target bullet screen information.

Figure BDA0002238070690000071
Figure BDA0002238070690000071

表1Table 1

步骤104、向电子设备发送目标弹幕信息。Step 104: Send the target barrage information to the electronic device.

本实施例提供的弹幕信息识别方法,通过获取电子设备对目标图像区域进行识别后确定的识别结果,根据识别结果,从目标视频包括的第一对象信息中确定第二对象信息,从而使确定的第二对象信息不但属于目标视频中的第一对象信息,而且属于目标图像区域中的对象信息,因此从存储的弹幕信息中识别出的包括至少一个第二对象信息的目标弹幕信息是与目标图像区域中的对象信息相关、且与目标视频相关的弹幕信息,也即目标弹幕信息是用户感兴趣的目标弹幕信息。并向电子设备发送目标弹幕信息,从而使电子设备可以展示目标弹幕信息,从而用能够为用户推送用户真正感兴趣的弹幕信息,丰富并满足用户对弹幕信息的个性化需求。The method for recognizing bullet screen information provided by this embodiment obtains the recognition result determined after the electronic device recognizes the target image area, and determines the second object information from the first object information included in the target video according to the recognition result, so as to determine The second object information not only belongs to the first object information in the target video, but also belongs to the object information in the target image area, so the target bullet screen information including at least one second object information identified from the stored bullet screen information is The bullet screen information related to the object information in the target image area and related to the target video, that is, the target bullet screen information is the target bullet screen information that the user is interested in. And send the target bullet screen information to the electronic device, so that the electronic device can display the target bullet screen information, so that the user can push the bullet screen information that the user is really interested in, enrich and meet the user's personalized needs for the bullet screen information.

参照图3,示出了本发明实施例中提供的另一种弹幕信息识别方法的流程图。Referring to FIG. 3 , a flowchart of another method for identifying bullet screen information provided in an embodiment of the present invention is shown.

步骤301、电子设备接收用户对电子设备上播放的目标视频的第一输入。Step 301: The electronic device receives a first input from a user to a target video played on the electronic device.

步骤302、电子设备响应于第一输入,确定目标视频的目标帧图像,并确定目标帧图像上的目标图像区域。Step 302: The electronic device determines a target frame image of the target video in response to the first input, and determines a target image area on the target frame image.

其中,响应于第一输入,确定目标视频的目标帧图像,并确定目标帧图像上的目标图像区域,可以通过如下步骤实现:Wherein, in response to the first input, determining the target frame image of the target video, and determining the target image area on the target frame image, can be achieved by the following steps:

响应于第一输入,确定与第一输入对应的划线轨迹;In response to the first input, determining a scribe line trajectory corresponding to the first input;

确定与第一输入的结束时刻对应的目标视频的帧图像,将与第一输入的结束时刻对应的目标视频的帧图像作为目标帧图像;Determine the frame image of the target video corresponding to the end moment of the first input, and use the frame image of the target video corresponding to the end moment of the first input as the target frame image;

在划线轨迹为非闭合区域的情况下,将非闭合区域补充为闭合区域,并将目标帧图像上的闭合区域作为目标图像区域;In the case that the line track is a non-closed area, the non-closed area is supplemented as a closed area, and the closed area on the target frame image is used as the target image area;

在划线轨迹不为非闭合区域的情况下,将划线轨迹组成的闭合区域作为目标图像区域。In the case that the scribing track is not a non-closed area, the closed area composed of the scribing track is used as the target image area.

需要说明的是,将与第一输入的结束时刻对应的目标视频的帧图像作为目标帧图像,可以保证根据划线轨迹在目标帧图像上确定的目标图像区域所包括的对象信息的完整性。例如如果用户在进行画圈的划线操作时,如果在画了半个圆圈时的一帧图像只包括A对象,而在整个画圈结束时的一帧图像包括A对象和B对象,而用户的划线轨迹为包括A对象和B对象的闭合区域。如果以画了半个圆圈时的一帧图像作为目标帧图像,则可能会使目标图像区域包括的对象信息只包括A对象,从而是目标图像区域包括的对象信息不够完整。It should be noted that taking the frame image of the target video corresponding to the end time of the first input as the target frame image can ensure the integrity of the object information included in the target image area determined on the target frame image according to the scribing trajectory. For example, if the user draws a circle and draws a line, if a frame of image when half a circle is drawn only includes object A, and a frame of image at the end of the entire circle includes object A and object B, and the user The stroke track of is a closed area including the A object and the B object. If a frame image when a half circle is drawn is used as the target frame image, the object information included in the target image area may only include the A object, so that the object information included in the target image area is not complete enough.

其中,在划线轨迹为非闭合区域的情况下,需要将非闭合区域补充为闭合区域。例如参照图4,图4示出了本发明实施例中提供的一种非闭合区域补充为闭合区域的示意图,即通过图4的虚线将划线轨迹对应的非闭合区域补充为闭合区域。Wherein, in the case where the scribe line track is a non-closed area, the non-closed area needs to be supplemented as a closed area. For example, referring to FIG. 4 , FIG. 4 shows a schematic diagram of supplementing a non-closed area as a closed area according to an embodiment of the present invention, that is, the non-closed area corresponding to the scribed line track is supplemented as a closed area through the dashed line in FIG. 4 .

步骤303、电子设备对目标图像区域进行识别,获得识别结果,并向服务器发送识别结果。Step 303: The electronic device identifies the target image area, obtains the identification result, and sends the identification result to the server.

步骤304、服务器获取目标视频的弹幕信息。Step 304: The server obtains the bullet screen information of the target video.

步骤305、服务器对弹幕信息进行语义分析,获得弹幕信息的至少一个关键字。Step 305: The server performs semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information.

需要说明的是,在步骤305、对弹幕信息进行语义分析,获得弹幕信息的至少一个关键字之前,还可以包括如下步骤:It should be noted that, instep 305, before performing semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information, the following steps may also be included:

在弹幕信息中包括符号信息的情况下,去除弹幕信息中的符号信息。In the case that the bullet screen information includes symbol information, the symbol information in the bullet screen information is removed.

如果弹幕信息中包括符号信息,例如标点符号、表情符号等符号信息,则可以先去除符号信息。如果一条弹幕信息中全是符号信息,则去除符号信息后无需再对该弹幕信息进行语义分析。针对某条弹幕信息中包括较多的符号信息,去除符号信息后只剩余的有效文字信息,有利于提高对有效文字信息进行语义分析的速率。If the bullet screen information includes symbol information, such as punctuation marks, emoticons and other symbol information, the symbol information can be removed first. If a piece of bullet screen information is full of symbol information, it is not necessary to perform semantic analysis on the bullet screen information after removing the symbol information. For a barrage message that includes more symbol information, after removing the symbol information, only the remaining valid text information is beneficial to improve the rate of semantic analysis of the valid text information.

相应的,步骤305对弹幕信息进行语义分析,获得弹幕信息的至少一个关键字可以通过如下步骤实现:Correspondingly,step 305 performs semantic analysis on the bullet screen information, and obtaining at least one keyword of the bullet screen information can be achieved by the following steps:

对去除符号信息的弹幕信息进行语义分析,获得弹幕信息的至少一个关键字。Semantic analysis is performed on the bullet screen information from which the symbol information is removed, and at least one keyword of the bullet screen information is obtained.

其中,关键字例如为对象的名称。The keyword is, for example, the name of the object.

步骤306、将弹幕信息包括的每个关键字与所有第一对象信息进行匹配。Step 306: Match each keyword included in the bullet screen information with all the first object information.

在每个关键字中的一个关键字与所有第一对象信息中的一个第三对象信息匹配的情况下,执行步骤307;在在每个关键字未与任意一个第三对象信息匹配的情况下,执行步骤308。In the case that one keyword in each keyword matches one third object information in all the first object information,step 307 is executed; in the case that each keyword does not match any third object information , and step 308 is executed.

例如,如果一个弹幕信息的关键字包括:对象A的名称(关键字1)、对象B的名称(关键字2),以此类推,对象C的名称(关键字3),在此不一一赘述。第一对象信息中包括对象信息A、对象信息B、对象信息C、对象信息D、以及对象信息E,则该弹幕信息中的关键字1与对象信息A匹配,关键字2与对象信息B匹配,对象信息A即为所有第一对象信息中的一个第三对象信息,对象信息B也为所有第一对象信息中的一个第三对象信息。For example, if the keywords of a bullet chat message include: the name of object A (keyword 1), the name of object B (keyword 2), and so on, the name of object C (keyword 3), which is different here One more elaboration. The first object information includes object information A, object information B, object information C, object information D, and object information E, then the keyword 1 in the bullet screen information matches the object information A, and the keyword 2 matches the object information B. If there is a match, the object information A is a third object information among all the first object information, and the object information B is also a third object information among all the first object information.

例如,结合下表2介绍将弹幕信息包括的每个关键字与所有第一对象信息进行匹配的情况。以上述实施例中举例介绍的10个弹幕信息为例。对弹幕信息1进行语义分析后,获得弹幕信息1的关键字为关键字1;对弹幕信息2进行语义分析后,获得的弹幕信息2的关键字为关键字2;;对弹幕信息3进行语义分析后,获得的弹幕信息3的关键字为关键字2;对弹幕信息4进行语义分析后,获得弹幕信息1的关键字为关键字1;对弹幕信息5进行语义分析后,获得的弹幕信息5的关键字为关键字3(C对象的名称);对弹幕信息6进行语义分析后,获得的弹幕信息6的关键字为关键字2;对弹幕信息7进行语义分析后,获得的弹幕信息7的关键字为关键字1;对弹幕信息8进行语义分析后,获得弹幕信息8的关键字为关键字1;对弹幕信息9进行语义分析后,获得的弹幕信息9的关键字为关键字5(E对象的名称)关键字5;对弹幕信息10进行语义分析后,获得的弹幕信息10的关键字为关键字6(F对象的名称)。如下表2所示,第一列为弹幕信息,第二列为弹幕信息的关键字,第三列为目标视频的所有第一对象信息。For example, the case of matching each keyword included in the bullet screen information with all the first object information is described with reference to Table 2 below. Take the 10 barrage information described in the above embodiment as an example. After semantic analysis of the bullet screen information 1, the keyword of the bullet screen information 1 is obtained as keyword 1; after the semantic analysis of the bullet screen information 2, the obtained keyword of the bullet screen information 2 is keyword 2; After the semantic analysis of the bullet screen information 3, the obtained keyword of the bullet screen information 3 is the keyword 2; after the semantic analysis of the bullet screen information 4, the keyword of the bullet screen information 1 is obtained as the keyword 1; for the bullet screen information 5 After the semantic analysis, the obtained keyword of the bullet screen information 5 is the keyword 3 (the name of the C object); after the semantic analysis of the bullet screen information 6, the obtained keyword of the bullet screen information 6 is the keyword 2; After semantic analysis of the bullet screen information 7, the obtained keyword of the bullet screen information 7 is keyword 1; after semantic analysis of the bullet screen information 8, the keyword of the bullet screen information 8 obtained is keyword 1; 9 After the semantic analysis is performed, the keyword of the obtained bullet screen information 9 is the keyword 5 (the name of the E object) keyword 5; after the semantic analysis of the bullet screen information 10, the keyword of the obtained bullet screen information 10 is the key Word 6 (the name of the F object). As shown in Table 2 below, the first column is the bullet screen information, the second column is the keyword of the bullet screen information, and the third column is all the first object information of the target video.

Figure BDA0002238070690000101
Figure BDA0002238070690000101

表2Table 2

第一对象信息可以为对象的名称,例如对象信息A即为对象A的名称,对象信息B即为对象B的名称。由于关键字为对象的名称,第一对象信息也为对象的名称,因此可以将关键字与第一对象信息进行匹配。由上述表2以及介绍可知,弹幕信息1的关键字1与所有第一对象信息中的对象信息A匹配;弹幕信息2的关键字2与所有第一对象信息中的对象信息B匹配;弹幕信息3的关键字2所有第一对象信息中的对象信息B匹配;弹幕信息4的关键字1所有第一对象信息中的对象信息A匹配;弹幕信息5的关键字3所有第一对象信息中的对象信息C匹配;其他弹幕信息与所有第一对象信息中的一个第三对象信息是否匹配不再一一举例说明。需要说明的是,由于弹幕信息10的关键字为关键字6(对象F的名称),所有第一对象信息中不存在任何一个第三对象信息与关键字6匹配。The first object information may be the name of the object, for example, the object information A is the name of the object A, and the object information B is the name of the object B. Since the keyword is the name of the object, and the first object information is also the name of the object, the keyword can be matched with the first object information. As can be seen from the above Table 2 and the introduction, the keyword 1 of the bullet screen information 1 matches the object information A in all the first object information; the keyword 2 of the bullet screen information 2 matches the object information B in all the first object information; The keyword 2 of the bullet screen information 3 matches the object information B in all the first object information; the keyword 1 of the bullet screen information 4 matches the object information A in all the first object information; the keyword 3 of the bullet screen information 5 matches all the first object information. Object information C in an object information matches; whether other bullet screen information matches a third object information in all the first object information will not be illustrated one by one. It should be noted that, since the keyword of the bullet screen information 10 is the keyword 6 (the name of the object F), none of the third object information matches the keyword 6 in all the first object information.

步骤307、服务器存储第三对象信息、以及与第三对象信息关联的弹幕信息。Step 307: The server stores the third object information and the bullet screen information associated with the third object information.

由上述表2以及介绍可知,弹幕信息1的关键字1与所有第一对象信息中的对象信息A(第三对象信息)匹配,则存储对象信息A、以及对象信息A关联的弹幕信息1;同样,弹幕信息2的关键字2与所有第一对象信息中的对象信息B(第三对象信息)匹配,弹幕信息中的每个关键字是否与所有第一对象信息中的一个第三对象信息匹配不再一一举例介绍,具体可以参照如下表3中示出的存储第三对象信息、以及与第三对象信息关联的弹幕信息。参照表3所示:It can be seen from the above Table 2 and the introduction that the keyword 1 of the bullet screen information 1 matches the object information A (third object information) in all the first object information, then the object information A and the bullet screen information associated with the object information A are stored. 1; Similarly, the keyword 2 of the bullet screen information 2 matches the object information B (third object information) in all the first object information, whether each keyword in the bullet screen information matches one of all the first object information The third object information matching will not be described one by one. For details, please refer to the storage of the third object information and the bullet screen information associated with the third object information as shown in Table 3 below. Refer to Table 3:

第三对象信息third object information与第三对象信息关联的弹幕信息The bullet screen information associated with the third object information对象信息AObject Information A弹幕信息1Barrage Information 1对象信息BObject Information B弹幕信息2Barrage Information 2对象信息BObject Information B弹幕信息3Barrage Information 3对象信息AObject Information A弹幕信息4Barrage Information 4对象信息CObject Information C弹幕信息5Barrage Information 5对象信息BObject Information B弹幕信息6Barrage Information 6对象信息AObject Information A弹幕信息7Barrage Information 7对象信息AObject Information A弹幕信息8Barrage Information 8对象信息EObject Information E弹幕信息9Barrage Information 9

表3table 3

步骤308、服务器存储无关信息、以及与无关信息关联的弹幕信息。Step 308: The server stores irrelevant information and the bullet screen information associated with the irrelevant information.

由于弹幕信息10包括的关键字为关键字6,而所有第一对象信息中不存在任意一个第三对象信息与关键字6匹配,因此,可以确定该弹幕信息为无关信息,即该弹幕信息是与目标图像区域中的对象信息无关的信息,则存储无关信息、以及与无关信息关联的弹幕信息10。Since the keyword included in the bullet screen information 10 is keyword 6, and none of the third object information matches the keyword 6 in all the first object information, it can be determined that the bullet screen information is irrelevant information, that is, the bullet screen information is irrelevant information. The screen information is information irrelevant to the object information in the target image area, and the irrelevant information and the bullet screen information 10 associated with the irrelevant information are stored.

步骤309、服务器获取电子设备对目标图像区域进行识别后确定的识别结果。Step 309: The server obtains the recognition result determined after the electronic device recognizes the target image area.

步骤310、在识别结果与所有第一对象信息中的至少一个第一对象信息匹配的情况下,则服务器将与识别结果匹配的第一对象信息作为第二对象信息。Step 310: If the identification result matches at least one piece of first object information among all the first object information, the server uses the first object information matching the identification result as the second object information.

结合上述实施例中的举例介绍,在此仍以所有第一对象信息包括对象信息A、对象信息B、对象信息C、对象信息D、以及对象信息E为例,如果在步骤309中服务器获取的识别结果中为对象信息A,则在本步骤中与识别结果匹配的至少一个第一对象信息为所有第一对象信息中对象信息A,则将对象信息A作为第二对象信息。如果在步骤309中服务器获取的识别结果中为对象信息A、对象信息B和对象信息C,则在本步骤中与识别结果匹配的至少一个第一对象信息包括所有第一对象信息中对象信息A、对象信息B和对象信息C,则将对象信息A、对象信息B和对象信息C都作为第二对象信息。如果在步骤309中服务器获取的识别结果为对象信息F,则所有第一对象信息中的不存一个任何一个与对象信息F匹配的对象信息。In combination with the examples in the above-mentioned embodiments, here still take all the first object information including object information A, object information B, object information C, object information D, and object information E as an example, if instep 309 the server obtains the If the identification result is object information A, then at least one first object information matching the identification result in this step is object information A in all the first object information, and the object information A is used as the second object information. If the identification result obtained by the server instep 309 is object information A, object information B and object information C, then at least one piece of first object information matching the identification result in this step includes object information A in all the first object information , object information B and object information C, the object information A, object information B and object information C are all used as the second object information. If the identification result obtained by the server instep 309 is the object information F, there is no object information that matches the object information F in all the first object information.

步骤311、在存储的弹幕信息中存在包括至少一个第二对象信息的弹幕信息的情况下,服务器将包括至少一个第二对象信息的弹幕信息作为目标弹幕信息。Step 311 : In the case where there is bullet screen information including at least one second object information in the stored bullet screen information, the server uses the bullet screen information including at least one second object information as the target bullet screen information.

其中,存储的弹幕信息包括与第三对象信息关联的弹幕信息和/或与无关信息关联的弹幕信息。Wherein, the stored bullet screen information includes bullet screen information associated with the third object information and/or bullet screen information associated with irrelevant information.

需要说明的是,由于存储了第三对象信息、以及与第三对象信息关联的弹幕信息,也即第三对象信息与弹幕信息二者关联,服务器可以直接从与弹幕信息关联第三对象信息中判断是否包括至少一个第二对象信息,如果与弹幕信息关联的第三信息中包括至少一个第二对象信息,则将与该第三对象信息关联的弹幕信息作为目标弹幕信息,无需服务器再识别弹幕信息中是否包括至少一个第二对象信息即可以确定出目标弹幕信息,从而在一定程度上加快识别目标弹幕信息的效率,进而可以较快的将目标弹幕信息发送给电子设备进行展示。It should be noted that, since the third object information and the bullet screen information associated with the third object information are stored, that is, the third object information is associated with the bullet screen information, the server can directly associate the third object information with the bullet screen information from the third object information. Determine whether the object information includes at least one second object information. If the third information associated with the bullet screen information includes at least one second object information, the bullet screen information associated with the third object information is used as the target bullet screen information. , the target bullet screen information can be determined without the server re-identifying whether the bullet screen information includes at least one second object information, so as to speed up the efficiency of identifying the target bullet screen information to a certain extent, and then the target bullet screen information can be quickly identified. Send to electronic device for display.

例如,如果第二对象信息为对象信息A,以上述表3中的弹幕信息1为例,弹幕信息1与第三对象信息(对象信息A)关联,因此可以直接从二者的关联关系中确定第三对象信息(对象信息A)中包括与第二对象信息(对象信息A)匹配的对象信息,因此,弹幕信息1即为目标弹幕信息。无需在确定出第二对象信息后,再对弹幕信息进行语义分析,再判断出哪些弹幕信息属于目标弹幕信息,因此在一定程度上提高了识别出目标弹幕信息的效率。For example, if the second object information is object information A, taking the bullet screen information 1 in the above Table 3 as an example, the bullet screen information 1 is associated with the third object information (object information A), so the relationship between the two can be directly derived from the relationship between the two. It is determined that the third object information (object information A) includes object information that matches the second object information (object information A), therefore, the bullet screen information 1 is the target bullet screen information. There is no need to perform semantic analysis on the bullet screen information after determining the second object information, and then determine which bullet screen information belongs to the target bullet screen information, thus improving the efficiency of identifying the target bullet screen information to a certain extent.

具体的,可以判断存储的弹幕信息包括与第三对象信息关联的弹幕信息和/或与无关信息关联的弹幕信息是否存在包括至少一个第二对象信息的弹幕信息,如果存在包括至少一个第二对象信息的弹幕信息,则将包括至少一个第二对象信息的弹幕信息作为目标弹幕信息;如果不存在包括至少一个第二对象信息的弹幕信息,则认为未识别出目标弹幕信息。Specifically, it can be determined whether the stored bullet screen information includes the bullet screen information associated with the third object information and/or the bullet screen information associated with irrelevant information whether there is bullet screen information including at least one second object information, if there is bullet screen information including at least one second object information A bullet screen information of the second object information, the bullet screen information including at least one second object information is used as the target bullet screen information; if there is no bullet screen information including at least one second object information, it is considered that the target is not identified. Barrage information.

需要说明的是,如果存储的弹幕信息全部都是与无关信息关联的弹幕信息,则服务器不会识别出目标弹幕信息,服务器可以向电子设备发送提示信息,以提示用户重新执行在目标视频上圈定一个区域。如果存储的弹幕信息包括与第三对象信息关联的弹幕信息,则可以存储的弹幕信息中识别包括至少一个第二对象信息的弹幕信息,并将识别出的包括至少一个第二对象信息的弹幕信息作为目标弹幕信息。例如,第二对象信息包括对象信息A、对象信息B和对象信息C,则根据上述表3,目标弹幕信息包括。It should be noted that if all the stored bullet screen information is related to irrelevant information, the server will not recognize the target bullet screen information, and the server can send prompt information to the electronic device to prompt the user to re-execute the target bullet screen information. Delineate an area on the video. If the stored bullet screen information includes the bullet screen information associated with the third object information, the bullet screen information including at least one second object information can be identified in the stored bullet screen information, and the identified bullet screen information includes at least one second object information. The bullet chat information of the information is used as the target bullet chat information. For example, if the second object information includes object information A, object information B, and object information C, according to the above Table 3, the target bullet screen information includes.

步骤312、若第二对象信息为多个,则服务器根据每个二对象信息,对目标弹幕信息划分类别,获得每个类别的目标弹幕信息。Step 312: If there are multiple pieces of second object information, the server classifies the target bullet screen information according to each second object information, and obtains target bullet screen information of each category.

例如,若第二对象信息包括对象信息A、对象信息B和对象信息C,服务器可以根据每个二对象信息,对目标弹幕信息划分类别,获得每个类别的目标弹幕信息,如下表4所示:For example, if the second object information includes object information A, object information B and object information C, the server can classify the target bullet screen information according to each two object information, and obtain the target bullet screen information of each category, as shown in Table 4 below. shown:

Figure BDA0002238070690000141
Figure BDA0002238070690000141

表4Table 4

需要说明的是,由于有些弹幕信息中可以包括多个对象信息,例如包括对象信息A、对象信息B、对象信息C,则可以将包括多个对象信息的弹幕信息与对象信息A或对象信息B或对象信息C归为一类,也可以独立于对象信息A、对象信息B和对象信息C单独归为一类,本发明对此不进行限制,本实施例中仅以弹幕信息中包括一个第二对象信息进行示例说明。It should be noted that since some bullet screen information can include multiple object information, such as object information A, object information B, and object information C, the bullet screen information including multiple object information can be combined with object information A or object information. Information B or object information C are classified into one category, and can also be classified into one category independently of object information A, object information B, and object information C. The present invention does not limit this. In this embodiment, only the bullet screen information is used. A second object information is included for illustration.

如上表4,类别1的目标弹幕信息包括弹幕信息1、弹幕信息4、弹幕信息7和弹幕信息8;类别2的目标弹幕信息包括弹幕信息2、弹幕信息3和弹幕信息6;类别3的目标弹幕信息包括弹幕信息5。As shown in Table 4 above, the target bullet screen information of category 1 includes bullet screen information 1, bullet screen information 4, bullet screen information 7 and bullet screen information 8; the target bullet screen information of category 2 includes bullet screen information 2, bullet screen information 3 and The bullet screen information 6; the target bullet screen information of category 3 includes the bullet screen information 5.

步骤313、服务器向电子设备发送每个类别的目标弹幕信息。Step 313: The server sends the target barrage information of each category to the electronic device.

相应的,电子设备接收服务器发送的每个类别的目标弹幕信息;按照每个类别显示与每个类别的目标弹幕信息。Correspondingly, the electronic device receives the target bullet screen information of each category sent by the server; and displays the target bullet screen information of each category according to each category.

参照图5,示出了本发明实施例中提供的一种与每个类别的目标弹幕信息显示的示意图。图5中示出的A即为与对象信息A(第二对象信息)对应的对象,A右边显示的即为类别1的目标弹幕信息。由一组“★”表示一条弹幕信息,类别1的右边显示了4条目标弹幕信息(弹幕信息1、弹幕信息4、弹幕信息7和弹幕信息8),其他类别的目标弹幕信息不再一一介绍。Referring to FIG. 5 , it is a schematic diagram of displaying information on a target barrage of each category provided in an embodiment of the present invention. A shown in FIG. 5 is the object corresponding to the object information A (second object information), and the target barrage information of category 1 is displayed to the right of A. A group of "★" represents a piece of bullet chat information, and the right side of category 1 displays 4 target bullet chat information (Bullet Chat Information 1, Bullet Chat Information 4, Bullet Chat Information 7 and Bullet Chat Information 8), other categories of targets The bullet screen information will not be introduced one by one.

还可以包括如下步骤:The following steps may also be included:

服务器根据每个所述第二对象信息,生成缩略图;The server generates a thumbnail image according to each of the second object information;

服务器向所述电子设备发送所述缩略图,以供所述电子设备显示所述缩略图。The server sends the thumbnail image to the electronic device for the electronic device to display the thumbnail image.

需要说明的是,服务器可以在向电子设备发送每个类别的目标弹幕信息之后,向电子设备发送缩略图;也可以向电子设备发送每个类别的目标弹幕信息之前,向电子设备发送缩略图;或者向电子设备发送每个类别的目标弹幕信息时,同时向电子设备发送缩略图。本发明对服务器向电子设备发送缩略图的时机不进行限制。It should be noted that the server may send a thumbnail image to the electronic device after sending the target bullet screen information of each category to the electronic device; or send a thumbnail image to the electronic device before sending the target bullet screen information of each category to the electronic device. Thumbnails; or when sending the target barrage information of each category to the electronic device, send the thumbnails to the electronic device at the same time. The present invention does not limit the timing when the server sends the thumbnail image to the electronic device.

相应的,电子设备接收服务器发送的缩略图,缩略图为服务器根据每个第二对象信息生成的;显示缩略图;Correspondingly, the electronic device receives the thumbnail image sent by the server, and the thumbnail image is generated by the server according to the information of each second object; the thumbnail image is displayed;

在显示缩略图之后,电子设备可以接收用户对缩略图的第二输入;响应于第二输入,控制每个类别的目标弹幕信息的移动方向和移动距离,或者隐藏缩略图。After displaying the thumbnails, the electronic device may receive a second input of the thumbnails by the user; in response to the second input, control the moving direction and moving distance of the target bullet screen information of each category, or hide the thumbnails.

例如,如图5,电子设备可以在如图5的左上角显示的缩略图501,第二输入为用户拖动缩略图501上下滑动或者向左滑动时对应的输入,拖动缩略图501向上滑动,则每个类别的目标弹幕信息可以向上滑动。若拖动缩略图501向下滑动,则每个类别的目标弹幕信息可以向下滑动。若拖动缩略图501向左滑动,则可以隐藏缩略图501。需要说明的是,每个类别的目标弹幕信息的滑动距离可以与缩略图501滑动的距离相同。通过本步骤,可以使用户控制弹幕在目标视频中显示的位置或者隐藏缩略图。For example, as shown in FIG. 5 , the electronic device may use the thumbnail 501 shown in the upper left corner of FIG. 5 , the second input is the corresponding input when the user drags the thumbnail 501 to slide up and down or to the left, drag the thumbnail 501 to slide up , the target barrage information of each category can be swiped up. If the thumbnail 501 is dragged and slid down, the target bullet screen information of each category can be slid down. If the thumbnail 501 is dragged to the left, the thumbnail 501 can be hidden. It should be noted that, the sliding distance of the target bullet screen information of each category may be the same as the sliding distance of the thumbnail 501 . Through this step, the user can control the displayed position of the bullet screen in the target video or hide the thumbnail.

在显示缩略图之后,还可以包括如下步骤:After the thumbnails are displayed, the following steps may also be included:

接收用户对缩略图的第三输入;响应于第三输入,展开缩略图中包括的与每个类别对应的对象图标;接收用户对所有对象图标中的第一目标对象图标的第四输入;响应于第四输入,调整目标对象图标在缩略图中的位置,并根据每个类别对应的对象图标在缩略图中的位置,对每个类别的目标弹幕信息进行排序,获得排序结果;显示排序结果。receiving a third input from the user on the thumbnail; in response to the third input, expanding the object icons corresponding to each category included in the thumbnail; receiving a fourth input from the user on the first target object icon among all the object icons; responding In the fourth input, adjust the position of the target object icon in the thumbnail, and sort the target barrage information of each category according to the position of the object icon corresponding to each category in the thumbnail to obtain the sorting result; display the sorting result.

参照图6,示出了本发明实施例中提供的一种对象图标展示示意图,用第三输入可以为用户点击如图5的缩略图501的操作,电子设备响应于第三输入,展开缩略图501中包括的与每个类别对应的对象图标,如图6:与类别1对应的对象图标为“A”,与类别2对应的对象图标为“B”,与类别3对应的对象图标为“C”。Referring to FIG. 6 , a schematic diagram of an object icon display provided in an embodiment of the present invention is shown. A third input can be used for a user to click on the thumbnail 501 in FIG. 5 . The electronic device responds to the third input and expands the thumbnail. The object icon corresponding to each category included in 501 is shown in Figure 6: the object icon corresponding to category 1 is "A", the object icon corresponding to category 2 is "B", and the object icon corresponding to category 3 is " C".

参照图7,示出了本发明实施例中提供的一种目标弹幕信息排序以及突出处理的示意图。第四输入可以为用户拖动对象图标,以改变拖动的对象图标的显示位置、以及改变与拖动的对象图标对应的类别的目标弹幕信息的显示顺序,如图7,当用户拖动对象图标A挪动到如图6的对象图标B位置后,对象图标A和对象图标B的位置互换,并且,类别1的目标弹幕信息和类别2的目标弹幕信息的位置互换。即类别1的目标弹幕信息由如图6的第一行改变为如图7的第二行,类别2的目标弹幕信息由如图6的第二行改变为排在第一行。Referring to FIG. 7 , a schematic diagram of sorting and highlighting of target bullet screen information provided in an embodiment of the present invention is shown. The fourth input can be that the user drags the object icon to change the display position of the dragged object icon and change the display order of the target bullet screen information of the category corresponding to the dragged object icon, as shown in Figure 7, when the user drags After the object icon A is moved to the position of the object icon B as shown in FIG. 6 , the positions of the object icon A and the object icon B are exchanged, and the positions of the target bullet screen information of category 1 and the target bullet screen information of category 2 are interchanged. That is, the target bullet screen information of category 1 is changed from the first row in Figure 6 to the second row in Figure 7, and the target bullet screen information of category 2 is changed from the second row in Figure 6 to the first row.

其中,在响应于第三输入,展开缩略图中包括的与每个类别对应的对象图标之后,还可以包括如下步骤:Wherein, after expanding the object icon corresponding to each category included in the thumbnail image in response to the third input, the following steps may be further included:

接收用户对所有对象图标中的第二目标对象图标的第五输入;receiving a fifth input from the user to the second target object icon among all the object icons;

响应于第五输入,确定与第二目标对象图标对应的目标类别,对目标类别的目标弹幕信息进行突出处理,并显示突出处理后的目标类别的目标弹幕信息。In response to the fifth input, the target category corresponding to the second target object icon is determined, the target bullet screen information of the target category is highlighted, and the highlighted target bullet screen information of the target category is displayed.

第五输入可以为用户点击由缩略图中展开的对象图标的操作,如图7,当用户点击对象图标A后,电子设备可以确定与对象图标A对应的目标类别为类别1,可以对类别1的目标弹幕信息进行突出处理,并显示突出处理后的目标类别的目标弹幕信息。对目标类别的目标弹幕信息进行突出处理例如将目标弹幕信息的字体加粗、加大或改变颜色等。图7示出了将类别1的目标弹幕信息的字体进行加粗的突出处理。The fifth input can be the operation of the user clicking the object icon expanded in the thumbnail image, as shown in FIG. 7 , after the user clicks the object icon A, the electronic device can determine that the target category corresponding to the object icon A is category 1, and can The target bullet chat information is highlighted, and the target bullet chat information of the highlighted target category is displayed. The target bullet chat information of the target category is highlighted, for example, the font of the target bullet chat information is bolded, enlarged, or its color is changed. FIG. 7 shows that the font of the target bullet screen information of category 1 is highlighted in bold.

参照图8,示出了本发明实施例中提供的一种服务器800的框图。服务器800包括:Referring to FIG. 8, a block diagram of aserver 800 provided in an embodiment of the present invention is shown.Server 800 includes:

第一获取模块810,用于获取电子设备对目标图像区域进行识别后确定的识别结果,所述目标图像区域为所述电子设备根据用户对目标视频的第一输入确定的,所述目标视频为所述电子设备上当前播放的视频;The first obtainingmodule 810 is configured to obtain the recognition result determined by the electronic device after identifying the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is: the video currently playing on the electronic device;

确定模块820,用于根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息;a determiningmodule 820, configured to determine second object information from the first object information included in the target video according to the identification result;

识别模块830,用于从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;Theidentification module 830 is configured to identify target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one of the second object information;

发送模块840,用于向所述电子设备发送所述目标弹幕信息。The sendingmodule 840 is configured to send the target bullet screen information to the electronic device.

参照图9,示出了本发明实施例中提供的另一种服务器900的框图,服务器900还可以包括:Referring to FIG. 9 , a block diagram of anotherserver 900 provided in an embodiment of the present invention is shown. Theserver 900 may further include:

第二获取模块910,用于获取所述目标视频的弹幕信息;The second obtainingmodule 910 is configured to obtain the bullet screen information of the target video;

分析模块920,用于对所述弹幕信息进行语义分析,获得所述弹幕信息的至少一个关键字;Ananalysis module 920, configured to perform semantic analysis on the bullet screen information, and obtain at least one keyword of the bullet screen information;

匹配模块930,用于将所述弹幕信息包括的每个所述关键字与所有所述第一对象信息进行匹配;Amatching module 930, configured to match each of the keywords included in the bullet screen information with all the first object information;

存储模块940,用于在每个所述关键字中的一个关键字与所有所述第一对象信息中的一个第三对象信息匹配的情况下,存储所述第三对象信息、以及与所述第三对象信息关联的所述弹幕信息。Thestorage module 940 is configured to store the third object information and the third object information with The bullet screen information associated with the third object information.

可选的,服务器900还可以包括:Optionally, theserver 900 may further include:

去除模块950,用于在所述弹幕信息中包括符号信息的情况下,去除所述弹幕信息中的符号信息;Aremoval module 950, configured to remove the symbol information in the bullet screen information when the bullet screen information includes symbol information;

相应的,所述分析模块920,具体用于对去除所述符号信息的弹幕信息进行语义分析,获得所述弹幕信息的至少一个所述关键字。Correspondingly, theanalysis module 920 is specifically configured to perform semantic analysis on the bullet screen information from which the symbol information is removed, and obtain at least one of the keywords of the bullet screen information.

可选的,所述存储模块940,还用于在每个所述关键字未与任意一个所述第三对象信息匹配的情况下,存储无关信息、以及与所述无关信息关联的所述弹幕信息。Optionally, thestorage module 940 is further configured to store irrelevant information and the bullets associated with the irrelevant information when each of the keywords does not match any one of the third object information. screen information.

可选的,所述识别模块830,具体用于在存储的所述弹幕信息中存在包括至少一个所述第二对象信息的弹幕信息的情况下,将包括至少一个所述第二对象信息的弹幕信息作为所述目标弹幕信息;所述存储的所述弹幕信息包括与所述第三对象信息关联的弹幕信息和/或与所述无关信息关联的所述弹幕信息。Optionally, theidentification module 830 is specifically configured to include at least one of the second object information in the case where there is bullet screen information including at least one of the second object information in the stored bullet screen information The information of the bullet screen is used as the target bullet screen information; the stored bullet screen information includes the bullet screen information associated with the third object information and/or the bullet screen information associated with the irrelevant information.

可选的,所述确定模块820,具体用于在所述识别结果与所有所述第一对象信息中的至少一个第一对象信息匹配的情况下,则将与所述识别结果匹配的所述第一对象信息作为所述第二对象信息。Optionally, the determiningmodule 820 is specifically configured to, in the case that the identification result matches at least one first object information among all the first object information, the The first object information is used as the second object information.

可选的,服务器900还可以包括:Optionally, theserver 900 may further include:

类别划分模块960,用于若所述第二对象信息为多个,则根据每个所述二对象信息,对所述目标弹幕信息划分类别,获得每个所述类别的目标弹幕信息;Thecategory dividing module 960 is configured to classify the target bullet screen information according to each of the two object information if there are multiple pieces of the second object information, and obtain the target bullet screen information of each category;

相应的,所述发送模块840,具体用于向所述电子设备发送每个所述类别的目标弹幕信息。Correspondingly, the sendingmodule 840 is specifically configured to send the target bullet screen information of each category to the electronic device.

可选的,发送模块840,还用于根据每个所述第二对象信息,生成缩略图;向所述电子设备发送所述缩略图,以供所述电子设备显示所述缩略图。Optionally, the sendingmodule 840 is further configured to generate a thumbnail image according to each of the second object information; and send the thumbnail image to the electronic device, so that the electronic device can display the thumbnail image.

参照图10,示出了本发明实施例中提供的一种电子设备1000的框图。Referring to FIG. 10 , a block diagram of anelectronic device 1000 provided in an embodiment of the present invention is shown.

电子设备1000包括:Electronic device 1000 includes:

第一接收模块1010,用于接收用户对所述电子设备上播放的目标视频的第一输入;Thefirst receiving module 1010 is configured to receive the first input from the user to the target video played on the electronic device;

确定模块1020,用于响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;a determiningmodule 1020, configured to determine a target frame image of the target video in response to the first input, and determine a target image area on the target frame image;

识别模块1030,用于对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;Theidentification module 1030 is configured to identify the target image area, obtain the identification result, and send the identification result to the server, so that the server can extract the first object information included in the target video from the first object information according to the identification result. determining the second object information in the system, and identifying the target bullet screen information from the stored bullet screen information, the target bullet screen information including at least one of the second object information;

第二接收模块1040,用于接收所述服务器发送的所述目标弹幕信息;Thesecond receiving module 1040 is configured to receive the target bullet screen information sent by the server;

目标弹幕信息显示模块1050,用于显示所述目标弹幕信息。The target bullet screeninformation display module 1050 is configured to display the target bullet screen information.

可选的,所述确定模块1020,具体用于响应于所述第一输入,确定与所述第一输入对应的划线轨迹;Optionally, the determiningmodule 1020 is specifically configured to, in response to the first input, determine a scribed trajectory corresponding to the first input;

确定与所述第一输入的结束时刻对应的所述目标视频的帧图像,将与所述第一输入的结束时刻对应的所述目标视频的帧图像作为所述目标帧图像;determining the frame image of the target video corresponding to the end moment of the first input, and using the frame image of the target video corresponding to the end moment of the first input as the target frame image;

在所述划线轨迹为所述非闭合区域的情况下,将所述非闭合区域补充为闭合区域,并将所述目标帧图像上的所述闭合区域作为所述目标图像区域;In the case that the scribing track is the non-closed area, the non-closed area is supplemented as a closed area, and the closed area on the target frame image is used as the target image area;

在所述划线轨迹不为所述非闭合区域的情况下,将所述划线轨迹组成的闭合区域作为所述目标图像区域。In the case that the scribed line track is not the non-closed region, the closed region formed by the scribed line track is used as the target image region.

可选的,所述第二接收模块1040,具体用于接收所述服务器发送的每个类别的目标弹幕信息,所述类别的目标弹幕信息为所述服务器根据每个所述二对象信息,对所述目标弹幕信息划分类别获得的;按照每个所述类别显示与每个所述类别的目标弹幕信息。Optionally, thesecond receiving module 1040 is specifically configured to receive the target bullet screen information of each category sent by the server, and the target bullet screen information of the category is the target bullet screen information of the server according to each of the two object information. , which is obtained by classifying the target bullet screen information into categories; the target bullet screen information of each category is displayed according to each category.

可选的,参照图11,示出了本发明实施例中提供的另一种电子设备1100的框图,电子设备1100还可以包括:Optionally, referring to FIG. 11 , a block diagram of anotherelectronic device 1100 provided in an embodiment of the present invention is shown, and theelectronic device 1100 may further include:

第三接收模块1110,用于接收所述服务器发送的缩略图,所述缩略图为所述服务器根据每个所述第二对象信息生成的;Athird receiving module 1110, configured to receive a thumbnail image sent by the server, where the thumbnail image is generated by the server according to each of the second object information;

缩略图显示模块1120,用于显示所述缩略图;athumbnail display module 1120, configured to display the thumbnail;

第四接收模块1130,用于接收用户对所述缩略图的第二输入;afourth receiving module 1130, configured to receive a second input of the thumbnail from the user;

控制模块1140,用于响应于所述第二输入,控制每个所述类别的目标弹幕信息的移动方向和移动距离,或者隐藏所述缩略图。Thecontrol module 1140 is configured to, in response to the second input, control the moving direction and moving distance of the target bullet screen information of each of the categories, or hide the thumbnails.

可选的,参照图12,示出了本发明实施例中提供的又一种电子设备1200的框图,电子设备1200还可以包括:Optionally, referring to FIG. 12 , a block diagram of anotherelectronic device 1200 provided in an embodiment of the present invention is shown, and theelectronic device 1200 may further include:

第五接收模块1210,用于接收所述用户对所述缩略图的第三输入;afifth receiving module 1210, configured to receive a third input from the user to the thumbnail;

对象图标展开模块1220,用于响应于所述第三输入,展开所述缩略图中包括的与每个所述类别对应的对象图标;an objecticon expansion module 1220, configured to, in response to the third input, expand the object icons corresponding to each of the categories included in the thumbnail;

第六接收模块1230,用于接收所述用户对所有所述对象图标中的第一目标对象图标的第四输入;asixth receiving module 1230, configured to receive a fourth input from the user to the first target object icon among all the object icons;

排序模块1240,用于响应于所述第四输入,调整所述目标对象图标在所述缩略图中的位置,并根据每个所述类别对应的对象图标在所述缩略图中的位置,对每个所述类别的目标弹幕信息进行排序,获得排序结果;Thesorting module 1240 is configured to adjust the position of the target object icon in the thumbnail in response to the fourth input, and, according to the position of the object icon corresponding to each category in the thumbnail Sort the target bullet screen information of each category to obtain the sorting result;

排序结果显示模块1250,用于显示所述排序结果。The sortingresult display module 1250 is configured to display the sorting result.

可选的,电子设备1200还可以包括:Optionally, theelectronic device 1200 may further include:

第七接收模块1260,用于接收所述用户对所有所述对象图标中的第二目标对象图标的第五输入;aseventh receiving module 1260, configured to receive a fifth input from the user to the second target object icon in all the object icons;

处理模块1270,用于响应于所述第五输入,确定与所述第二目标对象图标对应的目标类别,对所述目标类别的目标弹幕信息进行突出处理,并显示突出处理后的所述目标类别的目标弹幕信息。Theprocessing module 1270 is configured to, in response to the fifth input, determine a target category corresponding to the second target object icon, perform highlight processing on the target bullet screen information of the target category, and display the highlighted processing The target barrage information of the target category.

图13为实现本发明各个实施例的一种电子设备的硬件结构示意图,13 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention,

该电子设备1300包括但不限于:射频单元1301、网络模块1302、音频输出单元1303、输入单元1304、传感器1305、显示单元1306、用户输入单元1307、接口单元1308、存储器1309、处理器1310、以及电源1311等部件。本领域技术人员可以理解,图13中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。在本发明实施例中,电子设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。Theelectronic device 1300 includes but is not limited to: aradio frequency unit 1301, anetwork module 1302, anaudio output unit 1303, aninput unit 1304, asensor 1305, adisplay unit 1306, auser input unit 1307, aninterface unit 1308, amemory 1309, aprocessor 1310, andPower 1311 and other components. Those skilled in the art can understand that the structure of the electronic device shown in FIG. 13 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than the one shown, or combine some components, or different components layout. In this embodiment of the present invention, the electronic device includes but is not limited to a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

其中,处理器1310,用于接收用户对所述电子设备上播放的目标视频的第一输入;Wherein, theprocessor 1310 is configured to receive the first input from the user to the target video played on the electronic device;

响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;In response to the first input, determining a target frame image of the target video, and determining a target image area on the target frame image;

对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息;Identify the target image area, obtain a recognition result, and send the recognition result to the server, so that the server can determine second object information from the first object information included in the target video according to the recognition result , and identify the target bullet screen information from the stored bullet screen information, the target bullet screen information includes at least one of the second object information;

接收所述服务器发送的所述目标弹幕信息;receiving the target bullet screen information sent by the server;

显示所述目标弹幕信息。Display the target barrage information.

在本发明实施例中,通过确定目标帧图像上的目标图像区域,对目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器根据所述识别结果,从所述目标视频包括的第一对象信息中确定第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括至少一个所述第二对象信息,接收并显示服务器发送的目标弹幕信息。从而实现显示与用户感兴趣的目标图像区域的对象信息相关的目标弹幕信息,满足用户的个性化需求。In the embodiment of the present invention, the target image area on the target frame image is determined, the target image area is identified, the identification result is obtained, and the identification result is sent to the server, so that the server can retrieve the identification result from the identification result. The second object information is determined from the first object information included in the target video, and the target bullet screen information is identified from the stored bullet screen information, the target bullet screen information includes at least one piece of the second object information, received and displayed The target barrage information sent by the server. Thereby, the target bullet screen information related to the object information of the target image area that the user is interested in is displayed, so as to meet the user's personalized needs.

应理解的是,本发明实施例中,射频单元1301可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器1310处理;另外,将上行的数据发送给基站。通常,射频单元1301包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元1301还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in this embodiment of the present invention, theradio frequency unit 1301 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by theprocessor 1310; The uplink data is sent to the base station. Generally, theradio frequency unit 1301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, theradio frequency unit 1301 can also communicate with the network and other devices through a wireless communication system.

电子设备通过网络模块1302为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The electronic device provides the user with wireless broadband Internet access through thenetwork module 1302, such as helping the user to send and receive emails, browse web pages, access streaming media, and the like.

音频输出单元1303可以将射频单元1301或网络模块1302接收的或者在存储器1309中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元1303还可以提供与电子设备1300执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元1303包括扬声器、蜂鸣器以及受话器等。Theaudio output unit 1303 may convert audio data received by theradio frequency unit 1301 or thenetwork module 1302 or stored in thememory 1309 into audio signals and output as sound. Also, theaudio output unit 1303 may also provide audio output related to a specific function performed by the electronic device 1300 (eg, call signal reception sound, message reception sound, etc.). Theaudio output unit 1303 includes a speaker, a buzzer, a receiver, and the like.

输入单元1304用于接收音频或视频信号。输入单元1304可以包括图形处理器(Graphics Processing Unit,GPU)13041和麦克风13042,图形处理器13041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元1306上。经图形处理器13041处理后的图像帧可以存储在存储器1309(或其它存储介质)中或者经由射频单元1301或网络模块1302进行发送。麦克风13042可以接收声音,并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元1301发送到移动通信基站的格式输出。Theinput unit 1304 is used to receive audio or video signals. Theinput unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and amicrophone 13042. Thegraphics processor 13041 captures images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on thedisplay unit 1306 . The image frames processed by thegraphics processor 13041 may be stored in the memory 1309 (or other storage medium) or transmitted via theradio frequency unit 1301 or thenetwork module 1302 . Themicrophone 13042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via theradio frequency unit 1301 for output in the case of a telephone call mode.

电子设备1300还包括至少一种传感器1305,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板13061的亮度,接近传感器可在电子设备1300移动到耳边时,关闭显示面板13061和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别电子设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器1305还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。Theelectronic device 1300 also includes at least onesensor 1305, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of thedisplay panel 13061 according to the brightness of the ambient light, and the proximity sensor can turn off thedisplay panel 13061 and the proximity sensor when theelectronic device 1300 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.;sensors 1305 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., are not repeated here.

显示单元1306用于显示由用户输入的信息或提供给用户的信息。显示单元1306可包括显示面板13061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板13061。Thedisplay unit 1306 is used to display information input by the user or information provided to the user. Thedisplay unit 1306 may include adisplay panel 13061, and thedisplay panel 13061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

用户输入单元1307可用于接收输入的数字或字符信息,以及产生与电子设备的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元1307包括触控面板13071以及其他输入设备13072。触控面板13071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板13071上或在触控面板13071附近的操作)。触控面板13071可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1310,接收处理器1310发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板13071。除了触控面板13071,用户输入单元1307还可以包括其他输入设备13072。具体地,其他输入设备13072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。Theuser input unit 1307 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, theuser input unit 1307 includes atouch panel 13071 andother input devices 13072 . Thetouch panel 13071, also known as the touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on thetouch panel 13071 or near thetouch panel 13071. operate). Thetouch panel 13071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To theprocessor 1310, the command sent by theprocessor 1310 is received and executed. In addition, thetouch panel 13071 can be realized by various types of resistive, capacitive, infrared, and surface acoustic waves. In addition to thetouch panel 13071 , theuser input unit 1307 may also includeother input devices 13072 . Specifically,other input devices 13072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.

进一步的,触控面板13071可覆盖在显示面板13061上,当触控面板13071检测到在其上或附近的触摸操作后,传送给处理器1310以确定触摸事件的类型,随后处理器1310根据触摸事件的类型在显示面板13061上提供相应的视觉输出。虽然在图13中,触控面板13071与显示面板13061是作为两个独立的部件来实现电子设备的输入和输出功能,但是在某些实施例中,可以将触控面板13071与显示面板13061集成而实现电子设备的输入和输出功能,具体此处不做限定。Further, thetouch panel 13071 can be covered on thedisplay panel 13061. When thetouch panel 13071 detects a touch operation on or near it, it transmits it to theprocessor 1310 to determine the type of the touch event, and then theprocessor 1310 determines the type of the touch event according to the touch The type of event provides a corresponding visual output ondisplay panel 13061. Although in FIG. 13 , thetouch panel 13071 and thedisplay panel 13061 are used as two independent components to realize the input and output functions of the electronic device, but in some embodiments, thetouch panel 13071 and thedisplay panel 13061 can be integrated The implementation of the input and output functions of the electronic device is not specifically limited here.

接口单元1308为外部装置与电子设备1300连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元1308可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到电子设备1300内的一个或多个元件或者可以用于在电子设备1300和外部装置之间传输数据。Theinterface unit 1308 is an interface for connecting an external device to theelectronic device 1300 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. Theinterface unit 1308 may be used to receive input (eg, data information, power, etc.) from external devices and transmit the received input to one or more elements within theelectronic device 1300 or may be used between theelectronic device 1300 and external Transfer data between devices.

存储器1309可用于存储软件程序以及各种数据。存储器1309可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器1309可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。Thememory 1309 may be used to store software programs as well as various data. Thememory 1309 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally,memory 1309 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

处理器1310是电子设备的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或执行存储在存储器1309内的软件程序和/或模块,以及调用存储在存储器1309内的数据,执行电子设备的各种功能和处理数据,从而对电子设备进行整体监控。处理器1310可包括一个或多个处理单元;优选的,处理器1310可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1310中。Theprocessor 1310 is the control center of the electronic device, using various interfaces and lines to connect various parts of the entire electronic device, by running or executing the software programs and/or modules stored in thememory 1309, and calling the data stored in thememory 1309. , perform various functions of electronic equipment and process data, so as to monitor electronic equipment as a whole. Theprocessor 1310 may include one or more processing units; preferably, theprocessor 1310 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into theprocessor 1310.

电子设备1300还可以包括给各个部件供电的电源1311(比如电池),优选的,电源1311可以通过电源管理系统与处理器1313逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。Theelectronic device 1300 may also include a power supply 1311 (such as a battery) for supplying power to various components. Preferably, thepower supply 1311 may be logically connected to the processor 1313 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system and other functions.

另外,电子设备1300包括一些未示出的功能模块,在此不再赘述。In addition, theelectronic device 1300 includes some functional modules not shown, which will not be repeated here.

优选的,本发明实施例还提供一种电子设备,包括处理器1310,存储器1309,存储在存储器1309上并可在所述处理器1310上运行的计算机程序,该计算机程序被处理器1310执行时实现上述弹幕信息识别方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Preferably, an embodiment of the present invention further provides an electronic device, including aprocessor 1310, amemory 1309, and a computer program stored in thememory 1309 and running on theprocessor 1310, when the computer program is executed by theprocessor 1310 The various processes of the above embodiments of the method for identifying bullet screen information are implemented, and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.

本发明实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,该计算机程序被处理器执行时实现上述弹幕信息识别方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。其中,所述的计算机可读存储介质,如只读存储器(Read-Only Memory,简称ROM)、随机存取存储器(Random Access Memory,简称RAM)、磁碟或者光盘等。Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above embodiments of the method for identifying bullet screen information can be implemented, and can achieve the same In order to avoid repetition, the technical effect will not be repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本发明的保护之内。The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (12)

Translated fromChinese
1.一种弹幕信息识别方法,应用于服务器,其特征在于,所述方法包括:1. A method for identifying bullet screen information, applied to a server, wherein the method comprises:获取电子设备对目标图像区域进行识别后确定的识别结果,所述目标图像区域为所述电子设备根据用户对目标视频的第一输入确定的,所述目标视频为所述电子设备上当前播放的视频;Obtain the recognition result determined by the electronic device after recognizing the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is currently playing on the electronic device video;将所述目标视频包括的第一对象信息中与所述识别结果包括的对象信息相匹配的对象信息,确定为第二对象信息;其中,所述对象信息包含对象的名称;Determine the object information that matches the object information included in the recognition result in the first object information included in the target video as the second object information; wherein, the object information includes the name of the object;从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括所述第二对象信息中的至少一个对象信息;Identify the target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one object information in the second object information;向所述电子设备发送所述目标弹幕信息;sending the target bullet screen information to the electronic device;在所述获取电子设备对目标图像区域进行识别后确定的识别结果之前,还包括:Before the obtaining of the recognition result determined after the electronic device recognizes the target image area, the method further includes:获取所述目标视频的弹幕信息;Obtain the bullet screen information of the target video;对所述弹幕信息进行语义分析,获得所述弹幕信息的至少一个关键字;Perform semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information;将所述弹幕信息包括的每个所述关键字与所述第一对象信息中的每个对象信息进行匹配;Matching each keyword included in the bullet screen information with each object information in the first object information;在每个所述关键字中的一个关键字与所述第一对象信息中的一个对象信息匹配的情况下,将所述第一对象信息中的与所述关键字相匹配的对象信息确定为第三对象信息,存储所述第三对象信息、以及与所述第三对象信息关联的所述弹幕信息。In the case where one keyword in each of the keywords matches one object information in the first object information, the object information matching the keyword in the first object information is determined as The third object information stores the third object information and the bullet screen information associated with the third object information.2.根据权利要求1所述的方法,其特征在于,在所述对所述弹幕信息进行语义分析,获得所述弹幕信息的至少一个关键字之前,还包括:2 . The method according to claim 1 , wherein before the performing semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information, the method further comprises: 2 .在所述弹幕信息中包括符号信息的情况下,去除所述弹幕信息中的符号信息;In the case that the bullet screen information includes symbol information, remove the symbol information in the bullet screen information;所述对所述弹幕信息进行语义分析,获得所述弹幕信息的至少一个关键字,包括:The performing semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information includes:对去除所述符号信息的弹幕信息进行语义分析,获得所述弹幕信息的至少一个所述关键字。Semantic analysis is performed on the bullet screen information from which the symbol information is removed, and at least one of the keywords of the bullet screen information is obtained.3.根据权利要求2所述的方法,其特征在于,还包括:3. The method of claim 2, further comprising:在每个所述关键字未与所述第一对象信息中的一个对象信息匹配的情况下,将所述第一对象信息中的未与所述关键字相匹配的对象信息确定为无关信息,存储所述无关信息、以及与所述无关信息关联的所述弹幕信息。In the case that each of the keywords does not match one object information in the first object information, determining the object information in the first object information that does not match the keyword as irrelevant information, The irrelevant information and the bullet screen information associated with the irrelevant information are stored.4.根据权利要求3所述的方法,其特征在于,所述从存储的弹幕信息中识别目标弹幕信息,包括:4. The method according to claim 3, wherein the identifying the target bullet screen information from the stored bullet screen information comprises:在存储的所述弹幕信息中存在包括所述第二对象信息中的至少一个对象信息的弹幕信息的情况下,将包括所述第二对象信息中的至少一个对象信息的弹幕信息作为所述目标弹幕信息;所述存储的所述弹幕信息包括与所述第三对象信息关联的弹幕信息和/或与所述无关信息关联的所述弹幕信息。In the case where there is bullet screen information including at least one object information in the second object information in the stored bullet screen information, the bullet screen information including at least one object information in the second object information is used as the bullet screen information The target bullet screen information; the stored bullet screen information includes the bullet screen information associated with the third object information and/or the bullet screen information associated with the irrelevant information.5.根据权利要求1所述的方法,其特征在于,在所述向所述电子设备发送所述目标弹幕信息之前,还包括:5 . The method according to claim 1 , wherein before the sending the target bullet screen information to the electronic device, the method further comprises: 5 .若所述第二对象信息包含多个对象信息,则根据所述第二对象信息中的每个对象信息,对所述目标弹幕信息划分类别,获得每个所述类别的目标弹幕信息;If the second object information includes a plurality of object information, classify the target bullet screen information into categories according to each object information in the second object information, and obtain the target bullet screen information of each category;向所述电子设备发送所述目标弹幕信息,包括:Sending the target bullet screen information to the electronic device includes:向所述电子设备发送每个所述类别的目标弹幕信息。Sending target bullet screen information of each of the categories to the electronic device.6.一种弹幕信息显示方法,所述方法应用于电子设备,其特征在于,所述方法包括:6. A method for displaying bullet screen information, the method is applied to an electronic device, wherein the method comprises:接收用户对所述电子设备上播放的目标视频的第一输入;receiving the first input from the user to the target video played on the electronic device;响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;In response to the first input, determining a target frame image of the target video, and determining a target image area on the target frame image;对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器将所述目标视频包括的第一对象信息中与所述识别结果包括的对象信息相匹配的对象信息,确定为第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括所述第二对象信息中的至少一个对象信息;所述存储的弹幕信息是根据对所述弹幕信息进行语义分析,在获得的所述弹幕信息的每个关键字中的一个关键字与所述第一对象信息中的一个对象信息匹配的情况下,将所述第一对象信息中的与所述关键字相匹配的对象信息确定为第三对象信息,得到的;其中,所述对象信息包含对象的名称;Identify the target image area, obtain a recognition result, and send the recognition result to the server, so that the server can match the first object information included in the target video with the object information included in the recognition result The object information is determined as the second object information, and the target bullet screen information is identified from the stored bullet screen information, and the target bullet screen information includes at least one object information in the second object information; the stored bullet screen information The screen information is based on semantic analysis of the bullet screen information, and in the case that one keyword in each keyword of the obtained bullet screen information matches one object information in the first object information, the The object information in the first object information that matches the keyword is determined as the third object information, obtained; wherein, the object information includes the name of the object;接收所述服务器发送的所述目标弹幕信息;receiving the target bullet screen information sent by the server;显示所述目标弹幕信息。Display the target barrage information.7.根据权利要求6所述的方法,其特征在于,所述响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域,包括:7. The method according to claim 6, wherein, in response to the first input, determining a target frame image of the target video, and determining a target image area on the target frame image, comprising:响应于所述第一输入,确定与所述第一输入对应的划线轨迹;In response to the first input, determining a scribe line trajectory corresponding to the first input;确定与所述第一输入的结束时刻对应的所述目标视频的帧图像,将与所述第一输入的结束时刻对应的所述目标视频的帧图像作为所述目标帧图像;determining the frame image of the target video corresponding to the end moment of the first input, and using the frame image of the target video corresponding to the end moment of the first input as the target frame image;在所述划线轨迹为所述非闭合区域的情况下,将所述非闭合区域补充为闭合区域,并将所述目标帧图像上的所述闭合区域作为所述目标图像区域;In the case that the scribing track is the non-closed area, the non-closed area is supplemented as a closed area, and the closed area on the target frame image is used as the target image area;在所述划线轨迹不为所述非闭合区域的情况下,将所述划线轨迹组成的闭合区域作为所述目标图像区域。In the case that the scribed line track is not the non-closed region, the closed region formed by the scribed line track is used as the target image region.8.根据权利要求7所述的方法,其特征在于,所述接收所述服务器发送的所述目标弹幕信息,包括:8. The method according to claim 7, wherein the receiving the target bullet screen information sent by the server comprises:接收所述服务器发送的每个类别的目标弹幕信息,所述类别的目标弹幕信息为所述服务器根据所述第二对象信息中的每个所述对象信息,对所述目标弹幕信息划分类别获得的;Receive the target bullet screen information of each category sent by the server, and the target bullet screen information of the category is the target bullet screen information that the server sends to the target bullet screen information according to each of the object information in the second object information. obtained by classification;按照每个所述类别显示与每个所述类别的目标弹幕信息。The target barrage information for each of the categories is displayed according to each of the categories.9.一种服务器,其特征在于,包括:9. A server, characterized in that, comprising:第一获取模块,用于获取电子设备对目标图像区域进行识别后确定的识别结果,所述目标图像区域为所述电子设备根据用户对目标视频的第一输入确定的,所述目标视频为所述电子设备上当前播放的视频;The first acquisition module is used to acquire the recognition result determined after the electronic device recognizes the target image area, the target image area is determined by the electronic device according to the user's first input to the target video, and the target video is the target video. the video currently playing on the electronic device;确定模块,用于将所述目标视频包括的第一对象信息中与所述识别结果包括的对象信息相匹配的对象信息,确定为第二对象信息;其中,所述对象信息包含对象的名称;a determining module, configured to determine the object information that matches the object information included in the recognition result in the first object information included in the target video as the second object information; wherein, the object information includes the name of the object;识别模块,用于从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括所述第二对象信息中的至少一个对象信息;an identification module, configured to identify target bullet screen information from the stored bullet screen information, where the target bullet screen information includes at least one object information in the second object information;发送模块,用于向所述电子设备发送所述目标弹幕信息;a sending module, configured to send the target bullet screen information to the electronic device;所述服务器还包括:The server also includes:第二获取模块,用于获取所述目标视频的弹幕信息;The second acquisition module is used to acquire the bullet screen information of the target video;分析模块,用于对所述弹幕信息进行语义分析,获得所述弹幕信息的至少一个关键字;an analysis module, configured to perform semantic analysis on the bullet screen information to obtain at least one keyword of the bullet screen information;匹配模块,用于将所述弹幕信息包括的每个所述关键字与所述第一对象信息中的每个对象信息进行匹配;a matching module, configured to match each keyword included in the bullet screen information with each object information in the first object information;存储模块,用于在每个所述关键字中的一个关键字与所述第一对象信息中的一个对象信息匹配的情况下,将所述第一对象信息中的与所述关键字相匹配的对象信息确定为第三对象信息,存储所述第三对象信息、以及与所述第三对象信息关联的所述弹幕信息。A storage module, configured to match a keyword in the first object information with the keyword in the case that a keyword in each of the keywords matches an object information in the first object information The object information is determined as third object information, and the third object information and the bullet screen information associated with the third object information are stored.10.一种电子设备,其特征在于,包括:10. An electronic device, comprising:第一接收模块,用于接收用户对所述电子设备上播放的目标视频的第一输入;a first receiving module, configured to receive a user's first input of the target video played on the electronic device;确定模块,用于响应于所述第一输入,确定所述目标视频的目标帧图像,并确定所述目标帧图像上的目标图像区域;a determining module, configured to determine a target frame image of the target video in response to the first input, and determine a target image area on the target frame image;识别模块,用于对所述目标图像区域进行识别,获得识别结果,并向服务器发送所述识别结果,以供所述服务器将所述目标视频包括的第一对象信息中与所述识别结果包括的对象信息相匹配的对象信息,确定为第二对象信息,并从存储的弹幕信息中识别目标弹幕信息,所述目标弹幕信息包括所述第二对象信息中的至少一个对象信息;所述存储的弹幕信息是根据对所述弹幕信息进行语义分析,在获得的所述弹幕信息的每个关键字中的一个关键字与所述第一对象信息中的一个对象信息匹配的情况下,将所述第一对象信息中的与所述关键字相匹配的对象信息确定为第三对象信息,得到的;其中,所述对象信息包含对象的名称;An identification module, configured to identify the target image area, obtain an identification result, and send the identification result to a server, so that the server can compare the first object information included in the target video with the identification result including The object information that matches the object information is determined as the second object information, and the target bullet screen information is identified from the stored bullet screen information, and the target bullet screen information includes at least one object information in the second object information; The stored bullet screen information is based on semantic analysis of the bullet screen information, and a keyword in each keyword of the obtained bullet screen information matches an object information in the first object information. In the case of , the object information in the first object information that matches the keyword is determined as the third object information, and obtained; wherein, the object information includes the name of the object;第二接收模块,用于接收所述服务器发送的所述目标弹幕信息;a second receiving module, configured to receive the target bullet screen information sent by the server;目标弹幕信息显示模块,用于显示所述目标弹幕信息。The target bullet screen information display module is used to display the target bullet screen information.11.一种服务器,其特征在于,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如权利要求1至5中任一项所述的弹幕信息识别方法的步骤。11. A server, characterized by comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor to achieve the right The steps of the method for identifying bullet screen information in any one of requirements 1 to 5 are required.12.一种电子设备,其特征在于,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如权利要求6至8中任一项所述的弹幕信息显示方法的步骤。12. An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and running on the processor, the computer program being executed by the processor to achieve the following: Steps of the method for displaying bullet screen information according to any one of claims 6 to 8.
CN201910990386.8A2019-10-172019-10-17Barrage information identification method, barrage information display method, server and electronic equipmentActiveCN112689201B (en)

Priority Applications (2)

Application NumberPriority DateFiling DateTitle
CN201910990386.8ACN112689201B (en)2019-10-172019-10-17Barrage information identification method, barrage information display method, server and electronic equipment
PCT/CN2020/120415WO2021073478A1 (en)2019-10-172020-10-12Bullet screen information recognition method, display method, server and electronic device

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910990386.8ACN112689201B (en)2019-10-172019-10-17Barrage information identification method, barrage information display method, server and electronic equipment

Publications (2)

Publication NumberPublication Date
CN112689201A CN112689201A (en)2021-04-20
CN112689201Btrue CN112689201B (en)2022-08-26

Family

ID=75444635

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910990386.8AActiveCN112689201B (en)2019-10-172019-10-17Barrage information identification method, barrage information display method, server and electronic equipment

Country Status (2)

CountryLink
CN (1)CN112689201B (en)
WO (1)WO2021073478A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN113395567B (en)*2021-06-112022-07-05腾讯科技(深圳)有限公司Subtitle display method and related device
CN114245222A (en)*2021-12-162022-03-25网易(杭州)网络有限公司Bullet screen display method and device, electronic equipment and medium
CN114915832B (en)*2022-05-132024-02-23咪咕文化科技有限公司Barrage display method and device and computer readable storage medium
CN115103212B (en)*2022-06-102023-09-05咪咕文化科技有限公司Bullet screen display method, bullet screen processing device and electronic equipment
CN115065874B (en)*2022-06-202024-08-20维沃移动通信有限公司Video playing method, device, electronic equipment and readable storage medium
CN115297355B (en)*2022-08-022024-01-23北京奇艺世纪科技有限公司Barrage display method, barrage generation method, barrage display device, electronic equipment and storage medium
CN116193186B (en)*2023-01-292025-02-14北京达佳互联信息技术有限公司 A bullet screen display method, device, electronic device and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104811816A (en)*2015-04-292015-07-29北京奇艺世纪科技有限公司Video image object bullet screen marking method, device and system
CN105357586A (en)*2015-09-282016-02-24北京奇艺世纪科技有限公司Video bullet screen filtering method and device
CN107222790A (en)*2017-05-222017-09-29深圳市金立通信设备有限公司A kind of method, terminal and computer-readable recording medium for sending barrage
CN107613392A (en)*2017-09-222018-01-19广东欧珀移动通信有限公司 Information processing method, device, terminal device and storage medium
CN107645686A (en)*2017-09-222018-01-30广东欧珀移动通信有限公司Information processing method, device, terminal equipment and storage medium
CN108259968A (en)*2017-12-132018-07-06华为技术有限公司Processing method, system and the relevant device of video barrage
CN108347640A (en)*2017-01-222018-07-31北京康得新创科技股份有限公司Information processing method based on video and device
CN108495168A (en)*2018-03-062018-09-04优酷网络技术(北京)有限公司The display methods and device of barrage information
CN108632658A (en)*2018-03-142018-10-09维沃移动通信有限公司 A barrage display method and terminal
CN109739990A (en)*2019-01-042019-05-10北京七鑫易维信息技术有限公司Information processing method and terminal
CN109819280A (en)*2017-11-222019-05-28上海全土豆文化传播有限公司Barrage methods of exhibiting and device
CN110139134A (en)*2019-05-102019-08-16韶关市启之信息技术有限公司A kind of personalization barrage intelligently pushing method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP5224839B2 (en)*2008-02-072013-07-03キヤノン株式会社 Document management system, document management apparatus, document management method, and program
CN104618813B (en)*2015-01-202018-02-13腾讯科技(北京)有限公司Barrage information processing method, client and service platform
CN105516820A (en)*2015-12-102016-04-20腾讯科技(深圳)有限公司Barrage interaction method and device
CN105516821B (en)*2015-12-142019-07-30广州弹幕网络科技有限公司The method and device of barrage screening
CN105872781B (en)*2016-05-312019-07-09武汉斗鱼网络科技有限公司A kind of barrage control speech filtering control method and device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104811816A (en)*2015-04-292015-07-29北京奇艺世纪科技有限公司Video image object bullet screen marking method, device and system
CN105357586A (en)*2015-09-282016-02-24北京奇艺世纪科技有限公司Video bullet screen filtering method and device
CN108347640A (en)*2017-01-222018-07-31北京康得新创科技股份有限公司Information processing method based on video and device
CN107222790A (en)*2017-05-222017-09-29深圳市金立通信设备有限公司A kind of method, terminal and computer-readable recording medium for sending barrage
CN107613392A (en)*2017-09-222018-01-19广东欧珀移动通信有限公司 Information processing method, device, terminal device and storage medium
CN107645686A (en)*2017-09-222018-01-30广东欧珀移动通信有限公司Information processing method, device, terminal equipment and storage medium
CN109819280A (en)*2017-11-222019-05-28上海全土豆文化传播有限公司Barrage methods of exhibiting and device
CN108259968A (en)*2017-12-132018-07-06华为技术有限公司Processing method, system and the relevant device of video barrage
CN108495168A (en)*2018-03-062018-09-04优酷网络技术(北京)有限公司The display methods and device of barrage information
CN108632658A (en)*2018-03-142018-10-09维沃移动通信有限公司 A barrage display method and terminal
CN109739990A (en)*2019-01-042019-05-10北京七鑫易维信息技术有限公司Information processing method and terminal
CN110139134A (en)*2019-05-102019-08-16韶关市启之信息技术有限公司A kind of personalization barrage intelligently pushing method and system

Also Published As

Publication numberPublication date
CN112689201A (en)2021-04-20
WO2021073478A1 (en)2021-04-22

Similar Documents

PublicationPublication DateTitle
CN112689201B (en)Barrage information identification method, barrage information display method, server and electronic equipment
CN109857905B (en) A video editing method and terminal device
CN109561211B (en) Information display method and mobile terminal
CN110830362B (en) A method and mobile terminal for generating content
CN107846352A (en)A kind of method for information display, mobile terminal
CN109814786B (en)Image storage method and terminal equipment
CN108337374A (en)A kind of message prompt method and mobile terminal
WO2021233293A1 (en)Note recording method and electronic device
CN109753202B (en)Screen capturing method and mobile terminal
CN108460817B (en)Jigsaw puzzle method and mobile terminal
CN109634438B (en)Input method control method and terminal equipment
CN107908330B (en)The management method and mobile terminal of application icon
CN108616448A (en)A kind of the path recommendation method and mobile terminal of Information Sharing
CN107862059A (en)A kind of song recommendations method and mobile terminal
CN108376096A (en)A kind of message display method and mobile terminal
CN109032380A (en)A kind of character input method and terminal
CN108279833A (en)A kind of reading interactive approach and mobile terminal
WO2021104175A1 (en)Information processing method and apparatus
CN107944040B (en)Lyric display method and mobile terminal
CN111143614A (en) Video display method and electronic device
CN110781371B (en)Content processing method and electronic equipment
CN108459813A (en)A kind of searching method and mobile terminal
CN108062370A (en)A kind of application program searching method and mobile terminal
CN107967086A (en)A kind of icon arrangement method and device of mobile terminal, mobile terminal
CN107688617A (en)Multimedia service method and mobile terminal

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp