WO2023020509A1 - Method and apparatus for processing information of user watching live broadcast, and device - Google Patents
Method and apparatus for processing information of user watching live broadcast, and deviceDownload PDFInfo
- Publication number
- WO2023020509A1 WO2023020509A1PCT/CN2022/112867CN2022112867WWO2023020509A1WO 2023020509 A1WO2023020509 A1WO 2023020509A1CN 2022112867 WCN2022112867 WCN 2022112867WWO 2023020509 A1WO2023020509 A1WO 2023020509A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- live broadcast
- information
- watching
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/735—Filtering based on additional data, e.g. user or group profiles
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/745—Browsing; Visualisation therefor the internal structure of a single video sequence
Definitions
- This inventionis based on the Chinese patent application with application number 202110938730.6 and application date of August 16, 2021.
- the applicantsare: Migu Digital Media Co., Ltd., Migu Culture Technology Co., Ltd., China Mobile Communications Group Co., Ltd., and the application name is The technical solution of "A User Information Processing Method, Device, and Equipment for Watching Live Streaming" claims the priority of this Chinese patent application, and the entire content of this Chinese patent application is hereby incorporated by reference in the present invention.
- the present inventionrelates to the technical field of live broadcast information processing, and relates to but not limited to a user information processing method, device and equipment for watching live broadcast.
- the scene of the gamewill capture the images of the athletes and the audience through multiple cameras, but they are not related to the whole process of the live broadcast;
- embodiments of the present inventionare proposed to provide a user information processing method, device, and device for watching live broadcasts that overcome the above problems or at least partially solve the above problems.
- An embodiment of the present inventionprovides a user information processing method for watching a live broadcast, including:
- An embodiment of the present inventionprovides a user information processing device for watching a live broadcast, including:
- the obtaining moduleis configured to obtain the user status information when watching the live broadcast
- the processing moduleis configured to correlate the user state information with the live broadcast content to obtain target associated data.
- An embodiment of the present inventionprovides a computing device, including: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface complete mutual communication through the communication bus;
- the memoryis configured to store at least one executable instruction, and the executable instruction causes the processor to perform operations corresponding to the above-mentioned user information processing method for watching live broadcast.
- An embodiment of the present inventionprovides a computer storage medium, wherein at least one executable instruction is stored in the storage medium, and the executable instruction causes a processor to perform operations corresponding to the above-mentioned user information processing method for watching a live broadcast.
- target associated datais obtained by acquiring user status information while watching live broadcast; associating the user status information with live content. It can make the dynamic changes of the user watching the live broadcast be associated with the progress of the live video, and save the video, thereby solving the problem that the dynamic changes of the user cannot be associated with the whole process of the live broadcast in the related technology, and has obtained the user's ability to watch the video when watching the video. The beneficial effect of being able to return to the state of mind at that time again.
- FIG. 1shows a flowchart of a user information processing method for watching live broadcast provided by an embodiment of the present invention
- Fig. 2shows the user state interface diagram of difference and barrage in the user information processing of watching live broadcast provided by the embodiment of the present invention
- FIG. 3shows an interface diagram of a form of barrage in user information processing for viewing live broadcast provided by an embodiment of the present invention
- Fig. 4shows the interface diagram of my information status information in the user information processing for watching live broadcast provided by the embodiment of the present invention
- Fig. 5shows the information surface diagram of all the information state interfaces in the information processing of the user watching the live broadcast provided by the embodiment of the present invention
- Fig. 6shows the interface diagram of my real shot state in the user information processing for watching the live broadcast provided by the embodiment of the present invention
- FIG. 7shows an interface diagram of switching friend status information in user information processing for watching live broadcast provided by an embodiment of the present invention
- Fig. 8shows a schematic structural diagram of a user information processing device for watching a live broadcast provided by an embodiment of the present invention
- FIG. 9shows a schematic structural diagram of a computing device provided by an embodiment of the present invention.
- Fig. 1shows a flowchart of a method for processing user information for watching a live broadcast provided by an embodiment of the present invention. As shown in Figure 1, the method may include the following steps:
- Step 11obtaining the user status information when watching the live broadcast
- Step 12associating the user state information with the live broadcast content to obtain target association data.
- step 11may include:
- Step 111Obtain the viewing state information of the user within a preset period of time when watching the live broadcast; the viewing state information of the user may include the user's body movements, user's expression, user's language, user's emotion and user's voice , but not limited to the above.
- the viewing status information of the current useris recorded within a preset period of time. If the camera captures multiple users, a confirmation box can pop up to confirm the protagonist and friends; according to face recognition, record the viewing status information of the relevant users during this viewing process. If watching the game on the spot, the viewing status information of each stand user can be captured by the existing camera in the arena.
- Step 112obtain user status information according to the viewing status information; the user status information may include: victory status, concentration status and natural viewing status, but not limited to the above.
- online userscan extract facial expression changes in the viewing state information by giving computers the ability to recognize, understand, express and adapt to human emotions, and establish a harmonious human-machine environment (emotional computing technology), and then generate The mutual game learning (generative confrontation network) of the model (Generative) and the discriminant model (Discriminative) generates the user state information.
- the facial expression changes in the viewing state informationare extracted, and then the mutual game between the generative model (Generative) and the discriminative model (Discriminative) Learning (generative adversarial network) generates said user state information.
- the voice changes in the viewing state informationare extracted, and then the interaction between the generative model (Generative) and the discriminative model (Discriminative) Game learning (generative adversarial networks) generates the user state information.
- the technique for transforming the viewing state information into the user state informationincludes but not limited to the above.
- step 112may also include:
- Step 1121Match the viewing state information with the user state information in the emotion database to obtain the user state information;
- the emotion databasemay include preset emotion databases, existing emotion databases, and emotion databases generated on the spot At least one of, but not limited to, the above.
- the user state information in the emotional databaserefers to the normal size of the pupil
- the relaxed face and limbscan be defined as a natural viewing state; such as the user’s pupil dilation, the limbs remain fixed and the movement does not change, and the fist is clenched, etc., can be defined It is a focused state; if the user makes a victory gesture, and makes gesture changes such as cheering and jumping, it can be defined as a victory state.
- the user state information in the preset emotion databaseincludes but is not limited to the above, and the user state information in the preset emotion database supports expansion and change at any time.
- step 12may include:
- Step 121associating the user status information with the live broadcast content to obtain first data
- the first datarefers to the video screen associated with the user status information and the live broadcast content.
- Whether to display the user status information in the video screen, as well as the form and size of the displaycan be adjusted in real time according to the user status information .
- the statecan be hidden; for example, in the victory, disappointment, and natural state, the user can be added
- Data adjusted in real timeincludes, but is not limited to, those described above.
- Step 122associating the first data with the user account of the user to obtain target association data.
- the original picture data and the first datamay also be associated with the user account of the user to obtain target associated data, and the target associated data may be downloaded and stored.
- step 12it may further include:
- Step 123According to the user account information, obtain the review data of the user's goal-related data associated with the user's account information and the user status information and/or the review data of the user's friend users' goal-related data. Looking at the data, the user status of the user and the user status of the user's friends are displayed with different icons in a display interface.
- step 12it may further include:
- Step 124According to the user's account information, switch between multiple target associated data of the user associated with the multiple user state information, and obtain the target associated data associated with each state information of the user Review the data.
- status information of friends at the current progresscan also be displayed on the screen.
- the other usersrefer to users other than the current user, including but not limited to friends of the user.
- step 12it may also include:
- Step 13displaying the user status information.
- step 13may include:
- Step 131displaying the user status information in the user status display area, the user status display area is different from the barrage area; or,
- Step 132displaying the user status information in the barrage area.
- the changed viewing state informationis extracted, and displayed by reading the viewing state information of the user within Ns (such as 3s), analyzed once every Ns (such as 3s), if the next Ns (such as If the viewing status information in 3s) has not changed, the previous viewing status information will continue to be displayed, and if it changes, the user status information will be updated on the screen, thereby forming a section of first data associated with the live broadcast process.
- the collection frequencycan be automatically adjusted according to the progress of the game; for example, when the game score is close and the end is near, the collection frequency can be increased to Ns-ns (such as 3s-1s). If conditions permit, all user status information can be recorded and associated with the user account.
- the target associated datais obtained, and the target associated data is stored;
- the user status information associated with the associated dataIt can associate the dynamic changes of the user with the progress of the live video while watching the live broadcast, and save the video, thus solving the problem that the dynamic changes of the user cannot be associated with the whole process of the live broadcast one by one.
- beneficial effect on the state of mind at that timecan be Moreover, multiple people watching the live broadcast can distinguish me from my friends, and can generate more videos with a friend as the protagonist, so that friends can return to the state of mind at that time when they watch the video back.
- the live broadcast screencan combine the user status information to understand the progress of the current game (attack, critical moment of victory, etc.), and then adjust the display mode of the user status, such as not displaying or displaying more information, to bring a better viewing experience.
- Live broadcast userscan also automatically filter out the comments and bullet screens they want to post when watching the live broadcast, so that users will not miss the emotional expression of the wonderful moments when it is too late to express their comments in the highlight clips and focus on the event itself.
- the off-site audienceis watching the live broadcast, they can capture the audience's expressions and body changes by turning on the camera of the networked device, translate them into related emoticons, and release them automatically as a kind of barrage content.
- FIG. 8shows a schematic structural diagram of a user information processing device 80 for watching a live broadcast provided by an embodiment of the present invention. As shown in Figure 8, the device includes:
- Obtaining module 81configured to obtain user status information when watching live broadcast
- the processing module 82is configured to associate the user state information with the live broadcast content to obtain target association data
- the processing module 83is further configured to display the user status information.
- the obtaining module 81is also configured to obtain viewing status information of users within a preset time period when watching the live broadcast;
- the acquisition module 81is further configured to match the viewing state information with the user state information in the emotion database to obtain the user state information.
- processing module 82is further configured to associate the user status information with the live content to obtain the first data;
- the processing module 82is further configured to obtain, according to the user account information, the review data of the user's goal-associated data associated with the user's account information and the user status information and/or the user's
- the user status of the user and the user status of the user’s friendsare displayed with different icons in a display interface.
- the processing module 82is further configured to switch between multiple target associated data of the user associated with the multiple user status information according to the user's account information, and obtain each target associated data with the user.
- the processing module 82is further configured to display the user status information in the user status display area, the user status display area and the barrage area are different areas;
- this embodimentis a device embodiment corresponding to the above method embodiment, and all the implementation modes in the above method embodiment are applicable to this device embodiment, and can also achieve the same technical effect.
- An embodiment of the present inventionprovides a non-volatile computer storage medium, the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the user information processing method for watching live broadcast in any of the above method embodiments .
- FIG. 9shows a schematic structural diagram of a computing device provided by an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device.
- the computing devicemay include: a processor (processor), a communication interface (Communications Interface), a memory (memory), and a communication bus.
- a processorprocessor
- a communication interfaceCommunication Interface
- a memorymemory
- a communication busa communication bus
- the processor, the communication interface, and the memorycomplete the mutual communication through the communication bus.
- a communication interfaceconfigured to communicate with network elements of other devices such as clients or other servers.
- the processoris configured to execute a program, and specifically, may execute relevant steps in the above embodiment of the method for processing user information for watching a live broadcast on a computing device.
- the programmay include program code including computer operation instructions.
- the processormay be a central processing unit (Central Processing Unit, CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.
- the one or more processors included in the computing devicemay be of the same type, such as one or more CPUs, or may be different types of processors, such as one or more CPUs and one or more ASICs.
- a memoryconfigured to store a program.
- the memorymay include a high-speed random access memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory.
- RAMRandom Access Memory
- NVMnon-volatile memory
- the programmay be used to cause the processor to execute the user information processing method for watching live broadcast in any of the above method embodiments.
- each step in the programrefer to the corresponding steps and corresponding descriptions in the units in the above-mentioned embodiment of the user information processing method for watching live broadcast, and details are not repeated here.
- the specific working process of the above-described devices and modulescan refer to the corresponding process description in the foregoing method embodiments, and details are not repeated here.
- modules in the device in the embodimentcan be adaptively changed and arranged in one or more devices different from the embodiment.
- Modules or units or components in the embodimentsmay be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies.
- All features disclosed in this specificationincluding accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined.
- Each feature disclosed in this specificationmay be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
- the various component embodiments of the present inventionmay be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
- a microprocessor or a digital signal processormay be used in practice to implement some or all functions of some or all components according to the embodiments of the present invention.
- Embodiments of the present inventioncan also be implemented as a device or apparatus program (eg, computer program and computer program product) for performing a part or all of the methods described herein.
- a program implementing an embodiment of the present inventionmay be stored on a computer-readable medium, or may be in the form of one or more signals.
- Such a signalmay be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Translated fromChinese相关申请的交叉引用Cross References to Related Applications
本发明基于申请号为202110938730.6、申请日为2021年08月16日的中国专利申请提出，申请人为：咪咕数字传媒有限公司、咪咕文化科技有限公司、中国移动通信集团有限公司，申请名称为“一种观看直播的用户信息处理方法、装置及设备”的技术方案，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本发明作为参考。This invention is based on the Chinese patent application with application number 202110938730.6 and application date of August 16, 2021. The applicants are: Migu Digital Media Co., Ltd., Migu Culture Technology Co., Ltd., China Mobile Communications Group Co., Ltd., and the application name is The technical solution of "A User Information Processing Method, Device, and Equipment for Watching Live Streaming" claims the priority of this Chinese patent application, and the entire content of this Chinese patent application is hereby incorporated by reference in the present invention.
本发明涉及直播信息处理技术领域，涉及但不限于一种观看直播的用户信息处理方法、装置及设备。The present invention relates to the technical field of live broadcast information processing, and relates to but not limited to a user information processing method, device and equipment for watching live broadcast.
在观看直播时，比赛现场会通过多个摄像头捕捉到运动员以及现场观众的画面，但是并未与直播的整个过程一一关联；When watching the live broadcast, the scene of the game will capture the images of the athletes and the audience through multiple cameras, but they are not related to the whole process of the live broadcast;
观看直播赛事对于粉丝来说是非常激动人心的，一些精彩瞬间是值得永远珍藏的，同时也包含自己当时的心境。在回顾一些个人的经历的时候，除了通过还原当时看到的事物本身，也常常会有重新体验当时心境的需求；而相关技术只能记录赛事本身，无法让用户再次回到当时的心境。Watching live events is very exciting for fans. Some wonderful moments are worth cherishing forever, and it also includes their own state of mind at the time. When reviewing some personal experiences, in addition to restoring the things seen at that time, there is often a need to re-experience the state of mind at that time; and related technologies can only record the event itself, and cannot allow users to return to the state of mind at that time.
发明内容Contents of the invention
鉴于上述问题，提出了本发明实施例以便提供一种克服上述问题或者至少部分地解决上述问题的一种观看直播的用户信息处理方法、装置及设备。In view of the above problems, embodiments of the present invention are proposed to provide a user information processing method, device, and device for watching live broadcasts that overcome the above problems or at least partially solve the above problems.
本发明实施例提供了一种观看直播的用户信息处理方法，包括：An embodiment of the present invention provides a user information processing method for watching a live broadcast, including:
获取观看直播时用户状态信息；Obtain user status information while watching live broadcast;
关联所述用户状态信息与直播内容，得到目标关联数据。Associating the user state information with the live broadcast content to obtain target association data.
本发明实施例提供了一种观看直播的用户信息处理装置，包括：An embodiment of the present invention provides a user information processing device for watching a live broadcast, including:
获取模块，配置为获取观看直播时用户状态信息；The obtaining module is configured to obtain the user status information when watching the live broadcast;
处理模块，配置为关联所述用户状态信息与直播内容，得到目标关联数据。The processing module is configured to correlate the user state information with the live broadcast content to obtain target associated data.
本发明实施例提供了一种计算设备，包括：处理器、存储器、通信接口和通信总线，所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信；An embodiment of the present invention provides a computing device, including: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface complete mutual communication through the communication bus;
所述存储器配置为存放至少一可执行指令，所述可执行指令使所述处理器执行上述观看直播的用户信息处理方法对应的操作。The memory is configured to store at least one executable instruction, and the executable instruction causes the processor to perform operations corresponding to the above-mentioned user information processing method for watching live broadcast.
本发明实施例提供了一种计算机存储介质，所述存储介质中存储有至少一可执行指令，所述可执行指令使处理器执行如上述观看直播的用户信息处理方法对应的操作。An embodiment of the present invention provides a computer storage medium, wherein at least one executable instruction is stored in the storage medium, and the executable instruction causes a processor to perform operations corresponding to the above-mentioned user information processing method for watching a live broadcast.
根据本发明上述实施例提供的方案，通过获取观看直播时用户状态信息；关联所述用户状态信息与直播内容，得到目标关联数据。可以使用户观看直播时的动态变化与直播视频进度关联，并将视频保存，由此解决了相关技术中用户的动态变化无法与直播整个过程一一关联的问题，取得了用户在回看视频时能够再次回到当时的心境的有益效果。According to the solution provided by the above-mentioned embodiments of the present invention, target associated data is obtained by acquiring user status information while watching live broadcast; associating the user status information with live content. It can make the dynamic changes of the user watching the live broadcast be associated with the progress of the live video, and save the video, thereby solving the problem that the dynamic changes of the user cannot be associated with the whole process of the live broadcast in the related technology, and has obtained the user's ability to watch the video when watching the video. The beneficial effect of being able to return to the state of mind at that time again.
上述说明仅是本发明实施例技术方案的概述，为了能够更清楚了解本发明实施例的技术手段，而可依照说明书的内容予以实施，并且为了让本发明实施例的上述和其它目的、特征和优点能够更明显易懂，以下特举本发明实施例的具体实施方式。The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to better understand the technical means of the embodiments of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and The advantages can be more obvious and understandable, and the specific implementation manners of the embodiments of the present invention are enumerated below.
通过阅读下文优选实施方式的详细描述，各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目 的，而并不认为是对本发明实施例的限制。而且在整个附图中，用相同的参考符号表示相同的部件。在附图中：Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the embodiments of the present invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:
图1示出了本发明实施例提供的观看直播的用户信息处理方法流程图；FIG. 1 shows a flowchart of a user information processing method for watching live broadcast provided by an embodiment of the present invention;
图2示出了本发明实施例提供的观看直播的用户信息处理中区别与弹幕的用户状态界面图；Fig. 2 shows the user state interface diagram of difference and barrage in the user information processing of watching live broadcast provided by the embodiment of the present invention;
图3示出了本发明实施例提供的观看直播的用户信息处理中弹幕的一种形式界面图；FIG. 3 shows an interface diagram of a form of barrage in user information processing for viewing live broadcast provided by an embodiment of the present invention;
图4示出了本发明实施例提供的观看直播的用户信息处理中我的信息状态信息界面图；Fig. 4 shows the interface diagram of my information status information in the user information processing for watching live broadcast provided by the embodiment of the present invention;
图5示出了本发明实施例提供的观看直播的用户信息处理中所有的信息状态界信息面图；Fig. 5 shows the information surface diagram of all the information state interfaces in the information processing of the user watching the live broadcast provided by the embodiment of the present invention;
图6示出了本发明实施例提供的观看直播的用户信息处理中我的实拍状态界面图；Fig. 6 shows the interface diagram of my real shot state in the user information processing for watching the live broadcast provided by the embodiment of the present invention;
图7示出了本发明实施例提供的观看直播的用户信息处理中切换好友状态信息界面图；FIG. 7 shows an interface diagram of switching friend status information in user information processing for watching live broadcast provided by an embodiment of the present invention;
图8示出了本发明实施例提供的观看直播的用户信息处理装置的结构示意图；Fig. 8 shows a schematic structural diagram of a user information processing device for watching a live broadcast provided by an embodiment of the present invention;
图9示出了本发明实施例提供的计算设备的结构示意图。FIG. 9 shows a schematic structural diagram of a computing device provided by an embodiment of the present invention.
下面将参照附图更详细地描述本发明的示例性实施例。虽然附图中显示了本发明的示例性实施例，然而应当理解，可以以各种形式实现本发明而不应被这里阐述的实施例所限制。相反，提供这些实施例是为了能够更透彻地理解本发明，并且能够将本发明的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.
图1示出了本发明实施例提供的观看直播的用户信息处理方法的流程 图。如图1所示，该方法可以包括以下步骤：Fig. 1 shows a flowchart of a method for processing user information for watching a live broadcast provided by an embodiment of the present invention. As shown in Figure 1, the method may include the following steps:
步骤11，获取观看直播时用户状态信息；
步骤12，关联所述用户状态信息与直播内容，得到目标关联数据。
该实施例所述的观看直播的用户信息处理方法，通过获取观看直播时用户状态信息；关联所述用户状态信息与直播内容，得到目标关联数据。可以使用户观看直播时的动态变化与直播视频进度关联，并将视频保存，由此解决了用户的动态变化无法与直播整个过程一一关联的问题，取得了用户在回看视频时能够再次回到当时的心境的有益效果。在本发明的一可选的实施例中，步骤11可以包括：The user information processing method for watching live broadcast described in this embodiment obtains the user status information when watching the live broadcast, and associates the user status information with the live broadcast content to obtain target associated data. It can associate the dynamic changes of the user with the progress of the live video while watching the live broadcast, and save the video, thus solving the problem that the dynamic changes of the user cannot be associated with the whole process of the live broadcast one by one. beneficial effect on the state of mind at that time. In an optional embodiment of the present invention,
步骤111，获取观看直播时一预设时间段内的用户的观看状态信息；所述用户的观看状态信息，可以包括用户的肢体动作、用户的表情、用户的语言、用户的情绪以及用户的声音，但不限于如上所述。Step 111: Obtain the viewing state information of the user within a preset period of time when watching the live broadcast; the viewing state information of the user may include the user's body movements, user's expression, user's language, user's emotion and user's voice , but not limited to the above.
示例性地，当用户进入直播时，开启观看直播设备的摄像头(如观看直播的设备是手机、ipad等电子设备，则会有摄像功能，若观看直播的设备是电视等无摄像功能的，可借助周边的摄像头)，在一预设时间段记录当前用户的观看状态信息。如果摄像头捕捉到多个用户时，可弹出确认框确认主角以及好友；根据人脸识别，分别记录下本次观看过程中相关用户的观看状态信息。如果在现场观看比赛时，可通过赛场现有的摄像头捕捉每个看台用户的观看状态信息。Exemplarily, when the user enters the live broadcast, turn on the camera of the device watching the live broadcast (if the device watching the live broadcast is an electronic device such as a mobile phone or an ipad, it will have a camera function; if the device watching the live broadcast is a TV without a camera function, it can With the help of surrounding cameras), the viewing status information of the current user is recorded within a preset period of time. If the camera captures multiple users, a confirmation box can pop up to confirm the protagonist and friends; according to face recognition, record the viewing status information of the relevant users during this viewing process. If watching the game on the spot, the viewing status information of each stand user can be captured by the existing camera in the arena.
步骤112，根据所述观看状态信息，得到用户状态信息；所述用户状态信息可以包括：胜利状态、专注状态以及自然观看状态，但不限于如上所述。Step 112, obtain user status information according to the viewing status information; the user status information may include: victory status, concentration status and natural viewing status, but not limited to the above.
示例性地，线上用户通过赋予计算机识别、理解、表达和适应人的情感的能力，建立和谐人机环境(情感计算技术)，来提取所述观看状态信息中的面部表情变化，然后由生成模型(Generative)和判别模型(Discriminative)的互相博弈学习(生成对抗网络)产生所述用户状态信息。Exemplarily, online users can extract facial expression changes in the viewing state information by giving computers the ability to recognize, understand, express and adapt to human emotions, and establish a harmonious human-machine environment (emotional computing technology), and then generate The mutual game learning (generative confrontation network) of the model (Generative) and the discriminant model (Discriminative) generates the user state information.
示例性地，通过利用分析比较的计算机技术识别人脸(人脸识别技术)，来提取所述观看状态信息中的面部表情变化，然后由生成模型(Generative)和判别模型(Discriminative)的互相博弈学习(生成对抗网络)产生所述用户状态信息。Exemplarily, by using computer technology for analysis and comparison to identify faces (face recognition technology), the facial expression changes in the viewing state information are extracted, and then the mutual game between the generative model (Generative) and the discriminative model (Discriminative) Learning (generative adversarial network) generates said user state information.
示例性地，通过利用骨骼追踪技术，来提取所述观看状态信息中的肢体变化，然后由生成模型(Generative)和判别模型(Discriminative)的互相博弈学习(生成对抗网络)产生所述用户状态信息。Exemplarily, by using bone tracking technology to extract the limb changes in the viewing state information, and then generate the user state information by mutual game learning (generative confrontation network) of the generative model (Generative) and the discriminative model (Discriminative) .
示例性地，通过将用户语音中的词汇内容转换为计算机可读的输入(语音识别技术)，来提取观看状态信息中的语音变化，然后由生成模型(Generative)和判别模型(Discriminative)的互相博弈学习(生成对抗网络)产生所述用户状态信息。Exemplarily, by converting the vocabulary content in the user's voice into computer-readable input (speech recognition technology), the voice changes in the viewing state information are extracted, and then the interaction between the generative model (Generative) and the discriminative model (Discriminative) Game learning (generative adversarial networks) generates the user state information.
所述观看状态信息转换用户状态信息的技术包括但不限于如上所述。The technique for transforming the viewing state information into the user state information includes but not limited to the above.
示例性地，若为现场观看比赛的用户，需借助大数据分析，统计出当前看台大部分用户的表情变化，并根据大数据统计后的结果通过生成模型(Generative)和判别模型(Discriminative)的互相博弈学习(生成对抗网络)产生所述用户状态信息。For example, if you are a user watching a game on the spot, you need to use big data analysis to count the expression changes of most users in the current stand, and use the generative model (Generative) and the discriminative model (Discriminative) Mutual game learning (generative adversarial network) generates the user state information.
在本发明的又一可选的实施例中，步骤112还可以包括：In yet another optional embodiment of the present invention, step 112 may also include:
步骤1121，将所述观看状态信息与情绪库中用户状态信息进行匹配，得到所述用户状态信息；所述情绪库可以包括预设情绪库、现有的情绪库和结合现场生成的情绪库中的至少一项，但不限于如上所述。Step 1121: Match the viewing state information with the user state information in the emotion database to obtain the user state information; the emotion database may include preset emotion databases, existing emotion databases, and emotion databases generated on the spot At least one of, but not limited to, the above.
该实施例中，情绪库中用户状态信息是指，如瞳孔常态正常大小、面部、肢体放松可定义为自然观看状态；如用户瞳孔放大、肢体保持固定动作不变化、拳头紧握等，可定义为专注状态；如用户做出胜利姿态、并发出欢呼、跳跃等姿态变化，可定义为胜利状态。预设情绪库中用户状态信息包括但不限于如上所述，预设情绪库中用户状态信息支持随时扩展与变更。In this embodiment, the user state information in the emotional database refers to the normal size of the pupil, the relaxed face and limbs can be defined as a natural viewing state; such as the user’s pupil dilation, the limbs remain fixed and the movement does not change, and the fist is clenched, etc., can be defined It is a focused state; if the user makes a victory gesture, and makes gesture changes such as cheering and jumping, it can be defined as a victory state. The user state information in the preset emotion database includes but is not limited to the above, and the user state information in the preset emotion database supports expansion and change at any time.
如图2和图3所示，在本发明的又一可选的实施例中，步骤12可以包括：As shown in Figure 2 and Figure 3, in another optional embodiment of the present invention, step 12 may include:
步骤121，将所述用户状态信息和直播内容进行关联，得到第一数据；Step 121, associating the user status information with the live broadcast content to obtain first data;
示例性地，第一数据是指用户状态信息和直播内容关联后的视频画面，在视频画面中是否展现用户状态信息、以及展现的形式、展现的大小等数据都可根据用户状态信息进行实时调整。如为了增强视频画面的观看体验，在一些很精彩的场景，识别出用户正在屏住呼吸，专注度很大的时候，可对状态进行隐藏；如在胜利、失望、自然状态下，可增加用户状态信息变化的数据展现或者动效。实时调整的数据包括但不限于如上所述。Exemplarily, the first data refers to the video screen associated with the user status information and the live broadcast content. Whether to display the user status information in the video screen, as well as the form and size of the display can be adjusted in real time according to the user status information . For example, in order to enhance the viewing experience of the video screen, in some very exciting scenes, when it is recognized that the user is holding his breath and the concentration is high, the state can be hidden; for example, in the victory, disappointment, and natural state, the user can be added Data display or animation of state information changes. Data adjusted in real time includes, but is not limited to, those described above.
步骤122，将所述第一数据与用户的用户帐号进行关联，得到目标关联数据。Step 122, associating the first data with the user account of the user to obtain target association data.
示例性地，也可将原始画面数据和第一数据共同用户的用户帐号进行关联，得到目标关联数据，所述目标关联数据可进行下载、存储。Exemplarily, the original picture data and the first data may also be associated with the user account of the user to obtain target associated data, and the target associated data may be downloaded and stored.
如图4至图7所示，在本发明的又一可选的实施例中，步骤12之后还可以包括：As shown in FIGS. 4 to 7, in another optional embodiment of the present invention, after
步骤123，根据用户帐号信息，获得与所述用户的帐号信息、所述用户状态信息关联的所述用户的目标关联数据的回看数据和/或所述用户的好友用户的目标关联数据的回看数据，所述用户的用户状态与所述用户的好友的用户状态在一个显示界面中以不同图标进行显示。Step 123: According to the user account information, obtain the review data of the user's goal-related data associated with the user's account information and the user status information and/or the review data of the user's friend users' goal-related data. Looking at the data, the user status of the user and the user status of the user's friends are displayed with different icons in a display interface.
该实施例中，当用户登录自己的账号，进入回看，获取用户账号信息，调取关联数据及状态信息。如图4所示，用户进入回看时，在画面中展现当前进度下自己的状态信息。如图7所示，当用户与用户好友进入回看，根据最初判定的主角与好友，差异化展示，主角展示更多信息，给予更大空间，主角下方好友区域为好友用户状态。可单独查看某个好友的用户状态，生成好友的用户状态与视频进度关联的第一数据，支持快捷分享，此时他的用户状态就为主角，其他人为好友的用户状态。In this embodiment, when the user logs in his account, enters the review, obtains user account information, and retrieves associated data and status information. As shown in Figure 4, when the user enters the review, his status information under the current progress is displayed on the screen. As shown in Figure 7, when the user and the user's friends enter the review, according to the initial determination of the protagonist and friends, differentiated display, the protagonist displays more information, giving more space, and the friend area below the protagonist is the status of the friend user. You can check the user status of a friend separately, generate the first data related to the user status of the friend and the progress of the video, and support quick sharing. At this time, his user status is the protagonist, and other people are the user status of the friend.
如图5和图6所示，在本发明的又一可选的实施例中，步骤12之后还可以包括：As shown in Figures 5 and 6, in another optional embodiment of the present invention, after
步骤124，根据用户的帐号信息，在与多个所述用户状态信息关联的多个所述用户的目标关联数据之间进行切换，获得与所述用户的每一个状态信息关联的目标关联数据的回看数据。Step 124: According to the user's account information, switch between multiple target associated data of the user associated with the multiple user state information, and obtain the target associated data associated with each state information of the user Review the data.
该实施例中，如图5所示，还可在画面中展现当前进度下好友的状态信息。如图6所示，还可在画面中展现当前进度下自己的真实状态。若包含声音可通过点击或者其他交互方式进行播放，也可通过切换查看当前好友的真实状态，也可通过设置确认实拍画面展现视频运动员、观众等其他用户状态信息。所述其他用户是指除当前用户之外的用户，包括但不限于用户的好友。In this embodiment, as shown in FIG. 5 , status information of friends at the current progress can also be displayed on the screen. As shown in Figure 6, you can also display your real status at the current progress on the screen. If it contains sound, it can be played by clicking or other interactive methods, and the real status of the current friend can also be viewed by switching, or the real shot screen can be confirmed by setting to display the status information of other users such as video athletes and audiences. The other users refer to users other than the current user, including but not limited to friends of the user.
在本发明的再一可选的实施例中，步骤12之后还可以包括：In yet another optional embodiment of the present invention, after
步骤13，显示所述用户状态信息。Step 13, displaying the user status information.
示例性地，步骤13可以包括：Exemplarily, step 13 may include:
步骤131，在用户状态显示区域显示所述用户状态信息，所述用户状态显示区域与弹幕区域是不同的区域；或者，Step 131, displaying the user status information in the user status display area, the user status display area is different from the barrage area; or,
步骤132，在弹幕区域显示所述用户状态信息。Step 132, displaying the user status information in the barrage area.
该实施例中，对发生变化的观看状态信息进行提取，通过读取用户在Ns(如3s)的时间内的观看状态信息进行展现，每Ns(如3s)分析一次，若下一个Ns(如3s)的观看状态信息未发生变化，则继续展示上一个观看状态信息，若变化则在画面中更新用户状态信息，进而形成一段段与直播进程关联的第一数据。于此同时，可结合赛事的进展情况进行自动调节采集频率；如当在赛事比分接近，且接近尾声时可将采集频率提升为Ns-ns(如3s-1s)。若条件允许，可记录所有用户状态信息，并与用户账号关联。In this embodiment, the changed viewing state information is extracted, and displayed by reading the viewing state information of the user within Ns (such as 3s), analyzed once every Ns (such as 3s), if the next Ns (such as If the viewing status information in 3s) has not changed, the previous viewing status information will continue to be displayed, and if it changes, the user status information will be updated on the screen, thereby forming a section of first data associated with the live broadcast process. At the same time, the collection frequency can be automatically adjusted according to the progress of the game; for example, when the game score is close and the end is near, the collection frequency can be increased to Ns-ns (such as 3s-1s). If conditions permit, all user status information can be recorded and associated with the user account.
在本发明的上述实施例中，通过获取观看直播时用户状态信息；将用户状态信息与直播内容进行关联，得到目标关联数据，并存储所述目标关 联数据；在直播画面上显示与所述目标关联数据关联的所述用户状态信息。可以使用户观看直播时的动态变化与直播视频进度关联，并将视频保存，由此解决了用户的动态变化无法与直播整个过程一一关联的问题，取得了用户在回看视频时能够再次回到当时的心境的有益效果。且多人观看直播可区分我与好友，并可生成多分以某个好友为主角的视频，让好友在回看视频时也能够再次回到当时的心境。同时直播画面可结合用户状态信息理解当前比赛的进程(进攻、胜利关键时刻等)，进而调整用户状态的显示方式，如不显示或者显示更多的信息，带来更好的观看体验。直播用户还可以在观看直播的时候自动筛选等功能过滤出自己想要发表的评论、弹幕，使用户在精彩片段，聚焦赛事本身来不及发表言论时，也不会错过精彩瞬间的情绪表达。不仅如此，场外观众观看直播时，可通过开启联网设备的摄像头捕捉下观众的表情、肢体变化，转译成相关的表情包，作为弹幕的一种内容自动发布。In the above-mentioned embodiments of the present invention, by obtaining the user status information when watching live broadcast; associating the user status information with the live broadcast content, the target associated data is obtained, and the target associated data is stored; The user status information associated with the associated data. It can associate the dynamic changes of the user with the progress of the live video while watching the live broadcast, and save the video, thus solving the problem that the dynamic changes of the user cannot be associated with the whole process of the live broadcast one by one. beneficial effect on the state of mind at that time. Moreover, multiple people watching the live broadcast can distinguish me from my friends, and can generate more videos with a friend as the protagonist, so that friends can return to the state of mind at that time when they watch the video back. At the same time, the live broadcast screen can combine the user status information to understand the progress of the current game (attack, critical moment of victory, etc.), and then adjust the display mode of the user status, such as not displaying or displaying more information, to bring a better viewing experience. Live broadcast users can also automatically filter out the comments and bullet screens they want to post when watching the live broadcast, so that users will not miss the emotional expression of the wonderful moments when it is too late to express their comments in the highlight clips and focus on the event itself. Not only that, when the off-site audience is watching the live broadcast, they can capture the audience's expressions and body changes by turning on the camera of the networked device, translate them into related emoticons, and release them automatically as a kind of barrage content.
图8示出了本发明实施例提供的观看直播的用户信息处理装置80的结构示意图。如图8所示，该装置包括：FIG. 8 shows a schematic structural diagram of a user
获取模块81，配置为获取观看直播时用户状态信息；Obtaining
处理模块82，配置为关联所述用户状态信息与直播内容，得到目标关联数据；The
可选的，所述处理模块83还配置为显示所述用户状态信息。Optionally, the processing module 83 is further configured to display the user status information.
可选的，所述获取模块81还配置为获取观看直播时一预设时间段内的用户的观看状态信息；Optionally, the obtaining
根据所述观看状态信息，得到用户状态信息。According to the viewing status information, user status information is obtained.
可选的，所述获取模块81还配置为将所述观看状态信息与情绪库中用户状态信息进行匹配，得到所述用户状态信息。Optionally, the
可选的，所述处理模块82还配置为将所述用户状态信息和直播内容进行关联，得到第一数据；Optionally, the
将所述第一数据与用户的用户帐号进行关联，得到目标关联数据。Associating the first data with the user account of the user to obtain target association data.
可选的，所述处理模块82还配置为根据用户帐号信息，获得与所述用户的帐号信息、所述用户状态信息关联的所述用户的目标关联数据的回看数据和/或所述用户的好友用户的目标关联数据的回看数据，所述用户的用户状态与所述用户的好友的用户状态在一个显示界面中以不同图标进行显示。Optionally, the
可选的，所述处理模块82还配置为根据用户的帐号信息，在与多个所述用户状态信息关联的多个所述用户的目标关联数据之间进行切换，获得与所述用户的每一个状态信息关联的目标关联数据的回看数据。Optionally, the
可选的，所述处理模块82还配置为在用户状态显示区域显示所述用户状态信息，所述用户状态显示区域与弹幕区域是不同的区域；Optionally, the
或者在弹幕区域显示所述用户状态信息。Or display the user status information in the barrage area.
需要说明的是，该实施例是与上述方法实施例对应的装置实施例，上述方法实施例中的所有实现方式均适用于该装置的实施例中，也能达到相同的技术效果。It should be noted that this embodiment is a device embodiment corresponding to the above method embodiment, and all the implementation modes in the above method embodiment are applicable to this device embodiment, and can also achieve the same technical effect.
本发明实施例提供了一种非易失性计算机存储介质，所述计算机存储介质存储有至少一可执行指令，该计算机可执行指令可执行上述任意方法实施例中的观看直播的用户信息处理方法。An embodiment of the present invention provides a non-volatile computer storage medium, the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the user information processing method for watching live broadcast in any of the above method embodiments .
图9示出了本发明实施例提供的计算设备的结构示意图，本发明具体实施例并不对计算设备的具体实现做限定。FIG. 9 shows a schematic structural diagram of a computing device provided by an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device.
如图9所示，该计算设备可以包括：处理器(processor)、通信接口(Communications Interface)、存储器(memory)、以及通信总线。As shown in FIG. 9, the computing device may include: a processor (processor), a communication interface (Communications Interface), a memory (memory), and a communication bus.
其中：处理器、通信接口、以及存储器通过通信总线完成相互间的通信。通信接口，配置为与其它设备比如客户端或其它服务器等的网元通信。处理器，配置为执行程序，具体可以执行上述用于计算设备的观看直播的用户信息处理方法实施例中的相关步骤。Wherein: the processor, the communication interface, and the memory complete the mutual communication through the communication bus. A communication interface configured to communicate with network elements of other devices such as clients or other servers. The processor is configured to execute a program, and specifically, may execute relevant steps in the above embodiment of the method for processing user information for watching a live broadcast on a computing device.
具体地，程序可以包括程序代码，该程序代码包括计算机操作指令。Specifically, the program may include program code including computer operation instructions.
处理器可能是中央处理器(Central Processing Unit，CPU)，或者是特定集成电路(Application Specific Integrated Circuit，ASIC)，或者是被配置成实施本发明实施例的一个或多个集成电路。计算设备包括的一个或多个处理器，可以是同一类型的处理器，如一个或多个CPU；也可以是不同类型的处理器，如一个或多个CPU以及一个或多个ASIC。The processor may be a central processing unit (Central Processing Unit, CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the computing device may be of the same type, such as one or more CPUs, or may be different types of processors, such as one or more CPUs and one or more ASICs.
存储器，配置为存放程序。存储器可能包含高速随机存取存储器(Random Access Memory，RAM)，也可能还包括非易失性存储器(Non-Volatile Memory，NVM)，例如至少一个磁盘存储器。A memory configured to store a program. The memory may include a high-speed random access memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory.
程序具体可以用于使得处理器执行上述任意方法实施例中的观看直播的用户信息处理方法。程序中各步骤的具体实现可以参见上述观看直播的用户信息处理方法实施例中的相应步骤和单元中对应的描述，在此不赘述。所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的设备和模块的具体工作过程，可以参考前述方法实施例中的对应过程描述，在此不再赘述。Specifically, the program may be used to cause the processor to execute the user information processing method for watching live broadcast in any of the above method embodiments. For the specific implementation of each step in the program, refer to the corresponding steps and corresponding descriptions in the units in the above-mentioned embodiment of the user information processing method for watching live broadcast, and details are not repeated here. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the foregoing method embodiments, and details are not repeated here.
在此提供的算法或显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述，构造这类系统所要求的结构是显而易见的。此外，本发明实施例也不针对任何特定编程语言。应当明白，可以利用各种编程语言实现在此描述的本发明实施例的内容，并且上面对特定语言所做的描述是为了披露本发明实施例的最佳实施方式。The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other device. Various generic systems can also be used with the teachings based on this. The structure required to construct such a system is apparent from the above description. Furthermore, embodiments of the present invention are not directed to any particular programming language. It should be understood that various programming languages can be used to implement the contents of the embodiments of the present invention described herein, and the above description of specific languages is for disclosing the best implementation mode of the embodiments of the present invention.
在此处所提供的说明书中，说明了大量具体细节。然而，能够理解，本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.
类似地，应当理解，为了精简本发明实施例并帮助理解各个发明方面中的一个或多个，在上面对本发明的示例性实施例的描述中，本发明实施 例的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而，并不应将该公开的方法解释成反映如下意图：即所要求保护的本发明实施例要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说，如下面的权利要求书所反映的那样，发明方面在于少于前面公开的单个实施例的所有特征。因此，遵循具体实施方式的权利要求书由此明确地并入该具体实施方式，其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be understood that in the above description of the exemplary embodiments of the present invention, various features of the embodiments of the present invention are sometimes grouped together in order to simplify the embodiments of the present invention and facilitate understanding of one or more of the various inventive aspects. in a single embodiment, figure, or description thereof. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed embodiments of the invention require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.
本领域那些技术人员可以理解，可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件，以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外，可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述，本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外，本领域的技术人员能够理解，尽管在此的一些实施例包括其它实施例中所包括的某些特征而不是其它特征，但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如，在下面的权利要求书中，所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. And form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
本发明的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(Digital Signal Processor，DSP)来实现根据本发明实施例的一些或者全部部件的一些或者全部功能。本发明实施例还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如，计算机程序和计算机程序产品)。 这样的实现本发明实施例的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (Digital Signal Processor, DSP) may be used in practice to implement some or all functions of some or all components according to the embodiments of the present invention. Embodiments of the present invention can also be implemented as a device or apparatus program (eg, computer program and computer program product) for performing a part or all of the methods described herein. Such a program implementing an embodiment of the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.
应该注意的是上述实施例对本发明实施例进行说明而不是对本发明进行限制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明实施例可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。上述实施例中的步骤，除有特殊说明外，不应理解为对执行顺序的限定。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. Embodiments of the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be construed as limiting the execution order.
Claims (10)
Translated fromChineseApplications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110938730.6ACN113656638B (en) | 2021-08-16 | 2021-08-16 | A method, device and equipment for processing user information of watching live broadcast |
| CN202110938730.6 | 2021-08-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023020509A1true WO2023020509A1 (en) | 2023-02-23 |
Family
ID=78491193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/112867CeasedWO2023020509A1 (en) | 2021-08-16 | 2022-08-16 | Method and apparatus for processing information of user watching live broadcast, and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113656638B (en) |
| WO (1) | WO2023020509A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656638B (en)* | 2021-08-16 | 2024-05-07 | 咪咕数字传媒有限公司 | A method, device and equipment for processing user information of watching live broadcast |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130232516A1 (en)* | 2012-03-01 | 2013-09-05 | David S. PAULL | Method And Apparatus for Collection and Analysis of Real-Time Audience Feedback |
| CN105829995A (en)* | 2013-10-22 | 2016-08-03 | 谷歌公司 | Capture media content based on viewer expressions |
| CN110519617A (en)* | 2019-07-18 | 2019-11-29 | 平安科技（深圳）有限公司 | Video comment processing method, device, computer equipment and storage medium |
| CN111352507A (en)* | 2020-02-27 | 2020-06-30 | 维沃移动通信有限公司 | Information prompting method and electronic device |
| CN113656638A (en)* | 2021-08-16 | 2021-11-16 | 咪咕数字传媒有限公司 | Method, device and equipment for processing user information for watching live broadcast |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9020326B2 (en)* | 2005-08-23 | 2015-04-28 | At&T Intellectual Property Ii, L.P. | System and method for content-based navigation of live and recorded TV and video programs |
| US20130038756A1 (en)* | 2011-08-08 | 2013-02-14 | Samsung Electronics Co., Ltd. | Life-logging and memory sharing |
| US10986063B2 (en)* | 2013-02-27 | 2021-04-20 | Comcast Cable Communications, Llc | Methods and systems for providing supplemental data |
| CN105681855B (en)* | 2015-11-30 | 2018-07-06 | 乐视网信息技术（北京）股份有限公司 | Emulation mode and device are watched jointly in a kind of live broadcast |
| CN105740029B (en)* | 2016-03-03 | 2019-07-05 | 腾讯科技（深圳）有限公司 | A kind of method, user equipment and system that content is presented |
| CN107241622A (en)* | 2016-03-29 | 2017-10-10 | 北京三星通信技术研究有限公司 | video location processing method, terminal device and cloud server |
| CN106303578B (en)* | 2016-08-18 | 2020-10-16 | 北京奇虎科技有限公司 | Information processing method based on anchor program, electronic equipment and server |
| CN107154069B (en)* | 2017-05-11 | 2021-02-02 | 上海微漫网络科技有限公司 | Data processing method and system based on virtual roles |
| CN107635104A (en)* | 2017-08-11 | 2018-01-26 | 光锐恒宇（北京）科技有限公司 | A kind of method and apparatus of special display effect in the application |
| CN109635616B (en)* | 2017-10-09 | 2022-12-27 | 阿里巴巴集团控股有限公司 | Interaction method and device |
| WO2019191708A1 (en)* | 2018-03-30 | 2019-10-03 | Realnetworks, Inc. | Socially annotated audiovisual content |
| CN110881131B (en)* | 2018-09-06 | 2021-07-23 | 武汉斗鱼网络科技有限公司 | A kind of classification method and related device of live video playback |
| CN110324647A (en)* | 2019-07-15 | 2019-10-11 | 北京字节跳动网络技术有限公司 | The determination method, apparatus and electronic equipment of information |
| US11589094B2 (en)* | 2019-07-22 | 2023-02-21 | At&T Intellectual Property I, L.P. | System and method for recommending media content based on actual viewers |
| CN111343467B (en)* | 2020-02-10 | 2021-10-26 | 腾讯科技（深圳）有限公司 | Live broadcast data processing method and device, electronic equipment and storage medium |
| CN113132787A (en)* | 2021-03-15 | 2021-07-16 | 北京城市网邻信息技术有限公司 | Live content display method and device, electronic equipment and storage medium |
| CN113110783B (en)* | 2021-04-16 | 2022-05-20 | 北京字跳网络技术有限公司 | Control display method, device, electronic device and storage medium |
- 2021
- 2021-08-16CNCN202110938730.6Apatent/CN113656638B/enactiveActive
- 2022
- 2022-08-16WOPCT/CN2022/112867patent/WO2023020509A1/ennot_activeCeased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130232516A1 (en)* | 2012-03-01 | 2013-09-05 | David S. PAULL | Method And Apparatus for Collection and Analysis of Real-Time Audience Feedback |
| CN105829995A (en)* | 2013-10-22 | 2016-08-03 | 谷歌公司 | Capture media content based on viewer expressions |
| CN111522432A (en)* | 2013-10-22 | 2020-08-11 | 谷歌有限责任公司 | Capturing media content according to viewer expressions |
| CN110519617A (en)* | 2019-07-18 | 2019-11-29 | 平安科技（深圳）有限公司 | Video comment processing method, device, computer equipment and storage medium |
| CN111352507A (en)* | 2020-02-27 | 2020-06-30 | 维沃移动通信有限公司 | Information prompting method and electronic device |
| CN113656638A (en)* | 2021-08-16 | 2021-11-16 | 咪咕数字传媒有限公司 | Method, device and equipment for processing user information for watching live broadcast |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113656638A (en) | 2021-11-16 |
| CN113656638B (en) | 2024-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109547819B (en) | Live list display method and device and electronic equipment | |
| TWI752502B (en) | Method for realizing lens splitting effect, electronic equipment and computer readable storage medium thereof | |
| US20210249012A1 (en) | Systems and methods for operating an output device | |
| US10019825B2 (en) | Karaoke avatar animation based on facial motion data | |
| CN109691124B (en) | Method and system for automatically generating video highlights | |
| TWI255141B (en) | Method and system for real-time interactive video | |
| CN110602516A (en) | Information interaction method and device based on live video and electronic equipment | |
| US20150199995A1 (en) | Modular content generation, modification, and delivery system | |
| CN105955490A (en) | An information processing method, device and mobile terminal based on augmented reality | |
| CN108337573A (en) | A kind of implementation method that race explains in real time and medium | |
| CN109154862B (en) | Apparatus, method and computer readable medium for processing virtual reality content | |
| US20140331246A1 (en) | Interactive content and player | |
| US12395688B2 (en) | Group party view and post viewing digital content creation | |
| WO2021023047A1 (en) | Facial image processing method and device, terminal, and storage medium | |
| CN113301356A (en) | Method and device for controlling video display | |
| JP2018073217A (en) | Information processing device, and control method and control program for information processing device | |
| WO2023020509A1 (en) | Method and apparatus for processing information of user watching live broadcast, and device | |
| CN115665508B (en) | Method, device, electronic device and storage medium for generating video summary | |
| WO2022041202A1 (en) | Object-based video combining method, client end, and system | |
| CN109213719A (en) | Method and device for displaying content of electronic book and storage medium | |
| JP2016004566A (en) | Presentation information control device, method and program | |
| CN115665356B (en) | Audio import method, device and electronic device | |
| JP7596602B2 (en) | Video streaming to control the display of comments posted during a stream | |
| CN119316648A (en) | Bullet screen information display method, device, computer equipment and storage medium | |
| Pavlik | Immersion: Implications of wearable technologies for the future of broadcasting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | Ref document number:22857820 Country of ref document:EP Kind code of ref document:A1 | |
| NENP | Non-entry into the national phase | Ref country code:DE | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:22857820 Country of ref document:EP Kind code of ref document:A1 | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:22857820 Country of ref document:EP Kind code of ref document:A1 | |
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established | Free format text:NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 26/09/2024) | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:22857820 Country of ref document:EP Kind code of ref document:A1 |