CN113923498A - Processing method and device - Google Patents

Abstract

According to the processing method provided by the application, for at least two electronic devices which establish target communication connection and share at least one path of video stream data, screen information of the electronic devices can be obtained, and then display layout information of the at least one path of video stream data is determined to be output at least based on the screen information, so that the at least one path of video stream data can be output to a display screen of the corresponding electronic device according to the display layout information. Therefore, under the target communication connection, the method and the device can automatically adapt and display layout information for at least one path of video stream data shared among a plurality of electronic devices, effectively utilize screen layout of the electronic devices, and improve the utilization rate of a display screen.

Description

Processing method and device

Technical Field

The present application relates to the field of software technologies, and in particular, to a processing method and apparatus.

Background

In the content sharing software at the present stage, the equipment of the speaker can generally upload two paths of videos: one path of video is a content video, and the definition needs to be guaranteed preferentially, wherein the content video generally comprises a PPT video, a whiteboard video, a product display video and the like; the other path of video is motion video, which needs to be guaranteed with priority, and the motion video generally comprises a speaker video, a designated participant video, or a product operation video and the like.

The display screen of the speaker device not only needs to display the video uploaded by the speaker, but also needs to display the video uploaded by the speaker, so that the problem of compact video layout can easily occur in the display screen.

Disclosure of Invention

In view of the above, the present application provides a processing method and apparatus, and the technical solution is as follows:

one aspect of the present application provides a processing method, including:

the method comprises the steps of obtaining screen information of at least two electronic devices under the condition that a target communication connection is established between the at least two electronic devices, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two electronic devices;

and determining display layout information for outputting the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

Preferably, the obtaining screen information of the electronic device includes:

obtaining screen information of each electronic device in the at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a first electronic device belonging to a target object in the at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a determined target electronic device in the at least two electronic devices; or the like, or, alternatively,

and if the second electronic equipment in the at least two pieces of electronic equipment is switched from the first state to the second state, acquiring the screen information of the second electronic equipment.

Preferably, the determining, based on at least the screen information, display layout information for outputting the at least one piece of video stream data includes:

in a case where the target communication connection is used to share one path of video stream data between the at least two electronic devices, obtaining first attribute information of each object content in the one path of video stream data, and determining display layout information of each object content based on the first attribute information and the screen information; or the like, or, alternatively,

in a case where the target communication connection is used to share at least two paths of video stream data between the at least two electronic devices, second attribute information of each path of video stream data is obtained, and display layout information of each path of video stream data is determined based on the second attribute information and the screen information.

Preferably, the determining display layout information of the object contents based on the first attribute information and the screen information includes:

determining a display priority of each object content at least based on the first attribute information;

determining a third electronic device of the at least two electronic devices whose screen configuration information satisfies a first condition based on the screen information;

and performing area division on the display screen of the third electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the third electronic device based on the display priority to obtain the display layout information.

Preferably, the determining display layout information of the object contents based on the first attribute information and the screen information includes:

determining a display priority of each object content at least based on the first attribute information;

and performing area division on the display screen of the first electronic device/the target electronic device/the second electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the first electronic device/the target electronic device/the second electronic device based on the display priority to obtain the display layout information.

Preferably, the determining the display layout information of the video stream data based on the second attribute information and the screen information includes:

determining the output priority of each path of video stream data at least based on the second attribute information;

determining a fourth electronic device of the at least two electronic devices whose screen configuration information satisfies a second condition based on the screen information;

and performing area division on the display screen of the fourth electronic device based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the fourth electronic device based on the output priority to obtain the display layout information.

Preferably, the determining the display layout information of the video stream data based on the second attribute information and the screen information includes:

determining the output priority of each path of video stream data at least based on the second attribute information;

dividing the display screen of the first electronic device/the target electronic device/the second electronic device into regions based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the first electronic device/the target electronic device/the second electronic device based on the output priority, so as to obtain the display layout information.

Preferably, the method further comprises:

and obtaining control information of a target application which is depended on by the target communication connection, and determining the display layout information at least based on the control information and the screen information.

Preferably, the method further comprises:

and after the at least one path of video stream data is displayed and output to a display screen of the electronic equipment according to the display layout information, if the adjustment operation acting on the output position of the at least one path of video stream data is obtained, updating the display layout information.

Another aspect of the present application provides a processing apparatus, the apparatus comprising:

the information acquisition module is used for acquiring screen information of at least two pieces of electronic equipment under the condition that target communication connection is established between the at least two pieces of electronic equipment, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two pieces of electronic equipment;

and the layout determining module is used for determining display layout information of the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

Another aspect of the present application provides an electronic device, including:

at least one memory and at least one processor; the memory stores an application program, the processor calls the application program stored in the memory, and the application program is used for realizing that:

the method comprises the steps of obtaining screen information of at least two electronic devices under the condition that a target communication connection is established between the at least two electronic devices, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two electronic devices; and determining display layout information for outputting the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

Another aspect of the present application provides a storage medium having stored therein computer-executable instructions for performing the processing method.

According to the technical scheme, the processing method provided by the application can obtain the screen information of at least two electronic devices which establish the target communication connection and share at least one path of video stream data, and further determine the display layout information of the at least one path of video stream data to be output at least based on the screen information, so that the at least one path of video stream data can be output to the display screen of the corresponding electronic device according to the display layout information. Therefore, under the target communication connection, the method and the device can automatically adapt and display layout information for at least one path of video stream data shared among a plurality of electronic devices, effectively utilize screen layout of the electronic devices, and improve the utilization rate of a display screen.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a block diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure;

FIG. 2 is a flow chart of a method of processing according to an embodiment of the present disclosure;

fig. 3 is a system structural diagram of a video conference system according to an embodiment of the present application;

fig. 4 is a schematic view of a video conference scene provided in an embodiment of the present application;

FIG. 5 is a diagram illustrating an example display layout provided by an embodiment of the present application;

FIG. 6 is a diagram of another example display layout provided by an embodiment of the present application;

FIGS. 7(a) and 7(b) are diagrams of another exemplary display layout provided in an embodiment of the present application, respectively;

FIGS. 8(a) and 8(b) are diagrams of another exemplary display layout provided in an embodiment of the present application, respectively;

FIGS. 9(a) and 9(b) are diagrams of another exemplary display layout provided in an embodiment of the present application, respectively;

FIGS. 10(a) and 10(b) are diagrams of another exemplary display layout provided by an embodiment of the present application, respectively;

fig. 11 is a schematic structural diagram of a processing apparatus according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.

The present application provides a processing method, which may be applied to an electronic device, and referring to a hardware structure block diagram of the electronic device shown in fig. 1, the hardware structure of the electronic device may include: aprocessor 11, acommunication interface 12, amemory 13 and acommunication bus 14;

in the embodiment of the present application, the number of theprocessor 11, thecommunication interface 12, thememory 13 and thecommunication bus 14 is at least one, and theprocessor 11, thecommunication interface 12 and thememory 13 complete mutual communication through thecommunication bus 14.

Theprocessor 11 may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), or an application Specific Integrated circuit (asic), or one or more Integrated circuits configured to implement embodiments of the present application, etc.

Thememory 13 may include a high-speed RAM memory, and may further include a non-volatile memory (non-volatile memory) or the like, for example, at least one disk memory.

Thememory 13 stores applications and data generated by the applications, and theprocessor 11 executes the applications to implement the following functions:

under the condition that a target communication connection is established between at least two electronic devices, screen information of the electronic devices is obtained, and the target communication connection is used for sharing at least one path of video stream data between the at least two electronic devices; and determining display layout information for outputting the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

It should be noted that the processor performs the refinement and extension of the functions implemented by the application, as described below.

An embodiment of the present application provides a processing method, referring to a method flowchart shown in fig. 2, where the method includes the following steps:

step S101: the method comprises the steps of obtaining screen information of the electronic equipment under the condition that a target communication connection is established between the at least two electronic equipment, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two electronic equipment.

In the embodiment of the application, the target communication connection can be communication connection in content sharing scenes such as video conferences, video calls, screen projection and the like. For convenience of understanding, the present application is described below by taking a video conference scenario as an example, and it is understood that other content sharing scenarios not listed are also within the scope of the present application.

The present application is described with reference to a video conference scenario as an example. First, a system architecture of a video conference system in a video conference scene is described below. Referring to the system architecture diagram shown in fig. 3, the video conference system includes at least two electronic devices and a server, where the electronic devices establish a communication connection for the video conference through the server, and the at least two electronic devices belong to i (i ≧ 1) areas, and the number of the electronic devices in each area is one or more, that is, n ≧ 1, and m ≧ 1. The types of electronic devices in the video conference system include, but are not limited to, a conference machine, a notebook computer, a desktop computer, a tablet, a smart phone, and the like.

After a user of the electronic device enters a video conference through the login account, the role of the user in the video conference can be determined through the login account or a video conference manager, and in brief, the roles involved in the video conference include a speaker and a listener. The electronic device corresponding to the speaker can obtain or generate at least one path of video stream data shared by the speaker in the video conference, the at least one path of video stream data is forwarded to the electronic device corresponding to each speaker through the server, and the at least one path of video stream data is displayed on the display screen of the electronic device corresponding to each speaker, so that the speaker can watch the at least one path of video stream data shared by the speaker.

See fig. 4 for a schematic view of a video conference scenario. In the video conference scene, a speaker and a part of listeners are located in an area 1, and another part of the listeners are located in an area 2, the speaker speaks PPT content in an electronic device (i.e., an electronic device a), and the electronic device a simultaneously starts a camera to collect body motions of the speaker, that is, the speaker can share two paths of video stream data to the talker through the electronic device a, wherein one path is a content video containing the PPT content, and the other path is a motion video containing the motions of the speaker.

Meanwhile, one part of the listeners in the area 1 watch the content video and the action video shared by the speakers through a display screen externally connected with the electronic equipment A, and the other part of the listeners access the video conference through own electronic equipment (namely, the electronic equipment B) to watch the content video and the action video shared by the speakers on line; the listeners in the area 2 also access the video conference through their own electronic device (i.e., electronic device C) to watch the content video and the action video shared by the speakers online.

The display screen in the area 1 may be regarded as a part of the display screen of the electronic device a as an external device of the electronic device a. Assuming that the electronic device a is a notebook computer with an open top cover, the electronic device a has two display screens, one of which is a built-in screen of the notebook computer, and the other is the external display screen. Similarly, the electronic device B and the electronic device C both have at least one display screen, and the display screen may be a built-in screen of the electronic device and may also be at least one or more display screens externally connected to the electronic device.

It should be further noted that an execution subject of the processing method in the embodiment of the present application may be an electronic device in a video conference system, and may also be a server, where the electronic device may be an electronic device corresponding to a speaker, and may also be an electronic device corresponding to a listener, which is not limited in this embodiment of the present application.

Assuming that the main execution body of the processing method in the embodiment of the present application is the electronic device corresponding to the speaker, that is, the electronic device a, on the one hand, the electronic device a may obtain its own screen information, and on the other hand, the electronic device B and/or the electronic device C, which establishes a communication connection with the electronic device a, may also obtain screen information of the electronic device B and/or the electronic device C through the server, where the screen information may include attribute information of display screens of the electronic device, such as the number of the display screens, the resolution and the size of each display screen, and layout information of each display screen (for example, whether the display screen is a main screen). It is further assumed that the main execution body of the processing method in the embodiment of the present application is an electronic device corresponding to a listener, that is, an electronic device B or an electronic device C. Taking the electronic device B as an example, the screen information of the electronic device B can be obtained, and the screen information of the electronic device a and/or the electronic device C with which the communication connection is established can be obtained through the server. Further, assuming that the execution subject of the processing method in the embodiment of the present application is the server, the screen information of each electronic device or some electronic devices in the video conference, including the screen information of one or more of the electronic device a, the electronic device B, and the electronic device C, may be obtained.

Step S102: and determining display layout information for outputting the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

In the embodiment of the application, for each electronic device obtaining the screen information, the display layout information matched with the display screen of the electronic device may be determined according to the screen information of the electronic device, and the display layout information may include a corresponding position area of each path of video stream data in the display screen, so that the electronic device can draw each path of video stream data in different position areas in the display screen based on the display layout information, thereby improving the rationality of the screen layout.

Of course, in the above-described scheme, each electronic device that obtains the screen information has corresponding display layout information, where the display layout information of each electronic device may be determined based on only its own screen information or may also be determined based on screen information of other electronic devices, which is not limited in this embodiment of the application.

For ease of understanding, the description continues with the video conference scenario shown in fig. 4 as an example. The electronic devices in the video conference scenario include the electronic device of the speaker (i.e., electronic device a), the electronic device of the speaker located in the same area as the speaker (i.e., electronic device B), and the electronic device of the speaker located in a different area from the speaker (i.e., electronic device C). Therefore, for some application scenarios, the screen information of each electronic device (including the electronic device A, B, C) may be obtained, and then the screen layout information corresponding to the electronic device a is determined according to the screen information of the electronic device a, the screen layout information corresponding to the electronic device B is determined according to the screen information of the electronic device B, and the screen layout information corresponding to the electronic device C is determined according to the screen information of the electronic device C, so that each electronic device has the display layout information matching with its display screen, and the display layout information between any two electronic devices may be the same or different.

For other application scenarios, the screen information of the electronic device with specific attributes may be obtained, for example, the screen information of the electronic device of the speaker located in a different area from the speaker, that is, the screen information of the electronic device C may be obtained, and then the screen layout information corresponding to the electronic device C may be determined according to the screen information of the electronic device C, so that the viewing experience of the speaker located in a different place from the speaker may be considered in a focused manner, and the display layout information between any two electronic devices C may be the same or different.

The processing method provided by the embodiment of the application can automatically adapt and display layout information for at least one path of video stream data shared among a plurality of electronic devices under the target communication connection, effectively utilize the screen layout of the electronic devices, and improve the utilization rate of the display screen.

The embodiment of the present application provides another processing method, as an implementation manner for obtaining screen information of an electronic device, including the following steps:

obtaining screen information of each electronic device in at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a first electronic device belonging to a target object in at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a determined target electronic device in at least two electronic devices; or the like, or, alternatively,

and if the second electronic equipment in the at least two electronic equipment is switched from the first state to the second state, acquiring the screen information of the second electronic equipment.

In the embodiment of the application, the electronic equipment for obtaining the screen information can be selected according to different application scenes. For ease of understanding, the description continues with the video conference scenario shown in fig. 4 as an example.

1) Screen information of each electronic device that establishes a communication connection for the video conference is obtained. As in the above embodiment, the screen information of each of the electronic devices A, B, C may be obtained, and the display layout information that matches the display screen of each of the electronic devices is determined with the screen information of each of the electronic devices, that is, each of the electronic devices A, B, C has the display layout information corresponding to its screen information.

2) Screen information of an electronic device (i.e., a first electronic device) belonging to a target object that establishes a communication connection of a video conference is obtained. The target object may be a specific role or a specific user, for example, the first electronic device may be an electronic device of a speaker (i.e., electronic device a), an electronic device of some or some speakers (i.e., electronic device B and/or electronic device C), and an electronic device of a specific user, and the first electronic device may be one or more electronic devices. On one hand, the display layout information corresponding to the first electronic equipment can be determined according to the screen information of the first electronic equipment; on the other hand, according to the screen information of the first electronic device, the display layout information corresponding to the first electronic device may be determined, and the display layout information of other electronic devices related to the first electronic device (for example, electronic devices that are close to the screen information of the first electronic device or that establish a communication connection for a video conference) may also be determined, which is not limited in the embodiment of the present application.

3) Screen information of a target electronic device that establishes a communication connection for the video conference is obtained. The target electronic device is a determined electronic device, which may be an electronic device of the speaker (i.e., electronic device a), may also be an electronic device of the speaker (i.e., electronic device B and/or electronic device C), may also be an electronic device having a specific attribute (e.g., a specific location, and further e.g., having certain rights), and may be one or more. On one hand, the display layout information corresponding to the target electronic equipment can be determined according to the screen information of the target electronic equipment; on the other hand, according to the screen information of the target electronic device, the display layout information corresponding to the target electronic device may be determined, and the display layout information of other electronic devices related to the target electronic device (for example, electronic devices that are close to the screen information of the target electronic device or that establish a communication connection for a video conference) may also be determined, which is not limited in this embodiment of the present application.

4) Screen information of an electronic device (i.e., a second electronic device) in which a state of a communication connection for establishing a video conference is changed is obtained. The second electronic device is switched from the first state to the second state, for example, from the unregistered state to the logged-in state (i.e., the video conference is started/the electronic device is entering in progress), and further, for example, the logged-in account is switched from the first account to the second account (i.e., the role of the user changes), and the number of the second electronic devices may be one or more. On one hand, the display layout information corresponding to the second electronic equipment can be determined according to the screen information of the second electronic equipment; on the other hand, according to the screen information of the second electronic device, the display layout information corresponding to the second electronic device may be determined, and the display layout information of other electronic devices related to the second electronic device (for example, electronic devices that are close to the screen information of the second electronic device or that establish a communication connection for a video conference) may also be determined, which is not limited in the embodiment of the present application.

Of course, in some other embodiments, multiple conditions may be set for the electronic device that obtains the screen information, for example, the electronic device that simultaneously satisfies 2), 3), and 4), which are described in 2) and 4), and assuming that the target object is a talker in the area 2, in this embodiment of the present application, it is necessary to monitor the state of the electronic device (i.e., the electronic device C) of the talker in the area 2 in real time, determine one or more electronic devices of the electronic device C that are switched from the first state to the second state, and obtain the screen information of the electronic device.

An embodiment of the present application provides another processing method, as an implementation manner for determining display layout information of at least one video stream data output based on at least screen information, including the following steps:

in the case that a target communication connection is used for sharing one path of video stream data between at least two electronic devices, obtaining first attribute information of each object content in the one path of video stream data, and determining display layout information of each object content based on the first attribute information and screen information; or the like, or, alternatively,

in a case where the target communication connection is used to share at least two paths of video stream data between at least two electronic devices, second attribute information of each path of video stream data is obtained, and display layout information of each path of video stream data is determined based on the second attribute information and the screen information.

In the embodiment of the present application, video stream data shared between at least two electronic devices under a target communication connection is described as one or more paths of the video stream data. For ease of understanding, the description continues with the example of a video conference scenario.

1) Generally, when a video stream data is shared in a video conference, the video stream data may be a content video, a motion video, or a video in which the content video and the motion video are combined. The description is given by taking a video path combining a content video and a motion video, and assuming that a presenter uses a whiteboard to present related content and a conference machine starts a camera to simultaneously acquire the body motion and the content of the whiteboard of the presenter, at the moment, the conference machine uploads a video stream data including both the whiteboard content and the presenter motion to a server, and the video stream data includes both the content video and the motion video.

For the video stream data, the object contents included therein include at least a speaker and a whiteboard, but may also include other object contents, such as peripheral speakers. At this time, the attribute information (i.e. the first attribute information) of each object content in the channel of video stream data may be obtained, where the first attribute information may be description information of the object content, a category (such as a person or a whiteboard) including the object content, a role (such as a speaker or a listener) of the object content, and the like; further, the display layout information of each object content, that is, the corresponding position region of each object content in the display screen, may be determined according to the first attribute information of each object content, and the area and the relative position relationship of the corresponding position region of each object content may be determined according to the first attribute information.

For example, assuming that the target content included in the video stream data includes a speaker, a whiteboard and a listener, when the video stream data is output, the display screen of the electronic device may divide the video stream data into multiple video stream data according to the target content, and the divided video stream data may correspond to at least one target content. Referring to the display layout example shown in fig. 5, one path of video stream data is divided into three paths of video stream data according to three object contents, namely, a presenter, a whiteboard and a listener, where a position area of the one path of video stream data corresponding to the whiteboard in the display screen is a central position, position areas of the one path of video stream data corresponding to the presenter and the listener in the display screen are an upper left position and a lower right position, respectively, and areas of the one path of video stream data corresponding to each object content in the position areas of the display screen are sequentially the whiteboard, the presenter and the listener from large to small.

2) When at least two paths of video stream data are shared in a video conference, each path of video stream data may be a content video or an action video, and the at least two paths of video stream data may include at least one path of content video and at least one path of action video, may further include multiple paths of content video, and may further include multiple paths of action video, which is not limited in this application embodiment.

For the at least two paths of video stream data, attribute information (i.e. second attribute information) of each path of video stream data may be obtained, where the second attribute information may be description information of the path of video stream data, a category (such as content video or action video) containing the path of video stream data, video content in the path of video stream data (such as PPT or whiteboard in content video, and further such as character action or product operation in action video), and the like; further, the display layout information of each video stream data, that is, the position area of each video stream data in the display screen, may be determined according to the second attribute information of each video stream data, and the area and relative position relationship of the position area corresponding to each video stream data may be determined according to the second attribute information.

With continued reference to the video conference scenario shown in fig. 4, the speaker uploads two paths of video stream data to the server through the electronic device a, where one path is a content video containing PPT content, and the other path is an action video containing the action of the speaker, and the listener in the area 1 obtains the two paths of video stream data shared by the speaker through the electronic device B and the listener in the area 2 through the electronic device C. For the two paths of video stream data, one path of video stream data is a content video, the video content of the video stream data is PPT content, the other path of video stream data is a motion video, and the video content of the video stream data is a speaker. Referring to the display layout example shown in fig. 6, the position region of the content video in which the PPT content is located in the display screen is the center position, the position region of the action video in which the speaker is located in the display screen is the upper left position, and the area of the position region of the content video is larger than that of the position region of the action video, so that the user can conveniently view the PPT content.

An embodiment of the present application provides another processing method, as an implementation manner for determining display layout information of each object content based on first attribute information and screen information, including the following steps:

determining a display priority of each object content based on at least the first attribute information;

determining a third electronic device of the at least two electronic devices, wherein the screen configuration information meets the first condition, based on the screen information;

and performing area division on the display screen of the third electronic equipment based on the display priority, or determining the display output position of each object content by referring to the display screen of the third electronic equipment based on the display priority to obtain display layout information.

For convenience of understanding, in the embodiment of the present application, a path of video stream data is taken as a path of video in which content video and motion video are combined. The conference machine starts the camera, collects the limb actions of the speaker and the content of the whiteboard at the same time, and uploads a path of video streaming data containing the content of the whiteboard and the actions of the speaker to the server. It is assumed that the target content included in the video stream data includes a speaker, a whiteboard, and a listener, and each target content has corresponding first attribute information. According to the category and/or the role in the first attribute information of each object content, the display priority of each object content can be determined, for example, the display priority of the whiteboard is higher than that of the person, and for example, the display priority of the speaker is higher than that of the listener.

Further, the electronic device (i.e., the third electronic device) whose screen configuration information satisfies the corresponding condition (i.e., the first condition) is determined based on the obtained screen information of each electronic device, for example, the first condition may be a lowest screen configuration condition, and at this time, one electronic device with the lowest screen configuration may be determined according to the screen information of each electronic device, and specifically, the electronic device with the lowest screen configuration may be determined as the electronic device with the lowest screen configuration, i.e., the third electronic device, by considering the number of display screens in the screen information and the resolution and size of each display screen.

And performing area division on the display screen of the third electronic equipment based on the display priority of each object content, wherein one path of video stream data corresponding to each object content has a corresponding position area in the display screen of the third electronic equipment. As described above, since the whiteboard has a higher priority than the human priority and the speaker has a higher priority than the listener, the display screen of the third electronic device may display or not display the video stream data corresponding to the whiteboard mainly, the video stream data corresponding to the speaker secondarily, and the video stream data corresponding to the listener may be displayed according to a predetermined command, and of course, the video stream data corresponding to the listener has the smallest area of the position area and the worst viewability (for example, is set at the lower right position) when displayed.

Assume that the third electronic device is a notebook computer, which has no external display screen connected thereto, only one built-in screen, and a typical size of 12 to 17 inches. At this time, the one video stream data corresponding to the whiteboard is taken as the main, the one video stream data corresponding to the speaker is drawn at the corner, the position area corresponding to the two video stream data is displayed and outputted in a way of picture-in-picture stacking, the one video stream data corresponding to the listener is not displayed, and the display layout is shown in fig. 7(a), for example. Of course, if the presenter is not in the lecture and one of the video stream data corresponding to the whiteboard is interrupted, the position area of the one of the video stream data corresponding to the presenter may be maximized, and the position area of the one of the video stream data corresponding to the presenter or the video stream data uploaded by the third electronic device (for example, the video of the third device user or the video of the specified user around the third device) may be drawn at a corner, and displayed and output in a way of overlapping in picture, where the display layout is shown in fig. 7(b), for example.

It is assumed that the third electronic device is a typical desktop computer or a notebook computer with a top cover closing an external display screen, and has only one desktop display, typically 20 to 32 inches in size. In this case, the display layout may be mainly one video stream data corresponding to the white board, but may be a display layout having more than one video stream data on top of one another (or one video stream data on top of one another), and the display layout may be, for example, as shown in fig. 8(a), in which a position area of one or more video stream data among one video stream data corresponding to the presenter, one video stream data corresponding to the listener, and video stream data uploaded by the third electronic device is drawn below the display screen without overlapping the position area of the white board. Of course, if the presenter is not in the explanation and the one path of video stream data corresponding to the whiteboard is interrupted, the position areas of one or more video stream data in the one path of video stream data corresponding to the presenter, the one path of video stream data corresponding to the listener, and the video stream data uploaded by the third device may be displayed and output in a multi-grid manner, and the display layout is shown in fig. 8(b), for example.

Further, it is assumed that when the third electronic device is externally connected to two or more large screens, for example, the third electronic device is a desktop computer or a notebook computer externally connected to multiple display screens, or a conference machine externally connected to multiple display screens, the advantage of the large screen can be fully utilized to draw information on the large screen as much as possible, one path of video stream data corresponding to the white board can be independently presented on one display screen and is assisted to be displayed in picture-in-picture by one path of video stream data corresponding to the speaker, and the other display screen displays videos uploaded by each electronic device in the video conference, for example, videos of users of each electronic device, on the other display screen in multiple grids, and presents information as much as possible.

In the above scheme, the display screen of the third electronic device is divided into regions, so that the display layout of the electronic device with the screen configuration meeting the first condition can be adaptively adjusted, the display of important information such as the highlighted content is dynamically performed in real time, and the efficiency is improved.

In other embodiments, the display output position of each object content may be determined based on the display priority of each object content with reference to the display screen of the third electronic device, and the position area of the corresponding one of the video stream data is identified by the display output position, so that the display screens of all the electronic devices may display and output in the display layout.

The description continues with a path of video stream data as a path of video combining the content video and the motion video. Since the priority of the whiteboard is higher than the priority of the person and the priority of the speaker is higher than the priority of the listener, with reference to the display screen of the third electronic device, the video stream data corresponding to the whiteboard is used as the main video stream data, the video stream data corresponding to the speaker is used as the auxiliary video stream data, and the video stream data corresponding to the listener may or may not be displayed, or may be displayed according to a certain instruction.

With continued reference to the display layout example shown in fig. 7(a), the position area for displaying one path of video stream data corresponding to each of the output whiteboard and the presenter in a picture-in-picture superimposed manner is determined with reference to the display screen of the third electronic device. Based on this, the relative positional relationship and the relative size relationship between the position area of the one-way video stream data corresponding to the whiteboard and the position area of the one-way video stream data corresponding to the speaker in the display screen of the third electronic device can be determined, for example, the position area of the one-way video stream data corresponding to the speaker is located in the 11 o' clock direction of the position area of the one-way video stream data corresponding to the whiteboard, and the size ratio of the two is 10:1, so that the display output positions of the whiteboard and the speaker can be determined based on the relative positional relationship and the relative size relationship, and the display output can be performed on the display screen of any one electronic device.

An embodiment of the present application provides another processing method, for determining display layout information of each object content based on first attribute information and screen information, including the following steps:

determining a display priority of each object content based on at least the first attribute information;

and performing area division on the display screen of the first electronic device/target electronic device/second electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the first electronic device/target electronic device/second electronic device based on the display priority to obtain display layout information.

For convenience of understanding, in the embodiment of the present application, a path of video stream data is taken as a path of video in which content video and motion video are combined. The conference machine starts the camera, collects the limb actions of the speaker and the content of the whiteboard at the same time, and uploads a path of video streaming data containing the content of the whiteboard and the actions of the speaker to the server. It is assumed that the target content included in the video stream data includes a speaker, a whiteboard, and a listener, and each target content has corresponding first attribute information. According to the category and/or the role in the first attribute information of each object content, the display priority of each object content can be determined, for example, the display priority of the whiteboard is higher than that of the person, and for example, the display priority of the speaker is higher than that of the listener.

For the first electronic device/target electronic device/second electronic device obtaining the screen information, the display screen of each object content may be divided into regions based on the display priority of the object content, and one path of video stream data corresponding to each object content has a corresponding position region in the display screen of the electronic device. As described above, since the whiteboard has a higher priority than the human priority and the speaker has a higher priority than the listener, the target electronic device may display or not display the one-way video stream data corresponding to the whiteboard on the display screen of the target electronic device, may display the one-way video stream data corresponding to the speaker, or may display the one-way video stream data corresponding to the listener according to a certain instruction.

Of course, for the area division manner of the display screen of the first electronic device/the target electronic device/the second electronic device, reference may be made to the area division manner of the third electronic device in the foregoing embodiment, which is not described herein again.

In the scheme, the display screen of the first electronic device/the target electronic device/the second electronic device is divided into areas, so that the display layout of the first electronic device/the target electronic device/the second electronic device can be adaptively adjusted, important information such as highlighted content is displayed dynamically in real time, and efficiency is improved.

In other embodiments, the display screen of the first electronic device/the target electronic device/the second electronic device is used as a reference, and the display output position of each object content is determined based on the display priority of each object content.

An embodiment of the present application provides another processing method, as an implementation manner for determining display layout information of each path of video stream data based on second attribute information and screen information, including the following steps:

determining the output priority of each path of video stream data at least based on the second attribute information;

determining a fourth electronic device of the at least two electronic devices, wherein the screen configuration information meets a second condition, based on the screen information;

and performing area division on the display screen of the fourth electronic equipment based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the fourth electronic equipment based on the output priority to obtain display layout information.

For convenience of understanding, in the embodiment of the present application, the description is continued with a video conference scene shown in fig. 4. The speaker uploads two paths of video streaming data to the server through the electronic device A, wherein one path of video is content video containing PPT content, the other path of video is action video containing actions of the speaker, and the listener in the area 1 obtains the two paths of video streaming data shared by the speaker through the electronic device B and the listener in the area 2 through the electronic device C. For each path of video stream data, it has corresponding second attribute information, so that the output priority of each path of video stream data can be determined compared with other paths of video stream data based on the second attribute information.

In this scenario, the listener pays more attention to the PPT content than the speaker's action in the video content, and therefore the output priority of the content video is higher than that of the action video. Of course, in some other scenarios, the output priority of the action video may also be higher than the priority of the content video, which is not limited in this embodiment of the present application.

Further, the electronic device (i.e., the fourth electronic device) whose screen configuration information satisfies the corresponding condition (i.e., the second condition) is determined based on the obtained screen information of each electronic device, for example, the second condition may be the lowest screen configuration condition, and at this time, the electronic device with the lowest screen configuration may be determined according to the screen information of each electronic device, and specifically, the electronic device with the lowest screen configuration may be determined as the electronic device with the lowest screen configuration, that is, the fourth electronic device, by considering the number of display screens in the screen information and the resolution and size of each display screen.

And performing area division on a display screen of the fourth electronic device based on the output priority of each path of video stream data, wherein each path of video stream data has a corresponding position area in the display screen of the fourth electronic device. As described above, the output priority of the content video is higher than the output priority of the motion video, and therefore, one video stream data of the content video is displayed and output as a main video stream data and one video stream data of the motion video is displayed and output as an auxiliary video stream data in the display screen of the fourth electronic device.

Assume that the fourth electronic device is a notebook computer, which has no external display screen connected thereto, only one built-in screen, and a typical size of 12 to 17 inches. At this time, the one video stream data of the motion video is drawn at a corner mainly based on the one video stream data of the content video, and a position area corresponding to the two video stream data is displayed and output in a manner of superimposing the two video streams in picture-in-picture, and a display layout is shown in fig. 9(a), for example. Of course, if the presenter is not in the lecture and one video stream data of the content video is interrupted, the position area of one video stream data of the action video may be maximized, and the position area of the video stream data uploaded by the fourth electronic device (for example, the video of the fourth device user or the video of the specified user around the fourth device) may be drawn at a corner, and displayed and output in a way of overlapping in picture-in-picture, and the display layout is shown in fig. 9 (b).

It is assumed that the fourth electronic device is a typical desktop computer or a notebook computer with a top cover closing an external display screen, and has only one desktop display, typically 20 to 32 inches in size. In this case, a display layout in which one video stream data of the content video is the main but more than one video stream data is available (or one video stream data is available) is also used, and a position area of one video stream data of the content video is drawn above the display screen, and a position area of one video stream data of the motion video and one or more video stream data of the video stream data uploaded by the fourth electronic device are drawn below the display screen without overlapping the position area of the content video, and the display layout is shown in fig. 10 (a). Of course, if the presenter is not in the lecture and one video stream data of the content video is interrupted, only one video stream data of the motion video may be displayed and output, or one video stream data of the motion video and video stream data uploaded by the fourth electronic device may be displayed and output in a multi-grid manner, and the display layout is shown in fig. 10(b), for example.

Further, it is assumed that when the third electronic device is externally connected to two or more large screens, for example, the third electronic device is a desktop computer or a notebook computer externally connected to multiple display screens, or a conference machine externally connected to multiple display screens, the advantage of the large screens can be fully utilized to draw information on the large screens as much as possible, one path of video stream data of the content video can be independently presented on one display screen and assist in displaying one path of video stream data of the action video in picture-in-picture, and the other display screen displays videos uploaded by each electronic device in the video conference, for example, videos of users of each electronic device, on the other display screen in multiple grids, so as to present information as much as possible.

In the above scheme, the display screen of the fourth electronic device is divided into regions, so that the display layout of the electronic device with the screen configuration meeting the first condition can be adaptively adjusted, the display of important information such as the highlighted content is dynamically performed in real time, and the efficiency is improved.

In yet other embodiments, the display output position of each video stream data may be determined based on the output priority of each video stream data with reference to the display screen of the fourth electronic device, and the position area of the corresponding video stream data may be identified by the display output position, so that the display screens of all the electronic devices may display output in the display layout.

Continuing with the video conference scenario shown in fig. 4. The output priority of the one-channel video stream data of the content video is higher than the output priority of the one-channel video stream data of the action video, so that the one-channel video stream data of the content video is displayed and output mainly and the one-channel video stream data of the action video is displayed and output secondarily by referring to the display screen of the fourth electronic device.

With continued reference to the display layout example shown in fig. 10(a), the position area in which one piece of video stream data of the output content video and one piece of video stream data of the motion video are displayed in a picture-in-picture superimposed manner is determined with reference to the display screen of the fourth electronic device. Based on this, the relative positional relationship between the position area of one line of video stream data of the content video and the position area of one line of video stream data of the motion video in the display screen of the fourth electronic device, and the relative size relationship, such as the position area of one line of video stream data of the motion video being located in the 11 o' clock direction of the position area of one line of video stream data of the content video, the size ratio of both being 10:1, can be determined, whereby the display output positions of both the content video and the motion video can be determined based on the relative positional relationship and the relative size relationship, so that the display output can be made in the display screen of any one electronic device.

An embodiment of the present application provides another processing method, as an implementation manner for determining display layout information of each path of video stream data based on second attribute information and screen information, including the following steps:

determining the output priority of each path of video stream data at least based on the second attribute information;

and performing area division on the display screen of the first electronic device/target electronic device/second electronic device based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the first electronic device/target electronic device/second electronic device based on the output priority to obtain display layout information.

For convenience of understanding, in the embodiment of the present application, the description is continued with a video conference scene shown in fig. 4. The speaker uploads two paths of video streaming data to the server through the electronic device A, wherein one path of video is content video containing PPT content, the other path of video is action video containing actions of the speaker, and the listener in the area 1 obtains the two paths of video streaming data shared by the speaker through the electronic device B and the listener in the area 2 through the electronic device C. For each path of video stream data, it has corresponding second attribute information, so that the output priority of each path of video stream data can be determined compared with other paths of video stream data based on the second attribute information.

In this scenario, the listener pays more attention to the PPT content than the speaker's action in the video content, and therefore the output priority of the content video is higher than that of the action video. Of course, in some other scenarios, the output priority of the action video may also be higher than the priority of the content video, which is not limited in this embodiment of the present application.

For the first electronic device/target electronic device/second electronic device obtaining the screen information, the display screen of each path of video stream data may be divided into areas based on the output priority of the video stream data, and each path of video stream data has a corresponding position area in the display screen of the electronic device. As described above, since the output priority of the content video is higher than the output priority of the motion video, the display screen of the target electronic device displays and outputs the one-channel video stream data of the content video as the main stream and the one-channel video stream of the motion video as the auxiliary stream.

Of course, for the area division manner of the display screen of the first electronic device/the target electronic device/the second electronic device, reference may be made to the area division manner of the fourth electronic device in the foregoing embodiment, which is not described herein again.

In the scheme, the display screen of the first electronic device/the target electronic device/the second electronic device is divided into areas, so that the display layout of the first electronic device/the target electronic device/the second electronic device can be adaptively adjusted, important information such as highlighted content is displayed dynamically in real time, and efficiency is improved.

In other embodiments, the display screen of the first electronic device/the target electronic device/the second electronic device is used as a reference, and the display output position of each video stream data is determined based on the output priority of each video stream data.

The embodiment of the application provides another processing method, which further comprises the following steps:

and acquiring control information of the target application depending on the target communication connection, and determining display layout information at least based on the control information and the screen information.

In the embodiment of the application, when determining to display the layout information, in addition to considering the screen information of the electronic device, control information of a target application on which the target communication connection is established may be further considered. Continuing with the example of the video conference scenario shown in fig. 4, the control information of the video conference includes identification information of controls used for conference management operations and (screen and sound) output adjustment operations. Suppose that the electronic device of the speaker has a small-size display screen (10-17 inches), and is externally connected with a large-size display screen (more than 20 inches), and the small-size display screen is used as a main screen, such as an externally connected display screen of a notebook computer, a large screen connected with a conference machine, and the like. At this time, the small-size display screen can be used as a control screen to draw control information, and the large-size display screen can be used as a display screen to draw the position area of each path of video stream data.

The embodiment of the application provides another processing method, which further comprises the following steps:

after at least one video stream data is displayed and output to a display screen of the electronic device according to the display layout information, if an adjustment operation acting on an output position of the at least one video stream data is obtained, the display layout information is updated.

In the embodiment of the application, after at least one path of video stream data is output to the display screen of the corresponding electronic device according to the display layout information, a user of the electronic device can adjust the position area of one or more paths of video stream data, so as to update the display layout information. In other embodiments, the updated display layout information may be adapted to the electronic device of the user, or may be adapted to other electronic devices with which the target communication connection is established.

Corresponding to the processing method, an embodiment of the present application further discloses a processing apparatus, as shown in fig. 11, the processing apparatus includes:

aninformation obtaining module 10, configured to obtain screen information of an electronic device in a case where a target communication connection is established between at least two electronic devices, where the target communication connection is used to share at least one path of video stream data between the at least two electronic devices;

alayout determining module 20, configured to determine display layout information for outputting at least one piece of video stream data at least based on the screen information, so that the at least one piece of video stream data is output to a display screen of the electronic device according to the display layout information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, the obtainingmodule 10 obtains screen information of an electronic device, including:

obtaining screen information of each electronic device in at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a first electronic device belonging to a target object in at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a determined target electronic device in at least two electronic devices; or the like, or, alternatively,

and if the second electronic equipment in the at least two electronic equipment is switched from the first state to the second state, acquiring the screen information of the second electronic equipment.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 determines display layout information for outputting at least one piece of video stream data based on at least the screen information, including:

in the case that a target communication connection is used for sharing one path of video stream data between at least two electronic devices, obtaining first attribute information of each object content in the one path of video stream data, and determining display layout information of each object content based on the first attribute information and screen information; or the like, or, alternatively,

in a case where the target communication connection is used to share at least two paths of video stream data between at least two electronic devices, second attribute information of each path of video stream data is obtained, and display layout information of each path of video stream data is determined based on the second attribute information and the screen information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 determines the display layout information of each object content based on the first attribute information and the screen information, including:

determining a display priority of each object content based on at least the first attribute information; determining a third electronic device of the at least two electronic devices, wherein the screen configuration information meets the first condition, based on the screen information; and performing area division on the display screen of the third electronic equipment based on the display priority, or determining the display output position of each object content by referring to the display screen of the third electronic equipment based on the display priority to obtain display layout information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 determines the display layout information of each object content based on the first attribute information and the screen information, including:

determining a display priority of each object content based on at least the first attribute information; and performing area division on the display screen of the first electronic device/target electronic device/second electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the first electronic device/target electronic device/second electronic device based on the display priority to obtain display layout information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 determines the display layout information of each path of video stream data based on the second attribute information and the screen information, including:

determining the output priority of each path of video stream data at least based on the second attribute information; determining a fourth electronic device of the at least two electronic devices, wherein the screen configuration information meets a second condition, based on the screen information; and performing area division on the display screen of the fourth electronic equipment based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the fourth electronic equipment based on the output priority to obtain display layout information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 determines the display layout information of each path of video stream data based on the second attribute information and the screen information, including:

determining the output priority of each path of video stream data at least based on the second attribute information; and performing area division on the display screen of the first electronic device/target electronic device/second electronic device based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the first electronic device/target electronic device/second electronic device based on the output priority to obtain display layout information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 is further configured to:

and acquiring control information of the target application depending on the target communication connection, and determining display layout information at least based on the control information and the screen information.

In another embodiment of the processing apparatus disclosed in the embodiment of the present application, thelayout determining module 20 is further configured to:

after at least one video stream data is displayed and output to a display screen of the electronic device according to the display layout information, if an adjustment operation acting on an output position of the at least one video stream data is obtained, the display layout information is updated.

Corresponding to the processing method, the embodiment of the application also discloses a storage medium, wherein the storage medium stores computer-executable instructions, and the computer-executable instructions are used for executing the processing method.

The above detailed description is provided for a processing method and apparatus provided by the present application, and the principle and the implementation of the present application are explained by applying specific examples, and the description of the above examples is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include or include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A method of processing, the method comprising:

the method comprises the steps of obtaining screen information of at least two electronic devices under the condition that a target communication connection is established between the at least two electronic devices, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two electronic devices;

and determining display layout information for outputting the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

2. The method of claim 1, wherein the obtaining screen information of the electronic device comprises:

obtaining screen information of each electronic device in the at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a first electronic device belonging to a target object in the at least two electronic devices; or the like, or, alternatively,

obtaining screen information of a determined target electronic device in the at least two electronic devices; or the like, or, alternatively,

and if the second electronic equipment in the at least two pieces of electronic equipment is switched from the first state to the second state, acquiring the screen information of the second electronic equipment.

3. The method of claim 2, wherein said determining display layout information for outputting the at least one video stream data based on at least the screen information comprises:

in a case where the target communication connection is used to share one path of video stream data between the at least two electronic devices, obtaining first attribute information of each object content in the one path of video stream data, and determining display layout information of each object content based on the first attribute information and the screen information; or the like, or, alternatively,

in a case where the target communication connection is used to share at least two paths of video stream data between the at least two electronic devices, second attribute information of each path of video stream data is obtained, and display layout information of each path of video stream data is determined based on the second attribute information and the screen information.

4. The method according to claim 3, wherein the determining display layout information of the object contents based on the first attribute information and the screen information includes:

determining a display priority of each object content at least based on the first attribute information;

determining a third electronic device of the at least two electronic devices whose screen configuration information satisfies a first condition based on the screen information;

and performing area division on the display screen of the third electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the third electronic device based on the display priority to obtain the display layout information.

5. The method according to claim 3, wherein the determining display layout information of the object contents based on the first attribute information and the screen information includes:

determining a display priority of each object content at least based on the first attribute information;

and performing area division on the display screen of the first electronic device/the target electronic device/the second electronic device based on the display priority, or determining the display output position of each object content by referring to the display screen of the first electronic device/the target electronic device/the second electronic device based on the display priority to obtain the display layout information.

6. The method of claim 3, wherein the determining display layout information for the channels of video stream data based on the second attribute information and the screen information comprises:

determining the output priority of each path of video stream data at least based on the second attribute information;

determining a fourth electronic device of the at least two electronic devices whose screen configuration information satisfies a second condition based on the screen information;

and performing area division on the display screen of the fourth electronic device based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the fourth electronic device based on the output priority to obtain the display layout information.

7. The method of claim 3, wherein the determining display layout information for the channels of video stream data based on the second attribute information and the screen information comprises:

determining the output priority of each path of video stream data at least based on the second attribute information;

dividing the display screen of the first electronic device/the target electronic device/the second electronic device into regions based on the output priority, or determining the display output position of each path of video stream data by referring to the display screen of the first electronic device/the target electronic device/the second electronic device based on the output priority, so as to obtain the display layout information.

8. The method of any of claims 1 to 7, further comprising:

and obtaining control information of a target application which is depended on by the target communication connection, and determining the display layout information at least based on the control information and the screen information.

9. The method of any of claims 1 to 7, further comprising:

and after the at least one path of video stream data is displayed and output to a display screen of the electronic equipment according to the display layout information, if the adjustment operation acting on the output position of the at least one path of video stream data is obtained, updating the display layout information.

10. A processing apparatus, the apparatus comprising:

the information acquisition module is used for acquiring screen information of at least two pieces of electronic equipment under the condition that target communication connection is established between the at least two pieces of electronic equipment, wherein the target communication connection is used for sharing at least one path of video stream data between the at least two pieces of electronic equipment;

and the layout determining module is used for determining display layout information of the at least one path of video stream data at least based on the screen information, so that the at least one path of video stream data is output to a display screen of the electronic equipment according to the display layout information.

Images