Detailed Description
Example embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present disclosure and not all of the embodiments of the present disclosure, and that the present disclosure is not limited by the example embodiments described herein.
It should be noted that the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless it is specifically stated otherwise.
It will be appreciated by those of skill in the art that the terms "first," "second," etc. in embodiments of the present disclosure are used merely to distinguish between different steps, devices or modules, etc., and do not represent any particular technical meaning nor necessarily logical order between them.
It should also be understood that in embodiments of the present disclosure, "plurality" may refer to two or more, and "at least one" may refer to one, two or more.
It should also be appreciated that any component, data, or structure referred to in the presently disclosed embodiments may be generally understood as one or more without explicit limitation or the contrary in the context.
In addition, the term "and/or" in the present disclosure is merely an association relationship describing the association object, and indicates that three relationships may exist, such as a and/or B, and may indicate that a exists alone, while a and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.
It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and that the same or similar features may be referred to each other, and for brevity, will not be described in detail.
Meanwhile, it should be understood that the sizes of the respective parts shown in the drawings are not drawn in actual scale for convenience of description.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
It should be noted that like reference numerals and letters refer to like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
Embodiments of the present disclosure are applicable to electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with an electronic device such as a terminal device, computer system, or server include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, minicomputers systems, mainframe computer systems, distributed cloud computing environments that include any of the above systems, and the like.
Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc., that perform particular tasks or implement particular abstract data types. The computer system/server may be implemented in a distributed cloud computing environment. In a distributed cloud computing environment, tasks may be performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computing system storage media including memory storage devices.
Summary of the disclosure
In implementing the present disclosure, the inventors have found that, in a technique of implementing a video conference using signaling servers, when one signaling server cannot continue to provide services for the video conference due to a failure, part or all of the video conference that the signaling server is responsible for may be migrated to another signaling server, so that the video conference can continue. In the migration process of the video conference, not only the migration speed of the video conference to the new signaling server is considered, but also the accuracy of the video conference to be migrated to the new signaling server is considered, for example, the relevant settings of the participating users on the user terminal devices thereof should be consistent before and after the migration of the video conference. The migration speed of the video conference is improved, the migration accuracy of the video conference is improved, a participant cannot perceive the migration of the video conference, and therefore the influence of the fault on the video conference on the signaling server side is reduced as much as possible.
The migration speed of the video conference is improved, and not only should the information interaction flow in the video migration process be considered, but also the information acquisition speed and other factors should be considered. And the accuracy of video conference migration is improved, and the accuracy of the acquired information is mainly considered. Therefore, in the migration process of the video conference, if a reasonable video conference migration flow can be set, and information related to the migrated video conference is reasonably obtained, the migration speed of the video conference and the accuracy of the video conference migration are improved, namely the quick and lossless migration of the video conference is realized.
Exemplary overview
The technical scheme of video conference migration can be suitable for various application scenes. For example, the technical scheme for video conference migration provided by the disclosure can be suitable for an application scene of participating in the same video conference by using different types of user terminal equipment, and can also be suitable for an application scene of participating in the same video conference based on user terminal equipment of different protocols. A specific example is shown in fig. 1.
In fig. 1, the signaling server 101 is currently providing a video conference service for a plurality of (e.g., 100) video conferences, and one of the plurality of video conferences currently has N (N is an integer greater than 2, e.g., N is 100 or 1000, etc.) participating users who participate in the video conference through their user terminal devices (i.e., 100-1, 100-2..100-N in fig. 1), respectively. Some of the ue devices (e.g., ue devices 100-1 and 100-2, etc.) access the signaling server 101 through the wired internet, and some of the ue devices (e.g., ue devices 100-N, etc.) access the signaling server 101 through the mobile internet. The N user terminal devices may be of different device types, such as desktop computers, notebook computers, cell phones, etc. Some of the N user terminal devices may participate in the video conference through APP (Application) or a client, and some of the N user terminal devices may participate in the video conference through a web page.
In the case where the signaling server 101 fails in software, hardware, or a network, etc., and cannot continue to provide the video conference service for the plurality of video conferences, all video conferences provided by the signaling server 101 may be migrated to one or more signaling servers, for example, all video conferences provided by the signaling server 101 may be migrated to the signaling server 102, or some video conferences provided by the signaling server 101 may be migrated to the signaling server 102, while other video conferences are migrated to other one or more signaling servers (not shown in fig. 1). If the video conference in which the N participating users participate is set to be migrated to the signaling server 102, the user terminal device 100-1, the user terminal device 100-2.
Exemplary method
Fig. 2 is a flow chart of one embodiment of a video conference migration method of the present disclosure. The method shown in fig. 2 includes steps S200, S201, S202 and S203, and each step shown in fig. 2 is performed in a signaling server. The signaling server of the present disclosure refers to a server responsible for providing a video conference service to a participating user, and for example, the provided video conference service may include synchronous management of information related to a video conference, management of a video conference state, and the like. The signaling server of the present disclosure may be located in the same hardware device as other servers, or may be independently disposed in a hardware device. The steps in fig. 2 are described separately below.
S200, receiving video conference takeover information from the signaling routing server.
The signaling routing server of the present disclosure refers to a server that allocates signaling servers for video conferences. The signaling routing server can allocate a signaling server for the video conference to be held, and can also allocate a new signaling server for the video conference to be taken over.
The video conference takeover information in the present disclosure refers to information for representing migration of a video conference from an original signaling server to a new signaling server, that is, information for representing that a video conference responsible for providing services by the original signaling server needs to be taken over by the new signaling server.
In one example, the video conference takeover information in the present disclosure mainly includes information for determining a video conference to be taken over, such as a conference number of the video conference, and the like. Of course, other information for enabling the new signaling server to implement video conference takeover may also be included, for example, information capable of acquiring conference attribute information of the video conference to be taken over, specifically, a storage address of the conference attribute information of the video conference to be taken over (i.e., an address of the database server), and the like. The present disclosure is not limited to the specific content and protocol format, etc., contained in the video conference takeover information.
Optionally, the signaling routing server may send the video conference takeover information to the signaling server under the trigger of the user terminal device of the participating user of the video conference. For example, when a user terminal device of any participating user in a video conference senses that a signaling server currently providing services for the video conference fails, a message for applying for a new signaling server for the video conference is sent to a signaling routing server, the message may carry a conference number, and after receiving the message, the signaling routing server performs a signaling server allocation operation (for example, according to principles of nearby or load balancing or random, the signaling server is selected from a plurality of signaling servers that do not fail currently, and is used as the new signaling server), and sends video conference takeover information to the new signaling server allocated to the signaling server.
In an alternative example, user terminal devices of multiple participating users of a video conference may simultaneously or successively perceive that a signaling server currently serving the video conference is faulty, and thus, the signaling routing server may receive multiple messages for the same video conference for applying for a new signaling server for the video conference, and the signaling routing server may execute a signaling server allocation operation when receiving a message for a first one of the same video conferences for applying for a new signaling server for the video conference, and send video conference takeover information to the allocated new signaling server. If the response information of the new signaling server is not received within the predetermined time period, the signaling server allocation operation may be performed again.
S201, according to the video conference taking-over information, conference attribute information of the video conference to be taken over is obtained from a database server.
The database server of the present disclosure refers to a server for storing information related to a video conference. The information related to the video conferences stored by the database server may be maintained by one or more signaling servers, for example, a signaling server currently responsible for providing services for each of the plurality of video conferences, conference attribute information of each video conference stored in the database server may be updated periodically or aperiodically during the progress of each video conference, and so on. The database server may be located in the same hardware device as the other servers (e.g., in the same hardware device as the signaling routing server, etc.), or may be independently disposed in a hardware device.
In an application scenario, the database server in the present disclosure may not store the attribute information of the meeting user of each video conference, which is beneficial to not only reducing the calculation cost and the storage cost for writing the attribute information of the meeting user of each video conference into the database server in the process of holding the video conference, but also reducing the calculation cost and the time cost for reading all the meeting user attribute information of one or more video conferences from the read-write database server in the process of transferring the video conference, thereby being beneficial to avoiding the phenomenon that the calculation cost and the time cost for interaction with the database server increase with the increase of the number of meeting users, and finally being beneficial to not only reducing the maintenance cost of the video conference, but also being beneficial to effectively controlling the transfer time of the video conference. This is especially true in the case of a large number of video conferences and/or a large number of participating users.
Optionally, the present disclosure may obtain a conference number of a video conference to be taken over from video conference taking over information, query a storage address of conference attribute information of the video conference to be taken over, that is, an address of a database server, by using the conference number, and then read conference attribute information corresponding to the conference number from the database server by using the storage address. In addition, the conference number and the database server address information of the video conference to be taken over can be obtained from the video conference taking-over information, and conference attribute information corresponding to the conference number is read from the database server by utilizing the database server address information.
Optionally, the conference attribute information of the video conference in the present disclosure refers to information for describing a current holding condition of the video conference. The conference attribute information of the video conference generally includes information decided by the network side, and information set by the participating users of the full right does not belong to the conference attribute information. In one example, the conference attribute information of the video conference may include information such as whether the video conference is finished, a video conference lock-unlock state, a video conference current online participant list, a video conference allowed maximum participant number, a video conference allowed maximum speaker number, a video conference current moderator, a video conference joint moderator list, a video conference guest list, and a video conference extension attribute. The present disclosure is not limited to what the conference attribute information specifically includes.
S202, acquiring attribute information of a participating user from user terminal equipment of a migration effective participating user in an original participating user of a video conference to be taken over.
The attribute information of the participating users in the present disclosure refers to information that does not need network side decision of the video conference and the full right is set by the participating users themselves. For example, the participant user attribute information may include participant user private extension attributes, participant user speaking resource status (e.g., camera on-off status, microphone on-off status), and the like.
An original participant in the present disclosure refers to a participant in a video conference when the video conference is served by an original signaling server. In one example, the original participant user may be a participant user in a list of current online participant users of the video conference to be taken over stored in the database server.
In an application scenario, the present disclosure may use all original meeting users in the current online meeting user list as migration effective meeting users according to preset screening conditions.
In another application scenario, the present disclosure may use a portion of original meeting users in the current online meeting user list as migration effective meeting users according to preset screening conditions.
That is, the meeting user attribute information obtained in step S202 may be the meeting user attribute information of all the current original meeting users of the video conference to be taken over, or may be the meeting user attribute information of the current partial original meeting users of the video conference to be taken over.
Optionally, the preset screening condition may be set according to actual requirements, for example, response time of information may be allocated to a new signaling server returned by the user terminal device for the signaling routing server. By setting the screening condition to the response time, the method and the device can flexibly control the migration time of the video conference, thereby being beneficial to controlling the time cost of the video conference migration.
Optionally, the signaling server in the present disclosure may obtain the meeting user attribute information from the information carried by the reconnection request from the user terminal device of the original meeting user of the video meeting to be taken over. In one example, after a new signaling server is allocated to a video conference to be taken over, the signaling routing server returns information of the new signaling server to a user terminal device sending a message for applying for the new signaling server to the video conference, where the user terminal device may send a re-connection request carrying a conference number, a conference user identifier and a conference user attribute information of the video conference to be taken over to the corresponding signaling server according to the information of the new signaling server, if the conference number carried in the re-connection request is the conference number of the video conference to be taken over and the receiving time of the re-connection request meets the predetermined time requirement, the disclosure may use the original conference user as a migration valid conference user, store the conference user attribute information carried in the re-connection request as the conference user attribute information of the migration valid conference user (e.g. in a memory), and if the conference number carried in the re-connection request is the conference number of the video conference to be taken over and the receiving time of the re-connection request does not meet the predetermined time requirement (if the receiving time of the re-connection request does not meet the predetermined time requirement).
Because the user terminal equipment may not timely send the re-connection request or not send the re-connection request for meeting the preset time requirement due to various reasons (such as the networking problem of the user terminal equipment or the exit of the meeting user from the video conference, etc.), the re-connection request can be clearly indicated that the original meeting user can continue to normally participate in the migrated video conference, but the original meeting user who can not timely send the re-connection request or not send the re-connection request, the original meeting user which continues to normally participate in the migrated video conference is doubtful, and by excluding such original meeting user from the migration effective meeting user, the cost paid for acquiring the original meeting user attribute information which does not timely indicate the migrated video conference in the migration process of the video conference is avoided, so that the accuracy of the acquired meeting user attribute information is ensured, the acquisition time of the meeting user attribute information is effectively controlled, the accuracy of the migration of the video conference is further improved, and the time cost of the migration of the video conference is further controlled.
Optionally, for the migration invalid participant, the present disclosure may determine participant attribute information of the migration invalid participant according to a preset processing manner for the new participant. For example, for a migration-disabled participant, the present disclosure may consider that the participant does not have participant user attribute information (e.g., the participant user's participant user attribute information is null). For another example, for a migration invalid participant, default participant attribute information may be stored (e.g., locally cached) as participant attribute information for the migration invalid participant. The present disclosure may also add the participant user identification of the migration invalid participant in the current online participant list, making the migration invalid participant a participant of the migrated video conference, sending conference attribute information to the participant, in an application scenario in which default meeting user attribute information is used as meeting user attribute information of the migration invalid meeting user, the present disclosure may send meeting attribute information and default meeting user attribute information to the meeting user, and may also broadcast the meeting user attribute information to other meeting users.
According to the method and the device, the attribute information of the meeting users of the migration invalid meeting users is determined by utilizing the preset processing mode aiming at the new meeting users, so that the original meeting users who cannot timely send the reconnection meeting request can normally participate in the migrated video meeting under the condition that the existing video meeting processing flow is not changed as much as possible, and the influence of the video meeting migration on the experience of the meeting users is further avoided.
Alternatively, steps S201 and S202 of the present disclosure may be parallel steps, or may have a sequential execution order.
S203, executing the reconstruction operation of the video conference to be taken over according to the conference attribute information and the conference user attribute information of the migration effective conference user so as to migrate the video conference to be taken over to a signaling server executing the steps of the method.
When meeting attribute information is obtained, judging whether at least one original meeting user exists in a current online meeting user list in the meeting attribute information, and if the original meeting user does not exist in the current online meeting user list, setting the video meeting to be taken over to be in an ending state, so that unnecessary video meeting migration can be avoided; if at least one original participant exists in the current online participant list, the video conference to be taken over can be set to a conference loading state, and the joining of the participant is waited.
After the video conference to be taken over is set to the conference loading state, the method and the device can judge whether the attribute information of the currently acquired participating user meets the preset condition, if so, the conference loading state of the video conference to be taken over is ended, and the video conference to be taken over is set to the conference normal state, so that adverse effects caused by the fact that the participating user cannot participate normally for a long time due to overlong migration time of the video conference are avoided.
The predetermined conditions of the present disclosure may be set according to actual demands, and for example, the predetermined conditions may include a condition based on time-out and a condition based on the number of original participants in the participant user list. One specific example is as follows:
After the video conference to be taken over is set to be in a conference loading state, a timer is started for a preset loading time length (such as 5 seconds or 7 seconds), and under the condition that the timer is not overtime, whether the reconnection request of all original conference users in the current online conference user list is received is continuously judged, if the timer is not overtime, and the reconnection request of all original conference users is judged to have been received, the conference loading state of the video conference to be taken over is ended, and the video conference to be taken over is in a normal conference state. If only the reconnection request of partial original meeting users in the current online meeting user list is received, but the timer times out, ending the meeting loading state of the video meeting to be taken over, and enabling the video meeting to be taken over to be in a normal meeting state. The method and the device judge whether the re-connection request of all the original meeting users in the current online meeting user list is received or not, and enter a normal meeting state when the re-connection request of all the original meeting users is received, so that the migration time of the video meeting to be taken over is shortened as much as possible. By timing the preset receiving time, the longest time for transferring the video conference to be taken over from the conference loading state to the normal state of the conference is controllable, so that the phenomenon that the migration speed of the video conference is influenced due to the fact that individual original conference users fail to timely send the re-connection conference request is avoided.
Optionally, if only a part of the re-joining requests of the original joining users in the current online joining user list are received under the condition that the timer times out, the present disclosure may delete the pending joining users from the current online joining user list for the joining users (to be referred to as the pending joining users hereinafter) in the current online joining user list that fail to receive the re-joining requests. If the original conference users cannot timely send the re-connection request due to the situation of exiting the conference or abnormal user terminal equipment and the like, the method and the device cannot determine whether the pending conference users can continue to participate in the migrated video conference as soon as possible, so that the pending conference users can be ensured to be effective conference users capable of continuing to participate in the migrated video conference as soon as possible by deleting the pending conference users from the current online conference user list, thereby being beneficial to ensuring the accuracy of the conference user list and avoiding the phenomenon that the listed conference users in the migrated video conference have errors (such as the conference users exiting the video conference in the migration process or the conference users incapable of accessing a new signaling server in time).
The video conference to be taken over is in a normal conference state in the present disclosure may be specifically that the state of the video conference to be taken over is modified from a conference loading state to a normal conference state, after original participant users in a current online participant user list, which do not send a reconnection request, are deleted, conference attribute information and participant user attribute information are respectively sent to all current participant users in the current online participant user list, for example, the conference attribute information and participant user attribute information of each participant user in the current online participant user list are loaded in a reconnection response, and the reconnection response is respectively sent to all current participant users. In addition, after deleting the original meeting users in the current online meeting user list, which do not send the reconnection meeting request, the method can synchronize the meeting normal state, the current online meeting user list and other information into the database server (the meeting user attribute information does not need to be synchronized into the database server). The conference state is modified, conference attribute information and conference user attribute information are sent based on the current online conference user list after the deleting operation is executed, the migration of the video conference is finished in a controllable time range, settings of the conference user attribute information and the like of each conference user in the migrated video conference are accurate, and the problem of setting difference caused by the migration of the video conference is avoided.
Fig. 3 is a flow chart of another embodiment of a video conference migration method of the present disclosure. The method shown in fig. 3 includes steps S300, S301, S302 and S303, and each step shown in fig. 3 is performed in a user terminal device. The user terminal equipment of the present disclosure may be specifically electronic equipment such as a desktop computer, a notebook computer, a tablet computer, or a smart phone. The steps in fig. 3 are described below.
S300, detecting the working state of a signaling server which is currently used for providing services for the video conference.
This step is used to trigger the migration of the video conference. The working states of the signaling server in the present disclosure mainly include a normal working state and an abnormal working state. The user terminal device of the participating user uses this step to perceive whether the signaling server currently providing the video conference service to the participating user is malfunctioning.
Under the condition that the signaling server cannot interact with the user terminal equipment of the participating user due to faults, the detection result of the step is that the signaling server is in an abnormal working state, and under the condition that the signaling server can interact with the user terminal equipment of the participating user, the detection result of the step is that the signaling server is in a normal working state.
In one example, the present disclosure may interact with a signaling server through a heartbeat mechanism to detect an operational state of the signaling server. For example, the user terminal device of the participating user sends a heartbeat message to the signaling server that provides service for the video conference at regular time, waits for a heartbeat response message returned by the signaling server, if the heartbeat response message returned by the signaling server is not received within a predetermined time range, the detection result is that the signaling server is in an abnormal working state, and if the heartbeat response message returned by the signaling server is received within the predetermined time range, the detection result is that the signaling server is in a normal working state.
And S301, sending a request for new signaling server information to the signaling routing server to request the new signaling server to take over the video conference under the condition that the detected working state is an abnormal working state.
The method and the system for requesting the new signaling server information in the disclosure are mainly used for triggering the migration of the video conference, specifically, triggering the signaling routing server to execute the signaling server allocation operation (for example, selecting a signaling server from a plurality of signaling servers which do not have faults at present as a new signaling server according to the principles of nearby or load balancing or random and the like), and sending the video conference taking-over information to the allocated new signaling server, thereby promoting the execution of the video conference migration process. The request for new signaling server information mainly includes the conference number of the video conference. The message carrying the request for new signaling server information may be referred to as a message for applying for a new signaling server for a video conference. In addition, after the new signaling server is allocated, the signaling routing server should also return new signaling server allocation information to the user terminal device that sends the message for applying for the new signaling server for the video conference, so as to notify the user terminal device that the video conference is migrated to the new signaling server.
S302, receiving new signaling server allocation information returned by the signaling routing server, and locally acquiring the attribute information of the participating users participating in the video conference by using the user terminal equipment.
The new signaling server allocation information in the present disclosure mainly includes conference numbers, new signaling server address information, and the like. The attribute information of the participating users in the present disclosure refers to information that does not need network side decision of the video conference and the full right is set by the participating users themselves. For example, the participant user attribute information may include participant user private extension attributes, participant user speaking resource status (e.g., camera on-off status, microphone on-off status), and the like. Because the user terminal equipment locally stores the meeting user attribute information, the present disclosure can quickly acquire the meeting user attribute information which is currently and recently set by the meeting user.
S303, sending a reconnection request carrying the attribute information of the participating user to a new signaling server for taking over the video conference according to the received new signaling server allocation information.
The present disclosure should send a reconnection request to a new signaling server in time after receiving the new signaling server allocation information. The reconnection session in the present disclosure requests the original session user for the videoconference to join the videoconference that is migrated to the new signaling server. In one example, the present disclosure may load a conference number, a participant user identification, and participant user attribute information of a video conference to be taken over in a reconnection participant request, and send the reconnection participant request to a new signaling server according to a new signaling server address in the new signaling server allocation information.
The conference user attribute information carried in the reconnection conference request is used for enabling a new signaling server to execute reconstruction operation of the video conference to be taken over based on conference attribute information of the video conference to be taken over obtained from a database server and conference user attribute information of user terminal equipment of a migration effective participant user in an original participant user of the video conference to be taken over, so as to migrate the video conference to be taken over to the new signaling server. The manner in which the participant user attribute information carried in the reconnection participant request is used may be as described above with respect to the relevant steps in fig. 2.
S304, participating in the video conference migrated to the new signaling server according to the reconnection participation response returned by the new signaling server.
The reconnection conference response in the present disclosure is mainly used to indicate whether a participating user is successfully added to the migrated video conference. In one example, the reconnection meeting response can include a meeting number, a list of current online meeting users, a pre-migration meeting mode, and so forth. In the present disclosure, according to the reconnection session response returned by the new signaling server, participating in the video session migrated to the new signaling server may specifically be obtaining the information such as the session number, the current user list, and the session mode before migration carried in the reconnection session response, and executing the subsequent operation on the information according to the existing video session processing flow.
According to the method and the system, the working state of the signaling server providing the video conference service is detected by the user terminal equipment, the migration of the video conference can be triggered in time when the signaling server fails, the user terminal equipment actively reports the locally stored conference user attribute information to the new signaling server, the phenomenon that the new signaling server reads a large amount of conference user attribute information from the database server is avoided, the new signaling server acquires the latest conference user attribute information, and therefore, when the new signaling server performs conference reconstruction operation by utilizing the acquired conference attribute information and the conference user attribute information of the migrated effective conference user, the accuracy of the conference user attribute information of each conference user of the video conference after migration is guaranteed, and the migration time of the video conference is effectively controlled. Therefore, the video conference migration flow is formulated for the user terminal equipment of the participating user, and the flow is matched with the video conference migration flow at the network side, so that the video conference migration can be realized rapidly and accurately, and the experience of the participating user on the video conference is improved.
The embodiment has a good video conference migration effect, and the video conference migration flow different from the embodiment can be formulated for the network side (namely the signaling routing server and the signaling server side) and the user terminal equipment side, although the video conference migration flow is inferior to the video conference migration effect of the embodiment, the video conference migration flow is also a feasible video conference migration flow, and the problem of video conference interruption caused by the failure of the signaling server can be effectively solved. The videoconference migration flow is described below in conjunction with fig. 4 and 5.
Fig. 4 shows only two participating users of the video conference, who participate in the video conference using user terminal device 400-1 and user terminal device 400-2, respectively.
The signaling server 401-1 is configured to be a signaling server which is distributed by the signaling routing server 402 and is responsible for providing video conference service for the video conference when the video conference is held, if the signaling server 401-1 cannot continue to provide video conference service for each participating user due to software or hardware faults and other reasons in the process of the video conference, the signaling routing server 402 should be distributed with a new signaling server, for example, the signaling server 401-2 is distributed to be responsible for continuing to provide video conference service for the video conference, so as to complete migration of the video conference. The information interaction involved in the above process includes 1, 2, 3, 4, 5 and 6 in fig. 4.
Specifically, 1 in fig. 4 indicates that the user terminal device 400-1 performs information interaction with the signaling server 401-1 through a heartbeat mechanism, 2 in fig. 4 indicates that the signaling server 401-1 writes information related to the video conference (such as conference attribute information and parameter user attribute information, etc.) into the database server 403, 3 in fig. 4 indicates that the user terminal device 400-1 determines that the signaling server 401-1 fails through the heartbeat mechanism and requests the signaling routing server 402 to allocate a new signaling server for information interaction, 4 in fig. 4 indicates that the signaling routing server 402 uses the signaling server 401-2 as a new signaling server for information interaction, 5 in fig. 4 indicates that the signaling server 401-2 reads information related to the video conference from the database server 403, and 6 in fig. 4 indicates that the user terminal device 400-1 rejoins the video conference through the signaling server 401-2. The user terminal device 400-2 may also rejoin the video conference through information interaction with the signaling routing server 402 and the signaling server 401-2.
A timing diagram for the information interaction shown in fig. 4 is shown in fig. 5.
In fig. 5, in step 50, during the progress of the video conference, the signaling server 401-1 sends information related to the video conference (such as conference attribute information and meeting user attribute information) to the database server 403, and the database server 403 stores the received information related to the video conference.
Step 51-1, the user terminal device 400-1 sends a heartbeat message to the signaling server 401-1 according to the heartbeat mechanism.
Step 51-2, after receiving the heartbeat message, the signaling server 401-1 returns a heartbeat response message to the user terminal device 400-1.
Assuming that the user terminal device 400-1 does not receive the heartbeat response message returned by the signaling server 401-1 within the predetermined time frame after transmitting the heartbeat message, it goes to step 52.
Step 52, the user terminal device 400-1 sends a message to the signaling routing server 402 for applying a new signaling server for the video conference.
Step 53, the signaling routing server 402 allocates a new signaling server, such as the signaling server 401-2, to the video conference after receiving the message, and sends a message to the signaling server 401-2 for notifying that the signaling server 401-2 becomes the new signaling server of the video conference.
Step 54-1, signaling server 401-2, upon receiving the message, sends a request to database server 403 for reading information related to the video conference.
Step 54-2, database server 403, upon receiving the request, returns a message to signaling server 401-2 carrying information related to the video conference.
Step 55, the signaling routing server 402 may send a message for providing the user terminal device with new signaling server information to the user terminal device 400-1 after informing the signaling server 401-2 that it is a new signaling server.
Step 56-1, the ue 400-1, after receiving the message sent by the signaling routing server 402, sends a re-connection request carrying the conference number of the video conference and the participant user identifier to the signaling server 401-2. The participant user identification is the unique identification of the participant user in the video conference.
Step 56-2, the signaling server 401-2, after receiving the reconnection request, joins the user terminal device 400-1 to the video conference and returns a participant response message carrying the relevant information recovered from the database server 403 to the user terminal device 400-1.
Since the information related to the video conference including the user status information is recovered from the database server 403 during the migration of the video conference, the amount of information recovered from the database server 403 by the signaling server 401-2 is closely related to the number of participating users of the video conference, and the number of participating users is closely related to the efficiency of the migration of the video conference. Further, the attribute information of the participating user in the information related to the video conference is usually set autonomously by the participating user, and may not be decided by the signaling server, the signaling server may write the attribute information of the participating user set autonomously by the participating user into the database server 403 and broadcast the attribute information to other participating users, so that the user state information stored in the database server 403 may have a phenomenon of inconsistent attribute information of the participating user set autonomously by the participating user before the video conference is migrated due to factors such as update delay, so that the attribute information of the participating user carried in the participating response message returned by the signaling server 401-2 to the user terminal device 400-1 may have hysteresis, and the participating user may reset the attribute information thereof.
Since the participant user attribute information is determined by the participant user independently, the participant user attribute information stored in the user terminal device 400-1 is often more accurate than the database server 403, and if the video conference is reconstructed by using the participant user attribute information recovered from the database server 403 during the video conference migration process, the migration speed of the video conference is reduced and the migration reliability of the video conference is reduced than the video conference migration process shown in fig. 2 and 3.
Exemplary apparatus
Fig. 6 is a schematic structural diagram of an embodiment of a video conference migration apparatus of the present disclosure. The apparatus of this embodiment is disposed in a signaling server, and the apparatus of this embodiment may be used to implement the corresponding method embodiments of the present disclosure.
The apparatus shown in fig. 6 includes a takeover information receiving module 600, a first acquiring module 601, a second acquiring module 602, and a conference reconstructing module 603. The apparatus may also optionally include a new participant user processing module 604. The respective modules included in the apparatus are described below.
The takeover information receiving module 600 is mainly configured to receive video conference takeover information from the signaling routing server. The specific content included in the video conference takeover information, the triggering condition for the takeover information receiving module 600 to receive the video conference takeover information, etc. may be referred to the above description of S200 in fig. 2, and will not be described in detail herein.
The first obtaining module 601 is mainly configured to obtain conference attribute information of a video conference to be taken over from a database server according to the video conference taking over information received by the taking over information receiving module 600. The specific process of the first obtaining module 601 obtaining the conference attribute information from the database server, the specific content included in the conference attribute information, and the like can be referred to the related description of S201 in fig. 2, and will not be described in detail here.
The second obtaining module 602 is mainly configured to obtain attribute information of a participating user from a user terminal device of a migration effective participating user in an original participating user of a video conference to be taken over. Optionally, the second acquisition module 602 includes a first submodule 6021, a second submodule 6022, and a third submodule 6023. The first submodule 6021 is mainly used for receiving a reconnection participation request from a user terminal device of a participation user of the video conference to be taken over. The second submodule 6022 is mainly configured to, when it is determined that the conference number carried in the reconnection conference request received by the first submodule 6021 is the conference number of the video conference to be taken over, and the receiving time of the reconnection conference request meets the predetermined time requirement, perform the writing operation by using the parameter user attribute information carried in the reconnection conference request as parameter user attribute information of the migration effective parameter user. The third sub-module 6023 is mainly used for storing the attribute information of the participant user written by the second sub-module 6022. The operations specifically performed by the first sub-module 6021, the second sub-module 6022 and the third sub-module 6023 may be referred to the above description of S202 in fig. 2, and will not be described in detail herein.
The conference rebuilding module 603 is mainly configured to execute a rebuilding operation of the video conference to be taken over according to the conference attribute information acquired by the first acquiring module 601 and the conference user attribute information of the migration effective participant user acquired by the second acquiring module 602, so as to migrate the video conference to be taken over to a new signaling server. Optionally, the conference re-establishment module 603 may include a fourth sub-module 6031 and a fifth sub-module 6032. The fourth submodule 6031 is mainly used for placing the video conference to be taken over in a conference loading state under the condition that at least one original conference user exists in the conference user list in the conference attribute information acquired by the first acquisition module 601. The fifth submodule 6032 is mainly used for placing the video conference to be taken over in a normal conference state under the condition that the attribute information of the participating user of the migration effective participating user stored in the third submodule 6023 meets the preset condition.
In one example, the fifth submodule 6032 determines that the third submodule 6023 stores the attribute information of the meeting users of all original meeting users in the meeting user list, and the loading time set for the loading state of the meeting is not timed out, so that the video meeting to be taken over is in the normal state of the meeting. For example, the fifth submodule 6032 sends the conference attribute information and the currently stored conference user attribute information of the migration effective conference user of the third submodule 6023 to all the migration effective conference users in the conference user list, and modifies the state of the video conference to be taken over from the conference loading state to the conference normal state.
In another example, the fifth submodule 6032 determines that the third submodule 6023 stores the attribute information of the meeting user of the partial original meeting users in the meeting user list, and sets the loading time for the meeting loading state to be timed out, so that the video meeting to be taken over is in the meeting normal state. For example, in the case that the loading time period set for the conference loading state is timed out, the fifth submodule 6032 may delete the original conference user who does not receive the reconnection request from the conference user list, and after deleting, send the conference attribute information and the conference user attribute information of the migration effective conference user currently stored by the third submodule 6023 to all the migration effective conference users in the conference user list, respectively, and modify the state of the video conference to be taken over from the conference loading state to the conference normal state.
The operations specifically performed by the fourth submodule 6031 and the fifth submodule 6032 may be referred to the above description of S203 in fig. 2, and will not be described in detail here.
The new participant user processing module 604 is mainly configured to determine, when the second sub-module 6022 determines that the conference number carried in the reconnection request received by the first sub-module 6021 is the conference number of the video conference to be taken over, and the receiving time of the reconnection request does not meet the predetermined time requirement, use the participant user sending the reconnection request that does not meet the predetermined time requirement as a migration invalid participant user, and determine, according to a preset processing manner for the new participant user, attribute information of the migration invalid participant user, where optionally, the new participant user processing module 604 may consider that the attribute information of the migration invalid participant user is null. Optionally, the new meeting user processing module 604 may also set the meeting user attribute information as default meeting user attribute information, and in the application scenario, the new meeting user processing module 604 may write the default meeting user attribute information of the migration invalid meeting user into the third submodule 6023 for caching. The operations specifically performed by the new-participant user processing module 604 may be described above with respect to S202 in fig. 2, and will not be described in detail herein.
Fig. 7 is a schematic structural diagram of another embodiment of a video conference migration apparatus of the present disclosure. The apparatus of this embodiment is disposed in the user terminal device 710, and the apparatus of this embodiment may be used to implement the corresponding method embodiments of the present disclosure.
The device shown in fig. 7 comprises a detection module 700, a first sending module 701, a local acquisition module 702, a second sending module 703 and a conference joining module 704. The respective modules included in the apparatus are described below.
The detection module 700 is mainly used for detecting the working state of the signaling server 720. The signaling server 720 is currently serving a video conference and the participating user is currently participating in the video conference using the user terminal device 710. The specific operation of the detection module 700 may be described with reference to S300 in fig. 3, and will not be described in detail herein.
The first sending module 701 is mainly configured to send, to the signaling routing server 730, new signaling server information for requesting the video conference to take over the video conference by the new signaling server, when the working state detected by the detecting module 700 is an abnormal working state. The specific operation performed by the first transmitting module 701 may be referred to the above description of S301 in fig. 3, and will not be described in detail here.
The local acquisition module 702 is mainly configured to acquire, from the local location, the attribute information of a participating user who uses the user terminal device 710 to participate in the video conference when the user terminal device 710 receives new signaling server allocation information returned by the signaling routing server 730. The specific operations performed by the local acquisition module 702 may be described in connection with S302 in fig. 3, and will not be described in detail herein.
The second sending module 703 is mainly configured to send, to a new signaling server (i.e., the signaling server 740 in fig. 7) that takes over the video conference, a reconnection request carrying the parameter attribute information acquired by the local acquiring module 702 according to the new signaling server allocation information received by the user terminal device 710. The method comprises the steps of carrying out a reconstruction operation of a video conference to be taken over by a new signaling server based on conference attribute information of the video conference to be taken over obtained from a database server and the conference user attribute information of user terminal equipment of a migration effective participant user in an original participant user of the video conference to be taken over. The operation specifically performed by the second transmitting module 703 may be described with reference to S303 in fig. 3, which is not described in detail herein.
Conference joining module 704 is primarily configured to participate in a video conference that is migrated to a new signaling server (i.e., signaling server 740) based on a reconnection conference response returned by the signaling server. The operation of conference joining module 704 may be specifically described with reference to S304 in fig. 3, and will not be described in detail herein.
Exemplary System
Fig. 8 is a schematic structural diagram of an embodiment of a videoconference migration system of the present disclosure. The system of this embodiment includes a signaling routing server 800, a database server 801, and at least two signaling servers, such as signaling server 8021 and signaling server 8022 in fig. 8.
The signaling routing server 800 is connected to each signaling server 802, and an allocation module 8001 is provided in the signaling routing server 800, where the allocation module 8001 is mainly configured to allocate a new signaling server (e.g. the signaling server 8022) to the video conference and send video conference takeover information to the new signaling server (e.g. the signaling server 8022) when the signaling routing server 800 receives a message from the user terminal device for applying a new signaling server to the video conference.
The database server 801 is used to store conference attribute information of each video conference.
The signaling server 8021 and the signaling server 8022 are respectively provided with a video conference migration device, and the video conference migration device comprises a takeover information receiving module 600, a first acquisition module 601, a second acquisition module 602 and a conference reconstruction module 603. The operations performed by the takeover information receiving module 600, the first acquiring module 601, the second acquiring module 602, and the conference reconstructing module 603, the sub-modules included in each, and the operations performed by each sub-module are described in fig. 6, and are not described in detail herein.
Exemplary electronic device
An electronic device according to an embodiment of the present disclosure is described below with reference to fig. 9. Fig. 9 shows a block diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 9, the electronic device 91 includes one or more processors 911 and memory 912.
The processor 911 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities and may control other components in the electronic device 91 to perform desired functions.
Memory 912 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), among others. The nonvolatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that the processor 911 may execute to implement the video conference migration methods and/or other desired functions of the various embodiments of the present disclosure described above.
In one example, electronic device 91 may also include an input device 913 and an output device 914, among other components, interconnected by a bus system and/or other form of connection mechanism (not shown). In addition, the input device 913 may also include, for example, a keyboard, a mouse, and the like. The output device 914 can output various information to the outside. The output devices 914 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, among others.
Of course, only some of the components of the electronic device 91 relevant to the present disclosure are shown in fig. 9 for simplicity, components such as buses, input/output interfaces, and the like being omitted. In addition, the electronic device 91 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer readable storage Medium
In addition to the methods and apparatus described above, embodiments of the present disclosure may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in a video conference migration method according to various embodiments of the present disclosure described in the "exemplary methods" section of the present description.
The computer program product may write program code for performing the operations of embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium, having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform the steps in a video conference migration method according to various embodiments of the present disclosure described in the above "exemplary methods" section of the present disclosure.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of a readable storage medium may include an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The basic principles of the present disclosure have been described above in connection with specific embodiments, but it should be noted that the advantages, benefits, effects, etc. mentioned in the present disclosure are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present disclosure. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, since the disclosure is not necessarily limited to practice with the specific details described.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different manner from other embodiments, so that the same or similar parts between the embodiments are mutually referred to. For system embodiments, the description is relatively simple as it essentially corresponds to method embodiments, and reference should be made to the description of method embodiments for relevant points.
The block diagrams of the devices, apparatuses, devices, systems referred to in this disclosure are merely illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatus, devices, and systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.
The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, firmware. The above-described sequence of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the sequence specifically described above unless specifically stated otherwise. Furthermore, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
It is also noted that in the apparatus, devices and methods of the present disclosure, components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered equivalent to the present disclosure.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects, and the like, will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, changes, additions, and sub-combinations thereof.