

技术领域technical field
本发明涉及通信领域,尤其涉及通信领域中共享桌面内容的方法和智能设备。The invention relates to the communication field, in particular to a method for sharing desktop content in the communication field and an intelligent device.
背景技术Background technique
在各种通信网络中,一般地至少两个用户进行通话,例如,第一用户使用计算机,第二用户使用可视电话,计算机与可视电话通过网络进行通信,从而第一用户与第二用户可以进行通话。其中,第一用户与第二用户所听到的语音分别来自对方的语音输入装置,例如,第一用户从耳机或扬声器所听到的语音来自于第二用户使用的可视电话的麦克风的输入,第二用户从耳机或扬声器所听到的语音则来自于第一用户使用的计算机的麦克风的输入。In various communication networks, generally at least two users talk, for example, the first user uses a computer, the second user uses a videophone, and the computer and the videophone communicate through the network, so that the first user and the second user Calls are available. Wherein, the voices heard by the first user and the second user come from the other party's voice input device respectively, for example, the voice heard by the first user from the earphone or loudspeaker comes from the input of the microphone of the videophone used by the second user , the voice heard by the second user through the earphone or the speaker comes from the input of the microphone of the computer used by the first user.
但随着通信技术的发展,人们不再满足于传统通话的要求,人们还希望在进行通话的过程中能够共享对方所使用设备的桌面内容。例如,在第一用户向第二用户介绍某项业务的通话过程中,为了吸引第二用户使用该项业务或为了使第二用户更全面地了解该项业务,第一用户希望第二用户能够共享计算机的桌面内容,从而方便介绍该项业务,例如第一用户希望第二用户通过可视电话能够直接观看第一用户所使用的计算机正在播放的宣传片。However, with the development of communication technology, people are no longer satisfied with the requirements of traditional calls, and people also hope to be able to share the desktop content of the device used by the other party during the call. For example, during a call in which a first user introduces a certain service to a second user, in order to attract the second user to use the service or to make the second user understand the service more comprehensively, the first user hopes that the second user can Share the desktop content of the computer, so as to facilitate the introduction of this service. For example, the first user hopes that the second user can directly watch the promotional video being played by the computer used by the first user through the videophone.
在现有技术中,通过远程计算机控制协议可以实现可视电话共享计算机的桌面内容。具体实现的方案是:首先,在计算机上运行远程计算机控制协议服务器程序,并在可视电话上运行远程计算机控制协议客户端程序,然后,由使用可视电话的第二用户主动发起请求,第一用户使用的计算机响应请求并提供服务,由此第一用户使得第二用户能够共享到计算机的桌面内容。In the prior art, the desktop content of the computer can be shared by the videophone through the remote computer control protocol. The specific implementation scheme is: firstly, run the remote computer control protocol server program on the computer, and run the remote computer control protocol client program on the videophone, then, the second user who uses the videophone initiates the request actively, the second A computer used by a user responds to the request and provides a service whereby the first user enables a second user to share desktop content to the computer.
发明人在发明过程发现,现有技术至少存在如下问题:由于上述技术方案基于远程计算机控制协议,而该远程计算机控制协议是服务器/客户端的架构,因此,客户端和服务器端必须首先安装相应的服务器端程序和客户端程序,并且客户端必须先发起请求,才可能接收服务。因而,上述技术方案不仅不能灵活地实现桌面内容的共享,而且操作复杂。The inventor found in the invention process that at least the following problems exist in the prior art: since the above-mentioned technical solution is based on the remote computer control protocol, and the remote computer control protocol is a server/client architecture, the client and the server must first install the corresponding The server-side program and the client-side program, and the client must initiate a request before receiving the service. Therefore, the above technical solution not only cannot flexibly realize the sharing of desktop content, but also has complex operations.
发明内容Contents of the invention
为此,本发明要解决的技术问题是提供共享桌面内容的方法和智能设备,以提高桌面内容共享的灵活性、便利性和可操作性。Therefore, the technical problem to be solved by the present invention is to provide a method and an intelligent device for sharing desktop content, so as to improve the flexibility, convenience and operability of desktop content sharing.
为解决上述技术问题,本发明实施例提供了一种共享桌面内容的方法,该方法包括:In order to solve the above technical problems, an embodiment of the present invention provides a method for sharing desktop content, the method comprising:
与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,并与视频终端建立视频会话通道;Negotiate with the video terminal to transmit video data, obtain video parameters required for video data transmission, and establish a video session channel with the video terminal;
获取需要共享的桌面内容的显示数据;Obtain the display data of the desktop content that needs to be shared;
根据所述视频参数将所述显示数据转换为视频流;converting the display data into a video stream according to the video parameters;
利用所述视频会话通道向所述视频终端推送所述视频流。Using the video session channel to push the video stream to the video terminal.
本发明实施例还提供了一种共享桌面内容的智能设备,该智能设备包括:The embodiment of the present invention also provides a smart device for sharing desktop content, the smart device includes:
协商模块,用于与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,并与所述视频终端建立视频会话通道;A negotiation module, configured to negotiate with the video terminal for video data transmission, obtain video parameters required for video data transmission, and establish a video session channel with the video terminal;
获取模块,用于获取需要共享的桌面内容的显示数据;An acquisition module, configured to acquire display data of desktop content that needs to be shared;
转换模块,用于根据所述视频参数将所述显示数据转换为视频流;a conversion module, configured to convert the display data into a video stream according to the video parameters;
推送模块,用于利用所述视频会话通道向所述视频终端推送所述视频流。A push module, configured to push the video stream to the video terminal by using the video session channel.
由于智能设备与视频终端建立视频会话通道来实现智能设备向视频终端主动推送需共享的桌面内容,而建立该视频会话通道并不需要在智能设备和视频终端上安装相应的服务器程序和客户端程序,同时能够避免接收端必须先发起请求的弊端,因而上述技术方案能够简化操作过程,增加桌面内容共享的灵活性和便利性,也使得桌面内容共享更具有可操作性。因此,根据本发明实施例的方法和智能设备能够提高桌面内容共享的灵活性、便利性和可操作性。Since the smart device and the video terminal establish a video session channel to realize that the smart device actively pushes the desktop content to be shared to the video terminal, and the establishment of the video session channel does not need to install the corresponding server program and client program on the smart device and the video terminal , and at the same time, it can avoid the disadvantage that the receiving end must first initiate the request, so the above technical solution can simplify the operation process, increase the flexibility and convenience of desktop content sharing, and also make desktop content sharing more operable. Therefore, the method and smart device according to the embodiments of the present invention can improve the flexibility, convenience and operability of desktop content sharing.
附图说明Description of drawings
图1是本发明实施例的一种共享桌面内容的方法的流程图;FIG. 1 is a flowchart of a method for sharing desktop content according to an embodiment of the present invention;
图2是本发明实施例的另一种共享桌面内容的方法的流程图;FIG. 2 is a flowchart of another method for sharing desktop content according to an embodiment of the present invention;
图3是本发明实施例的一种共享桌面内容的智能设备的结构示意图;3 is a schematic structural diagram of a smart device for sharing desktop content according to an embodiment of the present invention;
图4是本发明实施例的另一种共享桌面内容的智能设备的结构示意图。Fig. 4 is a schematic structural diagram of another smart device for sharing desktop content according to an embodiment of the present invention.
具体实施方式Detailed ways
为了便于本领域普通技术人员理解和实现本发明,现结合附图和具体实施例来阐述本发明。In order to make it easier for those skilled in the art to understand and implement the present invention, the present invention will now be described in conjunction with the accompanying drawings and specific embodiments.
本发明实施例提供了一种共享桌面内容的方法,如图1所示,该方法包括:The embodiment of the present invention provides a method for sharing desktop content, as shown in Figure 1, the method includes:
S101,与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,并与视频终端建立视频会话通道;S101, negotiating with the video terminal to transmit video data, obtaining video parameters required for transmitting video data, and establishing a video session channel with the video terminal;
S102,获取需要共享的桌面内容的显示数据;S102, acquiring display data of desktop content to be shared;
S103,根据所述视频参数将所述显示数据转换为视频流;S103. Convert the display data into a video stream according to the video parameters;
S104,利用所述视频会话通道向所述视频终端推送所述视频流。S104. Push the video stream to the video terminal by using the video session channel.
根据本发明实施例,当智能设备需要向视频终端主动推送共享的桌面内容时,智能设备可以先获取智能设备需要共享的桌面内容的显示数据,然后智能设备与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,智能设备就与视频终端建立了视频会话通道;以及智能设备根据该视频参数将该显示数据转换为视频流,并且智能设备利用建立好的视频会话通道向视频终端推送该视频流,从而智能设备可以使得视频终端能够接收到智能设备共享的桌面内容。当然,智能设备也可以先与视频终端协商好传输视频数据,获取传输视频数据所需的视频参数,智能设备就与视频终端建立了视频会话通道;然后智能设备获取需要共享的桌面内容的显示数据,以及智能设备根据该视频参数将该显示数据转换为视频流,并且智能设备利用上述建立好的视频会话通道向视频终端推送该视频流,从而智能设备可以使得视频终端能够接收到智能设备共享的桌面内容。According to the embodiment of the present invention, when the smart device needs to actively push the shared desktop content to the video terminal, the smart device can first obtain the display data of the desktop content that the smart device needs to share, and then the smart device negotiates with the video terminal to transmit the video data, and obtains the transmission data. The video parameters required by the video data, the smart device establishes a video session channel with the video terminal; and the smart device converts the display data into a video stream according to the video parameters, and the smart device uses the established video session channel to push the video to the video terminal The video stream, so that the smart device can enable the video terminal to receive the desktop content shared by the smart device. Of course, the smart device can also negotiate with the video terminal to transmit video data first, obtain the video parameters required for transmitting video data, and the smart device establishes a video session channel with the video terminal; then the smart device obtains the display data of the desktop content that needs to be shared , and the smart device converts the display data into a video stream according to the video parameters, and the smart device uses the established video session channel to push the video stream to the video terminal, so that the smart device can enable the video terminal to receive the video shared by the smart device desktop content.
由于智能设备与视频终端建立视频会话通道来实现智能设备向视频终端主动推送需共享的桌面内容,而建立该视频会话通道并不需要在智能设备和视频终端上额外安装相应的服务器程序和客户端程序,并且该技术方案也不需要进行鉴权,因此上述技术方案能够简化操作过程,增加桌面内容共享的灵活性和便利性,也使得桌面内容共享更具有可操作性和安全性。因此,根据本发明实施例的共享桌面内容的方法能够提高桌面内容共享的灵活性、便利性和可操作性,同时避免由于鉴权产生的安全隐患问题。Since the smart device and the video terminal establish a video session channel to enable the smart device to actively push the desktop content to be shared to the video terminal, the establishment of the video session channel does not require additional installation of corresponding server programs and clients on the smart device and the video terminal program, and this technical solution does not require authentication, so the above technical solution can simplify the operation process, increase the flexibility and convenience of desktop content sharing, and make desktop content sharing more operable and secure. Therefore, the method for sharing desktop content according to the embodiment of the present invention can improve the flexibility, convenience and operability of desktop content sharing, and at the same time avoid security risks caused by authentication.
在本发明实施例中,智能设备包括但不限于个人计算机、便携式计算机、智能手机、智能多媒体机及其它智能设备;视频终端包括但不限于智能手机、个人数字助理(Personal Digital Assistant,简称“PDA”)、固话可视电话、网络电视(Internet Protocol Television,简称“IPTV”)可视电话及符合低位速率多媒体通信终端标准H.324M的设备。智能设备与视频终端可以分别通过线缆或无线接口连接到网络,从而在智能设备与视频终端之间建立通信连接。该网络包括但不限于各种有线电信网络、各种无线电信网络、IPTV网络、因特网络及以太局域网络。为了更好地解释本发明实施例的原理,本发明实施例中以计算机和可视电话分别作为智能设备和视频终端的示例进行描述,但并非以此限制本发明。In the embodiment of the present invention, smart devices include but are not limited to personal computers, portable computers, smart phones, smart multimedia machines and other smart devices; video terminals include but are not limited to smart phones, personal digital assistants (Personal Digital Assistant, referred to as "PDA") ”), fixed-line videophones, Internet Protocol Television (IPTV for short) videophones, and devices that meet the low-bit-rate multimedia communication terminal standard H.324M. The smart device and the video terminal can be respectively connected to the network through a cable or a wireless interface, so as to establish a communication connection between the smart device and the video terminal. The network includes but is not limited to various wired telecommunication networks, various wireless telecommunication networks, IPTV networks, Internet networks and Ethernet local area networks. In order to better explain the principles of the embodiments of the present invention, in the embodiments of the present invention, computers and videophones are used as examples of smart devices and video terminals respectively for description, but this does not limit the present invention.
在本发明实施例中,S101中视频参数可以包括视频传输协议、端口号、视频编解码格式、视频编解码分辨率、帧频率中的至少一种,其中,根据视频参数将显示数据转换为视频流包括:根据视频传输协议、端口号、视频编解码格式、视频编解码分辨率、帧频率中的至少一种将显示数据转换为视频流。下面以会话发起协议(Session Initiation Protocol,简称“SIP”)的协商过程为例进行说明:智能设备与视频终端建立连接并向视频终端的端口发送协商包文,该协商包文包括与视频终端进行视频通信相关的视频参数,比如智能设备使用的传输协议及端口号、视频编解码格式、视频编解码分辨率、帧速率及码速率等视频参数,视频终端接收到该协商包文后,如果视频终端能够接受上述视频参数,那么视频终端可以反馈确认信息,这样智能设备就建立了与视频终端的视频会话通道,并且智能设备可以采用上述视频参数与视频终端进行通信;如果视频终端不能够接受上述视频参数,那么视频终端可以反馈非确认信息,以通知智能设备重新进行协商,于是智能设备可以更换相关的信息,并重新发送协商包文,直到与视频终端协商好诸如视频编解码格式、视频编解码分辨率、帧速率及码速率等视频参数,并建立与视频终端的视频会话通道。In the embodiment of the present invention, the video parameters in S101 may include at least one of video transmission protocol, port number, video codec format, video codec resolution, and frame frequency, wherein the display data is converted into video Streaming includes: converting display data into a video stream according to at least one of video transmission protocol, port number, video codec format, video codec resolution, and frame frequency. The following takes the negotiation process of the Session Initiation Protocol (SIP for short) as an example to illustrate: the smart device establishes a connection with the video terminal and sends a negotiation packet to the port of the video terminal. Video parameters related to video communication, such as the transmission protocol and port number used by smart devices, video codec format, video codec resolution, frame rate, and code rate. After the video terminal receives the negotiation packet, if the video If the terminal can accept the above video parameters, then the video terminal can feed back confirmation information, so that the smart device establishes a video session channel with the video terminal, and the smart device can use the above video parameters to communicate with the video terminal; if the video terminal cannot accept the above video parameters, then the video terminal can feed back non-confirmation information to notify the smart device to re-negotiate, so the smart device can replace the relevant information and resend the negotiation packet until it negotiates with the video terminal such as video codec format, video codec Decode video parameters such as resolution, frame rate and code rate, and establish a video session channel with the video terminal.
在本发明实施例中,S102中智能设备获取需要共享的桌面内容的显示数据的步骤可以包括:智能设备可以通过操作系统接口调用的方式、直接访问显示内存的方式或获取差异数据的方式获取桌面内容的显示数据。其中,操作系统接口调用包括但不限于图形设备接口(Graphics Device Interface,简称“GDI”)调用;直接访问显示内存的方式包括但不限于采用DirectX调用的方式;获取差异数据的方式包括但不限于通过Windows的消息的钩子程序获取差异数据,即当有新消息产生的时候,钩子程序可截获该消息,并取得待显示的数据本次重绘内容与上次重绘内容的差异部分,由此获取桌面内容的显示数据。In the embodiment of the present invention, the step of the smart device obtaining the display data of the desktop content to be shared in S102 may include: the smart device may obtain the desktop by calling the operating system interface, directly accessing the display memory, or obtaining difference data Display data for content. Among them, the operating system interface call includes but not limited to Graphics Device Interface (Graphics Device Interface, referred to as "GDI") call; the method of directly accessing the display memory includes but not limited to the method of using DirectX call; the method of obtaining difference data includes but not limited to Obtain the difference data through the hook program of the Windows message, that is, when a new message is generated, the hook program can intercept the message and obtain the difference between the current redraw content and the last redraw content of the data to be displayed, thus Get display data for desktop content.
优选地,智能设备可以通过GDI调用的方式获取桌面内容的显示数据。例如,智能设备调用Windows GDI的接口函数CreateCompatibleDC,来创建图形设备;然后智能设备调用函数CreateCompatibleBitmap,来创建与图形设备描述表相兼容的位图;再把图形设备与位图关联起来;最后智能设备获取指定的坐标位置的位图,从而获取桌面内容的显示数据。Preferably, the smart device can acquire the display data of the desktop content through GDI calling. For example, the smart device calls the interface function CreateCompatibleDC of Windows GDI to create a graphics device; then the smart device calls the function CreateCompatibleBitmap to create a bitmap compatible with the graphics device description table; then associates the graphics device with the bitmap; finally the smart device Get the bitmap of the specified coordinate position, so as to get the display data of the desktop content.
在本发明实施例中,S103中智能设备根据视频参数将显示数据转换为视频流的步骤可以包括:智能设备根据与视频终端协商传输视频数据所获得的视频参数,将桌面内容的显示数据转换成具有特定频率的视频流,该特定频率与视频参数中的帧频率相同。仍结合智能设备通过GDI调用的方式获取桌面内容的显示数据为例进行说明,智能设备已经获取指定的坐标位置的位图,随后,智能设备根据协商获取的视频参数,把该位图转换成特定编解码格式和视频编解码分辨率的一帧视频画面,该视频图画的分辨率需要与视频参数中的帧频率相同。例如,当智能设备与视频终端协商的帧速率为每秒13帧时,可以让智能设备获取桌面内容的速率也设置为每秒13帧,即视频流的频率可以与视频参数中的帧频率相同。In the embodiment of the present invention, the step of the smart device converting the display data into a video stream according to the video parameters in S103 may include: the smart device converts the display data of the desktop content into A video stream with a specific frequency that is the same as the frame frequency in the video parameters. Still taking the display data of the desktop content obtained by the smart device through GDI calling as an example, the smart device has obtained the bitmap of the specified coordinate position, and then the smart device converts the bitmap into a specific One frame of video picture in codec format and video codec resolution. The resolution of the video picture needs to be the same as the frame frequency in the video parameters. For example, when the frame rate negotiated between the smart device and the video terminal is 13 frames per second, the rate at which the smart device can obtain desktop content can also be set to 13 frames per second, that is, the frequency of the video stream can be the same as the frame frequency in the video parameter .
在本发明实施例中,当智能设备根据视频参数将显示数据转换为视频流之后,智能设备可以根据与视频终端协商好的复用、同步及实时传输协议和端口号,利用视频会话通道向视频终端推送视频流。In the embodiment of the present invention, after the smart device converts the display data into a video stream according to the video parameters, the smart device can use the video session channel to send video streams to the video stream according to the multiplexing, synchronization, and real-time The terminal pushes the video stream.
本发明实施例提供了另一种共享桌面内容的方法,如图2所示,可能的应用场景如下:一个视频终端用户拨打呼叫中心语音电话,并与话务员的智能设备建立语音通话。在通话的过程中,话务员可能需要利用智能设备向视频终端共享智能设备的桌面内容,以便让视频终端用户能够看到话务员的智能设备的桌面内容,此时智能设备就需要与视频终端协商传输视频数据,并获取视频参数,建立视频会话通道,然后智能设备根据该视频参数将桌面内容转换成视频流,利用建立好的视频会话通道向视频中的推送上述视频流,该方法详细过程如下:The embodiment of the present invention provides another method for sharing desktop content. As shown in FIG. 2 , the possible application scenarios are as follows: a video terminal user makes a voice call in a call center and establishes a voice call with an operator's smart device. During a call, the operator may need to use the smart device to share the desktop content of the smart device with the video terminal, so that the video terminal user can see the desktop content of the operator's smart device. At this time, the smart device needs to negotiate with the video terminal to transmit video Data, and obtain video parameters, establish a video session channel, and then the smart device converts the desktop content into a video stream according to the video parameters, and uses the established video session channel to push the above video stream to the video. The detailed process of the method is as follows:
在执行下面步骤之前,视频终端首先建立了与智能设备的语音通话,这时智能设备用户需要向视频终端推送共享的桌面内容。Before performing the following steps, the video terminal first establishes a voice call with the smart device. At this time, the user of the smart device needs to push the shared desktop content to the video terminal.
S201,智能设备与视频终端协商传输视频数据,获取传输视频数据所需要的视频参数,并与视频终端建立视频会话通道;该部分内容详细过程在图1所涉及的实施例中已做了说明,这里就不再赘述。S201, the smart device negotiates with the video terminal to transmit video data, obtains video parameters required for transmitting video data, and establishes a video session channel with the video terminal; the detailed process of this part has been described in the embodiment involved in FIG. 1 , I won't go into details here.
智能设备确定是否与视频终端协商好视频数据的传输,如果确定没有与视频终端协商好传输视频数据,即智能设备还没有与视频终端成功建立视频会话通道,则智能设备继续与视频终端协商传输视频数据。当智能设备确定已经与视频终端协商好传输视频数据时,即智能设备与视频终端成功建立了视频会话通道,则智能设备可以获取桌面内容的显示数据。The smart device determines whether the video data transmission has been negotiated with the video terminal. If it is determined that the video data transmission has not been negotiated with the video terminal, that is, the smart device has not successfully established a video session channel with the video terminal, the smart device continues to negotiate with the video terminal to transmit video. data. When the smart device determines that the video data transmission has been negotiated with the video terminal, that is, the smart device and the video terminal have successfully established a video session channel, the smart device can acquire the display data of the desktop content.
S202,智能设备确定需要共享的桌面内容。S202. The smart device determines the desktop content that needs to be shared.
智能设备确定的桌面内容可以包括整个桌面的内容、或桌面内特定区域的内容,桌面内特定区域的内容可以例如为特定视窗的内容。例如,该桌面内容可以仅包括视频播放器视窗的内容,或可以包括特定视窗的内容和桌面某个区域的内容,或可以包括整个智能设备的桌面的内容。The desktop content determined by the smart device may include the content of the entire desktop, or the content of a specific area in the desktop, and the content of the specific area in the desktop may be, for example, the content of a specific window. For example, the desktop content may only include the content of the video player window, or may include the content of a specific window and a certain area of the desktop, or may include the content of the entire desktop of the smart device.
本发明实施例中,S201与S202并没有严格先后关系的限制,S201可以在S202之前执行,也可以在S202之后执行。In the embodiment of the present invention, S201 and S202 are not strictly limited in sequence, and S201 may be performed before S202, or may be performed after S202.
S203,智能设备获取上述确定需要共享的桌面内容的显示数据。S203. The smart device acquires the above-mentioned display data of the determined desktop content that needs to be shared.
在智能设备确定需要推送的桌面内容之后,智能设备获取与所述需要推送的桌面内容相对应的显示数据,智能设备获取上述确定需要共享的桌面内容的显示数据的方式,在图1所涉及的实施例中已做了说明,这里就不再赘述。After the smart device determines the desktop content that needs to be pushed, the smart device obtains the display data corresponding to the desktop content that needs to be pushed, and the smart device obtains the above-mentioned display data for determining the desktop content that needs to be shared. The description has been made in the embodiment, so it will not be repeated here.
S204,智能设备根据视频参数将显示数据转换为视频流。该部分内容详细过程在图1所涉及的实施例中已做了说明,这里就不再赘述。S204. The smart device converts the display data into a video stream according to the video parameters. The detailed process of this part of the content has been described in the embodiment involved in FIG. 1 , and will not be repeated here.
本发明实施例中,智能设备还可以将显示数据与附加视频数据进行合成,得到合成数据;然后根据视频参数将合成数据转换为视频流。即智能设备还可以将桌面内容的显示数据与附加视频数据进行合成,并通过转换形成的视频流向视频终端一起推送桌面内容和附加视频,使得智能设备推送桌面内容更加灵活,也使得桌面内容共享更具有可操作性和安全性。In the embodiment of the present invention, the smart device can also synthesize the display data and the additional video data to obtain the synthesized data; then convert the synthesized data into a video stream according to the video parameters. That is to say, the smart device can also synthesize the display data of the desktop content and the additional video data, and push the desktop content and the additional video to the video terminal through the converted video stream, which makes it more flexible for the smart device to push the desktop content, and also makes the sharing of the desktop content more convenient. It is operable and safe.
其中,上述附加视频数据指除了桌面内容的显示数据之外,智能设备希望视频终端能够共享的其它视频的数据。Wherein, the above-mentioned additional video data refers to other video data that the smart device expects the video terminal to share besides the display data of the desktop content.
S205,智能设备利用上述建立好的视频会话通道,向视频终端推送上述视频流。S205. The smart device uses the established video session channel to push the video stream to the video terminal.
本发明实施例中,智能设备可以向视频终端推送显示数据转换的视频流,也可以向视频终端推送上述合成数据转换的视频流。In the embodiment of the present invention, the smart device may push the video stream converted from the display data to the video terminal, and may also push the video stream converted from the above synthetic data to the video terminal.
在本发明实施例中,由于智能设备与视频终端建立视频会话通道来实现智能设备向视频终端主动推送需共享的桌面内容,而建立该视频会话通道并不需要在智能设备和视频终端上额外安装相应的服务器程序和客户端程序,此外也不存在鉴权的问题,因而上述技术方案能够简化操作过程,增加桌面内容共享的灵活性和便利性,也使得桌面内容共享更具有可操作性和安全性。因此,根据本发明实施例的共享桌面内容的方法能够提高桌面内容共享的灵活性、便利性和可操作性,同时避免由于鉴权产生的安全隐患问题。In the embodiment of the present invention, since the smart device establishes a video session channel with the video terminal to realize that the smart device actively pushes the desktop content to be shared to the video terminal, and the establishment of the video session channel does not require additional installation on the smart device and the video terminal. Corresponding server programs and client programs do not have authentication problems, so the above-mentioned technical solution can simplify the operation process, increase the flexibility and convenience of desktop content sharing, and make desktop content sharing more operable and secure sex. Therefore, the method for sharing desktop content according to the embodiment of the present invention can improve the flexibility, convenience and operability of desktop content sharing, and at the same time avoid security risks caused by authentication.
本发明另一实施例中,还可能出现这样的应用场景:一个视频终端用户拨打呼叫中心视频电话,并与话务员的智能设备建立视频会话通道,并且进行视频通话,与视频终端建立视频会话通道的过程和步骤S201的过程相同,这里不再赘述。在进行视频通话过程中,话务员可能需要利用智能设备向视频终端共享智能设备的桌面内容,以便让视频终端用户能够看到话务员的智能设备的桌面内容。此时智能设备确定需要共享的桌面内容和获取该确定的共享桌面内容的显示数据,该过程和图2所涉及的实施例的S202和S203步骤相同,这里不再赘述。然后智能设备可以根据建立视频通话过程中协商的视频参数,将上述显示数据转换为视频流,当然也可以将显示数据与正在视频通话的视频数据进行合成,获得合成数据,然后智能设备可以根据建立视频通话过程中协商的视频参数,将合成数据转换成视频流。该过程和图2所涉及的实施例的S204步骤相同,这里不再赘述。最后,智能设备利用正在进行视频通话的视频会话通道将视频流推送给视频终端,这样就实现了智能设备向视频终端共享智能设备的桌面内容了。In another embodiment of the present invention, such an application scenario may also occur: a video terminal user dials a call center video call, and establishes a video conversation channel with the operator's smart device, and conducts a video call, and establishes a video conversation channel with the video terminal The process is the same as the process of step S201, and will not be repeated here. During a video call, the operator may need to use the smart device to share the desktop content of the smart device to the video terminal, so that the video terminal user can see the desktop content of the operator's smart device. At this time, the smart device determines the desktop content to be shared and acquires the display data of the determined shared desktop content. This process is the same as steps S202 and S203 in the embodiment involved in FIG. 2 , and will not be repeated here. Then the smart device can convert the above display data into a video stream according to the video parameters negotiated during the establishment of the video call. Of course, the display data can also be synthesized with the video data in the video call to obtain the synthesized data, and then the smart device can be based on the established Video parameters negotiated during a video call, converting composite data into a video stream. This process is the same as step S204 of the embodiment involved in FIG. 2 , and will not be repeated here. Finally, the smart device pushes the video stream to the video terminal by using the video session channel where the video call is in progress, so that the smart device can share the desktop content of the smart device with the video terminal.
本发明另一实施例中,与上一个实施例不同的是:由于转换智能设备的共享的桌面内容的显示数据的视频参数,可能与已经建立好的的视频通话的视频会话通道的视频参数不相同,智能设备并不利用已经建立好的视频通话的视频会话通道,而是重新与视频终端协商传输视频数据,获取新的视频参数,并建立与视频终端新的视频会话通道,后续过程的同S202至S205,这里不再赘述。在本发明实施例中,当智能设备建立与视频终端新的视频会话通道后,原先用于视频通话的视频会话通道可以被释放,也可以同时存在,这样视频终端就可以用两个视频窗口接收智能设备传输的视频流。In another embodiment of the present invention, the difference from the previous embodiment is that due to the conversion of the video parameters of the display data of the shared desktop content of the smart device, it may be different from the video parameters of the video session channel of the established video call. Similarly, the smart device does not use the video session channel of the video call that has been established, but re-negotiates with the video terminal to transmit video data, obtains new video parameters, and establishes a new video session channel with the video terminal. S202 to S205 will not be repeated here. In the embodiment of the present invention, after the smart device establishes a new video session channel with the video terminal, the video session channel originally used for the video call can be released or exist at the same time, so that the video terminal can use two video windows to receive Video streaming from smart devices.
本发明实施例提供了一种共享桌面内容的智能设备,如图3所示,该智能设备包括:协商模块31、获取模块32、转换模块33以及推送模块34。其中,协商模块31用于与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,并与视频终端建立视频会话通道;获取模块32用于获取需要共享的桌面内容的显示数据;转换模块33用于根据视频参数将显示数据转换为视频流;以及推送模块34用于利用所述视频会话通道向视频终端推送视频流。An embodiment of the present invention provides a smart device for sharing desktop content. As shown in FIG. 3 , the smart device includes: a
当智能设备需要向视频终端推送共享的桌面内容时,协商模块31与视频终端协商传输视频数据,获取传输视频数据所需的视频参数,并与视频终端建立视频会话通道;获取模块32可以通过操作系统接口调用的方式(例如GDI调用)、直接访问显示内存的方式(例如DirectX调用)或获取差异数据的方式获取需要共享的桌面内容的显示数据;随后,转换模块33根据协商模块31获取的视频参数,将获取模块32获取的需要共享的桌面内容的显示数据进行转化处理,生成视频流,其中,该视频流可以具有与视频参数中的帧频率相同的特定频率;最后由推送模块34向视频终端推送转换模块33生成的视频流,其中,推送模块34可以根据与视频终端协商好的复用、同步及实时传输协议和端口号,向视频终端推送视频流,以使得视频终端能够获得智能设备共享的桌面内容。When the smart device needs to push the shared desktop content to the video terminal, the
其中,本实施例所涉及的获取显示数据、获取视频参数、将显示数据转换为视频流所涉及的具体工作过程,可以参考上述图1和图2所涉及的实施例揭露的相关内容,在此不再赘述。Among them, for the specific working process involved in the acquisition of display data, acquisition of video parameters, and conversion of display data into video streams involved in this embodiment, you can refer to the relevant content disclosed in the embodiments involved in the above-mentioned Figures 1 and 2, here No longer.
由于智能设备与视频终端建立视频会话通道来实现智能设备向视频终端主动推送需共享的桌面内容,而建立该视频会话通道并不需要在智能设备和视频终端上额外安装相应的服务器程序和客户端程序,同时能够避免接收端必须先发起请求的弊端,同时也不存在鉴权的问题,因而上述智能设备能够简化操作过程,增加桌面内容共享的灵活性和便利性,也使得桌面内容共享更具有可操作性和安全性。Since the smart device and the video terminal establish a video session channel to enable the smart device to actively push the desktop content to be shared to the video terminal, the establishment of the video session channel does not require additional installation of corresponding server programs and clients on the smart device and the video terminal At the same time, it can avoid the disadvantage that the receiving end must first initiate the request, and there is no authentication problem. Therefore, the above-mentioned smart device can simplify the operation process, increase the flexibility and convenience of desktop content sharing, and make desktop content sharing more effective. Operability and safety.
更进一步地,在本发明实施例中,如图4所示,本发明实施例的智能设备还包括:确定模块35,该确定模块35用于确定需要共享的桌面内容,根据确定模块35确定的需要共享的桌面内容,获取模块32获取上述确定的桌面内容。其中,桌面内容包括整个桌面的内容或桌面内特定区域的内容,从而能够增加智能设备推送桌面内容的灵活性。Furthermore, in the embodiment of the present invention, as shown in FIG. 4 , the smart device of the embodiment of the present invention further includes: a
更进一步地,转换模块33还可以包括:合成子模块331和转换子模块332,其中,合成子模块331用于将显示数据与附加视频数据进行合成,得到合成数据;转换子模块332用于根据视频参数将合成数据转换为视频流。推送模块34还可以用于向视频终端推送转换子模块332转换的视频流,使得智能设备能够提高桌面内容共享的灵活性和便利性。Furthermore, the
其中,本实施例所涉及的确定显示数据、合成数据、将显示数据转换为视频流的所涉及的具体工作过程,可以参考上述图1和图2所涉及的实施例揭露的相关内容,在此不再赘述。Among them, for the specific working process involved in determining display data, synthesizing data, and converting display data into video streams involved in this embodiment, you can refer to the relevant content disclosed in the above-mentioned embodiments involved in FIG. 1 and FIG. 2 , here No longer.
通过以上实施例的描述,本领域的技术人员可以清楚地了解到本发明可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得移动设备(可以是手机,个人计算机,媒体播放器等)执行本发明各个实施例所述的方法。这里所称的存储介质,如:ROM/RAM、磁盘、光盘等。Through the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be realized by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is a better implementation mode . Based on this understanding, the essence of the technical solution of the embodiment of the present invention or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for making A mobile device (which may be a mobile phone, a personal computer, a media player, etc.) executes the methods described in various embodiments of the present invention. The storage medium referred to here, such as: ROM/RAM, magnetic disk, optical disk, etc.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101367591ACN101888519A (en) | 2009-05-14 | 2009-05-14 | Method and smart device for sharing desktop content |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101367591ACN101888519A (en) | 2009-05-14 | 2009-05-14 | Method and smart device for sharing desktop content |
| Publication Number | Publication Date |
|---|---|
| CN101888519Atrue CN101888519A (en) | 2010-11-17 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101367591APendingCN101888519A (en) | 2009-05-14 | 2009-05-14 | Method and smart device for sharing desktop content |
| Country | Link |
|---|---|
| CN (1) | CN101888519A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012136165A1 (en)* | 2012-06-13 | 2012-10-11 | 华为终端有限公司 | Method, user equipment, server, and device for sharing information |
| CN103139527A (en)* | 2011-12-05 | 2013-06-05 | 中国电信股份有限公司 | Parameter negotiation method in video communication, device and video communication terminal |
| CN103188552A (en)* | 2011-12-30 | 2013-07-03 | 旭智科技(深圳)有限公司 | Method for video data acceptance and conversion between terminals and system for video data acceptance and conversion between terminals |
| CN103312804A (en)* | 2013-06-17 | 2013-09-18 | 华为技术有限公司 | Screen sharing method, associated equipment and communication system |
| CN103428528A (en)* | 2013-08-19 | 2013-12-04 | 江苏金智教育信息技术有限公司 | Cloud streaming media adaptive playing device and method |
| CN103595715A (en)* | 2013-11-08 | 2014-02-19 | 腾讯科技(成都)有限公司 | Information sharing method and device for desktop live broadcasting |
| CN103761025A (en)* | 2013-12-31 | 2014-04-30 | 广州华多网络科技有限公司 | Information interaction method and device |
| CN103888494A (en)* | 2012-12-20 | 2014-06-25 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN103888425A (en)* | 2012-12-20 | 2014-06-25 | 联想(北京)有限公司 | Information processing method and information processing device |
| WO2014094614A1 (en)* | 2012-12-20 | 2014-06-26 | 北京联想软件有限公司 | Information processing method and information processing device |
| CN104349108A (en)* | 2013-08-08 | 2015-02-11 | 中国电信股份有限公司 | Method and system for communication based on video telephone terminal and video telephone terminal |
| CN104427295A (en)* | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Method for processing video in video conference and terminal |
| CN103312804B (en)* | 2013-06-17 | 2016-11-30 | 华为技术有限公司 | Screen sharing method and relevant device and communication system |
| CN107357585A (en)* | 2017-07-13 | 2017-11-17 | 广州视源电子科技股份有限公司 | Video acquisition method and device, video equipment and storage medium |
| CN107623657A (en)* | 2016-07-13 | 2018-01-23 | 南京中兴新软件有限责任公司 | media data transmission method, device and terminal |
| US10715980B2 (en) | 2013-11-29 | 2020-07-14 | Huawei Device Co., Ltd. | Method for sharing application between terminals, and terminal |
| CN111679881A (en)* | 2020-06-09 | 2020-09-18 | 腾讯科技(深圳)有限公司 | File processing method and device, computer equipment and storage medium |
| CN111935540A (en)* | 2020-08-07 | 2020-11-13 | 北京飞讯数码科技有限公司 | Desktop sharing method and system between command and scheduling terminals |
| WO2023071131A1 (en)* | 2021-10-29 | 2023-05-04 | 华为技术有限公司 | Desktop sharing method, apparatus, and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139527B (en)* | 2011-12-05 | 2016-03-23 | 中国电信股份有限公司 | Parameter consultation method in video communication, device and video communication terminal |
| CN103139527A (en)* | 2011-12-05 | 2013-06-05 | 中国电信股份有限公司 | Parameter negotiation method in video communication, device and video communication terminal |
| CN103188552A (en)* | 2011-12-30 | 2013-07-03 | 旭智科技(深圳)有限公司 | Method for video data acceptance and conversion between terminals and system for video data acceptance and conversion between terminals |
| US11991249B2 (en) | 2012-06-13 | 2024-05-21 | Huawei Device Co., Ltd. | Method, user equipment, server, and apparatus for implementing information sharing |
| US10708390B2 (en) | 2012-06-13 | 2020-07-07 | Huawei Device Co., Ltd. | Method, user equipment, server, and apparatus for implementing information sharing |
| US10129305B2 (en) | 2012-06-13 | 2018-11-13 | Huaei Device (Dongguan) Co., Ltd. | Method, user equipment, server, and apparatus for implementing information sharing |
| US10992781B2 (en) | 2012-06-13 | 2021-04-27 | Huawei Device Co., Ltd. | Method, user equipment, server, and apparatus for implementing information sharing |
| US9641568B2 (en) | 2012-06-13 | 2017-05-02 | Huawei Device Co., Ltd. | Method, user equipment, server, and apparatus for implementing information sharing |
| WO2012136165A1 (en)* | 2012-06-13 | 2012-10-11 | 华为终端有限公司 | Method, user equipment, server, and device for sharing information |
| CN103125107B (en)* | 2012-06-13 | 2016-08-24 | 华为终端有限公司 | Realize sharing the method for information, subscriber equipment and server and device |
| CN103125107A (en)* | 2012-06-13 | 2013-05-29 | 华为终端有限公司 | Method, user equipment, server, and device for sharing information |
| US10126821B2 (en) | 2012-12-20 | 2018-11-13 | Beijing Lenovo Software Ltd. | Information processing method and information processing device |
| CN103888494B (en)* | 2012-12-20 | 2018-04-27 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| CN103888425B (en)* | 2012-12-20 | 2018-06-01 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| WO2014094614A1 (en)* | 2012-12-20 | 2014-06-26 | 北京联想软件有限公司 | Information processing method and information processing device |
| CN103888425A (en)* | 2012-12-20 | 2014-06-25 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN103888494A (en)* | 2012-12-20 | 2014-06-25 | 联想(北京)有限公司 | Information processing method and information processing device |
| CN103888426B (en)* | 2012-12-20 | 2018-08-31 | 联想(北京)有限公司 | Information processing method and information processing equipment |
| TWI558146B (en)* | 2013-06-17 | 2016-11-11 | Huawei Tech Co Ltd | Screen sharing methods and related equipment and communication systems |
| CN103312804B (en)* | 2013-06-17 | 2016-11-30 | 华为技术有限公司 | Screen sharing method and relevant device and communication system |
| CN103312804A (en)* | 2013-06-17 | 2013-09-18 | 华为技术有限公司 | Screen sharing method, associated equipment and communication system |
| CN104349108B (en)* | 2013-08-08 | 2018-01-12 | 中国电信股份有限公司 | Communication means, system and radio phone terminal based on radio phone terminal |
| CN104349108A (en)* | 2013-08-08 | 2015-02-11 | 中国电信股份有限公司 | Method and system for communication based on video telephone terminal and video telephone terminal |
| CN103428528A (en)* | 2013-08-19 | 2013-12-04 | 江苏金智教育信息技术有限公司 | Cloud streaming media adaptive playing device and method |
| CN104427295A (en)* | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Method for processing video in video conference and terminal |
| CN103595715B (en)* | 2013-11-08 | 2017-02-15 | 腾讯科技(成都)有限公司 | Information sharing method and device for desktop live broadcasting |
| WO2015067207A1 (en)* | 2013-11-08 | 2015-05-14 | Tencent Technology (Shenzhen) Company Limited | Method and device for sharing live desktop information |
| CN103595715A (en)* | 2013-11-08 | 2014-02-19 | 腾讯科技(成都)有限公司 | Information sharing method and device for desktop live broadcasting |
| US10715980B2 (en) | 2013-11-29 | 2020-07-14 | Huawei Device Co., Ltd. | Method for sharing application between terminals, and terminal |
| US11606677B2 (en) | 2013-11-29 | 2023-03-14 | Huawei Device Co., Ltd. | Method for sharing application between terminals, and terminal |
| US12284581B2 (en) | 2013-11-29 | 2025-04-22 | Huawei Device Co., Ltd. | Method for sharing application between terminals, and terminal |
| US11974204B2 (en) | 2013-11-29 | 2024-04-30 | Huawei Device Co., Ltd. | Method for sharing application between terminals, and terminal |
| CN103761025A (en)* | 2013-12-31 | 2014-04-30 | 广州华多网络科技有限公司 | Information interaction method and device |
| CN103761025B (en)* | 2013-12-31 | 2017-08-01 | 广州华多网络科技有限公司 | Information interacting method and device |
| CN107623657A (en)* | 2016-07-13 | 2018-01-23 | 南京中兴新软件有限责任公司 | media data transmission method, device and terminal |
| CN107357585A (en)* | 2017-07-13 | 2017-11-17 | 广州视源电子科技股份有限公司 | Video acquisition method and device, video equipment and storage medium |
| CN107357585B (en)* | 2017-07-13 | 2020-11-06 | 广州视源电子科技股份有限公司 | Video acquisition method and device, video equipment and storage medium |
| CN111679881B (en)* | 2020-06-09 | 2022-03-15 | 腾讯科技(深圳)有限公司 | File processing method and device, computer equipment and storage medium |
| CN111679881A (en)* | 2020-06-09 | 2020-09-18 | 腾讯科技(深圳)有限公司 | File processing method and device, computer equipment and storage medium |
| CN111935540B (en)* | 2020-08-07 | 2022-06-28 | 北京飞讯数码科技有限公司 | Desktop sharing method and system between commanding and scheduling terminals |
| CN111935540A (en)* | 2020-08-07 | 2020-11-13 | 北京飞讯数码科技有限公司 | Desktop sharing method and system between command and scheduling terminals |
| WO2023071131A1 (en)* | 2021-10-29 | 2023-05-04 | 华为技术有限公司 | Desktop sharing method, apparatus, and system |
| Publication | Publication Date | Title |
|---|---|---|
| CN101888519A (en) | Method and smart device for sharing desktop content | |
| CN101282464B (en) | Terminal and method for transferring video | |
| US10015440B2 (en) | Multiple channel communication using multiple cameras | |
| US7715872B2 (en) | Video calling method capable of providing video through third display | |
| US9781386B2 (en) | Virtual multipoint control unit for unified communications | |
| US20060085823A1 (en) | Media communications method and apparatus | |
| CN101909192B (en) | Television terminal and communication method thereof | |
| CN103870434B (en) | Integrated audio and video conference capabilities | |
| WO2012075937A1 (en) | Video call method and videophone | |
| WO2016110169A1 (en) | Display processing method and device | |
| CN108322429B (en) | Recording control method in real-time communication, real-time communication system and communication terminal | |
| CN102055961B (en) | Method for monitoring visible terminal of called party and video monitoring system | |
| WO2014005488A1 (en) | Video data flow transmission method, terminal and system | |
| CN113014950A (en) | Live broadcast synchronization method and system and electronic equipment | |
| EP4395304A1 (en) | Communication method, device and system | |
| CN113923396B (en) | Remote desktop control method, device and medium based on video conference scene | |
| CN110740286A (en) | video conference control method, multipoint control unit and video conference terminal | |
| US20080052631A1 (en) | System and method for executing server applications in mobile terminal | |
| CN101166279A (en) | Content transmission method and apparatus using video call | |
| CN105530537B (en) | A kind of transmission method and relevant device of multi-medium data | |
| US20240283833A1 (en) | Desktop sharing method, apparatus, and system | |
| CN119583741A (en) | Audio and video call method, device, equipment, medium and product based on signaling protocol | |
| WO2012155761A1 (en) | Method for implementing videophone dynamic photo frame and mobile terminal | |
| EP4395306A1 (en) | Communication method, apparatus, and system | |
| JP2006319779A (en) | Video conference control device, video conference control method and computer program thereof |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication | Application publication date:20101117 |