技术领域Technical field
本发明实施例涉及传屏技术，尤其涉及一种传屏方法、设备及存储介质。Embodiments of the present invention relate to screen transmission technology, and in particular, to a screen transmission method, device and storage medium.
背景技术Background technique
在工作、学习、娱乐等场景中，尤其是使用大型显示设备的时候，用户广泛使用传屏操作，在个人电脑等源设备接入传屏设备，传屏设备获取源设备的画面，并通过无线的方式将源设备的画面同步到诸如智能交互平板等目标设备，目标设备播放该画面。In scenarios such as work, study, and entertainment, especially when using large display devices, users widely use screen sharing operations. They connect a source device such as a personal computer to a screen sharing device. The screen sharing device obtains the screen of the source device and transmits it wirelessly to the source device. The method synchronizes the picture of the source device to the target device such as a smart interactive tablet, and the target device plays the picture.
目前，用户在选择待传屏的目标设备时，用户需要将传屏设备手动接入待传屏的目标设备中，目标设备将网络参数写入传屏设备，从而实现配对，此后，用户拔下传屏设备并接入源设备后，使用该网络参数执行传屏操作。Currently, when the user selects the target device to be screen transferred, the user needs to manually connect the screen transfer device to the target device to be screen transferred. The target device writes the network parameters to the screen transfer device to achieve pairing. After that, the user unplugs the device. After the screen transfer device is connected to the source device, use the network parameters to perform the screen transfer operation.
但是，诸如智能交互平板等目标设备，多为固定挂在墙上，用户走到目标设备处并进行插拔等操作较为繁琐，尤其是每次传屏到不同的目标设备时，都要执行重新执行一遍配对，使得选择目标设备的操作尤为繁琐，从而导致传屏操作的效率较低。However, target devices such as smart interactive tablets are mostly fixed on the wall. It is cumbersome for users to walk to the target device and perform operations such as plugging and unplugging. Especially each time the screen is transferred to a different target device, a new process must be performed. Performing pairing once makes the operation of selecting the target device particularly cumbersome, resulting in low efficiency of the screen transfer operation.
发明内容Contents of the invention
本发明实施例提供一种传屏方法、设备及存储介质，以解决用户通过插拔传屏设备选择待传屏的目标设备的方式较为繁琐、导致传屏操作的效率较低的问题。Embodiments of the present invention provide a screen transfer method, device and storage medium to solve the problem that the user selects a target device to be screen transferred by plugging and unplugging the screen transfer device, which is cumbersome and results in low efficiency of the screen transfer operation.
第一方面，本发明实施例提供了一种传屏方法，由传屏设备执行，包括：In a first aspect, an embodiment of the present invention provides a screen sharing method, which is executed by a screen sharing device, including:
确定接入源设备；Determine the access source device;
接收目标设备基于无线接入点所广播的目标数据帧；Receive target data frames broadcast by the target device based on the wireless access point;
从所述目标数据帧中读取所述目标设备的设备信息，所述设备信息包括描述信息和网络参数；Read the device information of the target device from the target data frame, where the device information includes description information and network parameters;
显示所述目标设备的所述描述信息；Display the description information of the target device;
接收作用于所述描述信息的选定操作；receiving selected operations that act on said description information;
响应于所述选定操作，根据所述描述信息对应的网络参数、通过所述传屏设备接入所述描述信息所属目标设备设置的无线接入点；In response to the selection operation, according to the network parameters corresponding to the description information, access the wireless access point set by the target device to which the description information belongs through the screen sharing device;
获取在所述源设备中产生的媒体数据；Obtain media data generated in the source device;
将所述媒体数据发送给所述目标设备进行播放。Send the media data to the target device for playback.
第二方面，本发明实施例还提供了一种传屏方法，应用于目标设备，包括：In a second aspect, embodiments of the present invention also provide a screen transfer method, applied to a target device, including:
开启无线接入点；Turn on the wireless access point;
基于所述无线接入点广播目标数据帧，以使所述目标数据帧被传屏设备接收，所述传屏设备接入源设备；Broadcast the target data frame based on the wireless access point, so that the target data frame is received by the screen transmission device, and the screen transmission device accesses the source device;
其中，所述目标数据帧包括所述目标设备的设备信息，所述设备信息包括描述信息和网络参数，所述描述信息用于显示在所述源设备中；Wherein, the target data frame includes device information of the target device, the device information includes description information and network parameters, and the description information is used to be displayed in the source device;
在所述描述信息被选定时，根据所述网络参数、基于所述无线接入点接入所述传屏设备；When the description information is selected, access the screen sharing device based on the network parameters and the wireless access point;
接收所述传屏设备发送的、在所述源设备中产生的媒体数据；Receive media data sent by the screen sharing device and generated in the source device;
播放所述媒体数据。Play the media data.
第三方面，本发明实施例还提供了一种传屏方法，包括：In a third aspect, embodiments of the present invention also provide a screen sharing method, including:
目标设备基于无线接入点广播目标数据帧；The target device broadcasts the target data frame based on the wireless access point;
源设备接收目标设备所广播的目标数据帧；The source device receives the target data frame broadcast by the target device;
源设备显示所述目标数据帧中、所述目标设备的描述信息；The source device displays the description information of the target device in the target data frame;
源设备在接收到作用于所述描述信息的选定操作时，根据所述目标数据帧的网络参数接入所述描述信息所属目标设备；When the source device receives the selected operation acting on the description information, access the target device to which the description information belongs according to the network parameters of the target data frame;
目标设备播放在所述源设备中产生的媒体数据。The target device plays the media data generated in the source device.
第四方面，本发明实施例还提供了一种传屏装置，位于传屏设备中，包括：In a fourth aspect, embodiments of the present invention also provide a screen transmission device, which is located in a screen transmission device and includes:
设备接入确定模块，用于确定接入源设备；The device access determination module is used to determine the access source device;
目标数据帧接收模块，用于接收目标设备基于无线接入点所广播的目标数据帧；The target data frame receiving module is used to receive the target data frame broadcast by the target device based on the wireless access point;
设备信息读取模块，用于从所述目标数据帧中读取所述目标设备的设备信息，所述设备信息包括描述信息和网络参数；A device information reading module, configured to read the device information of the target device from the target data frame, where the device information includes description information and network parameters;
描述信息显示模块，用于显示所述目标设备的所述描述信息；A description information display module, configured to display the description information of the target device;
选定操作接收模块，用于接收作用于所述描述信息的选定操作；a selected operation receiving module, configured to receive the selected operation acting on the description information;
无线接入点连接模块，用于响应于所述选定操作，根据所述描述信息对应的网络参数、通过所述传屏设备接入所述描述信息所属目标设备设置的无线接入点；A wireless access point connection module, configured to respond to the selection operation and access the wireless access point set by the target device to which the description information belongs through the screen sharing device according to the network parameters corresponding to the description information;
媒体数据获取模块，用于获取在所述源设备中产生的媒体数据；A media data acquisition module, used to acquire media data generated in the source device;
媒体数据传输模块，用于将所述媒体数据发送给所述目标设备进行播放。A media data transmission module is used to send the media data to the target device for playback.
第五方面，本发明实施例还提供了一种传屏装置，位于目标设备中，包括：In a fifth aspect, embodiments of the present invention also provide a screen sharing device, which is located in the target device and includes:
无线接入点开启模块，用于开启无线接入点；Wireless access point opening module, used to open the wireless access point;
目标数据帧广播模块，用于基于所述无线接入点广播目标数据帧，以使所述目标数据帧被传屏设备接收，所述传屏设备接入源设备；A target data frame broadcast module, configured to broadcast the target data frame based on the wireless access point, so that the target data frame is received by the screen transmission device, and the screen transmission device accesses the source device;
其中，所述目标数据帧包括所述目标设备的设备信息，所述设备信息包括描述信息和网络参数，所述描述信息用于显示在所述源设备中；Wherein, the target data frame includes device information of the target device, the device information includes description information and network parameters, and the description information is used to be displayed in the source device;
无线接入模块，用于在所述描述信息被选定时，根据所述网络参数、基于所述无线接入点接入所述传屏设备；A wireless access module, configured to access the screen sharing device according to the network parameters and the wireless access point when the description information is selected;
媒体数据接收模块，用于接收所述传屏设备发送的、在所述源设备中产生的媒体数据；A media data receiving module, configured to receive media data generated in the source device and sent by the screen transmission device;
媒体数据播放模块，用于播放所述媒体数据。A media data playing module is used to play the media data.
第六方面，本发明实施例还提供了一种传屏系统，包括：In a sixth aspect, embodiments of the present invention also provide a screen sharing system, including:
目标设备，用于基于无线接入点广播目标数据帧；The target device is used to broadcast the target data frame based on the wireless access point;
源设备，用于接收目标设备所广播的目标数据帧；显示所述目标数据帧中、所述目标设备的描述信息；在接收到作用于所述描述信息的选定操作时，根据所述目标数据帧的网络参数接入所述描述信息所属目标设备；The source device is configured to receive the target data frame broadcast by the target device; display the description information of the target device in the target data frame; when receiving a selected operation that acts on the description information, according to the target The network parameters of the data frame are accessed to the target device to which the description information belongs;
目标设备，还用于播放在所述源设备中产生的媒体数据。The target device is also used to play media data generated in the source device.
第七方面，本发明实施例还提供了一种电子设备，所述电子设备包括：In a seventh aspect, embodiments of the present invention further provide an electronic device, the electronic device including:
一个或多个处理器；one or more processors;
存储器，用于存储一个或多个程序；Memory, used to store one or more programs;
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如第一方面、第二方面、第三方面中任一所述的传屏方法。When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the screen sharing method as described in any one of the first aspect, the second aspect, and the third aspect. .
第八方面，本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现如第一方面、第二方面、第三方面中任一所述的传屏方法。In an eighth aspect, embodiments of the present invention also provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program implements any one of the first aspect, the second aspect, and the third aspect. The screen transmission method described.
在本实施例中，确定接入源设备，接收目标设备基于无线接入点所广播的目标数据帧，其中，目标设备用于通过传屏设备、与源设备执行传屏操作，从而显示源设备的媒体数据，从目标数据帧中读取目标设备的设备信息，设备信息包括描述信息，显示目标设备的描述信息，目标设备广播目标数据帧、传屏设备接收目标数据帧，对其进行解析并在源设备进行显示，这些均是用户无感知的操作，用户在源设备处即可浏览到周围各个目标设备的情况，方便用户选择所需传屏的目标设备，从而提高了传屏操作的效率。In this embodiment, the access source device is determined and the target data frame broadcast by the target device based on the wireless access point is received, where the target device is used to perform a screen sharing operation with the source device through the screen sharing device, thereby displaying the source device Media data, read the device information of the target device from the target data frame, the device information includes description information, display the description information of the target device, the target device broadcasts the target data frame, the screen transmission device receives the target data frame, parses it and Displaying on the source device is an operation that is imperceptible to the user. The user can browse the surrounding target devices at the source device, which facilitates the user to select the target device to which the screen needs to be transferred, thus improving the efficiency of the screen transfer operation. .
附图说明Description of the drawings
图1A为本发明实施例提供的传屏系统的架构示意图；Figure 1A is a schematic architectural diagram of a screen transmission system provided by an embodiment of the present invention;
图1B为本发明实施例提供的传屏设备的结构示意图；Figure 1B is a schematic structural diagram of a screen transmission device provided by an embodiment of the present invention;
图2为本发明实施例一提供的一种传屏方法的流程图；Figure 2 is a flow chart of a screen transmission method provided by Embodiment 1 of the present invention;
图3A至图3D是本发明实施例提供的一种发现及连接目标设备的界面示例图；Figures 3A to 3D are illustrations of an interface example for discovering and connecting to a target device provided by an embodiment of the present invention;
图4为本发明实施例二提供的一种传屏方法的流程图；Figure 4 is a flow chart of a screen transmission method provided in Embodiment 2 of the present invention;
图5为本发明实施例三提供的一种传屏方法的流程图；Figure 5 is a flow chart of a screen transmission method provided in Embodiment 3 of the present invention;
图6为本发明实施例四提供的一种传屏方法的流程图；Figure 6 is a flow chart of a screen transmission method provided in Embodiment 4 of the present invention;
图7为本发明实施例五提供的一种传屏方法的流程图；Figure 7 is a flow chart of a screen transmission method provided in Embodiment 5 of the present invention;
图8为本发明实施例六提供的一种传屏装置的结构示意图；Figure 8 is a schematic structural diagram of a screen transmission device provided in Embodiment 6 of the present invention;
图9为本发明实施七提供的一种传屏装置的结构示意图；Figure 9 is a schematic structural diagram of a screen transmission device provided in Embodiment 7 of the present invention;
图10为本发明实施例八提供的一种传屏系统的结构示意图；Figure 10 is a schematic structural diagram of a screen transmission system provided in Embodiment 8 of the present invention;
图11为本发明实施例九提供的一种电子设备的结构示意图。FIG. 11 is a schematic structural diagram of an electronic device provided in Embodiment 9 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It can be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for convenience of description, only some but not all structures related to the present invention are shown in the drawings.
图1A为本发明实施例提供的传屏系统的架构示意图。FIG. 1A is a schematic architectural diagram of a screen sharing system provided by an embodiment of the present invention.
如图1A所示，在传屏系统中，源设备110为传屏操作来源的设备，传屏设备120为执行传屏操作的设备，目标设备130为传屏操作目的的设备。As shown in FIG. 1A , in the screen sharing system, the source device 110 is the device that is the source of the screen sharing operation, the screen sharing device 120 is the device that performs the screen sharing operation, and the target device 130 is the device that is the destination of the screen sharing operation.
一般情况下，源设备110具有较强的运算能力，可以包括个人电脑、笔记本电脑等，其操作系统可以包括windows、Mac、Android(安卓)、iOS等，用户可在源设备110中制作、播放演示文稿(如PPT((PowerPoint，演示文稿软件))、工作文档(Word)等文件。Generally, the source device 110 has strong computing power and can include a personal computer, a laptop, etc., and its operating system can include windows, Mac, Android, iOS, etc. The user can create and play in the source device 110 Presentations (such as PPT ((PowerPoint, presentation software)), work documents (Word) and other files.
但是，源设备110的屏幕较小、扬声器功率较低，例如，笔记本电脑的屏幕多为13.3英寸、14英寸和15.6英寸，扬声器的功率一般在2W-5W。However, the screen of the source device 110 is small and the speaker power is low. For example, the screens of laptop computers are mostly 13.3 inches, 14 inches, and 15.6 inches, and the speaker power is generally 2W-5W.
在会议、演讲等场景中，场地宽广，对播放的要求较高，若在源设备110播放文件，容易出现界面信息(如字体、图片等)小、声音小等问题，导致播放效果较差。In scenarios such as meetings and lectures, the venue is wide and the requirements for playback are high. If the file is played on the source device 110, problems such as small interface information (such as fonts, pictures, etc.) and low sound are prone to occur, resulting in poor playback effects.
目标设备130可以包括平板、显示终端等。The target device 130 may include a tablet, a display terminal, etc.
该平板可以是两个或多个物理实体构成，也可以是一个物理实体构成。平板可以是通过触控技术对显示在平板上的内容进行操控，从而实现人机交互操作，其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。一般而言，平板的显示屏可以是电容屏、电阻屏或者电磁屏。用户可以通过手指或者触控笔对智能交互平板进行触控操作。The plate can be composed of two or more physical entities, or it can be composed of one physical entity. The tablet can control the content displayed on the tablet through touch technology to achieve human-computer interaction. It integrates one or more functions such as projector, electronic whiteboard, screen, audio, TV and video conferencing terminal. . Generally speaking, the display screen of a flat panel can be a capacitive screen, a resistive screen or an electromagnetic screen. Users can perform touch operations on the smart interactive tablet with their fingers or stylus.
平板中安装有操作系统自带的应用，同时，也安装有从第三方设备或者服务器中下载的应用，其中，应用的具体类型及内容可以根据实际情况设定，通常，该应用软件具有电子白板功能，其可以通过电子白板功能实现：书写、绘图、批注、课件制作以及展示播放等功能。The tablet is installed with applications that come with the operating system, as well as applications downloaded from third-party devices or servers. The specific type and content of the application can be set according to the actual situation. Usually, the application software has an electronic whiteboard Functions, which can be realized through the electronic whiteboard function: writing, drawing, annotation, courseware production, display and playback and other functions.
进一步地，该平板可以适于会议使用的平板、适于教育使用的平板。Furthermore, the tablet may be a tablet suitable for conference use or a tablet suitable for educational use.
所谓适于会议使用、教育使用，可以指平板中按照会议、教育的业务特性，定制化相应的应用。The so-called suitable for conference use and education use can refer to the corresponding customized applications in the tablet according to the business characteristics of conferences and education.
例如，在平板的屏幕上进行书写，同时融入图表辅助等设计，满足会议中高效的书写需求。For example, you can write on the tablet screen, while incorporating chart assistance and other designs to meet the needs of efficient writing in meetings.
平板中内置摄像、拾音、扩音等模块，可以支持远程桌面共享、异地书写实时同步，满足会议中远程协作、无界办公的需求。The tablet has built-in camera, sound pickup, amplification and other modules, which can support remote desktop sharing and real-time synchronization of writing in remote places, meeting the needs of remote collaboration and unbounded office in meetings.
目标设备130的屏幕较大、扬声器功率较高，例如，平板的屏幕多为55英寸-100英寸，扬声器的功率一般在30W-60W。The target device 130 has a larger screen and a higher speaker power. For example, the screen of a tablet is usually 55 inches to 100 inches, and the speaker power is generally 30W to 60W.
在会议、演讲等场景中，若在目标设备130播放文件，界面信息(如字体、图片等)清晰、声音响亮，播放效果较佳。In scenarios such as meetings and lectures, if the file is played on the target device 130, the interface information (such as fonts, pictures, etc.) will be clear, the sound will be loud, and the playback effect will be better.
因此，可通过传屏设备120将源设备110的多媒体数据同步至目标设备130进行播放，可将源设备110运算能力较强、目标设备130多媒体播放效果较佳的优势结合。Therefore, the multimedia data of the source device 110 can be synchronized to the target device 130 for playback through the screen transmission device 120, and the advantages of the source device 110 having strong computing power and the target device 130 having better multimedia playback effects can be combined.
图1B为本发明实施例提供的传屏设备的结构示意图。FIG. 1B is a schematic structural diagram of a screen transmission device provided by an embodiment of the present invention.
该传屏设备120包括但不限于：传输接口121、无线通信芯片122、输入单元123、输出单元124、存储器125、处理器126等部件。本领域技术人员可以理解，图1B中示出的传屏设备120的结构并不构成对传屏设备120的限定，传屏设备120可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。在本发明实施例中，传屏设备120包括但不限于USB Dongle(USB(Universal Serial Bus，通用串行总线)加密狗)等。The screen sharing device 120 includes but is not limited to: a transmission interface 121, a wireless communication chip 122, an input unit 123, an output unit 124, a memory 125, a processor 126 and other components. Those skilled in the art can understand that the structure of the screen transmission device 120 shown in FIG. 1B does not constitute a limitation on the screen transmission device 120. The screen transmission device 120 may include more or fewer components than those shown in the figure, or a combination of certain components. components, or different component arrangements. In the embodiment of the present invention, the screen transmission device 120 includes but is not limited to a USB Dongle (USB (Universal Serial Bus, Universal Serial Bus) dongle) and the like.
传输接口121为将传屏设备120作为外部装置、接入其他设备的接口。例如，USB接口(包括但不限于Type A、Type B、Type C)等。传输接口121可以用于接收来自其他设备的数据，以及，将数据输入其他设备。The transmission interface 121 is an interface for using the screen transmission device 120 as an external device and accessing other devices. For example, USB interface (including but not limited to Type A, Type B, Type C), etc. The transmission interface 121 may be used to receive data from other devices and to input data into other devices.
需要说明的是，该其他设备，在传屏操作时可以为源设备110，在配对操作时可以为目标设备130。It should be noted that the other device may be the source device 110 during the screen sharing operation, and may be the target device 130 during the pairing operation.
所谓配对，可以指将目标设备130对传屏设备120进行认证，将目标设备130的无线访问接入点的信息，写入传屏设备120中。The so-called pairing may refer to the target device 130 authenticating the screen sharing device 120 and writing the wireless access point information of the target device 130 into the screen sharing device 120 .
当传屏设备120通过传输接口121接入源设备110时，可接收源设备110的数据包括但不限于屏幕数据、音频数据等等，可传输至源设备110的数据包括但不限于触摸数据等等。When the screen sharing device 120 accesses the source device 110 through the transmission interface 121, the data that can be received from the source device 110 includes but is not limited to screen data, audio data, etc., and the data that can be transmitted to the source device 110 includes but is not limited to touch data, etc. wait.
当传屏设备120通过传输接口121接入目标设备130时，可接收目标设备130的数据包括但不限于配对数据、固件等等，可传输至源设备110的数据包括但不限于配对数据等等。When the screen sharing device 120 accesses the target device 130 through the transmission interface 121, the data that can be received from the target device 130 includes but is not limited to pairing data, firmware, etc., and the data that can be transmitted to the source device 110 includes but is not limited to pairing data, etc. .
无线通信芯片122可用于无线通信，包括但不限于Wi-Fi网卡、蓝牙芯片等，其中，Wi-Fi网卡可应用2.4G频段，5G频段等等，无线通信芯片122属于短距离无线传输技术，传屏设备120与目标设备130配对之后，可通过无线通信芯片122与目标设备130建立无线连接，传屏设备120可通过该无线连接从目标设备130接收数据(例如，触摸数据等等)，以及，将数据(例如，屏幕数据、音频数据等等)输入目标设备130。The wireless communication chip 122 can be used for wireless communication, including but not limited to Wi-Fi network cards, Bluetooth chips, etc. Among them, the Wi-Fi network card can apply 2.4G frequency band, 5G frequency band, etc. The wireless communication chip 122 belongs to short-distance wireless transmission technology. After the screen sharing device 120 is paired with the target device 130, a wireless connection can be established with the target device 130 through the wireless communication chip 122. The screen sharing device 120 can receive data (for example, touch data, etc.) from the target device 130 through the wireless connection, and , input data (eg, screen data, audio data, etc.) to the target device 130 .
输入单元123可用于产生与用户设置以及功能控制有关的键信号输入。具体地，输入单元123可包括功能键(例如，控制开始传屏的控件、控制暂停传屏的控制、控制停止传屏的控件)、触控面板、操作杆等中的一种或多种。The input unit 123 may be used to generate key signal inputs related to user settings and function control. Specifically, the input unit 123 may include one or more of function keys (for example, a control to start screen sharing, a control to pause screen sharing, a control to stop screen sharing), a touch panel, a joystick, and the like.
需要说明的是，这些功能键可以集成在同一个按键中，通过按压次数、按压时长、按压频次等方式区分不同的控制功能。It should be noted that these function keys can be integrated into the same button, and different control functions can be distinguished by the number of presses, press duration, press frequency, etc.
输出单元124可用于输出传屏的状态，例如，正在传屏、暂停传屏、未传屏等等，具体地，输出单元124该包括指示灯等。The output unit 124 may be used to output the status of the screen transfer, such as screen transfer in progress, screen transfer paused, screen transfer not yet performed, etc. Specifically, the output unit 124 should include an indicator light, etc.
存储器125可用于存储软件程序以及各种数据。存储器125可主要包括存储程序区和存储数据区，其中，存储程序区可存储至少一个功能所需的应用程序(例如，配对，传输屏幕数据、音频数据、触摸数据等等)等；存储数据区可存储根据传屏器120的使用所创建的数据(比如配对数据、操作标识位等)等。此外，存储器125可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。Memory 125 may be used to store software programs as well as various data. The memory 125 may mainly include a storage program area and a storage data area, wherein the storage program area may store at least one application program required for a function (for example, pairing, transmitting screen data, audio data, touch data, etc.), etc.; the storage data area Data created according to the use of the screen transmitter 120 (such as pairing data, operation identification bits, etc.) can be stored. In addition, memory 125 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
其中，处理器126是传屏设备120的控制中心，包括但不限于MPU(Micro ProcessorUnit，微处理器)，利用各种接口和线路连接整个传屏设备120的各个部分，通过运行或执行存储在存储器125内的软件程序和/或模块，以及调用存储在存储器125内的数据，执行传屏设备120的各种功能和处理数据，从而对计算机设备进行整体监控。Among them, the processor 126 is the control center of the screen transmission device 120, including but not limited to an MPU (Micro Processor Unit, microprocessor). It uses various interfaces and lines to connect various parts of the entire screen transmission device 120, and is stored in the screen by running or executing The software programs and/or modules in the memory 125 call the data stored in the memory 125 to perform various functions of the screen sharing device 120 and process data, thereby overall monitoring the computer device.
尽管未示出，传屏设备120还可以包括其他部件，如充电芯片等，在此不再赘述。Although not shown, the screen sharing device 120 may also include other components, such as a charging chip, etc., which will not be described again here.
在源设备110中可安装传屏客户端，在目标设备130中可安装传屏服务端，传屏客户端与传屏服务端遵循传屏协议，通过传屏设备120在源设备110与目标设备130之间执行传屏操作。The screen sharing client can be installed in the source device 110, and the screen sharing server can be installed in the target device 130. The screen sharing client and the screen sharing server follow the screen sharing protocol, and the screen sharing device 120 connects the source device 110 and the target device through the screen sharing device 120. Perform screen transfer operation between 130 and 130 seconds.
需要说明的是，针对不同的业务场景，如会议、教育、家庭娱乐等，传屏协议可能有所不同，传屏操作随之有所不同，并且，针对同一个业务场景，传屏协议在也有可能变更，传屏操作在不同版本的传屏客户端、传屏服务端之间也可能有所不同，本发明实施例对此不加以限制。It should be noted that for different business scenarios, such as conferences, education, home entertainment, etc., the screen transfer protocols may be different, and the screen transfer operations may also be different. Moreover, for the same business scenario, there are also screen transfer protocols. It may change, and the screen sharing operation may also be different between different versions of screen sharing clients and screen sharing servers, and this is not limited by the embodiment of the present invention.
为使本领域技术人员更好地理解本发明实施例，以下通过具体的示例来说明本发明实施例中的传屏操作：In order to enable those skilled in the art to better understand the embodiments of the present invention, the following uses specific examples to illustrate the screen sharing operation in the embodiments of the present invention:
1、目标设备同步源设备的多媒体数据1. The target device synchronizes the multimedia data of the source device
在源设备中，传屏客户端持续执行截屏操作(即录屏操作)，获得源设备产生的媒体数据，其中，该媒体数据包括在源设备的界面数据、音频数据。In the source device, the screen transfer client continues to perform a screen capture operation (ie, a screen recording operation) to obtain media data generated by the source device, where the media data includes interface data and audio data in the source device.
例如，在windows系统中，传屏客户端可通过GDI、mirror、ddraw和dxgi等方式进行截屏。For example, in Windows systems, the screen transfer client can capture screenshots through GDI, mirror, ddraw, and dxgi.
传屏客户端将媒体数据发送至传屏设备。传屏设备将媒体数据发送至目标设备。在目标设备中，传屏服务端播放该媒体数据，即在屏幕显示界面数据、调用扬声器播放音频数据。The screen sharing client sends media data to the screen sharing device. The screen transfer device sends media data to the target device. In the target device, the screen transfer server plays the media data, that is, the interface data is displayed on the screen and the speaker is called to play the audio data.
当然，在媒体数据之上，目标设备可显示操作控件、时间等其他信息。Of course, on top of the media data, the target device can display other information such as operating controls, time, etc.
2、源设备同步目标设备的触控操作2. The source device synchronizes the touch operations of the target device
在目标设备中，传屏服务端监听触摸数据，该触摸数据包括触摸点的数量、触摸点的状态、触摸点的坐标(包括横轴坐标x和纵轴坐标y)和触摸点的压力值中的至少一种。In the target device, the screen transfer server monitors touch data, which includes the number of touch points, the status of the touch points, the coordinates of the touch points (including the horizontal axis coordinate x and the vertical axis coordinate y) and the pressure value of the touch point. of at least one.
进一步地，触摸点的坐标根据屏幕数据在目标设备中显示区域的大小进行线性缩放，计算得到触摸点的坐标。Further, the coordinates of the touch point are linearly scaled according to the size of the display area of the screen data in the target device, and the coordinates of the touch point are calculated.
传屏服务端将触摸数据发送至传屏设备，传屏设备将触摸数据发送至源设备，在源设备中，传屏客户端执行与触摸数据对应的操作。The screen sharing server sends the touch data to the screen sharing device, and the screen sharing device sends the touch data to the source device. In the source device, the screen sharing client performs operations corresponding to the touch data.
或者，or,
在目标设备中，传屏服务端监听触摸数据，将该触摸数据转换为手势信号，传屏服务端将手势信号发送至传屏设备。传屏设备将手势信号发送至源设备。在源设备中，传屏客户端执行与手势信号对应的操作。In the target device, the screen sharing server monitors the touch data, converts the touch data into gesture signals, and the screen sharing server sends the gesture signals to the screen sharing device. The transmitting device sends the gesture signal to the source device. In the source device, the screen sharing client performs the operation corresponding to the gesture signal.
在一种情况中，该手势信号可用于触发源设备对当前界面显示的预设类型(如PPT)的文件执行指定的操作，如翻页操作页。In one case, the gesture signal can be used to trigger the source device to perform a specified operation, such as page turning, on a file of a preset type (such as PPT) displayed on the current interface.
在另一种情况中，该手势信号用于触发源设备采用其操作系统的模拟按键事件的方式执行与手势信号对应的操作。In another case, the gesture signal is used to trigger the source device to perform an operation corresponding to the gesture signal by using a simulated key event of its operating system.
在又一种情况中，传屏设备通过获取与手势信号对应的按键事件，将按键事件通过键盘协议发送给源设备，该按键事件用于触发源设备对该按键事件进行响应。In another case, the screen transmission device obtains the key event corresponding to the gesture signal and sends the key event to the source device through the keyboard protocol. The key event is used to trigger the source device to respond to the key event.
实施例一Embodiment 1
图2为本发明实施例一提供的一种传屏方法的流程图，本实施例可适用于目标设备广播目标数据帧，源设备通过解析目标数据帧自动发现目标设备的情况，该方法可以由传屏装置来执行，该传屏装置可以由软件和/或硬件实现，可配置在电子设备中，例如，传屏设备，该方法具体包括如下步骤：Figure 2 is a flow chart of a screen transmission method provided in Embodiment 1 of the present invention. This embodiment can be applied to the situation where the target device broadcasts the target data frame and the source device automatically discovers the target device by parsing the target data frame. This method can be performed by The screen sharing device can be implemented by software and/or hardware, and can be configured in an electronic device, such as a screen sharing device. The method specifically includes the following steps:
S201、确定接入源设备。S201. Determine the access source device.
在本实施例中，传屏设备并不需要预先与目标设备进行配对，即传屏设备中并未存储目标设备的网络参数。In this embodiment, the screen sharing device does not need to be paired with the target device in advance, that is, the screen sharing device does not store the network parameters of the target device.
在一种情况中，在传屏设备的存储器中，存储有传屏客户端，传屏客户端属于一个独立的客户端，或者是某个应用中的组件(如插件、SDK(Software Development Kit，软件开发工具包))。In one case, a screen sharing client is stored in the memory of the screen sharing device, and the screen sharing client belongs to an independent client, or is a component in a certain application (such as a plug-in, SDK (Software Development Kit, Software Development Kit)).
传屏设备在接入源设备时，该传屏客户端加载至源设备，在源设备提供的环境(如CPU(Central Processing Unit，中央处理器)、内存)中运行，此时，可确定源设备接入传屏设备。When the screen sharing device is connected to the source device, the screen sharing client is loaded into the source device and runs in the environment (such as CPU (Central Processing Unit, central processing unit), memory) provided by the source device. At this time, the source device can be determined. The device is connected to the screen transmission device.
进一步而言，由于源设备的操作系统类型较多，如windows、Mac、Android、iOS等，在传屏设备的存储器中，为兼容不同类型的操作系统，可针对不同类型的操作系统存储适于在该操作系统运行的传屏客户端，传屏设备接入源设备时，可将适于在该操作系统中运行的传屏客户端加载至源设备。Furthermore, since the source device has many types of operating systems, such as windows, Mac, Android, iOS, etc., in order to be compatible with different types of operating systems, the memory of the screen sharing device can store suitable files for different types of operating systems. When the screen sharing client running in the operating system and the screen sharing device connects to the source device, the screen sharing client suitable for running in the operating system can be loaded to the source device.
在另一种情况中，在传屏设备的存储器中，烧录有一个程序，命名为装载器。In another case, a program named loader is burned into the memory of the screen transmission device.
其中，该装载器具备与目标设备进行通信的功能，但并不具备执行传屏操作的功能，因此，一般情况下，装载器的功能少于传屏客户端的功能，装载器的体积小于传屏客户端的体积。Among them, the loader has the function of communicating with the target device, but it does not have the function of performing the screen transfer operation. Therefore, in general, the functions of the loader are less than the functions of the screen transfer client, and the size of the loader is smaller than that of the screen transfer client. The size of the client.
在此情况中，预先在源设备中注册一检测服务，该检测服务在确定传屏设备接入源设备时，启动源设备中的装载器，该装载器可在源设备中安装、更新传屏客户端，传屏客户端在源设备提供的环境(如CPU、内存)中运行，此时，可确定源设备接入传屏设备。In this case, a detection service is registered in the source device in advance. When the detection service determines that the screen transmission device is connected to the source device, the loader in the source device is started. The loader can install and update the screen transmission in the source device. Client, the screen sharing client runs in the environment (such as CPU, memory) provided by the source device. At this time, it can be determined that the source device is connected to the screen sharing device.
进一步而言，由于源设备的操作系统类型较多，如windows、Mac、Android、iOS等，在传屏设备的存储器中，为兼容不同类型的操作系统，可针对不同类型的操作系统开发适于在该操作系统运行的传屏客户端，传屏设备接入源设备时，装载器可安装、更新适于在该操作系统中运行的传屏客户端。Furthermore, since the source device has many types of operating systems, such as Windows, Mac, Android, iOS, etc., in order to be compatible with different types of operating systems, the memory of the screen sharing device can be developed for different types of operating systems. When the screen sharing client running in the operating system and the screen sharing device are connected to the source device, the loader can install and update the screen sharing client suitable for running in the operating system.
S202、接收目标设备基于无线接入点所广播的目标数据帧。S202. Receive the target data frame broadcast by the target device based on the wireless access point.
在本实施例中，目标设备是指遵循传屏协议的设备，可用于通过传屏设备、与源设备执行传屏操作，从而显示源设备的媒体数据，目标数据帧为具有特定结构的无线数据帧、可用于广播其设备信息。In this embodiment, the target device refers to a device that follows the screen sharing protocol and can be used to perform screen sharing operations with the source device through the screen sharing device, thereby displaying the media data of the source device. The target data frame is wireless data with a specific structure. Frames can be used to broadcast their device information.
在源设备所处的环境中，除了目标设备开启无线接入点(Access Point，AP)、广播目标数据帧之外，还可能具有其他设备(如用户的移动终端、其他类型的显示终端、路由器等)开启无线接入点、广播其他数据帧，因此，目标设备通过传屏协议筛选目标设备所广播的目标数据帧。In the environment where the source device is located, in addition to the target device turning on the wireless access point (AP) and broadcasting the target data frame, there may also be other devices (such as the user's mobile terminal, other types of display terminals, routers etc.) turns on the wireless access point and broadcasts other data frames. Therefore, the target device filters the target data frames broadcast by the target device through the screen transmission protocol.
在具体实现中，传屏客户端可以通过无线通信芯片的驱动，将无线通信芯片(如Wi-Fi网卡)设置成monitor模式(即监听模式)，即可通过无线通信芯片的驱动提供的API(Application Programming Interface，应用程序编程接口)接口监听无线广播的数据帧，接收数据帧。In the specific implementation, the screen sharing client can set the wireless communication chip (such as Wi-Fi network card) to monitor mode (i.e., listening mode) through the driver of the wireless communication chip, that is, through the API provided by the driver of the wireless communication chip ( Application Programming Interface (Application Programming Interface) interface monitors wireless broadcast data frames and receives data frames.
进一步而言，传屏客户端提供窗口显示目标设备的信息，供用户选择目标设备，在未搜索到目标设备时，可以在该窗口显示等待的提示信息。Furthermore, the screen transfer client provides a window to display the information of the target device for the user to select the target device. When the target device is not found, the waiting prompt information can be displayed in the window.
例如，如图3A所示，传屏客户端提供搜索目标设备的控件(标记“搜索设备”)，用户点击该搜索目标设备的控件，切换至一页面，在搜索到目标设备之前，可显示旋转的符号、文字“正在搜索附近可传屏的设备”等信息提示用户等待。For example, as shown in Figure 3A, the screen transfer client provides a control for searching for the target device (marked "Search Device"). The user clicks on the control for searching for the target device and switches to a page. Before the target device is searched, the rotation can be displayed. The symbol, text "Searching for nearby devices that can transfer screens" and other information prompt the user to wait.
在传屏协议中，目标数据帧中记录有传屏标识，并且，该传屏标识以明文的形式记录在目标数据帧中的第一位置，当然，该传屏标识以密文的形式记录在目标数据帧中的第一位置。In the screen sharing protocol, the screen sharing identification is recorded in the target data frame, and the screen sharing identification is recorded in the first position in the target data frame in the form of plain text. Of course, the screen sharing identification is recorded in the form of cipher text in the target data frame. The first position in the target data frame.
其中，传屏标识可用于标识支持传屏操作的设备，例如，该传屏标识可以为生产该目标设备、传屏设备的厂商的信息(如厂商的名称缩写)，也可以为其他传屏协议中预先约定的信息，本实施例对此不加以限制。Among them, the screen transfer identifier can be used to identify a device that supports screen transfer operations. For example, the screen transfer identifier can be information about the manufacturer of the target device and the screen transfer device (such as the abbreviation of the manufacturer's name), or it can also be other screen transfer protocols. Information pre-agreed in this embodiment is not limited to this.
因此，按照传屏协议，可从该数据帧中的第一位置读取第一数据。Therefore, according to the screen transfer protocol, the first data can be read from the first position in the data frame.
例如，若传屏协议中规定目标数据帧为Wi-Fi的Beacon帧，则可以从Beacon帧的自定义数据中读取排序最前的第n(n为正整数)个字节(第一位置)中的数据，作为第一数据。For example, if the screen transmission protocol stipulates that the target data frame is a Wi-Fi Beacon frame, you can read the first nth (n is a positive integer) byte (the first position) from the custom data of the Beacon frame. The data in is used as the first data.
将第一数据与预设的传屏标识相同进行比较。Compare the first data with the preset screen transmission identifier.
若第一数据与投屏标识相同，则确定该数据帧为目标设备基于无线接入点广播的目标数据帧。If the first data is the same as the screen projection identifier, it is determined that the data frame is a target data frame broadcast by the target device based on the wireless access point.
若第一数据与投屏标识不同，则确定该数据帧为其他设备基于无线接入点广播的数据帧。If the first data is different from the screen projection identifier, it is determined that the data frame is a data frame broadcast by other devices based on the wireless access point.
当然，搜索到其他设备基于无线接入点广播的数据帧之后，可以丢弃该数据帧，并继续监听数据帧。Of course, after searching for data frames broadcast by other devices based on wireless access points, you can discard the data frames and continue to listen for data frames.
S203、从目标数据帧中读取目标设备的设备信息。S203. Read the device information of the target device from the target data frame.
在传屏协议中，目标数据帧中记录有设备信息，并且，该设备信息以密文的形式记录在目标数据帧中的第二位置，从而保证传屏操作的安全性，当然，该设备信息也可以以明文的形式记录在目标数据帧中的第二位置。In the screen transfer protocol, device information is recorded in the target data frame, and the device information is recorded in the second position of the target data frame in the form of ciphertext, thereby ensuring the security of the screen transfer operation. Of course, the device information It can also be recorded in plain text at the second position in the target data frame.
因此，按照传屏协议，在确定当前接收的数据帧为目标设备广播的目标数据帧之后，可以从目标数据帧中的第二位置读取第二数据。Therefore, according to the screen transmission protocol, after determining that the currently received data frame is the target data frame broadcast by the target device, the second data can be read from the second position in the target data frame.
例如，若传屏协议中规定目标数据帧为Wi-Fi的Beacon帧，则可以从Beacon帧的自定义数据中读取排序第n+1个字节至第m(m为正整数)个字节(第一位置)数据，作为第二数据。For example, if the screen transfer protocol stipulates that the target data frame is a Wi-Fi Beacon frame, you can read the sorted n+1th byte to the mth (m is a positive integer) word from the custom data of the Beacon frame. section (first position) data as the second data.
从第二数据进行解析，则可以获得目标设备的设备信息。By parsing the second data, the device information of the target device can be obtained.
对于密文的形式，在传屏设备中可以存储密钥，使用传屏协议规定的对称密钥算法，对第二数据进行解密，获得二进制的数据，将二进制的数据转换为结构化的设备信息。For the form of ciphertext, the key can be stored in the screen transmission device, and the second data is decrypted using the symmetric key algorithm specified in the screen transmission protocol to obtain binary data, and the binary data is converted into structured device information. .
所谓结构化，是指设备信息中已经预先设置了各个参数(如描述信息、网络参数、校验码等)的位置，从相应的位置读取所需的参数。The so-called structured means that the location of each parameter (such as description information, network parameters, check code, etc.) has been preset in the device information, and the required parameters are read from the corresponding location.
其中，所谓对称密钥算法，可以指加密和解密使用相同密钥的算法，例如，AES(Advanced Encryption Standard，高级加密标准，又称Rijndael加密法)、DES(DataEncryption Standard，数据加密算法)、3DES(Triple Data Encryption Algorithm，三重数据加密算法)、PBE(Password-based encryption，基于密码验证)、RC4(Rivest Cipher4)、SM1、SM4，等等。Among them, the so-called symmetric key algorithm can refer to the algorithm that uses the same key for encryption and decryption, such as AES (Advanced Encryption Standard, also known as Rijndael encryption method), DES (Data Encryption Standard, data encryption algorithm), 3DES (Triple Data Encryption Algorithm, triple data encryption algorithm), PBE (Password-based encryption, based on password verification), RC4 (Rivest Cipher4), SM1, SM4, etc.
S204、显示目标设备的描述信息。S204. Display the description information of the target device.
在本实施例中，设备信息包括描述信息，所谓描述信息，可以指介绍目标设备的信息，方便用户了解可以并选择传屏的目标设备。In this embodiment, the device information includes description information. The so-called description information may refer to information introducing the target device, so as to facilitate the user to understand and select the target device for screen sharing.
进一步而言，该描述信息可以根据实际情况进行设置，例如，编号、名称、设备类型(如智能交互平板、电视盒子等)、地址(如所处会议室的地址简称、所处会议室的详细地址等)，等等。Furthermore, the description information can be set according to the actual situation, for example, number, name, device type (such as intelligent interactive tablet, TV box, etc.), address (such as the abbreviation of the address of the conference room, the details of the conference room) address, etc.), etc.
在源设备中，一方面，传屏客户端可以从按照传屏协议的规定，从设备信息中指定的字段中读取描述信息，另一方面，传屏客户端可以生成一个窗口，可在该窗口中显示目标设备的描述信息。In the source device, on the one hand, the screen sharing client can read description information from the fields specified in the device information in accordance with the provisions of the screen sharing protocol; on the other hand, the screen sharing client can generate a window in which The window displays the description information of the target device.
当然，除了描述信息之外，在该窗口还可以为目标设备显示其他信息，如图标等，该图标可以用于表示目标设备的设备类型。Of course, in addition to the description information, this window can also display other information for the target device, such as icons, and the icon can be used to represent the device type of the target device.
例如，如图3B所示，在传屏客户端窗口的页面，提供8个显示区域，每个显示区域用于显示同一个目标设备的信息，包括图标、描述信息。其中，第一排第三个显示区域中，目标设备的设备类型为智能交互平板，则可以显示智能交互平板的缩略图作为图标，并显示描述信息“505”。For example, as shown in Figure 3B, the page of the screen sharing client window provides 8 display areas, and each display area is used to display information about the same target device, including icons and description information. Among them, in the third display area of the first row, if the device type of the target device is a smart interactive tablet, the thumbnail of the smart interactive tablet can be displayed as an icon, and the description information "505" can be displayed.
在会议室等场所，目标设备的数量可能较多、密度可能较高，此时，在窗口可能分多页显示目标设备的描述信息。In places such as conference rooms, the number of target devices may be large and the density may be high. In this case, the description information of the target devices may be displayed in multiple pages in the window.
对此，本实施例在传屏设备的无线通信芯片接收目标数据帧时，可确定目标数据帧的信号强度，按照信号强度降序的方式、对目标设备的描述信息进行排序，从而确定描述信息的顺序，按照顺序显示描述信息，即信号强度越强，描述信息的顺序越前，反之，信号强度越弱，描述信息的顺序越后。In this regard, in this embodiment, when the wireless communication chip of the screen transmission device receives the target data frame, the signal strength of the target data frame can be determined, and the description information of the target device can be sorted in descending order of signal strength, thereby determining the location of the description information. Order, display the description information in order, that is, the stronger the signal strength, the earlier the order of the description information, and conversely, the weaker the signal strength, the later the order of the description information.
例如，如图3B所示，若源设备、传屏设备位于501室中，501室中的目标设备信号强度最大，则将501室中的目标设备的信息排序在最前。For example, as shown in Figure 3B, if the source device and the screen transmission device are located in room 501, and the signal strength of the target device in room 501 is the highest, then the information of the target device in room 501 is sorted first.
一般而言，目标设备越靠近传屏设备、目标设备与传屏设备之间的阻碍物越少，传屏设备所接收到的目标数据帧的强度越高，因此，本实施例通过对信号强度降序的方式对描述信息进行排序，优先显示信号强度较强的目标设备，尤其是在同一个室内环境的目标设备，提高用户在首页选中待传屏的目标设备的几率，减少翻页等操作，从而提高选中待传屏的目标设备的效率。Generally speaking, the closer the target device is to the screen transmission device and the fewer obstacles between the target device and the screen transmission device, the higher the intensity of the target data frame received by the screen transmission device. Therefore, in this embodiment, the signal strength is measured Sort the description information in descending order, giving priority to displaying target devices with stronger signal strength, especially target devices in the same indoor environment, increasing the probability of users selecting the target device to be screened on the homepage, and reducing page turning and other operations. This improves the efficiency of selecting the target device to be screen-transmitted.
此外，源设备中窗口的面积较小，对此，本实施例中，描述信息包括两个字段，一个字段的内容为第一信息，为优先显示的内容，另一个字段的内容为第二信息，为选择显示的内容。In addition, the area of the window in the source device is small. In this embodiment, the description information includes two fields. The content of one field is the first information, which is the content to be displayed first, and the content of the other field is the second information. , to select the displayed content.
需要说明的是，第一信息、第二信息可以根据实际情况设置，例如，第一信息为目标设备所处会议室的地址简称、第二信息为目标设备所处会议室的详细地址，或者，第一信息为目标设备的地址与设备类型，第二信息为目标信息的编号，等等，本实施例对此不加以限制。It should be noted that the first information and the second information can be set according to the actual situation. For example, the first information is the abbreviation of the address of the conference room where the target device is located, and the second information is the detailed address of the conference room where the target device is located, or, The first information is the address and device type of the target device, the second information is the number of the target information, and so on, which is not limited in this embodiment.
在具体实现中，可以在窗口显示第一信息，用户可视，与此同时，第二信息处于隐藏状态，用户不可视。In a specific implementation, the first information can be displayed in the window and visible to the user, while at the same time, the second information is hidden and invisible to the user.
接收作用于第一信息的确认操作，如鼠标的悬停(hover)操作、触摸的重按操作，等等，此时，可响应于该确认操作，在第一信息的上层等位置，显示第一信息关联的第二信息。Receive a confirmation operation that acts on the first information, such as a mouse hover operation, a touch re-click operation, etc. At this time, in response to the confirmation operation, the third information can be displayed on the upper level of the first information. The first information is associated with the second information.
例如，如图3C所示，某个目标设备的描述信息中，第一信息为“大会议室”，第二信息为“中国X公司办事处天河区五山路实验楼A-1栋507”，在显示时，第二排第三个显示区域中显示该目标设备的第一信息“大会议室”，如果用户认为“大会议室”不够明确是哪个目标设备，则可以将鼠标在该悬停在该显示区域中，此时，加载悬浮的窗口，在该窗口中显示第二信息“中国X公司办事处天河区五山路实验楼A-1栋507”，以供用户浏览。For example, as shown in Figure 3C, in the description information of a certain target device, the first information is "Large Conference Room", and the second information is "No. 507, Building A-1, Experimental Building, Wushan Road, Tianhe District, Office of Company X, China". When displayed, the first information of the target device "Large Conference Room" is displayed in the third display area of the second row. If the user thinks that "Large Conference Room" is not clear enough about which target device it is, the user can hover the mouse over the target device. In this display area, at this time, a suspended window is loaded, and the second information "No. 507, Building A-1, Experimental Building, Wushan Road, Tianhe District, Office of China X Company" is displayed in the window for the user to browse.
本实施例通过优先显示第一信息、选择显示第二信息，实现分层的显示机制，可以减少优先显示的数据量，在窗口的页面中增加显示的描述信息的数量，从而提高用户在一页选中待传屏的目标设备的几率，减少翻页等操作，从而提高选中待传屏的目标设备的效率。This embodiment implements a hierarchical display mechanism by preferentially displaying the first information and selectively displaying the second information, which can reduce the amount of data displayed with priority and increase the amount of displayed description information in the page of the window, thereby improving the user's ability to read on one page. The probability of selecting the target device to be screen-transferred reduces operations such as page turning, thereby improving the efficiency of selecting the target device to be screen-transferred.
实施例二Embodiment 2
图4为本发明实施例二提供的一种传屏方法的流程图，本实施例以前述实施例为基础，进一步增加连接目标设备、并执行传屏操作的处理操作，该方法具体包括如下步骤：Figure 4 is a flow chart of a screen sharing method provided in Embodiment 2 of the present invention. This embodiment is based on the previous embodiment and further adds a processing operation of connecting a target device and performing a screen sharing operation. The method specifically includes the following steps :
S401、确定接入源设备。S401. Determine the access source device.
S402、接收目标设备基于无线接入点所广播的目标数据帧。S402. Receive the target data frame broadcast by the target device based on the wireless access point.
其中，目标设备用于通过传屏设备、与源设备执行传屏操作，从而显示源设备的媒体数据。The target device is used to perform a screen sharing operation with the source device through the screen sharing device, thereby displaying the media data of the source device.
S403、从目标数据帧中读取目标设备的设备信息。S403. Read the device information of the target device from the target data frame.
其中，设备信息包括描述信息和网络参数。Among them, device information includes description information and network parameters.
S404、显示目标设备的描述信息。S404. Display the description information of the target device.
S405、接收作用于描述信息的选定操作。S405. Receive the selected operation that acts on the description information.
在具体实现中，用户根据描述信息，选择待传屏的目标设备，如处于同一个室内环境的目标设备，此时，可以根据源设备提供的交互方式针对某个描述信息触发选定操作。In a specific implementation, the user selects the target device to be screen-transmitted based on the description information, such as a target device in the same indoor environment. At this time, the selection operation can be triggered based on a certain description information based on the interaction method provided by the source device.
例如，源设备提供鼠标的交互方式，则可以在描述信息上点击鼠标左键，使得描述信息处于选定状态，再用鼠标左键点击表示确定的按键，此时，针对处于选定操作的描述信息触发选定操作。For example, if the source device provides a mouse interaction method, you can click the left mouse button on the description information to make the description information in the selected state, and then click the button indicating confirmation with the left mouse button. At this time, for the description in the selected operation Information triggers selected actions.
如图3D所示，用户点击第一排第一个显示区域，此时，可在该显示区域显示高亮的背景、带勾的图标等信息，提示用户该显示区域中描述信息表示目标设备处于选定状态，若用户继续点击标识“连接”的控件，则可以确定针对该该显示区域中的描述信息触发选定状态，待连接该描述信息表示的目标设备。As shown in Figure 3D, the user clicks on the first display area in the first row. At this time, highlighted background, ticked icons and other information can be displayed in the display area, prompting the user that the description information in the display area indicates that the target device is in In the selected state, if the user continues to click on the control labeled "Connect", it can be determined that the selected state is triggered for the description information in the display area, and the target device represented by the description information is to be connected.
又例如，源设备提供触控的交互方式，则可以在描述信息上触发单击的触控操作，使得描述信息处于选定状态，再点击表示确定的按键，此时，针对处于选定操作的描述信息触发选定操作。For another example, if the source device provides a touch interaction method, you can trigger a click touch operation on the description information, so that the description information is in the selected state, and then click the button indicating confirmation. At this time, for the selected operation Description information triggers the selected action.
S406、响应于选定操作，根据描述信息对应的网络参数接入描述信息所属目标设备设置的无线接入点。S406. In response to the selection operation, access the wireless access point set by the target device to which the description information belongs according to the network parameters corresponding to the description information.
在本实施例中，设备信息除了描述信息之外，还包括网络参数，该网络参数用于登入目标设备。In this embodiment, in addition to the description information, the device information also includes network parameters, which are used to log in to the target device.
对于使用传屏设备登入目标设备的方式而言，该网络参数包括无线接入点的SSID(Service Set Identifier，服务集标识)、密码、IP(Internet Protocol，网络之间互连的协议)地址和端口。For the method of using a screen sharing device to log in to the target device, the network parameters include the SSID (Service Set Identifier, Service Set Identifier) of the wireless access point, password, IP (Internet Protocol, protocol for interconnection between networks) address and port.
传屏客户端使用SSID和密码连接到目标设备的无线接入点，再通过IP地址和端口连接到传屏服务端。The screen sharing client uses the SSID and password to connect to the wireless access point of the target device, and then connects to the screen sharing server through the IP address and port.
S407、获取在源设备中产生的媒体数据。S407. Obtain media data generated in the source device.
S408、将媒体数据发送给目标设备进行播放。S408. Send the media data to the target device for playback.
在本发明实施例中，用户可以在源设备播放PPT、PDF(Portable DocumentFormat，便携式文档格式)、word等文档数据，也可以播放视频数据、音频数据等多媒体数据，与此同时，传屏客户端可通过GDI、mirror、ddraw和dxgi等方式进行截屏操作，获取截屏操作的屏幕数据作为媒体数据，并通过传输接口(如USB接口)发送至传屏设备。In the embodiment of the present invention, the user can play document data such as PPT, PDF (Portable Document Format, Word) on the source device, and can also play multimedia data such as video data, audio data, etc. At the same time, the screen transfer client Screen capture operations can be performed through GDI, mirror, ddraw, and dxgi. The screen data of the screenshot operation can be obtained as media data and sent to the screen transfer device through a transmission interface (such as a USB interface).
传屏设备通过无线连接(如Wi-Fi连接)将媒体数据发送给目标设备，目标设备将该媒体数据中的界面数据显示在屏幕上、调用扬声器播放音频数据。The screen transmission device sends the media data to the target device through a wireless connection (such as a Wi-Fi connection). The target device displays the interface data in the media data on the screen and calls the speaker to play the audio data.
进一步而言，设备信息除了描述信息、网络参数之外，还包括还包括校验码，该校验码一般具有时效性，在某台传屏设备登入无线接入点成功之后失效，目标设备重新生成。Furthermore, in addition to description information and network parameters, the device information also includes a check code. This check code is generally time-sensitive and will become invalid after a screen-sharing device successfully logs into the wireless access point, and the target device will re-enter. generate.
在S408中，传屏客户端将校验码与媒体数据一同发送给目标设备，目标设备用于在校验校验码成功时，允许播放媒体数据，在校验校验码失败时，禁止播放媒体数据。In S408, the screen transfer client sends the verification code together with the media data to the target device. The target device is used to allow the media data to be played when the verification code is successfully verified, and to prohibit playback when the verification code fails to be verified. media data.
由于目标设备的网络参数较为稳定，在不同源设备、传屏设备接入并执行投屏操作时，容易发生泄漏，从而提高目标设备被造成恶意传屏的风险，在本实施例中，在网络参数的基础上，通过校验校验码允许或禁止播放媒体数据，可以降低目标设备被造成恶意传屏的风险，提高目标设备的安全性。Since the network parameters of the target device are relatively stable, leakage may easily occur when different source devices and screen sharing devices are connected and perform screencasting operations, thereby increasing the risk of malicious screencasting on the target device. In this embodiment, in the network Based on the parameters, allowing or prohibiting the playback of media data by verifying the check code can reduce the risk of malicious screen sharing on the target device and improve the security of the target device.
在本实施例中，一方面，确定接入源设备，接收目标设备基于无线接入点所广播的目标数据帧，从目标数据帧中读取目标设备的设备信息，设备信息包括描述信息，显示目标设备的描述信息，目标设备广播目标数据帧、传屏设备接收目标数据帧，对其进行解析并在源设备进行显示，这些均是用户无感知的操作，用户在源设备处即可浏览到周围各个目标设备的情况，方便用户选择所需传屏的目标设备，另一方面，若接收到作用于描述信息的选定操作，则可以响应于选定操作，根据描述信息对应的网络参数、通过传屏设备接入描述信息所属目标设备设置的无线接入点，从而将在源设备中产生的媒体数据发送给目标设备进行播放，在目标设备广播的目标数据帧携带网络参数，使得传屏设备可以在解析目标数据帧之后，使用该网络参数登入目标设备设置的无线接入点，这个操作也是用户无感知的操作，无需用户走到目标设备处插入传屏设备进行配对，拔出传屏设备并接入源设备，大大提高了连接目标设备的简便性，从而提高了传屏操作的效率。In this embodiment, on the one hand, the access source device is determined, the target device is received based on the target data frame broadcast by the wireless access point, and the device information of the target device is read from the target data frame. The device information includes description information, and the display The description information of the target device, the target device broadcasts the target data frame, the screen transmission device receives the target data frame, parses it and displays it on the source device. These are all operations that the user is unaware of and can be browsed by the user at the source device. The situation of each surrounding target device facilitates the user to select the target device for screen transmission. On the other hand, if a selection operation acting on the description information is received, the user can respond to the selection operation according to the network parameters corresponding to the description information, The screen transfer device accesses the wireless access point set by the target device to which the description information belongs, thereby sending the media data generated in the source device to the target device for playback. The target data frame broadcast by the target device carries network parameters, so that the screen transfer device After parsing the target data frame, the device can use the network parameters to log in to the wireless access point set by the target device. This operation is also user-insensitive and does not require the user to go to the target device, insert the screen transmission device for pairing, and unplug the screen transmission device. device and access the source device, which greatly improves the simplicity of connecting to the target device, thus improving the efficiency of screen transfer operations.
实施例三Embodiment 3
图5为本发明实施例三提供的一种传屏方法的流程图，本实施例可适用于目标设备广播目标数据帧，源设备通过解析目标数据帧自动发现目标设备的情况，该方法可以由传屏装置来执行，该传屏装置可以由软件和/或硬件实现，可配置在电子设备中，例如，目标设备，该方法具体包括如下步骤：Figure 5 is a flow chart of a screen transmission method provided in Embodiment 3 of the present invention. This embodiment can be applied to the situation where the target device broadcasts the target data frame and the source device automatically discovers the target device by parsing the target data frame. This method can be performed by The screen sharing device can be implemented by software and/or hardware, and can be configured in an electronic device, such as a target device. The method specifically includes the following steps:
S501、开启无线接入点。S501. Turn on the wireless access point.
S502、基于无线接入点广播目标数据帧，以使目标数据帧被传屏设备接收。S502. Broadcast the target data frame based on the wireless access point, so that the target data frame is received by the screen transmission device.
在本实施例中，目标设备可以启动无线通信芯片(如Wi-Fi网卡)，开启无线接入点，并定期对外广播目标数据帧，等待接入传屏设备，该传屏设备接入源设备。In this embodiment, the target device can activate the wireless communication chip (such as Wi-Fi network card), turn on the wireless access point, and regularly broadcast the target data frame to the outside world, waiting for access to the screen transmission device, and the screen transmission device is connected to the source device .
其中，定期对外广播目标数据帧的周期一般为100ms。Among them, the period for regularly broadcasting target data frames to the outside world is generally 100ms.
在具体实现中，目标设备的操作系统包括Android、windows等等，启动无线接入点的方式也有所不同，例如，若目标设备的操作系统为windows，则可以运行命令：netsh wlanset hostednetwork mode＝allow ssid＝wuminPC key＝wuminWiFi，其中，mode为是否启用虚拟WiFi网卡，ssid表示无线接入点的名称，key表示密码，等等，本实施例对此不加以限制。In the specific implementation, the operating system of the target device includes Android, Windows, etc., and the method of starting the wireless access point is also different. For example, if the operating system of the target device is Windows, you can run the command: netsh wlanset hostednetwork mode=allow ssid=wuminPC key=wuminWiFi, where mode indicates whether to enable the virtual WiFi network card, ssid indicates the name of the wireless access point, key indicates the password, etc. This embodiment does not limit this.
在本实施例中，目标数据帧包括目标设备的设备信息，设备信息包括描述信息。In this embodiment, the target data frame includes device information of the target device, and the device information includes description information.
描述信息用于显示在源设备中，传屏设备用于在源设备与目标设备之间执行传屏操作，使得目标设备播放源设备的媒体数据。The description information is used to display in the source device, and the screen transfer device is used to perform a screen transfer operation between the source device and the target device, so that the target device plays the media data of the source device.
具体而言，目标数据帧中的第一位置为传屏标识，传屏标识用于标识支持传屏操作的设备。Specifically, the first position in the target data frame is a screen sharing identifier, and the screen sharing identifier is used to identify a device that supports screen sharing operations.
传屏客户端可从数据帧中的第一位置读取第一数据，将第一数据与预设的传屏标识相同进行比较，若第一数据与投屏标识相同，则确定数据帧为目标设备基于无线接入点广播的目标数据帧。The screencasting client can read the first data from the first position in the data frame, compare the first data with the preset screencasting identifier, and determine that the data frame is the target if the first data is the same as the screencasting identifier. The device is based on the target data frame broadcast by the wireless access point.
其次，目标数据帧中的第而位置为设备信息，传屏客户端可从目标数据帧中的第二位置读取第二数据，从第二数据进行解析(如使用对称密钥函数进行解密)，获得目标设备的设备信息。Secondly, the second position in the target data frame is device information. The screen transfer client can read the second data from the second position in the target data frame and parse from the second data (such as using a symmetric key function to decrypt) , obtain the device information of the target device.
再者，目标数据帧具有信号强度，传屏客户端可确定目标数据帧的信号强度，按照信号强度降序的方式、对目标设备的描述信息进行排序，从而确定描述信息的顺序，按照该顺序显示描述信息。Furthermore, the target data frame has signal strength. The screen transfer client can determine the signal strength of the target data frame, sort the description information of the target device in descending order of signal strength, thereby determining the order of the description information, and display it in this order. Description.
此外，描述信息包括第一信息与第二信息，传屏客户端可显示第一信息，接收作用于第一信息的确认操作，响应于确认操作，显示第一信息关联的第二信息。In addition, the description information includes first information and second information. The screen sharing client can display the first information, receive a confirmation operation on the first information, and in response to the confirmation operation, display the second information associated with the first information.
在本实施例中，由于实施例三与实施例一的应用基本相似，所以描述的比较简单，相关之处参见实施例一的部分说明即可，本实施例在此不加以详述。In this embodiment, since the applications of Embodiment 3 are basically similar to Embodiment 1, the description is relatively simple. For relevant details, please refer to the partial description of Embodiment 1. This embodiment will not be described in detail here.
在本实施例中，开启无线接入点，基于无线接入点广播目标数据帧，其中，目标数据帧包括目标设备的设备信息，设备信息包括描述信息，描述信息用于显示在源设备中，传屏设备用于在源设备与目标设备之间执行传屏操作，使得目标设备显示源设备的媒体数据，目标设备广播目标数据帧、传屏设备接收目标数据帧，对其进行解析并在源设备进行显示，这些均是用户无感知的操作，用户在源设备处即可浏览到周围各个目标设备的情况，方便用户选择所需传屏的目标设备，从而提高了传屏操作的效率。In this embodiment, the wireless access point is turned on and the target data frame is broadcast based on the wireless access point, where the target data frame includes device information of the target device, the device information includes description information, and the description information is used to display in the source device, The screen transfer device is used to perform screen transfer operations between the source device and the target device, so that the target device displays the media data of the source device. The target device broadcasts the target data frame. The screen transfer device receives the target data frame, parses it and displays it on the source device. These are all operations that the user is unaware of. The user can browse the surrounding target devices at the source device, which facilitates the user to select the target device to which the screen needs to be transferred, thus improving the efficiency of the screen transfer operation.
实施例四Embodiment 4
图6为本发明实施例四提供的一种传屏方法的流程图，本实施例以前述实施例为基础，进一步增加连接目标设备、并执行传屏操作的处理操作，该方法具体包括如下步骤：Figure 6 is a flow chart of a screen sharing method provided in Embodiment 4 of the present invention. This embodiment is based on the previous embodiment and further adds a processing operation of connecting the target device and performing the screen sharing operation. The method specifically includes the following steps :
S601、开启无线接入点。S601. Turn on the wireless access point.
S602、获取目标设备的设备信息，以使目标数据帧被传屏设备接收。S602. Obtain the device information of the target device so that the target data frame is received by the screen transmission device.
在本实施例中，设备信息包括描述信息、网络参数、校验码中的至少一者。In this embodiment, the device information includes at least one of description information, network parameters, and verification codes.
其中，描述信息、网络参数可以为用户配置的信息，预先存储在目标设备的数据库中，传屏服务端可从该数据库读取描述信息、网络参数。Among them, the description information and network parameters can be user-configured information and are stored in the database of the target device in advance. The screen sharing server can read the description information and network parameters from the database.
进一步而言，对于使用传屏设备登入目标设备的方式而言，该网络参数包括无线接入点的SSID、密码、IP地址和端口。Furthermore, for the method of logging in to the target device using a screen sharing device, the network parameters include the SSID, password, IP address and port of the wireless access point.
对于校验码是通过随机等方式实时生成的信息，对一次传屏操作有效，需要说明的是，在一次传屏操作中，目标设备可以接入一个传屏设备或源设备，也可以同时接入两个或两个以上的传屏设备或源设备，即该校验码可以为一个传屏设备或源设备使用，也可以为两个或两个以上的传屏设备或源设备使用，本实施例对此不加以限制。The check code is information generated in real time through random methods, and is valid for a screen transmission operation. It should be noted that in a screen transmission operation, the target device can be connected to a screen transmission device or a source device, or it can be connected to a screen transmission device at the same time. Enter two or more screen transmission devices or source devices, that is, the check code can be used for one screen transmission device or source device, or for two or more screen transmission devices or source devices. This code The embodiments are not limiting in this regard.
目标设备获取设备信息的各项参数之后，可将各项参数按照规定组合为结构化的设备信息。After the target device obtains various parameters of the device information, the parameters can be combined into structured device information according to regulations.
S603、将预设的传屏标识与设备信息封装至一数据帧中，作为目标数据帧。S603. Encapsulate the preset screen transmission identifier and device information into a data frame as a target data frame.
在本实施例中，目标设备可以按照无线传播协议(如Wi-Fi协议)封装数据帧，并且，该数据帧中可具有可设置自定义数据的区域，在该区域的第一位置写入传屏标识、在该区域第二位置写入设备信息。In this embodiment, the target device can encapsulate the data frame according to a wireless propagation protocol (such as Wi-Fi protocol), and the data frame can have an area where custom data can be set, and the data frame can be written in the first position of the area. Screen logo, write device information in the second position of this area.
一般而言，若将传屏标识写在前，设备信息写在后，可将传屏标识称之为前缀。Generally speaking, if the screen transmission logo is written first and the device information is written at the end, the screen transmission logo can be called a prefix.
以Wi-Fi协议中的Beacon帧作为数据帧的示例，按照Wi-Fi协议，Beacon帧包含如下信息：Take the Beacon frame in the Wi-Fi protocol as an example of a data frame. According to the Wi-Fi protocol, the Beacon frame contains the following information:
SSID、MAC地址、信道、通信速率、加密方式。SSID, MAC address, channel, communication rate, encryption method.
上述信息可用于建议Wi-Fi链接，除了上述信息之外，Beacon帧还具有可选的部分，长度为255个字节，可自定义数据。The above information can be used to suggest Wi-Fi links. In addition to the above information, the Beacon frame also has an optional part with a length of 255 bytes for customizable data.
在本示例中，可对Wi-Fi的Beacon帧进行延伸，即兼容Wi-Fi协议、不改变上述信息的前提下，将传屏标识与设备信息写入该部分中，从而实现设备信息的广播。In this example, the Wi-Fi Beacon frame can be extended, that is, while being compatible with the Wi-Fi protocol and without changing the above information, the screen transmission identification and device information can be written into this part to realize the broadcast of device information. .
一般每个Wi-Fi的无线接入点会定期广播Wi-Fi的Beacon帧，供电脑、手机等设备发现，然后输入密码连接到该Wi-Fi的无线接入点下，本示例通过Wi-Fi的Beacon帧广播目标设备的设备信息，可以兼容众多设备，实用性强。Generally, each Wi-Fi wireless access point will regularly broadcast Wi-Fi Beacon frames for computers, mobile phones and other devices to discover, and then enter the password to connect to the Wi-Fi wireless access point. This example uses Wi-Fi Fi's Beacon frame broadcasts the device information of the target device, is compatible with many devices, and is highly practical.
当然，上述Wi-Fi的Beacon只是作为示例，在实施本实施例时，可以根据实际情况设置其他广播目标数据帧的方式，例如，蓝牙的BLE(Bluetooth Low Energy，蓝牙低功耗)、Wi-Fi的P2P，等等，本实施例对此不加以限制。另外，除了上述广播目标数据帧的方式外，本领域技术人员还可以根据实际需要采用其它广播目标数据帧的方式，本实施例对此也不加以限制。Of course, the above-mentioned Wi-Fi Beacon is only used as an example. When implementing this embodiment, other methods of broadcasting target data frames can be set according to the actual situation, for example, Bluetooth BLE (Bluetooth Low Energy), Wi-Fi Fi's P2P, etc., this embodiment does not limit this. In addition, in addition to the above method of broadcasting the target data frame, those skilled in the art may also use other methods of broadcasting the target data frame according to actual needs, and this embodiment is not limited thereto.
进一步而言，为了保证设备信息的安全性，目标设备可以预先设置密钥，将设备信息转换为二进制的数据，使用传屏协议规定的对称密钥算法，对该二进制的数据进行加密，获得相应的密文，再将密文写入数据帧中。Furthermore, in order to ensure the security of device information, the target device can pre-set a key, convert the device information into binary data, and use the symmetric key algorithm specified in the screen transfer protocol to encrypt the binary data and obtain the corresponding ciphertext, and then write the ciphertext into the data frame.
S604、基于无线接入点广播目标数据帧。S604. Broadcast the target data frame based on the wireless access point.
其中，目标数据帧包括目标设备的设备信息，设备信息包括描述信息，描述信息用于显示在源设备中，传屏设备用于在源设备与目标设备之间执行传屏操作，使得目标设备显示源设备的媒体数据。Among them, the target data frame includes device information of the target device. The device information includes description information. The description information is used to display in the source device. The screen transfer device is used to perform screen transfer operations between the source device and the target device so that the target device displays Media data from the source device.
S605、在描述信息被选定时，根据网络参数、基于无线接入点接入传屏设备。S605. When the description information is selected, access the screen sharing device based on the network parameters and the wireless access point.
在本实施例中，可接收传屏客户端通过传屏设备发送的、被选定的描述信息所对应的网络参数，以及，在校验传屏客户端发送的网络参数成功时，基于无线接入点接入传屏设备。In this embodiment, the network parameters corresponding to the selected description information sent by the screen sharing client through the screen sharing device can be received, and when the network parameters sent by the screen sharing client are successfully verified, based on the wireless connection The entry point connects to the screen transmission device.
在具体实现中，传屏客户端接收到作用于描述信息的选定操作时，响应于选定操作，根据描述信息对应的网络参数、通过传屏设备接入描述信息所属目标设备设置的无线接入点。In a specific implementation, when the screen sharing client receives a selected operation that acts on the description information, in response to the selection operation, according to the network parameters corresponding to the description information, the screen sharing device accesses the wireless interface set by the target device to which the description information belongs. entry point.
进一步而言，传屏客户端使用SSID和密码连接到目标设备的无线接入点，再通过IP地址和端口连接到传屏服务端。Furthermore, the screen sharing client uses the SSID and password to connect to the wireless access point of the target device, and then connects to the screen sharing server through the IP address and port.
S606、接收所述传屏设备发送的、在所述源设备中产生的媒体数据。S606. Receive media data generated in the source device and sent by the screen sharing device.
S607、播放媒体数据。S607. Play media data.
在本实施例中，可接收传屏客户端通过传屏设备发送的、在源设备中产生的媒体数据。In this embodiment, the media data generated in the source device and sent by the screen sharing client through the screen sharing device can be received.
在具体实现中，传屏客户端获取在源设备中产生的媒体数据，通过通过传输接口(如USB接口)发送至传屏设备，传屏设备通过无线连接(如Wi-Fi连接)将媒体数据发送给目标设备，目标设备将该媒体数据中的界面数据显示在屏幕上、并调用扬声器播放该媒体数据中的音频数据。In the specific implementation, the screen sharing client obtains the media data generated in the source device and sends it to the screen sharing device through a transmission interface (such as a USB interface). The screen sharing device transmits the media data through a wireless connection (such as a Wi-Fi connection). Sent to the target device, the target device displays the interface data in the media data on the screen and calls the speaker to play the audio data in the media data.
进一步而言，设备信息除了描述信息、网络参数之外，还包括还包括校验码，Furthermore, in addition to description information and network parameters, device information also includes check codes.
传屏客户端将校验码与媒体数据一同发送给目标设备，则目标设备可接收传屏客户端通过传屏设备发送的校验码。The screen sharing client sends the verification code together with the media data to the target device, and the target device can receive the verification code sent by the screen sharing client through the screen sharing device.
在验证传屏客户端发送的校验码成功(即传屏客户端发送的校验码与目标设备本地的校验码相同)时，允许显示媒体数据。When the verification code sent by the screen sharing client is successful (that is, the verification code sent by the screen sharing client is the same as the local verification code of the target device), the media data is allowed to be displayed.
在验证传屏客户端发送的校验码失败(即传屏客户端发送的校验码与目标设备本地的校验码不同)时，禁止显示媒体数据。When the verification code sent by the screen sharing client fails (that is, the verification code sent by the screen sharing client is different from the local verification code of the target device), the display of media data is prohibited.
在一种情况中，目标设备为了节省电量，可维持息屏状态，在检测到传屏操作时，唤醒设备。In one case, in order to save power, the target device can maintain the screen-off state and wake up the device when detecting a screen transfer operation.
需要说明的是，对于Windows、Android等操作系统，可以使用操作系统提供的原生函数进行息屏、休眠，例如，在Android中，上层可以使用goToSleep()函数让操作系统进入息屏、休眠。It should be noted that for operating systems such as Windows and Android, you can use the native functions provided by the operating system to pause the screen and sleep. For example, in Android, the upper layer can use the goToSleep() function to allow the operating system to pause the screen and sleep.
当然，除了原生函数之外，若目标设备的屏幕背光关闭，也可以算是息屏、休眠，本实施例对此不加以限制。Of course, in addition to the native functions, if the screen backlight of the target device is turned off, it can also be regarded as turning off the screen or sleeping, and this embodiment does not limit this.
在本实施例中，由于实施例四与实施例二的应用基本相似，所以描述的比较简单，相关之处参见实施例二的部分说明即可，本实施例在此不加以详述。In this embodiment, since the applications of Embodiment 4 and Embodiment 2 are basically similar, the description is relatively simple. For relevant details, please refer to the partial description of Embodiment 2. This embodiment will not be described in detail here.
在本实施例中，接收传屏客户端通过传屏设备发送的、被选定的描述信息所对应的网络参数，在校验传屏客户端发送的网络参数成功时，基于无线接入点接入传屏设备，在目标设备广播的目标数据帧携带网络参数，使得传屏设备可以在解析目标数据帧之后，使用该网络参数登入目标设备设置的无线接入点，这个操作是用户无感知的操作，无需用户走到目标设备处插入传屏设备进行配对，拔出传屏设备并接入源设备，大大提高了连接目标设备的简便性，从而提高了传屏操作的效率。In this embodiment, the network parameters corresponding to the selected description information sent by the screen sharing client through the screen sharing device are received. When the verification of the network parameters sent by the screen sharing client is successful, based on the wireless access point connection Incoming screen device, the target data frame broadcast by the target device carries network parameters, so that the screen device can use the network parameters to log in to the wireless access point set by the target device after parsing the target data frame. This operation is imperceptible to the user. Operation does not require the user to go to the target device, insert the screen transmission device for pairing, unplug the screen transmission device and connect to the source device, which greatly improves the simplicity of connecting to the target device, thereby improving the efficiency of screen transmission operations.
实施例五Embodiment 5
图7为本发明实施例五提供的一种传屏方法的流程图，本实施例可适用于目标设备广播目标数据帧，源设备通过解析目标数据帧自动发现目标设备的情况，该方法可以由源设备、目标设备来执行，源设备、目标设备可以由软件和/或硬件实现。Figure 7 is a flow chart of a screen transmission method provided in Embodiment 5 of the present invention. This embodiment can be applied to the situation where the target device broadcasts the target data frame and the source device automatically discovers the target device by parsing the target data frame. This method can be performed by The source device and the target device are executed, and the source device and the target device can be implemented by software and/or hardware.
在一种情况中，源设备接入传屏设备，此时，传屏客户端通过传屏设备连接目标设备并执行传屏操作。In one case, the source device is connected to the screen sharing device. At this time, the screen sharing client connects to the target device through the screen sharing device and performs the screen sharing operation.
在另一种情况中，源设备未接入传屏设备，此时，传屏客户端通过局域网连接目标设备并执行传屏操作。In another situation, the source device is not connected to the screen sharing device. At this time, the screen sharing client connects to the target device through the LAN and performs the screen sharing operation.
如图7所示，该方法具体包括如下步骤：As shown in Figure 7, the method specifically includes the following steps:
S701、目标设备基于无线接入点广播目标数据帧。S701. The target device broadcasts the target data frame based on the wireless access point.
在具体实现中，目标设备可获取设备信息，设备信息包括描述信息、网络参数、校验码中的至少一者；In a specific implementation, the target device can obtain device information, and the device information includes at least one of description information, network parameters, and verification codes;
将预设的传屏标识与设备信息封装至一数据帧中，作为目标数据帧。Encapsulate the preset screen transmission identifier and device information into a data frame as the target data frame.
进一步而言，对于源设备接入传屏设备的情况，网络参数包括SSID、密码、IP地址和端口。Furthermore, for the case where the source device is connected to the screen transmission device, the network parameters include SSID, password, IP address and port.
对于源设备未接入传屏设备的情况，网络参数包括所处局域网的IP地址、子网掩码、端口。For the case where the source device is not connected to the screen transmission device, the network parameters include the IP address, subnet mask, and port of the local area network.
S702、源设备接收目标设备所广播的目标数据帧。S702. The source device receives the target data frame broadcast by the target device.
在本实施例中，原设备接收数据帧；从数据帧中的第一位置读取第一数据；将第一数据与预设的传屏标识相同进行比较，该传屏标识用于标识支持传屏操作的设备；若第一数据与投屏标识相同，则确定该数据帧为目标设备基于无线接入点广播的目标数据帧。In this embodiment, the original device receives the data frame; reads the first data from the first position in the data frame; and compares the first data with the preset screen transfer identification, which is used to identify that the transmission is supported. device that operates the screen; if the first data is the same as the screen projection identifier, it is determined that the data frame is a target data frame broadcast by the target device based on the wireless access point.
进一步而言，对于源设备接入传屏设备的情况，源设备中的传屏客户端可通过传屏设备中的无线通信芯片(如Wi-Fi网卡)接收数据帧。Furthermore, when the source device is connected to the screen sharing device, the screen sharing client in the source device can receive the data frame through the wireless communication chip (such as a Wi-Fi network card) in the screen sharing device.
对于源设备未接入传屏设备的情况，源设备中的传屏客户端可通过源设备中中的无线通信芯片(如Wi-Fi网卡)接收数据帧。If the source device is not connected to the screen transmission device, the screen transmission client in the source device can receive the data frame through the wireless communication chip (such as a Wi-Fi network card) in the source device.
S703、源设备显示目标数据帧中、目标设备的描述信息。S703. The source device displays the description information of the target device in the target data frame.
在本实施例中，源设备可以从目标数据帧中读取目标设备的设备信息，该设备信息包括描述信息，并显示目标设备的描述信息。In this embodiment, the source device can read the device information of the target device from the target data frame, where the device information includes description information, and display the description information of the target device.
在具体实现中，可从目标数据帧中的第二位置读取第二数据，从第二数据进行解析，获得目标设备的设备信息。In a specific implementation, the second data can be read from the second position in the target data frame, and the second data can be parsed to obtain the device information of the target device.
进一步而言，对于源设备接入传屏设备的情况，密钥存储在传屏设备中，源设备中的传屏客户端可从传屏设备中读取密钥，并使用相应的对称密钥算法对该第二数据进行解密，获得目标设备的设备信息。Furthermore, for the case where the source device is connected to the screen sharing device, the key is stored in the screen sharing device, and the screen sharing client in the source device can read the key from the screen sharing device and use the corresponding symmetric key The algorithm decrypts the second data to obtain device information of the target device.
对于源设备未接入传屏设备的情况，密钥存储在源设备中，源设备中的传屏客户端可从本地读取密钥，并使用相应的对称密钥算法对该第二数据进行解密，获得目标设备的设备信息。For the situation where the source device is not connected to the screen sharing device, the key is stored in the source device, and the screen sharing client in the source device can read the key locally and use the corresponding symmetric key algorithm to process the second data. Decrypt to obtain the device information of the target device.
在一种情况中，可确定目标数据帧的信号强度；按照信号强度降序的方式、对目标设备的描述信息进行排序，从而确定描述信息的顺序；按照该顺序显示描述信息。In one case, the signal strength of the target data frame can be determined; the description information of the target device is sorted in descending order of signal strength to determine the order of the description information; and the description information is displayed in this order.
在另一种情况中，描述信息包括第一信息与第二信息；则可以显示第一信息；接收作用于第一信息的确认操作；响应于确认操作，显示第一信息关联的第二信息。In another case, the description information includes first information and second information; then the first information can be displayed; a confirmation operation on the first information is received; and in response to the confirmation operation, the second information associated with the first information is displayed.
S704、源设备在接收到作用于描述信息的选定操作时，根据目标数据帧的网络参数接入描述信息所属目标设备。S704. When the source device receives the selected operation acting on the description information, it accesses the target device to which the description information belongs according to the network parameters of the target data frame.
对于源设备接入传屏设备的情况，源设备中的传屏客户端通过传屏设备、使用SSID和密码连接到目标设备的无线接入点，再通过IP地址和端口连接到传屏服务端。For the situation where the source device is connected to the screen sharing device, the screen sharing client in the source device connects to the wireless access point of the target device through the screen sharing device and uses the SSID and password, and then connects to the screen sharing server through the IP address and port. .
对于源设备未接入传屏设备的情况，源设备中的传屏客户端通过本地的无线通信芯片(如Wi-Fi网卡)使用局域网的IP地址、子网掩码登入目标设备所处的局域网，再通过端口连接到传屏服务端。If the source device is not connected to the screen sharing device, the screen sharing client in the source device uses the local wireless communication chip (such as Wi-Fi network card) to log in to the LAN where the target device is located using the IP address and subnet mask of the LAN. , and then connect to the screen sharing server through the port.
S705、目标设备播放在源设备中产生的媒体数据。S705. The target device plays the media data generated in the source device.
在本实施例中，传屏客户端获取在源设备中产生的媒体数据，将媒体数据发送给目标设备进行播放。In this embodiment, the screen sharing client obtains the media data generated in the source device and sends the media data to the target device for playback.
对于源设备未接入传屏设备的情况，可以使用传统的协议进行传屏，如RTP(Real-time Transport Protocol，实时传输协议)协议等，也可以使用自定义的私有协议，本实施例对此不加以限制。For the situation where the source device is not connected to the screen transmission device, traditional protocols can be used for screen transmission, such as RTP (Real-time Transport Protocol, Real-time Transport Protocol) protocol, etc., or a custom private protocol can be used. In this embodiment, This is not limited.
进一步地，传屏客户端将校验码与媒体数据发送给目标设备，目标设备用于在校验校验码成功时，允许显示媒体数据，在校验校验码失败时，禁止显示媒体数据。Further, the screen transfer client sends the verification code and media data to the target device. The target device is used to allow the media data to be displayed when the verification code is successfully verified, and to prohibit the display of the media data when the verification code fails to be verified. .
相对而言，目标设备接收传屏客户端发送的、在源设备中产生的媒体数据，以及，播放该媒体数据。In contrast, the target device receives the media data generated in the source device sent by the screen sharing client, and plays the media data.
进一步地，接收传屏客户端发送的校验码，在验证传屏客户端发送的校验码成功时，允许播放媒体数据；在验证传屏客户端发送的校验码失败时，禁止播放媒体数据。Further, receive the check code sent by the screen sharing client, and when the verification code sent by the screen sharing client is successful, the media data is allowed to be played; when the verification code sent by the screen sharing client fails, media playback is prohibited. data.
在一种实施方式中，在目标设备执行传屏操作之前，维持息屏状态，在执行传屏操作时，唤醒设备。In one implementation, before the target device performs the screen sharing operation, the screen is maintained in an idle state, and when the screen sharing operation is performed, the device is awakened.
在本实施例中，由于实施例五与实施例一、二、三、四的应用基本相似，所以描述的比较简单，相关之处参见实施例一、二、三、四的部分说明即可，本实施例在此不加以详述。In this embodiment, since the application of Embodiment 5 is basically similar to that of Embodiments 1, 2, 3, and 4, the description is relatively simple. For relevant details, please refer to the partial description of Embodiments 1, 2, 3, and 4. This embodiment will not be described in detail here.
对于源设备未接入传屏设备的情况，目前可将源设备、目标设备接入在同一局域网中，此时，源设备可通过SSDP(Simple Service Discovery Protocol，简单服务发现协议)、Bonjour(基于组播域名服务(multicast DNS)的开放性零设置网络标准)等协议来发现可传屏的目标设备。For the situation where the source device is not connected to the screen transmission device, the source device and the target device can currently be connected to the same LAN. At this time, the source device can use SSDP (Simple Service Discovery Protocol), Bonjour (based on The openness of the multicast domain name service (multicast DNS) and other protocols (zero-configuration network standards) are used to discover target devices that can transmit the screen.
这种方式，需要源设备与目标设备接入同一局域网，用户需要去目标设备处查询其接入的局域网，并且，在会议室、工作室等较为密集的场所，局域网较多，源设备、目标设备可能会自动切换至其他局域网，引起传屏操作中断，传屏操作较为繁琐，导致传屏操作的效率较低。This method requires the source device and the target device to be connected to the same LAN. The user needs to go to the target device to query the LAN it is connected to. Moreover, in densely populated places such as conference rooms and studios, there are many LANs, and the source device and the target device need to be connected to the same LAN. The device may automatically switch to other LANs, causing the screen transfer operation to be interrupted, making the screen transfer operation more cumbersome and resulting in lower efficiency of the screen transfer operation.
又或者，目标设备提供二维码、连接码，源设备通过扫二维码、输入连接码等方式连接目标设备。Alternatively, the target device provides a QR code and connection code, and the source device connects to the target device by scanning the QR code and entering the connection code.
这种方式，目标设备会存在息屏的状态，用户无法看到二维码、连接码等信息，需走到接目标设备附近点亮并操作跳转到提示二维码、传屏码的页面。又或者，目标设备接收多路输入视频信号时，若切换到摄像头等其他路的视频信号时，用户无法看到二维码、连接码等信息，传屏操作较为繁琐，导致传屏操作的效率较低。In this way, the screen of the target device will be in a state where the user cannot see the QR code, connection code and other information. They need to go to the target device, light it up and operate to jump to the page that prompts the QR code and screen transfer code. . Or, when the target device receives multiple input video signals, if it switches to other channels of video signals such as the camera, the user cannot see the QR code, connection code and other information, making the screen transfer operation more cumbersome and reducing the efficiency of the screen transfer operation. lower.
在本实施例中，目标设备基于无线接入点广播目标数据帧，源设备接收目标设备所广播的目标数据帧，源设备显示目标数据帧中、目标设备的描述信息，源设备在接收到作用于描述信息的选定操作时，根据目标数据帧的网络参数接入描述信息所属目标设备，目标设备显示在源设备中产生的媒体数据，目标设备广播目标数据帧、源设备接收目标数据帧，对其进行解析并显示，这些均是用户无感知的操作，用户在源设备处即可浏览到周围各个目标设备的情况，并根据需要选择所需传屏的目标设备，实现了一键传屏，操作简单，从而提高了传屏操作的效率。In this embodiment, the target device broadcasts the target data frame based on the wireless access point, the source device receives the target data frame broadcast by the target device, the source device displays the description information of the target device in the target data frame, and the source device receives the action During the selection operation of the description information, the target device to which the description information belongs is accessed according to the network parameters of the target data frame. The target device displays the media data generated in the source device. The target device broadcasts the target data frame and the source device receives the target data frame. It is parsed and displayed. These are all operations that the user is unaware of. The user can browse the situation of each surrounding target device at the source device, and select the target device to which the screen needs to be transferred as needed, realizing one-click screen transfer. , the operation is simple, thereby improving the efficiency of screen transfer operations.
并且，无需提前将源设备接入目标设备所处的局域网、也无需在目标设备中显示二维码、连接码等信息，从而避免因前述操作引起的查询局域网、自动切换局域网，或者，唤醒目标设备、切换视频信号等带来的操作不便。Moreover, there is no need to connect the source device to the LAN where the target device is located in advance, and there is no need to display QR code, connection code and other information on the target device, thereby avoiding querying the LAN, automatically switching LAN, or waking up the target caused by the aforementioned operations. Operation inconvenience caused by equipment, switching video signals, etc.
本实施例通过对信号强度降序的方式对描述信息进行排序，优先显示信号强度较强的目标设备，尤其是在同一个室内环境的目标设备，提高用户在首页选中待传屏的目标设备的几率，减少翻页等操作，从而提高选中待传屏的目标设备的效率。This embodiment sorts the description information in descending order of signal strength, giving priority to displaying target devices with stronger signal strength, especially target devices in the same indoor environment, thereby increasing the probability that users will select the target device to be screen-transmitted on the homepage. , reducing operations such as page turning, thereby improving the efficiency of selecting the target device to be screen-transmitted.
本实施例通过优先显示第一信息、选择显示第二信息，实现分层的显示机制，可以减少优先显示的数据量，在窗口的页面中增加显示的描述信息的数量，从而提高用户在一页选中待传屏的目标设备的几率，减少翻页等操作，从而提高选中待传屏的目标设备的效率。This embodiment implements a hierarchical display mechanism by preferentially displaying the first information and selectively displaying the second information, which can reduce the amount of data displayed with priority and increase the amount of displayed description information in the page of the window, thereby improving the user's ability to read on one page. The probability of selecting the target device to be screen-transferred reduces operations such as page turning, thereby improving the efficiency of selecting the target device to be screen-transferred.
在本实施例中，在网络参数的基础上，通过校验校验码允许或禁止显示媒体数据，可以降低目标设备被造成恶意传屏的风险，提高目标设备的安全性。In this embodiment, based on the network parameters, the verification code is used to allow or prohibit the display of media data, which can reduce the risk of the target device being maliciously uploaded to the screen and improve the security of the target device.
实施例六Embodiment 6
图8为本发明实施例六提供的一种传屏装置的结构示意图，该装置位于传屏设备中，具体可以包括如下模块：Figure 8 is a schematic structural diagram of a screen transmission device provided in Embodiment 6 of the present invention. The device is located in a screen transmission device and may specifically include the following modules:
设备接入确定模块801，用于确定接入源设备；The device access determination module 801 is used to determine the access source device;
目标数据帧接收模块802，用于接收目标设备基于无线接入点所广播的目标数据帧；The target data frame receiving module 802 is used to receive the target data frame broadcast by the target device based on the wireless access point;
设备信息读取模块803，用于从所述目标数据帧中读取所述目标设备的设备信息，所述设备信息包括描述信息和网络参数；The device information reading module 803 is used to read the device information of the target device from the target data frame, where the device information includes description information and network parameters;
描述信息显示模块804，用于显示所述目标设备的所述描述信息；Description information display module 804, used to display the description information of the target device;
选定操作接收模块805，用于接收作用于所述描述信息的选定操作；The selected operation receiving module 805 is used to receive the selected operation acting on the description information;
无线接入点连接模块806，用于响应于所述选定操作，根据所述描述信息对应的网络参数、通过所述传屏设备接入所述描述信息所属目标设备设置的无线接入点；The wireless access point connection module 806 is configured to respond to the selection operation and access the wireless access point set by the target device to which the description information belongs through the screen sharing device according to the network parameters corresponding to the description information;
媒体数据获取模块807，用于获取在所述源设备中产生的媒体数据；Media data acquisition module 807, used to acquire media data generated in the source device;
媒体数据传输模块808，用于将所述媒体数据发送给所述目标设备进行播放。The media data transmission module 808 is used to send the media data to the target device for playback.
在本发明的一个实施例中，所述目标数据帧接收模块802包括：In one embodiment of the present invention, the target data frame receiving module 802 includes:
数据帧接收子模块，用于接收数据帧；Data frame receiving submodule, used to receive data frames;
第一数据读取子模块，用于从所述数据帧中的第一位置读取第一数据；The first data reading submodule is used to read the first data from the first position in the data frame;
传屏标识比较子模块，用于将所述第一数据与预设的传屏标识相同进行比较，所述传屏标识用于标识支持传屏操作的设备；A screen transfer identification comparison submodule, used to compare the first data with a preset screen transfer identification, and the screen transfer identification is used to identify a device that supports screen transfer operation;
目标数据帧确定子模块，用于若所述第一数据与所述投屏标识相同，则确定所述数据帧为目标设备基于无线接入点广播的目标数据帧。The target data frame determination submodule is configured to determine that the data frame is a target data frame broadcast by the target device based on the wireless access point if the first data is the same as the screen projection identifier.
在本发明的一个实施例中，所述设备信息读取模块803包括：In one embodiment of the present invention, the device information reading module 803 includes:
第二数据读取子模块，用于从所述目标数据帧中的第二位置读取第二数据；The second data reading submodule is used to read the second data from the second position in the target data frame;
第二数据解析子模块，用于从所述第二数据进行解析，获得所述目标设备的设备信息。The second data parsing sub-module is used to parse the second data to obtain device information of the target device.
在本发明的一个实施例中，所述描述信息显示模块804包括：In one embodiment of the present invention, the description information display module 804 includes:
信号强度确定子模块，用于确定所述目标数据帧的信号强度；Signal strength determination submodule, used to determine the signal strength of the target data frame;
降序排序子模块，用于按照所述信号强度降序的方式、对所述目标设备的所述描述信息进行排序，从而确定所述描述信息的顺序；A descending order sorting submodule, configured to sort the description information of the target device in descending order of the signal strength, thereby determining the order of the description information;
排序显示子模块，用于按照所述顺序显示所述描述信息。A sorting display submodule is used to display the description information in the order.
在本发明的一个实施例中，所述描述信息包括第一信息与第二信息；In one embodiment of the present invention, the description information includes first information and second information;
所述描述信息显示模块804包括：The description information display module 804 includes:
第一信息显示子模块，用于显示所述第一信息；The first information display submodule is used to display the first information;
确认操作接收子模块，用于接收作用于所述第一信息的确认操作；A confirmation operation receiving submodule, configured to receive a confirmation operation acting on the first information;
第二信息显示子模块，用于响应于所述确认操作，显示所述第一信息关联的第二信息。The second information display submodule is configured to display second information associated with the first information in response to the confirmation operation.
在本发明的一个实施例中，所述设备信息还包括校验码，所述媒体数据显示模块包括：In one embodiment of the present invention, the device information also includes a check code, and the media data display module includes:
校验码传输子模块，用于将所述校验码与所述媒体数据发送给所述目标设备，所述目标设备用于在校验所述校验码成功时，允许播放所述媒体数据，在校验所述校验码失败时，禁止播放所述媒体数据。A check code transmission submodule, used to send the check code and the media data to the target device, and the target device is used to allow the media data to be played when the check code is successfully verified. , when the check code fails to be verified, the media data is prohibited from being played.
本发明实施例所提供的传屏装置可执行本发明任意实施例所提供的传屏方法，具备执行方法相应的功能模块和有益效果。The screen sharing device provided by the embodiment of the present invention can execute the screen sharing method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.
实施例七Embodiment 7
图9为本发明实施七提供的一种传屏装置的结构示意图，该装置位于目标设备中，具体可以包括如下模块：Figure 9 is a schematic structural diagram of a screen transmission device provided in the seventh embodiment of the present invention. The device is located in the target device and may specifically include the following modules:
无线接入点开启模块901，用于开启无线接入点；Wireless access point activation module 901, used to activate the wireless access point;
目标数据帧广播模块902，用于基于所述无线接入点广播目标数据帧，以使所述目标数据帧被传屏设备接收，所述传屏设备接入源设备；The target data frame broadcast module 902 is used to broadcast the target data frame based on the wireless access point, so that the target data frame is received by the screen transmission device, and the screen transmission device accesses the source device;
其中，所述目标数据帧包括所述目标设备的设备信息，所述设备信息包括描述信息和网络参数，所述描述信息用于显示在所述源设备中；Wherein, the target data frame includes device information of the target device, the device information includes description information and network parameters, and the description information is used to be displayed in the source device;
无线接入模块903，用于在所述描述信息被选定时，根据所述网络参数、基于所述无线接入点接入所述传屏设备；Wireless access module 903, configured to access the screen sharing device according to the network parameters and the wireless access point when the description information is selected;
媒体数据接收模块904，用于接收所述传屏设备发送的、在所述源设备中产生的媒体数据；The media data receiving module 904 is used to receive media data generated in the source device and sent by the screen sharing device;
媒体数据播放模块905，用于播放所述媒体数据。The media data playing module 905 is used to play the media data.
在本发明的一个实施例中，还包括：In one embodiment of the invention, it also includes:
设备信息获取模块，用于获取所述目标设备的设备信息，所述设备信息包括描述信息、网络参数、校验码中的至少一者；A device information acquisition module, configured to acquire device information of the target device, where the device information includes at least one of description information, network parameters, and verification codes;
设备信息封装模块，用于将预设的传屏标识与所述设备信息封装至一数据帧中，作为目标数据帧。The device information encapsulation module is used to encapsulate the preset screen transmission identification and the device information into a data frame as a target data frame.
在本发明的一个实施例中，还包括：In one embodiment of the invention, it also includes:
在本发明的一个实施例中，所述设备信息还包括校验码；所述媒体数据显示模块包括：In one embodiment of the present invention, the device information also includes a check code; the media data display module includes:
校验码接收子模块，用于接收所述传屏设备发送的校验码；A check code receiving submodule, used to receive the check code sent by the screen transmission device;
允许显示子模块，用于在验证所述传屏设备发送的校验码成功时，允许播放所述媒体数据；Allow display sub-module, used to allow the media data to be played when the verification code sent by the screen transmission device is successfully verified;
禁止显示子模块，用于在验证所述传屏设备发送的校验码失败时，禁止播放所述媒体数据。The display prohibition sub-module is used to prohibit the playback of the media data when the verification code sent by the screen transmission device fails to be verified.
在本发明的一个实施例中，还包括：In one embodiment of the invention, it also includes:
息屏模块，用于维持息屏状态。The breath screen module is used to maintain the breath screen state.
本发明实施例所提供的传屏装置可执行本发明任意实施例所提供的传屏方法，具备执行方法相应的功能模块和有益效果。The screen sharing device provided by the embodiment of the present invention can execute the screen sharing method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.
实施例八Embodiment 8
图10为本发明实施例八提供的一种传屏系统的结构示意图，该系统具体可以包括：Figure 10 is a schematic structural diagram of a screen transmission system provided in Embodiment 8 of the present invention. The system may specifically include:
目标设备1001，用于基于无线接入点广播目标数据帧；The target device 1001 is used to broadcast the target data frame based on the wireless access point;
源设备1002，用于接收目标设备所广播的目标数据帧；显示所述目标数据帧中、所述目标设备的描述信息；在接收到作用于所述描述信息的选定操作时，根据所述目标数据帧的网络参数接入所述描述信息所属目标设备；The source device 1002 is configured to receive the target data frame broadcast by the target device; display the description information of the target device in the target data frame; when receiving a selected operation that acts on the description information, perform the The network parameters of the target data frame are accessed to the target device to which the description information belongs;
目标设备1001，还用于显示在所述源设备中产生的媒体数据。The target device 1001 is also used to display media data generated in the source device.
本发明实施例所提供的传屏系统可执行本发明任意实施例所提供的传屏方法，具备执行方法相应的功能模块和有益效果。The screen transfer system provided by the embodiment of the present invention can execute the screen transfer method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.
实施例九Embodiment 9
图11为本发明实施例九提供的一种电子设备的结构示意图。如图11所示，该电子设备包括处理器1100、存储器、通信模块1102、输入装置1103和输出装置1104；电子设备中处理器1100的数量可以是一个或多个，图11中以一个处理器1100为例；电子设备中的处理器1100、存储器、通信模块1102、输入装置1103和输出装置1104可以通过总线或其他方式连接，图11中以通过总线连接为例。FIG. 11 is a schematic structural diagram of an electronic device provided in Embodiment 9 of the present invention. As shown in Figure 11, the electronic device includes a processor 1100, a memory, a communication module 1102, an input device 1103, and an output device 1104; the number of processors 1100 in the electronic device can be one or more. In Figure 11, one processor is used. 1100 is taken as an example; the processor 1100, memory, communication module 1102, input device 1103 and output device 1104 in the electronic device can be connected through a bus or other means. In Figure 11, connection through a bus is taken as an example.
存储器作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序以及模块，如本实施例中的传屏方法对应的模块(例如，如图8所示的传屏装置中的设备接入确定模块801、目标数据帧接收模块802、设备信息读取模块803、描述信息显示模块804、选定操作接收模块805、无线接入点连接模块806、媒体数据获取模块807和媒体数据传输模块808；或者，如图9所示的传屏装置中的无线接入点开启模块901、目标数据帧广播模块902、无线接入模块903、媒体数据接收模块904和媒体数据播放模块905；或者，如图10所示的传屏系统中的目标设备1001和源设备1002)。处理器1100通过运行存储在存储器中的软件程序、指令以及模块，从而执行电子设备的各种功能应用以及数据处理，即实现上述的传屏方法。As a computer-readable storage medium, the memory can be used to store software programs, computer executable programs and modules, such as the modules corresponding to the screen transmission method in this embodiment (for example, the equipment in the screen transmission device shown in Figure 8 Access determination module 801, target data frame receiving module 802, device information reading module 803, description information display module 804, selected operation receiving module 805, wireless access point connection module 806, media data acquisition module 807 and media data transmission Module 808; or, the wireless access point opening module 901, the target data frame broadcast module 902, the wireless access module 903, the media data receiving module 904 and the media data playing module 905 in the screen sharing device as shown in Figure 9; or , the target device 1001 and the source device 1002 in the screen sharing system as shown in Figure 10). The processor 1100 executes various functional applications and data processing of the electronic device by running software programs, instructions and modules stored in the memory, that is, implementing the above-mentioned screen sharing method.
存储器可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据电子设备的使用所创建的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储器可进一步包括相对于处理器1100远程设置的存储器，这些远程存储器可以通过网络连接至电子设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system and at least one application program required for a function; the stored data area may store data created based on the use of the electronic device, etc. In addition, the memory may include high-speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory may further include memory located remotely relative to the processor 1100, and these remote memories may be connected to the electronic device through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.
通信模块1102，用于与显示屏建立连接，并实现与显示屏的数据交互。The communication module 1102 is used to establish a connection with the display screen and implement data interaction with the display screen.
输入装置1103可用于接收输入的数字或字符信息，以及产生与电子设备的用户设置以及功能控制有关的键信号输入，还可以是用于获取图像的摄像头以及获取音频数据的拾音设备。The input device 1103 can be used to receive input numeric or character information, and generate key signal input related to user settings and function control of the electronic device. It can also be a camera used to acquire images and a sound pickup device to acquire audio data.
输出装置1104可以包括扬声器等音频设备。The output device 1104 may include an audio device such as a speaker.
需要说明的是，输入装置1103和输出装置1104的具体组成可以根据实际情况设定。It should be noted that the specific composition of the input device 1103 and the output device 1104 can be set according to actual conditions.
处理器1100通过运行存储在存储器中的软件程序、指令以及模块，从而执行设备的各种功能应用以及数据处理，即实现上述的电子白板的连接节点控制方法。The processor 1100 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implementing the above-mentioned connection node control method of the electronic whiteboard.
本实施例提供的电子设备，可执行本发明任一实施例提供的传屏方法，具体相应的功能和有益效果。The electronic device provided by this embodiment can execute the screen sharing method provided by any embodiment of the present invention, with specific corresponding functions and beneficial effects.
实施例十Embodiment 10
本发明实施例十还提供一种计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现一种传屏方法。Embodiment 10 of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, a screen sharing method is implemented.
在一种情况中，该传屏方法包括：In one case, the screen sharing method includes:
确定接入源设备；Determine the access source device;
接收目标设备基于无线接入点所广播的目标数据帧，所述目标设备用于通过所述传屏设备、与所述源设备执行传屏操作，从而显示所述源设备的媒体数据；Receive the target data frame broadcast by the target device based on the wireless access point, and the target device is configured to perform a screen sharing operation with the source device through the screen sharing device, thereby displaying the media data of the source device;
从所述目标数据帧中读取所述目标设备的设备信息，所述设备信息包括描述信息；Read device information of the target device from the target data frame, where the device information includes description information;
显示所述目标设备的所述描述信息；Display the description information of the target device;
接收作用于所述描述信息的选定操作；receiving selected operations that act on said description information;
响应于所述选定操作，根据所述描述信息对应的网络参数、通过所述传屏设备接入所述描述信息所属目标设备设置的无线接入点；In response to the selection operation, according to the network parameters corresponding to the description information, access the wireless access point set by the target device to which the description information belongs through the screen sharing device;
获取在所述源设备中产生的媒体数据；Obtain media data generated in the source device;
将所述媒体数据发送给所述目标设备进行播放。Send the media data to the target device for playback.
在另一种情况中，该传屏方法包括：In another case, the screen transmission method includes:
开启无线接入点；Turn on the wireless access point;
基于所述无线接入点广播目标数据帧，以使所述目标数据帧被传屏设备接收，所述传屏设备接入源设备；Broadcast the target data frame based on the wireless access point, so that the target data frame is received by the screen transmission device, and the screen transmission device accesses the source device;
其中，所述目标数据帧包括所述目标设备的设备信息，所述设备信息包括描述信息和万国参数，所述描述信息用于显示在所述源设备中；Wherein, the target data frame includes device information of the target device, the device information includes description information and universal parameters, and the description information is used to be displayed in the source device;
在所述描述信息被选定时，根据所述网络参数、基于所述无线接入点接入所述传屏设备；When the description information is selected, access the screen sharing device based on the network parameters and the wireless access point;
接收所述传屏设备发送的、在所述源设备中产生的媒体数据；Receive media data sent by the screen sharing device and generated in the source device;
播放所述媒体数据。Play the media data.
在又一种情况中，该传屏方法包括：In another case, the screen transmission method includes:
目标设备基于无线接入点广播目标数据帧；The target device broadcasts the target data frame based on the wireless access point;
源设备接收目标设备所广播的目标数据帧；The source device receives the target data frame broadcast by the target device;
源设备显示所述目标数据帧中、所述目标设备的描述信息；The source device displays the description information of the target device in the target data frame;
源设备在接收到作用于所述描述信息的选定操作时，根据所述目标数据帧的网络参数接入所述描述信息所属目标设备；When the source device receives the selected operation acting on the description information, access the target device to which the description information belongs according to the network parameters of the target data frame;
目标设备播放在所述源设备中产生的媒体数据。The target device plays the media data generated in the source device.
当然,本发明实施例所提供的计算机可读存储介质,其计算机程序不限于如上所述的方法操作,还可以执行本发明任意实施例所提供的传屏方法中的相关操作。Of course, the computer program of the computer-readable storage medium provided by the embodiments of the present invention is not limited to the method operations described above, and can also perform related operations in the screen sharing method provided by any embodiment of the present invention.
通过以上关于实施方式的描述，所属领域的技术人员可以清楚地了解到，本发明可借助软件及必需的通用硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(RandomAccess Memory,RAM)、闪存(FLASH)、硬盘或光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述的方法。From the above description of the implementation, those skilled in the art can clearly understand that the present invention can be implemented with the help of software and necessary general hardware. Of course, it can also be implemented with hardware, but in many cases the former is a better implementation. . Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or that contributes to the existing technology. The computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk. , read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (which can be a personal computer, Server, or network device, etc.) performs the methods described in various embodiments of the present invention.
值得注意的是，上述传屏装置的实施例中，所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本发明的保护范围。It is worth noting that in the above embodiments of the screen transmission device, the various units and modules included are only divided according to functional logic, but are not limited to the above divisions, as long as they can realize the corresponding functions; in addition, each unit and module is not limited to the above division. The specific names of the functional units are only for the convenience of distinguishing each other and are not used to limit the scope of the present invention.
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。Note that the above are only the preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments. Without departing from the concept of the present invention, it can also include more other equivalent embodiments, and the present invention The scope is determined by the scope of the appended claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311074202.6ACN117055833A (en) | 2020-03-30 | 2020-03-30 | Screen transmission method, device and storage medium |
| CN202010238651.XACN111459433B (en) | 2020-03-30 | 2020-03-30 | A screen transmission method, equipment and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010238651.XACN111459433B (en) | 2020-03-30 | 2020-03-30 | A screen transmission method, equipment and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311074202.6ADivisionCN117055833A (en) | 2020-03-30 | 2020-03-30 | Screen transmission method, device and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN111459433A CN111459433A (en) | 2020-07-28 |
| CN111459433Btrue CN111459433B (en) | 2023-09-15 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010238651.XAActiveCN111459433B (en) | 2020-03-30 | 2020-03-30 | A screen transmission method, equipment and storage medium |
| CN202311074202.6APendingCN117055833A (en) | 2020-03-30 | 2020-03-30 | Screen transmission method, device and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311074202.6APendingCN117055833A (en) | 2020-03-30 | 2020-03-30 | Screen transmission method, device and storage medium |
| Country | Link |
|---|---|
| CN (2) | CN111459433B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115225692B (en) | 2021-04-16 | 2024-03-26 | 广州视源电子科技股份有限公司 | Information processing method, device and storage medium |
| CN115514396B (en) | 2021-06-23 | 2023-06-13 | 广州视源电子科技股份有限公司 | NFC-based screen transmission device connection method, device and computer equipment |
| CN113556605A (en)* | 2021-07-21 | 2021-10-26 | 北京奇艺世纪科技有限公司 | Illegal advertisement determination method and device, electronic equipment and storage medium |
| TWI803925B (en)* | 2021-08-03 | 2023-06-01 | 明基電通股份有限公司 | Conference system with low standby power consumption |
| CN115811805A (en)* | 2021-09-14 | 2023-03-17 | 广州视源电子科技股份有限公司 | Screen projection connection method and control method, device, computer equipment and storage medium |
| CN114115775A (en)* | 2021-11-12 | 2022-03-01 | 广州视源电子科技股份有限公司 | Information screen projection method and device, terminal device, display device and storage medium |
| CN114143908B (en)* | 2021-11-17 | 2025-03-28 | 武汉领普科技有限公司 | Wireless pairing method, device and storage medium |
| WO2023097612A1 (en)* | 2021-12-02 | 2023-06-08 | 广州视臻信息科技有限公司 | Interaction implementation method and apparatus, interaction tablet and storage medium |
| JP2023083854A (en)* | 2021-12-06 | 2023-06-16 | シャープ株式会社 | Display device and display control method |
| CN114430497A (en)* | 2022-01-30 | 2022-05-03 | 深圳创维－Rgb电子有限公司 | Screen projection device automatic wireless connection method, device, screen projection device and storage medium |
| CN115562570B (en)* | 2022-04-27 | 2023-09-12 | 荣耀终端有限公司 | Data migration method, system and electronic device |
| CN117896447A (en)* | 2022-10-08 | 2024-04-16 | 广州视臻信息科技有限公司 | Data transmission method, electronic device, screen transmitter and storage medium |
| CN118235379A (en)* | 2022-10-21 | 2024-06-21 | 广州视臻信息科技有限公司 | Data transmission method and data transmission device |
| CN117939088B (en)* | 2022-10-25 | 2025-09-30 | 广州视臻信息科技有限公司 | Screen sharing device pairing method, pairing device, electronic device and medium |
| WO2024119365A1 (en)* | 2022-12-06 | 2024-06-13 | 广州视源电子科技股份有限公司 | Wireless screen-mirroring method and device, and storage medium |
| CN116436714A (en)* | 2023-03-27 | 2023-07-14 | 深圳市信锐网科技术有限公司 | Screen projection method, device, electronic device and storage medium |
| CN119893200A (en)* | 2023-10-25 | 2025-04-25 | 华为技术有限公司 | Screen projection method, electronic device, storage medium and program product |
| CN120111713A (en)* | 2023-11-30 | 2025-06-06 | 广州视臻信息科技有限公司 | Screen projection connection method, device, electronic device and storage medium |
| CN118433683B (en)* | 2024-07-04 | 2024-11-19 | 深圳市拔超科技股份有限公司 | APP and method for realizing remote connection between UAC and UVC devices using wireless channels |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106990964A (en)* | 2017-03-30 | 2017-07-28 | 成都伟德利普信息技术有限公司 | A kind of wireless screen transmission method and wireless screen transmission system |
| CN107517459A (en)* | 2017-09-18 | 2017-12-26 | 广州视源电子科技股份有限公司 | Method, device and system for establishing connection in wireless screen transmission and storage medium |
| CN108924837A (en)* | 2018-08-01 | 2018-11-30 | 广州视源电子科技股份有限公司 | Pairing method, device and system for intelligent interaction equipment |
| CN109120970A (en)* | 2018-09-30 | 2019-01-01 | 珠海市君天电子科技有限公司 | It is a kind of wirelessly to throw screen method, terminal device and storage medium |
| CN109963030A (en)* | 2017-12-25 | 2019-07-02 | 中国移动通信集团广东有限公司 | A screen sharing processing method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6634996B2 (en)* | 2016-09-30 | 2020-01-22 | 富士通クライアントコンピューティング株式会社 | Monitoring device, screen sharing method, and screen sharing program |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106990964A (en)* | 2017-03-30 | 2017-07-28 | 成都伟德利普信息技术有限公司 | A kind of wireless screen transmission method and wireless screen transmission system |
| CN107517459A (en)* | 2017-09-18 | 2017-12-26 | 广州视源电子科技股份有限公司 | Method, device and system for establishing connection in wireless screen transmission and storage medium |
| CN109963030A (en)* | 2017-12-25 | 2019-07-02 | 中国移动通信集团广东有限公司 | A screen sharing processing method and device |
| CN108924837A (en)* | 2018-08-01 | 2018-11-30 | 广州视源电子科技股份有限公司 | Pairing method, device and system for intelligent interaction equipment |
| CN109120970A (en)* | 2018-09-30 | 2019-01-01 | 珠海市君天电子科技有限公司 | It is a kind of wirelessly to throw screen method, terminal device and storage medium |
| Title |
|---|
| 于洪涛编著.学习通投屏.《基于"一平三端"的高校混合式教学实践探索》.吉林大学出版社,2019,* |
| Publication number | Publication date |
|---|---|
| CN111459433A (en) | 2020-07-28 |
| CN117055833A (en) | 2023-11-14 |
| Publication | Publication Date | Title |
|---|---|---|
| CN111459433B (en) | A screen transmission method, equipment and storage medium | |
| CN113360108B (en) | A screen projection connection control method and electronic device | |
| US12120162B2 (en) | Communication protocol switching method, apparatus, and system | |
| US10165391B2 (en) | Companion application for activity cooperation | |
| CN105122931B (en) | Electronic equipment and the method that personal cloud device is registered in its portal user server | |
| CN105573609B (en) | Content sharing method and device | |
| CN105933899B (en) | The cut-in method and device of wireless access point | |
| CN103200197B (en) | Multimedia control method for playing back, system, cloud server and terminal | |
| KR101650804B1 (en) | Method for sharing media content, terminal device, and content sharing system | |
| CN101325666B (en) | Telecontrol system for intelligent mobile terminal television | |
| CN103534679B (en) | Method and terminal for media stream sharing | |
| CN109842917B (en) | Transmission method of system information block and user terminal | |
| CN108702623A (en) | A wireless local area network configuration method and device | |
| WO2022089088A1 (en) | Display device, mobile terminal, screen-casting data transmission method, and transmission system | |
| WO2020133495A1 (en) | Smart device management method, mobile terminal, and system | |
| WO2017124860A1 (en) | Distributed wireless multi-screen virtual machine service system | |
| CN109104416B (en) | Multi-device cooperation cloud service platform based on PON (Passive optical network) local area network | |
| WO2020181906A1 (en) | Method and apparatus for interacting with smart television | |
| CN103532945B (en) | Sharing control method and related equipment and communication system | |
| CN102685856A (en) | Wireless communication method and Wi-Fi Direct (Wireless Fidelity Direct) communication system | |
| CN114697879B (en) | Bluetooth pairing method, electronic device, chip and storage medium | |
| CN106569758A (en) | Wireless projection screen method and device | |
| CN112788581A (en) | NFC interaction panel, interaction system, interaction method, interaction device and storage medium | |
| KR102428934B1 (en) | Display apparatus, user terminal apparatus, system and the controlling method | |
| WO2024045985A1 (en) | Screen control method, screen control apparatus, electronic device, program, and medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |