Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
In the embodiment of the invention, the screen sharing method is applied to the mobile terminal, and the terminal can be implemented in various forms. For example, the mobile terminal according to the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a personal digital assistant (Personal Digital Assistant, PDA), or the like.
The following description will be given taking a tablet computer as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present invention can be applied to other types of mobile terminals, in addition to elements particularly used for the purpose of movement.
Referring to fig. 1, fig. 1 is a schematic hardware structure of a mobile terminal implementing various embodiments of the present invention, where the terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not limiting of the mobile terminal and that the mobile terminal may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
The following describes the components of the mobile terminal in detail with reference to fig. 1:
the radio frequency unit 101 may be used for receiving and transmitting signals during the information receiving or communication process, specifically, after receiving downlink information of the base station, processing the downlink information by the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, global System for Mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.
WiFi belongs to a short-distance wireless transmission technology, and a mobile terminal can help a user to send and receive e-mails, browse web pages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of a mobile terminal, and can be omitted entirely as required within a range that does not change the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the terminal 100. The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.
The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the mobile terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the terminal gesture (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured for the terminal, the detailed description thereof will be omitted.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the terminal. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.
Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the home page display terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The mobile terminal 100 may further include a power source 111 (e.g., a battery) for supplying power to the respective components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described herein.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a screen sharing program may be included in the memory 109 as one type of computer storage medium, and the processor 110 may be configured to call the screen sharing program stored in the memory 109 and perform the steps of:
establishing a ViLTE connection with a receiving end;
when a screen sharing request is received, detecting whether a screen sharing condition is met currently;
and if the screen sharing condition is met currently, acquiring screen display content, and transmitting the screen display content to the receiving end based on the ViLTE connection.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
when a screen sharing request is received, detecting whether the receiving terminal is a legal receiving terminal;
And if the receiving end is a legal receiving end, currently meeting the screen sharing condition.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
when a screen sharing request is received, acquiring a terminal identifier of the receiving end;
detecting whether the terminal identifier is stored in a preset white list;
and if the terminal identifier is stored in a preset white list, determining that the receiving end is a legal receiving end.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
if the terminal identifier is stored in a preset white list, encrypting a preset character string through a preset private key to obtain encryption information, and sending the encryption information to the receiving end;
receiving decryption information fed back by the receiving end, and comparing whether the decryption information is consistent with the preset character string or not;
and if the decryption information is consistent with the preset character string, determining that the receiving end is a legal receiving end.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
If the screen sharing condition is met currently, acquiring a communication protocol corresponding to the ViLTE connection;
acquiring screen display content once every preset time length, and coding the screen display content acquired every time based on the communication protocol to obtain coding information;
and transmitting the coding information to the receiving end based on the ViLTE connection.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
if the screen sharing condition is met currently, closing the camera;
hiding a preset privacy application, and acquiring a communication protocol corresponding to the ViLTE connection.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
dividing a screen into N areas, and acquiring display contents of the N areas at a first time node to serve as screen display contents acquired for the first time;
when the time reaches the next time node, comparing the current screen display content with the screen display content of the previous time node to obtain a comparison result;
determining a target area with changed screen display content according to the comparison result;
Acquiring screen display content of the target area as currently acquired screen display content;
and repeating the step of comparing the current screen display content with the screen display content of the previous time node when the time reaches the next time node to obtain a comparison result until a sharing breaking instruction is received.
Further, the processor 110 may be configured to invoke a screen sharing program stored in the memory 109, and further perform the following steps:
if the screen sharing condition is not met currently, the screen sharing request is not responded, and an alarm prompt is output.
In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based will be described below.
Referring to fig. 2, fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present invention, where the communication network system is an LTE system of a general mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an e-UTRAN (Evolved UMTS Terrestrial Radio Access Network ) 202, an epc (Evolved Packet Core, evolved packet core) 203, and an IP service 204 of an operator that are sequentially connected in communication.
Specifically, the UE201 may be the terminal 100 described above, and will not be described herein.
The E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. The eNodeB2021 may be connected with other eNodeB2022 by a backhaul (e.g., an X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide access from the UE201 to the EPC 203.
EPC203 may include MME (Mobility Management Entity ) 2031, hss (Home Subscriber Server, home subscriber server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, pgw (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function, policy and tariff function entity) 2036, and so on. The MME2031 is a control node that handles signaling between the UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location registers (not shown) and to hold user specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034 and PGW2035 may provide IP address allocation and other functions for UE201, PCRF2036 is a policy and charging control policy decision point for traffic data flows and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).
IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem ), or other IP services, etc.
Although the LTE system is described above as an example, it should be understood by those skilled in the art that the present invention is not limited to LTE systems, but may be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.
Based on the above mobile terminal hardware structure and the communication network system, various embodiments of the method of the present invention are provided.
Referring to fig. 3, fig. 3 is a flowchart illustrating a first embodiment of a screen sharing method according to the present invention.
In one embodiment, the screen sharing method includes:
step S10, establishing a ViLTE connection with a receiving end;
referring to fig. 4, fig. 4 is a schematic diagram of a scenario in which two terminals establish a ViLTE connection in an embodiment of the screen sharing method according to the present invention. As shown in fig. 4, the terminal a is an end applying the screen sharing method, i.e. a sharing end, and the terminal B is a receiving end, i.e. a shared end. Wherein, the ViLTE is the abbreviation of "high definition Video over LTE", which is an extension of VoLTE that enhances voice services. The ViLTE has high-reliability data transmission capability, and ensures that the data of the terminal A can be stably transmitted to the terminal B with low time delay.
Step S20, when a screen sharing request is received, detecting whether a screen sharing condition is met currently;
in this embodiment, when a screen sharing request is received, it is first detected whether a screen sharing condition is currently satisfied, and only when the screen sharing condition is satisfied, screen sharing is performed, thereby improving information security guarantee for a sharing end.
In one embodiment, when the screen sharing request is triggered by the home terminal, for example, the user clicks the sharing button on the terminal a, the terminal a receives the screen sharing request triggered based on the user operation. At this time, the operator needs to be authenticated. The authentication mode can be password authentication, fingerprint authentication, facial image authentication and the like. Specifically, when face image authentication is adopted, in order to avoid fraud implemented by a user through means such as masks and photos, living body detection is firstly carried out on the user, after the living body detection is passed, the face image of the user is collected, similarity calculation is carried out on the collected face image and a preset face image, a similarity calculation result is obtained, if the similarity calculation result is larger than or equal to a preset threshold value, identity authentication is determined to pass, and then the current meeting of screen sharing conditions is determined. The living body detection process flow is as follows: the user head image acquired by the binocular camera comprises a left view user head image and a right view user head image, parallax images corresponding to left and right views can be obtained by a binocular stereo matching algorithm, then the parallax images are converted into depth images, after the depth images are obtained, gray level co-occurrence matrixes of the depth images are further calculated, texture features of the face depth images are extracted from the obtained gray level co-occurrence matrixes, all the texture features are cascaded into gray level co-occurrence matrix feature vectors so as to conveniently adopt a living body classification model of a support vector machine to classify the gray level co-occurrence matrix feature vectors, and finally whether a current detection object is a living body is determined according to classification results. Before living body detection, gray level co-occurrence matrix feature vectors are extracted from face images of a large number of living bodies and non-living bodies, sample marks of living bodies and non-living bodies are carried out, then machine learning is carried out by taking the gray level co-occurrence matrix feature vectors as training samples, and a living body classification model capable of identifying the living bodies and the non-living bodies is obtained, so that the living body classification model can carry out living body detection based on the gray level co-occurrence matrix feature vectors.
In another embodiment, when the screen sharing request is sent by the other end. For example, the user clicks a request sharing button on the terminal B, and the terminal B transmits a screen sharing request to the terminal a based on the user's operation, and at this time, the terminal a receives the screen sharing request transmitted by the terminal B. After receiving the screen sharing request, the terminal A further detects whether the terminal B is a legal terminal, and if the terminal B is the legal terminal, the terminal A determines that the sharing condition is met currently.
The mode of detecting whether the terminal B is a legal terminal may be: the screen sharing request sent by the terminal B comprises a terminal identifier of the terminal B (each terminal is endowed with a unique terminal identifier when leaving the factory), the terminal A extracts the terminal identifier from the received screen sharing request, searches whether the terminal identifier exists in a preset white list, and if so, determines that the terminal B is a legal terminal, namely, determines that the screen sharing condition is met currently. The preset white list is configured by a legal user of the terminal A, and a terminal identifier of a shared terminal which is allowed to carry out screen sharing is stored in the white list in advance.
The mode of detecting whether the terminal B is a legal terminal may also be: after receiving the screen sharing request, the terminal A encrypts a character string X through a pre-stored private key to obtain encryption information X1, and then sends the encryption information X1 to the terminal B. After receiving the X1, the terminal B decrypts the X1 by using a pre-stored public key or a public key input by a user to obtain decryption information X2, and feeds back the X2 to the terminal a. After receiving the X2, the terminal A compares whether the X is consistent with the X2, if so, the public key and the private key prestored in the terminal A are a pair of asymmetric keys, namely, the user of the terminal A is authorized to the terminal B, so that the terminal B is determined to be a legal terminal, and the current condition of meeting the screen sharing can be determined.
And step S30, if the screen sharing condition is met currently, acquiring screen display content, and transmitting the screen display content to the receiving end based on the ViLTE connection.
In this embodiment, when the home terminal (terminal a) establishes the ViLTE connection with the receiving terminal, the communication protocol will be negotiated by itself. The communication protocol defines an encoding scheme, a decoding scheme, a code stream rate, and the like. When the current condition of screen sharing is detected to be met, screen display content is acquired, the acquired screen display content is encoded according to a specified encoding mode to obtain encoded information, and then the encoded information is sent to a receiving end according to a specified code stream rate. And because the data transmission is carried out based on the ViLTE connection, the stable and low-delay transmission of the coded information to the receiving end is ensured by means of the high-reliability data transmission capability of the ViLTE. After the receiving end receives the coded information, the receiving end can decode the coded information according to a specified decoding mode, namely, the screen display content of the terminal A can be displayed on the receiving end, and screen sharing is realized.
In an embodiment, when the screen sharing condition is currently met, capturing the screen display content of the terminal a once every preset time period (the preset time period is set according to the actual situation, for example, is set to be thirty-one second), then encoding the screen display content obtained each time according to a specified encoding mode to obtain encoded information, and transmitting the encoded information to the receiving end based on the ViLTE connection according to the specified code stream rate. The receiving end decodes the received coded information according to a specified decoding mode, so that the screen display content of the terminal A is displayed.
In another embodiment, when the screen sharing condition is currently satisfied, the terminal a divides the screen into N display areas. Wherein N is set according to actual needs, for example, 9. Fig. 5 is a schematic view of a screen division of a terminal according to an embodiment of the screen sharing method of the present invention. The screen is divided into 9 display areas, areas 1, 2, 3, 4, 5, 6, 7, 8, 9, respectively. When the screen display content is acquired for the first time (i.e., at the first time node), the display content of 9 areas is acquired, and the acquired display content of 9 areas is encoded and then transmitted to the receiving end, so that the display content of 9 areas is displayed on the receiving end. And when the preset time length (the preset time length is set according to the actual situation, for example, is set to be thirty-one second), and the second time node is reached, comparing the current screen display content with the screen display content at the first time node to obtain a comparison result. Specifically, a region change detection algorithm can be adopted to determine whether the display content of the region 1 in the current screen display content is consistent with the display content of the region 1 in the screen display content at the first time node; determining whether the display content of the area 1 in the current screen display content is consistent with the display content of the area 1 in the screen display content at the first time node; determining whether the display content of the area 1 in the current screen display content is consistent with the display content of the area 1 in the screen display content at the first time node; determining whether the display content of the area 2 in the current screen display content is consistent with the display content of the area 2 in the screen display content at the first time node; and determining … … whether the display content of the current screen display content in the area 3 is consistent with the display content of the screen display content in the area 3 when the first time node is reached, and determining … … whether the display content of the current screen display content in the area 9 is consistent with the display content of the screen display content in the area 9 when the first time node is reached, so that a comparison result can be obtained. If the comparison result is that: the display contents of the first time node and the second time node are consistent in the areas 1, 2, 5, 6, 8 and 9, and the display contents of the first time node, the second time node and the second time node are inconsistent in the areas 3, 4 and 7, and the target areas with changed screen display contents are determined to be the areas 3, 4 and 7. The display contents of the current area 3, the area 4 and the area 7 are obtained, the display contents of the three areas are respectively encoded, the encoding information of the area 3, the encoding information of the area 4 and the encoding information of the area 7 are obtained, meanwhile, the position identifiers are respectively added into the three encoding information, and then the encoding information added with the position identifiers is sent to a receiving end. The receiving end decodes the encoded information to obtain the display contents of the areas 3, 4 and 7, and replaces the display contents of the areas 3, 4 and 7 by the display contents of the areas 3, 4 and 7 according to the position identification. And when the next time node is reached, repeating the processing flow, and realizing screen sharing.
In this embodiment, a ViLTE connection is established with the receiving end; when a screen sharing request is received, detecting whether a screen sharing condition is met currently; and if the screen sharing condition is met currently, acquiring screen display content, and transmitting the screen display content to the receiving end based on the ViLTE connection. According to the method and the device for the screen sharing, before screen sharing, condition judgment is carried out, information protection of the sharing end is enhanced, and illegal leakage of the information of the sharing end is avoided.
Further, in an embodiment of the screen sharing method of the present invention, step S10 includes:
step S101, when a screen sharing request is received, detecting whether the receiving end is a legal receiving end or not;
in this embodiment, when a screen sharing request is received, if the screen sharing request is from the receiving end, it is detected whether the receiving end is a legal receiving end.
Step S102, if the receiving terminal is a legal receiving terminal, the screen sharing condition is met currently.
In this embodiment, only when the receiving end is detected to be a legal receiving end, it is determined that the screen sharing condition is currently satisfied, so that subsequent screen sharing is performed. The information protection of the sharing end is enhanced, and illegal leakage of the information of the sharing end is avoided.
Further, in an embodiment of the screen sharing method of the present invention, step S101 includes:
step S1011, when a screen sharing request is received, acquiring a terminal identifier of the receiving end;
in this embodiment, the screen sharing request sent by the terminal B includes its own terminal identifier (each terminal is assigned with a unique terminal identifier when shipped from the factory), and the terminal a can extract the terminal identifier from the received screen sharing request.
Step S1012, detecting whether the terminal identifier is stored in a preset white list; step S1013, if the terminal identifier is stored in a preset white list, determining that the receiving end is a legal receiving end.
In this embodiment, whether the terminal identifier exists is searched in a preset white list, and if so, it is determined that the terminal B is a legal terminal, that is, it is determined that the screen sharing condition is currently satisfied. The preset white list is configured by a legal user of the terminal A, and a terminal identifier of a shared terminal which is allowed to carry out screen sharing is stored in the white list in advance.
By the aid of the user-defined authorization mechanism, a user can store the terminal identifier of the shared terminal which allows screen sharing in the white list, screen sharing can be automatically built when the user receives a screen sharing request sent by a corresponding terminal, and information safety of the user is guaranteed.
Further, in an embodiment of the screen sharing method of the present invention, step S1013 includes:
step S10131, if the terminal identifier is stored in a preset white list, encrypting a preset character string through a preset private key to obtain encryption information, and sending the encryption information to the receiving end;
in this embodiment, if the terminal identifier is stored in the preset white list, a character string X may be further encrypted by a pre-stored private key to obtain encrypted information X1, and then X1 is sent to the terminal B.
Step S10132, receiving decryption information fed back by the receiving end, and comparing whether the decryption information is consistent with the preset character string or not; step S10133, if the decryption information is consistent with the preset character string, determining that the receiving end is a legal receiving end.
In this embodiment, after receiving the screen sharing request, the terminal a decrypts the X1 by using a pre-stored public key or a public key input by the user after receiving the screen sharing request, to obtain the decryption information X2, and feeds back the X2 to the terminal a. After receiving the X2, the terminal A compares whether the X is consistent with the X2, if so, the public key and the private key prestored in the terminal A are a pair of asymmetric keys, namely, the user of the terminal A is authorized to the terminal B, so that the terminal B is determined to be a legal terminal, and the current condition of meeting the screen sharing can be determined.
The embodiment further improves the information security guarantee of the local terminal through double verification.
Further, step S30 includes:
if the screen sharing condition is met currently, acquiring a communication protocol corresponding to the ViLTE connection;
in this embodiment, when the home terminal (terminal a) establishes the ViLTE connection with the receiving terminal, the communication protocol will be negotiated by itself. The communication protocol defines an encoding scheme, a decoding scheme, a code stream rate, and the like, and these specifications are recorded in the communication protocol in the form of parameters.
Acquiring screen display content once every preset time length, and coding the screen display content acquired every time based on the communication protocol to obtain coding information; and transmitting the coding information to the receiving end based on the ViLTE connection.
In this embodiment, the screen display content may be acquired once every preset time period, or may be acquired for the first time, and only the changed screen display content may be acquired every preset time period. And coding the screen display content obtained each time according to a coding mode specified by a communication protocol to obtain coding information, and then transmitting the coding information to a receiving end based on the ViLTE connection according to a code stream rate specified by the communication protocol.
Further, the step of acquiring the communication protocol corresponding to the ViLTE connection if the screen sharing condition is currently satisfied includes:
if the screen sharing condition is met currently, closing the camera;
in this embodiment, when the screen sharing condition is satisfied, the camera may be turned off in order to save the local power.
Hiding a preset privacy application, and acquiring a communication protocol corresponding to the ViLTE connection.
In this embodiment, since the screen sharing will share the content of the home terminal screen, the user may set some applications that do not want to be seen by others as privacy applications in advance, and when it is detected that the screen sharing condition is met, the privacy applications are hidden, and at this time, even if the screen sharing is performed, the privacy applications are not seen by others, so that the privacy of the user is protected.
Further, the step of obtaining the screen display content once every preset time length includes:
dividing a screen into N areas, and acquiring display contents of the N areas at a first time node to serve as screen display contents acquired for the first time;
in this embodiment, when the screen sharing condition is currently satisfied, the terminal a divides the screen into N display areas. Wherein N is set according to actual needs, for example, 9. Fig. 5 is a schematic view of a screen division of a terminal according to an embodiment of the screen sharing method of the present invention. The screen is divided into 9 display areas, areas 1, 2, 3, 4, 5, 6, 7, 8, 9, respectively. At the time of first acquisition of the screen display content (i.e., at the first time node), 9 areas of display content (as the screen display content acquired for the first time) are acquired, and the acquired 9 areas of display content are encoded and then transmitted to the receiving end for display of the 9 areas of display content on the receiving end.
When the time reaches the next time node, comparing the current screen display content with the screen display content of the previous time node to obtain a comparison result;
in this embodiment, when the preset time length (the preset time length is set according to the actual situation, for example, set to thirty-one second) reaches the second time node, the current screen display content is compared with the screen display content at the first time node, so as to obtain a comparison result. Specifically, a region change detection algorithm can be adopted to determine whether the display content of the region 1 in the current screen display content is consistent with the display content of the region 1 in the screen display content at the first time node; determining whether the display content of the area 1 in the current screen display content is consistent with the display content of the area 1 in the screen display content at the first time node; determining whether the display content of the area 1 in the current screen display content is consistent with the display content of the area 1 in the screen display content at the first time node; determining whether the display content of the area 2 in the current screen display content is consistent with the display content of the area 2 in the screen display content at the first time node; and determining … … whether the display content of the current screen display content in the area 3 is consistent with the display content of the screen display content in the area 3 when the first time node is reached, and determining … … whether the display content of the current screen display content in the area 9 is consistent with the display content of the screen display content in the area 9 when the first time node is reached, so that a comparison result can be obtained. For example, the comparison results are: the first time node and the second time node have the same display content in the areas 1, 2, 5, 6, 8 and 9, and have different display content in the areas 3, 4 and 7.
Determining a target area with changed screen display content according to the comparison result;
in this embodiment, according to the comparison result, it is determined that the target areas where the screen display content is changed are the area 3, the area 4, and the area 7.
Acquiring screen display content of the target area as currently acquired screen display content;
in this embodiment, the display contents of the current area 3, the area 4 and the area 7 (as the currently acquired screen display contents) are acquired, and the display contents of the three areas are respectively encoded to obtain the encoded information of the area 3, the encoded information of the area 4 and the encoded information of the area 7, and meanwhile, the position identifiers are respectively added to the three encoded information, and then the encoded information added with the position identifiers is sent to the receiving end. The receiving end decodes the encoded information to obtain the display contents of the areas 3, 4 and 7, and replaces the display contents of the areas 3, 4 and 7 by the display contents of the areas 3, 4 and 7 according to the position identification.
And repeating the step of comparing the current screen display content with the screen display content of the previous time node when the time reaches the next time node to obtain a comparison result until a sharing breaking instruction is received.
In this embodiment, when the next time node is reached, the above processing flow is repeated until a command for disconnecting the sharing is received, so that the screen sharing can be realized.
According to the embodiment, the bandwidth pressure is reduced because only the coding information of the area with the changed display content is transmitted later, so that the data transmission is more stable and reliable, the time delay is lower, and the screen sharing is more real-time.
Further, after step S20, the method further includes:
if the screen sharing condition is not met currently, the screen sharing request is not responded, and an alarm prompt is output.
In this embodiment, if the screen sharing condition is not satisfied, the risk of leakage of the local information is indicated, so that the screen sharing request is not responded, and an alarm prompt is output. The alarm prompting modes comprise alarm sound, light flashing, vibration and the like.
In this embodiment, when the screen sharing condition is not satisfied, the screen sharing request is not responded, so that the information security of the local terminal is ensured, and the output of the alarm prompt can remind the user to pay attention to and timely make countermeasures.
In addition, the embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a screen sharing program, and the screen sharing program realizes the steps of the screen sharing method when being executed by a processor.
The specific embodiments of the computer readable storage medium of the present invention are substantially the same as the embodiments of the screen sharing method described above, and will not be described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.