CN110178111B - Image processing method and device for terminal - Google Patents

Abstract

Translated fromChinese

一种终端的图像处理方法及装置，可在移动终端PC化时可改善因大屏显示器进行过扫描而导致显示画面不完整的现象，提高大屏显示器的显示质量。该方法包括：终端与外部显示设备相连时，终端为外部显示设备生成待显示的目标显示画面，该目标显示画面内的目标区域用于布局目标显示画面中的显示内容，该目标区域为该目标显示画面中的一部分；终端将该目标显示画面发送至外部显示设备进行显示。

An image processing method and device for a terminal can improve the display quality of the large-screen display and improve the display quality of the large-screen display, which can improve the incomplete display image caused by the overscan of the large-screen display when the mobile terminal is converted into a PC. The method includes: when the terminal is connected to an external display device, the terminal generates a target display image to be displayed for the external display device, and a target area in the target display image is used to lay out the display content in the target display image, and the target area is the target area. A part of the display screen; the terminal sends the target display screen to an external display device for display.

Description

Image processing method and device for terminal

Technical Field

The embodiment of the application relates to the technical field of communication, in particular to an image processing method and device for a terminal.

Background

Personal Computer (PC) with mobile terminals is one of the important means for realizing mobile office work. Specifically, the mobile terminal such as a mobile phone may project the Display content on the screen of the mobile phone to a large-screen Display such as a PC through a wireless video Display (Wi-Fi-Display) function or a microsoft continuum (continuum) function, so that the mobile phone can be used as the PC after being connected to the large-screen Display.

Currently, some large-screen displays are opened with an overscan function to solve the problem of distortion of the edge of the screen due to the difference of the analog circuit parameters. Taking a television as an example of a large-screen display, when the television receives source picture data to be played, as shown in fig. 1, the television intercepts 95% of the source picture data located in the center of a picture from the source picture data, and then displays the intercepted source picture data in the television in a full screen manner.

In an application scenario of mobile terminal PC, when a large-screen display receives source picture data sent by a mobile terminal such as a mobile phone, an overtscan is still performed on the received source picture data, which may cause loss of partial image information sent by the mobile phone, and incomplete picture display when a user views the large-screen display.

Disclosure of Invention

The embodiment of the application provides an image processing method and device of a terminal, which can improve the phenomenon of incomplete display pictures caused by overscan of a large-screen display during mobile terminal PC (personal computer) and improve the display quality of the large-screen display.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, an embodiment of the present application provides an image processing method for a terminal, where the terminal is connected to an external display device, the method including: the terminal generates a target display picture to be displayed for external display equipment, wherein a target area in the target display picture is used for laying out display content in the target display picture, and the target area is one part of the target display picture; and the terminal sends the target display picture to external display equipment for display.

In this way, only a part of the target display picture sent by the terminal to the external display device is provided with substantial display contents, the external display device can continue to use the display image processing flow to overscan the target display picture after receiving the target display picture, and the substantial display contents lost during overscan are reduced, so that the phenomenon that the display picture is incomplete due to the overscan of the large-screen display can be improved, and the display quality of the large-screen display can be improved.

In one possible design method, before the terminal generates a target display screen to be displayed for the external display device, the method further includes: the terminal determines the size of a display picture, wherein the size of the display picture is the size of a picture sent to external display equipment; the target display has the display size. That is, the size of each display screen sent by the terminal to the external display device is the size of the display screen, but the area with substantial display content in each display screen is reduced.

In a possible design method, a terminal generates a target display screen to be displayed for an external display device, and specifically includes: the terminal generates an initial display picture for the content to be displayed by the external display equipment, wherein the initial display picture has the size of the display picture; and the terminal converts the initial display picture into the target display picture, wherein the display content of the target area in the target display picture is obtained by reducing the initial display picture.

In a possible design method, a terminal generates a target display screen to be displayed for an external display device, and specifically includes: and filling the content to be displayed by the external display equipment in the target area by the terminal to obtain the target display picture.

Then, when the area of the picture extracted by the external display device during overscan is larger than or equal to the area of the target area in the target display picture generated by the terminal, the information of the display picture received by the external display device is complete, and the phenomenon that the display picture is incomplete due to overscan can be avoided.

In one possible design method, before the terminal converts the initial display into the target display, the method further includes: the terminal generates a setting interface for adjusting the size of a display screen of the external display equipment for the external display equipment, wherein the setting interface comprises at least one candidate screen size; the terminal sends the setting interface to external display equipment for displaying; and the terminal determines the scaling between the initial display picture and the target area in the target display picture according to the input operation of the user on the setting interface.

In one possible design method, before the terminal fills the content to be displayed by the external display device in the target area, the method further includes: the terminal generates a setting interface for adjusting the size of a display screen of the external display equipment for the external display equipment, wherein the setting interface comprises at least one candidate screen size; the terminal sends the setting interface to external display equipment for displaying; and the terminal determines the size of the target area in the target display picture according to the input operation of the user on the setting interface.

Therefore, the user can manually select the proportion of the display picture in the external display equipment on the screen and select the picture size which accords with the use habit of the user.

In one possible design method, the setting interface further includes a screen preview effect of the external display device at the candidate screen size.

In one possible design method, the terminal generates a setting interface for adjusting the size of the display screen for the external display device, and the setting interface comprises: responding to the setting operation of a user on the external display equipment, and generating a setting interface for adjusting the size of a display picture for the external display equipment by the terminal; or when the terminal is successfully connected with the external display device, the terminal generates a setting interface for adjusting the size of the display screen for the external display device.

In one possible design method, the target area is located in the center of the target display screen, and the other area of the target display screen except the target area is provided with a ground color, for example, the ground color may be set to black.

In one possible design method, the target ratio of the target area to the target display screen is smaller than or equal to the extraction ratio of the display screen when the external display device overscans. In this way, the area of the picture extracted by the external display device during overscan is larger than or equal to the area of the effective picture in the target display picture generated by the terminal, so that the information of the display picture received by the external display device in the terminal PC scene is complete, and the phenomenon of incomplete display picture caused by overscan can be avoided.

In one possible design method, the terminal determines the size of the display screen, and includes: the terminal acquires the resolution supported by the external display equipment; the terminal determines the size of the display screen according to the resolution supported by the external display device.

In a second aspect, an embodiment of the present application provides an image processing method for a terminal, where the terminal is connected to an external display device, the method including: the terminal sends the generated initial display picture to external display equipment for displaying; the terminal sends a setting interface for adjusting the size of a display picture of external display equipment to the external display equipment for displaying, wherein the setting interface comprises at least one candidate picture size; and responding to a target picture size selected by a user in the candidate picture sizes, and sending the generated target display picture to an external display device for displaying, wherein the target display picture and the initial display picture have the same size, the display content of a target area in the target display picture is obtained by reducing the initial display picture, and the size of the target area is the size of the target picture.

In a third aspect, an embodiment of the present application provides a terminal, including: the display control device comprises a generating unit, a display control unit and a display control unit, wherein the generating unit is used for generating a target display picture to be displayed for an external display device, a target area in the target display picture is used for laying out display content in the target display picture, and the target area is a part of the target display picture; and the transceiving unit is used for transmitting the target display picture to the external display equipment for displaying.

In one possible design method, the terminal further includes: a determination unit configured to determine a display screen size, which is a size of a screen transmitted to an external display device; the target display has the display size.

In one possible design method, the generating unit is specifically configured to generate an initial display screen for content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display picture into the target display picture, wherein the display content of the target area in the target display picture is obtained by reducing the initial display picture.

In a possible design method, the generating unit is specifically configured to fill the target area with content to be displayed by an external display device, so as to obtain the target display screen.

In a possible design method, the generating unit is further configured to generate, for the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the receiving and sending unit is also used for sending the setting interface to external display equipment for displaying; the determining unit is further configured to determine a scaling between the initial display screen and the target area in the target display screen according to an input operation of a user on the setting interface.

In a possible design method, the generating unit is further configured to generate, for the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the receiving and sending unit is also used for sending the setting interface to external display equipment for displaying; the determining unit is further used for determining the size of the target area in the target display picture according to the input operation of the user on the setting interface.

In one possible design method, the generating unit is specifically configured to generate a setting interface for adjusting a display screen size for the external display device in response to a setting operation of the external display device by a user; or when the terminal is successfully connected with the external display device, generating a setting interface for adjusting the size of the display screen for the external display device.

In a possible design method, the transceiver unit is further configured to obtain a resolution supported by the external display device; the determining unit is specifically configured to determine the display screen size according to a resolution supported by the external display device.

In a fourth aspect, an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, and the terminal includes a processor, a memory, and a transceiver connected through a bus, where the processor is configured to generate a target display screen to be displayed for the external display device, a target area in the target display screen is used to lay out display content in the target display screen, and the target area is a part of the target display screen; the transceiver is used for transmitting the target display picture to an external display device for display

In one possible design approach, before generating a target display screen to be displayed for the external display device, the processor is further configured to determine a display screen size, which is a size of a screen sent to the external display device; the target display has the display size.

In one possible design method, the processor is specifically configured to generate an initial display screen for content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display picture into the target display picture, wherein the display content of the target area in the target display picture is obtained by reducing the initial display picture.

In a possible design method, the processor is specifically configured to fill the target area with content to be displayed by an external display device, so as to obtain the target display screen.

In one possible design method, the processor is further configured to generate a setting interface for the external display device, where the setting interface is used for adjusting a display screen size of the external display device, and includes at least one candidate screen size; the transceiver is also used for transmitting the setting interface to external display equipment for displaying; receiving input operation of a user on the setting interface; the processor is further configured to determine a scaling between the initial display and the target area in the target display.

In one possible design method, the processor is further configured to generate a setting interface for the external display device, where the setting interface is used for adjusting a display screen size of the external display device, and includes at least one candidate screen size; the transceiver is also used for transmitting the setting interface to external display equipment for displaying; receiving input operation of a user on the setting interface; the processor is further used for determining the size of the target area in the target display picture according to the input operation of the user on the setting interface.

In one possible design method, the setting interface further includes a screen preview effect of the external display device at the candidate screen size.

In one possible design approach, the processor is specifically configured to: generating a setting interface for adjusting the size of a display screen for the external display device in response to a setting operation of the external display device by a user; or when the terminal is successfully connected with the external display device, generating a setting interface for adjusting the size of the display screen for the external display device.

In one possible design method, the target area is located in the center of the target display screen, and the other areas of the target display screen except the target area are provided with ground colors.

In one possible design method, the target ratio of the target area to the target display screen is smaller than or equal to the extraction ratio of the display screen when the external display device overscans.

In one possible design approach, the transceiver is further configured to obtain a resolution supported by the external display device; the processor is specifically configured to determine the display screen size according to a resolution supported by the external display device.

In a fifth aspect, an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, and the terminal includes a processor, a memory, and a transceiver connected through a bus, where the processor is configured to generate an initial display screen for the external display device; generating a setting interface for adjusting the size of a display screen of the external display device; generating a target display picture for external display equipment, wherein the target display picture and the initial display picture have the same size, the display content of a target area in the target display picture is obtained by reducing the initial display picture, and the size of the target area is the size of the target picture; the transceiver is used for transmitting the initial display picture to external display equipment for display; sending the setting interface to an external display device for displaying; and sending the target display picture to an external display device for displaying.

In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, where instructions are stored, and when the instructions are executed on any one of the terminals, the instructions cause the terminal to execute any one of the image processing methods.

In a seventh aspect, an embodiment of the present application provides a computer program product including instructions, which, when run on any one of the above-mentioned terminals, causes the terminal to execute any one of the above-mentioned image processing methods.

In the embodiments of the present application, the names of the components in the terminal do not limit the device itself, and in practical implementations, the components may appear by other names. Insofar as the functions of the respective components are similar to those of the embodiments of the present application, they are within the scope of the claims of the present application and their equivalents.

In addition, the technical effects brought by any one of the design manners in the second aspect to the seventh aspect can be referred to the technical effects brought by the different design methods in the first aspect, and are not described herein again.

Drawings

FIG. 1 is a diagram illustrating an application scenario of overscan in the prior art;

fig. 2 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 3 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 4 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present application;

fig. 6 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 7 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 8 is an interaction diagram of an image processing method according to an embodiment of the present application;

fig. 9 is a schematic view six of an application scenario of an image processing method according to an embodiment of the present application;

fig. 10 is a schematic view seventh of an application scenario of an image processing method according to an embodiment of the present application;

fig. 11 is an application scenario diagram eight of an image processing method according to an embodiment of the present application;

fig. 12 is a schematic view nine of an application scenario of an image processing method according to an embodiment of the present application;

fig. 13 is a schematic view ten of an application scenario of an image processing method according to an embodiment of the present application;

fig. 14 is an eleventh application scenario schematic diagram of an image processing method according to an embodiment of the present application;

fig. 15 is a schematic view twelve of an application scenario of an image processing method according to an embodiment of the present application;

fig. 16A is a schematic view thirteen of an application scenario of an image processing method according to an embodiment of the present application;

fig. 16B is a schematic view fourteen of an application scene of an image processing method according to an embodiment of the present application;

fig. 17 is a schematic view fifteen illustrating an application scenario of an image processing method according to an embodiment of the present application;

fig. 18 is a schematic view sixteen illustrating an application scenario of an image processing method according to an embodiment of the present application;

fig. 19 is a schematic structural diagram of a terminal according to an embodiment of the present application;

fig. 20 is a third schematic structural diagram of a terminal according to an embodiment of the present application.

Detailed Description

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.

The image processing method of the terminal provided by the embodiment of the application can be applied to the terminal, and particularly can be applied to the process of projecting the display picture of the terminal to the external display device for display when the terminal is connected with the external display device.

In the embodiment of the application, the terminal may be connected to the external display device through the switching device, or the terminal may be connected to the external display device through a wireless connection. And, when the terminal is connected to an external display device, the external display device may be connected to an external device (such as a keyboard and/or a mouse), and the external display device may also be disconnected from the external device.

For example, the terminal in the embodiment of the present invention may be a mobile phone, a tablet computer, a wearable device, an Augmented Reality (AR) \ Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), and the like, which is not limited in this respect. The external display device in the embodiment of the present invention may be any display device such as a display of a PC, a television, a tablet computer, or a projector.

For example, the following description will be made of a connection manner between the terminal and the external display device, taking the terminal as a mobile phone and the external display device as a display as an example:

as shown in fig. 2, thehandset 110 may be connected to thedisplay 120 through a pass-throughdevice 130. Theswitching device 130 may be plugged with a Universal Serial Bus (USB) interface of a data line of the mobile phone, and a Type-c interface of a terminal data line is plugged in themobile phone 110. Theadaptor device 130 may also be connected to thedisplay 120 through an adaptor line, which may include any one of a High Definition Multimedia Interface (HDMI) connection line, a video graphics Array (AGI) connection line, a Digital Video Interface (DVI) connection line, and the like.

Theswitching device 130 in the embodiment of the present invention may be a mobile high-definition link (MHL) device, and the MHL device may transmit an audio or video signal in a mobile terminal (such as a mobile phone) to an external display device (i.e., the display 120) for display.

Alternatively, as shown in FIG. 3, thehandset 110 may be connected to thedisplay 120 through awireless connection 201. Thewireless connection 201 may be a bluetooth connection or a wireless-fidelity (Wi-Fi) connection.

As shown in fig. 2 or fig. 3, after themobile phone 110 is connected to thedisplay 120, theswitching device 130 may not be connected to the keyboard and/or the mouse, and themobile phone 110 may be used as a touch pad to control the external display device. Alternatively, theswitching device 130 may further include an interface for connecting a keyboard and a mouse, and a connection line for connecting the keyboard and the mouse. Of course, the keyboard and mouse may also be connected to thehandset 110 in a wireless manner.

Optionally, the handset may also be connected to thedisplay 120 via aDock device 122 as shown in fig. 4. Themobile phone 110 may also be connected with a keyboard and a mouse. For example, the keyboard and mouse may be connected to theDock device 122 via a connection line, or the keyboard and mouse may be connected to thecell phone 110 or theDock device 122 via a wireless connection. TheDock device 122 may be one of the MHL devices described above.

Fig. 5 is a schematic structural diagram of themobile phone 110. It should be understood that the illustratedhandset 110 is only one example of the above-described terminal, and that thehandset 110 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components.

As shown in fig. 5, themobile phone 110 may specifically include: aprocessor 101, Radio Frequency (RF)circuitry 102, amemory 103, atouch screen 104, abluetooth device 105, one ormore sensors 106, a WIreless-Fidelity (Wi-Fi)device 107, apositioning device 108,audio circuitry 109, aperipheral interface 110, and apower system 111. These components may communicate over one or more communication buses or signal lines (not shown in fig. 5). Those skilled in the art will appreciate that the hardware configuration shown in fig. 5 is not intended to be limiting, and that thehandset 110 may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes the components of thehandset 110 in detail with reference to fig. 5:

theprocessor 101 is a control center of thecellular phone 110, connects various parts of thecellular phone 110 by various interfaces and lines, and performs various functions of thecellular phone 110 and processes data by running or executing an application program stored in thememory 103 and calling data stored in thememory 103. In some embodiments,processor 101 may include one or more processing units; for example, theprocessor 101 may be an kylin 960 chip manufactured by Huanti technologies, Inc. In some embodiments of the present application, theprocessor 101 may further include a fingerprint verification chip for verifying the acquired fingerprint.

Therf circuit 102 may be used for receiving and transmitting wireless signals during the transmission and reception of information or calls. In particular, therf circuit 102 may receive downlink data of the base station and then process the received downlink data to theprocessor 101; in addition, data relating to uplink is transmitted to the base station. Typically, the radio frequency circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, theradio frequency circuitry 102 may also communicate with other devices via wireless communication. The wireless communication may use any communication standard or protocol including, but not limited to, global system for mobile communications, general packet radio service, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.

Thememory 103 is used for storing application programs and data, and theprocessor 101 executes various functions and data processing of themobile phone 110 by running the application programs and data stored in thememory 103. Thememory 103 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs (such as a sound playing function and an image playing function) required by at least one function; the storage data area may store data (e.g., audio data, a phonebook, etc.) created from use of thehandset 110. Further, thememory 103 may include a high speed Random Access Memory (RAM), and may also include a non-volatile memory, such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device. Thememory 103 may store various operating systems, such as those developed by apple Inc

Operating System, developed by Google

An operating system, etc. Thememory 103 may be independent and connected to theprocessor 101 through the communication bus; thememory 103 may also be integrated with theprocessor 101.

Thetouch screen 104 may specifically include a touch pad 104-1 and a display 104-2.

Wherein the touch pad 104-1 can capture touch events on or near thecell phone 110 by a user (e.g., user operation on or near the touch pad 104-1 using any suitable object such as a finger, stylus, etc.) and transmit the captured touch information to another device (e.g., the processor 101). Among them, a touch event of a user near the touch pad 104-1 can be called a hover touch; hover touch may refer to a user not needing to directly contact the touchpad in order to select, move, or drag a target (e.g., an icon, etc.), but only needing to be located near the terminal in order to perform a desired function. In addition, the touch pad 104-1 can be implemented by various types, such as resistive, capacitive, infrared, and surface acoustic wave.

Display (also referred to as a display screen) 104-2 may be used to display information entered by or provided to the user as well as various menus forhandset 110. The display 104-2 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The trackpad 104-1 may be overlaid on the display 104-2, and when the trackpad 104-1 detects a touch event thereon or nearby, it is communicated to theprocessor 101 to determine the type of touch event, and theprocessor 101 may then provide a corresponding visual output on the display 104-2 based on the type of touch event. Although in FIG. 5, the touch pad 104-1 and the display screen 104-2 are shown as two separate components to implement the input and output functions of thecell phone 110, in some embodiments, the touch pad 104-1 and the display screen 104-2 may be integrated to implement the input and output functions of thecell phone 110.

It is understood that thetouch screen 104 is formed by stacking multiple layers of materials, and only the touch pad (layer) and the display screen (layer) are shown in the embodiment of the present application, and other layers are not described in the embodiment of the present application. In addition, the touch pad 104-1 may be disposed on the front surface of themobile phone 110 in a full-panel manner, and the display screen 104-2 may also be disposed on the front surface of themobile phone 110 in a full-panel manner, so that a frameless structure can be implemented on the front surface of the mobile phone.

Thehandset 110 may also include abluetooth device 105 for enabling data exchange between thehandset 110 and other short-range terminals (e.g., cell phones, smart watches, etc.). The bluetooth device in the embodiment of the present application may be an integrated circuit or a bluetooth chip.

Thehandset 110 may also include at least onesensor 106, such as afingerprint acquisition device 112, a light sensor, a motion sensor, and other sensors. In particular, thefingerprint acquisition device 112 may be disposed on the back side of the handset 110 (e.g., below the rear camera), or thefingerprint acquisition device 112 may be disposed on the front side of the handset 110 (e.g., below the touch screen 104). For another example, thefingerprint acquisition device 112 may be configured in thetouch screen 104 to implement a fingerprint identification function, that is, thefingerprint acquisition device 112 may be integrated with thetouch screen 104 to implement a fingerprint identification function of themobile phone 110; the light sensor may include an ambient light sensor that adjusts the brightness of the display of thetouch screen 104 based on the intensity of ambient light, and a proximity sensor that turns off the display when thecell phone 110 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on themobile phone 110, further description is omitted here.

The Wi-Fi device 107 is used for providing themobile phone 110 with network access conforming to Wi-Fi related standard protocols, themobile phone 110 can access to a Wi-Fi access point through the Wi-Fi device 107, so that the user can be helped to receive and send emails, browse webpages, access streaming media and the like, and wireless broadband internet access is provided for the user. In other embodiments, the Wi-Fi device 107 can also act as a Wi-Fi wireless access point and can provide Wi-Fi network access to other terminals.

Apositioning device 108 for providing a geographic location for thehandset 110. It is understood that thepositioning device 108 may be a receiver of a Global Positioning System (GPS) or a positioning system such as the beidou satellite navigation system, russian GLONASS, etc. After receiving the geographical location transmitted by the positioning system, thepositioning device 108 transmits the information to theprocessor 101 for processing or transmits the information to thememory 103 for storage. In some other embodiments, thepositioning device 108 may also be an Assisted Global Positioning System (AGPS) receiver, which assists thepositioning device 108 in performing ranging and positioning services by acting as an assist server, in which case the assist server provides positioning assistance by communicating with the positioning device 108 (i.e., GPS receiver) of a terminal, such as ahandset 110, over a wireless communication network. In other embodiments, thelocation device 108 may also be a Wi-Fi access point based location technology. Because each Wi-Fi access point has a globally unique Media Access Control (MAC) address, the terminal can scan and collect broadcast signals of the surrounding Wi-Fi access points under the condition of starting Wi-Fi, and therefore the MAC address broadcasted by the Wi-Fi access points can be acquired; the terminal sends the data (such as the MAC address) capable of indicating the Wi-Fi access point to the location server through the wireless communication network, the location server retrieves the geographical location of each Wi-Fi access point, and calculates the geographical location of the terminal according to the strength of the Wi-Fi broadcast signal and sends the geographical location of the terminal to thepositioning device 108 of the terminal.

Theaudio circuitry 109,speaker 113,microphone 114 may provide an audio interface between a user and thehandset 110. Theaudio circuit 109 may transmit the electrical signal converted from the received audio data to thespeaker 113, and convert the electrical signal into a sound signal by thespeaker 113 for output; on the other hand, themicrophone 114 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by theaudio circuit 109, and outputs the audio data to theRF circuit 102 to be transmitted to, for example, another cellular phone, or outputs the audio data to thememory 103 for further processing.

Peripheral interface 110, which is used to provide various interfaces for external input/output devices (e.g., keyboard, mouse, external display, external memory, SIM card, etc.). For example, a mouse via a Universal Serial Bus (USB) interface, and a Subscriber Identity Module (SIM) card provided by a telecommunications carrier via metal contacts on a card slot of the SIM card.Peripheral interface 110 may be used to couple the aforementioned external input/output peripherals toprocessor 101 andmemory 103.

Thehandset 110 may further include a power supply device 111 (such as a battery and a power management chip) for supplying power to each component, and the battery may be logically connected to theprocessor 101 through the power management chip, so as to implement functions of managing charging, discharging, and power consumption through thepower supply device 111.

Although not shown in fig. 5, themobile phone 110 may further include a camera (front camera and/or rear camera), a flash, a micro-projector, a Near Field Communication (NFC) device, and the like, which are not described herein.

In the embodiment of the present application, after themobile phone 110 is connected to theexternal display device 120, themobile phone 110 is equivalent to have two displays, one is a display of themobile phone 110 itself, and the other is a display of theexternal display device 120 connected thereto. Themobile phone 110 may project the application installed on themobile phone 110 onto the display of theexternal display device 120 by a method of the homogeneous display or the heterogeneous display.

The homologous display means that signal sources of display pictures in different displays, for example, the display of themobile phone 110 and the display of theexternal display device 120 are the same; the heterogeneous display means that the signal source of the display screen of the display of themobile phone 110 is independent from the signal source of the display screen of the display of theexternal display device 120.

When themobile phone 110 projects its installed application onto the display of theexternal display device 120 in a homologous manner, as shown in fig. 6, before themobile phone 110 establishes a connection with theexternal display device 120, themobile phone 110 stores the generated display content to be displayed in a specified location of the memory (an area storing the display content to be displayed on the screen is referred to as a screen container in this application). Thus, the display of themobile phone 110 can display the related picture by reading the display content in the screen container. After themobile phone 110 and theexternal display device 120 are connected, as shown in fig. 6, themobile phone 110 may send the display content in the screen container to theexternal display device 120, so that theexternal display device 120 displays the same display content as themobile phone 110, and themobile phone 110 and theexternal display device 120 are synchronously displayed.

When themobile phone 110 projects the installed application to the display of theexternal display device 120 in a different source, as shown in fig. 7, before themobile phone 110 establishes a connection with theexternal display device 120, themobile phone 110 stores the generateddisplay content 1 to be displayed in thescreen container 1 of the memory, so that the display of themobile phone 110 can display the relevant picture by reading thedisplay content 1 in thescreen container 1.

When themobile phone 110 establishes a connection with theexternal display device 120, themobile phone 110 may recognize related specification information of the display of theexternal display device 120 connected thereto, such as resolution and Dots Per Inch (DPI) of the display of theexternal display device 120. At this time, themobile phone 110 may establish an independent screen container, i.e., thescreen container 2 in fig. 7, for theexternal display device 120 in its memory according to the specification information of the display of theexternal display device 120, where thescreen container 2 and thescreen container 1 may be distinguished by different display identifiers (display IDs).

Generally, for applications that support both display on themobile phone 110 and display on theexternal display device 120, such applications generally store two display resources in themobile phone 110, one display resource corresponds to themobile phone 110, the other display resource corresponds to theexternal display device 120, and the layout and display effect of the same display content (e.g., an icon of an application) may be different in different display resources. Then, after the connection between themobile phone 110 and theexternal display device 120 is established, as shown in fig. 7, themobile phone 110 may read the display resource stored in theexternal display device 120, and store the desktop display contents such as the application icons, the icon layout, and the status bar in the display resource into thescreen container 2. In this way, after themobile phone 110 sends the display content in thescreen container 2 to theexternal display device 120, the icons and/or interfaces of the applications installed on themobile phone 110 can be independently projected onto the display of theexternal display device 120. Subsequently, themobile phone 110 and theexternal display device 120 can independently run two display frames under the same operating system according to the display contents in the respective screen containers.

Of course, in the heterogeneous projection system shown in fig. 7, the display content in thescreen container 1 may also be the same as the display content in thescreen container 2, for example, the display content in thescreen container 1 and the display content in thescreen container 2 are both the 10 th minute display interface of the video a. In this way, the display contents in the display of thecellular phone 110 can be synchronously displayed in the display of theexternal display device 120.

It should be noted that, the screen container may specifically be a buffer queue for storing display contents generated by each task in the task queue when the terminal (for example, the mobile phone 110) runs each task in the task queue. Generally, a task located at the head of a task queue is a task currently running by a terminal, display content generated when the terminal runs the task can be stored at the head of the buffer queue, and a display of the terminal always reads and displays the display content located at the head of the buffer queue.

Hereinafter, an image processing method of a terminal according to an embodiment of the present application will be described in detail with reference to the screen projection principle shown in fig. 2 to 7, and as shown in fig. 8, the method includes:

and S701, connecting the terminal with an external display device.

Illustratively, as shown in any one of fig. 2 to 4, the terminal may be connected to the external display device through a wired connection or a wireless connection.

S702, the terminal determines the size of a display screen when the display screen is sent to the external display equipment subsequently.

When the terminal is connected with the external display device, the terminal can detect display parameters such as resolution of the external display device, and further determine the display screen size of a display screen which needs to be sent to the external display device subsequently. For example, the external display device supports image display in 1080P format, the terminal may determine that the display size of a display subsequently transmitted to the external display device is a display of 1920 × 1080 resolution size corresponding to 1080P format.

For example, the terminal may display a "large screen project welcome interface" 117 on its display screen as shown in fig. 2 or 3. Meanwhile, the terminal may generate a "welcome to use large screen projection"prompt 121 for the external display device, and send the prompt 121 to the external display device, so that the external display device displays the "welcome to use large screen projection" prompt 121 as shown in fig. 2 or fig. 3.

For example, taking fig. 2 as an example, the terminal may display an operation description for performing the large screen projection function in the "large screen projection welcome interface" 117. When the user clicks the "skip"option 113 in the "large screen projected welcome interface" 117 shown in the terminal of fig. 2, or the "large screen projected welcome interface" 117 shown in fig. 2 is displayed on the terminal for a certain time, the terminal may display the terminal interface 801 shown in fig. 9 on the display screen of the terminal, and display thelarge screen interface 802 shown in fig. 9 on the external display device according to the determined display screen size.

When the external display device displays thelarge screen interface 802, if an overscan option is selected in advance in the system setting of the external display device, the external display device may intercept and display 95% of display content located in the center from thelarge screen interface 802 sent by the terminal for display. At this time, as shown in fig. 10, the display screen of the external display device is a large screen interface 802 ', and since some display contents located at the edge of the originallarge screen interface 802 are not extracted when the external display device performs overscan, an incomplete display screen appears at theedge 803 on the large screen interface 802' after overscan.

And S703, the external display device displays a setting interface for adjusting the size of the display screen of the external display device.

In step S702, in order to avoid the incomplete display screen caused by overscan when the terminal projects a screen to the external display device, after the terminal establishes a connection with the external display device and completes an initialization process of the display of the external display device, as shown in fig. 11, the external display device may display a setting interface 1001 for adjusting the size of the display screen of the external display device.

Illustratively, a user may perform a right key operation on the large screen interface 802 (or the large screen interface 802') of the external display device through a mouse, the external display device transmits the right key operation input by the user to the terminal, and the terminal generates a right key menu for the external display device in response to the right key operation and transmits the right key menu to the external display device for display. If the external display device detects that the user selects the screen setting option in the right-click menu, the external display device may request the terminal to display the setting interface 1001. After receiving the request of the external display device, the terminal generates a setting interface 1001 shown in fig. 11 for the external display device, and sends the setting interface to the external display device for displaying.

Alternatively, as shown in fig. 12, the terminal may enter a keyboard and mouse simulation function, and atouch pad interface 1101 shown in fig. 12 is displayed on a display screen of the terminal. Thus, when the user's finger 1104 contacts thetouch pad interface 1101 shown in FIG. 12 and moves across thetouch pad interface 1101, the cursor in the large screen interface 1102 shown in FIG. 12 can be controlled to move accordingly. Then, the user may execute the right key operation and the selection operation of the screen setting option on the external display device through thetouch pad interface 1101, trigger the terminal to generate the setting interface 1001 shown in fig. 11 for the external display device, and send the setting interface to the external display device for displaying.

Or, after the terminal is successfully connected to the external display device, the terminal may be automatically triggered to generate the setting interface 1001 shown in fig. 11 for the external display device, and send the setting interface to the external display device for displaying, which is not limited in this embodiment of the application.

Specifically, the setting interface 1001 may include sizes of a plurality of candidate screen sizes. As shown in fig. 11, three candidate screen sizes are included in the setting interface 1001, one is afull screen size 1101 in which the display screen fills the screen, one is a medium screen size 1102 in which the display screen occupies 95% of the screen, and one is asmaller screen size 1103 in which the display screen occupies 85% of the screen.

Also, as shown in fig. 11, the setting interface 1001 also shows the screen preview effect for each candidate screen size, respectively. The preview effect of each screen may be a preview effect of any display screen when the external display device does not perform the overtscan process, or a preview effect obtained by performing the overtscan on any display screen according to a default extraction ratio (for example, a 95% screen extraction ratio) of the display screen at the overtscan process, which is not limited in this embodiment of the present application.

Taking a moderate screen size 1102 with a display screen occupying 95% of the screen as an example, when the terminal transmits a subsequent display screen to be displayed (for example, thelarge screen interface 802 shown in fig. 9) to the external display device, as shown in fig. 13, an image (i.e., an initial display screen) in thelarge screen interface 802 may be reduced by 95% from an original full screen size, and the image after being reduced by 95% is adjusted to the center of the large screen interface to obtain a target display screen with a size equal to that of the initial display screen, where at this time, a target area located in 95% of the center in the target display screen is an effective screen with substantial display content.

Then, after the terminal sends the target display screen to the external display device, as shown in fig. 13, the external display device performs overscan on the received target display screen, that is, captures a screen of 95% of the center of the target display screen. In this way, the picture captured by the external display device is just the effective picture in the target display picture, and at this time, the completelarge screen interface 802 can be displayed in the external display device, so that the problem of incomplete display picture caused by overscan is solved. Therefore, as shown in fig. 11, the medium screen size 1002 can be presented to the user as a recommended size.

For another example, taking thesmaller screen size 1103 with the display screen accounting for 85% of the screen as an example, when the terminal transmits the initial display screen to be displayed to the external display device (still taking thelarge screen interface 802 shown in fig. 9 as an example), as shown in fig. 14, the image in thelarge screen interface 802 may be reduced by 85% from the original full screen size, and the image after being reduced by 85% is adjusted to the center of the large screen interface to obtain the target display screen with the size equal to that of the initial display screen, at this time, the target area located in 85% of the center in the target display screen is an effective screen with substantial display content.

Then, after the terminal sends the target display screen to the external display device, as shown in fig. 14, the external display device performs overscan on the received target display screen, that is, captures 95% of the center of the target display screen for display. Since the captured picture at the overtscan is larger than the effective picture, the external display device can still display the completelarge screen interface 802 when displaying.

In other embodiments of the present application, as shown in fig. 15, the external display device may further display each candidate screen size in the setting interface 1001 in the form of aprogress bar 1401, and the user may change the progress of the progress bar by dragging theslider 1402 of theprogress bar 1401, so as to select the corresponding candidate screen size as a target screen size when a subsequent external display device displays.

Still as shown in fig. 15, when the user drags theslider 1402, the external display device may display ascreen preview effect 1403 of the candidate screen size at the slider position in the setting interface 1001, so that the user selects a screen size conforming to the own use habit according to the screen preview effect.

And S704, responding to the input operation of the user on the setting interface, and obtaining the target picture size selected by the user by the terminal.

The target screen size may be used to indicate the size of a target area having substantial display content in a target display screen generated by the terminal. For example, the target screen size may be a target ratio between the target area and the target display screen, for example, 95%, that is, 95% of the target display screens subsequently sent by the terminal to the external display device are screens with substantial display content; for another example, the target screen size may be a size of a target area in the target display screen, for example, a target area of 1900 × 1000 resolution.

After the user selects a candidate screen size from the candidate screen sizes provided by the setting interface 1001, the external display device may send the candidate screen size selected by the user as a target screen size to the terminal, where the target screen size may include a target ratio of a display screen on the subsequent external display device to a screen of the external display device. Of course, the target frame size may also include the ratio of the length to the height of the subsequent display frame, such as 16: 9. Therefore, when the terminal transmits the real-time display picture to the external display equipment subsequently, the display picture can be zoomed according to the target picture size, and a signal source of the complete display picture is provided for the external display equipment.

Specifically, the method for displaying by the signal source that provides the complete display screen for the external display device by the terminal may be referred to the following steps S705-S707, where the steps S705 and S705' are two optional implementations.

S705, the terminal converts an initial display picture to be displayed by the external display device into a target display picture adaptive to the size of the target picture, wherein the initial display picture and the target display picture both have the display picture size determined in the step 702.

After the terminal acquires the target picture size set by the user for the external display device, the target picture size can be stored in a memory of the terminal. Subsequently, when the user triggers the external display device to display, for example, when the user opens a certain application displayed on the external display device, the external display device may send an input event triggered by the user to the terminal, and the terminal generates a to-be-displayed picture, for example, an initial display picture, with the size of the display picture for the external display device.

In this case, taking the target screen size of 80% of the screen as an example, as shown in fig. 16A, the terminal may generate an initial display screen 1501 for the external display device to have a size of 10 × 10 that matches the respective rates of the external display device, and the terminal may reduce the generated initial display screen 1501 by 80% in accordance with the target screen size of 80% to obtain a scaled screen 1502 of 8 × 8. Further, the 8 × 8 zoom screen 1502 is adjusted to the center of the target position with reference to the target position where the initial display screen 1501 is located. As shown in fig. 16, the terminal may move the zoom screen 1502 of 8 × 8 by 10 × 10% to 1 in the positive direction of the X axis and by 10 × 10% to 1 in the positive direction of the Y axis, so that the zoom screen 1502 moves to the center of the target position where the original initial display screen is located. At this time, the terminal fills the periphery of the zoom screen 1502 with black or other colors to obtain the target display screen 1503 having the same size as the initial display screen 1501. It can be seen that the target display screen 1503 has the same size as the initial display screen 1501, but the area of the effective screen in the target display screen 1503 occupies 80% of the entire target display screen 1503, that is, 80% of the target area for laying out the display content is provided in the target display screen 1503.

As shown in fig. 17, the initial display screen 1501 may be the entire display interface to be displayed on the external display device, or may be one or more windows (windows) in the entire display interface, or may be a specific icon in the window, which is not limited in this embodiment of the application.

For example, the Android operating system is taken as an example, the Android operating system may be divided into four layers, from a high layer to a low layer, an application layer (i.e., APP layer), an application Framework layer (i.e., Framework layer), a system runtime layer (i.e., Libraries layer), and a Linux kernel layer.

The Linux kernel layer can be used as an abstraction layer between hardware (such as a CPU, a network card, a memory and the like) and a software stack, and can hide specific hardware details so as to provide uniform service for upper layers (a system runtime layer, an application framework layer and an application layer). The system operation library layer comprises some C/C + + libraries, such as a media library, a system C library, a display management library (Surface Manager) and the like, the libraries can be used by different components in the Android system, and the system operation library layer can provide services for developers through a Framework layer. The Framework layer provides developers with an API Framework that can fully access applications. Specifically, the Framework layer provides a great number of APIs for developing application programs, and an APP meeting related service requirements can be constructed by calling the corresponding APIs. And the application program layer mainly comprises an APP written by java language, and when a user operates an operation interface on the APP, the user interacts with a system operation library layer or a Linux kernel layer by calling a related API in the Framework layer to realize a function corresponding to the operation interface.

Then, in this embodiment of the present application, as shown in fig. 18, the system service (system service) maintained by the Framework layer includes a window manager service (window management service), and a PC manager service (PC management service) dedicated to maintaining and implementing a PC function of the terminal, where a target picture size sent by an external display device is maintained in the PC manager service. The window manager service is provided with a window state identifier (window state renderer), generally, the Activity of each application corresponds to one window, and the window state identifier can be used for rendering and managing the window surface and the window animation of the window.

In this way, when the window state identifier draws each window (for example, the initial display screen a) for the external display device, the window state identifier can acquire the target screen size set by the user from the PC manager service, and further draw the target display screen a according to the target screen size.

It should be noted that, in this embodiment of the application, when the initial display screen is a complete display interface to be displayed on the external display device, the display interface generally includes one or more windows (or icons), and then the terminal may convert each window (or icon) according to the method described in step S704 when drawing each window (or icon), so as to finally obtain a converted target display screen; after the entire display interface is drawn, the display interface may be converted according to the method described in step S704, and a converted target display picture may also be obtained, which is not limited in this embodiment of the application.

In addition, the terminal may also pre-store one or more target type windows that do not require resizing of the display, such as a wallpaper type window. The edges of such a preset window usually do not contain important information required by the user, and therefore, after the image in such a window is over-scanned, the information required by the user is not lost. Then, when the terminal determines that the currently drawn window is the window of the target type, the terminal may draw the window by using the existing window drawing method without executing the step S704, and send the drawn window to an external display device for display; when the terminal determines that the currently drawn window is not the preset window, the window may be converted according to the method in the step S704, and finally the converted target display image is obtained.

S705', the terminal draws a target display picture to be displayed for the external display device according to the target picture size.

In another implementation manner of the present application, when the external display device needs to display a display with a certain display size, for example, a 10 × 10 desktop image, the terminal may modify an initial canvas (canvas) used by default when the system draws the display into a target canvas according to the target screen size set by the user, where the target canvas may only draw the display in a target area with the same size as the target screen size. Then, the subsequent terminal can draw the display screen in the target area of the target canvas, and at this time, the obtained target display screen is the same as the target display screen formed after conversion in step S704.

For example, taking the target screen size as 80% of the screen, as shown in fig. 16B, the terminal may first reduce the initial canvas 1601 of 10 × 10 to 8 × 8 according to the target screen size before drawing the screen to be displayed. Further, the background color forming and 10 × 10 target canvas 1602 is filled around the reduced initial canvas 1601. As can be seen, the target canvas 1602 is the same size as the initial canvas 1601, but only the 8 × 8 target area in the target canvas 1602 is available for drawing the display. Thus, as also shown in FIG. 16B, the terminal can arrange the display content in the display, such as text, images, and icons, within the target area of the target canvas 1602, resulting in the same target display as in FIG. 16A.

When the terminal draws display content in the target area of the target canvas 1602, the terminal may still reduce the size of the to-be-displayed element by 80% according to the size of the target screen and then lay out the to-be-displayed element in the target area, and certainly, the terminal may also lay out the to-be-displayed element in the preset size in the target area directly.

And S706, the terminal sends the target display screen to external display equipment.

S707, the external display device overscans the target display screen, and then outputs the overscan target display screen on the display.

In steps S705-S706, the terminal sends the scaled target display screen to the external display device, and at this time, as shown in fig. 13 or fig. 14, the external display device may overscan the received target display screen, for example, extract and display data located at 95% of the center of the target display screen. Then, since the area of the picture extracted by the external display device during overscan is greater than or equal to the area of the effective picture in the target display picture generated by the terminal, the information of the display picture received by the external display device in the terminal PC scene is complete, and the phenomenon of incomplete display picture caused by overscan can be avoided.

It should be noted that, in the above embodiments, only the extraction ratio of 95% from the external display device to the display screen in overtscan is used as an example, it is understood that a person skilled in the art may set the specific extraction ratio of overtscan according to the actual application scenario, and when the scaling ratio of the terminal to the initial display screen (i.e. the target screen size set by the user) is smaller than or equal to the extraction ratio from the display screen in overtscan of the external display device, the external display device may obtain a complete display screen after overtscan.

In addition, in the image processing method of the terminal provided by the present application, after the terminal establishes a connection with the external display device, if the external display device can detect the display frame extraction rate set in the overscan option by the current system, the external display device may send the display frame extraction rate to the terminal. Further, the terminal may automatically set the target screen size to a value corresponding to the display screen extraction rate. Then, when the subsequent terminal sends the initial display screen to be displayed to the external display device, the initial display screen may still be scaled by using the size of the target screen according to the method shown in the above steps S704-S706, and the scaled target display screen is sent to the external display device for displaying after overscan. Because the size of the target picture corresponds to the extraction rate of the display picture, the display picture obtained after the external display device performs overscan is just an effective picture in the target display picture, and at the moment, the target display picture can be displayed in the external display device to the maximum extent, so that the problem of incomplete display picture caused by overscan is solved.

It is to be understood that the above-mentioned terminal and the like include hardware structures and/or software modules corresponding to the respective functions for realizing the above-mentioned functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.

In the embodiment of the present application, the terminal and the like may be divided into functional modules according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

In the case of dividing the functional modules by corresponding functions, fig. 18 shows a possible structural diagram of the terminal involved in the above embodiment, and the terminal includes: a transmitting/receiving unit 1901, a determining unit 1902, and a generating unit 1903.

The transceiving unit 1901 is configured to support the terminal to perform the processes S701, S704, and S706 in fig. 7; the determining unit 1902 is configured to support the terminal to execute the process S702 in fig. 7; the generating unit 1903 is configured to support the terminal to execute the processes S705 and S705' in fig. 7. All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

In the case of using an integrated unit, the determination unit 1902 and the generation unit 1903 may be integrated into a processing module, the transceiver unit 1901 may be used as a communication module, and the terminal may further include a storage module, a display module, and the like.

At this time, as shown in fig. 20, a possible configuration diagram of the terminal involved in the above embodiment is shown. Theprocessing module 2002 is configured to control and manage the actions of the terminal. The communication module 2003 is used to support communication between the terminal and other network entities. Thememory module 2001 is used for storing program codes and data of the terminal. Thedisplay module 2004 serves to display information input by or provided to the user and various menus of the terminal.

In this embodiment of the present application, when the terminal is connected to an external display device through a communication module 2003, aprocessing module 2002 of the terminal may generate a target display screen to be displayed for the external display device, where a target area in the target display screen is used to lay out display content in the target display screen, and the target area is a part of the target display screen; furthermore, the communication module 2003 may send the target display screen to the external display device for displaying, so that image information lost during overscan by the external display device is reduced, thereby improving the incomplete display screen caused by overscan.

All relevant contents of the steps related to the image processing method can be referred to the relevant descriptions in the steps S701 to S704 of the above embodiment, and are not described herein again.

Illustratively, theProcessing module 2002 may be a Processor or a controller, such as a Central Processing Unit (CPU), a GPU, a general purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others.

The communication module 2003 may be a transceiver, a transceiver circuit, an input-output device, a communication interface, or the like. For example, the communication module 2003 may specifically be a Bluetooth device, a Wi-Fi device, a peripheral interface, and the like.

Thememory module 2001 may be a memory, which may include high speed Random Access Memory (RAM), and may also include non-volatile memory, such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.

Thedisplay module 2004 may be a display, and may specifically be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. In addition, a touch pad may be integrated with the display for collecting touch events thereon or nearby and transmitting the collected touch information to other devices (e.g., a processor, etc.).

When theprocessing module 2002 is a processor, the communication module 2003 is a radio frequency circuit, thestorage module 2001 is a memory, and thedisplay module 2004 is a display, the terminal provided in the embodiment of the present application may be themobile phone 110 shown in fig. 5.

In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware or any combination thereof. When implemented using a software program, may take the form of a computer program product, either entirely or partially. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (21)

1. An image processing method of a terminal, the terminal being connected to an external display device, the method comprising:

the terminal determines the size of a display picture, wherein the size of the display picture is the size of a picture sent to the external display equipment;

the terminal generates a target display picture to be displayed for the external display equipment, wherein the target display picture has the size of the display picture, a target area in the target display picture is used for laying out display content in the target display picture, and the target area is one part of the target display picture;

the method for generating a target display picture to be displayed for the external display device by the terminal includes:

the terminal generates an initial display picture for the content to be displayed by the external display equipment, wherein the initial display picture has the size of the display picture;

the terminal converts the initial display picture into the target display picture, and the display content of the target area in the target display picture is obtained by reducing the initial display picture;

the terminal sends the target display picture to the external display equipment for display;

before the terminal converts the initial display picture into the target display picture, the method further comprises the following steps:

the terminal generates a setting interface for adjusting the size of a display screen of the external display equipment for the external display equipment, wherein the setting interface comprises at least one candidate screen size;

the terminal sends the setting interface to the external display equipment for displaying;

and the terminal determines the scaling between the initial display picture and the target area in the target display picture according to the input operation of the user on the setting interface.

2. The method according to claim 1, wherein the terminal generates a target display screen to be displayed for the external display device, comprising:

and the terminal fills the content to be displayed by the external display equipment in the target area to obtain the target display picture.

3. The method according to claim 2, wherein before the terminal fills the target area with the content to be displayed by the external display device, the method further comprises:

the terminal generates a setting interface for adjusting the size of a display screen of the external display equipment for the external display equipment, wherein the setting interface comprises at least one candidate screen size;

the terminal sends the setting interface to the external display equipment for displaying;

and the terminal determines the size of the target area in the target display picture according to the input operation of the user on the setting interface.

4. The method according to claim 1, wherein a screen preview effect of the external display device at the candidate screen size is further included in the setting interface.

5. The method according to claim 3, wherein the setting interface further comprises a screen preview effect of the external display device at the candidate screen size.

6. The method according to any one of claims 1 to 5, wherein the terminal generates a setting interface for adjusting the size of the display screen for the external display device, and comprises the following steps:

responding to the setting operation of a user on the external display equipment, and generating a setting interface for adjusting the size of a display picture for the external display equipment by the terminal; or,

and when the terminal is successfully connected with the external display equipment, the terminal generates a setting interface for adjusting the size of a display picture for the external display equipment.

7. The method according to any one of claims 1 to 5, wherein the target area is located at the center of the target display screen, and the other areas of the target display screen except the target area are provided with a ground color.

8. The method according to any one of claims 1-5, wherein the target ratio of the target area to the target display is smaller than or equal to the extraction ratio of the display when the external display device overscans.

9. The method according to any one of claims 1-5-wherein the terminal determines a display size, comprising:

the terminal acquires the resolution supported by the external display equipment;

and the terminal determines the size of the display picture according to the resolution supported by the external display equipment.

10. An image processing method of a terminal, the terminal being connected to an external display device, the method comprising:

the terminal sends the generated initial display picture to the external display equipment for displaying;

the terminal sends a setting interface for adjusting the size of a display picture of the external display equipment to the external display equipment for displaying, wherein the setting interface comprises at least one candidate picture size;

and responding to a target picture size selected by a user in the candidate picture sizes, and sending the generated target display picture to the external display equipment for displaying by the terminal, wherein the target display picture and the initial display picture have the same size, the display content of a target area in the target display picture is obtained by reducing the initial display picture, and the size of the target area is the size of the target picture.

11. A terminal connected to an external display device, characterized in that the terminal comprises a processor, a memory and a transceiver connected by a bus, wherein,

the processor is used for determining the size of a display picture, wherein the size of the display picture is the size of a picture sent to the external display equipment;

the processor is further configured to generate a target display screen to be displayed for the external display device, where the target display screen has the display screen size; a target area in the target display picture is used for laying out display content in the target display picture, and the target area is a part of the target display picture;

the processor is further specifically configured to generate an initial display screen for content to be displayed by the external display device, where the initial display screen has the display screen size;

the terminal converts the initial display picture into the target display picture, and the display content of the target area in the target display picture is obtained by reducing the initial display picture;

the transceiver is used for sending the target display picture to the external display equipment for display;

the processor is further configured to generate a setting interface for the external display device, where the setting interface is used to adjust a display screen size of the external display device, and the setting interface includes at least one candidate screen size;

the transceiver is further used for sending the setting interface to the external display equipment for displaying; receiving input operation of a user on the setting interface;

the processor is further configured to determine a scaling between the initial display frame and the target area in the target display frame.

12. The terminal of claim 11,

the processor is specifically configured to fill content to be displayed by the external display device in the target area to obtain the target display screen.

13. The terminal of claim 12,

the processor is further configured to generate a setting interface for the external display device, where the setting interface is used to adjust a display screen size of the external display device, and the setting interface includes at least one candidate screen size;

the transceiver is further used for sending the setting interface to the external display equipment for displaying; receiving input operation of a user on the setting interface;

the processor is further configured to determine a size of the target area in the target display screen according to an input operation of a user on the setting interface.

14. The terminal according to claim 11, wherein the setting interface further comprises a screen preview effect of the external display device at the candidate screen size.

15. The terminal according to claim 13, wherein the setting interface further comprises a screen preview effect of the external display device at the candidate screen size.

16. The terminal according to any of claims 11-15,

the processor is specifically configured to: generating a setting interface for adjusting the size of a display screen for the external display device in response to a setting operation of the external display device by a user; or when the terminal is successfully connected with the external display device, generating a setting interface for adjusting the size of the display screen for the external display device.

17. The terminal according to any of claims 11-15, wherein the target area is located in the center of the target display, and the other areas of the target display except the target area are provided with a background color.

18. The terminal according to any of claims 11-15, wherein the target ratio of the target area to the target display is smaller than or equal to the extraction ratio of the display when the external display device overscans.

19. The terminal according to any of claims 11-15,

the transceiver is further configured to obtain a resolution supported by the external display device;

the processor is specifically configured to determine the size of the display screen according to a resolution supported by the external display device.

20. A terminal connected to an external display device, characterized in that the terminal comprises a processor, a memory and a transceiver connected by a bus, wherein,

the processor is used for generating an initial display picture for the external display equipment; generating a setting interface for adjusting the size of a display screen of the external display device; generating a target display picture for the external display device, wherein the target display picture and the initial display picture have the same size, the display content of a target area in the target display picture is obtained by reducing the initial display picture, and the size of the target area is the size of the target picture;

the transceiver is used for sending the initial display picture to the external display equipment for display; sending the setting interface to the external display equipment for displaying; and sending the target display picture to the external display equipment for display.

21. A computer-readable storage medium having instructions stored therein, which when run on a terminal, cause the terminal to perform the image processing method of any one of claims 1-9 or 10.

Images