CN113870812A

Movatterモバイル変換

Info

Publication number: CN113870812A
Application number: CN202111205752.8A
Authority: CN
Inventors: 王月文; 钟柳和; 高延凯
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-10-15
Filing date: 2021-10-15
Publication date: 2021-12-31
Anticipated expiration: 2041-10-15
Also published as: CN116504201A; CN113870812B; CN116645933A; WO2023061096A1

Abstract

Translated fromChinese

本申请属于显示技术领域，尤其涉及一种显示屏刷新帧率的调整方法、装置、处理器、芯片和终端，本申请实施例中，通过监测移动产业处理器接口的工作状态，并在移动产业处理器接口的工作状态发生变化时，调整显示屏进行图像显示的刷新帧率，使得显示屏的刷新帧率可以根据移动产业处理器接口的工作状态动态调整，因而，可以避免固定使用高刷新帧率进行显示，出现显示屏的功耗较大的问题，有助于降低显示屏的功耗，同时，具有更高的实时性。

The present application belongs to the field of display technology, and in particular relates to a method, device, processor, chip and terminal for adjusting the refresh frame rate of a display screen. When the working state of the processor interface changes, adjust the refresh frame rate of the display screen for image display, so that the refresh frame rate of the display screen can be dynamically adjusted according to the working state of the mobile industry processor interface, thus avoiding the fixed use of high refresh frames. Display at high rate, the problem of large power consumption of the display screen occurs, which helps to reduce the power consumption of the display screen, and at the same time, it has higher real-time performance.

Description

Method and device for adjusting refresh frame rate of display screen, processor, chip and terminal

Technical Field

The application belongs to the technical field of display, and particularly relates to a method, a device, a processor, a chip and a terminal for adjusting a refresh frame rate of a display screen.

Background

With the continuous development of display screen technology, more and more display screens capable of supporting high refresh frame rate to display images have been developed.

However, although the smoothness of the screen can be improved by displaying the screen at a fixed high refresh frame rate, the power consumption of the display screen is also high.

Disclosure of Invention

The embodiment of the application provides a method, a device, a processor, a chip and a terminal for adjusting a refresh frame rate of a display screen, which can adjust the refresh frame rate of the display screen and are beneficial to reducing the power consumption of the display screen.

A first aspect of an embodiment of the present application provides a method for adjusting a refresh frame rate of a display screen, where the method is applied to a terminal including the display screen, and the method includes:

monitoring the working state of a mobile industry processor interface;

and when the working state of the interface of the mobile industrial processor changes, adjusting the refresh frame rate of the display screen for image display.

A second aspect of the embodiments of the present application provides an apparatus for adjusting a refresh frame rate of a display screen, where the apparatus is configured in a terminal including the display screen, and the apparatus includes:

the monitoring unit is used for monitoring the working state of the mobile industry processor interface;

and the adjusting unit is used for adjusting the refresh frame rate of the display screen for image display when the working state of the interface of the mobile industrial processor changes.

A third aspect of the embodiments of the present application provides an application processor, where the application processor is configured in a terminal including a display screen, and the application processor is configured to:

monitoring the working state of a mobile industry processor interface;

and when the working state of the interface of the mobile industrial processor is about to enter an idle state from a data sending state, sending a frequency reduction instruction to a display driving chip of the display screen, wherein the frequency reduction instruction is used for indicating the display driving chip to reduce the refresh frame rate of the display screen for image display.

A fourth aspect of the embodiments of the present application provides a display driver chip, where the display driver chip is configured on a display screen of a terminal, and is configured to drive the display screen of the terminal to display an image, and the display driver chip is configured to:

monitoring the working state of a mobile industry processor interface;

A fifth aspect of the embodiments of the present application provides a display screen, where the display screen is configured with the display driver chip of the fourth aspect.

A sixth aspect of the embodiments of the present application provides a terminal including a display screen, where the display screen of the terminal is configured with the display driver chip according to the fourth aspect.

A seventh aspect of the embodiments of the present application provides a terminal including a display screen, where the terminal is configured with the application processor described in the third aspect.

An eighth aspect of an embodiment of the present application provides a terminal including a display screen, where the terminal includes an application processor, the display screen is configured with a display driver chip, the application processor is connected to the display driver chip through a mobile industry processor interface, and the terminal is configured to implement the method for adjusting the refresh frame rate of the display screen according to the first aspect, or the terminal is configured with the apparatus for adjusting the refresh frame rate of the display screen according to the second aspect.

A ninth aspect of embodiments of the present application provides a computer-readable storage medium, which stores a computer program that, when executed, implements the steps of the method of the first aspect.

In the embodiment of the application, by monitoring the working state of the interface of the mobile industrial processor and adjusting the refresh frame rate of the display screen for image display when the working state of the interface of the mobile industrial processor changes, the refresh frame rate of the display screen can be dynamically adjusted according to the working state of the interface of the mobile industrial processor, so that the problem that the display screen is large in power consumption due to the fact that the high refresh frame rate is fixedly used for display can be avoided, and the reduction of the power consumption of the display screen is facilitated.

In addition, because the working state of the interface of the mobile industry processor is determined by hardware logic, and the change of the working state is real-time, the method has higher real-time performance for adjusting the refresh frame rate of the display screen by monitoring the working state of the interface of the mobile industry processor.

Drawings

In order to more clearly illustrate the method for adjusting the refresh frame rate of the display screen according to the embodiment of the present application, the following figures that are needed in the embodiment will be briefly described, it should be understood that the following figures only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related figures may be obtained according to these figures without creative efforts.

FIG. 1 is a diagram illustrating an image display process under the AP-DDCI-Panel architecture;

FIG. 2 is a diagram illustrating an embodiment of an AP adjusting a refresh frequency according to an average frame rate indication DDIC in the related art;

fig. 3 is a schematic flowchart of a first implementation process of a method for adjusting a refresh frame rate of a display screen according to an embodiment of the present application;

fig. 4 is a schematic diagram of a first structure of a terminal provided in an embodiment of the present application;

fig. 5 is a schematic diagram of an operating state of the MIPI provided in the embodiment of the present application;

fig. 6 is a schematic flowchart of a second implementation process of the method for adjusting the refresh frame rate of the display screen according to the embodiment of the present application;

FIG. 7 is a diagram illustrating a first adjustment of a refresh frame rate of a display screen according to an embodiment of the present disclosure;

FIG. 8 is a diagram illustrating a second adjustment of a refresh frame rate of a display screen according to an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of an apparatus for adjusting a refresh frame rate of a display screen according to an embodiment of the present application;

fig. 10 is a second structural diagram of a terminal according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

"and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more, and "at least one", "one or more" means one, two or more, unless otherwise specified.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

The method of the embodiment of the present application may be applied to various terminals, for example, a mobile phone, a tablet computer, an in-vehicle device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), and other terminals including a display screen, and the specific type of the terminal is not limited in the embodiment of the present application. In addition, the display screen may be an Active-Matrix Organic Light-Emitting Diode (AMOLED) display screen.

For the AMOLED Display screen, under a driving architecture of an Application Processor (AP) -Display Driver chip (DDIC) -Display Panel (Panel), that is, under an AP-DDIC-Panel driving architecture, as shown in fig. 1, an AP end first performs drawing and rendering of a layer through an Application program (Application), then performs layer synthesis on the drawn layer through a Surface flunger to obtain image data, and further transmits (writes) the image data to the DDIC through a Mobile Industry Processor Interface (MIPI). The DDIC stores the image data sent from the AP to the Buffer, and controls Panel to perform image refresh Display (Display) by scanning (reading) the image data in the Buffer. Under a high refresh frame rate display scene, the AP end generates image data at high frequency, and correspondingly, the Panel side carries out high-frequency image refresh according to the image data, so that the fluency of the picture is improved.

In the practical application process, besides the need of realizing a high refresh frame rate in a high frame rate game, the high frame rate is mainly applied to a small amount of fast sliding scenes such as desktop sliding and album browsing, and the purpose of the method is to improve the fluency of the picture when a user performs fast sliding operation. However, the fast sliding occupies a small time proportion in practical application, and most of the usage scenes are still static display, low-speed sliding and low-frame-rate video playing scenes. In a low frame rate usage scenario, the image rendering speed of the AP is reduced, and if the Panel side still maintains a high refresh frame rate for image refresh (when the AP does not send new image data, the DDIC controls the Panel to repeatedly display a single frame image according to recently received image data), the smoothness of the image is not improved, and the power consumption of the display screen is increased instead.

In the related technology, in order to reduce the power consumption of a display screen with a high refresh frame rate, an AP end counts the number of frames of image data sent to a DDIC by the AP within a period of time through software, so as to determine an average frame rate within the counted period according to the number of frames, and further send a refresh frame rate adjustment instruction to the DDIC based on the average frame rate, so that the DDIC adjusts the refresh frame rate based on the instruction.

Because the AP needs to occupy a certain processing resource when executing the software logic, the statistical period is usually set to be longer, for example, 1s, in consideration of power consumption, that is, the number of frames of image data sent by the AP in 1s is counted, so as to determine the average frame rate in 1 s. In an illustrative example, the AP counts that 30 frames of image data have been sent within the last 1s, thereby determining that the average frame rate is 30 fps.

However, the average frame rate can only reflect the average sending rate of the image data in the statistical time period, and cannot reflect the real-time image data sending situation of the AP, and particularly, under the condition that the statistical time period is long, the average frame rate calculated by the AP has obvious hysteresis and is poor in accuracy, so that the subsequent refresh frame rate is improperly adjusted, and the display effect is affected.

Illustratively, as shown in fig. 2, in the statistical period, the AP transmits 30 frames of image data in the first 500ms (DDIC scans from new image data transmitted by the AP in the first 500 ms), and does not transmit image data in the second 500ms (DDIC scans from the latest image data in the second 500 ms), and the AP determines the average frame rate to be 30fps based on the total number of frames of image data transmitted in the statistical period being 30 frames, and cannot recognize that the picture in the second 500ms is in a still state. Further, the AP instructs DDIC to adjust the refresh frame rate to 30Hz based on the average frame rate of 30 fps. However, since the picture is still (i.e. in a static display scenario) 500ms later, the DDIC could set a lower refresh frame rate to reduce power consumption, but in practice, the DDIC still maintains a higher refresh frame rate, resulting in increased display power consumption.

In addition, in the related art, in order to reduce the power consumption of the high refresh frame rate display screen, the AP determines the refresh frame rate corresponding to the current display scene by identifying the type of the application program, and further sends a refresh frame rate adjustment instruction to the DDIC based on the refresh frame rate, so that the DDIC adjusts the refresh frame rate based on the instruction.

Illustratively, the AP determines that the display content of the current display scene belongs to high-speed update, medium-speed update, low-speed update, or static by identifying that the type corresponding to the application program is a video type, a web page type, or a social type.

However, the type corresponding to the application program can only roughly reflect the display type of the current scene, and cannot feed back the refresh rate required by the current display picture in real time, so that the refresh rate of the display screen cannot be adjusted in real time.

Based on the technical problem, an embodiment of the application provides a method, an apparatus, a processor, a chip and a terminal for adjusting a refresh frame rate of a display screen, by monitoring a working state of MIPI, and when the working state of MIPI changes, adjusting the refresh frame rate of the display screen for image display, so that the refresh frame rate of the display screen can be dynamically adjusted according to the working state of MIPI, therefore, the method has higher real-time performance, and can solve the problem that the refresh rate of the display screen cannot be adjusted in real time in the related art.

Specifically, because the working state of the MIPI is determined by hardware logic, and the change of the working state is real-time, the method and the device have higher real-time performance in adjusting the refresh frame rate of the display screen by monitoring the working state of the MIPI, and further save power consumption under the condition of ensuring smooth display.

In order to better explain the technical solution of the present application, the following description is given by way of specific examples.

Exemplarily, as shown in fig. 3, a first implementation flow diagram of a method for adjusting a refresh frame rate of a display screen according to an embodiment of the present application is shown. The method for adjusting the refresh frame rate of the display screen can be executed by a terminal comprising the display screen, and comprises the following steps 301 to 302.

Step 301, monitoring the working state of the MIPI.

In the embodiments of the present application, MIPI is an interface standard for mobile devices and consumer electronics that is established by the MIPI alliance, which enables interfaces for such devices (e.g., terminals that include display screens in the present application) to increase bandwidth and improve performance while reducing cost, complexity, power consumption, and electromagnetic interference, and which is not a single interface or protocol, but rather includes a set of protocols and standards that meet the unique requirements of various subsystems.

Exemplarily, as shown in fig. 4, a first structural diagram of a terminal provided in an embodiment of the present application may include an Application Processor (AP)41 and a display screen, where the display screen includes a display driver chip (DDIC)42 and adisplay panel 43, thedisplay driver chip 42 is configured to drive thedisplay panel 43 of the display screen to perform image display, and the AP and the DDIC may communicate through a Mobile Industry Processor Interface (MIPI).

The working state of the MIPI can be monitored by the AP end and also can be monitored by the DDIC. Therefore, in some embodiments of the present application, the operating state of the MIPI may be monitored based on the AP. In other embodiments of the present application, the operating state of the MIPI may be monitored based on the DDIC.

Step 302, when the working state of the MIPI changes, adjusting a refresh frame rate of the display screen for image display.

Optionally, in some embodiments of the present application, the operating state of the MIPI may include a data transmission state and an idle state (idle mode).

Optionally, in some embodiments of the present application, the data transmission state may include a data transmission ongoing state and a data transmission preparation state.

The data transmission ongoing state is a state in which data transmission is being performed, and the data transmission ready state is a state in which data transmission is ready, that is, a state in which data transmission is immediately possible when data transmission is necessary. The data transmission preparation state generally indicates a state where the MIPI is not in an idle state after transmitting a frame of data, and in this state, the MIPI is in a state where data transmission is required, and data transmission can be performed immediately without waking up.

In this embodiment, the idle state refers to a state where no data needs to be sent and the MIPI is not in data sending, and in this state, when there is data that needs to be sent, the MIPI needs to be wakened up first, and after the MIPI is wakened up, the data sending is in a data sending running state.

In an application scenario, as shown in fig. 5, after the MIPI completes data transmission, the data transmission preparation state is entered, that is, the data transmission preparation state is entered from the data transmission proceeding state. After the MIPI enters the data transmission preparation state, when a preset standby time period, for example, 60ms, is reached, if there is still no data to be transmitted, the MIPI enters an idle state, that is, the MIPI enters the idle state from the data transmission preparation state. After the MIPI enters the idle state, if the AP needs to send data to the DDIC, a wake-up instruction needs to be sent to the MIPI first, the MIPI is woken up, the MIPI enters a data sending proceeding state from the idle state, in the data sending proceeding state, data are sent to the DDIC through the MIPI, and after the MIPI finishes sending the data, the data sending preliminary state is entered again.

The whole working process of the MIPI is as follows: data transmission progress state-data transmission preparation state-idle state-data transmission progress state, continuously cycling.

Since the MIPI is in a state in which data transmission is required and data transmission can be immediately performed although data transmission is not performed in the data transmission ready state, the data transmission ready state and the data transmission in progress state can be combined into a data transmission state in general.

Based on the above descriptions of the various operating states of the MIPI, in the embodiment of the present application, the operating state change of the MIPI in step 302 may include the following two forms: firstly, the working state of the MIPI enters an idle state from a data transmission state; second, the working state of the MIPI enters the data transmission state from the idle state.

In practical application, when the working state of the MIPI is monitored to enter the idle state from the data transmission state, the refresh frame rate of the display screen for displaying the image is adjusted, that is, when the working state of the MIPI is in the idle state, the refresh frame rate of the display screen for displaying the image is reduced, so that the refresh frame rate of the display screen for displaying the image is kept at a low refresh frame rate, and after the working state of the MIPI enters the data transmission state from the idle state, for example, after the AP sends the image data to the DDIC, because the DDIC receives the image data at this time, the refresh frame rate of the display screen for displaying the image can be automatically increased after the DDIC receives the image data, and whether the working state based on the MIPI enters the data transmission state from the idle state or not is not required.

Therefore, optionally, in some embodiments of the present application, the step 301 may monitor only whether the operating state of the MIPI enters the idle state from the data transmission state, and does not monitor whether the operating state of the MIPI enters the data transmission state from the idle state, and correspondingly, the step 302 may refer to: and when the working state of the MIPI enters an idle state from the data transmission state, adjusting the refresh frame rate of the display screen for image display.

For example, when the working state of the MIPI is monitored to enter the idle state from the data transmission state, the refresh frame rate of the display screen for displaying images is reduced, so that when the AP does not transmit data to the DDIC, the refresh frame rate of the display screen is actively reduced, and further the power consumption of the display screen is reduced. When the working state of the MIPI enters the idle state from the data sending state, the refreshing frame rate of the display screen for image display can be automatically increased after the DDIC receives the image data. That is, it is not necessary to monitor whether the operating state of the MIPI enters the idle state from the data transmission state.

In practical application, the DDIC can also default to the low refresh frame rate for image display, and when the working state of the MIPI is monitored to enter the data transmission state from the idle state, the refresh frame rate for image display on the display screen is increased, so as to reduce the power consumption of the display screen.

Therefore, optionally, in some embodiments of the present application, the step 301 may monitor only whether the operating state of the MIPI enters the data transmission state from the idle state, and does not monitor whether the operating state of the MIPI enters the idle state from the data transmission state, and correspondingly, the step 302 may refer to: and when the working state of the MIPI is monitored to enter a data sending state from an idle state, adjusting the refresh frame rate of the display screen for image display.

For example, when the working state of the MIPI enters a data transmission state from an idle state, the refresh frame rate of image display of a display screen is increased.

Since the working state of the MIPI enters the data sending state from the idle state, it is not necessarily that the AP needs to send image data to the DDIC, but may be that the AP needs to send a control instruction for screen display to the DDIC, for example, a control instruction for controlling display voltage of the display screen, and the like, in some embodiments of the present application, optionally, when it is monitored that the working state of the MIPI enters the data sending state from the idle state, and when the data sent by the MIPI is image data, the refresh frame rate for image display by the display screen may be increased.

That is, when the operating state of the MIPI enters the data transmission state from the idle state and it is determined that the data that the AP needs to transmit to the DDIC is the image display data, the refresh frame rate of the image display by the display screen is increased.

In addition, in an application scene, the refresh frame rate of the image display of the display screen can be automatically increased without receiving image data by the DDIC, and the image display can be performed without adopting a low refresh frame rate by default, and when the working state of the MIPI is monitored to enter a data sending state from an idle state, the refresh frame rate of the image display of the display screen is increased; but the refreshing frame rate of the image display of the display screen is adjusted completely based on the working state of the MIPI.

That is to say, in some embodiments of the present application, the step 301 may refer to monitoring whether the operating state of the MIPI enters the data transmission state from the idle state, and monitoring whether the operating state of the MIPI enters the idle state from the data transmission state, and correspondingly, the step 302 may refer to: and when the working state of the MIPI enters the data transmission state from the idle state, adjusting the refresh frame rate of the display screen for image display.

For example, when the working state of the MIPI is monitored to enter the idle state from the data transmission state, the refresh frame rate of the display screen for displaying the image is reduced, and when the working state of the MIPI is monitored to enter the data transmission state from the idle state, the refresh frame rate of the display screen for displaying the image is increased.

In the embodiment of the application, because the MIPI is a physical layer interface realized based on hardware, the working state of the MIPI is determined by hardware logic, and the change of the working state of the MIPI is real-time, the application has higher real-time performance in adjusting the refresh frame rate of the display screen by monitoring the working state of the interface of the mobile industrial processor, thereby further saving power consumption under the condition of ensuring smooth display.

According to the method and the device, the working state of the interface of the mobile industrial processor is monitored, and when the working state of the interface of the mobile industrial processor changes, the refresh frame rate of the display screen for image display is adjusted, so that the refresh frame rate of the display screen can be dynamically adjusted according to the working state of the interface of the mobile industrial processor, therefore, the problem that the high refresh frame rate is fixedly used for displaying, the power consumption of the display screen is large is solved, and the reduction of the power consumption of the display screen is facilitated.

It should be noted that, because the operating state of the MIPI is controlled by the software driver layer of the AP, the software driver layer of the AP itself needs to monitor the operating state of the MIPI in real time, so that the operating state of the MIPI is monitored at the AP end, the refresh frame rate of the display screen is dynamically adjusted based on the operating state of the MIPI, and extra power consumption does not need to be increased, and thus, the power consumption of the display screen can be further reduced.

For example, as shown in fig. 6, a second implementation flow diagram of a method for adjusting a refresh frame rate of a display screen according to an embodiment of the present application is provided, where the method for adjusting the refresh frame rate of the display screen is executed by an AP of a terminal, and may specifically be executed by an apparatus for adjusting the refresh frame rate of the display screen configured on the AP, and includes the following steps 601 to 603.

Step 601, monitoring the working state of the MIPI based on the AP of the terminal.

In practical application, when the MIPI is about to enter the idle state from the data transmission state, instruction data about the MIPI to enter the idle state is transmitted to the AP, so that the AP can monitor in real time whether the working state of the MIPI enters the idle state from the data transmission state.

In addition, in the process that the MIPI enters the data transmission state from the idle state, it indicates that the AP needs to transmit data to the DDIC and further transmits a wakeup instruction to the MIPI, so that the MIPI enters the data transmission state from the idle state, and therefore, the AP can also monitor whether the working state of the MIPI enters the data transmission state from the idle state in real time.

Step 602, when it is monitored that the working state of the MIPI is about to enter the idle state from the data transmission state, a frequency reduction instruction is sent to the DDIC of the display screen.

Optionally, as shown in fig. 7, in some embodiments of the present application, when monitoring that the working state of the MIPI is about to enter the idle state from the data sending state, the AP may generate a frequency reduction instruction, and send the frequency reduction instruction to the DDIC of the display screen through the MIPI, and after sending the frequency reduction instruction, the MIPI enters the idle state.

In the embodiment of the application, when the MIPI is about to enter the idle state from the data transmission state, instruction data about to enter the idle state is transmitted to the AP, and at this time, the MIPI is still in the data transmission state, so that a frequency reduction instruction can be transmitted to the DDIC.

The frequency reduction instruction is used for instructing the DDIC to reduce the refresh frame rate of the display screen for image display.

Optionally, in some embodiments of the present application, the DDIC may be preset with different refresh frame rate levels, and the foregoing down-conversion instruction may be used to instruct the DDIC to down-convert one refresh frame rate level. For example, when five levels of refresh frame rate levels are set, which are 120Hz, 90Hz, 60Hz, 30Hz and 10Hz from high to low, respectively, if the highest refresh frame rate of the current DDIC is 120Hz, it is determined that the highest refresh frame rate needs to be reduced to 90Hz after a frequency reduction instruction issued by the AP is received; and if the frequency reduction instruction sent by the AP is received again, determining that the highest refresh frame rate needs to be reduced to 60 Hz.

Optionally, in some embodiments of the present application, the down-conversion instruction is used to instruct the DDIC to down-convert the highest refresh frame rate to the specified refresh frame rate.

For example, as shown in fig. 7, the down-conversion instruction is used to instruct the DDIC to reduce the current highest refresh frame rate from 120Hz to 10Hz, so that after the MIPI enters the idle state, the DDIC performs image display at the refresh frame rate of 10 Hz.

The specified refresh frame rate may be other frame rates, and is not limited herein, for example, the specified refresh frame rate may be a refresh frame rate such as 20Hz or 1 Hz.

Step 603, when the working state of the MIPI enters a data sending state from an idle state and the data sent by the MIPI is image data, increasing a refresh frame rate of image display on the display screen.

After the AP sends the wakeup command to the MIPI, the MIPI can enter the data sending state from the idle state, so that the AP can monitor whether the working state of the MIPI enters the data sending state from the idle state or not in real time.

In addition, the AP sending a wake-up command to the MIPI to wake up the MIPI indicates that the AP needs to send data to the DDIC, and the data may be image data, or instruction data such as a control instruction, for example, a control instruction to control a display voltage of the display screen, or the like. Therefore, in some embodiments of the application, when it is monitored that the working state of the MIPI enters the data transmission state from the idle state, and the data transmitted by the MIPI is image data, the refresh frame rate of the display screen for displaying the image may be increased.

Optionally, in some embodiments of the present application, when the AP monitors that the working state of the MIPI enters a data transmission state from an idle state, and data transmitted by the MIPI is image data, the AP may generate an up-conversion instruction, and transmit the up-conversion instruction to the DDIC through the MIPI.

The frequency increasing instruction is used for instructing the DDIC to increase the refresh frame rate of the display screen for image display.

Optionally, in some embodiments of the present application, the DDIC may be preset with different refresh frame rate levels, and the foregoing up-conversion instruction may be used to instruct the DDIC to up-convert one level of the refresh frame rate level. For example, when five levels of refresh frame rate levels are set, from high to low, respectively 120Hz, 90Hz, 60Hz, 30Hz, and 10Hz, if the highest refresh frame rate of the current DDIC is 10Hz, after receiving an up-conversion instruction issued by the AP, it is determined that the highest refresh frame rate needs to be increased to 30 Hz; and if the frequency increasing instruction sent by the AP is received again, determining that the highest refresh frame rate needs to be increased to 60 Hz.

Optionally, in some embodiments of the present application, the frequency up instruction may be further configured to instruct the DDIC to perform automatic frequency conversion within a certain refresh frame rate range.

For example, the up-conversion instruction is used to instruct the DDIC to increase the current highest refresh frame rate from 10Hz to 30Hz, so that after the MIPI enters the data transmission state, the DDIC performs image display at the refresh frame rate of 30 Hz.

In the embodiment of the application, through AP monitoring MIPI's operating condition, current display scene is discerned, and when MIPI's operating condition changes, namely, when current display scene changes, increase or reduce the refresh frame rate that the display screen carries out image display, make the refresh frame rate of display screen can realize dynamic adjustment according to MIPI's operating condition dynamic adjustment, namely, the refresh frame rate of display screen can realize dynamic adjustment according to the change of current display scene, show in order to avoid the fixed too high refresh frame rate that uses, the great problem of the consumption of display screen appears. Thus, it may contribute to reducing power consumption of the display screen.

In addition, because the working state of the MIPI is determined by hardware logic, the change of the working state is real-time, and the software driver layer of the AP itself needs to monitor the working state of the MIPI in real time, so that the monitoring of the working state of the MIPI and the dynamic adjustment of the refresh frame rate of the DDIC based on the working state of the MIPI have higher real-time performance, and no additional power consumption is additionally added, so that the power consumption of the display screen can be further reduced.

In some embodiments of the present application, the DDIC may employ dynamic frequency conversion technology to implement automatic frequency conversion within a frequency conversion range.

For example, when the Base Frame Rate (Base Frame Rate) of the display screen is 120Hz (i.e. the highest refresh Frame Rate) and the lowest refresh Frame Rate is 1Hz, the DDIC may implement dynamic frequency conversion within the frequency conversion range of 1-120 Hz.

Specifically, as shown in fig. 6, in some embodiments of the present application, when the display screen is powered on and started, the AP may first send an initialization instruction carrying a preset refresh frame rate range to the DDIC.

The initialization instruction may be used to instruct the DDIC to perform image refresh according to a preset refresh frame rate range, that is, instruct the DDIC to perform automatic frequency conversion within the preset refresh frame rate range.

For example, the preset refresh frame rate ranges from 30Hz to 120 Hz.

Optionally, when performing automatic frequency conversion within the preset refresh frame rate range of 30Hz to 120Hz, the DDIC may perform image scanning at an upper limit (i.e., the highest refresh frame rate) in the preset refresh frame rate range when receiving an image sent by the AP, and perform image scanning at a lower limit (i.e., the lowest refresh frame rate) in the preset refresh frame rate range when not receiving a new image.

When the minimum refresh frame rate is less than or equal to the refresh frame rate threshold, for example, when the refresh frame rate threshold is 30Hz, in the process of reducing the maximum refresh frame rate to the minimum refresh frame rate, the image refresh may be performed by maintaining the preset number of times of high frame rate refresh and then reducing the preset number of times of high frame rate refresh to the minimum refresh frame rate.

For example, as shown in fig. 7, after DDIC scans image a sent by AP at a refresh frame rate of 120Hz, and then scans image B sent by AP at a refresh frame rate of 120Hz, AP does not send image data to DDIC, in order to prevent the problem of screen flicker from directly decreasing from 120Hz to 30Hz, after maintaining a preset number of times (once in the figure) at the refresh frame rate of 120Hz, image B may be rescanned by decreasing to the lowest refresh frame rate of 30Hz, until MIPI does not send image data within 7 frames of 8.3ms, MIPI sends down-conversion instruction to DDIC within 8 frames of 8.3ms, and enters an idle state.

At this time, the DDIC may reduce the refresh frame rate to the specified refresh frame rate according to the received down-conversion instruction sent by the MIPI, for example, as shown in fig. 7, after the MIPI enters the idle state, the DDIC may reduce the refresh frame rate to 10Hz, and perform repeated refreshing of the image at 10 Hz.

Optionally, when monitoring that the MIPI enters the data sending state from the idle state, the AP may send an up-conversion instruction to the DDIC through the MIPI before sending the image data to the DDIC, so as to update the refresh frame rate of the display screen in real time.

For example, as shown in fig. 8, when the AP monitors that the MIPI enters the data transmission state from the idle state, before sending the image C to the DDIC, the AP may send an up-conversion instruction to the DDIC through the MIPI, instruct the DDIC to perform automatic frequency conversion within the range of the refresh frame rate of 30Hz to 120Hz, and then send the image C to the DDIC.

When DDIC is instructed to carry out automatic frequency conversion within the refresh frame rate range of 30 Hz-120 Hz, image scanning can be carried out at the upper limit (namely, the highest refresh frame rate) in the refresh frame rate range, and when no new image is received, image scanning can be carried out at the lower limit (namely, the lowest refresh frame rate) in the refresh frame rate range.

When the minimum refresh frame rate is less than or equal to the refresh frame rate threshold, for example, when the refresh frame rate threshold is 30Hz, in the process of reducing the maximum refresh frame rate to the minimum refresh frame rate, the image refresh can be performed by reducing the maximum refresh frame rate to the minimum refresh frame rate after the preset number of high frame rate refreshes are maintained, so as to avoid the occurrence of smear.

For example, as shown in fig. 8, after DDIC scans image C transmitted by AP at the refresh frame rate of 120Hz, AP does not transmit image data to DDIC, and at this time, it should perform image scanning by decreasing to the lower limit (i.e. the lowest refresh frame rate) in the preset refresh frame rate range, but in order to prevent the problem of smear from rising from 10Hz to 30Hz in the idle state, image C may be rescanned by maintaining at the refresh frame rate of 120Hz for a preset number of times (once in the figure), and then rising to the lowest refresh frame rate of 30 Hz.

Optionally, in some embodiments of the present application, in order to further reduce the display power consumption of the terminal, when monitoring that the working state of the MIPI enters the idle state from the data transmission state, the AP may control the working circuit of the MIPI to enter the low voltage state.

Specifically, when the working state of the MIPI enters the idle state from the data transmission state, only power consumption caused by data transmission is reduced, and the whole working circuit is not caused to enter the low-voltage state, so that the working circuit of the MIPI can be controlled to enter the low-voltage state in order to further reduce the display power consumption of the terminal. When the MIPI is in a low-voltage state, the working voltage of the MIPI is smaller than that of the MIPI in a data sending state.

For example, the operating voltage of the MIPI in the data transmission state is 5V, and the operating voltage in the low voltage state is 0.5V.

It should be noted that the embodiment shown in fig. 6 is implemented by an AP based on a terminal, and in the embodiment of the present application, in addition to implementing the adjustment method by the AP based on the terminal in a software manner, the DDIC based on a display screen may also be implemented in a hardware manner.

That is, the DDIC based on the display monitors the working state of the MIPI, and adjusts the refresh frame rate of the display for displaying images when the working state of the MIPI changes, which can save the sending process of the up-conversion instruction and the down-conversion instruction compared with the AP implementation based on the terminal, that is, save the step of sending the down-conversion instruction to the DDIC of the display in the above step 602, and in the specific implementation of the above step 603, send the up-conversion instruction to the DDIC to instruct the DDIC to increase the refresh frame rate of the display for displaying images, and the rest of the steps are similar to the AP implementation based on the terminal, and are not described here again.

While, for purposes of simplicity of explanation, the foregoing method embodiments are described as a series of acts or combinations, it will be appreciated by those of ordinary skill in the art that the present application is not limited by the illustrated ordering of acts, as some steps may occur in other orders in some embodiments of the application.

Fig. 9 is a schematic structural diagram illustrating anadjusting apparatus 900 for adjusting a refresh frame rate of a display screen according to an embodiment of the present application, where the adjusting apparatus is configured in a terminal including the display screen and includes amonitoring unit 901 and anadjusting unit 902.

Amonitoring unit 901, configured to monitor a working state of the interface of the mobile industry processor;

the adjustingunit 902 is configured to adjust a refresh frame rate of the display screen for displaying an image when the operating state of the interface of the mobile industry processor changes.

Optionally, in some embodiments of the present application, the adjusting unit is configured to:

and when the working state of the mobile industry processor interface enters an idle state from a data sending state, reducing the refresh frame rate of the display screen for displaying the image.

Optionally, in some embodiments of the present application, the adjusting apparatus is configured in an application processor AP of the terminal; and the adjusting unit is used for sending a frequency reduction instruction to a display driving chip of the display screen when monitoring that the working state of the interface of the mobile industrial processor is about to enter an idle state from a data sending state, wherein the frequency reduction instruction is used for indicating the display driving chip to reduce the refresh frame rate of the display screen for image display.

and when the working state of the interface of the mobile industrial processor enters a data sending state from an idle state and the data sent by the interface of the mobile industrial processor is image data, increasing the refresh frame rate of the display screen for displaying the image.

Optionally, in some embodiments of the present application, the adjusting apparatus is configured in an application processor AP of the terminal;

the adjusting unit is configured to send a frequency-increasing instruction to a display driving chip of the display screen when a working state of the mobile industry processor interface enters a data sending state from an idle state and data sent by the mobile industry processor interface is image data, where the frequency-increasing instruction is used to instruct the display driving chip to increase a refresh frame rate of image display performed by the display screen.

and sending a frequency increasing instruction to a display driving chip of the display screen before sending the image data to the display driving chip.

Optionally, in some embodiments of the present application, the adjusting device is configured on a display driving chip of the terminal.

Optionally, in some embodiments of the present application, the adjusting apparatus further includes a voltage reducing unit, configured to:

and when the working state of the interface of the mobile industry processor enters an idle state from a data transmission state, controlling a working circuit of the interface of the mobile industry processor to enter a low-voltage state.

Optionally, in some embodiments of the present application, the adjusting apparatus further includes an initializing unit, configured to:

when the display screen is powered on and started, an initialization instruction carrying a first refreshing frame rate range is sent to a display driving chip of the display screen, and the initialization instruction is used for instructing the display driving chip to refresh images according to the first refreshing frame rate range.

It should be noted that, for convenience and simplicity of description, the specific working process of thedevice 900 for adjusting the refresh frame rate of the display screen described above may refer to the corresponding process of the method in fig. 1 to fig. 8, and is not described herein again.

By way of example, an embodiment of the present application further provides an application processor, where the application processor is configured in a terminal including a display screen, and is configured to:

monitoring the working state of a mobile industry processor interface;

Optionally, in some embodiments of the present application, the application processor is configured to:

when the working state of the interface of the mobile industry processor enters a data sending state from an idle state and data sent by the interface of the mobile industry processor is image data, sending an up-conversion instruction to a display driving chip of the display screen, wherein the up-conversion instruction is used for indicating the display driving chip to increase a refresh frame rate of the display screen for image display.

and sending the frequency increasing instruction to a display driving chip of the display screen before sending the image data to the display driving chip.

when the display screen is powered on and started, an initialization instruction carrying a preset refreshing frame rate range is sent to a display driving chip of the display screen, and the initialization instruction instructs the display driving chip to refresh images according to the first refreshing frame rate range.

In an exemplary embodiment, an embodiment of the present application further provides a display driver chip, where the display driver chip is configured on a display screen of a terminal, and is configured to drive the display screen of the terminal to display an image, and the display driver chip is configured to:

monitoring the working state of a mobile industry processor interface;

The display driving chip is used for:

The display driving chip is used for: and when the working state of the interface of the mobile industrial processor enters a data sending state from an idle state and the data sent by the interface of the mobile industrial processor is image data, increasing the refresh frame rate of the display screen for displaying the image.

By way of example, the embodiment of the present application further provides a display screen, and the display screen is configured with the display driving chip.

By way of example, the embodiment of the present application further provides a terminal including a display screen, and the terminal is configured with the application processor.

Illustratively, the embodiment of the application also provides a terminal comprising a display screen, and the display screen of the terminal is configured with the display driving chip.

Illustratively, as shown in fig. 10, an embodiment of the present application further provides a terminal including a display screen, where the terminal includes anapplication processor 111, thedisplay screen 113 includes a display driver chip (DDIC)1131 and adisplay panel 1132, theapplication processor 111 is connected to thedisplay driver chip 1131 through a MIPI (mobile industry processor interface), and the terminal is configured to implement the method for adjusting the display screen refresh frame rate shown in fig. 1 to 8, or the terminal is configured with the device for adjusting the display screen refresh frame rate shown in fig. 9.

For example, when theapplication processor 111 of the terminal executes the computer program in thememory 112, the method for adjusting the refresh frame rate of the display screen is implemented, so that the refresh frame rate of thedisplay screen 113 can be dynamically adjusted according to the operating state of the MIPI, and therefore, the problem that the power consumption of the display screen is large due to the fact that the display is performed by using a high refresh frame rate fixedly can be avoided, and the reduction of the power consumption of the display screen is facilitated.

Illustratively, the embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed, the steps of the method for adjusting the refresh frame rate of each display screen are implemented. It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of each functional unit is illustrated, and in practical applications, the above-mentioned functional allocation may be performed by different functional units or modules according to requirements, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the particular application and design constraints of the display screen refresh frame rate adjustment method. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/user terminal and method may be implemented in other manners. For example, the above-described apparatus/user terminal embodiments are merely illustrative, and for example, a division of modules or units is only one logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method according to the embodiments described above may be implemented by a computer program, which is stored in a computer readable storage medium and used by a processor to implement the steps of the embodiments of the methods described above. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain other components which may be suitably increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, in accordance with legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunications signals.

The above embodiments are only used to illustrate the method for adjusting the refresh frame rate of the display screen of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the method for adjusting the refresh frame rate of the display screen described in the foregoing embodiments may still be modified, or some of the method features may be equivalently replaced; such modifications or substitutions do not make the essence of the method for adjusting the refresh frame rate of the display screen deviate from the spirit and scope of the method for adjusting the refresh frame rate of the display screen according to the embodiments of the present application, and are all included in the scope of protection of the present application.