Disclosure of Invention
The embodiment of the invention provides a display device and a control system thereof, which can improve the refresh rate of a single type of interaction sensor while avoiding crosstalk of various types of interaction sensors, so that the display device is suitable for displaying interaction application scenes more widely.
The embodiment of the invention provides a control system which is applied to a display device, wherein the control system comprises an interaction sensor, a driving module and a state control module, the interaction sensor comprises a main sensor and at least one auxiliary sensor, the state control module comprises a plurality of working states, the driving module is respectively and electrically connected with the state control module and the interaction sensor, the main sensor and the auxiliary sensor are driven to work in a cross mode in the same frame period of the display device under the control of the state control module, and when the state control module is in different working states, the main sensor and the at least one auxiliary sensor respectively have different working frequencies under the driving of the driving module.
Optionally, the state control module includes a first working state and a second working state;
when the state control module is in the first working state, the working frequency of the main sensor is larger than that of the auxiliary sensor; and when the state control module is in the second working state, the working frequency of the main sensor is smaller than that of the auxiliary sensor.
Optionally, when the state control module is in the first working state, the main sensor completes a complete scans in a frame period, and the light sensor completes 1 complete scan in a b frame period; and when the state control module is in the second working state, the auxiliary sensor completes c complete scans in a frame picture period, and the main sensor completes 1 complete scan in a d frame picture period, wherein a, b, c and d are integers larger than 1.
Optionally, the state control module further includes a third working state, and when the state control module is in the third working state, the working frequency of the main sensor is equal to the working frequency of the auxiliary sensor.
Optionally, when the state control module is in the third working state, the main sensor completes e complete scans in a frame period, and the auxiliary sensor completes e complete scans in a frame period, where e is an integer greater than or equal to 1.
Optionally, the control system further includes a detection module, where the detection module is electrically connected to the main sensor and the auxiliary sensor, and is configured to detect whether a valid signal triggers the main sensor and the auxiliary sensor.
Optionally, the control system further includes a state switching module, where the state switching module is electrically connected to the detection module and the state control module, respectively, and is used to control the state control module to switch in different working states; wherein,
when the detection module detects that the effective signal triggers the main sensor but does not trigger the auxiliary sensor in a judging period, the state switching module controls the state control module to adjust the working state to the first working state;
when the detection module detects that the effective signal triggers the auxiliary sensor but does not trigger the main sensor in a judging period, the state switching module controls the state control module to adjust the working state to the second working state;
when the detection module detects that the effective signal triggers the main sensor and the auxiliary sensor in a judging period, the state switching module controls the state control module to adjust the working state to the third working state.
Optionally, the main sensor is one of a touch sensor, a light sensor, a pressure sensor, a sound control sensor and an electromagnetic sensor, the auxiliary sensor is at least one of a touch sensor, a light sensor, a pressure sensor, a sound control sensor and an electromagnetic sensor, and the main sensor and the auxiliary sensor are sensors of different types.
Optionally, the main sensor is one of the touch sensor and the light sensor, and the auxiliary sensor is the other of the touch sensor and the light sensor.
The embodiment of the invention provides a display device which comprises a display panel and the control system, wherein the interaction sensor is arranged in or on the display panel.
According to the display device and the control system thereof, the interactive sensors of various types are enabled to work in the same frame period in a crossing mode, and the working frequency of each type of sensor is regulated through the state control module, so that crosstalk is avoided, the refresh rate of the interactive sensors is improved, and the display device is adapted to more extensive display of interactive application scenes.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application. Furthermore, it should be understood that the detailed description is presented herein for purposes of illustration and explanation only and is not intended to limit the present application. In this application, unless otherwise indicated, terms of orientation such as "upper" and "lower" are used to generally refer to the upper and lower positions of the device in actual use or operation, and specifically the orientation of the drawing figures; while "inner" and "outer" are for the outline of the device.
The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. In order to simplify the present disclosure, components and arrangements of specific examples are described below. They are, of course, merely examples and are not intended to limit the invention. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples, which are for the purpose of brevity and clarity, and which do not themselves indicate the relationship between the various embodiments and/or arrangements discussed. In addition, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art will recognize the application of other processes and/or the use of other materials. The embodiment of the invention provides a display device. The following will describe in detail. The following description of the embodiments is not intended to limit the preferred embodiments.
Example 1
The embodiment of the invention discloses a display device and a control system thereof. The display device includes the control system and a display panel 10. The control system includes: the interactive sensor comprises a main sensor and at least one auxiliary sensor, the state control module comprises a plurality of working states, the driving module is respectively and electrically connected with the state control module and the interactive sensor, the main sensor and the auxiliary sensor are driven to work in a crossed mode in the same frame period under the control of the state control module, and when the state control module is in different working states, the main sensor and the at least one auxiliary sensor respectively have different working frequencies under the driving of the driving module. The interaction sensor is disposed in the display panel 10 or on the display panel 10.
According to the control system and the display device provided by the invention, the interactive sensors are enabled to work in a crossed mode in the same frame period, meanwhile, the working frequency of each type of sensor is regulated through the state control module, so that crosstalk is avoided, and meanwhile, the refresh rate of the interactive sensors is improved, so that the interactive sensors are suitable for displaying interactive application scenes more widely.
As shown in fig. 1 and 2, in the present embodiment, the display panel 10 may be any one or more of a liquid crystal display panel (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED) display panel, a Mini-Light-Emitting Diode (Mini-Light Emitting Diode, mini-LED) display panel, or a Micro-Light-Emitting Diode (Micro-Light Emitting Diode, micro-LED) display panel.
In this embodiment, the types of the interaction sensor 20 include various types, which may be specifically: at least two of a touch sensor 21, a light sensor 22, a pressure sensor, a sound control sensor, and an electromagnetic sensor, which are, for example, the touch sensor 21, the light sensor 22; a touch sensor 21, a pressure sensor; a touch sensor 21 and a sound control sensor; a touch sensor 21 and an electromagnetic sensor; a touch sensor 21, a light sensor 22, and a pressure sensor; a touch sensor 21, a light sensor 22, and a sound control sensor; a touch sensor 21, a light sensor 22, and an electromagnetic sensor; a light sensor 22, a pressure sensor, and a sound control sensor; a touch sensor 21, a light sensor 22, a pressure sensor, and a sound control sensor; this embodiment is not listed here.
Taking the touch sensor 21 widely used at present as an example, the touch sensor 21 can be an in-cell (in-cell) touch sensor, an on-cell (on-cell) touch sensor or an external hanging (OGS) touch sensor according to the relative positions of the touch sensor 21 and the display panel 10; similarly, the light sensor 22, the pressure sensor, the sound control sensor, and the electromagnetic sensor may be disposed inside or outside the display panel 10, which is not limited in this embodiment.
In this embodiment, the interaction sensor 20 includes a main sensor and an auxiliary sensor, the main sensor is one of a touch sensor 21, a light sensor 22, a pressure sensor, a sound control sensor and an electromagnetic sensor, the auxiliary sensor includes at least one of the touch sensor 21, the light sensor 22, the pressure sensor, the sound control sensor and the electromagnetic sensor, and the main sensor and the auxiliary sensor are different types of sensors. Further, the main sensor is, for example, one of the touch sensor 21 and the light sensor 22, and the auxiliary sensor is the other of the touch sensor 21 and the light sensor 22.
The following description will take the main sensor as a touch sensor 21 and the auxiliary sensor as a photo sensor 22 as an example.
In this embodiment, the control system includes a touch sensor 21 and a light sensor 22 disposed on the display panel 10. The display panel 10 includes, for example, a plurality of rows of scan lines and a plurality of columns of data lines disposed to cross each other, and the driving module 30 may be further electrically connected to a gate driver of the display panel 10 for driving the plurality of rows of scan lines of the display panel 10 to supply driving signals to the gate driver. The touch sensor 21 and the light sensor 22 are integrated in an interactive sensor panel, for example, although in other embodiments, the touch sensor 21 and the light sensor 22 may be integrated directly inside the display panel 10, which is not limited in this embodiment. The interactive sensor panel includes, for example: the two Glass substrates Glass and the touch sensor 21 and the light sensor 22 disposed between the two Glass substrates Glass are, for example, disposed on the same layer, but in other embodiments, the touch sensor 21 and the light sensor 22 may be disposed on different layers. The passivation layer is further laminated above the touch sensor 21 and the light sensor 22, the Glass substrate Glass and the optical adhesive OCA are laminated below the touch sensor 21 and the light sensor 22, the flat protection layer OC is laminated below the touch sensor 21 and the light sensor 22, the sensor TFT is arranged below the black matrix BM, for example, the touch sensor 21 includes a touch transmitting electrode Tx and a touch receiving electrode Rx, and the light sensor 22 includes a sensor TFT (sensor TFT) and a Switch TFT (Switch TFT) and a subsequent Readout (Readout circuit) and a processing system.
In order to avoid the influence of the gate driving line in the photo sensor 22 on the Rx in the touch sensor 21 and the influence of the Tx in the touch sensor 21 on the Readout in the photo sensor 22 in the present embodiment, as shown in fig. 1, 2, 3 (a) -3 (c), the control system in the embodiment of the present invention adopts a time-sharing multi-function driving method to divide the time T of one frame of the display device into a completely independent touch driving time T1, a light sensing driving time T3, and black inserting times (blanking times) T2 and T4, where the time of one frame is a frame period, and corresponds to the time corresponding to the time that the gate driving circuit of the display panel 10 completely scans the multiple rows of scanning lines row by row to form a display picture. In each frame period T, the driving sequence is sequentially performed according to the sequence of T1, T2, T3, and T4, for example, the touch sensor 21 is driven by the driving module 30 in the touch driving time T1, and the light sensor 22 is driven by the driving module 30 in the light sensing driving time T3. Since the driving timings of the two types of interaction sensors 20 are independently set and spaced apart from each other, a crosstalk problem between different interaction systems can be avoided. Preferably, the black insertion time t2 is equal to the black insertion time t4. In other embodiments of the present application, t3 is, for example, a touch driving time, in which the touch sensor 21 is driven by the driving module 30, and t1 is, for example, a light sensing driving time, in which the light sensor 22 is driven by the driving module 30.
In this embodiment, the driving module 30 in the control system is used to drive the interactive sensors 20 of the multiple types to cross-operate in the same frame period. Specifically, the driving module 30 is electrically connected to the multiple types of interaction sensors 20, and the electrode structures of the touch sensor 21 and the light sensor 22 in the control system are also arranged in multiple rows and multiple columns, for example, but the number of rows and columns of the electrode structures of the touch sensor 21 and the light sensor 22 may be the same as or different from the number of rows of the scan lines of the display driving circuit of the display panel 10. The driving module 30 can complete 1 or more complete scans of the touch sensor 21 in the period of t1 in a frame period, or complete one complete scan of the touch sensor 21 in a plurality of periods of t1 in a multi-frame period; the driving module 30 may complete 1 or more complete scans of the light sensor 22 in the period t3 of one frame of the frame period, or may complete one complete scan of the light sensor 22 in the periods t3 of multiple frames of the frame period.
In this embodiment, the state control module 40 includes, for example, a first operating state and a second operating state, wherein the operating frequency of the touch sensor 21 in the first operating state is greater than the operating frequency of the touch sensor in the second operating state, and the operating frequency of the light sensor 22 in the first operating state is lower than the operating frequency of the light sensor in the second operating state 22. That is, when the state control module 40 is switched from the first operation state to the second operation state, the operation frequency of the touch sensor 21 is reduced, and the operation frequency of the photo sensor 22 is increased. Further, when the state control module 40 is in the first working state, the working frequency of the touch sensor 21 is greater than the working frequency of the light sensor 22; when the state control module 40 is in the second operating state, the operating frequency of the touch sensor 21 is smaller than the operating frequency of the light sensor 22. Specifically, when the state control module 40 is in the first working state, the touch sensor 21 completes a complete scans in a t1 time period in a frame period, and the light sensor 22 completes 1 complete scan in b t3 time periods in a b frame period; when the state control module 40 is in the second working state, the light sensor 22 completes c complete scans in the t3 time period in one frame period, and the touch sensor 21 completes 1 complete scan in the d t1 time periods in the d frame period, wherein a, b, c, d is an integer greater than 1. Further, a is equal to c and b is equal to d.
In the present embodiment, the state control module 40 includes a third operating state, and when the state control module 40 is in the third operating state, the operating frequency of the touch sensor 21 is smaller than the operating frequency in the first operating state but larger than the operating frequency in the second operating state; the operating frequency of the light sensor 22 is greater than the operating frequency in the first operating state, but less than the operating frequency in the second operating state, i.e. the operating frequency of the touch sensor 21 decreases in sequence and the operating frequency of the light sensor 22 increases in sequence when the state control module 40 switches from the first operating state to the third operating state and then to the second operating state. Further, when the state control module 40 is in the third operating state, the operating frequency of the touch sensor 21 is equal to the operating frequency of the light sensor 22. When the state control module 40 is in the third operating state, the touch sensor 21 completes e complete scans in the t1 time period in one frame period, and the light sensor 22 completes e complete scans in the t1 time period in one frame period, wherein e is an integer greater than or equal to 1, and e is smaller than a, and e is smaller than c. Further, when the state control module 40 is in the third working state, the black inserting time t2 in each frame period is greater than the black inserting time t2 in the first state and the second state, and the black inserting time t4 in each frame period is greater than the black inserting time t4 in the first state and the second state.
Example two
The display device and the control system thereof disclosed in the second embodiment of the present invention are similar to those disclosed in the first embodiment, and for the same parts, the description of the embodiment is omitted here. In contrast, referring to fig. 2-4, in this embodiment, the control system further includes a detection module 50 electrically connected to the interaction sensor 20, specifically, the detection module 50 is electrically connected to the touch sensor 21 and the light sensor 22, respectively, for detecting whether a valid signal triggers the touch sensor 21 and the light sensor 22. Specifically, the effective signals include, for example, a first effective signal for triggering the touch sensor 21, for example, a touch signal generated by a user clicking or touching a screen of the display device, and a second effective signal for triggering the light sensor 22, for example, a light sensing signal generated by a laser pen illuminating the screen of the display device.
In this embodiment, the control system further includes a state switching module 60, where the state switching module 60 is electrically connected to the detecting module 50 and the state control module 40, respectively, and when the detecting module 50 detects that the valid signal triggers the touch sensor 21 but does not trigger the light sensor 22 in a determination period, the state switching module 60 adjusts the state control module 40 to a first working state; when the detection module 50 detects that the valid signal triggers the light sensor 22 but does not trigger the light sensor 22 in a determination period, the state switching module 60 adjusts the state control module 40 to a second working state; when the detection module 50 detects that the valid signal triggers the light sensor 22 and the light sensor 22 within a determination period, the state switching module 60 adjusts the state control module 40 to a third operating state. Specifically, when b is greater than or equal to d, the determination period is a b frame period; when b is smaller than d, the determination period is a d frame period.
Further, the state control module 40 of the control system includes an initial state, for example, preset for the system or selected by a user according to an actual application scenario, where the initial state includes a first working state, a second working state and a third working state.
In the following description, the working mode of the state control module 40 of the present control system is described, when the state control module 40 is in the first working state, the working frequency of the touch sensor 21 is greater than the working frequency of the light sensor 22, the touch sensor 21 completes a complete scans in a frame period, and the light sensor 22 completes 1 complete scan in a b frame period, where a and b are integers greater than 1. At this time, the light sensor 22 operates according to the first working state, the touch sensor 21 keeps high working frequency, the detection module 50 only detects the light sensor 22, and when the detection module 50 detects that no valid signal triggers the light sensor 22 in the b-frame period, the next b-frame period is continuously detected; if the second valid signal triggers the light sensor 22 in a certain b-frame period, the detection module 50 detects whether the first valid signal triggers the touch sensor 21 in the last frame period in the b-frame period; if there is a first valid signal in the last frame period of the b frame periods to trigger the touch sensor 21, the state switching module 60 switches the state control module 40 from the first working state to the third working state, so that the working frequency of the touch sensor 21 is equal to the working frequency of the photo sensor 22, the touch sensor 21 completes e complete scans in one frame period, the photo sensor 22 completes e complete scans in one frame period, wherein e is an integer greater than or equal to 1, if there is no first valid signal in the last frame period of the b frame periods to trigger the touch sensor 21, the state switching module 60 switches the state control module 40 from the first working state to the second working state, the working frequency of the touch sensor 21 is smaller than the working frequency of the photo sensor 22, the photo sensor 22 completes c complete scans in one frame period, and the touch sensor 21 completes d complete scans in 1 frame period, wherein c and d are integers greater than 1.
When the state control module 40 is in the second working state, the working frequency of the touch sensor 21 is smaller than the working frequency of the light sensor 22, the light sensor 22 completes c complete scans in one frame period, and the touch sensor 21 completes 1 complete scan in d frame period, wherein c and d are integers greater than 1. At this time, the light sensor 22 operates according to the second working state, the light sensor 22 keeps high working frequency, the detection module 50 only detects the touch sensor 21, and when the detection module 50 detects that no valid signal triggers the touch sensor 21 in the d frame period, the next d frame period is continuously detected; if the first valid signal triggers the touch sensor 21 within a certain d frame period, the detection module 50 detects whether the second valid signal triggers the light sensor 22 in the last frame period of the d frame period; if there is a second valid signal in the last frame period of the d frame periods to trigger the photo sensor 22, the state switching module 60 switches the state control module 40 from the second working state to the third working state, so that the working frequency of the touch sensor 21 is equal to the working frequency of the photo sensor 22, the touch sensor 21 completes e complete scans in one frame period, the photo sensor 22 completes e complete scans in one frame period, where e is an integer greater than or equal to 1, and if there is no second valid signal in the last frame period of the d frame periods to trigger the photo sensor 22, the state switching module 60 switches the state control module 40 from the second working state to the first working state, the working frequency of the touch sensor 21 is greater than the working frequency of the photo sensor 22, the touch sensor 21 completes a complete scans in one frame period, the photo sensor 22 completes b complete scans in 1 frame period, where a is an integer greater than 1.
When the state control module 40 is in the third working state, the working frequency of the touch sensor 21 is equal to the working frequency of the light sensor 22, the touch sensor 21 completes e complete scans in one frame period, the light sensor 22 completes e complete scans in one frame period, where e is an integer greater than or equal to 1, and e is smaller than a, and e is smaller than c. At this time, the detection module 50 detects the touch sensor 21 and the light sensor 22 at the same time, the light sensor 22 operates according to the third working state, the touch sensor 21 and the light sensor 22 simultaneously maintain a medium working frequency, and when the detection module 50 detects that the first effective signal and the second effective signal simultaneously trigger the touch sensor 21 and the light sensor 22 in the e-frame picture period, the next e-frame picture period is continuously detected; when the detection module 50 detects that only the first valid signal triggers the touch sensor 21 in a certain e frame period, the state switching module 60 switches the state control module 40 from the third working state to the first working state, the working frequency of the touch sensor 21 is greater than the working frequency of the light sensor 22, the touch sensor 21 completes a complete scans in a frame period, and the light sensor 22 completes 1 complete scan in a b frame period, wherein a and b are integers greater than 1; when the detection module 50 detects that only the second valid signal triggers the light sensor 22 in a certain e frame period, the state switching module 60 switches the state control module 40 from the third working state to the second working state, the working frequency of the touch sensor 21 is smaller than the working frequency of the light sensor 22, the light sensor 22 completes c complete scans in a frame period, and the touch sensor 21 completes 1 complete scan in d frame periods, wherein c and d are integers greater than 1.
When the state control module 40 is in the third working state and the detection module 50 detects that no valid signal triggers the touch sensor 21 and the light sensor 22 in a certain e-frame period, the state switching module 60 starts counting from the next frame of the e-frame period, and when the s-th frame (s is an integer greater than 1) is counted, the state switching module 60 switches the state control module 40 to the initial state.
Example III
The display device and the control system disclosed in the third embodiment of the present invention are similar to those disclosed in the first and second embodiments, and for the same parts, the description of the present embodiment is omitted here. In contrast, in the present embodiment, the main sensor is, for example, a touch sensor, and the auxiliary sensor includes a plurality of types, which are, for example, a light sensor and a pressure sensor. When the state control module is in different working states, the main sensor and at least one of the auxiliary sensors have different working frequencies under the driving of the driving module, for example, when the state control module 40 is in one working state, the touch sensor 21 keeps high working frequency, and the light sensor 22 and the pressure sensor keep low working frequency; when the state control module 40 is in another working state, the touch sensor 21 keeps a low working frequency, the light sensor 22 keeps a low frequency state, and the pressure sensor keeps a high working frequency; when the state control module 40 is in the other operating state, the touch sensor 21 maintains a low operating frequency, the light sensor 22 maintains a high operating frequency, and the pressure sensor maintains a low operating frequency; when the state control module 40 is in another working state, the touch sensor 21, the light sensor 22 and the pressure sensor all maintain the middle working frequency.
The control system and the display device provided by the embodiment of the present invention are described in detail, and specific examples are applied to illustrate the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present invention, the present description should not be construed as limiting the present invention.