CN115185414A

Movatterモバイル変換

Info

Publication number: CN115185414A
Application number: CN202210886872.7A
Authority: CN
Inventors: 李源; 张小涛; 曲喜维
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2022-07-26
Filing date: 2022-07-26
Publication date: 2022-10-14
Anticipated expiration: 2042-07-26
Also published as: CN115185414B

Abstract

Description

Display device and cursor control method

Technical Field

The application relates to the technical field of intelligent display equipment, in particular to display equipment and a cursor control method.

Background

The display device is a terminal device capable of outputting a specific display picture, and may be a terminal device such as a smart television, a mobile terminal, a smart advertisement screen, and a projector. Taking an intelligent television as an example, the intelligent television is based on an Internet application technology, is provided with an open operating system and a chip, is provided with an open application platform, can realize a bidirectional man-machine interaction function, integrates multiple functions of video, entertainment, data and the like, and is a television product for meeting diversified and personalized requirements of users.

In order to facilitate interaction of a user, the display device supports a mouse to control a cursor of a display screen, the user clicks a video on a browser page through the cursor, scrolls a webpage or clicks a soft keyboard through operating the mouse, information is input on a page of the soft keyboard, and when applications and pages of the mouse which are not supported or responded are operated on the display device, if switching to applications and pages of the response mouse is needed, the mouse is disconnected by an application management layer, so that the cursor cannot be operated; currently, a cursor control function is needed to selectively control a cursor for different applications or different application scenarios, which is convenient for a user to operate.

Disclosure of Invention

The application provides a display device and a cursor control method, which can selectively control a cursor aiming at different applications or different application scenes, and are convenient for a user to operate.

In one aspect, some embodiments of the present application provide a display device, including:

a display configured to display a user interface, the user interface including at least one display window;

a controller configured to:

responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor;

determining a display window containing the cursor as a target display window based on the position information of the cursor;

analyzing the state identification of the target display window to obtain the operation state of the target display window;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

In some embodiments of the present application, the controller performs determining the display window containing the cursor as a target display window, further configured to:

acquiring last position information of a cursor;

comparing the current position information of the cursor with the last position information of the cursor;

and if the current position information of the cursor and the last position information of the cursor are in different display windows, executing a step of analyzing the state identifier of the target display window to obtain the operation state of the target display window.

In some embodiments of the present application, the controller execution is further configured to:

receiving a cursor style modification instruction input by a user;

responding to the cursor style modification instruction, changing the cursor style into a cursor style specified by the cursor style modification instruction, and adding a mark to a display window where the cursor is located after the cursor style is changed;

acquiring the current position of the cursor to obtain the position information of the cursor;

determining a target application corresponding to a display window containing the cursor based on the position information of the cursor;

and if the target application contains the mark, displaying a cursor of a designated cursor style on the display window.

In some embodiments of the present application, the controller executes the target display window to change, analyzes the status identifier of the target display window, and is further configured to:

detecting the operating states of a first display window and a second display window, wherein the first display window is a target display window corresponding to the last position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor;

if the operation states of the first display window and the second display window allow the cursor operation to be accepted, changing the cursor of the first cursor style of the first display window into the cursor of the second cursor style of the second display window, and displaying the cursor of the second cursor style on the second display window.

In some embodiments of the present application, after obtaining the operating state of the target display window, the controller is further configured to:

identifying an application identifier of the display window, and inquiring the type of an application program according to the application identifier;

if the application identifier of the application program is a first type of application identifier, distributing a first cursor operation event in the cursor operation events to the target display window; the type of the application program corresponding to the first type of application identification comprises an interaction type and a text type; the first cursor operation event is a click operation event;

if the application identifier of the application program is a second type of application identifier, a first cursor operation event and a second cursor operation event in the cursor operation events are distributed to the target display window; the application program type corresponding to the second type application identification comprises a system type and an audio-video type; the second cursor operation event is a drag and/or scroll wheel operation event.

In some embodiments of the present application, after determining that the operating state of the target display window is to allow accepting a cursor operation, the controller is further configured to:

identifying a user mode of the display device; the user mode comprises a first mode and a second mode;

if the user mode of the display equipment is the first mode, stopping distributing the cursor operation event;

and if the user mode of the display equipment is the second mode, distributing the cursor operation event to the target display window.

In some embodiments of the present application, after determining that the user mode of the display is the second mode, the controller is further configured to:

acquiring account information of a current login account;

identifying a user identifier of the account information, and determining an account type according to the user identifier;

if the user identifier is a first user identifier, a first cursor operation event in the cursor operation events is distributed to the target display window; and the user type corresponding to the first user identification is an account type which is not verified.

In some implementations of the present application, the controller performs determining the type of the account based on the user identification, and is further configured to:

and if the account identification of the account is a second user identification, distributing a first cursor operation event and a second cursor operation event in the cursor operation events to the target display window, wherein the user type corresponding to the second user identification is a verified account type.

In some embodiments of the present application, the controller, in response to the cursor operation event, is further configured to:

detecting the operation state of a top-layer window in the user interface;

if the operation state of the top window is that the cursor operation is allowed to be accepted, the cursor operation event is sent to the top window;

and if the operation state of the top-layer window is not allowed to receive the cursor operation, detecting the operation states of other windows except the top-layer window in the user interface so as to send the cursor operation event to the window allowed to receive the cursor operation.

On the other hand, some embodiments of the present application further provide a cursor control method, which is applied to a display device, where the display device includes: a display and a controller; the display is used for displaying a user interface, and the user interface comprises a plurality of display windows; the cursor control method comprises the following steps:

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments are briefly described below, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a block diagram of a hardware configuration of a control apparatus according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments;

FIG. 5 illustrates a user interface diagram displayed by the display device in some embodiments;

FIG. 6 is a flowchart illustrating steps of a process for executing a cursor control method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a mouse system architecture according to some embodiments of the present application;

FIG. 8 is a schematic view of a scenario for executing a cursor control method in an embodiment of the present application;

FIG. 9 is a schematic diagram of yet another scenario for implementing a cursor control method in some embodiments of the present application;

FIG. 10 is a schematic diagram of a display interface presenting a distribution cursor operation event in some embodiments of the present application;

FIG. 11 is a schematic diagram illustrating distribution of different cursor operation events according to account type in some embodiments of the present application;

FIG. 12 is a timing diagram of a cursor control method provided in some embodiments of the present application.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, thedisplay apparatus 200 is also in data communication with aserver 400, and a user can operate thedisplay apparatus 200 through theterminal apparatus 300 or thecontrol device 100.

In some embodiments, thecontrol apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls thedisplay device 200 in a wireless or wired manner. The user may control thedisplay apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the display device may not receive instructions using the smart device or control device described above, but rather receive user control through touch or gestures, or the like.

In some embodiments, theterminal device 300 may comprise any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, theterminal device 300 may also be used to control thedisplay device 200. For example, thedisplay apparatus 200 is controlled using a camera application running on the terminal apparatus.

In some embodiments,terminal device 300 and a display device may also be used for communication of data.

In some embodiments, thedisplay device 200 may also be controlled in a manner other than thecontrol apparatus 100 and theterminal device 300, for example, the voice instruction control of the user may be directly received by a module configured inside thedisplay device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside thedisplay device 200.

In some embodiments, thedisplay device 200 is also in data communication with aserver 400. Thedisplay device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. Theserver 400 may provide various contents and interactions to thedisplay apparatus 200. Theserver 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by theserver 400 may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of thecontrol apparatus 100 according to an exemplary embodiment. As shown in fig. 2, thecontrol device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. Thecontrol apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by thedisplay device 200, serving as an interaction intermediary between the user and thedisplay device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Taking the example that thecontrol device 100 is a remote controller, thecontrol device 100 is distributed with a plurality of functional keys, and a user can generate a corresponding control instruction by pressing the keys on the remote controller, and send the control instruction to the display device through the remote controller, so that the display device executes the control instruction. For example, the control device is provided with a function key for instructing the display device to enter a cursor mode, and a user can select the key and send a mode selection instruction for instructing to enter the cursor mode to the display device, so that the display device enters the cursor mode to establish mapping between the remote controller and a cursor displayed by the display device, and the cursor displayed by the display device can be controlled to move by moving the remote controller.

Fig. 3 shows a hardware configuration block diagram of thedisplay apparatus 200 according to an exemplary embodiment.

In some embodiments, thedisplay apparatus 200 includes at least one of atuner demodulator 210, acommunicator 220, adetector 230, anexternal device interface 240, acontroller 250, adisplay 260, anaudio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, thedisplay 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, thedisplay 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, thetuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments,communicator 220 is a component for communicating with external devices orservers 400 according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. Thedisplay apparatus 200 may establish transmission and reception of a control signal and a data signal with thecontrol device 100 or theserver 400 through thecommunicator 220.

In some embodiments, thedetector 230 is used to collect signals of the external environment or interaction with the outside. For example,detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, thedetector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or thedetector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, thecontroller 250 and themodem 210 may be located in different separate devices, that is, themodem 210 may also be located in an external device of the main device where thecontroller 250 is located, such as an external set-top box.

In some embodiments, thecontroller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. Thecontroller 250 controls the overall operation of thedisplay apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on thedisplay 260, thecontroller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments, thecontroller 250 includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphic Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. The system is used for executing the operating system and the camera application instruction stored in the memory, and executing various camera applications, data and contents according to various interaction instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on thedirect display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed ondisplay 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between a camera application or operating system and a user that enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments,user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

As shown in fig. 4, the system of the display device is divided into three layers, i.e., an application layer, a middleware layer and a hardware layer from top to bottom.

The Application layer mainly includes common applications on the television and an Application Framework (Application Framework), wherein the common applications are mainly applications developed based on the Browser, such as: HTML5 APPs; and native applications (native APPs);

an Application Framework (Application Framework) is a complete program model, and has all basic functions required by standard Application software, such as: file access, data exchange, and interfaces to use these functions (toolbars, status lists, menus, dialog boxes).

The application framework layer in the embodiment of the application includes a manager (Managers), a Content Provider (Content Provider), and the like, wherein the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; a Location Manager (Location Manager) for providing access to the system Location service to the system service or application; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is configured to manage all window programs, for example, obtain a size of a display screen, determine whether a status bar exists, lock the screen, intercept the screen, control a change of the display window (for example, reduce and display the display window, perform dithering display, perform distortion display, and the like), detect whether to open a cursor mode, control a cursor to move to a corresponding position after opening the cursor mode, and the like.

Native APPs (Native APPs) may support online or offline, message push, or local resource access.

The middleware layer comprises various television protocols, multimedia protocols, system components and other middleware. The middleware can use basic service (function) provided by system software to connect each part of an application system or different applications on a network, and can achieve the purposes of resource sharing and function sharing.

The hardware layer mainly comprises an HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for butting all the television chips, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

The above embodiments describe the hardware/software architecture and functional implementation of the display device. In some application scenarios, thedisplay device 200 may directly enter a preset user interface as shown in fig. 5 after being started, where the user interface includes at least one operation control, a program in the application program layer may be displayed through a specific operation control, or may be further displayed after the operation control is selected, and in addition, a user may interact with thedisplay device 200 through thecontrol device 100, taking thecontrol device 100 as a remote controller as an example, and the user may generate a corresponding control instruction by pressing a key on the remote controller, and send the control instruction to the display device through the remote controller, so that the display device executes the control instruction. For example, with further reference to fig. 5, acursor 510 may also be displayed in the user interface of thedisplay device 200, and the user may control the cursor to move on the user interface through the movement control means.

In some embodiments, the operation mode of thedisplay device 200 includes a cursor mode, in which thedisplay device 200 may receive an operation event of a user, call a display parameter of a cursor, and control the cursor to be displayed in the screen according to the display parameter of the cursor, and may move the cursor to a target position on the screen according to the received cursor movement instruction. Since some applications and pages cannot respond to a cursor, when a user switches from an application and page that does not respond to a cursor to one that does respond to a cursor, a situation may arise where the cursor cannot operate because the cursor has already been disconnected by the application management layer.

In order to improve the interactive experience of a user, in some embodiments of the present application, a cursor control method is provided, in which a target display window is determined based on a position of a cursor, different cursor operation events are distributed according to a state identifier of the target display window, and the cursor is selectively distributed and controlled for different applications or different application scenes, so as to facilitate the user experience.

As shown in fig. 6, thedisplay device 200 may be used to execute the program steps of the cursor control method, and if no specific description is given, the steps executed by thedisplay device 200 in the following embodiments are all completed by thecontroller 250 in cooperation with other components in thedisplay device 200.

S610: and acquiring a cursor operation event input by a user. The cursor operation event refers to an operation for controlling a focus cursor in the user interface, and includes controlling a focus cursor moving operation, a selection operation, a long-time pressing operation, a dragging operation, a roller operation and the like. Thedisplay device 200 may monitor the interactive operation input by the user in real time during use, and acquire a cursor operation event input by the user according to the interactive action performed by the user.

In some embodiments, the user may enter cursor operation events through different device carriers. For example, the user may input an operation event for moving a focus cursor through a direction key on thecontrol device 100 associated with thedisplay apparatus 200; the user may also input a cursor operation event by means of a key, a touch screen, or the like through theterminal device 300 that establishes a communication connection with thedisplay device 200.

Thepartial display device 200 may also input a cursor operation event based on an external device by connecting the external device. For example, thedisplay device 200 may be connected to an external device such as a mouse through a USB interface, and the user may input a cursor operation event by performing an operation action such as moving, clicking, or the like on the mouse.

In order to enable thedisplay device 200 to obtain a cursor operation event input by a user, in some embodiments of the application, a cursor operation event monitoring module for a browser may be built in thedisplay device 200, and the cursor operation event monitoring module may detect an input action of the user in real time in a process that thedisplay device 200 displays a user interface based on the browser, and generate the cursor operation event according to the input action of the user.

S620: and responding to a cursor operation event, detecting the current position of the cursor, and obtaining the position information of the cursor.

Thedisplay apparatus 200 may open a cursor mode in response to a cursor operation event, the cursor mode being a mode in which a user may control a cursor to perform the cursor operation event in a user interface by moving a control device. After thecontroller 250 controls the cursor mode to be turned on, the input coordinates of thecontrol device 100 in the reference coordinate system of the sensing region may be detected, so as to control the position of the cursor in the user interface according to the input coordinates.

The sensing area is an area of a real physical space within a certain range around thedisplay device 200, for example, the sensing area may be an area placed in front of thedisplay device 200, and the sensing area may be an area in a cubic space with a length, a width and a height in front of thedisplay device 200, which are respectively a, b and c. For convenience of description, in the embodiment of the present application, the reference coordinate system of the sensing region is referred to as a first coordinate system, and the reference coordinate system of the user interface/display device 200 is referred to as a second coordinate system, wherein the first coordinate system is a three-dimensional coordinate system including an X-axis, a Y-axis and a Z-axis, the second coordinate system is a two-dimensional coordinate system including an X-axis and a Y-axis, the X-axis and the Y-axis may be two adjacent boundaries of the user interface, and the X-axis and the Y-axis may be the same direction as the X-axis, the Y-axis and the Y-axis are the same direction, and the Z-axis is perpendicular to the user interface, i.e., the Z-axis is perpendicular to a plane formed by the X-axis and the Y-axis.

In some embodiments, thecontrol apparatus 100 is an apparatus capable of emitting a radio frequency signal, and when a user sends a radio frequency signal for instructing a cursor in a user interface to move to thedisplay device 200 through thecontrol apparatus 100 within the sensing region, thedisplay device 200 receives the radio frequency signal, and obtains input coordinates of the position of the control point in the first coordinate system, and finally obtains position information of the cursor. Wherein a control point is a specific point on the control device, such as a top point, a bottom pad, a center point, etc.

S630: and determining the display window containing the cursor as a target display window based on the position information of the cursor.

When thedisplay device 200 presents the user interface, different display contents can be presented through different display windows to realize different user interaction functions. For example, when a browser is used for web browsing, a specific web browsing interface can be formed through two types of windows with a UI function and a browsing function, and two display contents are presented; for another example, by using the split screen mode of thedisplay device 200, different split screen applications are respectively displayed in the first split screen area and the second split screen area of thedisplay 260, so as to present two display contents; for another example, when the user operates two or more application programs in the foreground through thedisplay device 200, a situation may occur in which multiple applications overlap, that is, the application a is on the upper layer of the application B, and the actual display range of the application B is the full screen. Therefore, it is necessary to determine a target display window based on the position information of the cursor in order to distribute the cursor operation event.

In some embodiments, the mainstream browser on an embedded platform is a UI system that uses a chrome kernel framework, while being based on Hypertext Markup Language (HTML). The browser has both a UI function and a web browsing function. Therefore, when thedisplay device 200 performs a function such as web browsing using the browser, a specific web browsing interface may be composed through two types of windows of the UI function and the browsing function. Since the display of the user interface depends on the browser, the user can input a cursor operation event for controlling the movement, selection, and the like of the focus cursor through thecontrol apparatus 100 or theterminal device 300. These cursor operation events may be responded to a certain display window according to a specific interactive control manner, and for convenience of description, the display window responding to the browser event is referred to as a target display window. In the process of browsing the webpage, the window where the webpage content is located is the uppermost layer and is in a display state, and at the moment, the webpage window can acquire the cursor operation event input by the user.

In some embodiments, when thedisplay device 200 runs a plurality of applications, the application layer obtains progress information and determines a currently running application based on the progress information. The method comprises the steps of obtaining a drawing area of each application, detecting the current position of a cursor at regular time, and determining a display window containing the cursor as a target display window.

S640: and analyzing the state identifier of the target display window to obtain the operation state of the target display window.

After thedisplay device 200 determines the target display window, the status identifier of the target display window is acquired. The state identifier of the target display window may be stored in a database of thedisplay device 200 in real time as a state parameter of each display window, and after thedisplay device 200 responds to a cursor operation event, the state identifier corresponding to each current display window may be retrieved from the database.

Thedisplay device 200 analyzes the status identifier of the target display window to obtain the operating status of the target display window. The operation state is a state attribute set for each display window aiming at the currently displayed user interface, and comprises permission of accepting cursor operation and non-permission of accepting cursor operation. For example, in browsing a web page, the user interface displayed by thedisplay device 200 may include a UI window and a browsing window, and when the content displayed by the UI window is content that does not require user intervention operation, thedisplay device 200 may set the current operation state of the UI window to disallow accepting cursor operation. Meanwhile, the operation state of the browse window is set to allow accepting a cursor operation.

S650: and if the operation state of the target display window is that the cursor operation is allowed to be received, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window.

S660: and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

Thedisplay apparatus 200 determines whether to distribute the cursor operation event based on the operation state of the target display window. If the operation state of the target display window is that the cursor operation is allowed to be accepted, the cursor operation event is distributed to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As shown in fig. 7, thecontrol apparatus 100 takes a mouse as an example, an application layer (application management layer) may monitor a mouse message of a mouse device management layer, and after the mouse device is accessed, the mouse device management layer receives an access notification and sends a message supporting mouse operation to the application management layer in a notification form. The application management layer initializes the mouse object and distributes the mouse access information to each application. The application needing to respond to the mouse requests to register to the application management layer, and the mouse object is obtained after the registration is successful. The application management layer will continue to send mouse events to the currently displayed and registered applications. When the mouse is disconnected, the application management layer distributes the mouse disconnection information to each application, cancels the mouse registration of the application, hides the cursor display corresponding to the mouse, and destroys the cursor object.

When a plurality of applications are run on thedisplay device 200 and the plurality of applications are overlapped, it is necessary to determine a target display window according to the state identifier of the display window corresponding to different applications, and determine whether to distribute a cursor operation event, that is, some applications respond to a cursor operation, other applications do not respond to a cursor operation, or all applications respond to a mouse, and thedisplay device 200 distributes a mouse event according to the state identifier of the target display window. Therefore, each time the cursor moves, thedisplay device 200 needs to perform the step of obtaining the status identifier of the display window, which makes the operation cumbersome. To facilitate ease of operation, thecontroller 250 is further configured to: acquiring last position information of a cursor; comparing the current position information of the cursor with the last position information of the cursor; and if the current position information of the cursor and the last position information of the cursor are in different display windows, executing a step of analyzing the state identifier of the target display window to obtain the operation state of the target display window.

Thedisplay device 200 acquires position information of the cursor last time; comparing the position information of the cursor with the last position information of the cursor to obtain a comparison result; determining whether the second display window of the cursor is the same as the first display window of the cursor based on the comparison result; the first display window is a target display window corresponding to the last position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor; if the target display window is changed, analyzing the state identification of the target display window to obtain the operation state of the target display window; if the operation state of the target display window is that the cursor operation is allowed to be received, the cursor operation event is distributed to the target display window; and if the operation state of the target display window is that the cursor operation is not allowed to be accepted, stopping distributing the cursor operation event.

As shown in fig. 8, the user interface presented by thedisplay 260 includes a display window of an application a located on an upper layer and a display window of an application B located on a lower layer, because the application a located on the upper layer does not respond to the cursor operation event, the application B located on the lower layer responds to the cursor operation event, and the current cursor position is at a point P, and because the display window corresponding to the point P does not accept the cursor operation event, the application management layer may obtain the drawing area of the application a on the upper layer and regularly monitor the current cursor position. When the application B has the requirement of displaying the cursor, a request is sent to the application management layer; the application management layer judges the current position of the cursor and obtains the position of the cursor at the last time, and if the current position of the cursor is in the display area of the application A, namely the display window is not changed, the cursor is hidden; when the cursor moves from the point P to the point Q, thedisplay device 200 obtains the last position information of the cursor, that is, the point P, and at this time, the display window corresponding to the point P is different from the display window corresponding to the point Q, and the cursor is displayed because the current position of the cursor is in the display area of the application B; that is, when the cursor position is in the area outside the application a, the application management layer will distribute the cursor operation event to the application B at the same time.

As shown in fig. 9, both the application a located at the upper layer and the application B located at the lower layer respond to the cursor operation event, and when the current position of the cursor is in the display area of the application a, a cursor operation event a is distributed to the application a; when the cursor is moved from the R point to the S point, i.e., when the current position of the cursor is in the display area of the application B, and a cursor operation event B is distributed to the application B.

To enhance the user experience, in some embodiments, the user may modify the style of the cursor. Thecontroller 250 is further configured to: receiving a cursor style modification instruction input by a user; responding to the cursor style modification instruction, changing the cursor style into a cursor style specified by the cursor style modification instruction, and adding a mark to a display window where the cursor is located after the cursor style is changed; acquiring the current position of the cursor to obtain the position information of the cursor; determining a target application corresponding to a display window containing the cursor based on the position information of the cursor; and if the target application contains the mark, displaying a cursor of a designated cursor style on the display window.

When multiple applications are present in an overlapping manner, the target display window is easily distinguished for the user. Thecontroller 250 is further configured to: detecting the operating states of a first display window and a second display window, wherein the first display window is a target display window corresponding to the last position information of the cursor, and the second display window is a target display window corresponding to the current position information of the cursor; if the operation states of the first display window and the second display window allow the cursor operation to be accepted, changing the cursor of the first cursor style of the first display window into the cursor of the second cursor style of the second display window, and displaying the cursor of the second cursor style on the second display window.

As shown in fig. 10, in response to a cursor operation on the first display window and the second display window, thedisplay device 200 transmits values of the relevant parameters based on the setWindowFlags method to add window markers to the display window corresponding to the application a and the display window corresponding to the application B. Because the application A positioned at the upper layer and the application B positioned at the lower layer both respond to the cursor operation event, when the current position of the cursor is positioned in the display area of the application A, the cursor style of the application A is displayed, and the cursor operation event is distributed to the application A; when the cursor moves from the point U to the point V, namely when the current position of the cursor is in the display area of the application B, the cursor style of the application B is displayed, and a cursor operation event is distributed to the application B.

Since different applications have different administrative rights, to facilitate management, thecontroller 250 is configured to: identifying an application identifier of the display window, and inquiring the type of an application program according to the application identifier; if the application identifier of the application program is a first type of application identifier, a first cursor operation event in the cursor operation events is distributed to the target display window; the type of the application program corresponding to the first type of application identification comprises an interaction type and a text type; the first cursor operation event is a click operation event; if the application identifier of the application program is a second type of application identifier, a first cursor operation event and a second cursor operation event in the cursor operation events are distributed to the target display window; the application program type corresponding to the second type application identification comprises a system type and an audio-video type; the second cursor operation event is a drag and/or scroll wheel operation event.

In some embodiments, the display device may further include a memory, the memory may be configured to store an application identification of each display window in the current user interface in real time, and thecontroller 250 of thedisplay device 200 may transmit the query request to the memory upon detecting the application identification of the display window in the user interface. Wherein the query request includes a window ID for each display window in the user interface. The memory, upon receiving the query request, may feed back the application identification to thecontroller 250 according to the window ID in response to the query request.

For example, thedisplay device 200 obtains the application identifier of the display window a from the memory in response to the cursor operation events a and b, determines that the application identifier of the display window a is the first type of application identifier, i.e., the text type, and since the cursor operation event a is a click operation and the cursor operation event b is a drag operation, thedisplay device 200 only distributes the cursor operation event a to the application corresponding to the display window a.

For example, thedisplay device 200 obtains the application identifier of the display window C from the memory in response to the cursor operation events C and d, determines that the application identifier of the display window C is the second type of application identifier, i.e., the video type, and since the cursor operation event C is a click operation and the cursor operation event d is a drag operation, thedisplay device 200 distributes the cursor operation event C and the cursor operation event d to the application corresponding to the display window C.

To be suitable for a variety of different application scenarios, thecontroller 250 is further configured to: identifying a user mode of thedisplay apparatus 200; the user mode comprises a first mode and a second mode; if the user mode of thedisplay device 200 is the first mode, stopping distributing the cursor operation event; the first mode comprises a hotel mode and a shopping mall mode; if the user mode of thedisplay device 200 is the second mode, distributing the cursor operation event to the target display window; the second mode includes a home mode and an office mode.

For example, in response to a cursor operation event a, thedisplay device 200 detects a current position of the cursor, determines a target display window, obtains a state identifier of the target display window, analyzes the state identifier of the target display window, and obtains an operation state of the target display window, where the operation state of the target display window is to allow the cursor operation event to be accepted, and when thedisplay device 200 recognizes that a current user mode is a hotel mode, that is, a first mode, the distribution of the cursor operation event a is stopped.

For example, in response to a cursor operation event b, thedisplay device 200 detects a current position of the cursor, determines a target display window, obtains a state identifier of the target display window, analyzes the state identifier of the target display window, and obtains an operation state of the target display window, where the operation state of the target display window is to allow the cursor operation event to be received, and if thedisplay device 200 recognizes that a current user mode is a home mode, that is, a second mode, the display device distributes the cursor operation event b to an application corresponding to the target display window.

To facilitate user management, as shown in fig. 11, thecontroller 250 is further configured to: acquiring account information of a current login account; identifying a user identifier of the account information, and determining the type of the account according to the user identifier; if the account number identification of the account number is a first user identification, a first cursor operation event in the cursor operation events is distributed to the target display window; the first cursor operation event is a hitting and moving operation event, the user type corresponding to the first user identification is an account type which is not verified, and the account type comprises a child account and a tourist account. If the account number identification of the account number is a second user identification, a first cursor operation event and a second cursor operation event in the cursor operation events are distributed to the target display window; the second cursor operation event is a dragging and roller operation event, and the user type corresponding to the second user identification is a verified account type.

For example, thedisplay device 200 responds to the cursor operation events c and d, detects the current position of the cursor, determines the target display window, and obtains the operation state of the target display window, where the operation state of the target display window is that the cursor operation event is allowed to be accepted; thedisplay device 200 acquires account information of a current login account, determines that the account is a child account, determines that the cursor operation event c is a moving event, namely a first cursor operation event, and determines that d is a dragging event, namely a second cursor operation event, and thedisplay device 200 distributes the cursor operation event c to a target display window.

For example, in response to the cursor operation events e and f, thedisplay device 200 detects the current position of the cursor, determines a target display window, and obtains the operation state of the target display window, where the operation state of the target display window is to allow the cursor operation event to be accepted; thedisplay device 200 acquires account information of a current login account, determines that the account is an account 1 in the type of the account, the account is a verified account, the cursor operation event e is a moving event, namely a first cursor operation event, f is a dragging event, namely a second cursor operation event, and thedisplay device 200 distributes the cursor operation event e and the cursor operation event f to a target display window.

In the process of browsing a webpage, when a top-level window where webpage content is located does not support a user interface of an operation event, the problem of invalid user operation is easy to occur. The controller is further configured to: detecting the operation state of a top-layer window in the user interface; if the operation state of the top window is that the cursor operation is allowed to be accepted, the cursor operation event is sent to the top window; and if the operation state of the top-layer window is not allowed to receive the cursor operation, detecting the operation states of other windows except the top-layer window in the user interface so as to send the cursor operation event to the window allowed to receive the cursor operation.

By detecting the operation state of the top window, different windows can be determined as focus windows according to different operation states corresponding to the top window. If the operation state of the top window is that the cursor operation is allowed to be accepted, the current top window can respond to the current cursor operation event, so that the cursor operation event can be sent to the top window to trigger the top window to display a response picture corresponding to the current cursor operation event.

For example, when the top-level window is a browser window or a UI window that requires user intervention operation, by detecting the operation state of the top-level window, an entry "Operable condition =1" corresponding to the top-level window may be read, and it may be determined that the current top-level window can respond to the current cursor operation event, that is, the current top-level window may be used as the focus window. Therefore, thecontroller 250 can send the cursor operation event input by the user to the current top-level window, so that the top-level window executes the cursor operation event to realize interactive control. If the operation state of the top-layer window is that the cursor operation is not allowed to be received, it indicates that the current top-layer window is a UI window which does not need the user to intervene, and at this time, if the cursor operation event input by the user is sent to the window, the problem of invalid user operation may occur. To this end, thedisplay device 200 may detect the operation states of windows other than the top window in the user interface again to transmit a cursor operation event to a window that is allowed to accept a cursor operation.

In summary, the cursor control method provided in some embodiments of the present application may enrich the cursor application scene of thedisplay device 200, and support application use of different drawing layers. Different applications can customize cursor patterns, different cursor patterns are presented based on response behaviors of different applications, and cursor display and cursor distribution events are selectively performed when the applications on different layers are overlapped, so that user experience is improved.

Based on the cursor control method, as shown in fig. 12, some embodiments of the present application further provide a display device, including:

adisplay 260, acontroller 250; wherein thedisplay 260 is configured to display a user interface comprising at least one display window; acontroller 250 configured to perform the following program steps:

acquiring a cursor operation event input by a user;

responding to the cursor operation event, acquiring the current position of the cursor, and obtaining the position information of the cursor;

if the operation state of the target display window is that the cursor operation is allowed to be accepted, the cursor operation event is distributed to the target display window;

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display device, comprising:

a controller configured to:

if the operating state of the target display window is that the cursor operation is allowed to be accepted, distributing the cursor operation event to the target display window so as to execute a control instruction corresponding to the cursor operation event based on the target display window;

2. The display device according to claim 1, wherein the controller performs determining a display window containing the cursor as a target display window, and is further configured to:

acquiring last position information of a cursor;

3. The display device of claim 2, wherein the controller executes instructions further configured to:

receiving a cursor style modification instruction input by a user;

responding to the cursor style modification instruction, changing the cursor style into a cursor style specified by the cursor style modification instruction, and adding a mark to a display window where the cursor is positioned after the cursor style is changed;

4. The display device of claim 3, wherein the controller performs parsing the status indication for the target display window, and is further configured to:

5. The display device of claim 1, wherein the controller, having obtained the operational state of the target display window, is further configured to:

if the application identifier of the application program is a second type of application identifier, a first cursor operation event and a second cursor operation event in the cursor operation events are distributed to the target display window; the application program type corresponding to the second type application identification comprises a system type and an audio-video type; the second cursor operation event is a dragging and/or roller operation event.

6. The display device according to claim 5, wherein after the controller determines that the operation state of the target display window is a state allowing acceptance of a cursor operation, the controller is further configured to:

7. The display device of claim 6, wherein after determining that the user mode of the display is the second mode, the controller is further configured to:

acquiring account information of a current login account;

if the user identifier is a first user identifier, distributing a first cursor operation event in the cursor operation events to the target display window; and the user type corresponding to the first user identification is an account type which is not verified.

8. The display device according to claim 7, wherein the controller performs determining the type of the account according to the user identification, and is further configured to:

9. The display device of claim 1, wherein the controller, in response to the cursor operation event, is further configured to:

detecting the operation state of a top-layer window in the user interface;

10. A cursor control method is applied to a display device, and the display device comprises: a display and a controller; the display is used for displaying a user interface, and the user interface comprises a plurality of display windows; the cursor control method comprises the following steps: