CN111464844A - Screen projection display method and display equipment - Google Patents

Abstract

The invention discloses a screen projection display method and display equipment, wherein the display equipment comprises: a display; the communicator is used for being in communication connection with the terminal equipment and the server; a user interface for receiving user input; a controller for performing: responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source; responding to a permission instruction input by a user, and sending a first instruction to a server; when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen casting request; and responding to a switching instruction, exiting the initial film source, and playing the recommended film source corresponding to the recommended information. According to the method and the device, the initial film source can be played, and the film source recommended by the server can be played, so that the screen projection is not only dependent on the continuous request of the user to project the film source, the screen projection function is improved, and the user experience is improved.

Description

Screen projection display method and display equipment

Technical Field

The invention relates to the technical field of display equipment, in particular to a screen projection display method and display equipment.

Background

The D L NA (IGITA L L IVING NETWORK a LL IANCE, digital living NETWORK alliance) protocol is one of commonly used multi-screen interaction protocols, many applications in the terminal device support the D L NA function, and after a user logs in the application supporting the D L NA function in the terminal device, the user can search for a projectable television in the current WIFI environment, so that contents such as videos, music, pictures and the like on the terminal device are shared on large-screen display devices such as the television and the like for playing.

At present, in the process of using the D L NA function, a user pushes a film source to a television end at a terminal device, after the terminal device establishes a connection with the television end, the television plays the film source, and after the film source is played, the television quits playing and returns to a Home page.

Disclosure of Invention

In order to solve the technical problem, the invention provides a viewing history display method and display equipment.

In a first aspect, the present invention provides a display device comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen casting request;

and responding to a switching instruction, exiting the initial film source, and playing the recommended film source corresponding to the recommended information.

In some embodiments, the controller is further configured to:

responding to an allowing instruction input by a user, and analyzing keywords of the initial film source according to the URI of the initial film source sent by the terminal equipment;

generating the first instruction according to the keyword to cause the server to search recommendation information associated with the initial film source, wherein the recommendation information comprises URI of the recommended film source.

In some embodiments, the switching instruction is an instruction generated during the playing process of the initial film source or when the end point is reached.

In some embodiments, the controller is further configured to:

in the initial film source playing process, responding to a display instruction input by a user, and displaying a recommendation information list in a current playing interface;

and the recommendation information list comprises thumbnails and jump controls which are generated according to the URI of each recommendation film source.

In some embodiments, the switching instruction is an instruction generated after a user inputs a click operation on the recommended film source and triggers the jump control.

In some embodiments, the controller is further configured to:

when the recommended information is non-null information, generating a playing instruction, wherein the playing instruction is used for indicating the display to play the initial film source;

and when the recommendation information is null information, resending the first instruction.

In a second aspect, the present invention provides a screen projection display method, including:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen casting request;

and responding to a switching instruction, exiting the initial film source, and playing the recommended film source corresponding to the recommended information.

In some embodiments, the method further comprises;

responding to an allowing instruction input by a user, and analyzing keywords of the initial film source according to the URI of the initial film source sent by the terminal equipment;

generating the first instruction according to the keyword to cause the server to search recommendation information associated with the initial film source, wherein the recommendation information comprises URI of the recommended film source.

In some embodiments, the switching instruction is an instruction generated during the playing process of the initial film source or when the end point is reached.

In some embodiments, the method further comprises:

in the initial film source playing process, responding to a display instruction input by a user, and displaying a recommendation information list in a current playing interface;

and the recommendation information list comprises thumbnails and jump controls which are generated according to the URI of each recommendation film source.

In some embodiments, the switching instruction is an instruction generated after a user inputs a click operation on the recommended film source and triggers the jump control.

In some embodiments, the method further comprises:

when the recommended information is non-null information, generating a playing instruction, wherein the playing instruction is used for indicating the display to play the initial film source;

and when the recommendation information is null information, resending the first instruction.

In a third aspect, the present invention provides a display device comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

and when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display.

In some embodiments, the recommended source of film is associated with the initial source of film.

In a fourth aspect, the present invention provides a display device comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display;

and when the fact that the playing of the initial film source is finished is monitored, automatically playing the recommended film source on a display.

In a fifth aspect, the present invention provides a screen projection display method, including:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

and when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display.

In a sixth aspect, the present invention provides a screen projection display method, including:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display;

and when the fact that the playing of the initial film source is finished is monitored, automatically playing the recommended film source on a display.

When the terminal equipment initiates a screen projection request, a popup is prompted to inquire whether a user is allowed to be connected with the terminal equipment, when the user is allowed to connect the terminal equipment with the display equipment, the recommended film source is allowed to be played, a first instruction is sent to a server, the server searches some recommended information in response to the first instruction, the recommended information can comprise related recommended film sources related to the initial film source, for example, the initial film source is the 1 st set of the TV play A, the recommended film source can be the 2 nd set to the N th set of the TV play A, after the recommended information is obtained, the initial film source recommended by the terminal can be played, a switching instruction is received during or after the playing of the initial film source is finished, the playing of the initial film source is recommended, the playing of the initial film source can be played, the server can play the initial film source, the server can play the film source recommended by the terminal, the screen projection request is not dependent on the projection request of the user, and the screen projection is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating an operation scenario between adisplay device 200 and acontrol apparatus 100;

fig. 2 is a block diagram schematically showing a hardware configuration of thecontrol apparatus 100 in fig. 1;

fig. 3 is a block diagram illustrating a hardware configuration of thedisplay device 200 in fig. 1;

fig. 4 is a block diagram illustrating an architectural configuration of an operating system in a memory of thedisplay device 200;

fig. 5 is a schematic diagram illustrating a search device interface in a terminal device;

FIG. 6 is an interface diagram illustrating the terminal device projecting an initial film source;

FIG. 7 is a schematic diagram illustrating a display of a prompt popup;

FIG. 8 is an exemplary illustration of a playback interface for an initial source;

FIG. 9 is an exemplary illustration of a playback interface for another initial source;

fig. 10(a) is an exemplary interface diagram when hiding the recommendation information list;

fig. 10(b) is a diagram illustrating an interface when a recommendation information list is popped up;

FIG. 11 illustrates a screen projection control method;

an interaction flow diagram of a screen projection control method is illustrated in fig. 12.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

The terms "comprises" and "comprising," and any variations thereof, as used herein, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus. As shown in fig. 1, thecontrol apparatus 100 and thedisplay device 200 may communicate with each other in a wired or wireless manner.

Among them, thecontrol apparatus 100 is configured to control thedisplay device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by thedisplay device 200, serving as an intermediary for interaction between the user and thedisplay device 200. Such as: the user operates the channel up/down key on thecontrol device 100, and thedisplay device 200 responds to the channel up/down operation.

Thecontrol device 100 may be aremote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control thedisplay apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control thedisplay apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling thedisplay device 200.

Thecontrol device 100 may also be an intelligent device, such as amobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, thedisplay device 200 is controlled using an application program running on the smart device. The application program can provide various controls for a User through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, themobile terminal 100B may install a software application with thedisplay device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: themobile terminal 100B may be caused to establish a control instruction protocol with thedisplay device 200 to implement the functions of the physical keys as arranged in theremote control 100A by operating various function keys or virtual buttons of the user interface provided on themobile terminal 100B. The audio and video content displayed on themobile terminal 100B may also be transmitted to thedisplay device 200, so as to implement a synchronous display function.

Thedisplay apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

Thedisplay device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.

Thedisplay device 200 may also be in data communication with theserver 300 via a variety of communication means, such as a local area network (L AN), a wireless local area network (W L AN), and other networks, where theserver 300 may provide various content and interactions to thedisplay device 200, thedisplay device 200 may send and receive information, such as receiving Electronic Program Guide (EPG) data, receiving software Program updates, or accessing a remotely stored digital media library, for example, theserver 300 may be a group or groups of servers, one or more types of servers, and other web service content such as video-on-demand and advertising services provided via theserver 300.

Fig. 2 is a block diagram illustrating the configuration of thecontrol device 100. As shown in fig. 2, thecontrol device 100 includes acontroller 110, amemory 120, acommunicator 130, auser input interface 140, anoutput interface 150, and apower supply 160.

Thecontroller 110 includes a RAM (Random Access Memory) 111, a ROM (Read-Only Memory) 112, aprocessor 113, a communication interface, and a communication bus. Thecontroller 110 is used to control the operation of thecontrol device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on theremote controller 100A or an interaction of touching a touch panel disposed on theremote controller 100A is detected, thecontroller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to thedisplay device 200.

And amemory 120 for storing various operation programs, data and applications for driving and controlling thecontrol apparatus 100 under the control of thecontroller 110. Thememory 120 may store various control signal commands input by a user.

Thecommunicator 130 enables communication of control signals and data signals with thedisplay apparatus 200 under the control of thecontroller 110. Such as: thecontrol apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to thedisplay device 200 via thecommunicator 130, and thecontrol apparatus 100 may receive the signal transmitted by thedisplay device 200 via thecommunicator 130. Thecommunicator 130 may include an infrared module 131 (infrared signal interface) and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to thedisplay device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to thedisplay device 200 through the rf transmitting terminal.

Theuser input interface 140 may include at least one of amicrophone 141, atouch pad 142, asensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling thedisplay apparatus 200 to thecontrol apparatus 100 through voice, touch, gesture, press, and the like.

Here, theoutput interface 150 may includeL ED interface 151,vibration interface 152 generating vibration,sound output interface 153 outputting sound,display 154 outputting images, and the like, for example, theremote controller 100A may receive an output signal such as audio, video, or data from theoutput interface 150, and display the output signal as an image on thedisplay 154, as an audio on thesound output interface 153, or as a vibration on thevibration interface 152.

And apower supply 160 for providing operation power support for each element of thecontrol device 100 under the control of thecontroller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of thedisplay device 200 is exemplarily shown in fig. 3. As shown in fig. 3, thedisplay apparatus 200 may include atuner demodulator 210, acommunicator 220, adetector 230, anexternal device interface 240, acontroller 250, amemory 260, auser interface 265, avideo processor 270, adisplay 275, anaudio processor 280, anaudio output interface 285, and apower supply 290.

Thetuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

Thetuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by thecontroller 250.

Thetuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, thetuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into thedisplay apparatus 200 through theexternal device interface 240.

Thecommunicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, thedisplay apparatus 200 may transmit content data to an external apparatus connected via thecommunicator 220, or browse and download content data from an external apparatus connected via thecommunicator 220. Thecommunicator 220 may include a network communication protocol module or a near field communication protocol module, such as aWIFI module 221, abluetooth module 222, and awired ethernet module 223, so that thecommunicator 220 may receive a control signal of thecontrol device 100 according to the control of thecontroller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

Thedetector 230 is a component of thedisplay apparatus 200 for collecting signals of an external environment or interaction with the outside. Thedetector 230 may include asound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control thedisplay device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling thedisplay device 200 to adapt to ambient noise.

In some other exemplary embodiments, thedetector 230, which may further include animage collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of thedisplay device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.

In some other exemplary embodiments, thedetector 230 may further include a light receiver (not shown) for collecting the intensity of the ambient light to adapt to the display parameter variation of thedisplay device 200.

In some other exemplary embodiments, thedetector 230 may further include a temperature sensor (not shown), such as by sensing an ambient temperature, and thedisplay device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, thedisplay apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, thedisplay device 200 may be adjusted to display a warmer color temperature of the image.

Theexternal device interface 240 is a component for providing thecontroller 250 to control data transmission between thedisplay apparatus 200 and an external apparatus. Theexternal device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

Theexternal device interface 240 may include: one or more of an HDMI (High Definition multimedia interface)terminal 241, a CVBS (Composite Video Blanking and Sync) terminal 242, a Component (analog or digital)terminal 243, a USB (Universal Serial Bus) terminal 244, a Component (Component) terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

Thecontroller 250 controls the operation of thedisplay device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on thememory 260.

As shown in fig. 3, thecontroller 250 includes a RAM (random access memory) 251, a ROM (read only memory) 252, agraphic processor 253, aCPU processor 254, acommunication interface 255, and acommunication bus 256. The RAM251, the ROM252, thegraphic processor 253, theCPU processor 254, and thecommunication interface 255 are connected by acommunication bus 256.

The ROM252 stores various system boot instructions. When thedisplay apparatus 200 starts power-on upon receiving the power-on signal, theCPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in thememory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, theCPU processor 254 copies the various application programs in thememory 260 to the RAM251 and then starts running and starting the various application programs.

And agraphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. Thegraphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on thedisplay 275.

ACPU processor 254 executes the operating system and application program instructions stored inmemory 260 and, in accordance with received user input instructions, performs the processing of various application programs, data and content for the ultimate display and playback of various audiovisual content.

In some example embodiments, theCPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of thedisplay apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

Thecommunication interface 255 may include a first interface, a second interface, and an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

Thecontroller 250 may control the overall operation of thedisplay apparatus 200. For example: in response to receiving a User input command for selecting a GUI (Graphical User Interface) object displayed on thedisplay 275, thecontroller 250 may perform an operation related to the object selected by the User input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to thedisplay apparatus 200 or a voice command corresponding to a voice spoken by the user.

Amemory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of thedisplay device 200. Thememory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes thememory 260, the RAM251 and the ROM252 of thecontroller 250, or a memory card in thedisplay device 200.

In some embodiments, thememory 260 is specifically used for storing an operating program for driving thecontroller 250 of thedisplay device 200; storing various application programs built in thedisplay apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by thedisplay 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments,memory 260 is specifically configured to store drivers fortuner demodulator 210,communicator 220,detector 230,external device interface 240,video processor 270,display 275,audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

In some embodiments,memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an Application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of thedisplay device 200 is illustrated in fig. 4. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer may include a plurality of applications, such as a setup application, a post application, a media center application, etc. these applications may be implemented as Web applications that are executed based on a WebKit engine, and in particular may be developed and executed based on HTM L5, Cascading Style Sheets (CSS), and JavaScript.

Here, the HTM L, which is called HyperText Markup language (HyperText Markup L anguage) is a standard Markup language for creating web pages, and describes the web pages by Markup tags, the HTM L tags are used to describe characters, graphics, animation, sound, tables, links, etc., and the browser reads the HTM L document, interprets the contents of the tags in the document, and displays them in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTM L files, and can be used to define the Style structure, such as the language of font, color, location, etc.

JavaScript, which is a language applied to Web page programming, can be inserted into the HTM L page and interpreted and executed by a browser, wherein the interaction logic of the Web application is realized by the JavaScript, the JavaScript can be used for encapsulating a JavaScript extension interface by the browser to realize the communication with a kernel layer,

for example, the middleware layer may be implemented as Multimedia and Hypermedia Experts Group (MHEG) middleware of middleware related to data broadcasting, D L NA (Digital L interactive Network Alliance) middleware of middleware related to communication with an external device, middleware providing a browser environment in which each application program in the display device operates, and the like.

The kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on L inux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: the display driver is provided for the display, the camera driver is provided for the camera, the key driver is provided for the remote controller, the WIFI driver is provided for the WIFI module, the audio driver is provided for the audio output interface, the Power Management driver is provided for the Power Management (PM) module, and the like.

Auser interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to thecontroller 250 or transmit an output signal from thecontroller 250 to the user. For example, theremote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to theuser interface 265, and then the input signal is transferred to thecontroller 250 through theuser interface 265; alternatively, theremote controller 100A may receive an output signal such as audio, video, or data output from theuser interface 265 via thecontroller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on thedisplay 275, and theuser interface 265 receives the user input commands through the GUI. Specifically, theuser interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and theuser interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

Thevideo processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on thedisplay 275.

Illustratively, thevideo processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

Adisplay 275 for receiving the image signal from thevideo processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by thecommunicator 220 or theexternal device interface 240. Thedisplay 275, while displaying a user manipulation interface UI generated in thedisplay apparatus 200 and used to control thedisplay apparatus 200.

And, thedisplay 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provideddisplay 275 is a projection display.

Theaudio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by thespeaker 286.

Illustratively,audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

Theaudio output interface 285 is used for receiving an audio signal output by theaudio processor 280 under the control of thecontroller 250, and theaudio output interface 285 may include aspeaker 286 or an externalsound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

In other exemplary embodiments,video processor 270 may comprise one or more chips.Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, thevideo processor 270 and theaudio processor 280 may be separate chips or may be integrated with thecontroller 250 in one or more chips.

And apower supply 290 for supplying power supply support to thedisplay apparatus 200 from the power input from the external power source under the control of thecontroller 250. Thepower supply 290 may be a built-in power supply circuit installed inside thedisplay apparatus 200 or may be a power supply installed outside thedisplay apparatus 200.

The user logs in an application program (APP) supporting a D L NA screen projection function in a terminal device, and enters a screen projection interface, firstly, searches for a display device to be projected, taking the display device as an intelligent television as an example, as shown in FIG. 5, the terminal device initiating screen projection and a television as a projected object both need to connect WiFi, the terminal device can search for a television in the same WiFi network environment, and lists the searched television devices capable of establishing screen projection connection in the interface, such as FIG. 5, the current WiFi is MERCURY _6ABC, one television device is searched, the information of the television device is a living room polar light TV (365D), the IP address is 192.168.1.101, and after clicking the television device, the user can select an initial film source to be projected to the device.

Fig. 6 shows an interface for the terminal device to project an initial film source, which may include a thumbnail of the initial film source, a film source name, a rating, a genre, a brief description, and the like, and film source information, wherein the thumbnail of the initial film source may be a frame image captured from the film source. A control for triggering a screen projection request, such as "tv play" in fig. 6, is further provided in the interface, and after the user clicks "tv play", a screen projection request is generated, where the screen projection request carries information such as tv device information, so as to realize requesting a tv end of the target projection object to project the initial film source. It should be noted that the manner of initiating the screen-casting request, the interface operation, and the content of the interface display in the terminal device are not limited to those shown in this embodiment and the drawings, and are specifically related to different types of terminal devices and application programs.

The method comprises the steps of sending first indication information to a Media center application in a television end after a screen-shooting request is responded by a D L NA protocol stack configured by the television end, and displaying a prompt popup on a display of the television according to the first indication information. fig. 7 shows a prompt popup for inquiring whether a user is allowed to connect with a terminal device and play a recommended film source, such as displaying 'a terminal device is connecting with your television and is allowed to connect and play the recommended film source?' and displaying Mac Address (Media Access Control Address) of the terminal device requesting to establish connection together, wherein each device in a network has a unique network identifier, namely Mac Address, for confirming the position of the network device.

After the user inputs the permission instruction in the prompt popup, a Uniform Resource Identifier (URI) of the initial film source sent by the terminal device is received, and the initial film source can be played subsequently according to the URI of the initial film source. The recommended film source needs to be obtained next. The television may send a first instruction to the server, and the server may search for some recommended film sources in response to the first instruction, where the recommended film sources may be film sources related to the initial film source, such as film sources belonging to different episodes of the same tv series, or film sources of the same genre as the initial film source, or recently hot-played film sources, high-scoring film sources, and so on, that is, film sources that the user may be interested in viewing are recommended to the user. When the television receives the recommendation information fed back by the server, the recommendation information may include URIs of the recommended film sources, and then the initial film source can be played, where a playing interface of the initial film source is shown in fig. 8, that is, the initial film source pushed by the terminal device is projected onto the television for playing, so that a large-screen viewing effect is experienced.

In order to realize the richness of the screen projection function, in the initial film source playing process, a user can directly display a recommendation information list to the user, the user can conveniently check the recommended film source, and a certain recommended film source is selected according to the interest degree to play. In a specific implementation, as shown in fig. 9, the recommendation information list may be displayed at a preset position, such as the bottom of the interface; the recommendation information list may be presented in rows, i.e. comprising 1 row and multiple columns, and the user may view the recommended film sources included in the list by sliding left and right.

In other implementations, the recommendation information list may be presented in columns, that is, including a plurality of rows and 1 column, and the user views each item of recommendation film sources included in the list by sliding up and down; still alternatively, the recommendation information list may be presented in a grid form, i.e. comprising a plurality of rows and a plurality of columns. The presentation form of the recommendation information list is not limited, the recommendation information list may include a thumbnail of each recommended film source, the bottom of the thumbnail may also be accompanied by basic information of the recommended film source, the basic information may be information such as a film source name, a corresponding set number/period number/part number, a main viewpoint, a duration, and the like, and the thumbnail is associated with a jump control, so that when a user clicks a certain recommended film source, the jump control of the recommended film source is triggered, and then the play interface of the initial film source is jumped to the play interface of the recommended film source. The display content of the recommendation information list is not limited to that described in this embodiment, and may be configured according to the actual UI display requirement. The proportion of the recommendation information list in the whole display interface is required to be as small as possible so as to ensure the viewing effect of the current initial film source.

In addition, aflick control 41 may be further disposed in the playing interface of the initial film source, and theflick control 41 is used to hide or pop up the recommendation information list. When the initial film source starts to play, the recommendation information list may be in a hidden state by default, and at this time, as shown in fig. 10(a), theflick control 41 is located at the bottom edge of the interface, and the initial film source is played in a full screen; when a user wants to view the recommended information list, the user can click theflick control 41, and then theflick control 41 is expanded according to the arrow direction shown in fig. 10(a), so that the row of the recommended information list is gradually popped up from bottom to top until the display interface shown in fig. 10(b) shows that the recommended information list is in a display state, and at this time, the upper part of the recommended information list on the source is played; when theflick control 41 is clicked once again in the state of fig. 10(b), theflick control 41 is reset in the direction of the arrow shown in fig. 10(b), so that the rows of the recommendation information list are gradually closed from top to bottom until the hidden state shown in fig. 10(a) is reached. It should be noted that the configuration and control manner of theflick control 41 are not limited to those described in this embodiment, and this embodiment shows a gradual flick mode, and other dynamic effects may also be adopted, for example, the play effect that can be referred to in a slide show. Theflick control 41 may fade or blur the display to avoid affecting the playback effect of the film source.

In practical applications, theflick control 41 may not be set, for example, some forms such as gesture control, voice control, remote control click/double-click interface, and the like are adopted; or timing display and hiding are adopted, for example, a recommendation information list is automatically popped up when an initial film source is played to half of the total time, and the recommendation information list is automatically hidden when a user has no operation and response within a preset time (for example, 5 seconds); or automatically displaying the recommended information list when the playing of the initial film source is finished, and enabling the user to select which recommended film source to continue playing next. In a word, the control modes for hiding and displaying the recommendation information list are various, and the display and hidden control modes of various recommendation information lists can be set in the screen projection setting of the television for the user to select and set, which is not described in detail in this embodiment.

Fig. 11 shows an embodiment of a screen projection control method, which is configured to be executed by thecontroller 250 of the display device, that is, thecontroller 250 is an execution subject of the method, and the method includes the following program steps:

step S10, in response to receiving a screen projection request sent by the terminal equipment, controlling a display to display a prompt pop-up window; and the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source.

Step S20, in response to the permission instruction input by the user, sends a first instruction to the server.

In other implementation manners, when the terminal device initiates a screen-casting request, the prompt popup may only ask the user whether to allow connection with the terminal device, and when the user allows connection between the terminal device and the display device, the user may automatically allow playing of the recommended film source by default. When the user selects 'consent' or 'permanent consent' in the prompt pop-up window, namely a permission instruction is input, a first instruction is sent to the server, and the first instruction is used for instructing the server to acquire the recommendation information. After responding to the first instruction, the server searches some recommended film sources, which may be film sources related to the initial film source, such as film sources belonging to different episodes of the same television series, or film sources of the same type and style as the initial film source, or recently hot-played film sources, high-scoring film sources, and the like, and recommends the film sources that the user may be interested in viewing to the user.

In one embodiment, when the user enters the permission instruction, the terminal device sends the URI of the initial film source to the display device. After receiving the URI of the initial film source, the display device may parse a keyword of the initial film source through the URI of the initial film source, where the keyword may be important information such as a film source name. For example, if the URI of the original source is http://192.168.0.121:38520/ExportContent/Dream Therapy. mp4, then the key is Dream Therapy. And then generating a first instruction according to the keyword, or directly sending the keyword to a server, and then performing relevance/similarity matching search by the server according to the keyword to obtain recommendation information, wherein the recommendation information comprises required information such as URIs (Uniform resource identifiers) of a plurality of recommendation film sources. The relevance/similarity between the recommended film source and the initial film source obtained in the mode is highest, so that the recommended film source can be closer to the watching interest and taste of the user, and the user experience is greatly improved.

And step S30, when receiving the recommendation information sent by the server according to the first instruction, playing the initial film source corresponding to the screen projection request.

In some embodiments, since there are many film sources in the whole network, when the server searches for relevance/similarity film sources according to keyword matching, the possibility that the search cannot be performed is very low, and even if the relevance/similarity film sources are not searched, the server may select some film sources with slightly low relevance/similarity according to priority, or directly recommend some film sources with high score, latest mapping, or high playing amount/recommended amount/collection amount as recommended film sources. It should be noted that the way in which the server obtains the recommended film source is not limited to that described in this embodiment, which does not affect the essence of this solution.

Therefore, if the situation that the recommendation information returned by the server is null information is met, which may be caused by abnormal working state of the server or abnormal communication between the server and the display device, and the like, retry is needed, that is, the display device sends the first instruction to the server again until the recommendation information returned by the server is not null. When the recommendation information is not empty, it is indicated that an effective recommended film source is obtained, and a playing instruction can be generated, wherein the playing instruction is used for indicating a display to play an initial film source.

Step S40, in response to the switching instruction, quitting the initial film source, and playing the recommended film source corresponding to the recommendation information.

In a further embodiment of step S40, during the playing of the initial film source, the playing process of the initial film source is detected, and when the playing process reaches the end point, that is, when the playing of the initial film source is finished, the recommendation information list may be automatically displayed, so that the user may select one of the recommended film sources in the list to continue playing.

In other implementation manners, after receiving the recommendation information, the display device sorts all recommendation film sources in the recommendation information according to a certain sorting rule, and then generates a recommendation information list, where the sorting rule is, for example, sorted in descending order according to the relevance or similarity with the initial film source, or sorted in descending order according to reference factors such as play amount, collection amount, and score, and the sorting rule may be set according to an actual situation, which is not limited in this embodiment. After the initial film source is played, playing the recommended film source arranged at the head in the recommended information list, and then playing the recommended film sources in the list in sequence according to the sequence of the recommended list under the condition that the user does not perform operation and response.

In other implementation manners, in the process that the playing of the initial film source is not finished, the user may switch the film source, and in response to receiving a display instruction input by the user, the recommended information list is displayed in the current playing interface, where the display instruction may be in the form of an operation on theflick control 41, a gesture control instruction, a click/double-click interface in the remote controller, or the like, or may be in the form of a voice instruction, for example, the user "displays the recommended information list" through voice input. When the recommended information list is displayed, a user inputs clicking operation on a certain recommended film source in the list, the skip control can be triggered, a switching instruction is generated, the playing of the initial film source can be quitted, the selected recommended film source is skipped to and continuously played, and therefore the switching of the film source is achieved in the playing process of the initial film source.

When the terminal equipment initiates a screen projection request, a popup is prompted to inquire whether a user is allowed to connect with the terminal equipment and to play a recommended film source, when the user allows the terminal to connect with the display equipment, the user is allowed to play the recommended film source, a first instruction is sent to a server by what the user wants, the server searches some recommended information in response to the first instruction, the recommended information can comprise related recommended film sources related to the initial film source, for example, the initial film source is the 1 st set of the TV series A, the recommended film source can be the 2 nd set to the N th set of the TV series A, after the recommended information is obtained, the initial film source pushed by the terminal can be played, a switching instruction is received during or after the playing of the initial film source is finished, the playing of the initial film source is quitted, the recommended film source playing can be started, the application can play the initial film source, the playing of the recommended film source can be played, the server can also play the initial film source, and the screen projection request of the user can be continuously improved.

In other possible embodiments, fig. 12 exemplarily shows an interactive flowchart of a screen projection control method, which includes a terminal device, adisplay device 200, and aserver 300, where the display device is in communication connection with the terminal device and the server, respectively, the terminal device includes but is not limited to amobile terminal 100B such as a smart phone, a tablet computer, and a notebook computer, the display device may be a large-screen device such as a television, a cinema screen, and the display device and the terminal device support a D L NA protocol and operate under the same WiFi network.

In fig. 12, the display device may include a D L NA protocol stack and a media center application, and when a terminal device initiates screen projection, it sends a screen projection request to a D L NA protocol stack, after receiving the screen projection request, the D L NA protocol stack sends oncheck black L ist callback information to the media center application, a check black L ist interface of the media center application responds to the oncheck black L ist callback information, starts check black L ist logic, controls a display to display a prompt popup, detects whether an allow instruction input by a user is received, and if the allow instruction input by the user is not detected, i.e. the user selects "disagree", it rejects the screen projection request this time, and ends the flow, and if the allow instruction input by the user is received, i.e. the user selects "agree" or "permanently", it goes to the next processing logic.

When a user responds to a screen projection request, equipment is allowed to connect and play a recommended film source, terminal equipment sends a URI of an initial film source to display equipment, after a D L NA protocol stack receives the URI of the initial film source, onset URI callback information is sent to a media center application, the onset URI callback information carries the URI of the initial film source, and a SetURI interface of the media center application responds to the onset URI callback information, starts onset URI logic and analyzes keywords of the initial film source.

The method comprises the steps that a D L NA protocol stack sends onCheckMsg callback information to a media center application, a CheckMsg interface of the media center application responds to the onCheckMsg callback information, a CheckMsg logic is started, a first instruction is generated according to a keyword and sent to a server, and the server responds to the first instruction, acquires recommendation information and sends the recommendation information to the media center application.

The D L NA protocol stack judges whether the recommendation information is null according to the recommendation information fed back by the media center application, if the recommendation information is not null, a play instruction onPlay is sent to the media center application, the media center application starts play logic, a display plays an initial film source according to the play instruction, in the initial film source playing process, whether click operation of a user on the recommendation film source is received or not is detected, if the click operation on the recommendation film source is received, the initial film source is quitted and the recommendation film source is played, if the click operation on the recommendation film source is not received, whether the playing of the initial film source is finished or not is detected, if the playing of the initial film source is finished, the recommendation film source is played, and if the playing of the initial film source is not finished, the step is returned to continuously detect whether the click operation of the user on the recommendation film source is received or not.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. In particular implementations, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and when the computer storage medium is located in a display device, the program may include steps that thecontroller 250 is configured to perform. The computer storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

The same and similar parts in the various embodiments are referred to each other in this specification.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. The specification and examples are to be regarded in an illustrative manner only and are not intended to limit the scope of the present invention. With a true scope and spirit of the invention being indicated by the following claims.

Claims (15)

1. A display device, comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

and when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display.

2. The display device of claim 1, wherein the recommended feed is associated with the initial feed.

3. A display device, comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display;

and when the fact that the playing of the initial film source is finished is monitored, automatically playing the recommended film source on a display.

4. A display device, comprising:

a display;

the communicator is used for being in communication connection with the terminal equipment and the server;

a user interface for receiving user input;

a controller for performing:

responding to a screen projection request sent by the terminal equipment, and controlling the display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen casting request;

and responding to a switching instruction, exiting the initial film source, and playing the recommended film source corresponding to the recommended information.

5. The display device of claim 4, wherein the controller is further configured to:

responding to an allowing instruction input by a user, and analyzing keywords of the initial film source according to the URI of the initial film source sent by the terminal equipment;

generating the first instruction according to the keyword to cause the server to search recommendation information associated with the initial film source, wherein the recommendation information comprises URI of the recommended film source.

6. The display device according to claim 4, wherein the switching instruction is an instruction generated during the playing process of the initial source or when the end point is reached.

7. The display device of claim 5, wherein the controller is further configured to:

in the initial film source playing process, responding to a display instruction input by a user, and displaying a recommendation information list in a current playing interface;

and the recommendation information list comprises thumbnails and jump controls which are generated according to the URI of each recommendation film source.

8. The display device according to claim 7, wherein the switching instruction is an instruction generated after a user inputs a click operation on the recommended film source and triggers the jump control.

9. A screen projection display method is characterized by comprising the following steps:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment and play the recommended film source;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen casting request;

and responding to a switching instruction, exiting the initial film source, and playing the recommended film source corresponding to the recommended information.

10. The method of claim 9, further comprising:

responding to an allowing instruction input by a user, and analyzing keywords of the initial film source according to the URI of the initial film source sent by the terminal equipment;

generating the first instruction according to the keyword to cause the server to search recommendation information associated with the initial film source, wherein the recommendation information comprises URI of the recommended film source.

11. The method of claim 10, further comprising:

in the initial film source playing process, responding to a display instruction input by a user, and displaying a recommendation information list in a current playing interface;

and the recommendation information list comprises thumbnails and jump controls which are generated according to the URI of each recommendation film source.

12. The method of claim 11, wherein the switching instruction is an instruction generated after a user inputs a click operation on the recommended film source and triggers the jump control.

13. A screen projection display method is characterized by comprising the following steps:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

and when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display.

14. The method of claim 13, wherein the recommended feed is associated with the initial feed.

15. A screen projection display method is characterized by comprising the following steps:

responding to a screen projection request sent by the terminal equipment, and controlling a display to display a prompt popup; the prompt popup is used for inquiring whether the user is allowed to be connected with the terminal equipment or not;

responding to a permission instruction input by a user, and sending a first instruction to a server;

when receiving recommendation information sent by the server according to the first instruction, starting playing an initial film source corresponding to the screen projection request on a display, and simultaneously displaying the recommendation film source contained in the recommendation information on the display;

and when the fact that the playing of the initial film source is finished is monitored, automatically playing the recommended film source on a display.

Images