CN111083538A - Background image display method and device - Google Patents

Abstract

The embodiment provides a method and equipment for displaying a background image. The method and the equipment comprise the steps of detecting a label arranged on a time axis of the audio-video resource, wherein the position of the label on the time axis is set according to the appearance time of a preset word in the text; in response to detecting the tag, acquiring a second image corresponding to the tag; and displaying the second image on the current user interface. The display device and the background image display method provided by the embodiment can display the image corresponding to the text in the audio and video resource in the process of playing the audio and video resource, so that the user can blend in the scene provided by the audio and video resource.

Description

Background image display method and device

Technical Field

The embodiment of the application relates to the technical field of image display, in particular to a method and equipment for displaying a background image.

Background

With the rapid development and the comprehensive popularization of the smart tv, people can perform 3D avatar K song (abbreviated as song 3D K) based on the avatar through the smart tv at home. As shown in fig. 1, in the process of playing the accompaniment in the song-3D K process, the smart tv not only displays the lyrics on the screen, but also displays the virtual image of the user and the background of the lyrics in a fusion manner, so that the user can "approach" the song scene and get closer to the relationship between the user and the tv.

At present, the background of lyrics is usually the MV (Music Video) of a song of K songs, but the content of the MV often cannot correspond to the content directly described by the lyrics. For example, in the process of playing a song "travel with you", when lyrics "go to the prosperous shanghai and beijing" together, the content related to the shanghai and beijing in the MV displayed by the smart television is not available, so that the user cannot "personally visit" the scene corresponding to the song in the process of playing the song 3D K, and the user experience is not good.

Therefore, it is desirable to provide a display method and a display apparatus for background images to improve the song experience of the user 3D K and enable the user to "personally visit" the song scene.

Disclosure of Invention

The application provides a method and equipment for displaying a background image, which are used for solving the problem that the text of the existing audio-video resource does not correspond to the background image of the existing audio-video resource and improving the user experience when a user watches the audio-video resource.

In a first aspect, the present embodiment provides a display device, including:

a speaker configured to output sound information in the audio-visual resource;

a display configured to display a user interface for displaying a first image in the audio-visual resource and displaying a text corresponding to the sound information on the first image;

a controller respectively connected with the speaker and the display, the controller configured to: detecting a label arranged on a time axis of the audio and video resource, wherein the position of the label on the time axis is set according to the occurrence time of a preset word in the text; in response to detecting the tag, acquiring a second image corresponding to the tag; and displaying the second image on the current user interface.

In a first implementation manner of the first aspect, the tag includes an image determination sub-tag and a play sub-tag, where the image determination sub-tag is located before the play sub-tag on the time axis; the controller is further configured to:

determining a sub-label in response to the detected image, and obtaining the second image according to a preset corresponding relation between the sub-label and the image;

and controlling the display to display the second image on the current user interface in response to detecting the play sub-label.

In a second implementation manner of the first aspect, determining a preset corresponding relationship between a sub-tag and an image according to the image, and acquiring the second image includes: determining a preset corresponding relation between the sub-label and the image according to the image, and determining identification information of a second image corresponding to the label; according to the identification information, the second image is searched locally; or downloading the second image from a cloud server according to the identification information.

In a third implementation manner of the first aspect, downloading the second image from a cloud server according to the identification information includes: if the second image is not found locally according to the identification information, the identification information is sent to a cloud server; and receiving a second image determined by the cloud server according to the identification information.

In a fourth implementation form of the first aspect, the controller is further configured to display the second image directly on the current user interface after the second image is acquired.

In a fifth implementation manner of the first aspect, displaying, at the current user interface, the second image includes: switching the first image to the second image; alternatively, the first image is displayed in a part of the first image.

In a sixth implementation manner of the first aspect, different labels correspond to different second images.

In a seventh implementation form of the first aspect, the preset words include place names, person names, item names, or emotional words.

In a second aspect, this embodiment provides a method for displaying a background image, which is applied to a display device, where the display device is configured to play an audio and video resource, where the audio and video resource includes sound information, a text corresponding to the sound information, and a first image, and the text is displayed on the first image, and the method includes:

detecting a label arranged on a time axis of the audio and video resource, wherein the position of the label on the time axis is set according to the occurrence time of a preset word in the text;

in response to detecting the tag, acquiring a second image corresponding to the tag;

and displaying the second image on the current user interface.

The technical scheme provided by the application comprises the following beneficial technical effects:

according to the background image display method and the display device, the second image can be called according to the preset label corresponding to the text on the time axis of the audio-video resource, the second image is displayed on the current user interface, the text in the audio-video resource corresponds to the background height of the text, and a user can be integrated into the scene provided by the audio-video resource.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of adisplay device 200 according to an embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of thecontrol apparatus 100 according to the embodiment;

fig. 4 is a diagram exemplarily showing a functional configuration of thedisplay device 200 according to the embodiment;

fig. 5a schematically shows a software configuration in thedisplay device 200 according to an embodiment;

fig. 5b schematically shows a configuration of an application in thedisplay device 200 according to an embodiment;

fig. 6 is a flowchart illustrating a background image display method according to an embodiment;

FIG. 7 illustrates a first diagram of a user interface in accordance with an embodiment;

FIG. 8 schematically shows a second diagram of a user interface according to an embodiment;

a third schematic diagram of a user interface according to an embodiment is exemplarily shown in fig. 9.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" as used herein refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device, such as the display device disclosed in this application, that is typically wirelessly controllable over a short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate thedisplay apparatus 200 through thecontrol device 100.

Thecontrol device 100 may be aremote controller 100A, which includes infrared protocol communication, bluetooth protocol communication, other short-distance communication methods, and the like, and controls thedisplay apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control thedisplay apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling thedisplay device 200.

Thecontrol device 100 may also be an intelligent device, such as amobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, thedisplay device 200 is controlled using an application program running on the smart device. The application may provide the user with various controls through an intuitive User Interface (UI) on a screen associated with the smart device.

For example, themobile terminal 100B may install a software application with thedisplay device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: themobile terminal 100B and thedisplay device 200 may establish a control instruction protocol, synchronize the remote control keyboard to themobile terminal 100B, and control the function of thedisplay device 200 by controlling the user interface on themobile terminal 100B. The audio and video content displayed on themobile terminal 100B may also be transmitted to thedisplay device 200, so as to implement a synchronous display function.

As shown in fig. 1, thedisplay apparatus 200 also performs data communication with theserver 300 through various communication means. Thedisplay device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. Theserver 300 may provide various contents and interactions to thedisplay apparatus 200. Illustratively, thedisplay device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. Theservers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through theserver 300.

Thedisplay device 200 may be a liquid crystal display, an OLED display, a projection display device. The specific display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that thedisplay device 200 may be modified in performance and configuration as desired.

Thedisplay apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.

A hardware configuration block diagram of adisplay device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, thedisplay apparatus 200 may include atuner demodulator 220, acommunicator 230, adetector 240, anexternal device interface 250, acontroller 210, amemory 290, a user input interface, a video processor 260-1, an audio processor 260-2, adisplay 280, anaudio input interface 272, and a power supply.

Thetuning demodulator 220 receives the broadcast television signals in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., an EPG data signal).

Thetuner demodulator 220 is responsive to the user-selected television channel frequency and the television signal carried thereby, as selected by the user and as controlled by thecontroller 210.

Thetuner demodulator 220 may receive signals according to different broadcasting systems of television signals, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, the digital modulation mode and the analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to different types of the received television signals.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into thedisplay device 200 through the input/output interface 250.

Thecommunicator 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: thecommunicator 230 may include aWIFI module 231, a bluetooth communication protocol module 232, a wired ethernetcommunication protocol module 233, and other network communication protocol modules or near field communication protocol modules.

Thedisplay apparatus 200 may establish a connection of a control signal and a data signal with an external control apparatus or a content providing apparatus through thecommunicator 230. For example, the communicator may receive a control signal of theremote controller 100 according to the control of the controller.

Thedetector 240 is a component of thedisplay apparatus 200 for collecting signals of an external environment or interaction with the outside. Thedetector 240 may include alight receiver 242, a sensor for collecting the intensity of ambient light, which may be used to adapt to display parameter changes, etc.; the system can further include animage collector 241, such as a camera, etc., which can be used for collecting external environment scenes, collecting attributes of the user or interacting gestures with the user, adaptively changing display parameters, and recognizing user gestures, so as to realize the function of interaction with the user.

In some other exemplary embodiments, thedetector 240 may further include a temperature sensor, such as by sensing an ambient temperature, and thedisplay device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, thedisplay apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, thedisplay device 200 may be adjusted to display a warmer color temperature of the image.

In some other exemplary embodiments, thedetector 240 may further include a sound collector, such as a microphone, which may be used to receive a user's voice, a voice signal including a control instruction of the user to control thedisplay device 200, or collect an ambient sound for identifying an ambient scene type, and thedisplay device 200 may adapt to the ambient noise.

Theexternal device interface 250 provides a component for thecontroller 210 to control data transmission between thedisplay apparatus 200 and other external apparatuses. The external device interface may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

Theexternal device interface 250 may include: a High Definition Multimedia Interface (HDMI) terminal 251, a Composite Video Blanking Sync (CVBS)terminal 252, an analog ordigital component terminal 253, a Universal Serial Bus (USB)terminal 254, a red, green, blue (RGB) terminal (not shown), and the like.

Thecontroller 210 controls the operation of thedisplay device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on thememory 290.

As shown in fig. 2, thecontroller 210 includes a random access memory RAM213, a read only memory ROM214, agraphics processor 216, aCPU processor 212, a communication interface 218, and a communication bus. The RAM213 and the ROM214, thegraphic processor 216, theCPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If thedisplay device 200 is powered on upon receipt of the power-on signal, theCPU processor 212 executes a system boot instruction in the ROM and copies the operating system stored in thememory 290 to the RAM214 to start running the boot operating system. After the start of the operating system is completed, theCPU processor 212 copies the various application programs in thememory 290 to the RAM214, and then starts running and starting the various application programs.

Agraphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on thedisplay 280.

CPU processor 212 is operative to execute operating system and application program instructions stored inmemory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, theCPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of thedisplay apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for performing an operation in a standby mode or the like.

The communication interfaces may include a first interface 218-1 through an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

Thecontroller 210 may control the overall operation of thedisplay apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on thedisplay 280, thecontroller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to an icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to thedisplay apparatus 200 or a voice command corresponding to a voice spoken by the user.

Thememory 290 includes a memory for storing various software modules for driving and controlling thedisplay apparatus 200. Such as: various software modules stored inmemory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

The basic module is a bottom layer software module for signal communication between hardware in thedisplay device 200 and sending processing and control signals to an upper layer module. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling thedisplay 280 to display image content, and may be used to play information such as multimedia image content and UI interface. The communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. The service module is a module for providing various services and various application programs.

Meanwhile, thememory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A user input interface for transmitting an input signal of a user to thecontroller 210 or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on thedisplay 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 260-1 is configured to receive a video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on thedisplay 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, such as a frame rate of an input 24Hz, 25Hz, 30Hz, or 60Hz video into a frame rate of 60Hz, 120Hz, or 240Hz, where the input frame rate may be related to a source video stream, and the output frame rate may be related to an update rate of a display screen. The input is realized in a common format by using a frame insertion mode.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And adisplay 280 for receiving the image signal input from the video processor 260-1 and displaying the video content and image and the menu manipulation interface. Thedisplay 280 includes a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. The video content may be displayed from the video in the broadcast signal received by the tuner/demodulator 220, or from the video content input from the communicator or the external device interface. And adisplay 220 simultaneously displaying a user manipulation interface UI generated in thedisplay apparatus 200 and used to control thedisplay apparatus 200.

And, a driving component for driving the display according to the type of thedisplay 280. Alternatively, in case thedisplay 280 is a projection display, it may also comprise a projection device and a projection screen.

When thedisplay apparatus 200 plays the audio-visual resource, if the audio-visual resource includes sound information, text corresponding to the sound information, and a first image, the first image and the text are displayed on the user interface of thedisplay 280, and the text is shown over the first image.

In one specific example, when the audio-visual resource is a song of K songs, the user interface displayed by thedisplay 280 is as shown in FIG. 7. The text is lyrics of a currently played song, and the second image is an image in an MV of the currently played song.

The audio processor 260-2 is configured to receive an audio signal, decompress and decode the audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification and other audio data processing to obtain an audio signal that can be played in thespeaker 272.

Anaudio output interface 270 for receiving the audio signal output by the audio processor 260-2 under the control of thecontroller 210, wherein the audio output interface may include aspeaker 272 or an externalsound output terminal 274 for outputting to a generating device of an external device, such as: external sound terminal or earphone output terminal.

In one specific example, thespeaker 272 is used to play sound information during the course of providing the karaoke service by thedisplay apparatus 200. Wherein the sound information includes song accompaniment and user sound.

In other exemplary embodiments, video processor 260-1 may comprise one or more chip components. The audio processor 260-2 may also include one or more chips.

And in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with thecontroller 210 in one or more chips.

And a power supply for supplying power supply support to thedisplay apparatus 200 from the power input from the external power source under the control of thecontroller 210. The power supply may include a built-in power supply circuit installed inside thedisplay apparatus 200, or may be a power supply installed outside thedisplay apparatus 200, such as a power supply interface for providing an external power supply in thedisplay apparatus 200.

In this embodiment, referring to fig. 6, thecontroller 210 in thedisplay device 200 provided in this embodiment is further configured to execute the following steps S601 to S603.

Step S601, detecting a tag set on a time axis of the audio/video resource, where a position of the tag on the time axis is set according to a time when a preset word appears in the text.

Specifically, the display 602 displays different contents in the audio/video resource (e.g., a song of K song) in different time periods of the audio/video resource time axis, and the tag provided by the embodiment is set on the time axis. In addition, during the playing process of the audio/video resource, thecontroller 210 will continuously identify the tag in the audio/video resource.

The label is determined according to a preset word in a text carried by the audio-visual resource, and the preset word can include a name (such as Turkey, Beijing, Shanghai, Tokyo, Yunnan and the like), a name (such as Xiaofang and Julie leaves), a name of an object (such as a hot air balloon, a Paris iron tower, cherry blossom and the like) and other nouns or emotional words (such as happiness, joy, hurt, difficulty and the like).

Each label corresponds to at least one preset word and is arranged near the playing time period of the corresponding preset word. For example, the tag may be set N seconds before the playing time period of the corresponding preset word, so that the display device has enough time to acquire the image corresponding to the tag and configure it as the background image corresponding to the playing time period. Where N is not less than 0, and is determined according to a predetermined configuration, such as 0, 1, or 3, and the like, which is not limited in this embodiment.

Taking the example that the text in the audio and video resources is the lyrics in the song "travel with you" going to the prosperous Shanghai and Beijing together, the preset words in the lyrics are "Shanghai" and "Beijing", the playing time period of the lyrics is 01: 13-01: 16 (i.e., 1min13s-1min16 s). It should be noted that the playing time period of the lyrics refers to the playing time of the accompaniment corresponding to the lyrics, and is not necessarily the display time of the lyrics.

In one example, a tag may be set before the playing time period of the lyric, and the tag may correspond to two preset words, "shanghai" and "beijing", set at 01: 12.

In another example, two tags, namely a first tag and a second tag, may be set on the playing time axis corresponding to the lyric. Wherein the first label corresponds to the preset word "shanghai", set at 01: 13 in position; the second label corresponds to the preset word "beijing", set at 01: 15, respectively.

Step S602, in response to detecting the tag, acquires a second image corresponding to the tag.

Thememory 290 of thedisplay device 200 stores a correspondence table of labels and images, for example, a correspondence table shown in table 1, in advance. In the correspondence table, one label corresponds to at least identification information of one image, and identification information corresponding to different labels may be the same or different, and is specifically determined according to a preset configuration. The label name is used for uniquely indicating one label, and the identification information is used for uniquely indicating the corresponding image. Illustratively, the identification information may be a name of the image.

TABLE 1 table of correspondences

Label name	Identification information of image
		1	A、B
2	C
		3	D
4	B、C
		…	…

Thecontroller 210 may determine the identification information of the image corresponding to the tag by querying the correspondence table according to the tag name. For example, according to the label name "1", the correspondence table shown in table 1 is looked up, and the identification information of the image corresponding to the label is determined to be "a" and "B".

After determining the identification information, thecontroller 210 may search a local database for a corresponding second image according to the identification information; or downloading a corresponding second image from the cloud server; and then or, firstly, searching the corresponding second image in the local database according to the identification information, and if the corresponding second image is not searched, downloading the corresponding second image from the cloud server.

Specifically, when thecontroller 210 downloads the corresponding second image from the cloud server, the controller first sends the identification information to the cloud server, the cloud server searches for the corresponding second image in the cloud server database according to the identification information, and sends the second image to thecontroller 210, and after thecontroller 210 receives the image, the image downloading is completed.

Step S603, displaying the second image on the current user interface.

Specifically, after thecontroller 210 acquires the second image, the second image may be directly set as a background image of the audio-visual resource, and thecontroller 210 controls thedisplay 280 to display the second image.

In addition, as an optional implementation manner, each of the tags provided by this embodiment may include an image determination sub-tag and a play sub-tag. For example, label "1" (which may be referred to as a parent label) includes an image-determining sub-label "1-1" and a play sub-label "1-2". It is noted that the image determines that the sub-label is located before the play sub-label on the time axis of the audio-visual resource.

In the playing process of the audio and video resources, after thecontroller 210 identifies the image determination sub-label (for example, the label "1-1"), thecontroller 210 determines a preset corresponding relationship between the sub-label and the image according to the image, and acquires an image corresponding to the parent label. When thecontroller 210 recognizes the play sub-label (e.g., label "1-2"), thecontroller 210 controls thedisplay 280 to display the acquired second image as a background image of the audio-visual resource. By setting the two sub-labels, the display device can not only obtain enough time to acquire the second image, but also accurately control the time point of the second image display, so that the content of the audio-video resource highly corresponds to the background image.

Wherein, when the second image is displayed, thecontroller 210 may control thedisplay 280 to switch the first image to the second image. For example, as shown in fig. 8, in the process that thedisplay device 200 provides the K song service and plays the lyrics "to go to the prosperous shanghai and beijing" together, thecontroller 210 controls thedisplay 280 to set the picture of the shanghai huangpu river corresponding to the preset word "shanghai" as the full-screen background of the lyrics of the sentence.

Alternatively, the second image is displayed in a part of the first image. For example, as shown in fig. 9, in the process that thedisplay device 200 provides the K song service and plays the lyrics "to go to the prosperous shanghai and beijing" together, thecontroller 210 controls thedisplay 280 to set the picture of the corresponding story palace and lake of the preset word "beijing" as the local background of the lyrics of the sentence.

It should be noted that in the scene of song 3D K, there is usually a user image in the user interface, and the user image may be a cartoon image or a real image of the user captured by a camera. In the user interface, the layer where the text is located at the top, the layer where the first image is located at the bottom, and the layer where the user image is located in the middle. Thecontroller 210 controls thedisplay 280 to display the second image on the layer between the layer where the user image is located and the layer where the first image is located in the process of controlling thedisplay 280 to display the second image, so as to prevent the second image from blocking the text and the user image.

Fig. 3 is a block diagram schematically showing the configuration of thecontrol apparatus 100 according to the exemplary embodiment. As shown in fig. 3, thecontrol device 100 includes acontroller 110, acommunicator 130, a user input/output interface 140, amemory 190, and apower supply 180.

Thecontrol apparatus 100 is configured to control thedisplay device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by thedisplay device 200, serving as an interaction intermediary between the user and thedisplay device 200. Such as: the user operates the channel up/down key on thecontrol device 100, and thedisplay device 200 responds to the channel up/down operation.

In some embodiments, thecontrol device 100 may be a smart device. Such as: thecontrol apparatus 100 may install various applications that control thedisplay device 200 according to user demands.

In some embodiments, as shown in fig. 1, themobile terminal 100B or other intelligent electronic device may function similar to thecontrol apparatus 100 after an application for manipulating thedisplay device 200 is installed. Such as: the user may implement the functions of controlling the physical keys of theapparatus 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on themobile terminal 100B or other intelligent electronic devices.

Thecontroller 110 includes aprocessor 112, a RAM113 and a ROM114, a communication interface, and a communication bus. Thecontroller 110 is used to control the operation of thecontrol device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

Thecommunicator 130 enables communication of control signals and data signals with thedisplay apparatus 200 under the control of thecontroller 110. Such as: the received user input signal is transmitted to thedisplay apparatus 200. Thecommunicator 130 may include at least one of aWIFI module 131, abluetooth module 132, anNFC module 133, and the like.

A user input/output interface 140, wherein the input interface includes at least one of amicrophone 141, atouch pad 142, asensor 143, a key 144, and the like. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to thedisplay device 200.

The output interface includes an interface that transmits the received user instruction to thedisplay apparatus 200. In some embodiments, it may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to thedisplay device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to thedisplay device 200 through the rf transmitting terminal.

In some embodiments, thecontrol device 100 includes at least one of acommunicator 130 and an output interface. Thecommunicator 130 is configured in thecontrol device 100, such as: the modules of WIFI, bluetooth, NFC, etc. may send the user input command to thedisplay device 200 through the WIFI protocol, or the bluetooth protocol, or the NFC protocol code.

And amemory 190 for storing various operation programs, data and applications for driving and controlling thecontrol apparatus 100 under the control of thecontroller 110. Thememory 190 may store various control signal commands input by a user.

And apower supply 180 for providing operational power support to the components of thecontrol device 100 under the control of thecontroller 110. A battery and associated control circuitry.

Fig. 4 is a diagram schematically illustrating a functional configuration of thedisplay device 200 according to an exemplary embodiment. As shown in fig. 4, thememory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs system operations for driving thedisplay device 200 and various operations in response to a user under the control of thecontroller 210. Thememory 290 may include volatile and/or nonvolatile memory.

Thememory 290 is specifically used for storing an operating program for driving thecontroller 210 in thedisplay device 200, and storing various applications installed in thedisplay device 200, various applications downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. Thememory 290 is used to store system software such as an Operating System (OS) kernel, middleware, and applications, and to store input video data and audio data, and other user data.

Thememory 290 is specifically used for storing drivers and related data such as the video processor 260-1 and the audio processor 260-2, thedisplay 280, thecommunication interface 230, thetuner demodulator 220, thedetector 240, the input/output interface, etc.

In some embodiments,memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

Thememory 290, for example, includes abroadcast receiving module 2901, achannel control module 2902, avolume control module 2903, animage control module 2904, adisplay control module 2905, anaudio control module 2906, an externalinstruction recognition module 2907, acommunication control module 2908, alight receiving module 2909, apower control module 2910, anoperating system 2911, andother applications 2912, a browser module, and the like. Thecontroller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.

A block diagram of a configuration of a software system in adisplay device 200 according to an exemplary embodiment is exemplarily shown in fig. 5 a.

As shown in FIG. 5a, anoperating system 2911, including the executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary between application programs and hardware components for performing data processing.

In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controlling process management, including runtime applications and the like.

Theevent transmission system 2914 may be implemented within theoperating system 2911 or within theapplication 2912. In some embodiments, an aspect is implemented within theoperating system 2911, while implemented in theapplication 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in thedisplay device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interfacelayout management module 2913, directly or indirectly receiving the input events or sub-events from theevent transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.

As shown in fig. 5b, theapplication layer 2912 contains various applications that may be executed at thedisplay device 200. The application may include, but is not limited to, one or more applications such as: live television applications, video-on-demand applications, media center applications, application centers, gaming applications, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on thedisplay device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on thedisplay device 200.

The display device provided by this embodiment can call the second image according to the preset label corresponding to the text on the time axis of the audio-video resource, and display the second image on the current user interface, so that the text in the audio-video resource corresponds to the background height thereof, and the user can blend in the scene provided by the audio-video resource.

For example, in the process of providing the K song service, the display device may call the corresponding second image according to the currently played lyric content and the preset tag corresponding to the lyric content, and use the second image as the background of the lyric, so that the user can "personally" approach the scene described by the lyric in the K song process.

In addition, an embodiment of the present application further provides a method for displaying a background image, which is applied to the display device provided in the embodiment of the present application, and the method includes the step 5601-.

The method for displaying the background image according to this embodiment can call the second image according to the preset label corresponding to the text on the time axis of the audio-video resource, and display the second image on the current user interface, so that the text in the audio-video resource corresponds to the background height of the text, and the user is merged into the scene provided by the audio-video resource.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A display device, comprising:

a speaker configured to output sound information in the audio-visual resource;

a display configured to display a user interface for displaying a first image in the audio-visual resource and displaying a text corresponding to the sound information on the first image;

a controller respectively connected with the speaker and the display, the controller configured to:

detecting a label arranged on a time axis of the audio and video resource, wherein the position of the label on the time axis is set according to the occurrence time of a preset word in the text;

in response to detecting the tag, acquiring a second image corresponding to the tag;

and displaying the second image on the current user interface.

2. The display device according to claim 1, wherein the tag includes an image determination sub-tag and a play sub-tag, wherein the image determination sub-tag is located before the play sub-tag on the time axis; the controller is further configured to:

determining a sub-label in response to the detected image, and obtaining the second image according to a preset corresponding relation between the sub-label and the image;

and controlling the display to display the second image on the current user interface in response to detecting the play sub-label.

3. The display device according to claim 2, wherein determining the preset correspondence between the sub-label and the image according to the image, and acquiring the second image comprises:

determining a preset corresponding relation between the sub-label and the image according to the image, and determining identification information of a second image corresponding to the label;

according to the identification information, the second image is searched locally; or,

and downloading the second image from a cloud server according to the identification information.

4. The display device of claim 3, wherein downloading the second image from a cloud server according to the identification information comprises:

if the second image is not found locally according to the identification information, the identification information is sent to a cloud server; and receiving a second image determined by the cloud server according to the identification information.

5. The display device according to any one of claims 1 to 4, wherein the controller is further configured to,

and after the second image is acquired, directly displaying the second image on the current user interface.

6. The display device of claim 1, wherein displaying the second image at a current user interface comprises:

switching the first image to the second image; or,

displaying the first image on a part of the first image.

7. The display device according to any of claims 1-4, wherein different labels correspond to different second images.

8. The display device as claimed in any one of claims 1 to 4, wherein the preset words comprise nouns or emotional words.

9. A method for displaying a background image is applied to a display device, the display device is used for playing audio and video resources, the audio and video resources comprise sound information, text corresponding to the sound information and a first image, and the text is displayed on the first image, and the method comprises the following steps:

detecting a label arranged on a time axis of the audio and video resource, wherein the position of the label on the time axis is set according to the occurrence time of a preset word in the text;

in response to detecting the tag, acquiring a second image corresponding to the tag;

and displaying the second image on the current user interface.

10. The method of claim 9, wherein the predetermined words comprise nouns or emotional words.

Images