Detailed Description
For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.
It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.
The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate thedisplay device 200 through thesmart device 300 or thecontrol apparatus 100.
In some embodiments, thecontrol apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and thedisplay device 200 is controlled by a wireless or wired mode. The user may control thedisplay device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.
In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control thedisplay device 200. For example, thedisplay device 200 is controlled using an application running on a smart device.
In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.
In some embodiments, thedisplay device 200 may also perform control in a manner other than thecontrol apparatus 100 and thesmart device 300, for example, the voice command control of the user may be directly received through a module configured inside thedisplay device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside thedisplay device 200 device.
In some embodiments, thedisplay device 200 is also in data communication with aserver 400. Thedisplay device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. Theserver 400 may provide various contents and interactions to thedisplay device 200. Theserver 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of thecontrol apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, thecontrol device 100 includes acontroller 110, acommunication interface 130, a user input/output interface 140, a memory, and a power supply. Thecontrol apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to thedisplay device 200, and function as an interaction between the user and thedisplay device 200.
As shown in fig. 3, thedisplay apparatus 200 includes at least one of amodem 210, acommunicator 220, adetector 230, anexternal device interface 240, acontroller 250, adisplay 260, anaudio output interface 270, a memory, a power supply, and a user interface.
In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.
Thedisplay 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.
Thedisplay 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.
Thecommunicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. Thedisplay device 200 may establish transmission and reception of control signals and data signals with theexternal control device 100 or theserver 400 through thecommunicator 220.
A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).
Thedetector 230 is used to collect signals of the external environment or interaction with the outside. For example,detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, thedetector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, thedetector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.
Theexternal device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.
Themodem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, thecontroller 250 and themodem 210 may be located in separate devices, i.e., themodem 210 may also be located in an external device to the main device in which thecontroller 250 is located, such as an external set-top box or the like.
Thecontroller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. Thecontroller 250 controls the overall operation of thedisplay apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on thedisplay 260, thecontroller 250 may perform an operation related to the object selected by the user command.
In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.
The user may input a user command through a Graphical User Interface (GUI) displayed on thedisplay 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form for user interfaces is a graphical user interface (GraphicUserInterface, GUI), which refers to a graphically displayed user interface associated with computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.
The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5APPs; native applications (Native APPs);
the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).
Native applications (Native APPs) may support online or offline, message pushing, or local resource access.
The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.
The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.
In some embodiments of the present application, a user interface may be displayed indisplay 260. The user interface may be a specific target image, for example, various media materials obtained from a network signal source, including video, pictures and the like. The user interface may also be some UI interface of the display device, such as a system recommendation page or the like.
The display device may have various functions such as browsing web pages, playing media assets, entertainment games, video chat, etc., thereby providing a wide variety of services to users. The user may control the display device to launch a related application program to thereby launch a corresponding function.
The media assets can be specifically classified into network media assets and media asset programs. The network media resource refers to media resource provided in the network, and the user can access the corresponding network link by using the display device to acquire the network media resource. The media asset program refers to a media asset program provided by a cable television provider, and a user can search for the media asset program for viewing using a display device.
The display device can be connected with a network, and a user can control the display device to directly acquire various network media resources in the network. The display device may also be provided with an external device interface, which is used to connect to an external device, so as to realize that the display device is connected to the external device, and the external device may be a signal transmission device, for example, a set top box. The display device and the signal transmission device which establish the connection serve as a receiving end and a transmitting end respectively, and the signal transmission device can transmit data to the display device through an external device interface, for example, send media information to the display device. The set-top box may receive various media information signals transmitted from a server at a cable television provider, including video data and audio data corresponding to various media information channels, and may transmit the media information signals to a display device to output the video data and the audio data as image pictures and sounds through the display device, so that a user can watch the corresponding media information channels at a time.
The external device interface may be HDMI (High Definition Multimedia Interface ). Fig. 5 illustrates a schematic diagram of the connection of a display device and a signal transmission device in some embodiments. As shown in fig. 5, the display device and the signal transmission device are connected through an HDMI interface, thereby transmitting media data signals.
In some embodiments, after the display device is connected to the set-top box, when the set-top box transmits a media signal to the display device, the controller may set a signal source of the display device to HDMI, so as to control the display to display a picture provided by the set-top box. At this time, the user can use the remote controller matched with the set top box to control the set top box, for example, switch media information channels and the like.
In some embodiments, the user may also control the set top box using the display device.
When the signal transmission device is connected to the display device, in order to enable the display device to normally control the set top box, the controller may first acquire information of the signal transmission device to determine various parameters corresponding to the signal transmission device, so that the display device can display relevant information of the signal transmission device, for example, a media information channel detail interface may be provided.
The set-top box device is a device provided by a cable television provider for playing media channels, and the cable television provider is different in consideration of the difference of the region where the display device is located, so that the set-top box device provided by the cable television provider is different, and the media channels provided by different cable television providers are different. Therefore, the influence of regional factors can be considered, and the information of the signal transmission equipment in the region where the display equipment is located can be acquired, so that the situation that the display equipment cannot be controlled due to the acquisition of the information of the signal transmission equipment in other regions is avoided.
The controller may first obtain the region information of the display device, to indicate the target region where the display device is currently located. For example, the controller may obtain network information of the display device, which may be an IP address of the display device, capable of representing geographical location information of the display device.
The controller may acquire the signal transmission device information based on the zone information. The controller may generate a signal transmission device information acquisition request carrying network information of the display device and transmit to the server. After receiving the signal transmission equipment information acquisition request sent by the display equipment, the server can determine the geographic position information of the display equipment according to the network information of the display equipment, so as to determine the target region where the display equipment is located. The server may further obtain a signal transmission device information obtaining request corresponding to the target region, and send the signal transmission device information obtaining request to the display device.
The signaling device information may include a device name of the signaling device, infrared code information, and media channel information.
The device name may be an initial name that the server defaults to the signaling device, and the user may modify the device name of the signaling device by himself.
The infrared code information is an infrared code corresponding to various control instructions for indicating the control signal transmission equipment, and the infrared code information can comprise a plurality of infrared code corresponding information, and each infrared code corresponding information is used for representing the corresponding relation between one infrared code and one control instruction. It should be noted that, in order to control the external device connected to the display device, the control information corresponding to the control instruction is not limited to an infrared code, and may be in a coding form supported by a signal transmission device such as a bluetooth instruction code, a radio frequency signal code, a network instruction code, and the like. In the embodiment of the application, the set top box device is considered to be only capable of responding to the infrared code, so that the infrared code is taken as an example for description.
The control instructions of the signal transmission device may include mute instructions, volume adjustment instructions, channel switching instructions, and the like. Each control instruction can correspond to an infrared code, and when the signal transmission equipment receives a certain infrared code, the control instruction corresponding to the infrared code can be determined, so that the signal transmission equipment responds.
Taking the control signal transmission device of the remote controller of the set top box as an example, each key in the remote controller can correspond to a control instruction, so that each key corresponds to a specific infrared code. When a user presses a certain key, the remote controller can send an infrared code corresponding to the key to the signal transmission equipment, so that the signal transmission equipment responds to a control instruction corresponding to the key. Fig. 6 illustrates a key schematic of a set-top box remote control in some embodiments. As shown in fig. 6, the keys of the set-top box remote control may include apower key 601, amute key 602, achannel switch key 603, aback key 604, amain interface key 605, and aset key 606. Thepower button 601 is used for controlling the signal transmission device to be turned on and off.Mute button 602 is used to control the muting of the signaling device. Thechannel switch key 603 is used for controlling the signal transmission device to switch media channels, and specifically includes number keys 0-9, and channel add-subtract keys P-and p+. The digital key can control the signal transmission equipment to directly jump to the media information channel corresponding to the digital, and the channel adding and subtracting key controls the signal transmission equipment to switch the media information channel according to the media information channel sequence. Thereturn button 604 is used to return to the last operation of the user. Themain interface key 605 is used to return to the main interface provided by the signaling device. Thesetup button 606 is used to jump to the setup interface.
Each key corresponds to a control instruction, namely an infrared code corresponding to the control instruction. According to different operations of a user, the remote controller can send different infrared codes to the signal transmission equipment so as to enable the signal transmission equipment to realize different functions.
After the display device acquires the infrared code information of the signal transmission device, the display device can determine the infrared code corresponding to each control instruction for controlling the signal transmission device. Since the signal transmission device can only receive the infrared instruction, the display device cannot directly send the control instruction to the signal transmission device. When a user controls the signal transmission device by using the display device, the display device can firstly send the infrared code to a control device matched with the display device, such as a mobile phone or a display device remote controller, and then the control device forwards the infrared code to the signal transmission device so that the signal transmission device responds to the control instruction.
The information of the media information channels is information of all media channels which can be provided by a cable television provider in a region where the display device is located, namely information which can be provided by the signal transmission device for the media channels displayed by the display device.
In some embodiments, a cable provider may provide a plurality of signal transmission devices, each corresponding to a remote control and also to a specific set of ir code information, for the region in which the display device is located. At this time, since the infrared code information acquired by the display device from the server may be the infrared code information of all the signal transmission devices in the current region, that is, the display device may acquire multiple sets of infrared code information. In order to enable the display device to control the signal transmission device, the controller may acquire infrared code information corresponding to the signal transmission device to which the display device is currently connected.
The controller can perform code matching verification on each set of obtained infrared code information to obtain infrared code information corresponding to the signal transmission equipment currently connected with the display equipment, and the infrared code information is called target infrared code information in the embodiment of the application.
When the controller performs code matching verification on the infrared code information, each set of infrared code information can be verified in sequence until the correct target infrared code information is obtained.
The controller can detect whether the acquired infrared code information is one set or a plurality of sets.
If the infrared code information is one set, the controller can directly determine the infrared code information as target infrared code information by indicating that only one signal transmission device exists in the current region.
If the infrared code information is multiple sets, the controller needs to check the infrared code information of the multiple sets. Some control instructions can be preset as test instructions, and for a certain set of infrared code information, if the signal transmission equipment can respond to the infrared codes corresponding to all the test instructions, the set of infrared code information is indicated to be the infrared code information matched with the signal transmission equipment.
According to a preset test instruction, the controller can respectively acquire a plurality of sets of test infrared codes of a plurality of sets of infrared code information, wherein the test infrared codes are the infrared codes corresponding to the preset control instruction. Therefore, for each set of infrared code information, a plurality of test infrared codes corresponding to all the test instructions can be obtained. The test instructions may be set as mute instructions, channel add-subtract instructions, and digital instructions. The controller may separately detect each set of test infrared codes to determine whether the signal transmission device is responsive.
Because the STB can only receive the signal through the mode of infrared signal, the display device can't send infrared signal, so the controller can send the infrared code to controlling means earlier, and then send the infrared signal that the infrared code corresponds to the STB by controlling means.
The controller may send the plurality of sets of test infrared codes to the control device, respectively, such that the control device sends the plurality of sets of test infrared codes to the signal transmission device. The display device and the control device may be connected via bluetooth, and considering that the display device cannot send an infrared instruction, the infrared code cannot be directly sent to the signal transmission device, so that the controller may send the test infrared code to the control device, for example, through a bluetooth channel. The control device can be used as a transfer device to send the test infrared code to the signal transmission device again. It should be noted that the test infrared code may be accurate, i.e. the signal transmission device is able to respond. The test infrared code may also be erroneous and the signaling device may not respond. Therefore, whether the set of infrared code information is the infrared code information matched with the signal transmission equipment can be determined by judging whether the signal transmission equipment responds to all the test infrared codes corresponding to the set of infrared code information.
After receiving the test infrared code, the signal transmission device can determine whether the signal transmission device can respond to the test infrared code, and if so, directly update the media information signal sent to the display device, such as updating volume setting or media information channel. If the test infrared code can not be responded, and the media information can not be updated.
The controller can verify the response condition of the signal transmission equipment to each set of test infrared codes, so that the target test infrared codes responded by the signal transmission equipment are obtained, and the infrared code information corresponding to the target test infrared codes is determined as target infrared code information.
In determining whether the signaling device is responsive to the test infrared code, the controller may verify that each test instruction was successfully executed. For mute instructions, whether the audio volume is changed before and after the display equipment is judged to be effectively executed or not, for channel addition and subtraction instructions, front and back signal pictures of the display equipment are intercepted to be subjected to channel recognition, so that matching is carried out according to media information channel information to judge whether front and back channel cutting is realized, and for digital instructions, the signal pictures of the display equipment are intercepted to be subjected to channel recognition to judge whether the audio channel is the media channel corresponding to the digital.
For a certain set of infrared code information, if the signal transmission equipment can respond to all the test infrared codes, the set of infrared code information is the infrared code information matched with the signal transmission equipment, namely the target infrared code information.
In some embodiments, the display device may also present to the user the status of the media channels that the signal transmission device can provide, for the user to select a media channel for viewing.
The user may input an instruction for playing the media information channel to the display device, which is referred to as a media information channel playing instruction in this embodiment of the present application, and the controller may control the display to display media information channel information.
In some embodiments, thecontroller 250 may control thedisplay 260 to display a user interface when the user controls the display device to power on. FIG. 7 illustrates a schematic diagram of a user interface in some embodiments. As shown in fig. 7, the user interface includes afirst navigation bar 700, asecond navigation bar 710, afunction bar 720, and acontent display area 730, thefunction bar 720 including a plurality of function controls such as "watch record", "my collection", and "my application", etc. Wherein the content displayed in thecontent display area 730 will change as the selected control in thefirst navigation bar 700 and thesecond navigation bar 710 changes. When the application panel page is applied, a user can trigger entering a corresponding application panel by clicking on a My application control to input a display instruction for the application panel page. It should be noted that, the user may also input the selection operation of the function control in other manners to trigger entering into the application panel. For example, control is entered into the application panel page using a voice control function, a search function, or the like.
The user can view the application programs already installed on the display device, i.e., the functions supported by the display device, through the application panel. The user may select one of the applications and open it to implement the functionality of the application. It should be noted that, the application installed in the display device may be a system application or a third party application. And the user controls the display device to realize the corresponding function of the application program by starting the application program. Fig. 6 illustrates a schematic diagram of an application panel in some embodiments. As shown in fig. 8, the application panel includes three controls, namely, a "player", "cable tv", and "game". Wherein the user can control the display device to open the player application by clicking on the "player" control. The user can perform corresponding operations in the player, such as searching for media assets, etc. The user may click on the "cable" control to view some of the media channels, including various media programs offered by the cable provider, using the display device. The user may click on the "game" control to play a game using the display device.
When the user clicks the "cable television" control, it may be determined that a media channel play instruction has been entered for the user.
In some embodiments, in response to a user-entered media channel play instruction, the controller may generate a media channel interface based on the media channel information, wherein the media channel interface includes at least one media channel control.
The information of the media information channels may include information of all media channels in the current region, that is, the information of the media channels that can be provided by the signal transmission device may include names of all media channels. The controller may generate a media channel interface based on the names of all media channels. FIG. 9 illustrates a schematic diagram of a media asset channel interface in some embodiments. As shown in fig. 9, the media channel interface includes media channel controls corresponding to all media channels searched by the display device, including channel a, channel B, channel C, and so on. The user may select one of the media channel controls and confirm, in the embodiment of the present application, the media channel control selected by the user is referred to as a target media channel control.
In response to the user's selection operation of the target media resource channel control, the controller may acquire the target media resource channel corresponding to the target media resource channel control, so as to control the display to display the target media resource channel, thereby enabling the user to watch the media resource program being played in the target media resource channel.
The controller may acquire, based on a preset database, an infrared code corresponding to a control instruction indicating a playing target media information channel, which is referred to as a playing infrared code in the embodiment of the present application, and the controller may send the playing infrared code to the control device. The control means may send the played infrared code to the signal transmission device. The playing infrared code is used for enabling the signal transmission equipment to provide a first media information signal corresponding to the target media information channel. The signal transmission device may send the first media asset signal to the display device for the display device to play the target media asset channel.
In some embodiments, in view of the fact that the media channel control presented in the media channel interface does not enable the user to determine the media program being played on that media channel, to enhance the user's use experience, the display device may also present a cable interface to the user so that the user may preview the media program being played on a particular media channel to enable the user to determine whether to view the media channel.
Fig. 10 illustrates a schematic diagram of a cable television interface in some embodiments. As shown in fig. 10, the cable interface includes a preview window and a media channel list. The user may select a particular media channel, such asmedia channel 1, from a list of media channels on the right side of the cable interface. And the preview window on the left side of the cable television interface can display themedia information channel 1 selected by the user for the user to preview. The user can determine the currently selected media program in the media channel according to the preview window, so as to decide whether to watch the media channel. When the user determines that viewing of the media asset channel is desired, the user may click on the preview window and thecontroller 250 controls thedisplay 260 to display the media asset channel full screen for viewing by the user.
In some embodiments, in response to the first media asset signal sent by the signal transmission device, the controller may parse the first media asset signal to obtain first media asset data, thereby controlling the display to display the first media asset data. It should be noted that, the first media data includes video data and audio data, and the controller may control the display to display the video data and control the audio device of the display device to play the audio data.
The user can directly control the display device by using the display device remote controller or by using a touch control mode and the like to control the signal transmission device, such as switching media information channels and the like. After receiving the control instruction of the user, the display device can acquire the infrared code corresponding to the control instruction and send the infrared code to the control device, so that the control device forwards the infrared code to the signal transmission device. After receiving the infrared code, the signal transmission device can respond to the control instruction corresponding to the infrared code to update the media information signal.
It should be noted that, the user may control the signal transmission device through the set top box controller or the display device, but it is inconvenient to control when the current location of the user is far away from the remote controller or the display device. At this time, the user may be using the third party smart device, and want to control the signal transmission device through the nearby third party smart device. For example, a user is currently using a smart screen or other display device, and may have a need to control signaling devices using such smart devices. However, since the set-top box receives the signal provided by the cable television provider and transmits the signal to the display device, connection with other devices cannot be established, and thus the user cannot control the set-top box by using the third party device. At this time, the user needs to take the remote controller or control the display device to control the set top box, which seriously affects the use experience of the user.
For this reason, the display device in the embodiment of the application has a function of enabling the third party device to control the signal transmission device. The display device and the signal transmission device may be associated as a transfer station for receiving signals by the signal transmission device, considering that the display device has established a connection with the signal transmission device. When the user wants to control the signal transmission device by using the third party device, the user can send an instruction to the display device, and the display device is used for controlling the signal transmission device, so that the user can control the signal transmission device by using the third party device, and the use experience of the user is improved. For this purpose, the display device is provided with a third party control mode as a relay for the third party device to control the signal transmission device.
In some embodiments, the user may send a third party control mode instruction to the display device by operating a designated key of the remote control. And pre-associating the corresponding relation between the third party control mode instruction and the remote controller key in the actual application process. For example, a third party control mode key is set on the remote controller, when the user touches the key, the remote controller sends a third party control mode instruction to thecontroller 250, and at this time, thecontroller 250 controls the display device to enter the third party control mode. When the user touches the key again, thecontroller 250 may control the display device to exit the third party control mode.
In some embodiments, the user may send a third party control mode instruction to the display device by way of voice input using a sound collector of the display device, such as a microphone, to control the display device to enter a third party control mode. The display device can be provided with an intelligent voice system, and the intelligent voice system can recognize the voice of the user so as to extract instruction content input by the user.
In some embodiments, when the user controls the display device using the smart device, for example, using a mobile phone, the third party control mode instruction may also be sent to the display device through the mobile phone. In the actual application process, a control can be set in the corresponding operation interface of the mobile phone, and whether to enter the third party control mode can be selected through the control, so that a third party control mode instruction is sent to thecontroller 250, and at this time, thecontroller 250 can control the display device to enter the third party control mode.
A third party control mode option may also be set in the UI interface of the display device, and when the user clicks the option, the display device may be controlled to enter or exit the third party control mode.
In some embodiments, to prevent the user from triggering the third party control mode by mistake, when thecontroller 250 receives the third party control mode instruction, thedisplay 260 may be controlled to display the third party control mode confirmation information, so that the user performs secondary confirmation whether to control the display device to enter the third party control mode. FIG. 11 illustrates a schematic diagram of third party control mode validation information in some embodiments.
Fig. 12 shows a flow chart of interaction of a display device and a terminal device in some embodiments, comprising the steps of:
s101, responding to a first media asset signal sent by signal transmission equipment, analyzing the first media asset signal to obtain first media asset data, and controlling a display to display the first media asset data;
s102, associating the signal transmission equipment with the display equipment to obtain association information, and sending the association information to a server;
s103, receiving a control instruction sent by a server, wherein the control instruction is an instruction sent to the server when a terminal device indicates a control signal transmission device by a user;
s104, acquiring a target infrared code corresponding to the control instruction, and transmitting the target infrared code to a control device so that the control device can transmit the target infrared code to signal transmission equipment, wherein the target infrared code is used for enabling the signal transmission equipment to update media information signals;
s105, responding to a second media asset signal sent by the signal transmission equipment, analyzing the second media asset signal to obtain second media asset data, and controlling a display to display the second media asset data.
In some embodiments, the first media signal sent by the signal transmission device may be played in the display device for viewing by the user.
The controller may first associate the display device with the signal transmission device in view of the user's need to have a third party device to control the signal transmission device.
When the association is made, the controller may first acquire the device identification of the display device. The device identification may be used to uniquely identify the device, thereby distinguishing between different devices. In consideration of the fact that the user can set the device names of the display devices by himself, there may be a case where a plurality of display devices have the same device name, so in the embodiment of the present application, the display devices are not distinguished by the device names, but the device identifier corresponding to each display device is generated.
The controller may acquire device information of the display device when generating the device identification, the device information may include a device ID of the display device, for example, a DeviceID, and may further include a device address of the display device, which may be a physical address, for example, a MAC address. It should be noted that their DeviceID should be different for different display devices, while the MAC address should be different. In consideration of the possibility that a technician may mislabel certain device information of two display devices when the display devices are shipped, the controller may generate a device identification of the display device based on the device ID and the MAC address of the display device as a unique identification of the display device.
The controller can splice the device ID and the MAC address of the display device, and the obtained spliced character string is the device identifier of the display device. In the embodiment of the application, the device identifier of the display device is referred to as a first device identifier.
The controller may generate the device identifier of the signal transmission device according to the first device identifier of the display device, where the device identifier of the signal transmission device is referred to as a second device identifier in the embodiment of the present application.
The controller may first randomly generate an ID, and splice the first device identifier and the random ID to obtain a second device identifier.
In order to associate the display device with the signal transmission device, the controller may set an association identifier for the signal transmission device, the association identifier being used to indicate a device to which the signal transmission device is associated, and the controller may determine the first device identifier as the association identifier of the signal transmission device.
The controller may generate association information based on the second device identification, the association identification and the device name of the signaling device, the association information being used to characterize the information of the signaling device.
In some embodiments, the server may be used to manage the respective devices, for example, to send information of the display device to the third party device or to send control instructions of the third party device to the display device, considering that the display device and the third party device may not be able to directly interact with each other. Therefore, each device can be bound with the server in advance so as to log own information into the server, and the server can conveniently manage the information. The server may be an AIOT (Artificial Intelligence & Internet of Things, artificial intelligence internet of things) server.
For intelligent devices, the information of the intelligent devices after the intelligent devices are started up can be counted, wherein the information comprises the device names and the device identifications. The smart device may send this information to the server. It should be noted that, since the signal transmission device cannot send information to the server, when the controller detects that the signal transmission device is connected to the display device, the controller may acquire the association information of the signal transmission device and send the association information to the server.
In some embodiments, the server may associate the devices, for example, each device under the same user account, to avoid other users from querying the device information of the current user, in view of device security.
The user can log in the user account of the user in the intelligent device. Taking the display device as an example, after the user logs in to the account, the controller may associate the display device with the user account, and send the user account information to the server, so that the server associates the display device with the current user account. The server may count all devices under the same user account to associate the devices.
It should be noted that, the controller may bind the signal transmission device to the user account corresponding to the display device.
In some embodiments, the user may control the display device as well as the signaling device using a third party smart device, such as other display devices, smart screens, etc. In the embodiment of the application, the terminal equipment is used for referring to third party equipment.
The user may input device query instructions to the terminal device to determine other devices that the terminal device may control. The controller in the terminal device may send a device information acquisition request to the server.
After receiving the device information obtaining request, the server may obtain other devices associated with the terminal device, for example, other devices under the user account corresponding to the terminal device. The server may send device information of these devices to the terminal device, including a device name and a device identification. If the signal transmission device is a signal transmission device, the association information of the signal transmission device can be sent to the terminal device.
After the terminal device receives the device information sent by the server, the controller may generate a user device interface based on the device information. The user equipment interface comprises a plurality of equipment controls, each equipment control corresponds to one controllable equipment and can comprise signal transmission equipment controls.
The controller may control the display to display a user device interface for a user to select a device to be controlled.
In response to a user selection of a signaling device control, it may be determined that a signaling device control instruction was entered for the user. The controller may control the display to display a signaling device control interface including at least one control. Each control corresponds to an instruction for controlling the signaling device, such as a mute instruction, a channel switch instruction, etc.
And responding to the selected operation of the user on the target control, the controller can acquire a control instruction corresponding to the target control.
The controller can acquire the association information of the signal transmission devices, and can determine the display devices associated with the signal transmission devices according to the association identification in the association information.
The controller may generate a control request based on the association information and transmit the control request to the server. The control request may include a control instruction and an associated identifier, i.e. a first device identifier of the display device.
The server may determine the control instruction and the first device identification according to the control request, so as to transmit the control instruction to the display device.
In some embodiments, after receiving the control instruction sent by the server, the display device may indicate to the device that determines that the control instruction is controlling.
If the control instruction instructs to control the display device, the display device may directly execute the control instruction.
If the control instruction indicates to control the signal transmission device, the display device may acquire the target infrared code corresponding to the control instruction based on a preset database. The target infrared code is used for enabling the signal transmission device to update the media information signal, for example, when the control instruction indicates that the media information channel is switched, the video data and the audio data provided by the signal transmission device are updated, and when the control instruction indicates silence, the audio data are required to be updated.
The display device may send the target infrared code to the control means, and the control means may send the target infrared code to the signal transmission device. The signal transmission device may update the first media asset signal to the second media asset signal.
In response to the second media asset signal sent by the signal transmission device, the display device may parse the second media asset signal to obtain second media asset data, and display the second media asset data.
The embodiment of the application also provides a device control method, which is applied to the display device provided in the above embodiment, and includes:
responding to a first media information signal sent by the signal transmission equipment, analyzing the first media information signal to obtain first media information data, and controlling a display to display the first media information data;
Associating the signal transmission equipment with the display equipment to obtain association information, and sending the association information to a server;
receiving a control instruction sent by a server, wherein the control instruction is an instruction sent to the server when a user indicates a control signal transmission device by a terminal device;
acquiring a target infrared code corresponding to the control instruction, and transmitting the target infrared code to the control device so that the control device can transmit the target infrared code to the signal transmission equipment, wherein the target infrared code is used for enabling the signal transmission equipment to update the media information signal;
and responding to the second media information sent by the signal transmission equipment, analyzing the second media information to obtain second media information data, and controlling the display to display the second media information data.
In some embodiments, further comprising:
acquiring region information of display equipment;
acquiring signal transmission equipment information based on region information, wherein the signal transmission equipment information comprises equipment names, infrared code information and media information;
performing code matching verification on the infrared code information to obtain target infrared code information; the target infrared code information comprises the corresponding relation between at least one infrared code and a control instruction;
and storing the target infrared code information into a preset database.
In some embodiments, performing code matching verification on the infrared code information further includes:
if the infrared code information is one set, determining the infrared code information as target infrared code information;
if the infrared code information is multiple sets, respectively acquiring multiple sets of test infrared codes of the multiple sets of infrared code information; the test infrared code is an infrared code corresponding to a preset control instruction;
the method comprises the steps that a plurality of sets of test infrared codes are respectively sent to a control device, so that the control device sends the plurality of sets of test infrared codes to signal transmission equipment;
and acquiring a target test infrared code responded by the signal transmission equipment, and determining infrared code information corresponding to the target test infrared code as target infrared code information.
In some embodiments, further comprising:
responding to a media information channel playing instruction input by a user, and generating a media information channel interface based on media information channel information; the media resource channel interface comprises at least one media resource channel control;
responding to the selected operation of the user on the target media resource channel control, and acquiring a target media resource channel corresponding to the target media resource channel control;
acquiring a playing infrared code corresponding to a control instruction indicating a playing target media information channel based on a preset database, and sending the playing infrared code to a control device so that the control device sends the playing infrared code to signal transmission equipment; the playing infrared code is used for enabling the signal transmission equipment to provide a first media information signal corresponding to the target media information channel.
In some embodiments, associating the signal transmission device with the display device further comprises:
acquiring a device ID and a device address of a display device;
generating a first device identification of the display device based on the device ID and the device address;
generating a second equipment identifier of the signal transmission equipment based on the first equipment identifier, and determining the first equipment identifier as an associated identifier of the signal transmission equipment;
and generating association information based on the second device identification, the association identification and the device name.
In some embodiments, obtaining the target infrared code corresponding to the control instruction further includes:
if the control instruction indicates to control the signal transmission equipment, acquiring a target infrared code corresponding to the control instruction based on a preset database;
if the control instruction instructs to control the display device, the control instruction is executed.
The embodiment of the application also provides a device control method, which is applied to the terminal device provided in the above embodiment, and includes:
responding to a signal transmission device control instruction, and controlling a display to display a signal transmission device control interface; the signal transmission equipment control interface comprises at least one control;
responding to the selected operation of a user on a target control, and acquiring a control instruction corresponding to the target control;
Acquiring association information of signal transmission equipment, wherein the association information is used for indicating display equipment associated with the signal transmission equipment;
generating a control request based on the associated information, and sending the control request to a server, so that the server sends a control instruction to the display device, and the display device obtains a target infrared code corresponding to the control instruction and sends the target infrared code to the control device; the target infrared code is used for enabling the signal transmission equipment to update the media information signal.
In some embodiments, further comprising:
responding to the equipment inquiry instruction, and sending an equipment information acquisition request to a server;
receiving equipment information fed back by a server based on the equipment information acquisition request, and generating a user equipment interface based on the equipment information;
controlling a display to display a user equipment interface, wherein the user equipment interface comprises a signal transmission equipment control;
and responding to the selected operation of the signal transmission equipment control by the user, and generating a signal transmission equipment control instruction.
The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.
It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present invention.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.