技术领域Technical Field
本申请涉及显示设备技术领域，尤其涉及一种显示设备和音频输出方法。The present application relates to the technical field of display devices, and in particular to a display device and an audio output method.
背景技术Background Art
随着智能显示设备的快速发展，显示设备的功能将越来越丰富，性能也越来越强大，可实现双向人机交互功能，集影音、娱乐、数据等多种功能于一体，用于满足用户多样化和个性化需求。随着用户对显示设备所能提供功能或服务的要求也越来越高，画面分屏显示也逐渐成为用户经常使用的一个功能。With the rapid development of intelligent display devices, the functions of display devices will become more and more abundant, and the performance will become more and more powerful. They can realize two-way human-computer interaction, integrate multiple functions such as audio and video, entertainment, and data, and meet the diverse and personalized needs of users. As users' requirements for the functions or services that display devices can provide are getting higher and higher, split-screen display has gradually become a function that users often use.
对于一些显示设备，可以对显示器显示的画面进行分屏处理，形成多个窗口，同时每个窗口分别展示不同的画面内容，使得用户可以同时观看到不同的节目画面。For some display devices, the picture displayed on the monitor can be split into multiple windows, and each window displays different picture content, so that users can watch different program pictures at the same time.
然而本申请的发明人发现，现有的显示设备虽然能够通过多个窗口展示出不同的画面，但是只会选择其中一个窗口播放声音，即允许用户观看多个节目画面，但是会播放其中一个节目画面的声音，而其余的节目画面则无法播放声音，从而严重影响到用户的体验性。However, the inventor of the present application discovered that although the existing display device can display different pictures through multiple windows, it will only select one of the windows to play sound, that is, it allows the user to watch multiple program pictures, but the sound of one of the program pictures will be played, while the sound of the remaining program pictures cannot be played, which seriously affects the user experience.
发明内容Summary of the invention
本发明提供了一种显示设备和音频输出方法。以解决现有的显示设备中，多个窗口中只有一个窗口能够播放声音，导致用户的体验性较差的问题。The present invention provides a display device and an audio output method to solve the problem that in the existing display device, only one window among multiple windows can play sound, resulting in poor user experience.
第一方面，本申请提供一种显示设备，显示设备包括显示器、音频输出接口以及控制器。其中，显示器用于显示用户界面，用户界面中包括多个窗口；音频输出接口为多个，用于连接多类音频设备；控制器被配置为用以执行如下步骤：响应于用户输入的指示显示多个窗口的显示指令，控制显示器显示多个窗口；检测用户控制的焦点位于的焦点窗口；响应于用户输入的指示切换所述焦点窗口对应的音频设备的切换指令，对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备，以使每个窗口使用不同的音频设备。In a first aspect, the present application provides a display device, which includes a display, an audio output interface, and a controller. The display is used to display a user interface, which includes multiple windows; there are multiple audio output interfaces for connecting multiple types of audio devices; the controller is configured to perform the following steps: respond to a display instruction input by a user to display multiple windows, control the display to display multiple windows; detect the focus window where the focus controlled by the user is located; respond to a switching instruction input by a user to switch the audio device corresponding to the focus window, switch the audio device corresponding to the focus window, and adjust the audio devices corresponding to the remaining windows so that each window uses a different audio device.
在一些实现方式中，所述切换指令为：将所述焦点窗口对应的音频设备由第二类音频设备切换至第一类音频设备。In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from the second category audio device to the first category audio device.
在执行对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备的步骤中，所述控制器进一步被配置为：将所述焦点窗口的第一音频通道设置为静音状态，并判断第一类音频设备的使用状态；所述第一音频通道用于将所述焦点窗口的音频输出至所述焦点窗口对应的音频设备；当所述第一类音频设备处于未使用状态时，将所述第一音频通道和第一类音频设备进行连接；当所述第一类音频设备处于使用状态时，确定所述第一类音频设备当前对应的第一切换窗口；将所述第一切换窗口的第二音频通道设置为静音状态，所述第二音频通道用于将所述第一切换窗口的音频输出至所述第一切换窗口对应的音频设备；将所述第二音频通道和所述焦点窗口对应的第二类音频设备进行连接，以及，将所述第一音频通道和第一类音频设备连接；解除所述第二音频通道的静音状态；解除所述第一音频通道的静音状态。In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine the use status of the first type of audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the first type of audio device is in an unused state, connect the first audio channel and the first type of audio device; when the first type of audio device is in a used state, determine the first switching window currently corresponding to the first type of audio device; set the second audio channel of the first switching window to a mute state, and the second audio channel is used to output the audio of the first switching window to the audio device corresponding to the first switching window; connect the second audio channel to the second type of audio device corresponding to the focus window, and connect the first audio channel to the first type of audio device; release the mute state of the second audio channel; release the mute state of the first audio channel.
在一些实现方式中，所述切换指令为：将所述焦点窗口对应的音频设备由第一类音频设备切换至第二类音频设备。In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from a first type of audio device to a second type of audio device.
在执行对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备的步骤中，所述控制器进一步被配置为：将所述焦点窗口的第一音频通道设置为静音状态，并判断所述音频输出接口是否连接有未使用的第二类音频设备；所述第一音频通道用于将所述焦点窗口的音频输出至所述焦点窗口对应的音频设备；当所述音频输出接口连接有未使用的第二类音频设备时，将所述第一音频通道和未使用的第二类音频设备进行连接；当所述音频输出接口没有连接未使用的第二类音频设备时，随机选取第二类音频设备中的第一设备，并确定所述第一设备当前对应的第二切换窗口；将所述第二切换窗口的第三音频通道设置为静音状态，所述第三音频通道用于将所述第二切换窗口的音频输出至所述第二切换窗口对应的音频设备；将所述第三音频通道和第一类音频设备连接，以及，将所述第一音频通道和所述第一设备进行连接；解除所述第三音频通道的静音状态；解除所述第一音频通道的静音状态。In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine whether the audio output interface is connected to an unused second-category audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the audio output interface is connected to an unused second-category audio device, connect the first audio channel to the unused second-category audio device; when the audio output interface is not connected to an unused second-category audio device, randomly select a first device from the second-category audio devices, and determine the second switching window currently corresponding to the first device; set the third audio channel of the second switching window to a mute state, the third audio channel is used to output the audio of the second switching window to the audio device corresponding to the second switching window; connect the third audio channel to the first-category audio device, and connect the first audio channel to the first device; release the mute state of the third audio channel; release the mute state of the first audio channel.
在一些实现方式中，在执行对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备的步骤前，所述控制器还被配置为：响应于用户输入的指示查询所述焦点窗口对应的音频设备的查询指令，控制显示器显示音频设备使用情况，以使用户根据所述音频设备使用情况，将所述焦点窗口对应的音频设备切换为特定音频设备；所述音频设备使用情况中包括显示设备能够使用的所有音频设备以及每个音频设备当前对应的窗口。In some implementations, before executing the steps of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: respond to a query instruction input by a user to query the audio device corresponding to the focus window, control the display to display the audio device usage status, so that the user can switch the audio device corresponding to the focus window to a specific audio device according to the audio device usage status; the audio device usage status includes all audio devices that can be used by the display device and the window currently corresponding to each audio device.
在一些实现方式中，所述切换指令为：将所述焦点窗口对应的音频设备由第一类音频设备切换至特定第二类音频设备。In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from a first-category audio device to a specific second-category audio device.
在执行对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备的步骤中，所述控制器进一步被配置为：将所述焦点窗口的第一音频通道设置为静音状态，并判断所述特定第二类音频设备的使用状态；所述第一音频通道用于将所述焦点窗口的音频输出至所述焦点窗口对应的音频设备；当所述特定第二类音频设备处于未使用状态时，将所述第一音频通道和所述特定第二类音频设备进行连接；当所述特定第二类音频设备处于使用状态时，确定所述特定第二类音频设备当前对应的特定切换窗口；将所述特定切换窗口的特定音频通道设置为静音状态，所述特定音频通道用于将所述特定切换窗口的音频输出至所述特定切换窗口对应的音频设备；将所述特定音频通道和第一类音频设备进行连接，以及，将所述第一音频通道和所述特定第二类音频设备连接；解除所述特定音频通道的静音状态；解除所述第一音频通道的静音状态。In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine the use state of the specific second-category audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the specific second-category audio device is in an unused state, connect the first audio channel and the specific second-category audio device; when the specific second-category audio device is in a used state, determine the specific switching window currently corresponding to the specific second-category audio device; set the specific audio channel of the specific switching window to a mute state, the specific audio channel is used to output the audio of the specific switching window to the audio device corresponding to the specific switching window; connect the specific audio channel to the first-category audio device, and connect the first audio channel to the specific second-category audio device; release the mute state of the specific audio channel; release the mute state of the first audio channel.
在一些实现方式中，所述用户界面中包括第一窗口和第二窗口。当所述第一窗口对应的音频设备为第一类音频设备时，所述第二窗口对应的音频设备为第二类音频设备；当所述第一窗口对应的音频设备为第二类音频设备时，所述第二窗口对应的音频设备为第一类音频设备或其余的第二类音频设备。In some implementations, the user interface includes a first window and a second window. When the audio device corresponding to the first window is a first-category audio device, the audio device corresponding to the second window is a second-category audio device; when the audio device corresponding to the first window is a second-category audio device, the audio device corresponding to the second window is the first-category audio device or the remaining second-category audio devices.
在一些实现方式中，在执行控制显示器显示多个窗口的步骤前，所述控制器还被配置为：响应于用户输入的指示开启显示设备的开机指令，控制显示器显示第一窗口，所述第一窗口用于播放第一媒资资源。在执行控制显示器显示多个窗口的步骤中，所述控制器进一步被配置为：响应于所述显示指令，控制显示器同时显示第一窗口和第二窗口，所述第二窗口用于显示媒资资源推荐列表，以使用户根据所述媒资资源推荐列表选择第二媒资资源；在所述第二窗口中播放第二媒资资源。In some implementations, before executing the step of controlling the display to display multiple windows, the controller is further configured to: in response to a power-on instruction input by a user indicating to turn on the display device, control the display to display a first window, wherein the first window is used to play a first media resource. In executing the step of controlling the display to display multiple windows, the controller is further configured to: in response to the display instruction, control the display to simultaneously display the first window and the second window, wherein the second window is used to display a media resource recommendation list, so that the user can select a second media resource according to the media resource recommendation list; and play the second media resource in the second window.
在一些实现方式中，所述切换指令为：将所述焦点窗口对应的音频设备由第二类音频设备中的第一设备切换至第二类音频设备中的第二设备；其中，所述焦点窗口为第一窗口，所述第二设备为第二窗口当前对应的音频设备。在执行对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备的步骤中，所述控制器进一步被配置为：将第一窗口的音频通道和第二设备进行连接，将第二窗口的音频通道和第一设备进行连接。In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from the first device in the second category of audio devices to the second device in the second category of audio devices; wherein the focus window is the first window, and the second device is the audio device currently corresponding to the second window. In executing the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: connect the audio channel of the first window to the second device, and connect the audio channel of the second window to the first device.
在一些实现方式中，所述控制器还被配置为：响应于用户输入的指示将用户界面由多个窗口切换为单个窗口的控制指令，控制显示器仅显示所述焦点窗口；将其余窗口的音频通道设置为静音状态。In some implementations, the controller is further configured to: in response to a control instruction input by a user indicating switching of the user interface from multiple windows to a single window, control the display to display only the focus window; and set the audio channels of the remaining windows to a mute state.
第二方面，本申请还提供一种音频输出方法，应用于显示设备，所述方法包括：响应于用户输入的指示显示多个窗口的显示指令，控制显示器显示多个窗口；检测用户控制的焦点位于的焦点窗口；响应于用户输入的指示切换所述焦点窗口对应的音频设备的切换指令，对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备，以使每个窗口使用不同的音频设备。In a second aspect, the present application also provides an audio output method, which is applied to a display device, and the method includes: responding to a display instruction of displaying multiple windows in response to an instruction input by a user, controlling the display to display multiple windows; detecting a focus window where the focus controlled by the user is located; responding to a switching instruction of switching the audio device corresponding to the focus window in response to an instruction input by the user, switching the audio device corresponding to the focus window, and adjusting the audio devices corresponding to the remaining windows so that each window uses a different audio device.
由以上技术方案可以看出，本申请提供了一种显示设备和音频输出方法，可以控制显示器显示多个窗口，并检测用户控制的焦点位于的焦点窗口；通过对焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备，以使每个窗口使用不同的音频设备，从而使得每个窗口均可以独立播放音频，提高了用户的体验性。It can be seen from the above technical solution that the present application provides a display device and an audio output method, which can control the display to display multiple windows and detect the focus window where the focus controlled by the user is located; by switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, so that each window uses a different audio device, each window can play audio independently, thereby improving the user experience.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
图1示出了根据一些实施例的显示设备的使用场景；FIG1 shows a usage scenario of a display device according to some embodiments;
图2示出了根据一些实施例的控制装置100的硬件配置框图；FIG2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;
图3示出了根据一些实施例的显示设备200的硬件配置框图；FIG3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;
图4示出了根据一些实施例的显示设备200中软件配置图；FIG. 4 shows a software configuration diagram in the display device 200 according to some embodiments;
图5示出了一些实施例中显示设备各部件的交互流程图；FIG5 shows a flowchart of the interaction between components of a display device in some embodiments;
图6示出了一可行性实施例中多窗口模式下显示器中的画面示意图；FIG6 is a schematic diagram showing a screen in a display in a multi-window mode in a feasible embodiment;
图7示出了一可行性实施例中一种多窗口模式的示意图；FIG7 shows a schematic diagram of a multi-window mode in a feasible embodiment;
图8示出了一可行性实施例中多窗口模式下音频输出方式的示意图；FIG8 is a schematic diagram showing an audio output method in a multi-window mode in a feasible embodiment;
图9示出了一可行性实施例中焦点窗口的示意图；FIG9 is a schematic diagram showing a focus window in a feasible embodiment;
图10示出了一些实施例中显示设备各部件的交互流程图；FIG10 shows a flowchart of the interaction of various components of a display device in some embodiments;
图11示出了一可行性实施例中显示器显示焦点窗口对应的音频设备的示意图；FIG11 is a schematic diagram showing an audio device corresponding to a focus window displayed on a display in a feasible embodiment;
图12示出了一些实施例中显示设备各部件的交互流程图；FIG12 shows a flowchart of the interaction between components of a display device in some embodiments;
图13示出了一可行性实施例中显示器显示焦点窗口对应的音频设备的示意图；FIG13 is a schematic diagram showing an audio device corresponding to a focus window displayed on a display in a feasible embodiment;
图14示出了一可行性实施例中显示设备从多窗口模式切换至单窗口模式的示意图；FIG14 is a schematic diagram showing a display device switching from a multi-window mode to a single-window mode in a feasible embodiment;
图15示出了音频输出方法的一个实施例的流程示意图。FIG. 15 is a schematic flow chart showing an embodiment of an audio output method.
具体实施方式DETAILED DESCRIPTION
为使本申请的目的和实施方式更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施方式进行清楚、完整地描述，显然，描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.
需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体，而不必然意味着限定特定的顺序或先后次序，除非另外注明。应该理解这样使用的用语在适当情况下可以互换。The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
术语“包括”和“具有”以及他们的任何变形，意图在于覆盖但不排他的包含，例如，包含了一系列组件的产品或设备不必限于清楚地列出的所有组件，而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
术语“模块”是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合，能够执行与该元件相关的功能。The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functions associated with that element.
图1为根据实施例中显示设备的使用场景的示意图。如图1所示，显示设备200还与服务器400进行数据通信，用户可通过智能设备300或控制装置100操作显示设备200。FIG1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式中的至少一种，通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等至少一种输入用户指令，来控制显示设备200。In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and at least one of other short-range communication methods, to control the display device 200 wirelessly or wired. The user may control the display device 200 by inputting user commands through at least one of buttons on the remote controller, voice input, and control panel input.
在一些实施例中，智能设备300可以包括移动终端、平板电脑、计算机、笔记本电脑，AR/VR设备等中的任意一种。In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a laptop computer, an AR/VR device, etc.
在一些实施例中，也可以使用智能设备300以控制显示设备200。例如，使用在智能设备上运行的应用程序控制显示设备200。In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 may be controlled using an application running on the smart device.
在一些实施例中，也可以使用智能设备300和显示设备进行数据的通信。In some embodiments, the smart device 300 and the display device may also be used to communicate data.
在一些实施例中，显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制，例如，可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制，也可以通过显示设备200设备外部设置的语音控制装置来接收用户的语音指令控制。In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
在一些实施例中，显示设备200还与服务器400进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。服务器400可以是一个集群，也可以是多个集群，可以包括一类或多类服务器。In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.
在一些实施例中，一个步骤执行主体执行的软件步骤可以随需求迁移到与之进行数据通信的另一步骤执行主体上进行执行。示例性的，服务器执行的软件步骤可以随需求迁移到与之数据通信的显示设备上执行，反之亦然。In some embodiments, the software steps executed by a step execution subject can be migrated to another step execution subject in data communication with it as required. Exemplarily, the software steps executed by a server can be migrated to a display device in data communication with it as required, and vice versa.
图2示例性示出了根据示例性实施例中控制装置100的配置框图。如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。FIG2 exemplarily shows a block diagram of a configuration of a control device 100 according to an exemplary embodiment. As shown in FIG2 , the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 can receive an input operation instruction from a user, and convert the operation instruction into an instruction that can be recognized and responded to by the display device 200, playing the role of an interactive intermediary between the user and the display device 200.
在一些实施例中，通信接口130用于和外部通信，包含WIFI芯片，蓝牙模块，NFC或可替代模块中的至少一种。In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
在一些实施例中，用户输入/输出接口140包含麦克风，触摸板，传感器，按键或可替代模块中的至少一种。In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button, or alternative modules.
图3示出了根据示例性实施例中显示设备200的硬件配置框图。FIG. 3 is a block diagram showing a hardware configuration of a display device 200 according to an exemplary embodiment.
在一些实施例中，显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
在一些实施例中控制器包括中央处理器，视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口。In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input/output.
在一些实施例中，显示器260包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件，用于接收源自控制器输出的图像信号，进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.
在一些实施例中，显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种，还可以为一种投影装置和投影屏幕。In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
在一些实施例中，调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如以及EPG数据信号。In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
在一些实施例中，通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如：通信器可以包括Wifi模块，蓝牙模块，有线以太网模块等其他网络通信协议芯片或近场通信协议芯片，以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。In some embodiments, the communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
在一些实施例中，检测器230用于采集外部环境或与外部交互的信号。例如，检测器230包括光接收器，用于采集环境光线强度的传感器；或者，检测器230包括图像采集器，如摄像头，可以用于采集外部环境场景、用户的属性或用户交互手势，再或者，检测器230包括声音采集器，如麦克风等，用于接收外部声音。In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
在一些实施例中，外部装置接口240可以包括但不限于如下：高清多媒体接口接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input/output interface formed by the above multiple interfaces.
在一些实施例中，控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如：响应于接收到用于选择在显示器260上显示UI对象的用户命令，控制器250便可以执行与由用户命令选择的对象有关的操作。In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.
在一些实施例中，所述对象可以是可选对象中的任何一个，例如超链接、图标或其他可操作的控件。与所选择的对象有关操作有：显示连接到超链接页面、文档、图像等操作，或者执行与所述图标相对应程序的操作。In some embodiments, the object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. Operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.
在一些实施例中控制器包括中央处理器(Central Processing Unit，CPU)，视频处理器，音频处理器，图形处理器(Graphics Processing Unit，GPU)，RAM Random AccessMemory，RAM)，ROM(Read-Only Memory，ROM)，用于输入/输出的第一接口至第n接口，通信总线(Bus)等中的至少一种。In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input/output, a communication bus (Bus), etc.
CPU处理器。用于执行存储在存储器中操作系统和应用程序指令，以及根据接收外部输入的各种交互指令，来执行各种应用程序、数据和内容，以便最终显示和播放各种音视频内容。CPU处理器，可以包括多个处理器。如，包括一个主处理器以及一个或多个子处理器。CPU processor. Used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video content. CPU processor may include multiple processors. For example, it includes a main processor and one or more sub-processors.
在一些实施例中，图形处理器，用于产生各种图形对象，如：图标、操作菜单、以及用户输入指令显示图形等中的至少一种。图形处理器包括运算器，通过接收用户输入各种交互指令进行运算，根据显示属性显示各种对象；还包括渲染器，对基于运算器得到的各种对象，进行渲染，上述渲染后的对象用于显示在显示器上。In some embodiments, the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input command display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes; and a renderer, which renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.
在一些实施例中，视频处理器，用于将接收外部视频信号，根据输入信号的标准编解码协议，进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频处理中的至少一种，可得到直接可显示设备200上显示或播放的信号。In some embodiments, the video processor is used to receive an external video signal and perform at least one of the following video processing operations, such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis, according to a standard codec protocol of the input signal, to obtain a signal that can be directly displayed or played on the display device 200.
在一些实施例中，视频处理器，包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等中的至少一种。其中，解复用模块，用于对输入音视频数据流进行解复用处理。视频解码模块，用于对解复用后的视频信号进行处理，包括解码和缩放处理等。图像合成模块，如图像合成器，其用于将图形生成器根据用户输入或自身生成的GUI信号，与缩放处理后视频图像进行叠加混合处理，以生成可供显示的图像信号。帧率转换模块，用于对转换输入视频帧率。显示格式化模块，用于将接收帧率转换后视频输出信号，改变信号以符合显示格式的信号，如输出RGB数据信号。In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, and a display formatting module. The demultiplexing module is used to demultiplex the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting an RGB data signal.
在一些实施例中，音频处理器，用于接收外部的音频信号，根据输入信号的标准编解码协议，进行解压缩和解码，以及降噪、数模转换、和放大处理等处理中的至少一种，得到可以在扬声器中播放的声音信号。In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
在一些实施例中，用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
在一些实施例中，“用户界面”，是应用程序或操作系统与用户之间进行交互和信息交换的介质接口，它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface，GUI)，是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素，其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on a display screen of an electronic device, wherein a control may include at least one of icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.
在一些实施例中，用户接口280，为可用于接收控制输入的接口(如：显示设备本体上的实体按键，或其他等)。In some embodiments, the user interface 280 is an interface that can be used to receive control input (such as a physical button on the display device body, or other interfaces).
在一些实施例中，显示设备的系统可以包括内核(Kernel)、命令解析器(shell)、文件系统和应用程序。内核、shell和文件系统一起组成了基本的操作系统结构，它们让用户可以管理文件、运行程序并使用系统。上电后，内核启动，激活内核空间，抽象硬件、初始化硬件参数等，运行并维护虚拟内存、调度器、信号及进程间通信(IPC)。内核启动后，再加载Shell和用户应用程序。应用程序在启动后被编译成机器码，形成一个进程。In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together constitute the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.
参见图4，在一些实施例中，将系统分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和系统库层(简称“系统运行库层”)，以及内核层。Referring to Figure 4, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
在一些实施例中，应用程序层中运行有至少一个应用程序，这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等；也可以是第三方开发者所开发的应用程序。在具体实施时，应用程序层中的应用程序包不限于以上举例。In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
框架层为应用程序层的应用程序提供应用编程接口(application programminginterface，API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心，这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口，可在执行中访问系统中的资源和取得系统的服务。The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.
如图4所示，本申请实施例中应用程序框架层包括管理器(Managers)，内容提供者(Content Provider)等，其中管理器包括以下模块中的至少一个：活动管理器(ActivityManager)用与和系统中正在运行的所有活动进行交互；位置管理器(Location Manager)用于给系统服务或应用提供了系统位置服务的访问；文件包管理器(Package Manager)用于检索当前安装在设备上的应用程序包相关的各种信息；通知管理器(NotificationManager)用于控制通知消息的显示和清除；窗口管理器(Window Manager)用于管理用户界面上的括图标、窗口、工具栏、壁纸和桌面部件。As shown in Figure 4, the application framework layer in the embodiment of the present application includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers and desktop components on the user interface.
在一些实施例中，活动管理器用于管理各个应用程序的生命周期以及通常的导航回退功能，比如控制应用程序的退出、打开、后退等。窗口管理器用于管理所有的窗口程序，比如获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕，控制显示窗口变化(例如将显示窗口缩小显示、抖动显示、扭曲变形显示等)等。In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).
在一些实施例中，系统运行库层为上层即框架层提供支撑，当框架层被使用时，安卓操作系统会运行系统运行库层中包含的C/C++库以实现框架层要实现的功能。In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
在一些实施例中，内核层是硬件和软件之间的层。如图4所示，内核层至少包含以下驱动中的至少一种：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，压力传感器等)、以及电源驱动等。In some embodiments, the kernel layer is a layer between hardware and software. As shown in FIG4 , the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
对于一些显示设备，可以对显示器显示的画面进行分屏处理，形成多个窗口，同时每个窗口分别展示不同的画面内容，使得用户可以同时观看到不同的节目画面。然而现有的显示设备虽然能够通过多个窗口展示出不同的画面，但是只会选择其中一个窗口播放声音，即允许用户观看多个节目画面，但是会播放其中一个节目画面的声音，而其余的节目画面则无法播放声音，从而严重影响到用户的体验性。For some display devices, the screen displayed on the display can be split to form multiple windows, and each window displays different screen content, so that users can watch different program screens at the same time. However, although the existing display devices can display different screens through multiple windows, only one of the windows will be selected to play the sound, that is, the user is allowed to watch multiple program screens, but the sound of one program screen will be played, while the other program screens cannot play the sound, which seriously affects the user experience.
为了解决上述技术问题，本申请提供一种显示设备，包括显示器、音频输出接口以及控制器。其中，显示器用于显示用户界面；音频输出接口包括多类音频接口，分别用于连接多类音频设备。In order to solve the above technical problems, the present application provides a display device, including a display, an audio output interface and a controller. The display is used to display a user interface; the audio output interface includes multiple types of audio interfaces, which are respectively used to connect multiple types of audio devices.
在一些实施例中，显示设备中的音频输出接口可以包括第一类音频接口和第二类音频接口，其中第一类音频接口用于连接第一类音频设备，第二类音频接口用于连接第二类音频设备。其中，第一类音频设备可以为显示设备内置的扬声器或音箱等音频设备。第二类音频设备可以为显示设备外接的蓝牙音箱、USB音箱或Soundbar音箱等。In some embodiments, the audio output interface in the display device may include a first-class audio interface and a second-class audio interface, wherein the first-class audio interface is used to connect a first-class audio device, and the second-class audio interface is used to connect a second-class audio device. The first-class audio device may be an audio device such as a speaker or sound box built into the display device. The second-class audio device may be a Bluetooth speaker, USB speaker, or soundbar speaker connected to the display device.
在一些实施例中，显示设备可以设置有一个第一类音频接口和多个第二类音频接口。即显示设备可以连接有一个第一类音频设备和多个第二类音频设备，并播放音频内容。例如，显示设备可以本机内置有一个扬声器，同时外接有两个蓝牙音箱。In some embodiments, the display device may be provided with a first-class audio interface and multiple second-class audio interfaces. That is, the display device may be connected to a first-class audio device and multiple second-class audio devices, and play audio content. For example, the display device may have a built-in speaker and two external Bluetooth speakers.
在一些实施例中，显示设备具有分屏功能，可以将显示器中显示的用户界面划分为多个窗口，并且每个窗口可以展示不同的画面内容，即显示设备具有多窗口模式。在多窗口模式下，显示设备可以同时显示多个窗口，以使用户在一个显示设备中可以观看的不同的画面内容。In some embodiments, the display device has a split screen function, which can divide the user interface displayed in the display into multiple windows, and each window can display different screen contents, that is, the display device has a multi-window mode. In the multi-window mode, the display device can display multiple windows at the same time, so that the user can view different screen contents in one display device.
图5为一些实施例中显示设备各部件的交互流程图。当显示设备中显示用户画面，并且用户画面中仅有一个窗口时，用户可以向显示设备输入显示多个窗口的显示指令，即多窗口模式指令。控制器接收到多窗口模式指令时，可以控制显示器从显示一个窗口变为显示多个窗口。FIG5 is a flowchart of the interaction between the components of the display device in some embodiments. When the display device displays a user screen and there is only one window in the user screen, the user can input a display instruction to display multiple windows, i.e., a multi-window mode instruction, to the display device. When the controller receives the multi-window mode instruction, it can control the display to change from displaying one window to displaying multiple windows.
在一些实施例中，用户可以通过操作遥控器的指定按键，向显示设备发送多窗口模式指令。在实际应用的过程中预先绑定多窗口模式指令与遥控器按键之间的对应关系。例如，在遥控器上设置一个多窗口模式按键，当用户触控该按键时，遥控器发送多窗口模式指令至控制器，此时控制器控制显示设备进入多窗口模式，并控制显示器显示多个窗口。当用户再次触控该按键时，控制器可以控制显示设备退出多窗口模式。In some embodiments, the user can send a multi-window mode instruction to the display device by operating a designated button of the remote control. In the actual application process, the correspondence between the multi-window mode instruction and the remote control button is pre-bound. For example, a multi-window mode button is set on the remote control. When the user touches the button, the remote control sends a multi-window mode instruction to the controller. At this time, the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows. When the user touches the button again, the controller can control the display device to exit the multi-window mode.
在一些实施例中，也可以预先绑定多窗口模式指令与多个遥控器按键之间的对应关系，当用户触控与多窗口模式指令绑定的多个按键时，遥控器发出多窗口模式指令。在一可行性实施例中，多窗口模式指令绑定的按键依次为方向键(左、下、左、下)，即当用户在预设时间内连续触控按键(左、下、左、下)的情况下，遥控器才发送多窗口模式指令至控制器。采用上述绑定方法，可以避免多窗口模式指令由于用户的误操作而发出。In some embodiments, the correspondence between the multi-window mode command and multiple remote control buttons can also be pre-bound. When the user touches multiple buttons bound to the multi-window mode command, the remote control issues the multi-window mode command. In a feasible embodiment, the buttons bound to the multi-window mode command are the direction keys (left, down, left, down) in sequence, that is, when the user continuously touches the buttons (left, down, left, down) within a preset time, the remote control sends the multi-window mode command to the controller. The above binding method can prevent the multi-window mode command from being issued due to user's misoperation.
本申请实施例仅是示例性的提供几种多窗口模式指令与按键之间的绑定关系，在实际应用的过程中可以根据用户的习惯设定多窗口模式指令与按键之间的绑定关系，在此不做过多的限定。The embodiments of the present application only provide several exemplary binding relationships between multi-window mode commands and buttons. In actual application, the binding relationship between multi-window mode commands and buttons can be set according to user habits, and no excessive limitations are made here.
在一些实施例中，当用户使用智能设备控制显示设备时，例如使用手机时，也可以向显示设备发送多窗口模式指令。在实际应用的过程中可以在手机中设置一个分屏控件，可以通过分屏控件选择是否进入多窗口模式以及设置窗口的数量，从而发送多窗口模式指令至控制器，此时控制器控制显示设备进入多窗口模式，并控制显示器显示多个窗口。In some embodiments, when a user uses a smart device to control a display device, such as a mobile phone, a multi-window mode instruction can also be sent to the display device. In actual application, a split-screen control can be set in the mobile phone, and the split-screen control can be used to select whether to enter the multi-window mode and set the number of windows, thereby sending a multi-window mode instruction to the controller, and the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.
在一些实施例中，当用户使用手机控制显示设备时，可以对手机发出连续点击指令。连续点击指令指的是：在预设的周期内，用户对手机触摸屏的同一区域进行点击的次数超过预设阈值。例如：当用户在1s内对手机触摸屏的某个区域连续点击3次，则视为一次连续点击指令。手机接收到连续点击指令后，可以向显示设备发送多窗口模式指令，以使控制器控制显示设备进入多窗口模式，并控制显示器显示多个窗口。In some embodiments, when a user uses a mobile phone to control a display device, a continuous click instruction can be issued to the mobile phone. A continuous click instruction means that within a preset period, the number of times the user clicks on the same area of the mobile phone touch screen exceeds a preset threshold. For example, when a user clicks on a certain area of the mobile phone touch screen three times in a row within 1 second, it is regarded as a continuous click instruction. After receiving the continuous click instruction, the mobile phone can send a multi-window mode instruction to the display device so that the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.
在一些实施例中，当用户使用手机控制显示设备时，也可以设置为：当检测到用户对手机触摸屏的某一区域的触控压力值超过预设的压力阈值时，手机可以向显示设备发送多窗口模式指令。In some embodiments, when a user uses a mobile phone to control a display device, it can also be set as follows: when it is detected that the touch pressure value of a certain area of the mobile phone touch screen by the user exceeds a preset pressure threshold, the mobile phone can send a multi-window mode instruction to the display device.
还可以在显示设备的UI界面中设置多窗口模式切换选项，当用户点击该切换选项时，可以控制显示设备进入或退出多窗口模式。A multi-window mode switching option may also be set in the UI interface of the display device. When the user clicks the switching option, the display device may be controlled to enter or exit the multi-window mode.
在一些实施例中，可以设置多窗口模式下显示两个窗口，也可以显示两个以上的窗口。图6示出了一可行性实施例中多窗口模式下显示器中的画面示意图，在显示设备进入到多窗口模式后，显示器中同时显示第一窗口和第二窗口，其中第一窗口和第二窗口分别可以显示不同的画面内容，第一窗口中显示第一媒资资源的画面内容，在第二窗口中显示第二媒资资源的画面内容。In some embodiments, two windows can be displayed in the multi-window mode, or more than two windows can be displayed. Figure 6 shows a schematic diagram of a screen in a display in the multi-window mode in a feasible embodiment. After the display device enters the multi-window mode, the first window and the second window are displayed in the display at the same time, wherein the first window and the second window can display different screen contents respectively, the screen contents of the first media resource are displayed in the first window, and the screen contents of the second media resource are displayed in the second window.
在一些实施例中，多窗口显示的画面内容不同时，可以令多窗口显示的画面类型相同。例如，可以在第一窗口中显示第一媒资资源的画面内容时，在第二窗口中显示第二媒资资源的画面内容，此时两个窗口显示的画面类型相同，均为媒资资源。也可以设定在不同的使用场景中，多窗口显示的画面类型不同。例如，在第一窗口中显示媒资资源的画面内容时，在第二窗口中显示UI界面或者游戏界面等，此时两个窗口显示的画面类型是不同的。从而可以满足用户的不同需求，增强了用户的体验性。In some embodiments, when the screen contents displayed in multiple windows are different, the screen types displayed in the multiple windows can be made the same. For example, when the screen contents of the first media resource are displayed in the first window, the screen contents of the second media resource can be displayed in the second window. At this time, the screen types displayed in the two windows are the same, both of which are media resources. It can also be set that the screen types displayed in multiple windows are different in different usage scenarios. For example, when the screen contents of the media resource are displayed in the first window, the UI interface or the game interface is displayed in the second window. At this time, the screen types displayed in the two windows are different. Thereby, different needs of users can be met and the user experience is enhanced.
在一些实施例中，可以根据用户的使用状态设定多窗口模式。当检测到用户开启显示设备后，显示设备默认为单窗口模式，即显示器中只显示第一窗口，第一窗口可以为全屏显示，也可以为窗口化显示，显示设备可以在第一窗口中播放第一媒资资源。In some embodiments, the multi-window mode can be set according to the user's usage status. When it is detected that the user turns on the display device, the display device defaults to single-window mode, that is, only the first window is displayed in the display, and the first window can be displayed in full screen or in windowed mode. The display device can play the first media resource in the first window.
当第一窗口中播放第一媒资资源时，如果用户向显示设备发送多窗口模式指令，还可以先进入节目推荐界面。图7示出了一可行性实施例中一种多窗口模式的示意图，在第一窗口的右侧显示媒资资源推荐列表，包括多个推荐节目选项，如果用户选中推荐节目2选项并确认后，可以控制显示设备进入多窗口模式，此时仍然通过第一窗口显示第一媒资资源，而第二窗口则显示用户选择的推荐节目2。When the first media resource is played in the first window, if the user sends a multi-window mode command to the display device, the program recommendation interface can be entered first. FIG7 shows a schematic diagram of a multi-window mode in a feasible embodiment, where a media resource recommendation list is displayed on the right side of the first window, including multiple recommended program options. If the user selects the recommended program 2 option and confirms it, the display device can be controlled to enter the multi-window mode, at which time the first media resource is still displayed in the first window, while the second window displays the recommended program 2 selected by the user.
在一些实施例中，当显示设备处于多窗口模式时，在多窗口同时显示不同的画面内容的同时，还可以分别输出每个画面对应的音频内容。显示设备可以同时使用一个第一类音频设备和多个第二类音频设备播放音频，例如显示设备同时连接有一个内置扬声器和两个外接蓝牙音箱，此时显示设备可以利用这三个音频设备分别输出三个窗口的音频内容。同时每个窗口可以通过各自的音频通道分别将音频输出至每个窗口对应的音频设备，并通过音频设备播放音频内容。In some embodiments, when the display device is in multi-window mode, while multiple windows simultaneously display different screen contents, the audio content corresponding to each screen can also be output separately. The display device can use a first-class audio device and multiple second-class audio devices to play audio at the same time. For example, the display device is connected to a built-in speaker and two external Bluetooth speakers at the same time. At this time, the display device can use these three audio devices to output the audio content of the three windows respectively. At the same time, each window can output audio to the audio device corresponding to each window through its own audio channel, and play the audio content through the audio device.
在一些实施例中，显示设备可以设定两种音频设备模式。一种是内置播放模式，可以使用显示设备内置的第一类音频设备播放窗口对应的音频内容。一种是外接播放模式，通过使用第二类音频设备，例如蓝牙音箱等，播放窗口对应的音频内容。In some embodiments, the display device can be set to two audio device modes. One is a built-in playback mode, in which the audio content corresponding to the window can be played using the first type of audio device built into the display device. The other is an external playback mode, in which the audio content corresponding to the window is played by using a second type of audio device, such as a Bluetooth speaker.
图8示出了一可行性实施例中多窗口模式下音频输出方式的示意图。其中，显示设备处于多窗口模式，其中，第一窗口中播放第一媒资资源，采用第一类音频设备输出音频；第二窗口中播放第二媒资资源，采用第二类音频设备输出音频。Figure 8 is a schematic diagram showing an audio output method in a multi-window mode in a feasible embodiment, wherein the display device is in a multi-window mode, wherein a first media resource is played in a first window, and a first type of audio device is used to output audio; and a second media resource is played in a second window, and a second type of audio device is used to output audio.
也可以是第一窗口和第二窗口均采用第二类音频设备输出音频，即第一窗口采用第一设备输出音频，第二窗口采用第二设备输出音频。本申请实施例中的第一设备和第二设备均为第二类音频设备。需要说明的是，由于每个窗口通过不同的音频设备播放音频，从而使多窗口模式中每个画面的音频均可以独立播放，达到互不干扰的目的。Alternatively, both the first window and the second window may use a second-class audio device to output audio, that is, the first window uses a first device to output audio, and the second window uses a second device to output audio. The first device and the second device in the embodiment of the present application are both second-class audio devices. It should be noted that since each window plays audio through a different audio device, the audio of each screen in the multi-window mode can be played independently to achieve the purpose of non-interference.
因此，为保证多窗口模式下所有窗口的音频都能正常播放，可以设定为：当第一窗口对应的音频设备为第一类音频设备时，第二窗口对应的音频设备为第二类音频设备。当第一窗口对应的音频设备为第二类音频设备时，第二窗口对应的音频设备为第一类音频设备或其余的第二类音频设备。以保证每个窗口使用的音频设备是不同的。Therefore, to ensure that the audio of all windows in multi-window mode can be played normally, it can be set as follows: when the audio device corresponding to the first window is a first-class audio device, the audio device corresponding to the second window is a second-class audio device. When the audio device corresponding to the first window is a second-class audio device, the audio device corresponding to the second window is a first-class audio device or the remaining second-class audio device. This ensures that the audio devices used by each window are different.
控制器可以在用户使用过程中接收用户输入的各种控制指令，并根据这些控制指令分别执行相应的交互动作，从而对每个窗口进行控制，例如画质控制和声音控制等。The controller can receive various control instructions input by the user during use, and perform corresponding interactive actions according to these control instructions, so as to control each window, such as image quality control and sound control.
在一些实施例中，显示设备可以实时检测焦点窗口。其中，焦点窗口是指用户控制的焦点所位于的窗口。焦点是指显示设备用于辅助用户进行人机交互的标志，可以突出显示用户当前选取内容。例如，焦点可以是选择框，通过诸如“加深显示”、“突出显示”的方式展示用户选择的内容，用户可以通过遥控器上的“上、下、左、右”方向键控制选择框，进而选择不同的选项。焦点可以位于窗口中的某个选项上，也可以位于整个窗口，只要焦点位于某一窗口的整体范围内，则该窗口即为焦点窗口。图9示出了一可行性实施例中焦点窗口的示意图，用户界面包括第一窗口和第二窗口，其中，焦点为选择框的形式。此时选择框选取的是第一窗口中的选项，因此第一窗口即为焦点窗口，用户还可以选择第一窗口内其他的选项，从而对第一窗口进行调节。In some embodiments, the display device can detect the focus window in real time. Among them, the focus window refers to the window where the focus controlled by the user is located. Focus refers to the sign used by the display device to assist the user in human-computer interaction, which can highlight the user's current selection. For example, the focus can be a selection box, which displays the content selected by the user in a manner such as "deepening display" and "highlighting display". The user can control the selection box through the "up, down, left, right" direction keys on the remote control to select different options. The focus can be on an option in the window or on the entire window. As long as the focus is within the overall range of a certain window, the window is the focus window. Figure 9 shows a schematic diagram of the focus window in a feasible embodiment, and the user interface includes a first window and a second window, wherein the focus is in the form of a selection box. At this time, the selection box selects the option in the first window, so the first window is the focus window, and the user can also select other options in the first window to adjust the first window.
显示设备通过实时检测出焦点窗口，可以及时响应用户的各种操作。图10为一些实施例中显示设备各部件的交互流程图。The display device can respond to various operations of the user in a timely manner by detecting the focus window in real time. Fig. 10 is a flowchart of the interaction of various components of the display device in some embodiments.
在一些实施例中，在显示设备实时检测焦点窗口的同时，控制器还可以获取焦点窗口当前对应的音频设备。例如，可以通过显示设备中用于记录每个窗口当前使用的音频设备的数据库获取。控制器可以根据焦点位置判断出焦点窗口，如果焦点窗口是第一窗口，则可以从数据库中获取第一窗口当前使用的音频输出设备。In some embodiments, while the display device detects the focus window in real time, the controller can also obtain the audio device currently corresponding to the focus window. For example, it can be obtained through a database in the display device that records the audio device currently used by each window. The controller can determine the focus window according to the focus position, and if the focus window is the first window, the audio output device currently used by the first window can be obtained from the database.
在一些实施例中，显示设备可以将音频设备模式情况展示给用户，所述音频设备模式情况指的是：焦点窗口当前对应的音频设备以及可以切换的音频设备模式，以使用户对焦点窗口的音频设备模式进行切换。用户可以通过操作遥控器的指定按键，向显示设备发送展示指令。在实际应用的过程中预先绑定展示指令与遥控器按键之间的对应关系。例如，在遥控器上设置一个展示按键，当用户触控该按键时，遥控器发送展示指令至控制器，此时控制器控制显示器显示焦点窗口当前对应的音频设备，以及可切换的音频设备模式。In some embodiments, the display device can display the audio device mode status to the user, and the audio device mode status refers to: the audio device currently corresponding to the focus window and the audio device mode that can be switched, so that the user can switch the audio device mode of the focus window. The user can send a display instruction to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the display instruction and the remote control button is pre-bound. For example, a display button is set on the remote control. When the user touches the button, the remote control sends a display instruction to the controller. At this time, the controller controls the display to display the audio device currently corresponding to the focus window, as well as the switchable audio device mode.
也可以是用户调取设置键UI菜单，控制器控制OSD层菜单显示当前窗口对应的音频设备以及可切换的音频设备模式。Alternatively, the user calls up the setting key UI menu, and the controller controls the OSD layer menu to display the audio device corresponding to the current window and the switchable audio device modes.
图11示出了一可行性实施例中显示器显示焦点窗口对应的音频设备的示意图，其中，用户界面包括第一窗口和第二窗口，第一窗口为焦点窗口。当检测到用户的展示指令时，在第一窗口中显示第一窗口当前对应的音频设备，即第一类音频设备，以及第一窗口可以切换的音频设备模式，即第二类音频设备。用户可以选择将第一窗口的音频设备从第一类音频设备切换至第二类音频设备，或者不做切换。Figure 11 shows a schematic diagram of an audio device corresponding to a focus window displayed on a display in a feasible embodiment, wherein the user interface includes a first window and a second window, and the first window is the focus window. When a user's display instruction is detected, the audio device currently corresponding to the first window, i.e., the first type of audio device, and the audio device mode that the first window can switch, i.e., the second type of audio device, are displayed in the first window. The user can choose to switch the audio device of the first window from the first type of audio device to the second type of audio device, or not to switch.
当检测到指示切换焦点窗口对应的音频设备的切换指令时，显示设备可以响应于用户输入的切换指令，对焦点窗口对应的音频设备进行切换。同时，为保证每个窗口依然可以独立播放音频，还可以调整其余窗口对应的音频设备，从而保证每个窗口均使用不同的音频设备。When a switching instruction indicating switching the audio device corresponding to the focus window is detected, the display device can switch the audio device corresponding to the focus window in response to the switching instruction input by the user. At the same time, in order to ensure that each window can still play audio independently, the audio devices corresponding to the remaining windows can also be adjusted, so as to ensure that each window uses a different audio device.
在一些实施例中，如果焦点窗口当前对应的音频设备为第二类音频设备，同时用户指示将焦点窗口对应的音频设备由第二类音频设备切换至第一类音频设备，显示设备响应于该切换指令，可以对焦点窗口对应的音频设备进行切换。In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to the first-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.
在对音频设备进行切换之前，控制器可以先将焦点窗口的第一音频通道设置为静音状态，以防止在切换音频设备时发生爆音现象。Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.
在将第一音频通道设置为静音状态之后，可以判断第一类音频设备当前的使用状态。如果第一类音频设备处于未使用状态时，说明当前并没有窗口使用第一类音频设备，可以直接将第一音频通道和第一类音频设备进行连接，并解除第一音频通道的静音状态。以使焦点窗口可以将音频通过第一音频通道输出至第一类音频设备，并利用第一类音频设备播放音频。After the first audio channel is set to a muted state, the current usage state of the first audio device can be determined. If the first audio device is not in use, it means that no window is currently using the first audio device. The first audio channel can be directly connected to the first audio device, and the muted state of the first audio channel can be released. This allows the focus window to output audio to the first audio device through the first audio channel and use the first audio device to play audio.
如果第一类音频设备处于使用状态时，说明有其他窗口正在使用第一类音频设备，此时可以将该窗口和焦点窗口的音频设备进行交换，从而实现焦点窗口可以使用第一类音频设备。在交换音频设备之前，控制器可以检测第一类音频设备当前对应的窗口，并设定为第一切换窗口，同时将第一切换窗口的第二音频通道设置为静音状态，以防止爆音。控制器再将第二音频通道和焦点窗口对应的第二类音频设备进行连接，以及将第一音频通道和第一类音频设备连接。此时，焦点窗口和第一切换窗口之间的音频设备进行了交换。控制器再将第一音频通道和第二音频通道解除静音状态，从而使得焦点窗口可以使用第一类音频设备播放音频，同时每个窗口依然可以独立播放音频，不受影响。If the first type of audio device is in use, it means that other windows are using the first type of audio device. At this time, the audio devices of the window and the focus window can be exchanged, so that the focus window can use the first type of audio device. Before exchanging audio devices, the controller can detect the window currently corresponding to the first type of audio device and set it as the first switching window, and at the same time set the second audio channel of the first switching window to a muted state to prevent popping sounds. The controller then connects the second audio channel to the second type of audio device corresponding to the focus window, and connects the first audio channel to the first type of audio device. At this point, the audio devices between the focus window and the first switching window are exchanged. The controller then unmutes the first audio channel and the second audio channel, so that the focus window can use the first type of audio device to play audio, and each window can still play audio independently without being affected.
在一些实施例中，如果焦点窗口当前对应的音频设备为第一类音频设备，同时用户指示将焦点窗口对应的音频设备由第一类音频设备切换至第二类音频设备，显示设备响应于该切换指令，可以对焦点窗口对应的音频设备进行切换。In some embodiments, if the audio device currently corresponding to the focus window is a first category audio device, and the user instructs to switch the audio device corresponding to the focus window from the first category audio device to the second category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.
在对音频设备进行切换之前，控制器可以先将焦点窗口的第一音频通道设置为静音状态，以防止在切换音频设备时发生爆音现象。Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.
在将第一音频通道设置为静音状态之后，考虑到显示设备可以连接多个第二类音频设备，可以判断当前是否显示设备连接有未使用的第二类音频设备。如果当前存在未使用的第二类音频设备，则可以直接将第一音频通道和一个未使用的第二类音频设备进行连接，以使焦点窗口可以将音频通过第一音频通道输出至该第二类音频设备，并利用第二类音频设备播放音频。After the first audio channel is set to a muted state, considering that the display device can be connected to multiple second-class audio devices, it can be determined whether the display device is currently connected to an unused second-class audio device. If there is an unused second-class audio device, the first audio channel can be directly connected to an unused second-class audio device, so that the focus window can output audio to the second-class audio device through the first audio channel, and use the second-class audio device to play audio.
如果显示设备并未连接有未使用的第二类音频设备，说明所有的第二类音频设备全部被其他窗口使用，此时可以随机选取一个第二类音频设备进行使用，从而实现焦点窗口可以使用第二类音频设备。在切换音频设备之前，控制器可以随机选取一个第二类音频设备，即第一设备，并确定该第二类音频设备当前对应的第二切换窗口，同时将第二切换窗口的第三音频通道设置为静音状态，以防止爆音。If the display device is not connected to an unused second-class audio device, it means that all second-class audio devices are used by other windows. At this time, a second-class audio device can be randomly selected for use, so that the focus window can use the second-class audio device. Before switching the audio device, the controller can randomly select a second-class audio device, that is, the first device, and determine the second switching window currently corresponding to the second-class audio device, and at the same time set the third audio channel of the second switching window to a mute state to prevent popping sounds.
控制器再将第三音频通道和第一类音频设备进行连接，以及将第一音频通道和第一设备连接。此时，焦点窗口和第二切换窗口之间的音频设备进行了交换。控制器再将第一音频通道和第三音频通道解除静音状态，从而使得焦点窗口可以使用第一设备播放音频，同时每个窗口依然可以独立播放音频，不受影响。The controller then connects the third audio channel to the first type of audio device, and connects the first audio channel to the first device. At this point, the audio devices between the focus window and the second switching window are swapped. The controller then unmutes the first audio channel and the third audio channel, so that the focus window can use the first device to play audio, while each window can still play audio independently without being affected.
图12为一些实施例中显示设备各部件的交互流程图。FIG. 12 is a flowchart showing the interaction of various components of a display device in some embodiments.
在一些实施例中，显示设备可以将焦点窗口当前对应的音频设备和显示音频设备使用情况展示给用户。其中，音频设备使用情况可以包括显示设备能够使用的所有音频设备以及每个音频设备当前对应的窗口。用户根据音频设备使用情况对焦点窗口的音频设备进行选择，并切换至选择的特定音频设备。用户可以通过操作遥控器的指定按键，向显示设备发送查询指令。在实际应用的过程中预先绑定查询指令与遥控器按键之间的对应关系。例如，在遥控器上设置一个查询按键，当用户触控该按键时，遥控器发送查询指令至控制器，此时控制器控制显示器显示焦点窗口当前对应的音频设备，以及音频设备使用情况。In some embodiments, the display device can display the audio device currently corresponding to the focus window and the usage of the displayed audio device to the user. Among them, the audio device usage may include all audio devices that the display device can use and the window currently corresponding to each audio device. The user selects the audio device of the focus window according to the usage of the audio device and switches to the selected specific audio device. The user can send a query instruction to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the query instruction and the remote control button is pre-bound. For example, a query button is set on the remote control. When the user touches the button, the remote control sends a query instruction to the controller. At this time, the controller controls the display to display the audio device currently corresponding to the focus window, as well as the usage of the audio device.
也可以是用户调取设置键UI菜单，控制器控制OSD层菜单显示当前窗口对应的音频设备以及音频设备使用情况。Alternatively, the user may call up a setting key UI menu, and the controller may control the OSD layer menu to display the audio device corresponding to the current window and the usage of the audio device.
图13示出了一可行性实施例中显示器显示焦点窗口对应的音频设备的示意图，其中，用户界面包括第一窗口、第二窗口和第三窗口，第一窗口为焦点窗口。当检测到用户的查询指令时，在第一窗口中显示第一窗口当前对应的音频设备，为第一类音频设备。以及音频设备使用情况，即：第一类音频设备当前对应第一窗口，第一设备当前对应第二窗口，第二设备当前对应第三窗口。用户可以选择将第一窗口的音频设备从第一类音频设备切换至第一设备或第二设备，或者不做切换。Figure 13 shows a schematic diagram of an audio device corresponding to a focus window displayed on a display in a feasible embodiment, wherein the user interface includes a first window, a second window, and a third window, and the first window is a focus window. When a user's query instruction is detected, the audio device currently corresponding to the first window is displayed in the first window, which is a first-class audio device. And the usage of the audio device, that is: the first-class audio device currently corresponds to the first window, the first device currently corresponds to the second window, and the second device currently corresponds to the third window. The user can choose to switch the audio device of the first window from the first-class audio device to the first device or the second device, or not to switch.
在一些实施例中，如果焦点窗口当前对应的音频设备为第一类音频设备，同时用户指示将焦点窗口对应的音频设备由第一类音频设备切换至特定第二类音频设备，显示设备响应于该切换指令，可以对焦点窗口对应的音频设备进行切换。In some embodiments, if the audio device currently corresponding to the focus window is a first category audio device, and the user instructs to switch the audio device corresponding to the focus window from the first category audio device to a specific second category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.
在对音频设备进行切换之前，控制器可以先将焦点窗口的第一音频通道设置为静音状态，以防止在切换音频设备时发生爆音现象。Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.
在将第一音频通道设置为静音状态之后，控制器可以判断特定第二类音频设备的使用状态。After setting the first audio channel to a mute state, the controller may determine a usage state of the specific second-category audio device.
在将第一音频通道设置为静音状态之后，可以判断特定第二类音频设备当前的使用状态。如果特定第二类音频设备处于未使用状态时，说明当前并没有窗口使用第一类音频设备，可以直接将第一音频通道和特定第二类音频设备进行连接，并解除第一音频通道的静音状态。以使焦点窗口可以将音频通过第一音频通道输出至特定第二类音频设备，并利用特定第二类音频设备播放音频。After the first audio channel is set to a muted state, the current usage state of the specific second-class audio device can be determined. If the specific second-class audio device is not in use, it means that no window is currently using the first-class audio device. The first audio channel can be directly connected to the specific second-class audio device, and the muted state of the first audio channel can be released. This allows the focus window to output audio to the specific second-class audio device through the first audio channel, and use the specific second-class audio device to play audio.
如果特定第二类音频设备处于使用状态时，说明有其他窗口正在使用特定第二类音频设备，此时可以将该窗口和焦点窗口的音频设备进行交换，从而实现焦点窗口可以使用特定第二类音频设备。在交换音频设备之前，控制器可以检测特定第二类音频设备当前对应的窗口，并设定为特定切换窗口，同时将特定切换窗口的特定音频通道设置为静音状态，以防止爆音。控制器再将特定音频通道和第一类音频设备进行连接，以及将第一音频通道和特定第二类音频设备连接。此时，焦点窗口和特定切换窗口之间的音频设备进行了交换。控制器再将第一音频通道和第二音频通道解除静音状态，从而使得焦点窗口可以使用特定第二类音频设备播放音频，同时每个窗口依然可以独立播放音频，不受影响。If a specific second-class audio device is in use, it means that other windows are using the specific second-class audio device. At this time, the audio devices of the window and the focus window can be exchanged, so that the focus window can use the specific second-class audio device. Before exchanging audio devices, the controller can detect the window currently corresponding to the specific second-class audio device and set it as a specific switching window, and at the same time set the specific audio channel of the specific switching window to a muted state to prevent popping sounds. The controller then connects the specific audio channel to the first-class audio device, and connects the first audio channel to the specific second-class audio device. At this point, the audio devices between the focus window and the specific switching window are exchanged. The controller then unmutes the first audio channel and the second audio channel, so that the focus window can use the specific second-class audio device to play audio, and each window can still play audio independently without being affected.
在一些实施例中，当检测到特定第二类音频设备当前对应有特定切换窗口时，也可以先检测显示设备当前是否连接有未使用的第二类音频设备。如果是，则将特定切换窗口和未使用的第二类音频设备相连接，并将焦点窗口和特定第二类音频设备相连接。如果没有未使用的第二类音频设备，则将焦点窗口和特定切换窗口之间的音频设备进行交换。In some embodiments, when it is detected that a specific second-category audio device currently corresponds to a specific switching window, it can also be detected whether the display device is currently connected to an unused second-category audio device. If so, the specific switching window is connected to the unused second-category audio device, and the focus window is connected to the specific second-category audio device. If there is no unused second-category audio device, the audio device between the focus window and the specific switching window is exchanged.
在一些实施例中，如果焦点窗口当前对应的音频设备为第二类音频设备，同时用户指示将焦点窗口对应的音频设备由第二类音频设备切换至第一类音频设备，显示设备响应于该切换指令，可以对焦点窗口对应的音频设备进行切换。控制器可以将焦点窗口和第一类音频设备当前对应的窗口进行音频设备交换，具体的交换方法可以参考上述实施例中将焦点窗口对应的音频设备由第一类音频设备切换至特定第二类音频设备，此处不再赘述。In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to the first-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction. The controller can exchange the audio devices of the focus window and the window currently corresponding to the first-category audio device. The specific exchange method can refer to the above-mentioned embodiment of switching the audio device corresponding to the focus window from the first-category audio device to a specific second-category audio device, which will not be repeated here.
在一些实施例中，如果焦点窗口当前对应的音频设备为第二类音频设备，同时用户指示将焦点窗口对应的音频设备由第二类音频设备切换至特定第二类音频设备，显示设备响应于该切换指令，可以对焦点窗口对应的音频设备进行切换。In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to a specific second-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.
控制器可以先判断特定第二类音频设备的使用情况。如果特定第二类音频设备处于未使用状态，则直接将第一音频通道和特定第二类音频设备进行连接。如果特定第二类音频设备处于使用状态，可以将焦点窗口和特定第二类音频设备当前对应的特定切换窗口直接进行音频设备交换，具体的交换方法可参考上述实施例中的内容，此处不再赘述。The controller may first determine the usage of the specific second-class audio device. If the specific second-class audio device is not in use, the first audio channel is directly connected to the specific second-class audio device. If the specific second-class audio device is in use, the focus window and the specific switching window currently corresponding to the specific second-class audio device may be directly exchanged for audio devices. The specific exchange method may refer to the content in the above embodiment, which will not be repeated here.
在一些实施例中，显示设备可以通过将窗口的音频数据进行打包处理，并传输至第二类音频设备。当显示设备连接一个第二类音频设备和连接多个第二类音频设备时，对音频数据的打包处理方法也不相同。In some embodiments, the display device may package the audio data of the window and transmit it to the second type audio device. When the display device is connected to one second type audio device or multiple second type audio devices, the method of packaging the audio data is also different.
当显示设备连接一个第二类音频设备时，可以将窗口的音频数据进行左右声道分开打包的方式，并分别将左声道打包数据和右声道打包数据传输至第二类音频设备。当显示设备连接有两个第二类音频设备时，会将同一个窗口的音频数据一起打包，即每个窗口只有一个打包数据，再将打包数据传输到相应的第二类音频设备。When the display device is connected to a second-class audio device, the audio data of the window can be packaged separately for left and right channels, and the left channel packaged data and the right channel packaged data are transmitted to the second-class audio device respectively. When the display device is connected to two second-class audio devices, the audio data of the same window will be packaged together, that is, each window has only one packaged data, and then the packaged data will be transmitted to the corresponding second-class audio device.
在一些实施例中，当显示设备处于多窗口模式时，用户还可以控制显示设备进入单窗口模式。用户选中焦点窗口，并可以通过二次触控单窗口模式按键，控制显示设备进入单窗口模式。此时控制器可以控制显示器仅仅显示焦点窗口，也可以全屏显示焦点窗口。In some embodiments, when the display device is in multi-window mode, the user can also control the display device to enter single-window mode. The user selects the focus window and can control the display device to enter single-window mode by touching the single-window mode button twice. At this time, the controller can control the display to display only the focus window or display the focus window in full screen.
在一些实施例中，当显示设备从多窗口模式切换至单窗口模式时，可以控制当前使用的音频设备为焦点窗口对应的音频设备，同时将其余所有窗口的音频通道设置为静音状态，即显示设备只使用焦点窗口对应的音频设备播放音频。In some embodiments, when the display device switches from multi-window mode to single-window mode, the currently used audio device can be controlled to be the audio device corresponding to the focus window, and the audio channels of all other windows can be set to mute mode, that is, the display device only uses the audio device corresponding to the focus window to play audio.
在一些实施例中，如果焦点窗口使用第二类音频设备播放音频，同时还有其他窗口也是用第二类音频设备播放音频时，在将多窗口模式切换至单窗口模式时，还需要改变音频数据的打包方式，变更为将焦点窗口的音频数据进行左右声道分开打包，并分别传送至第二类音频设备。In some embodiments, if the focus window uses a second-class audio device to play audio, and there are other windows that also use the second-class audio device to play audio, when switching the multi-window mode to the single-window mode, it is also necessary to change the packaging method of the audio data, and change it to packaging the audio data of the focus window separately into left and right channels, and transmit them to the second-class audio device respectively.
在一些实施例中，当显示设备从多窗口模式切换至单窗口模式时，也可以将第一类音频设备设定为默认音频设备，并控制当前使用的音频设备为第一类音频设备。In some embodiments, when the display device switches from the multi-window mode to the single-window mode, the first type of audio device may also be set as the default audio device, and the currently used audio device may be controlled to be the first type of audio device.
图14示出了一可行性实施例中显示设备从多窗口模式切换至单窗口模式的示意图，其中，用户界面包括第一窗口和第二窗口，第一窗口为焦点窗口，通过第一类音频设备播放音频。当显示设备从多窗口模式切换至单窗口模式时，可控制器可以控制显示器全屏显示第一窗口，并使用第一类音频设备播放音频。Figure 14 shows a schematic diagram of a display device switching from a multi-window mode to a single-window mode in a feasible embodiment, wherein the user interface includes a first window and a second window, the first window is a focus window, and audio is played through a first-class audio device. When the display device switches from the multi-window mode to the single-window mode, the controller can control the display to display the first window in full screen and use the first-class audio device to play audio.
需要说明的是，本申请实施例中所述多窗口模式下的多个窗口，可以显示在显示设备的同一个显示器上，也可以显示在不同的多个显示器上。例如，显示设备可以是双屏智能点电视，即可以包括第一显示器和第二显示器。其中，第一显示器为主屏幕可以显示具体的用户界面，第二显示器为副屏幕可以显示特定的界面。在进入多窗口模式后，显示设备可以控制分别在第一显示器和第二显示器中分别显示不同的窗口，从而同时输出具体的显示画面内容。对于将多个窗口显示在不同的显示器中的情况，显示设备同样可以通过运行上述多窗口音量调整方法完成对显示设备200的音量进行调整，提高用户体验。It should be noted that the multiple windows in the multi-window mode described in the embodiment of the present application can be displayed on the same display of the display device, or on different multiple displays. For example, the display device can be a dual-screen smart point TV, that is, it can include a first display and a second display. Among them, the first display is the main screen that can display a specific user interface, and the second display is the sub-screen that can display a specific interface. After entering the multi-window mode, the display device can control the display of different windows in the first display and the second display, respectively, so as to output specific display screen content at the same time. For the case where multiple windows are displayed in different displays, the display device can also adjust the volume of the display device 200 by running the above-mentioned multi-window volume adjustment method to improve the user experience.
本申请实施例还提供一种音频输出方法，应用于显示设备，如图15所示，该方法包括：The embodiment of the present application also provides an audio output method, which is applied to a display device. As shown in FIG15 , the method includes:
步骤1501、响应于用户输入的指示显示多个窗口的显示指令，控制显示器显示多个窗口；Step 1501, in response to a display instruction input by a user indicating to display multiple windows, controlling a display to display multiple windows;
步骤1502、检测用户控制的焦点位于的焦点窗口；Step 1502: Detect the focus window where the focus controlled by the user is located;
步骤1503、响应于用户输入的指示切换所述焦点窗口对应的音频设备的切换指令，对所述焦点窗口对应的音频设备进行切换，并调整其余窗口对应的音频设备，以使每个窗口使用不同的音频设备。Step 1503: In response to a switching instruction input by the user indicating to switch the audio device corresponding to the focus window, the audio device corresponding to the focus window is switched, and the audio devices corresponding to the remaining windows are adjusted so that each window uses a different audio device.
本说明书中各个实施例之间相同相似的部分互相参照即可，在此不再赘述。The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例或者实施例的某些部分的方法。Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM/RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.
最后应说明的是：以上各实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述各实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110481435.2ACN114302070B (en) | 2021-04-30 | 2021-04-30 | Display device and audio output method |
| PCT/CN2022/090563WO2022228573A1 (en) | 2021-04-30 | 2022-04-29 | Display device and method for outputting audio |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110481435.2ACN114302070B (en) | 2021-04-30 | 2021-04-30 | Display device and audio output method |
| Publication Number | Publication Date |
|---|---|
| CN114302070A CN114302070A (en) | 2022-04-08 |
| CN114302070Btrue CN114302070B (en) | 2024-11-08 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110481435.2AActiveCN114302070B (en) | 2021-04-30 | 2021-04-30 | Display device and audio output method |
| Country | Link |
|---|---|
| CN (1) | CN114302070B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022228573A1 (en)* | 2021-04-30 | 2022-11-03 | 海信视像科技股份有限公司 | Display device and method for outputting audio |
| CN116056058A (en)* | 2023-01-16 | 2023-05-02 | 深圳感臻智能股份有限公司 | Audio control method, device, computer equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677727A (en)* | 2013-12-05 | 2014-03-26 | 深圳市中兴移动通信有限公司 | Mobile terminal and audio control method |
| CN107147929A (en)* | 2017-06-22 | 2017-09-08 | 深圳Tcl数字技术有限公司 | Multiwindow method of outputting acoustic sound, television set and computer-readable recording medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160060846A (en)* | 2014-11-20 | 2016-05-31 | 삼성전자주식회사 | A display apparatus and a display method |
| CN106201421A (en)* | 2016-06-28 | 2016-12-07 | 维沃移动通信有限公司 | A kind of terminal and audio-frequency processing method |
| CN112188279A (en)* | 2020-09-30 | 2021-01-05 | 青岛海信传媒网络技术有限公司 | Channel switching method and display equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677727A (en)* | 2013-12-05 | 2014-03-26 | 深圳市中兴移动通信有限公司 | Mobile terminal and audio control method |
| CN107147929A (en)* | 2017-06-22 | 2017-09-08 | 深圳Tcl数字技术有限公司 | Multiwindow method of outputting acoustic sound, television set and computer-readable recording medium |
| Publication number | Publication date |
|---|---|
| CN114302070A (en) | 2022-04-08 |
| Publication | Publication Date | Title |
|---|---|---|
| CN114302194A (en) | Display device and playing method during switching of multiple devices | |
| CN111343489B (en) | A display device and a method for playing music in a terminal | |
| CN112612443B (en) | Audio playing method, display device and server | |
| CN112272417B (en) | double-Bluetooth sound box reconnection method and display device | |
| CN114302021B (en) | Display device and audio-visual synchronization method | |
| WO2022073392A1 (en) | Picture display method, and display device | |
| CN114079819B (en) | Content display method and display device | |
| CN114296664B (en) | A method for adjusting brightness of a secondary screen and a display device | |
| CN113766164B (en) | Display device and signal source interface display method | |
| WO2022048203A1 (en) | Display method and display device for manipulation prompt information of input method control | |
| CN114302201B (en) | A method for automatically switching screens in speaker mode, an intelligent terminal, and a display device | |
| CN113064691B (en) | Display method and display equipment for starting user interface | |
| WO2021121051A1 (en) | Display method and display device | |
| CN114302070B (en) | Display device and audio output method | |
| CN113490024A (en) | Control device key setting method and display equipment | |
| CN115884061A (en) | A display device, external device and audio output method | |
| CN113495711B (en) | Display apparatus and display method | |
| CN111954059A (en) | Screen saver display method and display device | |
| CN112399217B (en) | Display device and method for establishing communication connection with power amplifier device | |
| WO2022078065A1 (en) | Display device resource playing method and display device | |
| CN112637957A (en) | Display device and communication method of display device and wireless sound box | |
| CN114007119A (en) | Video playing method and display equipment | |
| CN115407911A (en) | Display device and external audio device | |
| CN111818654A (en) | Channel access method and display device | |
| CN114302203B (en) | Image display method and display device |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |