Movatterモバイル変換


[0]ホーム

URL:


CN110517470B - Remote control method, equipment and system - Google Patents

Remote control method, equipment and system
Download PDF

Info

Publication number
CN110517470B
CN110517470BCN201910631841.5ACN201910631841ACN110517470BCN 110517470 BCN110517470 BCN 110517470BCN 201910631841 ACN201910631841 ACN 201910631841ACN 110517470 BCN110517470 BCN 110517470B
Authority
CN
China
Prior art keywords
control
control device
display screen
frequency microwave
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910631841.5A
Other languages
Chinese (zh)
Other versions
CN110517470A (en
Inventor
刘野
张科
刘鹏举
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co LtdfiledCriticalHuawei Technologies Co Ltd
Priority to CN201910631841.5ApriorityCriticalpatent/CN110517470B/en
Publication of CN110517470ApublicationCriticalpatent/CN110517470A/en
Application grantedgrantedCritical
Publication of CN110517470BpublicationCriticalpatent/CN110517470B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本申请实施例公开了一种远程控制方法、设备和系统,涉及电子设备领域,解决了远程控制精度较低,无法快速准确地控制显示设备显示屏内的光标移动到用户想要操作内容的对应位置的问题。具体方案为:控制设备接收用户的操作,响应该操作,向显示设备发射高频微波信号;显示设备通过显示屏设置的天线阵列接收高频微波信号,根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置,这样,响应上述操作,可对显示屏显示的第一界面上控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面。

Figure 201910631841

Embodiments of the present application disclose a remote control method, device, and system, which relate to the field of electronic devices, and solve the problem that the remote control precision is low, and it is impossible to quickly and accurately control the cursor in the display screen of the display device to move to the corresponding content of the user's desired operation. problem of location. The specific scheme is: the control device receives the user's operation, and in response to the operation, transmits a high-frequency microwave signal to the display device; the display device receives the high-frequency microwave signal through the antenna array set on the display screen, and according to the irradiation of the high-frequency microwave signal in the antenna array In this way, in response to the above operation, a corresponding event can be executed for the control on the first interface displayed by the display screen at the position where the control device points to the display screen, and the second interface can be displayed.

Figure 201910631841

Description

Translated fromChinese
一种远程控制方法、设备和系统A remote control method, device and system

技术领域technical field

本申请涉及电子设备领域,尤其涉及一种远程控制方法、设备和系统。The present application relates to the field of electronic devices, and in particular, to a remote control method, device and system.

背景技术Background technique

大屏显示设备已经普遍应用于显示场景,如大屏电视、商用大屏显示以及显示投影等。且人们对显示设备的操控要求也越来越高。例如,可以利用触控屏技术,直接对显示设备显示屏上显示的内容进行操控。具体的,可以在显示设备的显示屏中内置行列垂直的透明线路形成电阻-电容电路(resistor-capacitance circuit,RC电路),通过向透明线路形成的RC电路输入信号,可输出参考波形。当用户触摸显示屏时,人体与透明线路形成的RC电路形成并联电容,会引起参考波形的变化。显示设备根据参考波形的变化可计算用户触摸的位置以及操作的内容,并以此进行响应,从而实现用户对显示设备的操控。这种控制方法虽具有较高的精度,但无法实现远距离操控。Large-screen display devices have been widely used in display scenarios, such as large-screen TVs, commercial large-screen displays, and display projections. And people's control requirements for display devices are getting higher and higher. For example, the content displayed on the display screen of the display device can be directly controlled by using the touch screen technology. Specifically, a resistor-capacitance circuit (RC circuit) can be built in the display screen of the display device with vertical rows and columns of transparent lines, and a reference waveform can be output by inputting a signal to the RC circuit formed by the transparent lines. When the user touches the display screen, the RC circuit formed by the human body and the transparent line forms a parallel capacitance, which will cause the reference waveform to change. The display device can calculate the position touched by the user and the content of the operation according to the change of the reference waveform, and respond accordingly, so as to realize the user's manipulation of the display device. Although this control method has high precision, it cannot realize long-distance control.

为了实现对显示设备的远程控制,可以通过遥控控制的方法实现。例如,通过空中鼠标(简称空鼠)可实现对显示设备的远距离操控。具体的,空鼠可根据用户的操作,利用内置的重力传感器、加速度传感器或触摸板收集用户控制空鼠运动的轨迹和方向。然后,空鼠根据该轨迹和方向可计算出显示设备上光标需移动的方向和距离。空鼠还可收集用户对空鼠上按键的操作。空鼠通过蓝牙或者红外线将计算出的显示设备上光标需移动的方向和距离,以及用户对空鼠上按键的操作传输给显示设备。显示设备根据接收到信息便可进行相应响应。但是,这种远程控制精度较低,无法快速准确地控制显示设备显示屏内的光标移动到用户想要操作内容的对应位置。In order to realize the remote control of the display device, it can be realized by the method of remote control. For example, the remote control of the display device can be realized through an air mouse (referred to as an air mouse). Specifically, according to the user's operation, the air mouse can use the built-in gravity sensor, acceleration sensor or touchpad to collect the trajectory and direction of the user's control of the air mouse movement. Then, the air mouse can calculate the direction and distance that the cursor on the display device needs to move according to the trajectory and direction. The air mouse can also collect user operations on the keys on the air mouse. The air mouse transmits the calculated direction and distance of the cursor on the display device to be moved and the user's operation of the keys on the air mouse to the display device through Bluetooth or infrared. The display device can respond accordingly according to the received information. However, this kind of remote control has low precision, and cannot quickly and accurately control the cursor in the display screen of the display device to move to the corresponding position of the content that the user wants to operate.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供一种远程控制方法、设备和系统,解决了远程控制精度较低,无法快速准确地控制显示设备显示屏内的光标移动到用户想要操作内容的对应位置的问题。The embodiments of the present application provide a remote control method, device and system, which solve the problem of low remote control precision and inability to quickly and accurately control the cursor in the display screen of the display device to move to the corresponding position of the user's desired operation content.

本申请实施例的第一方面,提供一种远程控制方法,该方法可以应用于远程控制系统,该远程控制系统包括控制设备和显示设备。其中,显示设备包括设置有天线阵列的显示屏,显示屏上显示有第一界面。该方法可以包括:控制设备接收用户的操作;控制设备响应操作,向显示设备发射高频微波信号;显示设备通过天线阵列接收高频微波信号;显示设备根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置;显示设备响应操作,对第一界面上控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面。A first aspect of the embodiments of the present application provides a remote control method, which can be applied to a remote control system, where the remote control system includes a control device and a display device. The display device includes a display screen provided with an antenna array, and a first interface is displayed on the display screen. The method may include: controlling the device to receive the user's operation; controlling the device to transmit a high-frequency microwave signal to the display device in response to the operation; the display device receiving the high-frequency microwave signal through the antenna array; the display device according to the irradiation of the high-frequency microwave signal in the antenna array area, and determine the position where the control device points to the display screen; the display device responds to the operation, executes a corresponding event on the control at the position where the control device points to the display screen on the first interface, and displays the second interface.

这样,用户在想要对显示设备进行远程控制时,通过控制设备向显示设备发射高频微波信号,显示设备通过天线阵列接收该高频微波信号,并根据该高频微波信号确定用户想要控制的位置以及用户想要进行的操作,以便显示设备进行响应。由于该方法中的高频微波信号具有快速准确的特性,而显示设备也可以实时的通过高频微波信号知晓用户指向的位置以及想要实现的操作,因此该方法在实现了用户对显示设备远程控制的同时,也提高了控制的准确性。In this way, when the user wants to remotely control the display device, the control device transmits a high-frequency microwave signal to the display device, and the display device receives the high-frequency microwave signal through the antenna array, and determines according to the high-frequency microwave signal that the user wants to control the display device. location and what the user wants to do in order for the display device to respond. Because the high-frequency microwave signal in this method is fast and accurate, and the display device can also know the position pointed by the user and the desired operation through the high-frequency microwave signal in real time, this method can realize the remote control of the display device by the user. At the same time of control, the accuracy of control is also improved.

结合第一方面,在一种可能的实现方式中,天线阵列包括多个阵列单元;在显示设备根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置之前,该方法还包括:显示设备根据高频微波信号从天线阵列中确定多个第一阵列单元,第一阵列单元是天线阵列中电气参数发生改变的阵列单元;显示设备根据多个第一阵列单元在天线阵列中的位置,确定照射区域。这样,显示设备根据接收到的高频微波信号,就能够准确的确定出用户所指向显示屏的照射区域。With reference to the first aspect, in a possible implementation manner, the antenna array includes a plurality of array units; before the display device determines the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, the method It also includes: the display device determines a plurality of first array units from the antenna array according to the high-frequency microwave signal, and the first array unit is an array unit whose electrical parameters are changed in the antenna array; in the position to determine the irradiation area. In this way, the display device can accurately determine the irradiation area of the display screen pointed by the user according to the received high-frequency microwave signal.

结合第一方面和上述可能的实现方式,在另一种可能的实现方式中,显示设备根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置,包括:显示设备确定照射区域的几何中心,根据照射区域的几何中心确定出控制设备指向显示屏的位置;或,显示设备根据多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将多个第一阵列单元划分为至少两个阵列单元组;针对至少两个阵列单元组中每个阵列单元组,确定阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与至少两个阵列单元组一一对应的几何中心;根据与至少两个阵列单元组一一对应的几何中心,确定控制设备指向显示屏的位置。这样,在确定出照射区域之后,显示设备就能够确定用户指向显示屏的具体位置。In combination with the first aspect and the above possible implementation manners, in another possible implementation manner, the display device determines the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, including: the display device determines The geometric center of the irradiated area determines the position where the control device points to the display screen according to the geometric center of the irradiated area; The first array unit is divided into at least two array unit groups; for each array unit group in the at least two array unit groups, determine the geometric center of the area formed by all the first array units in the array unit group, and obtain a The geometric centers corresponding to the unit groups one-to-one; according to the geometric centers corresponding to the at least two array unit groups one-to-one, determine the position where the control device points to the display screen. In this way, after determining the irradiation area, the display device can determine the specific position where the user points to the display screen.

结合第一方面和上述可能的实现方式,在另一种可能的实现方式中,在控制设备接收用户的操作之后,方法还包括:控制设备确定操作的操作类型,操作类型为:单击,双击,拖拽或长按;控制设备根据操作的操作类型生成控制信号;控制设备响应操作,发射高频微波信号,包括;控制设备根据控制信号发射控制信号对应的高频微波信号,不同操作类型对应的控制信号不同,不同控制信号对应的高频微波信号不同。这样,控制设备可以根据用户输入操作的不同类型,向显示设备发射不同的高频微波信号,以实现用户对显示设备的多种不同类型的远程控制。In combination with the first aspect and the above possible implementation manner, in another possible implementation manner, after the control device receives the user's operation, the method further includes: the control device determines the operation type of the operation, and the operation type is: single-click, double-click , drag or long press; the control device generates a control signal according to the operation type of the operation; the control device responds to the operation and transmits high-frequency microwave signals, including; the control device transmits high-frequency microwave signals corresponding to the control signal according to the control signal, and different operation types correspond to The control signals of different control signals are different, and the high-frequency microwave signals corresponding to different control signals are different. In this way, the control device can transmit different high-frequency microwave signals to the display device according to different types of user input operations, so as to realize various types of remote control of the display device by the user.

结合第一方面和上述可能的实现方式,在另一种可能的实现方式中,显示设备根据高频微波信号确定操作类型;显示设备响应操作,对第一界面上控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面,包括:显示设备根据操作类型,响应操作,对控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面。这样,显示设备就能够根据不同的高频微波信号确定用户想要进行的操作,并对用户指向位置处的控件执行对应事件并显示执行之后的界面。以此实现了显示设备对用户操作的响应。In combination with the first aspect and the above possible implementation manner, in another possible implementation manner, the display device determines the operation type according to the high-frequency microwave signal; The control executes the corresponding event to display the second interface, including: the display device responds to the operation according to the operation type, executes the corresponding event on the control at the position where the control device points to the display screen, and displays the second interface. In this way, the display device can determine the operation that the user wants to perform according to different high-frequency microwave signals, execute the corresponding event on the control at the position pointed by the user, and display the interface after the execution. In this way, the response of the display device to the user operation is realized.

结合第一方面和上述可能的实现方式,在另一种可能的实现方式中,显示设备根据控制设备指向显示屏的位置在第一界面显示光标。这样,显示设备就可以向用户直观的示出用户通过遥控设备指向显示屏的位置。In combination with the first aspect and the above possible implementation manner, in another possible implementation manner, the display device displays a cursor on the first interface according to the position where the control device points to the display screen. In this way, the display device can intuitively show the user where the user points to the display screen through the remote control device.

结合第一方面和上述可能的实现方式,在另一种可能的实现方式中,高频微波信号的工作频率为30GHz-3000GHz。这样,高频微波信号就具备了延迟小、波束窄、功耗小的特点,更加有利于用户对显示设备的准确的远程控制。In combination with the first aspect and the above possible implementation manner, in another possible implementation manner, the operating frequency of the high-frequency microwave signal is 30 GHz-3000 GHz. In this way, the high-frequency microwave signal has the characteristics of small delay, narrow beam, and low power consumption, which is more conducive to the user's accurate remote control of the display device.

本申请实施例的第二方面,提供一种控制设备,该设备可以应用于远程控制系统,该远程控制系统还可以包括显示设备,显示设备包括设置有天线阵列的显示屏;控制设备包括:至少一个输入模块,处理器,振荡器和发射天线;处理器用于根据用户对至少一个输入模块的操作,确定控制标识,并传输给振荡器;振荡器用于根据控制标识,生成控制信号,并传输给发射天线;发射天线用于根据控制信号,发射高频微波信号,以便显示设备通过天线阵列接收高频微波信号。A second aspect of the embodiments of the present application provides a control device, which can be applied to a remote control system, and the remote control system may further include a display device, where the display device includes a display screen provided with an antenna array; the control device includes: at least an input module, a processor, an oscillator and a transmitting antenna; the processor is used for determining a control identification according to the user's operation on at least one input module, and transmitting it to the oscillator; the oscillator is used for generating a control signal according to the control identification, and transmitting To the transmitting antenna; the transmitting antenna is used to transmit high-frequency microwave signals according to the control signal, so that the display device can receive the high-frequency microwave signals through the antenna array.

结合第二方面和上述可能的实现方式,在一种可能的实现方式中,处理器用于根据用户对至少一个输入模块的操作,确定控制标识,包括:处理器用于根据用户对至少一个输入模块的操作,确定操作的操作类型,根据操作的操作类型确定控制标识,操作类型为:单击,双击,拖拽或长按;发射天线用于根据控制信号,发射高频微波信号,包括:发射天线用于根据控制信号发射控制信号对应的高频微波信号,不同操作类型对应的控制标识不同,不同控制标识对应的控制信号不同,不同控制信号对应的高频微波信号不同。With reference to the second aspect and the above possible implementation manner, in a possible implementation manner, the processor is configured to determine the control identifier according to the user's operation on the at least one input module, including: the processor is configured to determine the control identifier according to the user's operation on the at least one input module. Operation, determine the operation type of the operation, and determine the control mark according to the operation type of the operation. The operation type is: click, double-click, drag or long press; the transmitting antenna is used to transmit high-frequency microwave signals according to the control signal, including: transmitting antenna It is used to transmit the high-frequency microwave signal corresponding to the control signal according to the control signal. The control marks corresponding to different operation types are different, the control signals corresponding to different control marks are different, and the high-frequency microwave signals corresponding to different control signals are different.

结合第二方面和上述可能的实现方式,在另一种可能的实现方式中,控制设备还包括:设置在振荡器和发射天线之间的滤波器和功率放大器;滤波器用于对控制信号进行滤波,以使得控制信号工作在预设的工作频段;放大器用于对滤波器滤波后的控制信号进行放大,并将放大后的控制信号传输给发射天线。In combination with the second aspect and the above possible implementation manner, in another possible implementation manner, the control device further includes: a filter and a power amplifier arranged between the oscillator and the transmitting antenna; the filter is used to filter the control signal , so that the control signal works in a preset working frequency band; the amplifier is used to amplify the control signal filtered by the filter, and transmit the amplified control signal to the transmitting antenna.

结合第二方面和上述可能的实现方式,在另一种可能的实现方式中,高频微波信号的工作频率为30GHz-3000GHz。In combination with the second aspect and the above possible implementation manner, in another possible implementation manner, the operating frequency of the high-frequency microwave signal is 30GHz-3000GHz.

本申请实施例的第三方面,提供一种显示设备,该设备可以应用于远程控制系统,远程控制系统还包括控制设备,控制设备能够根据用户的操作向显示设备发射高频微波信号;显示设备包括:显示屏以及处理器,其中,显示屏设置有天线阵列,显示屏上显示有第一界面;显示屏用于通过天线阵列接收控制设备发射的高频微波信号;处理器用于根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置;响应操作,对第一界面上控制设备指向显示屏对应位置处的控件执行对应事件;显示屏还用于显示第二界面,第二界面是响应操作,对第一界面上控制设备指向显示屏的位置处的控件执行对应事件后的界面。A third aspect of the embodiments of the present application provides a display device, which can be applied to a remote control system, where the remote control system further includes a control device, which can transmit high-frequency microwave signals to the display device according to a user's operation; the display device It includes: a display screen and a processor, wherein the display screen is provided with an antenna array, and a first interface is displayed on the display screen; the display screen is used for receiving high-frequency microwave signals emitted by the control device through the antenna array; The irradiation area of the signal in the antenna array determines the position where the control device points to the display screen; in response to the operation, a corresponding event is executed for the control on the first interface where the control device points to the corresponding position of the display screen; the display screen is also used to display the second interface, The second interface is an interface after a corresponding event is performed on the control on the first interface at the position where the control device points to the display screen in response to the operation.

结合第三方面和上述可能的实现方式,在一种可能的实现方式中,天线阵列包括多个阵列单元;处理器还用于根据高频微波信号从天线阵列中确定多个第一阵列单元,第一阵列单元是天线阵列中电气参数发生改变的阵列单元;根据多个第一阵列单元在天线阵列中的位置,确定照射区域。With reference to the third aspect and the above possible implementation manner, in a possible implementation manner, the antenna array includes a plurality of array units; the processor is further configured to determine a plurality of first array units from the antenna array according to the high-frequency microwave signal, The first array unit is an array unit whose electrical parameters are changed in the antenna array; the irradiation area is determined according to the positions of the plurality of first array units in the antenna array.

结合第三方面和上述可能的实现方式,在另一种可能的实现方式中,处理器用于根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置,包括:处理器用于确定照射区域的几何中心,根据照射区域的几何中心确定出控制设备指向显示屏的位置;或,处理器用于根据多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将多个第一阵列单元划分为至少两个阵列单元组;针对至少两个阵列单元组中每个阵列单元组,确定阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与至少两个阵列单元组一一对应的几何中心;根据与至少两个阵列单元组一一对应的几何中心,确定控制设备指向显示屏的位置。In combination with the third aspect and the above possible implementation manner, in another possible implementation manner, the processor is used to determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, including: for determining the geometric center of the irradiation area, and determining the position where the control device points to the display screen according to the geometric center of the irradiation area; Divide the plurality of first array units into at least two array unit groups; for each array unit group in the at least two array unit groups, determine the geometric center of the area formed by all the first array units in the array unit group, and obtain at least The one-to-one geometric center of the two array unit groups; the position where the control device points to the display screen is determined according to the one-to-one correspondence with the at least two array unit groups.

结合第三方面和上述可能的实现方式,在另一种可能的实现方式中,处理器还用于根据高频微波信号确定操作的操作类型;操作类型为:单击,双击,拖拽或长按;处理器响应操作,对第一界面上控制设备指向显示屏的位置对应位置处的控件执行对应事件,包括:处理器根据操作类型,响应操作,对第一界面上控制设备指向显示屏的位置对应位置处的控件执行对应事件。In combination with the third aspect and the above possible implementation manner, in another possible implementation manner, the processor is further configured to determine the operation type of the operation according to the high-frequency microwave signal; the operation type is: click, double-click, drag or long Press; the processor responds to the operation and executes a corresponding event on the control at the position corresponding to the position where the control device points to the display screen on the first interface, including: the processor responds to the operation according to the operation type, and responds to the control device on the first interface that points to the display screen. The control at the position corresponding to the position executes the corresponding event.

结合第三方面和上述可能的实现方式,在另一种可能的实现方式中,显示屏还用于根据处理器确定的控制设备指向显示屏的位置,在第一界面显示光标。In combination with the third aspect and the above possible implementation manner, in another possible implementation manner, the display screen is further configured to display a cursor on the first interface according to the position where the control device points to the display screen determined by the processor.

结合第三方面和上述可能的实现方式,在另一种可能的实现方式中,天线阵列由光透明材质或不透明细金属线制成。In combination with the third aspect and the above possible implementation manner, in another possible implementation manner, the antenna array is made of a light-transparent material or an opaque thin metal wire.

本申请实施例的第四方面,提供一种远程控制系统,该系统可以包括:控制设备,及包含设置有天线阵列的显示屏的显示设备;其中,控制设备用于接收用户的操作,响应操作,发射高频微波信号;显示设备用于通过天线阵列接收高频微波信号,根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置,响应操作,对显示屏上当前显示的第一界面上控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面。A fourth aspect of the embodiments of the present application provides a remote control system, which may include: a control device, and a display device including a display screen provided with an antenna array; wherein the control device is configured to receive an operation from a user and respond to the operation , transmits high-frequency microwave signals; the display device is used to receive high-frequency microwave signals through the antenna array, and according to the irradiation area of the high-frequency microwave signal in the antenna array, determine the position where the control device points to the display screen, and respond to the operation. The control on the displayed first interface at the position where the control device points to the display screen executes the corresponding event, and displays the second interface.

第五方面,本申请实施例提供一种计算机可读存储介质,包括:计算机软件指令;当计算机软件指令在控制设备中运行时,使得过控制设备执行如第一方面或第一方面的可能的实现方式中任一所述的远程控制方法中的控制设备侧方法。In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, including: computer software instructions; when the computer software instructions are executed in the control device, the control device enables the control device to perform the first aspect or the possibility of the first aspect The control device side method in any of the remote control methods described in the implementation manner.

第六方面,本申请实施例提供一种计算机可读存储介质,包括:计算机软件指令;当计算机软件指令在显示设备中运行时,使得过控制设备执行如第一方面或第一方面的可能的实现方式中任一所述的远程控制方法中的显示设备侧方法。In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising: computer software instructions; when the computer software instructions are executed in the display device, the over-control device can execute the first aspect or the possibility of the first aspect. A display device-side method in any of the remote control methods described in the implementation manner.

第七方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第一方面或第一方面的可能的实现方式中任一所述的远程控制方法,以实现控制设备的行为功能。In a seventh aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the remote control method described in any of the first aspect or possible implementations of the first aspect , to control the behavior of the device.

第八方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第一方面或第一方面的可能的实现方式中任一所述的远程控制方法,以实现显示设备的行为功能。In an eighth aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the remote control method described in any of the first aspect or possible implementations of the first aspect , in order to realize the behavior function of the display device.

可以理解地,上述提供的第二方面所述控制设备,上述提供的第三方面所述显示设备,上述提供的第四方面所述远程控制系统,上述提供的第五方面和第六方面所述的计算机可读存储介质,以及第七方面和第八方面所述的计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。It can be understood that the control device described in the second aspect provided above, the display device described in the third aspect provided above, the remote control system described in the fourth aspect provided above, and the fifth and sixth aspects provided above. The computer-readable storage medium, and the computer program products described in the seventh aspect and the eighth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the above provided. The beneficial effects in the corresponding method will not be repeated here.

附图说明Description of drawings

图1本申请实施例提供的一种远程控制系统的组成示意图;1 is a schematic diagram of the composition of a remote control system provided by an embodiment of the present application;

图2为本申请实施例提供的一种天线阵列的结构示意图;FIG. 2 is a schematic structural diagram of an antenna array according to an embodiment of the present application;

图3为本申请实施例提供的一种在触摸屏上蚀刻天线阵列的结构示意图;3 is a schematic structural diagram of etching an antenna array on a touch screen according to an embodiment of the present application;

图4为本申请实施例提供的一种远程控制方法的流程示意图;4 is a schematic flowchart of a remote control method provided by an embodiment of the present application;

图5为本申请实施例提供的一种操作类型与控制信号的对应关系示意图;5 is a schematic diagram of the correspondence between an operation type and a control signal provided by an embodiment of the present application;

图6为本申请实施例提供的一种确定用户想要操作位置的方法示意图;FIG. 6 is a schematic diagram of a method for determining a position that a user wants to operate according to an embodiment of the present application;

图7为本申请实施例提供的一种根据高频微波信号确定操作类型的方法示意图;7 is a schematic diagram of a method for determining an operation type according to a high-frequency microwave signal provided by an embodiment of the present application;

图8为本申请实施例提供的一种场景的应用示意图;FIG. 8 is an application schematic diagram of a scenario provided by an embodiment of the present application;

图9为本申请实施例提供的另一种场景的应用示意图;FIG. 9 is an application schematic diagram of another scenario provided by an embodiment of the present application;

图10为本申请实施例提供的另一种场景的应用示意图;FIG. 10 is an application schematic diagram of another scenario provided by an embodiment of the present application;

图11为本申请实施例提供的另一种场景的应用示意图;FIG. 11 is an application schematic diagram of another scenario provided by an embodiment of the present application;

图12为本申请实施例提供的控制设备的组成示意图;12 is a schematic diagram of the composition of a control device provided by an embodiment of the present application;

图13为本申请实施例提供的显示设备的组成示意图。FIG. 13 is a schematic diagram of the composition of a display device provided by an embodiment of the present application.

具体实施方式Detailed ways

本申请实施例提供一种远程控制方法,应用于远程控制系统。该远程控制系统可以包括控制设备和显示设备。其中,显示设备可以包括设置有天线阵列的显示屏。通过本申请实施例提供的方法,用户可以通过对控制设备进行操作,以触发控制设备发射高频微波信号。显示设备通过显示屏中设置的天线阵列可接收控制设备发射的高频微波信号,并根据该高频微波信号确定控制设备指向显示屏的位置,即可确定出用户通过控制设备想要操控显示设备上显示的哪部分内容。进而显示设备根据确定出的控制设备指向显示屏的位置,便可对用户的操作进行相应响应,以实现利用控制设备对显示设备进行操控的效果。在该方法中,显示设备根据显示屏中设置的天线阵列接收到的高频微波信号,可快速准确的确定出用户想要操控显示屏的具体位置,提高了远程控制的控制精度。The embodiment of the present application provides a remote control method, which is applied to a remote control system. The remote control system may include a control device and a display device. Wherein, the display device may include a display screen provided with an antenna array. With the method provided by the embodiment of the present application, the user can trigger the control device to emit a high-frequency microwave signal by operating the control device. The display device can receive the high-frequency microwave signal emitted by the control device through the antenna array set in the display screen, and determine the position where the control device points to the display screen according to the high-frequency microwave signal, and then it can be determined that the user wants to control the display device through the control device. which part of the content shown above. Further, the display device can respond to the user's operation according to the determined position where the control device points to the display screen, so as to realize the effect of using the control device to control the display device. In this method, the display device can quickly and accurately determine the specific position where the user wants to control the display screen according to the high-frequency microwave signal received by the antenna array set in the display screen, which improves the control precision of the remote control.

示例性的,本申请实施例中电气参数的显示设备可以是手机、平板电脑、桌面型、膝上型、手握计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personalcomputer,UMPC)、上网本,以及电视、商用显示、投影等包括显示屏的设备,且该显示屏中设置有天线阵列。本申请实施例对该设备的具体形态不作特殊限制。Exemplarily, the display device of the electrical parameters in the embodiment of the present application may be a mobile phone, a tablet computer, a desktop type, a laptop type, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, And television, commercial display, projection and other equipment including a display screen, and the display screen is provided with an antenna array. The specific form of the device is not particularly limited in this embodiment of the present application.

下面将结合附图对本申请实施例的实施方式进行详细描述。The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

请参考图1,为本申请实施例提供的一种远程控制系统的组成示意图。如图1所示,该远程控制系统可以包括控制设备100和显示设备110。该显示设备110可包括设置有天线阵列114的显示屏111。Please refer to FIG. 1 , which is a schematic diagram of the composition of a remote control system according to an embodiment of the present application. As shown in FIG. 1 , the remote control system may include acontrol device 100 and adisplay device 110 . Thedisplay device 110 may include adisplay screen 111 provided with an antenna array 114 .

示例性的,在本实施例中,在用户想要使用控制设备100对显示设备110进行远程操控时,可手握控制设备100对着显示设备110的显示屏111中想要操控的位置,对控制设备100进行操作。控制设备100在接收到该操作后,可发射出高频微波信号。这样,显示设备110通过显示屏111设置的天线阵列114可接收到该高频微波信号,并根据接收到的高频微波信号确定出用户想要操控的显示屏111的具体位置,并据此对用户的操作进行相应的响应,即实现了远程操控。Exemplarily, in this embodiment, when the user wants to use thecontrol device 100 to remotely control thedisplay device 110, the user can hold thecontrol device 100 to the desired position in thedisplay screen 111 of thedisplay device 110, Thecontrol device 100 operates. After receiving the operation, thecontrol device 100 can emit a high-frequency microwave signal. In this way, thedisplay device 110 can receive the high-frequency microwave signal through the antenna array 114 set on thedisplay screen 111 , and determine the specific position of thedisplay screen 111 that the user wants to control according to the received high-frequency microwave signal, and based on the received high-frequency microwave signal The user's operation responds accordingly, that is, the remote control is realized.

以下对控制设备100和显示设备110的具体结构进行举例说明。The specific structures of thecontrol device 100 and thedisplay device 110 are illustrated below with examples.

请继续参考图1,上述控制设备100可以包括:至少一个输入模块101,与至少一个输入模块101连接的处理器102,与处理器102连接的振荡器103,与振荡器103输出端连接的发射天线106。该控制设备100还包括通信线路108,用于按照上述连接方式连接上述各模块,以实现各模块之间的通信。Please continue to refer to FIG. 1 , the above-mentionedcontrol device 100 may include: at least one input module 101 , a processor 102 connected to the at least one input module 101 , an oscillator 103 connected to the processor 102 , a transmitter connected to the output end of the oscillator 103 Antenna 106 . Thecontrol device 100 further includes a communication line 108, which is used to connect the above-mentioned modules in the above-mentioned connection manner, so as to realize the communication between the various modules.

其中,至少一个输入模块101可以是至少一个物理键,也可以是至少一块触控板(touch pannel),当然也可以同时包括至少一个物理键和至少一个触控板。需要说明的是,图1中以一个输入模块进行示例性说明,而在实际产品中,输入模块101可以是一个,也可以是多个。本申请实施例在此不做限制。Wherein, at least one input module 101 may be at least one physical key or at least one touch panel, and of course may also include at least one physical key and at least one touch panel. It should be noted that, in FIG. 1 , one input module is used as an example for illustration, but in an actual product, there may be one input module 101 or multiple input modules. The embodiments of the present application are not limited herein.

示例性的,控制设备100可以通过至少一个输入模块101接收用户的操作,并将该操作传输给处理器102,以便处理器102根据该操作控制振荡器103生成控制信号。进而该控制信号就可以被发射天线106以高频微波信号的形式发射出去,以实现对显示设备110的远程控制。Exemplarily, thecontrol device 100 may receive a user's operation through at least one input module 101, and transmit the operation to the processor 102, so that the processor 102 controls the oscillator 103 to generate a control signal according to the operation. Then, the control signal can be transmitted by the transmitting antenna 106 in the form of a high-frequency microwave signal, so as to realize the remote control of thedisplay device 110 .

在本申请的另一些实施例中,控制设备100中还可以设置天线开关107。如图1所示,该天线开关107可以设置在发射天线106与振荡器103之间,同时与输入模块101相连。在这种场景下,控制设备100可以不包括处理器102。In other embodiments of the present application, anantenna switch 107 may also be provided in thecontrol device 100 . As shown in FIG. 1 , theantenna switch 107 can be arranged between the transmitting antenna 106 and the oscillator 103 and is connected to the input module 101 at the same time. In this scenario, thecontrol device 100 may not include the processor 102 .

示例性的,振荡器103可以不间断地生成基础控制信号,该基础控制信号可以通过天线开关107传输给发射天线106。控制设备100可以通过至少一个输入模块101接收用户的操作,并将该操作包括的通断信息和/或幅度信息发送给天线开关107,以便天线开关107根据该操作包括的通断信息和/或幅度信息对基础控制信号进行调整,发射天线106就可以将经过调整的控制信号以高频微波信号的形式发射出去,以实现对显示设备110的远程控制。Exemplarily, the oscillator 103 may continuously generate the base control signal, and the base control signal may be transmitted to the transmit antenna 106 through theantenna switch 107 . Thecontrol device 100 can receive the user's operation through at least one input module 101, and send the on-off information and/or amplitude information included in the operation to theantenna switch 107, so that theantenna switch 107 can perform the on-off information and/or the on-off information included in the operation according to the operation. The amplitude information adjusts the basic control signal, and the transmitting antenna 106 can transmit the adjusted control signal in the form of a high-frequency microwave signal, so as to realize the remote control of thedisplay device 110 .

需要说明的是,对于发射天线而言,所有馈入的信号都能够以电磁波的形式发射出去,但是只有当馈入的信号的强度与信噪比达到一定要求,同时该信号与接收端具有相同的工作频段时,该信号通过发射天线发射出去的电磁波才能够被接收端有效地接收。因此,本申请实施例提供的控制设备,为了保证上述与用户操作的操作类型对应的控制信号能够通过发射天线发射出去,并能够被接收端(如显示设备)有效的接收,可以在上述控制设备100中设置滤波器104和功率放大器105,以便保证该控制信号的信号强度与信噪比能够到被发射的要求,同时使得该控制信号具有与接收端相同的频段。It should be noted that for the transmitting antenna, all incoming signals can be transmitted in the form of electromagnetic waves, but only when the strength and signal-to-noise ratio of the incoming signal meet certain requirements, and the signal has the same characteristics as the receiving end. When the working frequency band of the signal is transmitted through the transmitting antenna, the electromagnetic wave emitted by the signal can be effectively received by the receiving end. Therefore, in the control device provided by the embodiment of the present application, in order to ensure that the above-mentioned control signal corresponding to the operation type operated by the user can be transmitted through the transmitting antenna and can be effectively received by the receiving end (such as a display device), the above-mentioned control device can be used. Afilter 104 and apower amplifier 105 are set in 100 to ensure that the signal strength and signal-to-noise ratio of the control signal can meet the requirements of being transmitted, and at the same time, the control signal has the same frequency band as the receiving end.

示例性的,如图1所示,进一步的,控制设备100还可以包括设置在振荡器103以及发射天线106之间的滤波器104和功率放大器105。Exemplarily, as shown in FIG. 1 , further, thecontrol device 100 may further include afilter 104 and apower amplifier 105 disposed between the oscillator 103 and the transmitting antenna 106 .

在本申请的一些实施例中,对于控制设备100包括处理器102,不包括天线开关107的情况。振荡器103可以将与用户输入的操作对应的控制信号传输给滤波器104进行滤波,使得该控制信号工作在预先设定的工作频段,同时对该控制信号进行调整,去除外界信号对于该控制信号的干扰(即提高该控制信号的信噪比)。经过滤波后的控制信号可以被发送给功率放大器105,经过功率放大器105放大后传输给发射天线106,使得该控制信号的信号强度得以提高。In some embodiments of the present application, thecontrol device 100 includes the processor 102 and does not include theantenna switch 107 . The oscillator 103 can transmit the control signal corresponding to the operation input by the user to thefilter 104 for filtering, so that the control signal works in the preset working frequency band, and at the same time, the control signal is adjusted to remove the external signal for the control signal. interference (that is, to improve the signal-to-noise ratio of the control signal). The filtered control signal can be sent to thepower amplifier 105, amplified by thepower amplifier 105 and then transmitted to the transmit antenna 106, so that the signal strength of the control signal can be improved.

在本申请的另一些实施例中,对于控制设备100不包括处理器102,包括天线开关107的情况。振荡器103不间断地生成基础控制信号,并在将该基础控制信号通过天线开关107传输给发射天线106之前,可以将该基础控制信号传输给滤波器104进行滤波,使得该基础控制信号工作在预先设定的工作频段,同时对该基础控制信号进行调整,去除外界信号对于该基础控制信号的干扰(即提高该基础控制信号的信噪比)。经过滤波后的基础控制信号可以被发送给功率放大器105,经过功率放大器105放大,使得该控制信号的信号强度得以提高。然后将经过滤波和放大的基础控制信号发送给天线开关107,以便天线开关107根据该操作包括的通断信息和/或幅度信息对基础控制信号进行调整,得到控制信号并传输给发射天线106进行发射。In other embodiments of the present application, thecontrol device 100 does not include the processor 102, including theantenna switch 107. The oscillator 103 continuously generates the basic control signal, and before transmitting the basic control signal to the transmit antenna 106 through theantenna switch 107, the basic control signal can be transmitted to thefilter 104 for filtering, so that the basic control signal works in the At the same time, the basic control signal is adjusted to remove the interference of the external signal on the basic control signal (ie, the signal-to-noise ratio of the basic control signal is improved). The filtered basic control signal can be sent to thepower amplifier 105 and amplified by thepower amplifier 105, so that the signal strength of the control signal can be improved. Then, the filtered and amplified basic control signal is sent to theantenna switch 107, so that theantenna switch 107 can adjust the basic control signal according to the on-off information and/or amplitude information included in the operation to obtain the control signal and transmit it to the transmit antenna 106 for further processing. emission.

当然在一些场景中下,如果振荡器103生成的控制信号或者基础控制信号能够被发射天线发射并被接收端(如显示设备110)有效的接收,那么,该控制设备100中也可以不包括滤波器104和功率放大器105,或者按照需求只包括滤波器104或功率放大器105中的一个器件。Of course, in some scenarios, if the control signal or basic control signal generated by the oscillator 103 can be transmitted by the transmitting antenna and effectively received by the receiving end (such as the display device 110 ), then thecontrol device 100 may not include filtering. Thefilter 104 and thepower amplifier 105, or only one of thefilter 104 or thepower amplifier 105 is included as required.

本申请实施例中,上述高频微波信号可以工作在30GHz-3000GHz的范围内。一般来说,控制设备100需要具有方便用户使用的特征,因此,其体积不能过大。而方向性较好的高频微波信号又需要较大的天线口径以及较多的天线阵列单元。因此在控制设备100的发射天线106的选取和设计过程中需要关注二者的平衡。In the embodiment of the present application, the above-mentioned high-frequency microwave signal can work in the range of 30GHz-3000GHz. Generally speaking, thecontrol device 100 needs to have features that are convenient for users to use, and therefore, its volume should not be too large. However, high-frequency microwave signals with better directivity require larger antenna apertures and more antenna array units. Therefore, in the selection and design process of the transmitting antenna 106 of thecontrol device 100, attention needs to be paid to the balance of the two.

示例性的,假设发射天线106采用微带天线阵列的形式实现60GHz的高频微波信号,如果需要在3.5m的工作距离下,能够在显示设备上产生小于30cm的照射区域。那么,通过仿真计算可得控制设备中的发射天线106需要具备以下特征:天线口径需要在85mm以上,同时天线阵列上具有至少由512个天线阵列单元。因此,在发射天线106的制备过程中,需要注意以下几点:由于需要至少512个天线阵列单元,需要考虑馈电的连接,较多的走线会引入较高的损耗;在限定照射区域的条件下,使用距离越远,需求的微波信号的波瓣宽度越窄,天线阵列单元和整体口径会越大。Exemplarily, it is assumed that the transmitting antenna 106 adopts the form of a microstrip antenna array to realize a high-frequency microwave signal of 60 GHz, and if a working distance of 3.5 m is required, an irradiation area of less than 30 cm can be generated on the display device. Then, it can be obtained through simulation calculation that the transmitting antenna 106 in the control device needs to have the following characteristics: the antenna aperture needs to be more than 85mm, and the antenna array has at least 512 antenna array elements. Therefore, in the preparation process of the transmitting antenna 106, the following points need to be paid attention to: since at least 512 antenna array units are required, the connection of the feeder needs to be considered, and more wires will introduce higher losses; Under certain conditions, the longer the operating distance, the narrower the required lobe width of the microwave signal, and the larger the antenna array unit and the overall aperture.

也就是说,能够满足本申请实施例中提出的控制设备100向显示设备110发送高频微波信号的发射天线106的设计均应在本申请的保护范围之内。该发射天线106的制备过程需要参考以上几点注意事项,在实际使用的过程中灵活选取。That is to say, the design of the transmitting antenna 106 that can meet the requirements of thecontrol device 100 to transmit the high-frequency microwave signal to thedisplay device 110 proposed in the embodiments of the present application should all fall within the protection scope of the present application. The preparation process of the transmitting antenna 106 needs to refer to the above points for attention, and can be selected flexibly in the actual use process.

继续参考图1,在一些实施例中,上述显示设备110还可以包括处理器112。Continuing to refer to FIG. 1 , in some embodiments, the above-describeddisplay device 110 may further include a processor 112 .

在一些实施例中,处理器112可以包括控制器116和坐标计算电路117。In some embodiments, the processor 112 may include acontroller 116 and a coordinatecalculation circuit 117 .

其中,控制器116,也可以称为主处理芯片。其可以是显示设备110的神经中枢和指挥中心。例如,控制器116可以根据天线阵列114接收到的高频微波信号确定与该高频微波信号对应的操作类型。坐标计算电路117可用于根据显示屏111通过其包括的天线阵列114接收到的高频微波信号,确定控制设备100指向的显示屏111的位置等。Thecontroller 116 may also be referred to as a main processing chip. It may be the nerve center and command center of thedisplay device 110 . For example, thecontroller 116 may determine the operation type corresponding to the high-frequency microwave signal received by the antenna array 114 according to the high-frequency microwave signal. The coordinatecalculation circuit 117 can be used to determine the position of thedisplay screen 111 to which thecontrol device 100 points according to the high-frequency microwave signal received by thedisplay screen 111 through the antenna array 114 included therein.

可以理解的是,坐标计算电路117的相关功能也可以由处理器112中的其他组成部分执行,如图1中所示的控制器116。当坐标计算电路117的功能由处理器112中的其他组成部分执行时,处理器112中也可以不包括坐标计算电路117。另外,该处理器112中还可以设置有滤波器和功率放大器,用于显示屏111传输给处理器112的信号进行滤波以及功率放大,可以根据实际使用场景进行灵活选择。It can be understood that the related functions of the coordinatecalculation circuit 117 may also be performed by other components in the processor 112, such as thecontroller 116 shown in FIG. 1 . When the functions of the coordinatecalculation circuit 117 are performed by other components in the processor 112 , the processor 112 may not include the coordinatecalculation circuit 117 . In addition, the processor 112 may also be provided with a filter and a power amplifier for filtering and power amplification of the signal transmitted from thedisplay screen 111 to the processor 112, which can be flexibly selected according to the actual usage scenario.

如图1所示,显示屏111还可以包括显示模组115。显示设备110可以通过处理器112控制显示模组115显示需要显示的信息,如显示界面。示例性的,显示模组115可以为液晶(Liquid Crystal Display,LCD)模组、发光二极管(Light Emitting Diode,LED)阵列、投影幕布或者墙壁等。As shown in FIG. 1 , thedisplay screen 111 may further include a display module 115 . Thedisplay device 110 can control the display module 115 through the processor 112 to display information to be displayed, such as a display interface. Exemplarily, the display module 115 may be a liquid crystal display (LCD) module, a light emitting diode (Light Emitting Diode, LED) array, a projection screen, a wall, or the like.

另外,显示屏111中还可以设置用于保护天线阵列114的透明盖板118,用于放置天线阵列114的基板119。其中,透明盖板118,天线阵列114,基板119以及显示模组115顺序放置。该显示设备110还可以包括通信线路117,用于按照上述连接方式连接上述各模块,以实现显示设备110中各模块之间的通信。需要说明的是,本申请实施例所提供的显示屏111中111也可以不包括透明盖板118或者基板119,而是通过其他的可以保护天线阵列114的组件或者能够用于放置天线阵列114的组件替代。In addition, a transparent cover plate 118 for protecting the antenna array 114 may also be provided in thedisplay screen 111 , and for placing the substrate 119 of the antenna array 114 . The transparent cover plate 118 , the antenna array 114 , the substrate 119 and the display module 115 are placed in sequence. Thedisplay device 110 may further include acommunication line 117 for connecting the above-mentioned modules in the above-mentioned connection manner, so as to realize the communication between the various modules in thedisplay device 110 . It should be noted that, thedisplay screen 111 provided in the embodiment of the present application may not include the transparent cover plate 118 or the substrate 119 , but use other components that can protect the antenna array 114 or can be used to place the antenna array 114 . Component substitution.

示例性的,显示设备110可以通过天线阵列114接收高频微波信号,以便处理器112根据该高频微波信号在天线阵列114中的照射区域,确定控制设备指向显示屏111的位置。这样显示设备110就能够准确的获取用户想要操作的显示屏中的位置。作为对用户操作的响应,处理器112可以对控制设备指向显示屏111的位置处的控件执行对应事件,并控制显示模组115显示对应界面。Exemplarily, thedisplay device 110 may receive a high-frequency microwave signal through the antenna array 114 , so that the processor 112 determines the position where the control device points to thedisplay screen 111 according to the irradiation area of the high-frequency microwave signal in the antenna array 114 . In this way, thedisplay device 110 can accurately acquire the position in the display screen that the user wants to operate. In response to the user's operation, the processor 112 may execute a corresponding event on the control at the position where the control device points to thedisplay screen 111 , and control the display module 115 to display the corresponding interface.

需要说明的是,天线阵列114可以由多个阵列单元113组成。其中,组成天线阵列114的阵列单元113可以是根据透明薄膜天线技术制成的光透明阵列单元,也可以是由不透明细金属线制成的阵列单元。例如,阵列单元可以由纳米银或铜线制成,以降低制造成本并提高显示模组115显示图像的亮度。在本申请的另一些实施例中,天线阵列114与显示模组115之间可以设置屏蔽层(当显示屏111设置有基板119时,该屏蔽层可以设置在基板119与显示模组115之间)。该屏蔽层可以减少显示模组115工作时对天线阵列114产生的干扰,避免由此导致的天线阵列114无法准确定位控制设备所指向的位置,由此提高定位精度。It should be noted that the antenna array 114 may be composed of multiple array units 113 . The array unit 113 constituting the antenna array 114 may be an optically transparent array unit made according to the transparent thin film antenna technology, or may be an array unit made of opaque thin metal wires. For example, the array unit may be made of nano-silver or copper wire, so as to reduce the manufacturing cost and improve the brightness of the image displayed by the display module 115 . In other embodiments of the present application, a shielding layer may be provided between the antenna array 114 and the display module 115 (when thedisplay screen 111 is provided with the substrate 119 , the shielding layer may be provided between the substrate 119 and the display module 115 ) ). The shielding layer can reduce the interference to the antenna array 114 when the display module 115 is working, and prevent the antenna array 114 from being unable to accurately locate the position pointed by the control device, thereby improving the positioning accuracy.

本申请实施例图2提供了一种天线阵列的结构示意图。如图2所示,天线阵列可以由多个阵列单元组成,此处以3*3排布的9个阵列单元为例进行说明。由于天线阵列需要接收高频微波信号,因此,天线阵列的工作频段需要与高频微波信号的工作频率相似或相同。根据高频微波信号的工作频率,可以确定该工作频率对应的工作波长,那么就可以根据该工作波长,确定天线阵列中阵列单元的大小。例如,假设工作波长为λ,那么阵列单元就可以是边长为λ/2的微带天线,相邻两个阵列单元的距离可以是λ/4。多个阵列单元的每个阵列单元都可以通过微带传输线将阵列单元接收到的信号的变化发送给显示设备中的包括坐标计算电路或者控制器的处理器。FIG. 2 in the embodiment of the present application provides a schematic structural diagram of an antenna array. As shown in FIG. 2 , the antenna array may be composed of multiple array units, and here, 9 array units arranged in 3*3 are used as an example for description. Since the antenna array needs to receive high-frequency microwave signals, the working frequency band of the antenna array needs to be similar or the same as the working frequency of the high-frequency microwave signal. According to the working frequency of the high-frequency microwave signal, the working wavelength corresponding to the working frequency can be determined, and then the size of the array unit in the antenna array can be determined according to the working wavelength. For example, assuming that the operating wavelength is λ, the array unit may be a microstrip antenna with a side length of λ/2, and the distance between two adjacent array units may be λ/4. Each of the array units of the plurality of array units can transmit the change of the signal received by the array unit to the processor including the coordinate calculation circuit or the controller in the display device through the microstrip transmission line.

需要说明的是,本申请实施例中提供的用于接收高频微波信号的天线阵列,可以是单独设置的。对于具有触摸功能的显示屏(如称为触摸屏)而言,也可以将天线阵列集成在现有的触摸屏上,以实现对于包括触摸屏的显示设备的远程控制。示例性的,以触摸屏为投射式电容屏为例,该触摸屏的组成如图3中的(a)所示。例如,该触摸屏可以由并排设置的两层由氧化铟锡(Indium tin oxide,ITO)构成的导电薄膜构成(如导电薄膜A和导电薄膜B),该两层导电薄膜互不相连。其中,导电薄膜A上设置有多个纵向连接的导电单元(如图3中的(a)示出的无填充的导电单元),导电薄膜B上设置有多个横向连接的导电单元(如图3中的(a)示出的网格填充的导电单元。其中,填充网格仅是为了区别导电薄膜A和导电薄膜B上的导电单元,并不代表导电单元的结构或产品形态)。检测信号输入端可以向导电薄膜A输入检测信号,导电薄膜B可以与导电薄膜A耦合,在两个薄膜的每个导电单元之间形成稳定的电容。当用户触摸到该触摸屏时,由于人体是带电的,触碰到触摸屏会引起对应位置的两层导电薄膜的导电单元之间的电容发生变化。通过检测信号输出端的信号,就能够确定电容发生变化的导电单元的位置,由此便可确定用户触碰触摸屏上的位置的坐标,以实现触摸控制。It should be noted that, the antenna array provided in the embodiments of the present application for receiving high-frequency microwave signals may be set independently. For a display screen with a touch function (such as a touch screen), the antenna array can also be integrated on the existing touch screen, so as to realize the remote control of the display device including the touch screen. Illustratively, taking the touch screen as a projected capacitive screen as an example, the composition of the touch screen is shown in (a) of FIG. 3 . For example, the touch screen may be composed of two layers of conductive films (eg, conductive film A and conductive film B) made of indium tin oxide (ITO) arranged side by side, and the two conductive films are not connected to each other. Wherein, the conductive film A is provided with a plurality of longitudinally connected conductive units (as shown in (a) in FIG. 3 ), and the conductive film B is provided with a plurality of laterally connected conductive units (as shown in FIG. 3 ). The grid-filled conductive unit shown in (a) in 3. The grid-filled conductive unit is only to distinguish the conductive unit on the conductive film A and the conductive film B, and does not represent the structure or product form of the conductive unit). The detection signal input terminal can input the detection signal to the conductive film A, and the conductive film B can be coupled with the conductive film A to form a stable capacitance between each conductive unit of the two films. When the user touches the touch screen, since the human body is charged, touching the touch screen will cause the capacitance between the conductive units of the two layers of conductive films at the corresponding position to change. By detecting the signal at the signal output end, the position of the conductive unit whose capacitance has changed can be determined, and thus the coordinates of the position where the user touches the touch screen can be determined to realize touch control.

在本申请实施例中,可以通过在该触摸屏上的导电薄膜(如包括导电薄膜A和导电薄膜B)上设置的每个导电单元上,蚀刻天线阵列,使得触摸屏也能接收控制设备发射的高频微波信号。例如,如图3中的(b)所示,为蚀刻了天线阵列后的导电单元的示意图。可以在导电单元上蚀刻天线阵列的阵列单元,阵列单元的的尺寸根据高频微波信号的工作波长进行调节。如假设工作波长为λ,那么阵列单元就可以是边长为λ/2的微带天线,相邻两个阵列单元的距离可以是λ/4。在保证阵列单元的尺寸以及间距的情况下,可以在导电单元上尽量多的蚀刻天线阵列的阵列单元,如图3中的(b)所示,可以在一个导电单元上蚀刻2*2共4个阵列单元。以此实现在触摸屏上的远程控制的同时,提高控制精度。In the embodiment of the present application, the antenna array can be etched on each conductive unit provided on the conductive film (for example, including the conductive film A and the conductive film B) on the touch screen, so that the touch screen can also receive the high voltage transmitted by the control device. frequency microwave signal. For example, as shown in (b) of FIG. 3 , it is a schematic diagram of the conductive unit after the antenna array is etched. The array unit of the antenna array can be etched on the conductive unit, and the size of the array unit is adjusted according to the working wavelength of the high-frequency microwave signal. Assuming that the working wavelength is λ, the array unit can be a microstrip antenna with a side length of λ/2, and the distance between two adjacent array units can be λ/4. Under the condition of ensuring the size and spacing of the array units, you can etch as many array units of the antenna array as possible on the conductive unit. As shown in (b) in Figure 3, you can etch 2*2 total 4 on one conductive unit. array unit. In this way, the remote control on the touch screen is realized, and the control accuracy is improved.

可以理解的是,以上说明仅仅是本申请实施例提供的天线阵列的一种设计方案,其他能够满足本申请实施例中提出的可以用于接收高频微波信号并将该高频微波信号产生的电气参数的变化发送给处理器的天线阵列的设计均应在本申请的保护范围之内。It can be understood that the above description is only a design solution of the antenna array provided by the embodiments of the present application, and other solutions can meet the requirements of the embodiments of the present application and can be used to receive high-frequency microwave signals and generate the high-frequency microwave signals. The design of the antenna array sent to the processor by changes in electrical parameters should all fall within the protection scope of this application.

另外,本实施例示意的显示设备110的结构并不构成对该设备的具体限定。在另一些实施例中,显示设备110可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。例如,显示设备110还可以包括以下模块中的一个或多个(图1中未示出):存储器,用于存储计算机可执行程序代码,该可执行程序代码包括指令。上述处理器112可通过运行存储在存储器的指令,从而执行显示设备110的各种功能应用以及数据处理。充电管理模块用于从充电器接收充电输入,还用于为显示设备110的部件供电。天线,移动通信模块,无线通信模块,调制解调处理器以及基带处理器等,用于实现无线通信功能。GPU(GraphicsProcessing Unit,图形处理器)以及应用处理器等,用于配合显示屏111实现显示功能。音频模块,扬声器,受话器,麦克风,耳机接口,以及应用处理器等用于实现音频功能。例如音乐播放,录音等。In addition, the structure of thedisplay device 110 illustrated in this embodiment does not constitute a specific limitation to the device. In other embodiments, thedisplay device 110 may include more or fewer components than shown, or some components may be combined, or some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, thedisplay device 110 may also include one or more of the following modules (not shown in FIG. 1 ): a memory for storing computer-executable program code, the executable program code including instructions. The above-mentioned processor 112 can execute various functional applications and data processing of thedisplay device 110 by executing the instructions stored in the memory. The charging management module is used to receive charging input from the charger and also to supply power to the components of thedisplay device 110 . Antennas, mobile communication modules, wireless communication modules, modem processors and baseband processors, etc., are used to implement wireless communication functions. A GPU (Graphics Processing Unit, graphics processor), an application processor, etc., are used to cooperate with thedisplay screen 111 to implement a display function. Audio modules, speakers, receivers, microphones, headphone jacks, and application processors are used to implement audio functions. Such as music playback, recording, etc.

本申请实施例提供的远程控制方法均可在上述远程控制系统中实现。以下对本申请实施例提供的远程控制方法进行详细说明。The remote control methods provided in the embodiments of the present application can all be implemented in the above-mentioned remote control system. The remote control method provided by the embodiments of the present application will be described in detail below.

图4为本申请实施例提供的一种远程控制方法的流程示意图。该方法可以应用于上述远程控制系统。如图4所示,该方法可以包括S401-S406。FIG. 4 is a schematic flowchart of a remote control method provided by an embodiment of the present application. The method can be applied to the above-mentioned remote control system. As shown in FIG. 4, the method may include S401-S406.

S401、控制设备接收用户的操作。S401. The control device receives the operation of the user.

当用户想要对显示设备进行远程控制时,可以手握控制设备,并对控制设备进行操作。When the user wants to remotely control the display device, the user can hold the control device and operate the control device.

示例性的,结合图1,控制设备100可以设置至少一个输入模块101,上述操作可以是用户对该至少一个输入模块101的操作。例如,上述输入模块101可以是物理键。上述操作可以是用户对该物理键的操作。又如,上述输入模块101可以是触控板。上述操作可以是用户在触控板上的操作。Exemplarily, with reference to FIG. 1 , thecontrol device 100 may be provided with at least one input module 101 , and the above-mentioned operation may be a user's operation on the at least one input module 101 . For example, the above-mentioned input module 101 may be a physical key. The above operation may be an operation of the physical key by the user. For another example, the above-mentioned input module 101 may be a touch panel. The above operations may be operations performed by the user on the touchpad.

在一些实施例中,可能只需通过控制设备实现对显示设备一种控制,如单击或双击。在该实施例中,控制设备100中可仅设置一个输入模块101,如一个物理键,用户通过对该物理键进行单击或双击操作,可实现对显示设备110的控制。In some embodiments, only one control of the display device, such as a single click or double click, may be achieved through the control device. In this embodiment, only one input module 101, such as a physical key, may be provided in thecontrol device 100, and the user can control thedisplay device 110 by clicking or double-clicking the physical key.

在其他一些实施例中,可能需通过控制设备实现对显示设备的多种控制,如单击,双击,拖拽(拖拽可以是指长按输入模块,并移动控制设备的操作),翻页及切屏等中的两种或两种以上的控制。对于不同的控制而言,用户执行操作的操作类型是不同的。如在本实施例中,该操作类型可以包括单击,双击,拖拽或长按中的一种。翻页及切屏的控制可通过单击或双击或拖拽实现。在该实施例中,控制设备100中可以包括一个或多个输入模块101。如控制设备100中可包括一个或多个物理键,或控制设备100中包括触控板,或控制设备100中包括一个或多个物理键及触摸板。用户通过对这一个或多个输入模块101进行不同的操作,可实现对显示设备110的不同控制。例如,控制设备100中包括一个物理键,用户可通过对该物理键进行单击操作,实现对显示设备的单击控制,通过对该物理键进行双击操作,实现对显示设备的双击控制。又如,控制设备100中包括两个物理键,分别为物理键1和物理键2,用户可通过对物理键1进行单击操作,实现对显示设备的单击控制,通过对物理键2的单击操作,实现对显示设备的双击控制。In some other embodiments, it may be necessary to implement various controls on the display device through the control device, such as clicking, double-clicking, dragging (draging may refer to long-pressing the input module and moving the control device), turning pages And two or more controls in the screen cut and so on. For different controls, the types of actions that the user performs are different. As in this embodiment, the operation type may include one of single click, double click, drag or long press. The control of page turning and screen cutting can be realized by clicking or double-clicking or dragging. In this embodiment, one or more input modules 101 may be included in thecontrol device 100 . For example, thecontrol device 100 may include one or more physical keys, or thecontrol device 100 may include a touchpad, or thecontrol device 100 may include one or more physical keys and a touchpad. The user can implement different controls on thedisplay device 110 by performing different operations on the one or more input modules 101 . For example, thecontrol device 100 includes a physical key, the user can click the physical key to realize the single-click control of the display device, and double-click the physical key to realize the double-click control of the display device. For another example, thecontrol device 100 includes two physical keys, namely physical key 1 andphysical key 2. The user can click the physical key 1 to realize the click control of the display device. Single-click operation to realize double-click control of the display device.

S402、控制设备响应用户的操作,向显示设备发射高频微波信号。S402, the control device transmits a high-frequency microwave signal to the display device in response to the user's operation.

对应于S401中的描述,在一些实施例中,对于只需通过控制设备实现对显示设备一种控制的场景。结合图1,控制设备100可以在通过物理键接收到用户的操作(如单击操作)之后,控制振荡器103生成控制信号,并发送给发射天线106进行发射。Corresponding to the description in S401, in some embodiments, only one control of the display device needs to be implemented through the control device. 1 , thecontrol device 100 may control the oscillator 103 to generate a control signal after receiving a user's operation (such as a single-click operation) through a physical key, and send the control signal to the transmit antenna 106 for transmission.

在其他一些实施例中,对于需通过控制设备实现对显示设备的多种控制的场景。为了能够让显示设备识别出用户的不同操作,控制设备在接收到用户的操作之后,可以根据用户的操作确定与之相对应的操作类型。并根据操作类型,生成与该操作类型对应的高频微波信号并发射。如,控制设备可根据操作类型,生成与该操作类型对应的控制信号,并将该控制信号以高频微波信号的形式发射出去。In some other embodiments, for scenarios where multiple controls on the display device need to be implemented through the control device. In order to enable the display device to recognize different operations of the user, after receiving the operation of the user, the control device may determine the operation type corresponding to the operation of the user according to the operation of the user. And according to the operation type, a high-frequency microwave signal corresponding to the operation type is generated and transmitted. For example, the control device can generate a control signal corresponding to the operation type according to the operation type, and transmit the control signal in the form of a high-frequency microwave signal.

示例性的,在本申请一些是实施例中,结合图1,输入模块101可以将接收到的用户的操作发送给处理器102,处理器102可以根据用户的操作确定与该操作对应的控制标识,并控制振荡器103生成与该控制标识对应的控制信号。这样振荡器103就可以将该控制信号传输给发射天线106,向显示设备110发射与该控制信号对应的高频微波信号。在本实施例中,不同操作类型对应的控制标识不同,不同控制标识可以对应不同的控制信号,而不同控制信号对应的高频微波信号也不同。其中,可以通过不同的通断间隔或信号强弱来区分不同种类的控制信号,用于与不同操作类型的用户操作进行对应。Exemplarily, in some embodiments of the present application, with reference to FIG. 1 , the input module 101 may send the received operation of the user to the processor 102, and the processor 102 may determine the control identifier corresponding to the operation according to the operation of the user. , and control the oscillator 103 to generate a control signal corresponding to the control flag. In this way, the oscillator 103 can transmit the control signal to the transmitting antenna 106 and transmit the high-frequency microwave signal corresponding to the control signal to thedisplay device 110 . In this embodiment, the control identifiers corresponding to different operation types are different, the different control identifiers may correspond to different control signals, and the high-frequency microwave signals corresponding to different control signals are also different. Among them, different types of control signals can be distinguished by different on-off intervals or signal strengths, so as to correspond to user operations of different operation types.

例如,请参考图5,为本申请实施例提供的一种不同操作类型与控制信号的对应关系示意图。如图5所示,控制标识1可对应控制信号1,或者说,该控制标识1是控制信号1的标识。该控制信号1可以是在一个周期T内,包括一个幅度为A的时钟信号。假设控制标识1对应的操作类型是单击,那么当控制设备接收到用户的单击操作后,控制设备就可以生成控制标识1所对应的控制信号1。For example, please refer to FIG. 5 , which is a schematic diagram of a corresponding relationship between different operation types and control signals according to an embodiment of the present application. As shown in FIG. 5 , the control identification 1 may correspond to the control signal 1 , or in other words, the control identification 1 is the identification of the control signal 1 . The control signal 1 may include a clock signal with an amplitude of A within a period T. Assuming that the operation type corresponding to the control identifier 1 is a single click, after the control device receives the user's single click operation, the control device can generate a control signal 1 corresponding to the control identifier 1 .

类似的,假设控制标识2对应的操作类型是双击。其中,控制标识2可对应控制信号2,或者说,该控制标识2是控制信号2的标识。该控制信号2可以是在一个周期T内,包括两个幅度为A的时钟信号,其中幅度为A的时钟信号出现的周期为T/2。那么当控制设备接收到用户的双击操作后,控制设备就可以生成控制标识2所对应的控制信号。Similarly, it is assumed that the operation type corresponding to controlmark 2 is double-click. Wherein, thecontrol identification 2 may correspond to thecontrol signal 2 , or in other words, thecontrol identification 2 is the identification of thecontrol signal 2 . Thecontrol signal 2 may include two clock signals with an amplitude of A in a period T, wherein the period in which the clock signal with an amplitude of A appears is T/2. Then, after the control device receives the user's double-click operation, the control device can generate a control signal corresponding to thecontrol identifier 2 .

假设控制标识3对应的操作类型是拖拽。其中,控制标识3可对应控制信号3,或者说,该控制标识3是控制信号3的标识。该控制信号3可以是在一个周期T内,包括一个幅度为A/2的时钟信号。那么当控制设备接收到用户的拖拽操作后,控制设备就可以生成控制信号3所对应的控制信号。It is assumed that the operation type corresponding to control identifier 3 is drag and drop. Wherein, the control identification 3 may correspond to the control signal 3 , or in other words, the control identification 3 is an identification of the control signal 3 . The control signal 3 may include a clock signal with an amplitude of A/2 within a period T. Then, after the control device receives the user's drag operation, the control device can generate a control signal corresponding to the control signal 3 .

假设控制标识4对应的操作类型是长按。其中,控制标识4可对应控制信号4,或者说,该控制标识4是控制信号4的标识。该控制信号4可以是在一个周期T内,包括两个幅度为A/2的时钟信号,其中每个幅度为A/2的时钟信号出现的周期为T/2。那么当控制设备接收到用户的长按操作后,控制设备就可以生成控制标识4所对应的控制信号。It is assumed that the operation type corresponding to control mark 4 is a long press. The control identification 4 may correspond to the control signal 4 , or in other words, the control identification 4 is an identification of the control signal 4 . The control signal 4 may include two clock signals with an amplitude of A/2 in a period T, wherein each clock signal with an amplitude of A/2 appears in a period of T/2. Then, after the control device receives the user's long-press operation, the control device can generate a control signal corresponding to the control identifier 4 .

依照上述方法示例,控制设备能够根据操作的操作类型,生成对应的控制信号,根据该控制信号就能够向显示设备发射对应的高频微波信号。According to the above method example, the control device can generate the corresponding control signal according to the operation type of the operation, and according to the control signal, the corresponding high-frequency microwave signal can be transmitted to the display device.

上述实现方法中,控制设备可以根据用户输入的不同类型的操作,生成具有不同通断间隔或信号强弱的控制信号,进而向显示设备发射不同的高频微波信号。In the above implementation method, the control device can generate control signals with different on-off intervals or signal strengths according to different types of operations input by the user, and then transmit different high-frequency microwave signals to the display device.

在本申请的另一些实施例中,控制设备还可以通过改变控制信号的通断间隔或信号强弱来实现控制信号与用户输入的不同操作的对应。该方法可以通过在控制设备上的设置天线开关实现。In other embodiments of the present application, the control device may also implement the correspondence between the control signal and the different operations input by the user by changing the on-off interval or the signal strength of the control signal. The method can be realized by setting the antenna switch on the control device.

示例性的,结合图1,控制设备100中的振荡器103可以不断的产生相同的基础控制信号,该信号通过滤波器104滤波以及功率放大器105放大后,以高频微波信号的形式被发射天线106发射。天线开关107可以通过打开、关闭控制发射天线106发射的高频微波信号的通断状态。当用户输入操作时,天线开关107可以接收该操作,对发射天线106执行对应的打开/关闭的控制。这样,发射天线106发射的高频微波信号就变得不连续,而不同的通断状态的高频微波信号可以对应不同操作类型的操作。因此显示设备110也就可以接到与用户操作对应的具有不同通断状态的高频微波信号。Exemplarily, with reference to FIG. 1 , the oscillator 103 in thecontrol device 100 can continuously generate the same basic control signal, which is filtered by thefilter 104 and amplified by thepower amplifier 105, and then sent to the transmitting antenna in the form of a high-frequency microwave signal. 106 launches. Theantenna switch 107 can control the on-off state of the high-frequency microwave signal emitted by the transmitting antenna 106 by turning it on or off. When a user inputs an operation, theantenna switch 107 can receive the operation and perform corresponding on/off control of the transmit antenna 106 . In this way, the high-frequency microwave signals emitted by the transmitting antenna 106 become discontinuous, and the high-frequency microwave signals in different on-off states can correspond to different types of operations. Therefore, thedisplay device 110 can also receive high-frequency microwave signals with different on-off states corresponding to user operations.

本申请实施例中,高频微波信号的工作频率可以在30GHz-3000GHz之间。该高频微波信号需要具有较好的方向性,以便控制设备发射出的信号能够更好的反应用户所执行的操作。具体对于发射天线的设计要求,请结合图1参考上述关于远程控制系统的说明,此处不再赘述。In the embodiment of the present application, the working frequency of the high-frequency microwave signal may be between 30 GHz and 3000 GHz. The high-frequency microwave signal needs to have good directivity, so that the signal emitted by the control device can better reflect the operation performed by the user. For specific design requirements of the transmitting antenna, please refer to the above description about the remote control system with reference to FIG. 1 , and details are not repeated here.

另外,由于本申请实施例采用高频微波信号实现远程控制,而工作在较高频率下的微波信号受到的外界干扰要远小于工作在红外、蓝牙或Wi-Fi频段的信号。另外,高频微波信号还具有延迟小、波束窄、功耗小的特点,也更有利于发射天线的小型化,同时在使用的过程中也不会对人体造成额外的辐射伤害。因此,通过高频微波信号实现远程控制,能够有效的避免外界干扰,从而实现远程控制的精准性,还可提高控制效率。In addition, since the embodiments of the present application use high-frequency microwave signals to realize remote control, the external interference of microwave signals operating at higher frequencies is far less than that of signals operating in infrared, Bluetooth or Wi-Fi frequency bands. In addition, the high-frequency microwave signal also has the characteristics of small delay, narrow beam, and low power consumption, which is also more conducive to the miniaturization of the transmitting antenna, and will not cause additional radiation damage to the human body during use. Therefore, realizing remote control through high-frequency microwave signals can effectively avoid external interference, thereby realizing the accuracy of remote control and improving control efficiency.

S403、显示设备通过天线阵列接收高频微波信号。S403, the display device receives the high-frequency microwave signal through the antenna array.

显示设备上设置有天线阵列,该天线阵列的工作频段可以覆盖上述控制设备发射的高频微波信号所在的频段,以此确保该高频微波信号能够被显示设备上的天线阵列所接收。The display device is provided with an antenna array, and the working frequency band of the antenna array can cover the frequency band of the high-frequency microwave signal emitted by the control device, so as to ensure that the high-frequency microwave signal can be received by the antenna array on the display device.

可以理解的是,天线阵列在接收到高频微波信号之后,天线阵列上的阵列单元能够将该高频微波信号转换为电信号。例如,该转换过程可以体现为,在接收到高频微波信号之后,天线阵列上的阵列单元的电气参数可以发生相应的变化。It can be understood that, after the antenna array receives the high-frequency microwave signal, the array unit on the antenna array can convert the high-frequency microwave signal into an electrical signal. For example, the conversion process can be embodied in that, after receiving the high-frequency microwave signal, the electrical parameters of the array elements on the antenna array can be changed accordingly.

S404、显示设备根据高频微波信号在天线阵列中的照射区域,确定控制设备指向电气参数显示屏的位置。S404, the display device determines the position where the control device points to the electrical parameter display screen according to the irradiation area of the high-frequency microwave signal in the antenna array.

可以理解的是,控制设备发射的高频微波信号,能够集中投射到在显示设备上的天线阵列中的一部分区域,因此,显示设备可以根据天线阵列接收到的集中投射至天线阵列的高频微波信号确定高频微波信号的照射区域。例如,接收到高频微波信号的天线阵列中的阵列单元会产生相应的电气参数的变化,显示设备由此便可以确定高频微波信号投射到天线阵列上到照射区域。其中,电气参数可以是电流、电压或其他电气参数。也就是说,通过对天线阵列中阵列单元的电气参数是否发生改变,来确定高频微波信号在天线阵列中的照射区域。如在本实施例中,可将电气参数发生变化的阵列单元称为第一阵列单元。It can be understood that the high-frequency microwave signals emitted by the control device can be projected to a part of the antenna array on the display device. The signal determines the irradiated area of the high frequency microwave signal. For example, an array unit in an antenna array that receives a high-frequency microwave signal will produce changes in corresponding electrical parameters, so that the display device can determine that the high-frequency microwave signal is projected onto the antenna array to the irradiation area. Wherein, the electrical parameters can be current, voltage or other electrical parameters. That is to say, the irradiation area of the high-frequency microwave signal in the antenna array is determined by checking whether the electrical parameters of the array units in the antenna array are changed. As in this embodiment, the array unit whose electrical parameters change may be referred to as the first array unit.

示例性的,结合图1,当控制设备100发射出高频微波信号后,显示设备110的显示屏111中的天线阵列114中,接收到高频微波信号的阵列单元113会将接收到的该高频微波信号转换成电气参数。天线阵列114可以将所有天线阵列单元113的电气参数传输给坐标计算电路117。坐标计算电路117根据所有天线阵列单元113电气参数的变化的情况确定出照射区域。例如,坐标计算电路117可以将所有电气参数发生变化的阵列单元(如称为第一阵列单元)在天线阵列所在的区域确定为照射区域。Exemplarily, with reference to FIG. 1 , after thecontrol device 100 emits a high-frequency microwave signal, in the antenna array 114 in thedisplay screen 111 of thedisplay device 110, the array unit 113 that receives the high-frequency microwave signal will send the received high-frequency microwave signal to the antenna array 114. High-frequency microwave signals are converted into electrical parameters. The antenna array 114 can transmit the electrical parameters of all the antenna array elements 113 to the coordinatecalculation circuit 117 . The coordinatecalculation circuit 117 determines the irradiation area according to the changes of the electrical parameters of all the antenna array units 113 . For example, the coordinatecalculation circuit 117 may determine the area where the antenna array is located in the area where all the array units whose electrical parameters are changed (for example, called the first array unit) is the irradiation area.

例如,请参考图6,在天线阵列没有接收到高频微波信号之前,其阵列单元不会出现电气参数的变化,如图6中的6a所示。在天线阵列接收到高频微波信号后,天线阵列上的部分阵列单元就会出现电气参数的变化,如图6中的6b所示,黑色填充示意的阵列单元就可以是电气参数发生变化的阵列单元,也就是第一阵列单元,这些第一阵列单元就构成了照射区域(如图6中的6c所示的圆形照射区域)。For example, please refer to FIG. 6 , before the antenna array does not receive high-frequency microwave signals, the electrical parameters of the array elements do not change, as shown by 6 a in FIG. 6 . After the antenna array receives the high-frequency microwave signal, some array elements on the antenna array will have changes in electrical parameters. As shown in 6b in Figure 6, the array elements indicated by black filling can be arrays whose electrical parameters have changed. Units, that is, the first array units, these first array units constitute the irradiation area (the circular irradiation area as shown by 6c in FIG. 6 ).

显示设备在确定照射区域之后,可根据该照射区域确定控制设备指向电气参数显示屏的位置。After the display device determines the irradiated area, the position where the control device points to the electrical parameter display screen can be determined according to the irradiated area.

在本申请的一些实施例中,显示设备可以确定照射区域的几何中心,将照射区域的几何中心确定为控制设备指向显示屏的位置。例如,参考图6,在确定出如图6中的6c所示的照射区域之后,可以将该照射区域的几何中心,如图6中的6d所示的圆形照射区域的原点确定为控制设备指向显示屏的位置。In some embodiments of the present application, the display device may determine the geometric center of the illuminated area, and determine the geometric center of the illuminated area as the position where the control device points to the display screen. For example, referring to FIG. 6 , after determining the irradiation area as shown in 6c in FIG. 6 , the geometric center of the irradiation area, the origin of the circular irradiation area as shown in 6d in FIG. 6 can be determined as the control device Point to the location of the display.

可以理解的是,当高频微波信号在照射到显示设备的阵列天线上时,由于该高频微波信号在空间中不同位置的功率密度不同,因此,阵列天线上不同位置的阵列单元接收到的高频微波信号的信号强弱也不同,对应的电气参数变化的大小也不同。在本申请的另一些实施例中,显示设备可以根据多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将多个第一阵列单元划分为至少两个阵列单元组。针对至少两个阵列单元组中每个阵列单元组,显示设备能够通过确定阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与至少两个阵列单元组一一对应的几何中心,并根据该多个几何中心确定控制设备指向电气参数显示屏的位置。It can be understood that when the high-frequency microwave signal is irradiated on the array antenna of the display device, since the power density of the high-frequency microwave signal at different positions in space is different, the array elements at different positions on the array antenna receive the signal. The signal strength of the high-frequency microwave signal is also different, and the corresponding electrical parameter changes are also different. In other embodiments of the present application, the display device may divide the plurality of first array units into at least two array unit groups according to the magnitude of the electrical parameter change of each of the plurality of first array units. For each array unit group in the at least two array unit groups, the display device can obtain a one-to-one geometric center corresponding to the at least two array unit groups by determining the geometric center of the area formed by all the first array units in the array unit group, And according to the plurality of geometric centers, the position where the control device points to the electrical parameter display screen is determined.

如图6所示,显示设备根据高频微波信号确定出照射区域之后,可以将该照射区域内的多个第一阵列单元进行分组。示例性的,可以对比接收到高频微波信号前后的阵列单元的电气参数的变化值,当第一阵列单元的电气参数变化小于第一阈值时,将对应的第一阵列单元确定为第一阵列单元组A;当第一阵列单元的电气参数变化大于第一阈值时,将对应的第一阵列单元确定为第一阵列单元组B。需要说明的是,电气参数变化越小,反映出该阵列单元处,接收到高频微波信号的信号强度越强。反之,电气参数变化越小,则对应位置的阵列单元接收到的高频微波信号的强度越弱。如图6中的6e中示出的,标号为1、2、3和4的阵列单元可以组成第一阵列单元组A,标号为5、6、7和8的阵列单元可以组成第一阵列单元组B。这样,显示设备就可以根据标号为1、2、3和4的阵列单元的位置就可以确定第一阵列单元组A的几何中心P1,同样的,根据标号为5、6、7和8的阵列单元的位置就可以确定第一阵列单元组B的几何中心P2。那么,在一些实施例中,P1和P2的连线的中点就可以确定为如图6中的6f所示的控制设备指向电气参数显示屏的位置。As shown in FIG. 6 , after the display device determines the irradiation area according to the high-frequency microwave signal, a plurality of first array units in the irradiation area can be grouped. Exemplarily, the change values of the electrical parameters of the array unit before and after receiving the high-frequency microwave signal can be compared, and when the change of the electrical parameters of the first array unit is less than the first threshold, the corresponding first array unit is determined as the first array. Unit group A; when the electrical parameter change of the first array unit is greater than the first threshold, determine the corresponding first array unit as the first array unit group B. It should be noted that the smaller the change of the electrical parameters, the stronger the signal strength of the received high-frequency microwave signal at the array unit. Conversely, the smaller the change of electrical parameters, the weaker the intensity of the high-frequency microwave signal received by the array unit at the corresponding position. As shown in 6e in FIG. 6, the array elements numbered 1, 2, 3 and 4 may form the first array element group A, and the array elements numbered 5, 6, 7 and 8 may form the first array element group B. In this way, the display device can determine the geometric center P1 of the first array unit group A according to the positions of the array elements numbered 1, 2, 3 and 4. Similarly, according to the positions of the array elements numbered 5, 6, 7 and 8 The positions of the cells can determine the geometric center P2 of the first array cell group B. Then, in some embodiments, the midpoint of the connection line between P1 and P2 can be determined as the position where the control device points to the electrical parameter display screen as shown in 6f in FIG. 6 .

当然,在其他一些实施例中,由于第一阵列单元组B的阵列单元接收到的高频微波信号的强度更强,那么,第一阵列单元组B的几何中心就有较大概率更接近于用户想要操作的位置。因此,可以引入与每个阵列单元组在接收到高频微波信号后电气参数变化对应的权重,如设第一阵列单元组A的权重为a1,第一阵列单元组B的权重为a2。由于第一阵列单元组B接收到的高频微波信号的强度更强,可以设a2大于a1,那么,显示设备在计算控制设备指向显示屏的位置的过程中,可以根据上述P1和P2的连线以及a1与a2的相互关系确定控制设备指向电气参数显示屏的位置,如称为P3。例如,假设,P1到P2的连线长度为单位1,a2=2*a1,那么控制设备指向电气参数显示屏的位置P3到P1的距离与P3到P2的距离就可以为2:1,也就是说,控制设备指向电气参数显示屏的位置P3可以为在P1与P2连线上,距离P1为2/3的点。这样,显示设备根据高频微波信号确定出的控制设备指向电气参数显示屏的位置更接近高频微波信号强度较大的点,也就更接近用户想要操作的位置。Of course, in some other embodiments, since the strength of the high-frequency microwave signal received by the array elements of the first array element group B is stronger, the geometric center of the first array element group B has a greater probability to be closer to The location where the user wants to operate. Therefore, a weight corresponding to the electrical parameter change of each array unit group after receiving the high-frequency microwave signal can be introduced. For example, let the weight of the first array unit group A be a1 and the weight of the first array unit group B to be a2 . Since the strength of the high-frequency microwave signal received by the first array unit group B is stronger, a2 can be set to be greater than a1 . Then, in the process of calculating the position where the control device points to the display screen, the display device can be based on the above P1 and P2 The connection of , and the relationship between a1 and a2 determine the position where the control device points to the electrical parameter display screen, such as called P3. For example, assuming that the length of the connection from P1 to P2 is unit 1, a2 =2*a1 , then the distance from P3 to P1 and the distance from P3 to P2 where the control device points to the electrical parameter display screen can be 2:1 , that is to say, the position P3 where the control device points to the electrical parameter display screen can be a point on the connection line between P1 and P2, and the distance P1 is 2/3. In this way, the position where the control device points to the electrical parameter display screen determined by the display device according to the high-frequency microwave signal is closer to the point where the intensity of the high-frequency microwave signal is higher, and thus closer to the position the user wants to operate.

可以理解的是,上述确定控制设备指向电气参数显示屏的位置的方法只是示例性的,其他基于本申请实施例确定控制设备指向电气参数显示屏的位置的方法均在本申请保护范围之内。此处不再赘述。It can be understood that the above method for determining the position where the control device points to the electrical parameter display screen is only exemplary, and other methods for determining the position where the control device points to the electrical parameter display screen based on the embodiments of the present application are all within the protection scope of the present application. It will not be repeated here.

S405、显示设备根据控制设备指向电气参数显示屏的位置在第一界面显示光标。S405, the display device displays a cursor on the first interface according to the position where the control device points to the electrical parameter display screen.

显示设备在未接收到控制设备发射的高频微波信号之前,在其显示屏上可以显示有第一界面。因此,用户的操作可以是基于第一界面上展示的内容进行的。也就是说,显示设备确认的用户想要操作的位置可以为第一界面上位置。显示设备根据确定的控制设备指向显示屏的位置,便可在第一界面对应的位置显示光标。Before the display device receives the high-frequency microwave signal emitted by the control device, a first interface may be displayed on its display screen. Therefore, the user's operation may be performed based on the content displayed on the first interface. That is, the position confirmed by the display device that the user wants to operate may be the position on the first interface. The display device can display the cursor at the position corresponding to the first interface according to the determined position where the control device points to the display screen.

S406、显示设备响应操作对第一界面上控制设备指向电气参数显示屏的位置对应位置处的控件执行对应事件,显示第二界面。S406 , the display device executes a corresponding event on the control on the first interface corresponding to the position where the control device points to the electrical parameter display screen in response to the operation, and displays the second interface.

对应于S401中的描述,在一些实施例中,对于只需通过控制设备实现对显示设备一种控制的场景。显示设备仅会接收到一种高频微波信号,显示设备可以在接收到该高频微波信号,确定控制设备执行的显示屏的位置之后,对控制设备指向的显示屏的位置处的控件执行对应的事件,并显示第二界面。Corresponding to the description in S401, in some embodiments, only one control of the display device needs to be implemented through the control device. The display device will only receive one type of high-frequency microwave signal. After receiving the high-frequency microwave signal and determining the position of the display screen executed by the control device, the display device can perform the corresponding control on the position of the display screen pointed by the control device. event and display the second interface.

在其他一些实施例中,对于需通过控制设备实现对显示设备的多种控制的场景。显示设备会接收控制设备发射的多种高频微波信号,且控制设备发射的不同高频微波信号与不同操作类型是一一对应的。因此,显示设备可以在接收到高频微波信号后,确定与该高频微波信号对应的操作类型,进而确定用户想要实现哪种控制。示例性的,显示设备上可以根据天线阵列接收高频微波信号后产生的电气参数的变化,确定出该高频微波信号的通断信息和/或幅度信息,进而确定与该高频微波信号对应的操作类型。例如,请参考图7,控制设备可以根据该电气参数的变化,获取与该电气参数的变化对应的控制信号,进而确定与该控制信号对应的操作类型。In some other embodiments, for scenarios where multiple controls on the display device need to be implemented through the control device. The display device will receive a variety of high-frequency microwave signals emitted by the control device, and the different high-frequency microwave signals emitted by the control device are in one-to-one correspondence with different operation types. Therefore, after receiving the high-frequency microwave signal, the display device can determine the operation type corresponding to the high-frequency microwave signal, and then determine which control the user wants to implement. Exemplarily, the display device can determine the on-off information and/or amplitude information of the high-frequency microwave signal according to changes in electrical parameters generated after the antenna array receives the high-frequency microwave signal, and then determine the signal corresponding to the high-frequency microwave signal. type of operation. For example, referring to FIG. 7 , the control device may obtain a control signal corresponding to the change of the electrical parameter according to the change of the electrical parameter, and then determine the operation type corresponding to the control signal.

请参考图7中的(a),以电气参数为电压为例,对根据电气参数的变化确定控制信号的方法进行举例说明。Please refer to (a) in FIG. 7 , taking the electrical parameter as voltage as an example, to illustrate the method of determining the control signal according to the change of the electrical parameter.

如图7中的(a)所示,当电压变化为0时,可以认为该段时间内对应时钟信号的第一电平;当电压变化为在0-A之间时,可以认为该段时间内对应时钟信号的第二电平;当电压变化大于A时,可以认为该段时间内对应时钟信号的第三电平。其中,A为大于0的电压值,第一电平对应的信号幅度小于第二电平对应的信号幅度小于第三电平对应的信号幅度。这样,根据电气参数的变化,显示设备就可以确定由上述不同电平组成的时钟信号,该时钟信号就可以是对应于不同控制类型的控制信号。As shown in (a) of Figure 7, when the voltage changes to 0, it can be considered that the first level of the clock signal corresponds to this period of time; when the voltage changes to be between 0-A, it can be considered that this period of time When the voltage change is greater than A, it can be considered that this period corresponds to the third level of the clock signal. Wherein, A is a voltage value greater than 0, and the signal amplitude corresponding to the first level is smaller than the signal amplitude corresponding to the second level is smaller than the signal amplitude corresponding to the third level. In this way, according to the change of the electrical parameters, the display device can determine the clock signal composed of the above-mentioned different levels, and the clock signal can be a control signal corresponding to different control types.

也就是说,当显示设备接收到高频微波信号之后,就能够确定与之相对应的时钟信号。假设第一电平对应的时钟信号的幅度为0,第二电平对应的时钟信号的幅度为1/2A,第三电平对应的时钟信号的幅度为A。如图7中的(b)所示,当在T时间内,显示设备接收到一个幅度为A的时钟信号,那么,就可以确定此时用户向显示设备发出了“单击”的操作。当在T时间内,显示设备接收到两个幅度为A的时钟信号的信号,其中幅度为A的时钟信号出现的周期为T/2,那么,就可以确定此时用户向显示设备发出了“双击”的操作。当在T时间内,显示设备接收到一个幅度为A/2的时钟信号的信号,那么,就可以确定此时用户向显示设备发出了“拖拽”的操作。当在T时间内,显示设备接收到两个幅度为A/2的时钟信号的信号,其中每个幅度为A/2的时钟信号出现的周期为T/2,那么,就可以确定此时用户向显示设备发出了“长按”的操作。That is to say, after the display device receives the high-frequency microwave signal, it can determine the corresponding clock signal. It is assumed that the amplitude of the clock signal corresponding to the first level is 0, the amplitude of the clock signal corresponding to the second level is 1/2A, and the amplitude of the clock signal corresponding to the third level is A. As shown in (b) of FIG. 7 , when the display device receives a clock signal with an amplitude of A within the time T, it can be determined that the user has sent a “click” operation to the display device at this time. When the display device receives two clock signals with amplitude A within T time, and the clock signal with amplitude A appears at a period of T/2, then it can be determined that the user has sent "" Double-click" operation. When the display device receives a clock signal with an amplitude of A/2 within T time, it can be determined that the user has sent a "drag" operation to the display device at this time. When the display device receives two clock signals with an amplitude of A/2 within T time, and the period of each clock signal with an amplitude of A/2 is T/2, then it can be determined that the user at this time A "long press" was issued to the display device.

作为对用户的操作的响应,显示设备可以对上述第一界面上控制设备指向电气参数显示屏的位置对应处的控件执行对应的事件。并在显示屏上显示执行该事件后对应的第二界面。As a response to the user's operation, the display device may execute a corresponding event on the control on the first interface that corresponds to the position where the control device points to the electrical parameter display screen. And the second interface corresponding to the execution of the event is displayed on the display screen.

本申请实施例能够在多个场景下实现对于显示设备的准确快速的远程控制。以下说明以不同场景示例性的对本申请实施例的具体实现进行说明。The embodiments of the present application can implement accurate and fast remote control of a display device in multiple scenarios. The following description exemplarily describes the specific implementation of the embodiments of the present application in different scenarios.

在如图8所示的场景中,以显示设备为电脑,控制设备包括一个物理键为例,用户可以利用控制设备执行双击操作打开文件夹。如图8中的(a)所示,电脑的显示屏上显示有第一界面,该第一界面可以包括名称为“相机”、“微信”、“录屏截屏”、“杂志锁屏”以及“蓝牙分享”等文件夹。假设用户想要打开“相机”文件夹查看其中的内容,那么,用户可以手握控制设备,指向显示屏中的“相机”文件夹对应的位置,并双击该控制设备上的物理键。控制设备通过物理键接收用户输入的双击操作,控制振荡器生成控制信号,并通过发射天线以高频微波信号的形式发射出去。电脑的显示屏可以通过设置在显示屏上的天线阵列接收该高频微波信号,并根据该高频微波信号确定照射区域进而确定用户想要操作的位置为“相机”文件夹。那么,如图8中的(b)所示,电脑就可以在该位置处显示光标,以便电脑向用户提供直观的所操作控件的位置。另外,电脑可以对“相机”文件夹执行与“双击”操作对应的事件,即打开文件夹,并显示执行该操作之后的界面,如图8中的(c)所示的打开“相机”文件夹之后的界面。In the scenario shown in FIG. 8 , taking the display device as a computer and the control device including a physical key as an example, the user can use the control device to perform a double-click operation to open a folder. As shown in (a) of FIG. 8, a first interface is displayed on the display screen of the computer, and the first interface may include names such as “camera”, “WeChat”, “screen capture”, “magazine lock screen” and "Bluetooth Sharing" and other folders. Assuming that the user wants to open the "Camera" folder to view the contents, the user can hold the control device, point to the location corresponding to the "Camera" folder on the display screen, and double-click the physical key on the control device. The control device receives the double-click operation input by the user through the physical key, controls the oscillator to generate the control signal, and transmits it in the form of a high-frequency microwave signal through the transmitting antenna. The display screen of the computer can receive the high-frequency microwave signal through the antenna array set on the display screen, and determine the irradiation area according to the high-frequency microwave signal, and then determine the location that the user wants to operate as the "camera" folder. Then, as shown in (b) of FIG. 8 , the computer can display the cursor at this position, so that the computer can provide the user with an intuitive position of the operated control. In addition, the computer can perform an event corresponding to the "double-click" operation on the "camera" folder, that is, to open the folder and display the interface after performing the operation, as shown in (c) in Figure 8 to open the "camera" file The interface after the folder.

在如图9所示的游戏场景中,假设显示设备包括一个显示屏,控制设备包括一个物理键,用户可以利用控制设备进行“切水果”的游戏。如图9中的(a)所示,在该场景下,显示屏上会快速的出现多个移动的水果图像,用户在进行该“切水果”游戏时,需要控制光标尽可能多的划过显示设备中的水果图像,划过的水果图像越多,得分越高。可以理解的是,该游戏场景下,需要显示设备快速准确的响应用户的操作,才能尽可能多的划过快速移动中的水果图像。将本申请实施例所提供的方法应用在该场景下时,当用户开始切水果时,可以手握控制设备(图9中并未示出),输入“拖拽”的操作。例如,长按物理键,并沿着能够划过最多水果图像的线路移动控制设备(如图9中的(a)中所示的虚线箭头所示的路线),直至该切水果的动作结束,松开物理键。这样,控制设备就可以根据该“拖拽”的操作生成控制信号,不间断向显示设备发送沿图9中的(a)包括的虚线箭头的路线发送高频微波信号。显示设备通过设置在显示屏上的天线阵列接收上述高频微波信号,经过显示设备中处理器的分析计算,获取用户想要操作的光标移动线路,并执行与该高频微波信号对应的事件,即切掉该线路上的水果。例如,如图9中的(b)所示,在显示屏中显示切掉上述移动线路上的水果并显示切掉水果后的果汁喷溅效果,同时可以在显示屏左上角显示的切水果总数的变化情况。In the game scenario shown in FIG. 9 , it is assumed that the display device includes a display screen, and the control device includes a physical key, and the user can use the control device to play the game of "cutting fruit". As shown in (a) of Figure 9, in this scenario, a plurality of moving fruit images will quickly appear on the display screen. When playing the "cut fruit" game, the user needs to control the cursor to swipe as many times as possible. Display the fruit images in the device, the more fruit images that are crossed, the higher the score. It is understandable that in this game scenario, the display device needs to respond quickly and accurately to the user's operation, so as to swipe through the fast-moving fruit images as much as possible. When the method provided by the embodiment of the present application is applied in this scenario, when the user starts to cut the fruit, the user can hold the control device (not shown in FIG. 9 ) and input a "drag" operation. For example, long press the physical key, and move the control device along the line that can swipe the most fruit images (the line shown by the dotted arrow as shown in (a) in Fig. 9), until the action of cutting the fruit ends, Release the physical key. In this way, the control device can generate a control signal according to the "drag" operation, and continuously transmit the high-frequency microwave signal to the display device along the route of the dotted arrow included in (a) of FIG. 9 . The display device receives the above-mentioned high-frequency microwave signal through the antenna array arranged on the display screen, and through the analysis and calculation of the processor in the display device, obtains the cursor movement line that the user wants to operate, and executes the event corresponding to the high-frequency microwave signal, That is, cut off the fruit on the line. For example, as shown in (b) of Figure 9, the fruit on the above-mentioned moving line is displayed on the display screen and the fruit juice splash effect after cutting the fruit is displayed, and at the same time, the total number of cut fruits can be displayed in the upper left corner of the display screen. changes.

在如图10所示的即时通信场景中,假设用户想要在如图10中的(a)所示的聊天框内进行手写输入。将本申请实施例所提供的方法应用在该场景下时,用户可以手握控制设备(图10中未示出),输入“拖拽”的操作。例如,长按控制设备上的输入模块,并对着显示设备中显示的聊天框中的输入区域(如图10中的(a)所示的模拟手写区域)移动,以便输入想要输入的文字。示例性的,如图10中的(a)所示,假设用户想要在聊天框中输入“Hi”,那么就可以手握控制设备,在模拟手写区域,长按输入模块并沿着“H”和“i”的笔画方向移动。控制设备就可以根据用户输入的操作生成对应的控制信号,并以高频微波信号的形式发射出去。进而显示设备就能够通过天线阵列接收该高频微波信号,并根据该高频微波信号获取用户输入的操作类型以及用户想要光标移动的线路。以便显示设备对该信息进行分析,确定用户输入的内容,进而将用户想要输入的信息显示在输入框中,如图10中的(b)所示。由于本申请实施例提供的方法,显示设备能够准确的接收用户操作并作出响应,因此聊天软件的聊天框能够准确的获取用户输入的信息,进而为用户提供高效顺畅的聊天体验。In the instant messaging scenario shown in FIG. 10 , it is assumed that the user wants to perform handwriting input in the chat box as shown in (a) of FIG. 10 . When the method provided by the embodiment of the present application is applied in this scenario, the user can hold the control device (not shown in FIG. 10 ) and input a "drag" operation. For example, long press the input module on the control device and move it toward the input area in the chat box displayed on the display device (the simulated handwriting area shown in (a) in Figure 10) to input the text you want to enter . Exemplarily, as shown in (a) of Figure 10, suppose the user wants to input "Hi" in the chat box, then he can hold the control device, in the simulated handwriting area, long press the input module and move along the "H" " and "i" in the stroke direction. The control device can generate a corresponding control signal according to the operation input by the user, and transmit it in the form of a high-frequency microwave signal. Then, the display device can receive the high-frequency microwave signal through the antenna array, and obtain the operation type input by the user and the line on which the user wants the cursor to move according to the high-frequency microwave signal. So that the display device analyzes the information, determines the content input by the user, and then displays the information that the user wants to input in the input box, as shown in (b) of FIG. 10 . Due to the method provided by the embodiments of the present application, the display device can accurately receive and respond to user operations, so the chat box of the chat software can accurately obtain the information input by the user, thereby providing users with an efficient and smooth chat experience.

请参考图11,为本申请实施例提供的一种视频播放场景。在该场景下,用户可以通过显示设备的显示屏观看视频内容,也可以通过移动进度标记进行视频帧的跳转。用户可以手握控制设备(图中并未示出),将预览标记帧移动到想要的进度条位置,不同的进度条位置可以对应视频内容中不同时刻的视频帧,以便用户可以直接观看想要观看的时刻的视频。示例性的,假设当前观看的视频内容为视频信息中的第01:01时刻的视频帧(如图11中的(a)所示)。而用户想要跳转到26:01时刻继续观看视频,那么,用户就可以手握控制设备对准进度条上26:01时刻的位置,输入单击的操作。控制设备接收该操作,确认该操作的操作类型为“单击”,就可以生成与该“单击”的操作类型对应的控制信号,并以高频微波信号的形式发射出去。如图11中的(b)所示,显示设备的显示屏通过设置在显示屏中的天线阵列接收该高频微波信号,并据此确定操作类型为“单击”,那么,就可以响应于用户的操作,将视频帧跳转到用户想要指向的位置(如26:01时刻),并显示该时刻的视频帧。Please refer to FIG. 11 , which illustrates a video playback scene provided by an embodiment of the present application. In this scenario, the user can watch the video content through the display screen of the display device, and can also jump the video frame by moving the progress marker. The user can hold the control device (not shown in the figure) and move the preview marker frame to the desired progress bar position. Different progress bar positions can correspond to the video frames at different times in the video content, so that the user can directly watch the desired Video of the moment to watch. Exemplarily, it is assumed that the currently viewed video content is the video frame at the time 01:01 in the video information (as shown in (a) in FIG. 11 ). If the user wants to jump to the 26:01 time to continue watching the video, then the user can hold the control device and aim at the position of the progress bar at 26:01 time and input the click operation. The control device receives the operation, confirms that the operation type of the operation is "click", and can generate a control signal corresponding to the operation type of the "click" and transmit it in the form of a high-frequency microwave signal. As shown in (b) of FIG. 11 , the display screen of the display device receives the high-frequency microwave signal through the antenna array arranged in the display screen, and determines the operation type as “click” accordingly, then, it can respond to the The user's operation jumps the video frame to the position that the user wants to point to (such as time 26:01), and displays the video frame at that time.

这样,控制设备根据用户的操作生成与该操作对应的高频微波信号,并向显示设备发射,能够准确的将用户的操作的信息传递给显示设备。显示设备通过天线阵列中的多个阵列单元接收该高频微波信号,并根据高频微波信号引起的电气参数发生的变化情况确定照射区域,进而确定控制设备指向显示屏的位置。同时,显示设备还可以根据天线阵列接收到的高频微波信号,确定用户所执行操作的操作类型。这样显示设备就能够知晓用户想要控制显示设备的具体位置以及想要执行何种操作。那么,作为对用户输入控制设备的操作的响应,显示设备可以在控制设备指向显示屏对应位置处的控件执行对应事件,并显示执行对应事件之后的界面。通过以上方法,就实现了在对显示设备的远程控制中,提高控制精度,快速准确地控制显示屏内的光标移动到用户想要操作内容的对应位置,并根据用户的操作进行响应的目的。In this way, the control device generates a high-frequency microwave signal corresponding to the operation according to the user's operation, and transmits it to the display device, so that the information of the user's operation can be accurately transmitted to the display device. The display device receives the high-frequency microwave signal through a plurality of array units in the antenna array, and determines the irradiation area according to the changes in electrical parameters caused by the high-frequency microwave signal, and then determines the position where the control device points to the display screen. At the same time, the display device can also determine the operation type of the operation performed by the user according to the high-frequency microwave signal received by the antenna array. In this way, the display device can know the specific location where the user wants to control the display device and what operation the user wants to perform. Then, as a response to the user inputting the operation of the control device, the display device may execute the corresponding event when the control device points to the control at the corresponding position of the display screen, and display the interface after executing the corresponding event. Through the above method, in the remote control of the display device, the control accuracy is improved, the cursor in the display screen is quickly and accurately controlled to move to the corresponding position of the user's desired operation content, and the purpose of responding according to the user's operation is achieved.

上述主要从控制设备以及显示设备的角度对本申请实施例提供的方案进行了介绍。可以理解的是,为了实现上述远程控制功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。The solutions provided by the embodiments of the present application have been introduced above mainly from the perspectives of the control device and the display device. It can be understood that, in order to realize the above-mentioned remote control function, it includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in conjunction with the algorithm steps of the examples described in the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

本申请实施例可以根据上述方法示例对控制设备以及显示设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In this embodiment of the present application, the control device and the display device can be divided into functional modules according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.

在采用对应各个功能划分各个功能单元的情况下,图12示出了上述实施例中涉及的控制设备的一种可能的组成示意图,如图12所示,该控制设备包括:至少一个输入单元1201(如图12所示的输入单元1-n),处理单元1202,以及发射单元1203。In the case where each functional unit is divided according to each function, FIG. 12 shows a possible schematic composition diagram of the control device involved in the above embodiment. As shown in FIG. 12 , the control device includes: at least one input unit 1201 (input units 1-n as shown in FIG. 12), processing unit 1202, and transmitting unit 1203.

其中,至少一个输入单元1201,用于接收用户输入的操作。示例性的,至少一个输入单元1201可以用于执行上述图4所示远程控制方法的S401。Among them, at least oneinput unit 1201 is used to receive an operation input by a user. Exemplarily, at least oneinput unit 1201 may be used to execute S401 of the above-mentioned remote control method shown in FIG. 4 .

处理单元1202,用于根据控制标识,生成控制信号,并传输给发射单元1203。The processing unit 1202 is configured to generate a control signal according to the control identifier, and transmit the control signal to the transmitting unit 1203 .

发射单元1203,用于根据控制信号,发射高频微波信号,以便显示设备通过天线阵列接收高频微波信号。示例性的,处理单元1202以及发射单元1203可以用于执行上述图4所示远程控制方法的S402。The transmitting unit 1203 is configured to transmit high-frequency microwave signals according to the control signal, so that the display device receives the high-frequency microwave signals through the antenna array. Exemplarily, the processing unit 1202 and the transmitting unit 1203 may be configured to execute S402 of the remote control method shown in FIG. 4 above.

进一步的,处理单元1202还可以用于根据用户对至少一个输入单元的操作,确定操作的操作类型,根据操作的操作类型确定控制标识,操作类型为:单击,双击,拖拽或长按。Further, the processing unit 1202 can also be configured to determine the operation type of the operation according to the user's operation on at least one input unit, and determine the control identifier according to the operation type of the operation. The operation type is: single click, double click, drag or long press.

发射单元1203还可以用于根据控制信号发射控制信号对应的高频微波信号,不同操作类型对应的控制标识不同,不同控制标识对应的控制信号不同,不同控制信号对应的高频微波信号不同。其中,高频微波信号的工作频率为30GHz-3000GHz。The transmitting unit 1203 can also be used to transmit the high frequency microwave signal corresponding to the control signal according to the control signal. Different operation types correspond to different control signs, different control signs correspond to different control signals, and different control signals correspond to different high frequency microwave signals. Among them, the working frequency of the high-frequency microwave signal is 30GHz-3000GHz.

处理单元1202还可以用于对控制信号进行滤波,以使得控制信号工作在预设的工作频段。The processing unit 1202 may also be configured to filter the control signal, so that the control signal operates in a preset operating frequency band.

处理单元1202还可以用于控制信号进行放大,并将放大后的控制信号传输给发射单元1203。The processing unit 1202 can also be used to amplify the control signal, and transmit the amplified control signal to the transmitting unit 1203 .

需要说明的是,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能单元的功能描述,在此不再赘述。本申请实施例提供的控制设备,用于执行上述远程控制方法,因此可以达到与上述远程控制方法相同的效果。It should be noted that, all the relevant contents of the steps involved in the above method embodiments can be cited in the functional description of the corresponding functional unit, which will not be repeated here. The control device provided in the embodiment of the present application is used to execute the above-mentioned remote control method, and thus can achieve the same effect as the above-mentioned remote control method.

在采用对应各个功能划分各个功能单元的情况下,图13示出了上述实施例中涉及的显示设备的一种可能的组成示意图,如图13所示,该显示设备包括:设置有天线阵列的显示单元1301和处理单元1302。例如,显示单元1301可以为如图1所示的显示屏111,天线阵列可以由光透明材质或不透明细金属线制成。In the case where each functional unit is divided according to each function, FIG. 13 shows a possible schematic diagram of the composition of the display device involved in the above embodiment. As shown in FIG. 13 , the display device includes: a display device provided with an antenna array Display unit 1301 and processing unit 1302. For example, the display unit 1301 may be thedisplay screen 111 as shown in FIG. 1 , and the antenna array may be made of a light-transparent material or an opaque thin metal wire.

其中,显示单元1301,用于通过天线阵列接收控制设备发射的高频微波信号。示例性的,显示单元1301可以用于执行上述图4所示远程控制方法的S403。Among them, the display unit 1301 is used to receive the high-frequency microwave signal transmitted by the control device through the antenna array. Exemplarily, the display unit 1301 may be configured to execute S403 of the remote control method shown in FIG. 4 above.

处理单元1302,用于根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置;响应用户的操作,对第一界面上控制设备指向显示屏对应位置处的控件执行对应事件。The processing unit 1302 is used to determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array; in response to the user's operation, perform corresponding operations on the control device on the first interface pointing to the corresponding position of the display screen. event.

显示单元1301,还用于显示第二界面,第二界面是响应操作,对第一界面上控制设备指向显示屏的位置处的控件执行对应事件后的界面。示例性的,显示单元1301以及处理单元1302可以用于执行上述图4所示远程控制方法的S404-S406。The display unit 1301 is further configured to display a second interface, and the second interface is an interface after a corresponding event is performed on a control on the first interface at a position where the control device points to the display screen in response to an operation. Exemplarily, the display unit 1301 and the processing unit 1302 may be used to execute S404-S406 of the remote control method shown in FIG. 4 above.

进一步的,显示单元1301中的天线阵列可以包括多个阵列单元。Further, the antenna array in the display unit 1301 may include multiple array units.

处理单元1302,还用于根据高频微波信号从天线阵列中确定多个第一阵列单元,第一阵列单元是天线阵列中电气参数发生改变的阵列单元;根据多个第一阵列单元在天线阵列中的位置,确定照射区域。The processing unit 1302 is further configured to determine a plurality of first array units from the antenna array according to the high-frequency microwave signal, where the first array unit is an array unit whose electrical parameters are changed in the antenna array; in the position to determine the irradiation area.

处理单元1302,还用于确定照射区域的几何中心,根据照射区域的几何中心确定出控制设备指向显示屏的位置;或,根据多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将多个第一阵列单元划分为至少两个阵列单元组;针对至少两个阵列单元组中每个阵列单元组,确定阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与至少两个阵列单元组一一对应的几何中心;根据与至少两个阵列单元组一一对应的几何中心,确定控制设备指向显示屏的位置。The processing unit 1302 is further configured to determine the geometric center of the irradiated area, and determine the position where the control device points to the display screen according to the geometric center of the irradiated area; or, according to changes in electrical parameters of each first array unit in the plurality of first array units The size of the first array unit is divided into at least two array unit groups; for each array unit group in the at least two array unit groups, determine the geometric center of the area formed by all the first array units in the array unit group, Obtain the geometric centers corresponding to the at least two array unit groups one-to-one; and determine the position where the control device points to the display screen according to the geometric centers corresponding to the at least two array unit groups one-to-one.

显示单元1301,还用于根据处理单元1302确定的控制设备指向显示屏的位置,在第一界面显示光标。The display unit 1301 is further configured to display a cursor on the first interface according to the position where the control device points to the display screen determined by the processing unit 1302 .

处理单元1302,还用于根据高频微波信号确定操作的操作类型;操作类型为:单击,双击,拖拽或长按,并根据操作类型,响应操作,对第一界面上控制设备指向显示屏的位置对应位置处的控件执行对应事件。The processing unit 1302 is further configured to determine the operation type of the operation according to the high-frequency microwave signal; the operation type is: single-click, double-click, dragging or long-pressing, and according to the operation type, in response to the operation, point the display to the control device on the first interface The position of the screen corresponds to the control at the position to execute the corresponding event.

需要说明的是,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能单元的功能描述,在此不再赘述。本申请实施例提供的显示设备,用于执行上述远程控制方法,因此可以达到与上述远程控制方法相同的效果。It should be noted that, all the relevant contents of the steps involved in the above method embodiments can be cited in the functional description of the corresponding functional unit, which will not be repeated here. The display device provided by the embodiment of the present application is used to execute the above-mentioned remote control method, and thus can achieve the same effect as the above-mentioned remote control method.

本申请实施例还提供一种远程控制系统,该远程控制系统可以包括:控制设备和包含设置有天线阵列的显示屏的显示设备。Embodiments of the present application further provide a remote control system, which may include: a control device and a display device including a display screen provided with an antenna array.

控制设备,用于接收用户的操作,响应操作,发射高频微波信号。示例性的,控制设备可以用于执行上述图4所示远程控制方法的S401-S402。The control device is used to receive the user's operation, respond to the operation, and transmit high-frequency microwave signals. Exemplarily, the control device may be used to execute S401-S402 of the remote control method shown in FIG. 4 above.

显示设备,用于通过天线阵列接收高频微波信号,根据高频微波信号在天线阵列中的照射区域,确定控制设备指向显示屏的位置,响应操作,对显示屏上当前显示的第一界面上控制设备指向显示屏的位置处的控件执行对应事件,显示第二界面。示例性的,显示设备可以用于执行上述图4所示远程控制方法的S403-S406。The display device is used to receive high-frequency microwave signals through the antenna array, determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, respond to the operation, and respond to the operation on the first interface currently displayed on the display screen. The control device points to the control at the position of the display screen to execute the corresponding event and display the second interface. Exemplarily, the display device may be used to execute S403-S406 of the remote control method shown in FIG. 4 above.

需要说明的是,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。本申请实施例提供的远程控制系统,用于执行上述远程控制方法,因此可以达到与上述远程控制方法相同的效果。It should be noted that, all relevant contents of the steps involved in the above method embodiments can be cited in the functional description of the corresponding functional module, which will not be repeated here. The remote control system provided by the embodiments of the present application is used to execute the above-mentioned remote control method, and thus can achieve the same effect as the above-mentioned remote control method.

通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。From the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated as required. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.

在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。Units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (which may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

以上,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (16)

Translated fromChinese
1.一种远程控制方法,其特征在于,应用于远程控制系统,所述远程控制系统包括控制设备和显示设备,所述显示设备包括设置有天线阵列的显示屏,所述显示屏上显示有第一界面;所述方法包括:1. a remote control method, is characterized in that, is applied to the remote control system, and described remote control system comprises control equipment and display equipment, and described display equipment comprises the display screen that is provided with antenna array, and described display screen is displayed with A first interface; the method includes:所述控制设备接收用户的操作;the control device receives the user's operation;所述控制设备响应所述操作,向所述显示设备发射高频微波信号,所述高频微波信号的工作频率为30GHz-3000GHz;The control device transmits a high-frequency microwave signal to the display device in response to the operation, and the operating frequency of the high-frequency microwave signal is 30GHz-3000GHz;所述显示设备通过所述天线阵列接收所述高频微波信号;The display device receives the high-frequency microwave signal through the antenna array;所述显示设备根据所述高频微波信号在所述天线阵列中的照射区域,确定所述控制设备指向所述显示屏的位置;The display device determines the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array;所述显示设备响应所述操作,对所述第一界面上所述控制设备指向所述显示屏的位置处的控件执行对应事件,显示第二界面。In response to the operation, the display device executes a corresponding event on a control on the first interface where the control device points to the display screen, and displays a second interface.2.根据权利要求1所述的方法,其特征在于,所述天线阵列包括多个阵列单元;在所述显示设备根据所述高频微波信号在所述天线阵列中的照射区域,确定所述控制设备指向所述显示屏的位置之前,所述方法还包括:2 . The method according to claim 1 , wherein the antenna array comprises a plurality of array units; the display device determines the Before controlling the position where the device points to the display screen, the method further includes:所述显示设备根据所述高频微波信号从所述天线阵列中确定多个第一阵列单元,所述第一阵列单元是所述天线阵列中电气参数发生改变的阵列单元;The display device determines a plurality of first array units from the antenna array according to the high-frequency microwave signal, where the first array units are array units whose electrical parameters are changed in the antenna array;所述显示设备根据所述多个第一阵列单元在所述天线阵列中的位置,确定所述照射区域。The display device determines the irradiation area according to the positions of the plurality of first array units in the antenna array.3.根据权利要求2所述的方法,其特征在于,所述显示设备根据所述高频微波信号在所述天线阵列中的照射区域,确定所述控制设备指向所述显示屏的位置,包括:3 . The method according to claim 2 , wherein the display device determines the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, comprising: 3 . :所述显示设备确定所述照射区域的几何中心,根据所述照射区域的几何中心确定出所述控制设备指向所述显示屏的位置;或,The display device determines the geometric center of the irradiation area, and determines the position where the control device points to the display screen according to the geometric center of the irradiation area; or,所述显示设备根据所述多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将所述多个第一阵列单元划分为至少两个阵列单元组;针对所述至少两个阵列单元组中每个阵列单元组,确定所述阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与所述至少两个阵列单元组一一对应的几何中心;根据与所述至少两个阵列单元组一一对应的几何中心,确定所述控制设备指向所述显示屏的位置。The display device divides the plurality of first array units into at least two array unit groups according to the magnitude of the electrical parameter change of each of the plurality of first array units; for the at least two For each array unit group in the array unit groups, determine the geometric center of the area formed by all the first array units in the array unit group, and obtain the geometric center corresponding to the at least two array unit groups one-to-one; The one-to-one geometric center of the at least two array unit groups is used to determine the position where the control device points to the display screen.4.根据权利要求1-3中任一项所述的方法,其特征在于,在所述控制设备接收用户的操作之后,所述方法还包括:4. The method according to any one of claims 1-3, wherein after the control device receives the operation of the user, the method further comprises:所述控制设备确定所述操作的操作类型,所述操作类型为:单击,双击,拖拽或长按;The control device determines the operation type of the operation, and the operation type is: single click, double click, dragging or long pressing;所述控制设备根据所述操作的操作类型生成控制信号;the control device generates a control signal according to the operation type of the operation;所述控制设备响应所述操作,发射高频微波信号,包括;The control device transmits a high frequency microwave signal in response to the operation, including;所述控制设备根据所述控制信号发射所述控制信号对应的高频微波信号,不同操作类型对应的控制信号不同,不同控制信号对应的高频微波信号不同。The control device transmits a high-frequency microwave signal corresponding to the control signal according to the control signal, the control signals corresponding to different operation types are different, and the high-frequency microwave signals corresponding to different control signals are different.5.根据权利要求4所述的方法,其特征在于,所述方法还包括:5. method according to claim 4, is characterized in that, described method also comprises:所述显示设备根据所述高频微波信号确定所述操作类型;the display device determines the operation type according to the high frequency microwave signal;所述显示设备响应所述操作,对所述第一界面上所述控制设备指向所述显示屏的位置处的控件执行对应事件,显示第二界面,包括:In response to the operation, the display device executes a corresponding event on the control on the first interface where the control device points to the display screen, and displays the second interface, including:所述显示设备根据所述操作类型,响应所述操作,对所述控制设备指向所述显示屏的位置处的控件执行对应事件,显示所述第二界面。According to the operation type, the display device executes a corresponding event on a control at a position where the control device points to the display screen in response to the operation, and displays the second interface.6.根据权利要求5所述的方法,其特征在于,所述方法还包括:6. The method according to claim 5, wherein the method further comprises:所述显示设备根据所述控制设备指向所述显示屏的位置在所述第一界面显示光标。The display device displays a cursor on the first interface according to the position where the control device points to the display screen.7.一种控制设备,其特征在于,应用于远程控制系统,所述远程控制系统还包括显示设备,所述显示设备包括设置有天线阵列的显示屏;所述控制设备包括:至少一个输入模块,处理器,振荡器和发射天线;7. A control device, characterized in that it is applied to a remote control system, the remote control system further comprising a display device, the display device comprising a display screen provided with an antenna array; the control device comprising: at least one input module , processor, oscillator and transmit antenna;所述处理器用于根据用户对所述至少一个输入模块的操作,确定控制标识,并传输给所述振荡器;The processor is configured to determine a control identifier according to a user's operation on the at least one input module, and transmit it to the oscillator;所述振荡器用于根据所述控制标识,生成控制信号,并传输给所述发射天线;The oscillator is configured to generate a control signal according to the control identification, and transmit it to the transmitting antenna;所述发射天线用于根据所述控制信号,发射高频微波信号,以便所述显示设备通过所述天线阵列接收所述高频微波信号,所述高频微波信号的工作频率为30GHz-3000GHz。The transmitting antenna is used for transmitting a high-frequency microwave signal according to the control signal, so that the display device receives the high-frequency microwave signal through the antenna array, and the working frequency of the high-frequency microwave signal is 30GHz-3000GHz.8.根据权利要求7所述的一种控制设备,其特征在于,所述处理器用于根据用户对所述至少一个输入模块的操作,确定控制标识,包括:8. The control device according to claim 7, wherein the processor is configured to determine a control identifier according to a user's operation on the at least one input module, comprising:所述处理器用于根据用户对所述至少一个输入模块的操作,确定所述操作的操作类型,根据所述操作的操作类型确定所述控制标识,所述操作类型为:单击,双击,拖拽或长按;The processor is configured to determine the operation type of the operation according to the operation of the user on the at least one input module, and determine the control identifier according to the operation type of the operation, and the operation type is: single click, double click, dragging. drag or long press;所述发射天线用于根据所述控制信号,发射高频微波信号,包括:The transmitting antenna is used for transmitting high-frequency microwave signals according to the control signal, including:所述发射天线用于根据所述控制信号发射所述控制信号对应的高频微波信号,不同操作类型对应的控制标识不同,不同控制标识对应的控制信号不同,不同控制信号对应的高频微波信号不同。The transmitting antenna is used to transmit the high-frequency microwave signal corresponding to the control signal according to the control signal, the control marks corresponding to different operation types are different, the control signals corresponding to different control marks are different, and the high-frequency microwave signals corresponding to different control signals different.9.根据权利要求7-8中任一项所述的一种控制设备,其特征在于,所述控制设备还包括:设置在所述振荡器和所述发射天线之间的滤波器和功率放大器;9 . The control device according to claim 7 , wherein the control device further comprises: a filter and a power amplifier arranged between the oscillator and the transmitting antenna. 10 . ;所述滤波器用于对所述控制信号进行滤波,以使得所述控制信号工作在预设的工作频段;The filter is used for filtering the control signal, so that the control signal works in a preset working frequency band;所述放大器用于对所述滤波器滤波后的控制信号进行放大,并将放大后的控制信号传输给所述发射天线。The amplifier is used for amplifying the control signal filtered by the filter, and transmitting the amplified control signal to the transmitting antenna.10.一种显示设备,其特征在于,应用于远程控制系统,所述远程控制系统还包括控制设备,所述控制设备能够根据用户的操作向所述显示设备发射高频微波信号;所述显示设备包括:显示屏以及处理器,其中,所述显示屏设置有天线阵列,所述显示屏上显示有第一界面,所述高频微波信号的工作频率为30GHz-3000GHz;10. A display device, characterized in that it is applied to a remote control system, the remote control system further comprising a control device capable of transmitting a high-frequency microwave signal to the display device according to a user's operation; the display device The device includes: a display screen and a processor, wherein the display screen is provided with an antenna array, a first interface is displayed on the display screen, and the operating frequency of the high-frequency microwave signal is 30GHz-3000GHz;所述显示屏用于通过所述天线阵列接收所述控制设备发射的高频微波信号;The display screen is used to receive the high-frequency microwave signal emitted by the control device through the antenna array;所述处理器用于根据所述高频微波信号在所述天线阵列中的照射区域,确定所述控制设备指向所述显示屏的位置;响应所述操作,对所述第一界面上所述控制设备指向所述显示屏对应位置处的控件执行对应事件;The processor is configured to determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array; in response to the operation, the control device on the first interface The device points to the control at the corresponding position of the display screen to execute the corresponding event;所述显示屏还用于显示第二界面,所述第二界面是响应所述操作,对所述第一界面上所述控制设备指向所述显示屏的位置处的控件执行对应事件后的界面。The display screen is also used to display a second interface, the second interface is an interface after a corresponding event is performed on the control on the first interface at the position where the control device points to the display screen in response to the operation .11.根据权利要求10所述的一种显示设备,其特征在于,所述天线阵列包括多个阵列单元;11. A display device according to claim 10, wherein the antenna array comprises a plurality of array units;所述处理器还用于根据所述高频微波信号从所述天线阵列中确定多个第一阵列单元,所述第一阵列单元是所述天线阵列中电气参数发生改变的阵列单元;根据所述多个第一阵列单元在所述天线阵列中的位置,确定所述照射区域。The processor is further configured to determine a plurality of first array units from the antenna array according to the high-frequency microwave signal, where the first array units are array units whose electrical parameters are changed in the antenna array; The positions of the plurality of first array units in the antenna array are used to determine the irradiation area.12.根据权利要求11所述的一种显示设备,其特征在于,所述处理器用于根据所述高频微波信号在所述天线阵列中的照射区域,确定控制设备指向所述显示屏的位置,包括:12 . The display device according to claim 11 , wherein the processor is configured to determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array. 13 . ,include:所述处理器用于确定所述照射区域的几何中心,根据所述照射区域的几何中心确定出所述控制设备指向所述显示屏的位置;或,The processor is configured to determine the geometric center of the irradiation area, and determine the position where the control device points to the display screen according to the geometric center of the irradiation area; or,所述处理器用于根据所述多个第一阵列单元中每个第一阵列单元的电气参数变化的大小,将所述多个第一阵列单元划分为至少两个阵列单元组;针对所述至少两个阵列单元组中每个阵列单元组,确定所述阵列单元组中所有第一阵列单元所构成区域的几何中心,获得与所述至少两个阵列单元组一一对应的几何中心;根据与所述至少两个阵列单元组一一对应的几何中心,确定所述控制设备指向所述显示屏的位置。The processor is configured to divide the plurality of first array units into at least two array unit groups according to the magnitude of the electrical parameter change of each of the plurality of first array units; for the at least two array units For each array unit group in the two array unit groups, determine the geometric center of the area formed by all the first array units in the array unit group, and obtain the geometric center corresponding to the at least two array unit groups one-to-one; The one-to-one geometric center of the at least two array unit groups determines the position where the control device points to the display screen.13.根据权利要求10-12中任一项所述的一种显示设备,其特征在于,13. A display device according to any one of claims 10-12, wherein,所述处理器还用于根据所述高频微波信号确定所述操作的操作类型;所述操作类型为:单击,双击,拖拽或长按;The processor is further configured to determine the operation type of the operation according to the high-frequency microwave signal; the operation type is: single click, double click, dragging or long pressing;所述处理器响应所述操作,对所述第一界面上所述控制设备指向所述显示屏的位置对应位置处的控件执行对应事件,包括:In response to the operation, the processor executes a corresponding event on the control at the position corresponding to the position where the control device points to the display screen on the first interface, including:所述处理器根据所述操作类型,响应所述操作,对所述第一界面上所述控制设备指向所述显示屏的位置对应位置处的控件执行对应事件。The processor responds to the operation according to the operation type, and executes a corresponding event on the control at the position corresponding to the position where the control device points to the display screen on the first interface.14.根据权利要求13所述的一种显示设备,其特征在于,14. A display device according to claim 13, wherein,所述显示屏还用于根据所述处理器确定的所述控制设备指向所述显示屏的位置,在所述第一界面显示光标。The display screen is further configured to display a cursor on the first interface according to the position where the control device points to the display screen determined by the processor.15.根据权利要求10或14所述的一种显示设备,其特征在于,15. A display device according to claim 10 or 14, wherein,所述天线阵列由光透明材质或不透明细金属线制成。The antenna array is made of optically transparent material or opaque thin metal wires.16.一种远程控制系统,其特征在于,包括:控制设备,及包含设置有天线阵列的显示屏的显示设备;其中,16. A remote control system, comprising: a control device, and a display device including a display screen provided with an antenna array; wherein,所述控制设备用于接收用户的操作,响应所述操作,发射高频微波信号;The control device is used to receive the operation of the user, and in response to the operation, transmit a high-frequency microwave signal;所述显示设备用于通过所述天线阵列接收所述高频微波信号,根据所述高频微波信号在所述天线阵列中的照射区域,确定所述控制设备指向所述显示屏的位置,响应所述操作,对所述显示屏上当前显示的第一界面上所述控制设备指向所述显示屏的位置处的控件执行对应事件,显示第二界面。The display device is configured to receive the high-frequency microwave signal through the antenna array, determine the position where the control device points to the display screen according to the irradiation area of the high-frequency microwave signal in the antenna array, and respond to In the operation, a corresponding event is performed on a control on the first interface currently displayed on the display screen at a position where the control device points to the display screen, and a second interface is displayed.
CN201910631841.5A2019-07-122019-07-12Remote control method, equipment and systemActiveCN110517470B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201910631841.5ACN110517470B (en)2019-07-122019-07-12Remote control method, equipment and system

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910631841.5ACN110517470B (en)2019-07-122019-07-12Remote control method, equipment and system

Publications (2)

Publication NumberPublication Date
CN110517470A CN110517470A (en)2019-11-29
CN110517470Btrue CN110517470B (en)2020-11-17

Family

ID=68623441

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910631841.5AActiveCN110517470B (en)2019-07-122019-07-12Remote control method, equipment and system

Country Status (1)

CountryLink
CN (1)CN110517470B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN118362974A (en)*2023-01-182024-07-19华为技术有限公司 Positioning method, positioning system and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104010208B (en)*2014-04-232017-03-08深圳创维-Rgb电子有限公司A kind of LCD TV with infrared positioning function and its infrared positioning method
KR20160097868A (en)*2015-02-102016-08-18삼성전자주식회사A display apparatus and a display method
CN107995972A (en)*2016-12-282018-05-04深圳市柔宇科技有限公司A kind of control method and device of display screen
WO2018195828A1 (en)*2017-04-262018-11-01深圳市汇顶科技股份有限公司Eyeball-based remote control system and electronic device
CN206697172U (en)*2017-05-102017-12-01青岛利恩迪电子科技发展有限公司A kind of LED display of remote-controlled wireless receiving and dispatching instruction
CN109842437A (en)*2017-11-292019-06-04索尼公司Electronic equipment, method and computer readable storage medium in wireless communication system
TWI691875B (en)*2018-09-072020-04-21友達光電股份有限公司Detection-display device and display module using the same

Also Published As

Publication numberPublication date
CN110517470A (en)2019-11-29

Similar Documents

PublicationPublication DateTitle
US20240171478A1 (en)Electronic Device with Intuitive Control Interface
US20180356935A1 (en)Touch point positioning method and apparatus, and terminal device
KR102092132B1 (en)Electronic apparatus providing hovering input effect and control method thereof
US10747357B2 (en)Coordinate measuring apparatus for measuring input position of a touch and a coordinate indicating apparatus and driving method thereof
CN109062464B (en) Touch operation method, device, storage medium and electronic device
CN108693520A (en) Electronic device and proximity detection method
CN103699292A (en)Method and device for entering into text selection mode
CN114501119B (en)Interactive display method, device, electronic equipment, system and storage medium
CN108983211B (en)Proximity sensor, method of controlling the same, electronic device, and computer-readable storage medium
US20240414250A1 (en)Electronic device comprising flexible display and method for controlling electronic device
WO2017166218A1 (en)Pressure-sensing touch method and electronic device
US9727131B2 (en)User input method for use in portable device using virtual input area
CN110517470B (en)Remote control method, equipment and system
CN109104640B (en)Virtual gift presenting method and device and storage equipment
CN111343321A (en) Backlight brightness adjustment method and related products
CN113055039B (en)Electronic device, control method and control device
CN112486354A (en)Touch method of electronic equipment, information transmission method and device of touch component
US20210165986A1 (en)Method and device for fingerprint acquisition, and touchpad
TWI484385B (en)Touch panel and method of using same
WO2018166057A1 (en)Method and electronic device for outputting touch control signals
CN107229341B (en)Terminal control ring, terminal control method and computer readable storage medium
CN104793813B (en)A kind of display base plate, display device and remote control system
TWM473558U (en)Touch panel
CN110099169A (en)Instant message processing method, electronic device and computer readable storage medium
CN113010041B (en)Touch display panel, preparation method thereof and mobile terminal

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant
TR01Transfer of patent right
TR01Transfer of patent right

Effective date of registration:20210428

Address after:Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040

Patentee after:Honor Device Co.,Ltd.

Address before:518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before:HUAWEI TECHNOLOGIES Co.,Ltd.

CP03Change of name, title or address
CP03Change of name, title or address

Address after:Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040

Patentee after:Honor Terminal Co.,Ltd.

Country or region after:China

Address before:3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong

Patentee before:Honor Device Co.,Ltd.

Country or region before:China


[8]ページ先頭

©2009-2025 Movatter.jp