CN111367452B

Movatterモバイル変換

Info

Publication number: CN111367452B
Application number: CN202010188711.1A
Authority: CN
Inventors: 王泽湘; 陈建哲
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Apollo Intelligent Connectivity Beijing Technology Co Ltd
Priority date: 2020-03-17
Filing date: 2020-03-17
Publication date: 2021-08-03
Anticipated expiration: 2040-03-17
Also published as: KR102528104B1; JP7262498B2; CN111367452A; KR20210036880A; JP2021101356A

Abstract

Translated fromChinese

本申请实施例公开了一种设备交互方法、装置、设备、系统及介质，涉及车载设备控制领域。具体实现方案为：接收主控设备发送的操作指令；其中，操作指令由主控设备响应于用户对触控组件的触控操作生成；向操作指令对应的输入设备的指令空间中，写入与操作指令对应的输入指令；通过输入设备的驱动从指令空间中访问并响应输入指令，以对附属设备进行控制。本申请实施例通过在主控设备中的触控操作，对附属设备加以控制；通过在操控指令对应的输入设备的指令空间，实现了对不同输入设备和输入指令的区分，为附属设备的泛化输入奠定基础；通过输入设备的驱动从指令空间中进行输入指令的访问和响应，从而实现对附属设备的泛化控制。

The embodiments of the present application disclose a device interaction method, apparatus, device, system and medium, which relate to the field of vehicle-mounted device control. The specific implementation scheme is as follows: receiving the operation instruction sent by the main control device; wherein, the operation instruction is generated by the main control device in response to the user's touch operation on the touch control component; in the instruction space of the input device corresponding to the operation instruction, write and The input command corresponding to the operation command; access and respond to the input command from the command space through the driver of the input device to control the attached device. The embodiment of the present application controls the auxiliary device through touch operation in the main control device; through the command space of the input device corresponding to the manipulation command, the distinction between different input devices and input commands is realized, which is a generalization of the auxiliary device. It lays the foundation for the generalized input; accesses and responds to the input command from the command space through the driver of the input device, so as to realize the generalized control of the auxiliary device.

Description

Translated fromChinese

一种设备交互方法、装置、设备、系统及介质A device interaction method, apparatus, device, system and medium

技术领域technical field

本申请涉及通信技术，尤其涉及车载设备控制领域，具体涉及一种设备交互方法、装置、设备、系统及介质。The present application relates to communication technologies, in particular to the field of vehicle-mounted device control, and in particular to a device interaction method, apparatus, device, system and medium.

背景技术Background technique

随着智能化需求的不断提升，通常需要在一个设备中固定设置附属设备以丰富设备功能。通常情况下，由于没有屏幕或屏幕较小等原因，导致用户对附属设备的操作非常不便。With the continuous improvement of the demand for intelligence, it is usually necessary to set up auxiliary devices in a device to enrich the functions of the device. Usually, it is very inconvenient for users to operate the accessory device due to reasons such as no screen or small screen.

现有技术中，通常在方便操作的主控设备中输入语音或手势生成操作指令，并通过主控设备下发至附属设备，以使附属设备响应于该操作指令执行相应操作。In the prior art, an operation command is usually generated by inputting a voice or gesture in a main control device that is convenient to operate, and then sent to an accessory device through the main control device, so that the accessory device performs a corresponding operation in response to the operation command.

然而，上述方式仅适用于可操作区域唯一的情况，当附属设备中包含有多个可操作区域时，将会导致由于无法确定当前需要操作的区域，致使操作失败的情况。However, the above method is only applicable to the case where there is only one operable area. When the accessory device includes multiple operable areas, the operation will fail because the area currently required to be operated cannot be determined.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供了一种设备交互方法、装置、设备、系统及介质，以在主控设备与附属设备进行交互过程中，实现对附属设备的泛化操作。Embodiments of the present application provide a device interaction method, apparatus, device, system, and medium, so as to implement generalization operations on the auxiliary device during the interaction between the main control device and the auxiliary device.

第一方面，本申请实施例提供了一种设备交互方法，由附属设备执行，包括：In a first aspect, an embodiment of the present application provides a device interaction method, which is executed by an accessory device, including:

接收主控设备发送的操作指令；其中，所述操作指令由主控设备响应于用户对触控组件的触控操作生成；receiving an operation instruction sent by the main control device; wherein, the operation instruction is generated by the main control device in response to a user's touch operation on the touch control component;

向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令；Write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction;

通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。The auxiliary device is controlled by accessing and responding to the input command from the command space through the driver of the input device.

本申请实施例通过附属设备接收主控设备响应于用户对触控组件的触控操作所生成的操作指令；向操作指令对应的输入设备的指令空间中，写入与操作指令对应的输入指令；通过输入设备的驱动从指令空间中访问并响应输入指令，以对附属设备进行控制。上述技术方案通过附属设备接收主控设备发送的操作指令，并进行响应，实现了在主控设备与附属设备交互过程中，通过在主控设备中的触控操作，对附属设备的操作控制；同时，附属设备在响应操作指令过程中，向操控指令对应的输入设备的指令空间写入与操作指令对应的输入指令，从而实现了对不同输入设备和输入指令的区分，为附属设备的泛化输入奠定基础；通过输入设备的驱动从指令空间中进行输入指令的访问和响应，从而实现了对附属设备的泛化控制。In this embodiment of the present application, an operation instruction generated by the main control device in response to the user's touch operation on the touch control component is received by the accessory device; the input instruction corresponding to the operation instruction is written into the instruction space of the input device corresponding to the operation instruction; Access and respond to the input command from the command space through the driver of the input device to control the accessory device. The above technical solution receives the operation instruction sent by the main control device through the auxiliary device, and responds, so as to realize the operation control of the auxiliary device through the touch operation in the main control device during the interaction between the main control device and the auxiliary device; At the same time, in the process of responding to the operation command, the accessory device writes the input command corresponding to the operation command into the command space of the input device corresponding to the manipulation command, thereby realizing the distinction between different input devices and input commands, which is the generalization of the accessory device. The input lays the foundation; the access and response of the input command are carried out from the command space through the driver of the input device, thereby realizing the generalized control of the auxiliary device.

可选的，通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制，包括：Optionally, accessing and responding to the input command from the command space through the driver of the input device to control the accessory device, including:

通过所述输入设备的驱动从所述指令空间中访问并解析输入指令；Access and parse input instructions from the instruction space through the driver of the input device;

通过所述输入设备的驱动将所述输入指令的解析结果，通过所述附属设备的操作系统分发至对应的附属应用中进行响应，以对所述附属应用进行控制。Through the driver of the input device, the analysis result of the input instruction is distributed to the corresponding auxiliary application through the operating system of the auxiliary device, so as to control the auxiliary application.

上述申请中的一个可选实施方式，通过将输入指令的访问响应操作，细化为通过输入设备的驱动从指令空间中访问并解析输入指令，并将解析结果通过操作系统分发至对应的附属应用中进行相应，从而实现了对附属应用的控制，完善了输入指令的访问响应机制。An optional embodiment in the above application, by refining the access response operation of the input instruction to access and parse the input instruction from the instruction space through the drive of the input device, and distribute the parsing result to the corresponding auxiliary application through the operating system. In this way, the control of the affiliated application is realized, and the access response mechanism of the input command is improved.

可选的，所述触控组件包括硬件触控组件和/或软件触控组件；Optionally, the touch control component includes a hardware touch control component and/or a software touch control component;

所述操作指令包括操作事件和/或输入文本；The operating instructions include operating events and/or input text;

相应的，输入设备的驱动，包括硬件触控组件驱动，和/或文本输入驱动。Correspondingly, the driver of the input device includes a hardware touch component driver and/or a text input driver.

上述申请中的一个可选实施方式，通过将触控组件、操作指令以及输入设备的驱动进行细化，从而实现了通过硬件触控组件和/或软件触控组件，对附属设备进行事件操作控制和/或文本输入控制，同时丰富了主控设备与附属设备之间的交互方式和交互内容。In an optional embodiment of the above application, by refining the touch control components, operation instructions and the drive of the input device, the event operation control of the auxiliary equipment is realized through the hardware touch control components and/or software touch components and/or text input control, while enriching the interaction mode and interaction content between the main control device and the auxiliary device.

通过所述硬件触控组件驱动，从所述指令空间中获取所述操作事件的控制字符指令，并根据所述控制字符指令更新附属应用显示界面中的当前焦点；和/或，Driven by the hardware touch component, obtain the control character instruction of the operation event from the instruction space, and update the current focus in the display interface of the attached application according to the control character instruction; and/or,

通过所述文本输入驱动，从所述指令空间中获取所述输入文本的文本字符指令，并根据所述文本字符指令，控制附属应用从当前焦点开始显示所述输入文本。Through the text input driver, a text character instruction of the input text is obtained from the instruction space, and according to the text character instruction, the attached application is controlled to display the input text from the current focus.

上述申请中的一个可选实施方法，通过将对输入指令的访问响应操作，细化为通过硬件触控组件驱动，更新附属应用显示界面中的焦点位置，和/或，通过文本输入驱动，实现对附属应用中的文本输入控制，进一步完善了主控设备对附属设备进行控制时的控制机制。An optional implementation method in the above-mentioned application, through the access response operation to the input command, is refined to be driven by a hardware touch component to update the focus position in the display interface of the auxiliary application, and/or, driven by text input, to achieve For the text input control in the auxiliary application, the control mechanism when the main control device controls the auxiliary device is further improved.

可选的，接收主控设备发送的操作指令，包括：Optionally, receive operation instructions sent by the master device, including:

通过接收应用接收所述主控设备的传输应用发送的操作指令。The operation instruction sent by the transmission application of the master device is received by the receiving application.

上述申请中的一个可选实施方式，通过附属设备中的接收应用接收主控设备的传输应用发送的操作指令，从而完善了主控设备与附属设备之间的数据交互方式。In an optional embodiment of the above application, the operation instruction sent by the transmission application of the main control device is received by the receiving application in the auxiliary device, thereby improving the data interaction mode between the main control device and the auxiliary device.

可选的，在通过接收应用接收所述主控设备的传输应用发送的操作指令之后，在向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令之前，所述方法还包括：Optionally, after receiving the operation instruction sent by the transmission application of the master control device through the receiving application, before writing the input instruction corresponding to the operation instruction in the instruction space of the input device corresponding to the operation instruction. , the method also includes:

基于安卓开放附件AOA协议，解析所述操作指令。Based on the Android Open Accessory AOA protocol, the operation instruction is parsed.

上述申请中的一个可选实施方式，通过AOA协议解析操作指令，并根据解析结果确定对应的输入设备，完善了主控设备与附属设备之间的通信机制。In an optional embodiment of the above application, the operation instruction is parsed through the AOA protocol, and the corresponding input device is determined according to the analysis result, which improves the communication mechanism between the main control device and the auxiliary device.

可选的，向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令，包括：Optionally, write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, including:

根据所述操作指令，确定对应的输入设备；According to the operation instruction, determine the corresponding input device;

根据所述操作指令，构建输入指令；According to the operation instruction, construct the input instruction;

向所述输入设备的指令空间中写入所述输入指令。The input instruction is written into the instruction space of the input device.

上述申请中的一个可选实施方式，通过将输入指令在指令空间的写入操作，细化为根据操作指令确定对应的输入设备并构建输入指令；向输入设备的指令空间中写入输入指令，完善了输入设备的确定机制和输入指令的写入机制，为不同输入设备的不同输入指令的区分提供保障。In an optional embodiment of the above application, the writing operation of the input instruction in the instruction space is refined to determine the corresponding input device according to the operation instruction and construct the input instruction; write the input instruction into the instruction space of the input device, The determination mechanism of the input device and the writing mechanism of the input command are improved, which provides a guarantee for the distinction of different input commands of different input devices.

可选的，所述主控设备为车机；所述附属设备为车载设备。Optionally, the main control device is an in-vehicle device; the auxiliary device is an in-vehicle device.

上述申请中的一个可选实施方式，通过将主控设备细化为车机，将附属设备细化为车载设备，从而实现了通过车机对车载设备的泛化控制，为用户对车载设备的控制提供了便利，同时通过用户对车机中的触控组件进行操作，即可实现对车载设备的泛化控制，提升了用户的操作感。In an optional embodiment of the above application, by subdividing the main control device into an on-board device and subdivided into an on-board device, the generalized control of the on-board device through the on-board device is realized, and the user's control of the on-board device is improved. The control provides convenience, and at the same time, by operating the touch components in the vehicle, the generalized control of the vehicle equipment can be realized, which improves the user's sense of operation.

第二方面，本申请实施例还提供了一种设备交互方法，由主控设备执行，包括：In a second aspect, the embodiments of the present application also provide a device interaction method, which is executed by a master control device, including:

响应于用户对触控组件的触控操作，生成操作指令；In response to a user's touch operation on the touch component, generating an operation instruction;

将所述操作指令发送至附属设备，以使所述附属设备向所述操作指令对应的输入设备的指令空间中写入与所述操作指令对应的输入指令，并通过输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。Send the operation instruction to the accessory device, so that the accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and writes the input instruction corresponding to the operation instruction through the drive of the input device. Access and respond to the input command in the command space to control the accessory device.

第三方面，本申请实施例还提供了一种设备交互装置，配置于附属设备，包括：In a third aspect, an embodiment of the present application further provides a device interaction device, which is configured on an accessory device and includes:

操作指令接收模块，用于接收主控设备发送的操作指令；其中，所述操作指令由主控设备响应于用户对触控组件的触控操作生成；an operation instruction receiving module, configured to receive an operation instruction sent by the main control device; wherein, the operation instruction is generated by the main control device in response to a user's touch operation on the touch control component;

输入指令写入模块，用于向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令；an input instruction writing module, configured to write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction;

附输入指令响应模块，用于从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。An attached input instruction response module is used to access and respond to the input instruction from the instruction space, so as to control the attached device.

第四方面，本申请实施例还提供了一种设备交互装置，配置于主控设备，包括：In a fourth aspect, an embodiment of the present application further provides a device interaction device, which is configured on the main control device and includes:

操作指令生成模块，用于响应于用户对触控组件的触控操作，生成操作指令；an operation instruction generation module, configured to generate an operation instruction in response to a user's touch operation on the touch control component;

操作指令发送模块，用于将所述操作指令发送至附属设备，以使所述附属设备向所述操作指令对应的输入设备的指令空间中写入与所述操作指令对应的输入指令，并通过输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。The operation instruction sending module is used to send the operation instruction to the accessory device, so that the accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and passes the input instruction corresponding to the operation instruction. The driver of the input device accesses and responds to the input command from the command space to control the accessory device.

第五方面，本申请实施例还提供了一种附属设备，包括：In a fifth aspect, an embodiment of the present application also provides an accessory device, including:

至少一个处理器；以及at least one processor; and

与所述至少一个处理器通信连接的存储器；其中，a memory communicatively coupled to the at least one processor; wherein,

所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行第一方面实施例所提供的一种设备交互方法。The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can execute the device provided by the embodiment of the first aspect interactive method.

第六方面，本申请实施例还提供了一种主控设备，包括：In a sixth aspect, an embodiment of the present application further provides a main control device, including:

至少一个处理器；以及at least one processor; and

所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行第二方面实施例所提供的一种设备交互方法。The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can execute the device provided by the embodiment of the second aspect interactive method.

第七方面，本申请实施例还提供了一种交互系统，包括：In a seventh aspect, an embodiment of the present application also provides an interactive system, including:

主控设备和附属设备；main control equipment and auxiliary equipment;

所述主控设备响应于用户对触控组件的触控操作，生成操作指令，并将所述操作指令发送至附属设备；The main control device generates an operation instruction in response to a user's touch operation on the touch control component, and sends the operation instruction to the accessory device;

所述附属设备向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令，并通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。The accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and accesses and responds to the input from the instruction space through the drive of the input device instructions to control the accessory device.

第八方面，本申请实施例还提供了一种存储有计算机指令的非瞬时计算机可读存储介质，所述计算机指令用于使所述计算机执行第一方面实施例或第二方面实施例所提供的一种设备交互方法。In an eighth aspect, embodiments of the present application further provide a non-transitory computer-readable storage medium storing computer instructions, where the computer instructions are used to cause the computer to execute the first aspect or the second aspect. a device interaction method.

上述可选方式所具有的其他效果将在下文中结合具体实施例加以说明。Other effects of the above-mentioned optional manners will be described below with reference to specific embodiments.

附图说明Description of drawings

附图用于更好地理解本方案，不构成对本申请的限定。其中：The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present application. in:

图1是本申请实施例一中的一种设备交互方法的流程图；FIG. 1 is a flowchart of a device interaction method in Embodiment 1 of the present application;

图2是本申请实施例二中的一种设备交互方法的流程图；FIG. 2 is a flowchart of a device interaction method in Embodiment 2 of the present application;

图3是本申请实施例三中的一种设备交互方法的流程图；3 is a flowchart of a device interaction method in Embodiment 3 of the present application;

图4是本申请实施例四中的一种设备交互方法的流程图；4 is a flowchart of a device interaction method in Embodiment 4 of the present application;

图5A是本申请实施例五中的一种设备交互方法的流程图；5A is a flowchart of a device interaction method in Embodiment 5 of the present application;

图5B是本申请实施例五中的一种车机与车载设备操作交互示意图；FIG. 5B is a schematic diagram of the operation interaction between a vehicle and vehicle equipment in Embodiment 5 of the present application;

图6是本申请实施例六中的一种设备交互装置的结构图；6 is a structural diagram of a device interaction apparatus in Embodiment 6 of the present application;

图7是本申请实施例七中的一种设备交互装置的结构图；7 is a structural diagram of a device interaction apparatus in Embodiment 7 of the present application;

图8是用来实现本申请实施例的设备交互方法的电子设备的框图；8 is a block diagram of an electronic device used to implement the device interaction method according to the embodiment of the present application;

图9是本申请实施例九中的一种设备交互系统的结构示意图。FIG. 9 is a schematic structural diagram of a device interaction system in Embodiment 9 of the present application.

具体实施方式Detailed ways

以下结合附图对本申请的示范性实施例做出说明，其中包括本申请实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本申请的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present application are described below with reference to the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

实施例一Example 1

图1是本申请实施例一中的一种设备交互方法的流程图。本申请实施例适用于在主控设备与附属设备交互过程中，通过主控设备对附属设备进行控制的情况，该方法由设备交互装置执行，该装置通过软件和/或硬件实现，并具体配置于附属设备中。FIG. 1 is a flowchart of a device interaction method in Embodiment 1 of the present application. The embodiment of the present application is applicable to the case where the main control device controls the auxiliary device during the interaction between the main control device and the auxiliary device, the method is executed by the device interaction device, the device is realized by software and/or hardware, and the specific configuration is in ancillary equipment.

如图1所示的一种设备交互方法，包括：A device interaction method, as shown in Figure 1, includes:

S101、接收主控设备发送的操作指令；其中，所述操作指令由主控设备响应于用户对触控组件的触控操作生成。S101. Receive an operation instruction sent by a main control device, wherein the operation instruction is generated by the main control device in response to a user's touch operation on a touch control component.

其中，触控组件可以理解为主控设备中的输入设备，例如按键、旋钮、操作杆等硬件触控组件，或者软键盘、触摸屏中的虚拟按键等软件触控组件。The touch component can be understood as an input device in the main control device, such as hardware touch components such as buttons, knobs, and joysticks, or software touch components such as soft keyboards and virtual keys in a touch screen.

可选的，操作指令包括控制附属设备的操作事件。或者可选的，操作指令包括向附属设备中的附属应用中进行文本输入的输入文本。Optionally, the operation instruction includes an operation event for controlling the accessory device. Or alternatively, the operation instruction includes input text for text input into an accessory application in the accessory device.

示例性地，用户在主控设备的输入设备中，对触控组件进行触控操作时，主控设备响应于用户对触控组件的触控操作，生成操作指令，并将操作指令发送至附属设备。相应的，附属设备接收该操作指令。Exemplarily, when the user performs a touch operation on the touch control component in the input device of the main control device, the main control device generates an operation instruction in response to the user's touch operation on the touch control component, and sends the operation instruction to the accessory device. equipment. Correspondingly, the accessory device receives the operation instruction.

可选的，可以由附属设备的操作系统直接接收主控设备发送的操作指令。或者可选的，为了对用户直接触控附属设备所产生的操作指令和由主控设备发送的操作指令加以区分，以实现对现有附属设备的直接复用，还可以在附属设备中设置接收应用，并通过接收应用接收由主控设备发送的操作指令。Optionally, the operation instruction sent by the main control device may be directly received by the operating system of the accessory device. Or alternatively, in order to distinguish the operation instructions generated by the user directly touching the auxiliary device from the operation instructions sent by the main control device, so as to realize the direct multiplexing of the existing auxiliary devices, you can also set the receiving device in the auxiliary device. application, and receive operation instructions sent by the master device through the receiving application.

S102、向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令。S102. Write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction.

示例性地，可以根据操作指令，确定对应的输入设备；根据操作指令，构建输入指令；向输入设备的指令空间中写入输入指令。Exemplarily, the corresponding input device may be determined according to the operation instruction; the input instruction may be constructed according to the operation instruction; and the input instruction may be written into the instruction space of the input device.

具体的，根据操作指令，确定可以执行该操作指令的输入设备；根据操作指令，构建所确定的输入设备能够识别的输入指令；向所确定的指令空间中写入所构建的输入指令，从而对不同输入设备能够处理的输入指令加以区分，实现输入指令的有序存储，为主控设备对附属设备的泛化控制奠定基础。Specifically, according to the operation instruction, an input device that can execute the operation instruction is determined; according to the operation instruction, an input instruction that can be recognized by the determined input device is constructed; and the constructed input instruction is written into the determined instruction space, so as to The input commands that can be processed by different input devices are distinguished, and the orderly storage of input commands is realized, which lays the foundation for the generalized control of the auxiliary devices by the main control device.

其中，操作指令对应的输入设备可以理解为附属设备中的按键、旋钮和操纵杆等硬件输入设备，或者触摸屏虚拟按键、软键盘等软件输入设备。The input device corresponding to the operation instruction may be understood as a hardware input device such as a button, a knob, and a joystick in an accessory device, or a software input device such as a touch screen virtual button and a soft keyboard.

可以理解的是，通过将主控设备的输入设备所关联的操作指令发送至附属设备，并由附属设备向操作指令对应的附属设备的输入设备的指令空间中，写入操作指令对应的输入指令，从而实现将主控设备的输入设备的输入操作向附属设备的输入设备映射，达到主控设备的输入设备等效替代附属设备的输入设备的效果。It can be understood that, by sending the operation instruction associated with the input device of the main control device to the accessory device, the accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device of the accessory device corresponding to the operation instruction. , so that the input operation of the input device of the main control device is mapped to the input device of the auxiliary device, so as to achieve the effect that the input device of the main control device is equivalent to replacing the input device of the auxiliary device.

S103、通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。S103. Access and respond to the input instruction from the instruction space through the driver of the input device, so as to control the accessory device.

示例性地，可以通过输入设备的驱动从指令空间中访问并解析输入指令；通过输入设备的驱动将输入指令的解析结果，通过附属设备的操作系统分发至对应的附属应用中进行响应，以对附属应用进行控制。Exemplarily, the input instruction can be accessed and parsed from the instruction space through the driver of the input device; the parsing result of the input instruction can be distributed to the corresponding auxiliary application through the operating system of the auxiliary device through the driver of the input device to respond to the corresponding auxiliary application. Affiliated applications for control.

具体的，通过输入设备的驱动，从指令空间中访问输入指令，并解析该输入指令得到相应的指令与内容；将解析得到的指令和内容传递给附属设备的操作系统，通过附属设备的操作系统将解析得到的指令和内容分发至附属应用中；附属应用接收操作系统发送的指令和内容加以响应。Specifically, through the drive of the input device, the input command is accessed from the command space, and the input command is parsed to obtain the corresponding command and content; the parsed command and content are passed to the operating system of the accessory device, and the operating system of the accessory device Distribute the parsed instructions and content to the auxiliary application; the auxiliary application responds by receiving the instructions and content sent by the operating system.

可选的，输入设备的驱动可以是与硬件触控组件对应的硬件触控组件驱动；或者可选的，输入设备的驱动还可以包括软件触控组件对应的文本输入驱动等。Optionally, the driver of the input device may be a hardware touch component driver corresponding to the hardware touch component; or alternatively, the driver of the input device may further include a text input driver corresponding to the software touch component.

在本申请实施例的一种可选实施方式中，若输入设备的驱动包括硬件触控组件驱动，则通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制，可以是：通过硬件触控组件驱动，从指令空间中获取操作事件的控制字符指令，并根据控制字符指令更新附属应用显示界面中的当前焦点。采用上述方式，能够通过在主控设备中对按键、旋钮或操作杆等硬件输入设备中所执行的触控操作，更新附属设备中附属应用显示界面中的当前焦点，以便在不同焦点处对附属设备进行操作控制。In an optional implementation manner of the embodiment of the present application, if the driver of the input device includes a hardware touch component driver, the driver of the input device accesses and responds to the input instruction from the instruction space to respond to the input instruction. The control of the accessory device may be: driven by a hardware touch component, obtain the control character instruction of the operation event from the instruction space, and update the current focus in the display interface of the accessory application according to the control character instruction. With the above method, the current focus in the display interface of the subsidiary application in the subsidiary device can be updated by the touch operation performed on the hardware input device such as the button, knob or joystick in the main control device, so that the subsidiary application display interface can be updated at different focal points. equipment for operational control.

在本申请实施例的另一可选实施方式中，若输入设备的驱动包括文本输入驱动，则通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制，可以是：通过文本输入驱动，从指令空间中获取输入文本的文本字符指令，并根据文本字符指令，控制附属应用从当前焦点开始显示输入文本。其中，当前焦点为附属应用显示界面中在当前时刻对应的焦点。该焦点可以是预先默认的焦点、通过用户在附属设备的触控操作而更新的焦点，还可以是通过用户在主控设备中触控组件的触控操作而更新的焦点。In another optional implementation manner of the embodiment of the present application, if the driver of the input device includes a text input driver, the driver of the input device accesses and responds to the input instruction from the instruction space, so as to respond to the input instruction to the input device. The control of the accessory device may be: through a text input driver, the text character command of the input text is obtained from the command space, and according to the text character command, the accessory application is controlled to display the input text from the current focus. The current focus is the focus corresponding to the current moment in the display interface of the subsidiary application. The focus may be a pre-default focus, a focus updated through a user's touch operation on an accessory device, or a focus updated through a user's touch operation on a touch component in the master device.

在上述各实施例的技术方案的基础上，主控设备可以是车机，附属设备可以是车载设备，从而实现车机与车载设备之间的交互操作，以通过对车机上触控组件的触控操作，实现对车载设备的泛化控制，为用户对车载设备的控制提供了便利，同时通过用户对车机的触控组件进行操作，即可实现对车载设备的泛化控制，提升了用户的操作感。On the basis of the technical solutions of the above-mentioned embodiments, the main control device may be a vehicle device, and the auxiliary device may be an in-vehicle device, so as to realize the interactive operation between the vehicle device and the in-vehicle device. Control operation to realize generalized control of in-vehicle equipment, which provides convenience for users to control in-vehicle equipment. At the same time, by operating the touch components of the vehicle, the generalized control of in-vehicle equipment can be realized, which improves the user experience. sense of operation.

实施例二Embodiment 2

图2是本申请实施例二中的一种设备交互方法的流程图，本申请实施例在上述各实施例的技术方案的基础上，进行了优化改进。FIG. 2 is a flowchart of a device interaction method in Embodiment 2 of the present application. On the basis of the technical solutions of the foregoing embodiments, the embodiments of the present application are optimized and improved.

进一步地，将操作“接收主控设备发送的操作指令”细化为“通过接收应用接收所述主控设备的传输应用发送的操作指令”，以完善主控设备与附属设备之间的数据交互方式。Further, the operation "receive the operation instruction sent by the master control device" is refined into "receive the operation instruction sent by the transmission application of the master control device through the receiving application", so as to improve the data interaction between the master control device and the auxiliary equipment. Way.

如图2所示的一种设备交互方法，包括：A device interaction method, as shown in Figure 2, includes:

S201、通过接收应用接收所述主控设备的传输应用发送的操作指令；其中，所述操作指令由主控设备响应于用户对触控组件的触控操作生成。S201. Receive, through a receiving application, an operation instruction sent by a transmission application of the master control device; wherein the operation instruction is generated by the master control device in response to a user's touch operation on a touch control component.

示例性地，用户在主控设备的输入设备中，对触控组件进行触控操作时，主控设备响应于用户对触控组件的触控操作，生成操作指令；通过主控设备的驱动将所述操作指令发送至相应的传输应用；通过所述传输应用将所述操作指令发送至附属设备。Exemplarily, when the user performs a touch operation on the touch control component in the input device of the main control device, the main control device generates an operation instruction in response to the user's touch operation on the touch control component; The operation instruction is sent to the corresponding transmission application; the operation instruction is sent to the accessory device through the transmission application.

相应的，为了对用户直接触控附属设备所产生的操作指令和由主控设备发送的操作指令加以区分，以实现对现有附属设备的直接复用，还可以在附属设备中设置接收应用，并通过接收应用接收由主控设备的传输应用发送的操作指令。Correspondingly, in order to distinguish the operation command generated by the user directly touching the accessory device and the operation command sent by the main control device, so as to realize the direct multiplexing of the existing accessory device, the receiving application can also be set in the accessory device, And the operation instruction sent by the transmission application of the master device is received through the receiving application.

可选的，可以通过USB(Universal Serial Bus，通用串行总线)或局域网的方式，在主控设备和附属设备之间进行数据传输。Optionally, data transmission can be performed between the master device and the accessory device by means of a USB (Universal Serial Bus, Universal Serial Bus) or a local area network.

示例性地，当主控设备与附属设备基于AOA(Android Open Accessory Protocol，安卓开放附件)协议进行通信时，主控设备向附属设备发送操作指令时，会通过主控设备的驱动将操作指令发送至相应的传输应用；通过传输应用从主控设备的操作系统中，获取操作指令；基于AOA协议对操作指令进行封装，并将封装结果通过数据传输通道传输至附属设备。相应的，附属设备通过接收应用接收主控设备的传输应用发送的操作指令，基于AOA协议解析该操作指令。Exemplarily, when the master device communicates with the accessory device based on the AOA (Android Open Accessory Protocol, Android Open Accessory) protocol, when the master device sends an operation command to the accessory device, the operation command is sent through the driver of the master device. to the corresponding transmission application; obtain operation instructions from the operating system of the master device through the transmission application; encapsulate the operation instructions based on the AOA protocol, and transmit the encapsulation result to the auxiliary device through the data transmission channel. Correspondingly, the accessory device receives the operation instruction sent by the transmission application of the master device through the receiving application, and parses the operation instruction based on the AOA protocol.

需要说明的是，当主控设备与附属设备基于AOA协议进行通信时，进入配件模式，其中主控设备充当USB从机，附属设备充当USB主机并为总线供电。此时，附属设备即为安卓配件。It should be noted that when the master device and the accessory device communicate based on the AOA protocol, the accessory mode is entered, in which the master device acts as a USB slave, and the accessory device acts as a USB host and supplies power to the bus. At this point, the accessory device is an Android accessory.

S202、向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令。S202. Write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction.

示例性地，根据操作指令的解析结果，确定对应的输入设备；根据操纵指令的解析结果，构建输入设备能够识别的输入指令；向输入设备的指令空间中写入输入指令。Exemplarily, the corresponding input device is determined according to the analysis result of the operation instruction; the input instruction that can be recognized by the input device is constructed according to the analysis result of the manipulation instruction; the input instruction is written into the instruction space of the input device.

S203、通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。S203. Access and respond to the input instruction from the instruction space through the driver of the input device, so as to control the accessory device.

本申请实施例通过将接收主控设备发送的操作指令，细化为通过接收应用接收主控设备的传输应用发送的操作指令，完善了操作指令的接收方式，同时通过设置接收应用对主控设备发送的操作指令进行接收，实现了对附属设备自身产生的操作指令与主控设备产生的操作指令的区分，从而实现附属设备的复用。The embodiment of the present application improves the receiving method of the operation instruction by subdividing the operation instruction sent by the receiving main control device into receiving the operation instruction sent by the transmission application of the main control device through the receiving application. The sent operation instructions are received, which realizes the distinction between the operation instructions generated by the auxiliary equipment itself and the operation instructions generated by the main control equipment, thereby realizing the multiplexing of the auxiliary equipment.

实施例三Embodiment 3

图3是本申请实施例三中的一种设备交互方法的流程图，本申请实施例适用于在主控设备与附属设备交互过程中，通过主控设备对附属设备进行控制的情况，该方法由设备交互装置执行，该装置通过软件和/或硬件实现，并具体配置于主控设备中。3 is a flowchart of a device interaction method in Embodiment 3 of the present application. The embodiment of the present application is applicable to the case where the main control device controls the accessory device during the interaction between the main control device and the accessory device. It is executed by a device interaction apparatus, which is implemented by software and/or hardware, and is specifically configured in the main control device.

如图3所示的一种设备交互方法，包括：A device interaction method, as shown in Figure 3, includes:

S301、响应于用户对触控组件的触控操作，生成操作指令。S301. In response to a user's touch operation on the touch component, an operation instruction is generated.

示例性地，若触控组件包括硬件触控组件，则响应于用户对硬件触控组件的触控操作，生成操作指令，可以是：响应于用户对硬件触控组件的触控操作，生成控制电信号，并将所述控制电信号转化为触控数字信号；基于预设协议，将所述触控数字信号转化为操作事件，并生成包括所述操作事件的操作指令。Exemplarily, if the touch component includes a hardware touch component, generating an operation instruction in response to a user's touch operation on the hardware touch component may be: in response to a user's touch operation on the hardware touch component, generating a control electrical signals, and convert the control electrical signals into touch digital signals; based on a preset protocol, convert the touch digital signals into operation events, and generate operation instructions including the operation events.

具体的，用户对硬件触控组件进行触控操作后，通过CAN(Controller AreaNetwork，控制器局域网络)总线协议，将触控操作的报文传输至主控设备；其中，CAN总线协议中会将传输报文分为数据帧、元城镇、错误帧和过载帧等。在每一个帧中根据帧标识来区分各类型事件。例如，在车辆中通过CAN总线连接汽车内如发动机控制系统、防抱死系统级座椅调节系统等电控单元时，可以通过帧标识来区分灯光信号、旋钮信号等。其中，灯光信号的帧标识为0X555，旋钮信号的帧标识为0X566。Specifically, after the user performs a touch operation on the hardware touch component, the message of the touch operation is transmitted to the main control device through the CAN (Controller Area Network) bus protocol; Transmission messages are divided into data frames, meta-towns, error frames and overload frames. Different types of events are distinguished in each frame according to the frame ID. For example, when connecting electronic control units such as engine control systems and anti-lock braking system-level seat adjustment systems in vehicles through CAN bus, light signals, knob signals, etc. can be distinguished by frame identification. Among them, the frame ID of the light signal is 0X555, and the frame ID of the knob signal is 0X566.

当主控设备接收到CAN总线的电信号后，将控制电信号转化为触控数字信号；根据预设协议，将数字信号转换为控制系统的模拟事件，并生成包括操作事件的操作指令。其中，模拟事件即为操作事件，可以是旋钮事件及按键事件等中的至少一个。When the main control device receives the electrical signal of the CAN bus, it converts the control electrical signal into a touch digital signal; according to the preset protocol, the digital signal is converted into an analog event of the control system, and an operation command including the operation event is generated. The simulated event is an operation event, which may be at least one of a knob event and a key event.

示例性地，若所述触控组件包括软件触控组件，则响应于用户对软件触控组件的触控操作，生成操作指令，可以是：响应于用户对软件触控组件的输入操作，生成包括输入文本的操作指令。Exemplarily, if the touch control component includes a software touch control component, generating an operation instruction in response to a user's touch operation on the software touch component may be: in response to a user's input operation on the software touch component, generating an operation instruction. Contains operating instructions for entering text.

S302、将所述操作指令发送至附属设备，以使所述附属设备向所述操作指令对应的输入设备的指令空间中写入与所述操作指令对应的输入指令，并通过输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。S302. Send the operation instruction to an accessory device, so that the accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and sends the input instruction from the input device through the drive of the input device. accessing and responding to the input command in the command space to control the accessory device.

可选的，主控设备可以通过自身操作系统将操作指令发送至附属设备。Optionally, the master device may send the operation instruction to the accessory device through its own operating system.

或者可选的，为了实现对主控设备的不同功能的区分，还可以在主控设备中设置传输应用，用于根据用户对主控设备的操作，向主控设备的操作系统进行数据传输，或者在主控设备与附属设备之间进行数据传输。相应的，主控设备通过传输应用将操作指令发送至附属设备。Or optionally, in order to distinguish different functions of the main control device, a transmission application may also be set in the main control device, which is used to transmit data to the operating system of the main control device according to the user's operation on the main control device, Or data transfer between the master device and the accessory device. Correspondingly, the master device sends the operation instruction to the accessory device through the transmission application.

本申请实施例由主控设备响应于用户对触控组件的触控操作，生成操作指令；将操作指令发送至附属设备，以使附属设备向操作指令对应的输入设备的指令空间中写入与操作指令对应的输入指令，并通过输入设备的驱动从指令空间中访问并响应输入指令，以对附属设备进行控制。上述技术方案，通过在用户对主控设备中的触控组件的触控操作生成操作指令，进而基于该操作指令对附属设备加以控制，实现了在主控设备与附属设备交互过程中，通过主控设备中的触控操作，对附属设备的操作控制；同时，附属设备在响应操作指令过程中，向操控指令对应的输入设备的指令空间写入与操作指令对应的输入指令，从而实现了对不同输入设备和输入指令的区分，为附属设备的泛化输入奠定基础；通过输入设备的驱动从指令空间中进行输入指令的访问和响应，从而实现了对附属设备的泛化控制。In this embodiment of the present application, the main control device generates an operation instruction in response to the user's touch operation on the touch control component; the operation instruction is sent to the accessory device, so that the accessory device writes and writes the corresponding operation instruction into the instruction space of the input device corresponding to the operation instruction. The input command corresponding to the operation command is accessed from the command space through the driver of the input device and responds to the input command to control the attached device. In the above technical solution, an operation command is generated by the user's touch operation on the touch control component in the main control device, and then the auxiliary device is controlled based on the operation command, so that during the interaction between the main control device and the auxiliary device, the main control device and the auxiliary device are interacted. In the process of responding to the operation command, the auxiliary device writes the input command corresponding to the operation command into the command space of the input device corresponding to the manipulation command, thus realizing the control of the operation of the accessory device. The distinction between different input devices and input commands lays the foundation for generalized input of accessory devices; the access and response of input commands from the command space through the drive of input devices, thus realizing generalized control of accessory devices.

实施例四Embodiment 4

图4是本申请实施例四中的一种设备交互方法的流程图，本申请实施例在上述各实施例的技术方案的基础上，进行了优化改进。FIG. 4 is a flowchart of a device interaction method in Embodiment 4 of the present application. The embodiments of the present application are optimized and improved on the basis of the technical solutions of the foregoing embodiments.

进一步地，将操作“将所述操作指令发送至附属设备”细化为“通过主控设备的驱动将所述操作指令发送至相应的传输应用；通过所述传输应用将所述操作指令发送至附属设备”，以完善主控设备与附属设备之间的数据交互方式。Further, the operation "send the operation instruction to the auxiliary device" is refined into "send the operation instruction to the corresponding transmission application through the driving of the main control device; send the operation instruction to the corresponding transmission application through the transmission application. Auxiliary equipment" to improve the data interaction between the main control equipment and the auxiliary equipment.

如图4所示的一种设备交互方法，包括：A device interaction method, as shown in Figure 4, includes:

S401、响应于用户对触控组件的触控操作，生成操作指令。S401. In response to a user's touch operation on the touch component, generate an operation instruction.

S402、通过主控设备的驱动将所述操作指令发送至相应的传输应用。S402. Send the operation instruction to the corresponding transmission application through the driving of the main control device.

S403、通过所述传输应用将所述操作指令发送至附属设备，以使所述附属设备向所述操作指令对应的输入设备的指令空间中写入与所述操作指令对应的输入指令，并通过输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。S403. Send the operation instruction to the accessory device through the transmission application, so that the accessory device writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and sends the operation instruction through the operation instruction. The driver of the input device accesses and responds to the input command from the command space to control the accessory device.

可选的，传输应用可以是为了便于主控设备与附属设备之间进行数据传输而额外安装的应用程序。Optionally, the transmission application may be an application program additionally installed to facilitate data transmission between the master device and the accessory device.

在现有的主控设备中，在用户通过主控设备的输入设备对主控设备进行操作控制时，通常会根据自身设置的应用程序，响应于用户的输入操作，向主控设备的操作系统进行数据传输，以实现主控设备的输入设备的固有功能，如在车辆中通过旋钮操作控制灯光等。相应的，传输应用还可以通过对自身设置的应用程序的复用，实现在主控设备与附属设备之间的数据传输，以实现对附属设备的操作控制。In the existing main control device, when the user controls the main control device through the input device of the main control device, it usually responds to the user's input operation according to the application program set by itself to the operating system of the main control device. Carry out data transmission to realize the inherent function of the input device of the main control device, such as controlling the lights through knob operation in the vehicle. Correspondingly, the transmission application can also realize the data transmission between the main control device and the auxiliary device by multiplexing the application program set by itself, so as to realize the operation control of the auxiliary device.

在对传输应用进行复用时，为了避免对主控设备自身进行操作控制和对附属设备进行操作控制的混淆，可以通过传输应用的运行模式对两者加以区分。When multiplexing the transmission application, in order to avoid confusion between the operation control of the main control device itself and the operation control of the auxiliary device, the two can be distinguished by the operation mode of the transmission application.

示例性地，若传输应用处于前台运行模式，则通过主控设备的驱动将操作指令发送至相应的传输应用，从而通过传输应用将操作指令发送至附属设备。若传输应用处于后台运行模式，传输应用将会实现自身的固有功能，不会实现数据在主控设备与附属设备之间的传输。Exemplarily, if the transmission application is in the foreground running mode, the operation instruction is sent to the corresponding transmission application through the driving of the master device, so that the operation instruction is sent to the accessory device through the transmission application. If the transmission application is in the background running mode, the transmission application will realize its own inherent functions, and will not realize the transmission of data between the main control device and the auxiliary device.

可选的，通过传输应用将操作指令发送至附属设备，可以通过USB或局域网传输的方式加以实现。Optionally, the operation instruction is sent to the accessory device through the transmission application, which may be implemented by means of USB or local area network transmission.

示例性地，通过USB方式进行数据传输是，可以通过传输应用从主控设备的操作系统中，获取操作指令；基于AOA协议对操作指令进行封装；将封装结果通过数据传输通道传输至附属设备。相应的，附属设备通过接收应用接收主控设备的传输应用发送的操作指令，基于AOA协议解析该操作指令。其中，数据传输通道可以是AOA连接通道，在主控设备与附属设备通过USB进行通信连接后，在主控设备和附属设备之间建立得到。Exemplarily, for data transmission through USB, an operation instruction can be obtained from the operating system of the master device through a transmission application; the operation instruction is encapsulated based on the AOA protocol; and the encapsulation result is transmitted to the auxiliary device through a data transmission channel. Correspondingly, the accessory device receives the operation instruction sent by the transmission application of the master device through the receiving application, and parses the operation instruction based on the AOA protocol. The data transmission channel may be an AOA connection channel, which is established between the main control device and the auxiliary device after the main control device and the auxiliary device are connected via USB for communication.

本申请实施例通过将操作指令发送过程，细化为通过主控设备的驱动将操作指令发送至相应的传输应用；通过传输应用将操作指令发送至附属设备，从而完善了主控设备与附属设备之间的数据传输方式，实现了将对主控设备自身进行操作控制以及对附属设备进行操作控制的区分，避免了控制混乱现象的发生。In the embodiment of the present application, the operation instruction sending process is refined into sending the operation instruction to the corresponding transmission application through the driving of the main control device; the operation instruction is sent to the auxiliary equipment through the transmission application, thereby improving the main control equipment and auxiliary equipment. The data transmission mode between the two devices realizes the distinction between the operation control of the main control equipment itself and the operation control of the auxiliary equipment, and the occurrence of control confusion is avoided.

实施例五Embodiment 5

图5A是本申请实施例五中的一种设备交互方法的流程图，本申请实施例在上述各实施例的技术方案的基础上，提供了一种优选实施方式，以实现车机对车载设备的控制。并结合图5B所示的一种车机与车载设备操作交互示意图，进行示例性说明。FIG. 5A is a flowchart of a device interaction method in Embodiment 5 of the present application. Based on the technical solutions of the above-mentioned embodiments, the embodiments of the present application provide a preferred implementation to realize vehicle-to-vehicle device interaction. control. An exemplary description will be given in conjunction with a schematic diagram of the operation interaction between the vehicle machine and the vehicle-mounted device shown in FIG. 5B .

如图5A所示的一种设备交互方法，包括：A device interaction method as shown in FIG. 5A includes:

S501、响应于用户在车辆上的旋钮操作，生成操作信号。S501. In response to a user's operation of a knob on the vehicle, an operation signal is generated.

其中，车机旋钮为车机触控组件，充当车机的输入设备。Among them, the car-machine knob is a car-machine touch component, which acts as an input device of the car-machine.

S502、旋钮控制系统将操作信号转换为旋钮信号帧，以电信号的形式通过CAN总线传输至车机。S502, the knob control system converts the operation signal into a knob signal frame, and transmits it to the vehicle machine in the form of an electrical signal through the CAN bus.

其中，电信号是指随着时间而变换的电压或电流，旋钮操作所产生的操作信号为非电信号，此类信号可以通过传感器转换成电信号，通过时间与高低电平的配合形成电信号，来传递非电物理量。Among them, the electrical signal refers to the voltage or current that changes with time. The operation signal generated by the knob operation is a non-electrical signal. Such signals can be converted into electrical signals by sensors, and electrical signals are formed by the cooperation of time and high and low levels. , to transfer non-electrical physical quantities.

其中，CAN总线是ISO国际标准化串行通讯协议，用于连接车辆内各个电控单元(如发动机控制系统、防抱死系统和座椅调节系统等)。在CAN总线协议中会将传输报文分为数据帧、远程帧、错误帧和过载帧等。而在每一个帧中，根据帧标识(ID)来区分各类型事件，例如灯光信号帧ID为0X555，旋钮信号帧ID为0X566等。Among them, CAN bus is an ISO international standardized serial communication protocol, which is used to connect various electronic control units in the vehicle (such as engine control system, anti-lock braking system and seat adjustment system, etc.). In the CAN bus protocol, the transmission messages are divided into data frames, remote frames, error frames and overload frames. In each frame, various types of events are distinguished according to the frame identification (ID), for example, the frame ID of the light signal is 0X555, and the frame ID of the knob signal is 0X566.

S503、车机接收到CAN总线的电信号后，会将电信号转换为数字信号。S503, after receiving the electrical signal of the CAN bus, the vehicle machine converts the electrical signal into a digital signal.

S504、根据车机协议，将数字信号转化成车机系统的模拟事件。S504 , according to the vehicle-machine agreement, convert the digital signal into an analog event of the vehicle-machine system.

其中，模拟事件可以归纳为上下左右的指令，用于表征不同的操作事件，例如旋钮事件、按键事件等。Among them, the simulated events can be summarized into up, down, left, and right instructions, which are used to represent different operation events, such as knob events, button events, and the like.

S505、响应于键盘输入操作，生成输入文本。S505. In response to the keyboard input operation, generate input text.

S506、车机接收通过车机键盘的输入文本。S506, the vehicle machine receives the input text through the vehicle machine keyboard.

其中，车机键盘为车的触控组件，充当车机的输入设备。其中，传输应用处于前台运行模式。Among them, the car-machine keyboard is a touch-control component of the car, and acts as an input device of the car-machine. The transmission application is in the foreground running mode.

其中，车机键盘可以是硬键盘或软键盘。Wherein, the vehicle-machine keyboard may be a hard keyboard or a soft keyboard.

其中，S505-S506可以在S501-S505之前进行，也可以在S501-S505之后，还可以择一执行。Wherein, S505-S506 may be performed before S501-S505, or may be performed after S501-S505, or one may be performed alternatively.

S507、通过驱动与车机操作系统的转发后，将包括模拟事件和/或输入文本的操作指令分发到具体的传输应用。S507. Distribute the operation instruction including the simulated event and/or the input text to a specific transmission application after forwarding by the driver and the vehicle operating system.

S508、车机的传输应用在车机与车载设备建立AOA连接通道。S508 , the transmission application of the vehicle-mounted device establishes an AOA connection channel between the vehicle-mounted device and the vehicle-mounted device.

其中，车载设备可以是智能音箱和智能后视镜等设备。Among them, the in-vehicle devices may be devices such as smart speakers and smart rearview mirrors.

其中，S508在车机与车载设备通过USB连接时进行AOA连接通道的构建，该操作可以在基于AOA连接通道进行数据传输之前任一时刻执行。Wherein, S508 constructs the AOA connection channel when the vehicle-mounted device and the vehicle-mounted device are connected via USB, and this operation can be performed at any time before data transmission is performed based on the AOA connection channel.

S509、传输应用从操作系统中获取操作指令，封装成AOA协议数据。S509, the transmission application obtains the operation instruction from the operating system, and encapsulates it into AOA protocol data.

S510、将封装好的操作指令通过AOA连接通道传输至车载设备。S510 , transmitting the packaged operation instruction to the in-vehicle device through the AOA connection channel.

S511、车载设备的接收应用根据AOA协议解析操作指令。S511 , the receiving application of the in-vehicle device parses the operation instruction according to the AOA protocol.

S512、根据解析结果确定车载设备中的字符设备节点。S512: Determine the character device node in the vehicle-mounted device according to the analysis result.

其中，字符设备节点包括硬件触控组件驱动和文本输入驱动。例如，通过旋钮操作生成包括旋钮事件的操作指令；相应的，字符设备节点为旋钮驱动“/dev/input/event1”。The character device node includes a hardware touch component driver and a text input driver. For example, an operation instruction including a knob event is generated through a knob operation; correspondingly, the character device node is the knob driver "/dev/input/event1".

S513、根据解析结果构建字符设备节点能够识别的字符指令。S513 , constructing a character instruction that can be recognized by the character device node according to the parsing result.

如旋钮事件的操作指令对应的字符指令“1 330 1”。For example, the character command "1 330 1" corresponding to the operation command of the knob event.

S514、向字符设备节点的指令空间写入字符指令。S514, write a character instruction into the instruction space of the character device node.

如向旋钮驱动“/dev/input/event1”写入字符指令“1 330 1”，得到“/dev/input/event1 1 330 1”。For example, write the character command "1 330 1" to the knob driver "/dev/input/event1", and get "/dev/input/event1 1 330 1".

S515、字符设备驱动解析字符指令中的指令与内容。S515, the character device driver parses the instruction and content in the character instruction.

其中，解析结果包括与旋钮操作对应的交点更新指令，以及与文本输入操作对应的输入文本。The analysis result includes the intersection update instruction corresponding to the knob operation and the input text corresponding to the text input operation.

S516、将解析结果通过车载设备的操作系统，分发至车载应用。S516: Distribute the analysis result to the in-vehicle application through the operating system of the in-vehicle device.

S517、车载应用根据接收到的焦点更新指令，改变车载应用中显示界面中的当前焦点；和/或根据接收到的输入文本，在当前焦点开始显示文本内容。S517. The in-vehicle application changes the current focus in the display interface of the in-vehicle application according to the received focus update instruction; and/or starts to display text content at the current focus according to the received input text.

实施例六Embodiment 6

图6是本申请实施例六中的一种设备交互装置的结构图。本申请实施例适用于在主控设备与附属设备交互过程中，通过主控设备对附属设备进行控制的情况，该装置通过软件和/或硬件实现，并具体配置于附属设备中。FIG. 6 is a structural diagram of a device interaction apparatus in Embodiment 6 of the present application. The embodiments of the present application are applicable to the case where the main control device controls the auxiliary device during the interaction between the main control device and the auxiliary device. The device is implemented by software and/or hardware, and is specifically configured in the auxiliary device.

如图6所示的一种设备交互装置600，包括：操作指令接收模块601、输入指令写入模块602和输入指令响应模块603。其中，As shown in FIG. 6 , adevice interaction apparatus 600 includes: an operationinstruction receiving module 601 , an inputinstruction writing module 602 and an inputinstruction response module 603 . in,

操作指令接收模块601，用于接收主控设备发送的操作指令；其中，所述操作指令由主控设备响应于用户对触控组件的触控操作生成；The operationinstruction receiving module 601 is configured to receive an operation instruction sent by the main control device; wherein, the operation instruction is generated by the main control device in response to a user's touch operation on the touch control component;

输入指令写入模块602，用于向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令；The inputinstruction writing module 602 is used to write the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction;

输入指令响应模块603，用于从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。The inputcommand response module 603 is configured to access and respond to the input command from the command space, so as to control the accessory device.

本申请实施例通过操作指令接收模块接收主控设备响应于用户对触控组件的触控操作所生成的操作指令；通过输入指令写入模块向操作指令对应的输入设备的指令空间中，写入与操作指令对应的输入指令；通过输入指令响应模块从指令空间中访问并响应输入指令，以对附属设备进行控制。上述技术方案通过附属设备接收主控设备发送的操作指令，并进行响应，实现了在主控设备与附属设备交互过程中，通过在主控设备中的触控操作，对附属设备的操作控制；同时，附属设备在响应操作指令过程中，向操控指令对应的输入设备的指令空间写入与操作指令对应的输入指令，从而实现了对不同输入设备和输入指令的区分，为附属设备的泛化输入奠定基础；通过输入设备的驱动从指令空间中进行输入指令的访问和响应，从而实现了对附属设备的泛化控制。In the embodiment of the present application, the operation instruction generated by the main control device in response to the user's touch operation on the touch control component is received by the operation instruction receiving module; the operation instruction is written into the instruction space of the input device corresponding to the operation instruction through the input instruction writing module. The input command corresponding to the operation command; access and respond to the input command from the command space through the input command response module to control the accessory equipment. The above technical solution receives the operation instruction sent by the main control device through the auxiliary device, and responds, so as to realize the operation control of the auxiliary device through the touch operation in the main control device during the interaction between the main control device and the auxiliary device; At the same time, in the process of responding to the operation command, the accessory device writes the input command corresponding to the operation command into the command space of the input device corresponding to the manipulation command, thereby realizing the distinction between different input devices and input commands, which is the generalization of the accessory device. The input lays the foundation; the access and response of the input command are carried out from the command space through the driver of the input device, thereby realizing the generalized control of the auxiliary device.

进一步地，输入指令响应模块603，具体用于：Further, the inputinstruction response module 603 is specifically used for:

从所述指令空间中访问并解析输入指令；access and parse input instructions from said instruction space;

将所述输入指令的解析结果，通过所述附属设备的操作系统分发至对应的附属应用中进行响应，以对所述附属应用进行控制。The parsing result of the input instruction is distributed to the corresponding auxiliary application through the operating system of the auxiliary device to respond, so as to control the auxiliary application.

进一步地，所述触控组件包括硬件触控组件和/或软件触控组件；Further, the touch control component includes a hardware touch control component and/or a software touch control component;

相应的，输入指令响应模块603，包括硬件触控组件驱动，和/或文本输入驱动。Correspondingly, the inputinstruction response module 603 includes a hardware touch component driver and/or a text input driver.

从所述指令空间中获取所述操作事件的控制字符指令，并根据所述控制字符指令更新所述附属应用显示界面中的当前焦点；和/或，Acquire the control character instruction of the operation event from the instruction space, and update the current focus in the display interface of the auxiliary application according to the control character instruction; and/or,

从所述指令空间中获取所述输入文本的文本字符指令，并根据所述文本字符指令，控制所述附属应用从当前焦点开始显示所述输入文本。A text character instruction of the input text is obtained from the instruction space, and according to the text character instruction, the subsidiary application is controlled to display the input text from the current focus.

进一步地，操作指令接收模块601，具体用于：Further, the operationinstruction receiving module 601 is specifically used for:

接收所述主控设备的传输应用发送的操作指令。Receive an operation instruction sent by the transmission application of the master device.

进一步地，该装置还包括，操作指令解析模块，用于：Further, the device also includes an operation instruction parsing module for:

在操作指令接收模块601接收所述主控设备的传输应用发送的操作指令之后，在输入指令写入模块602向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令之前，基于安卓开放附件AOA协议，解析所述操作指令。After the operationinstruction receiving module 601 receives the operation instruction sent by the transmission application of the main control device, the inputinstruction writing module 602 writes the operation instruction corresponding to the operation instruction in the instruction space of the input device corresponding to the operation instruction Before entering the command, the operation command is parsed based on the Android Open Accessory AOA protocol.

进一步地，输入指令写入模块602，具体用于：Further, the inputinstruction writing module 602 is specifically used for:

进一步地，所述主控设备为车机；所述附属设备为车载设备。Further, the main control device is an on-board device; the auxiliary device is an on-board device.

上述设备交互装置可执行本申请任意实施例所提供的设备交互方法，具备执行设备交互方法相应的功能模块和有益效果。The above device interaction apparatus can execute the device interaction method provided by any embodiment of the present application, and has functional modules and beneficial effects corresponding to executing the device interaction method.

实施例七Embodiment 7

图7是本申请实施例七中的一种设备交互装置的结构图。本申请实施例适用于在主控设备与附属设备交互过程中，通过主控设备对附属设备进行控制的情况，该装置通过软件和/或硬件实现，并具体配置于主控设备中。FIG. 7 is a structural diagram of a device interaction apparatus in Embodiment 7 of the present application. The embodiment of the present application is applicable to the case where the main control device controls the auxiliary device during the interaction between the main control device and the auxiliary device. The device is implemented by software and/or hardware, and is specifically configured in the main control device.

如图7所示的一种设备交互装置700，包括：操作指令生成模块701和操作指令发送模块702。其中，As shown in FIG. 7 , adevice interaction apparatus 700 includes: an operationinstruction generating module 701 and an operationinstruction sending module 702 . in,

操作指令生成模块701，用于响应于用户对触控组件的触控操作，生成操作指令；An operationinstruction generation module 701, configured to generate an operation instruction in response to a user's touch operation on the touch control component;

操作指令发送模块702，用于将所述操作指令发送至附属设备，以使所述附属设备向所述操作指令对应的输入设备的指令空间中写入与所述操作指令对应的输入指令，并通过输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备进行控制。An operationinstruction sending module 702, configured to send the operation instruction to an accessory device, so that the accessory device writes an input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and The auxiliary device is controlled by accessing and responding to the input command from the command space through the driver of the input device.

本申请实施例通过操作指令生成模块响应于用户对触控组件的触控操作，生成操作指令；通过操作指令发送模块将操作指令发送至附属设备，以使附属设备向操作指令对应的输入设备的指令空间中写入与操作指令对应的输入指令，并通过输入设备的驱动从指令空间中访问并响应输入指令，以对附属设备进行控制。上述技术方案，通过在用户对主控设备中的触控组件的触控操作生成操作指令，进而基于该操作指令对附属设备加以控制，实现了在主控设备与附属设备交互过程中，通过主控设备中的触控操作，对附属设备的操作控制；同时，附属设备在响应操作指令过程中，向操控指令对应的输入设备的指令空间写入与操作指令对应的输入指令，从而实现了对不同输入设备和输入指令的区分，为附属设备的泛化输入奠定基础；通过输入设备的驱动从指令空间中进行输入指令的访问和响应，从而实现了对附属设备的泛化控制。In this embodiment of the present application, an operation instruction is generated by the operation instruction generation module in response to the touch operation of the touch control component by the user; the operation instruction is sent to the accessory device through the operation instruction sending module, so that the accessory device can send the operation instruction to the input device corresponding to the operation instruction. Input commands corresponding to the operation commands are written in the command space, and the drive of the input device is used to access and respond to the input commands from the command space, so as to control the auxiliary device. In the above technical solution, an operation command is generated by a user's touch operation on the touch control component in the main control device, and then the auxiliary device is controlled based on the operation command, so that during the interaction between the main control device and the auxiliary device, the main control device and the auxiliary device are interacted. In the process of responding to the operation command, the auxiliary device writes the input command corresponding to the operation command into the command space of the input device corresponding to the manipulation command, thereby realizing the control of the operation of the accessory device. The distinction between different input devices and input commands lays the foundation for generalized input of accessory devices; the access and response of input commands from the command space through the drive of input devices, thus realizing generalized control of accessory devices.

进一步地，操作指令发送模块702，具体用于：Further, the operationinstruction sending module 702 is specifically used for:

通过主控设备的驱动将所述操作指令发送至相应的传输应用；Send the operation instruction to the corresponding transmission application through the driving of the main control device;

通过所述传输应用将所述操作指令发送至附属设备。The operation instruction is sent to the accessory device through the transmission application.

进一步地，操作指令发送模块702，在执行通过所述传输应用将所述操作指令发送至附属设备时，具体用于：Further, when the operationinstruction sending module 702 is executed to send the operation instruction to the accessory device through the transmission application, it is specifically used for:

通过所述传输应用，从所述附属设备的操作系统中，获取所述操作指令；Obtain the operation instruction from the operating system of the accessory device through the transmission application;

基于安卓开放附件AOA协议，对所述操作指令进行封装；Based on the Android Open Accessory AOA protocol, the operation instructions are encapsulated;

将封装结果通过数据传输通道传输至所述附属设备。The encapsulation result is transmitted to the accessory device through the data transmission channel.

进一步地，该装置还包括，数据传输通道建立模块，用于：Further, the device also includes a data transmission channel establishment module for:

在将封装结果通过数据传输通道传输至所述附属设备之前，建立所述主控设备和所述附属设备的数据传输通道。Before transmitting the encapsulation result to the auxiliary device through the data transmission channel, a data transmission channel between the master device and the auxiliary device is established.

进一步地，操作指令发送模块702，在执行通过主控设备的驱动将所述操作指令发送至相应的传输应用时，具体用于：Further, when the operationinstruction sending module 702 is executed to send the operation instruction to the corresponding transmission application through the driving of the main control device, it is specifically used for:

若所述传输应用处于前台运行模式，则通过主控设备的驱动将所述操作指令发送至相应的传输应用。If the transmission application is in the foreground running mode, the operation instruction is sent to the corresponding transmission application through the driving of the main control device.

进一步地，所述触控组件包括硬件触控组件和/或软件触控组件。Further, the touch control components include hardware touch control components and/or software touch control components.

进一步地，若所述触控组件包括硬件触控组件，则操作指令生成模块701，具体用于：Further, if the touch control component includes a hardware touch control component, the operationinstruction generation module 701 is specifically used for:

响应于用户对硬件触控组件的触控操作，生成控制电信号，并将所述控制电信号转化为触控数字信号；In response to a user's touch operation on the hardware touch component, a control electrical signal is generated, and the control electrical signal is converted into a touch digital signal;

基于预设协议，将所述触控数字信号转化为操作事件，并生成包括所述操作事件的操作指令。Based on a preset protocol, the touch digital signal is converted into an operation event, and an operation instruction including the operation event is generated.

进一步地，所述操作事件包括旋钮事件和/或按键事件。Further, the operation events include knob events and/or key events.

进一步地，若所述触控组件包括软件触控组件，则则操作指令生成模块701，具体用于：Further, if the touch control component includes a software touch control component, the operationinstruction generation module 701 is specifically used for:

响应于用户对软件触控组件的输入操作，生成包括输入文本的操作指令。In response to the user's input operation on the software touch component, an operation instruction including input text is generated.

实施例八Embodiment 8

根据本申请的实施例，本申请还提供了一种电子设备和一种可读存储介质。其中，该电子设备可以是主控设备，或者还可以是附属设备。According to the embodiments of the present application, the present application further provides an electronic device and a readable storage medium. Wherein, the electronic device may be a main control device, or may also be an accessory device.

如图8所示，是实现本申请实施例的设备交互方法的电子设备的框图。电子设备旨在表示各种形式的数字计算机，诸如，膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置，诸如，个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例，并且不意在限制本文中描述的和/或者要求的本申请的实现。As shown in FIG. 8 , it is a block diagram of an electronic device implementing the device interaction method according to the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the application described and/or claimed herein.

如图8所示，该电子设备包括：一个或多个处理器801、存储器802，以及用于连接各部件的接口，包括高速接口和低速接口。各个部件利用不同的总线互相连接，并且可以被安装在公共主板上或者根据需要以其它方式安装。处理器可以对在电子设备内执行的指令进行处理，包括存储在存储器中或者存储器上以在外部输入/输出装置(诸如，耦合至接口的显示设备)上显示GUI的图形信息的指令。在其它实施方式中，若需要，可以将多个处理器和/或多条总线与多个存储器和多个存储器一起使用。同样，可以连接多个电子设备，各个设备提供部分必要的操作(例如，作为服务器阵列、一组刀片式服务器、或者多处理器系统)。图8中以一个处理器801为例。As shown in FIG. 8, the electronic device includes: one ormore processors 801, amemory 802, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or otherwise as desired. The processor may process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple electronic devices may be connected, each providing some of the necessary operations (eg, as a server array, a group of blade servers, or a multiprocessor system). Aprocessor 801 is taken as an example in FIG. 8 .

存储器802即为本申请所提供的非瞬时计算机可读存储介质。其中，所述存储器存储有可由至少一个处理器执行的指令，以使所述至少一个处理器执行本申请所提供的设备交互方法。本申请的非瞬时计算机可读存储介质存储计算机指令，该计算机指令用于使计算机执行本申请所提供的设备交互方法。Thememory 802 is the non-transitory computer-readable storage medium provided by the present application. Wherein, the memory stores instructions executable by at least one processor, so that the at least one processor executes the device interaction method provided by the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions, and the computer instructions are used to cause the computer to execute the device interaction method provided by the present application.

存储器802作为一种非瞬时计算机可读存储介质，可用于存储非瞬时软件程序、非瞬时计算机可执行程序以及模块，如本申请实施例中的设备交互方法对应的程序指令/模块(例如，附图6所示的操作指令接收模块601、输入指令写入模块602和输入指令响应模块603，或者附图7所示的操作指令生成模块701和操作指令发送模块702)。处理器801通过运行存储在存储器802中的非瞬时软件程序、指令以及模块，从而执行服务器的各种功能应用以及数据处理，即实现上述方法实施例中的设备交互方法。As a non-transitory computer-readable storage medium, thememory 802 can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the device interaction method in the embodiments of the present application (for example, appendix). The operationinstruction receiving module 601, the inputinstruction writing module 602 and the inputinstruction response module 603 shown in FIG. 6, or the operationinstruction generating module 701 and the operationinstruction sending module 702 shown in FIG. 7). Theprocessor 801 executes various functional applications and data processing of the server by running the non-transitory software programs, instructions and modules stored in thememory 802, ie, implements the device interaction method in the above method embodiments.

存储器802可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储实现设备交互方法的电子设备的使用所创建的数据等。此外，存储器802可以包括高速随机存取存储器，还可以包括非瞬时存储器，例如至少一个磁盘存储器件、闪存器件、或其他非瞬时固态存储器件。在一些实施例中，存储器802可选包括相对于处理器801远程设置的存储器，这些远程存储器可以通过网络连接至实现设备交互方法的电子设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。Thememory 802 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function; the storage data area may store data created by the use of the electronic device that implements the device interaction method, etc. . Additionally,memory 802 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, thememory 802 may optionally include memory located remotely relative to theprocessor 801, and these remote memories may be connected to the electronic device implementing the device interaction method through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

实现设备交互方法的电子设备还可以包括：输入装置803和输出装置804。处理器801、存储器802、输入装置803和输出装置804可以通过总线或者其他方式连接，图8中以通过总线连接为例。The electronic device implementing the device interaction method may further include: aninput device 803 and anoutput device 804 . Theprocessor 801 , thememory 802 , theinput device 803 and theoutput device 804 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 8 .

输入装置803可接收输入的数字或字符信息，以及产生与实现设备交互方法的电子设备的用户设置以及功能控制有关的键信号输入，例如触摸屏、小键盘、鼠标、轨迹板、触摸板、指示杆、一个或者多个鼠标按钮、轨迹球、操纵杆等输入装置。输出装置804可以包括显示设备、辅助照明装置(例如，LED)和触觉反馈装置(例如，振动电机)等。该显示设备可以包括但不限于，液晶显示器(LCD)、发光二极管(LED)显示器和等离子体显示器。在一些实施方式中，显示设备可以是触摸屏。Theinput device 803 can receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device implementing the device interaction method, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick , one or more mouse buttons, trackballs, joysticks and other input devices.Output devices 804 may include display devices, auxiliary lighting devices (eg, LEDs), haptic feedback devices (eg, vibration motors), and the like. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.

此处描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、专用ASIC(专用集成电路)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括：实施在一个或者多个计算机程序中，该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释，该可编程处理器可以是专用或者通用可编程处理器，可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令，并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described herein can be implemented in digital electronic circuitry, integrated circuit systems, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

这些计算程序(也称作程序、软件、软件应用、或者代码)包括可编程处理器的机器指令，并且可以利用高级过程和/或面向对象的编程语言、和/或汇编/机器语言来实施这些计算程序。如本文使用的，术语“机器可读介质”和“计算机可读介质”指的是用于将机器指令和/或数据提供给可编程处理器的任何计算机程序产品、设备、和/或装置(例如，磁盘、光盘、存储器、可编程逻辑装置(PLD))，包括，接收作为机器可读信号的机器指令的机器可读介质。术语“机器可读信号”指的是用于将机器指令和/或数据提供给可编程处理器的任何信号。These computational programs (also referred to as programs, software, software applications, or codes) include machine instructions for programmable processors, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages calculation program. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or apparatus for providing machine instructions and/or data to a programmable processor ( For example, magnetic disks, optical disks, memories, programmable logic devices (PLDs), including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

为了提供与用户的交互，可以在计算机上实施此处描述的系统和技术，该计算机具有：用于向用户显示信息的显示装置(例如，CRT(阴极射线管)或者LCD(液晶显示器)监视器)；以及键盘和指向装置(例如，鼠标或者轨迹球)，用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互；例如，提供给用户的反馈可以是任何形式的传感反馈(例如，视觉反馈、听觉反馈、或者触觉反馈)；并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如，作为数据服务器)、或者包括中间件部件的计算系统(例如，应用服务器)、或者包括前端部件的计算系统(例如，具有图形用户界面或者网络浏览器的用户计算机，用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如，通信网络)来将系统的部件相互连接。通信网络的示例包括：局域网(LAN)、广域网(WAN)、互联网和区块链网络。The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), the Internet, and blockchain networks.

计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other.

实施例九Embodiment 9

图9是本申请实施例九中的一种交互系统的结构示意图，该系统包括：主控设备901和附属设备902；9 is a schematic structural diagram of an interaction system in Embodiment 9 of the present application, the system includes: amain control device 901 and anauxiliary device 902;

所述主控设备901响应于用户对触控组件的触控操作，生成操作指令，并将所述操作指令发送至附属设备902；Themain control device 901 generates an operation instruction in response to a user's touch operation on the touch control component, and sends the operation instruction to theaccessory device 902;

所述附属设备902向所述操作指令对应的输入设备的指令空间中，写入与所述操作指令对应的输入指令，并通过所述输入设备的驱动从所述指令空间中访问并响应所述输入指令，以对所述附属设备902进行控制。Theaccessory device 902 writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, and accesses and responds to the instruction space through the drive of the input device. Commands are entered to control theaccessory device 902 .

进一步地，主控设备901可以执行本申请实施例所提供的一种设备交互方法；附属设备902可以执行本申请实施例所提供的另一种设备交互方法。Further, themain control device 901 may execute a device interaction method provided by the embodiment of the present application; theaccessory device 902 may execute another device interaction method provided by the embodiment of the present application.

应该理解，可以使用上面所示的各种形式的流程，重新排序、增加或删除步骤。例如，本申请中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行，只要能够实现本申请公开的技术方案所期望的结果，本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present application can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in the present application can be achieved, no limitation is imposed herein.

上述具体实施方式，并不构成对本申请保护范围的限制。本领域技术人员应该明白的是，根据设计要求和其他因素，可以进行各种修改、组合、子组合和替代。任何在本申请的精神和原则之内所作的修改、等同替换和改进等，均应包含在本申请保护范围之内。The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of this application shall be included within the protection scope of this application.